A framework for the long-term planning of infrastructure based on flexibility

This dissertation presents a framework for the long-term planning of infrastructure subject to conditions of deep uncertainty based on the concept of flexibility. The proposed framework combines ideas and methodologies from two fields that have evolved mostly separately from each other: decision-mak...

Full description

Autores:
Torres Rincón, Samuel Fernando
Tipo de recurso:
Doctoral thesis
Fecha de publicación:
2024
Institución:
Universidad de los Andes
Repositorio:
Séneca: repositorio Uniandes
Idioma:
eng
OAI Identifier:
oai:repositorio.uniandes.edu.co:1992/74927
Acceso en línea:
https://hdl.handle.net/1992/74927
Palabra clave:
Flexibility
Adaptability
Deep uncertainty
Infrastructure
Ingeniería
Rights
openAccess
License
Attribution-NonCommercial-NoDerivatives 4.0 International
id UNIANDES2_e6b34bf6cc150df338cd70153cb77456
oai_identifier_str oai:repositorio.uniandes.edu.co:1992/74927
network_acronym_str UNIANDES2
network_name_str Séneca: repositorio Uniandes
repository_id_str
dc.title.eng.fl_str_mv A framework for the long-term planning of infrastructure based on flexibility
title A framework for the long-term planning of infrastructure based on flexibility
spellingShingle A framework for the long-term planning of infrastructure based on flexibility
Flexibility
Adaptability
Deep uncertainty
Infrastructure
Ingeniería
title_short A framework for the long-term planning of infrastructure based on flexibility
title_full A framework for the long-term planning of infrastructure based on flexibility
title_fullStr A framework for the long-term planning of infrastructure based on flexibility
title_full_unstemmed A framework for the long-term planning of infrastructure based on flexibility
title_sort A framework for the long-term planning of infrastructure based on flexibility
dc.creator.fl_str_mv Torres Rincón, Samuel Fernando
dc.contributor.advisor.none.fl_str_mv Sánchez Silva, Edgar Mauricio
dc.contributor.author.none.fl_str_mv Torres Rincón, Samuel Fernando
dc.contributor.jury.none.fl_str_mv Medaglia González, Andrés L.
Gómez Castro, Camilo Hernando
Damnjanovic, Iván
Bastidas Arteaga, Edgar Emilio
dc.contributor.researchgroup.none.fl_str_mv Facultad de Ingeniería::Geomateriales y Sistemas de Infraestructura
dc.subject.keyword.eng.fl_str_mv Flexibility
Adaptability
Deep uncertainty
Infrastructure
topic Flexibility
Adaptability
Deep uncertainty
Infrastructure
Ingeniería
dc.subject.themes.spa.fl_str_mv Ingeniería
description This dissertation presents a framework for the long-term planning of infrastructure subject to conditions of deep uncertainty based on the concept of flexibility. The proposed framework combines ideas and methodologies from two fields that have evolved mostly separately from each other: decision-making under deep uncertainty (DMDU) and flexibility analysis. Concretely, existing DMDU methods do not consider technical options for the adaptation of infrastructure systems, while the complex issue of deep uncertainty has been overlooked in most flexibility analysis approaches. This work aims to address this gap by presenting a design framework that explicitly considers technical options that enable adaptations to the system and tests their performance under a diverse set of external conditions to account for the deep uncertainty ever present in long-term planning.  In particular, the proposed framework combines exploratory modeling with reinforcement learning to find policies that are robust over many different futures. The framework also introduces a quantitative measure of flexibility that characterizes the adaptation potential using a vector in $\mathbb{R}^{2}$. Combined with the results from the exploratory modeling simulations, this representation can be used to determine the value provided by flexibility. In addition to the technical options that enable flexibility, the framework also considers different policies that control the adaptation of the system depending on the evolution of the uncertain conditions and the stakeholders' preferences.  The framework utilizes multiple models for the system and the environment to consider both internal and external uncertainty. Using a scenario generator, it simulates the interaction between the system and several external conditions to produce various economic and technical outcomes. Based on these outcomes, potential designs and policies are identified; then, using scenario discovery methods, it finds subsets of environmental conditions that cause these policies to fail. Next, it uses reinforcement learning to improve upon these policies, first under the challenging environments and later under the full ensemble of conditions. The purpose is to understand the limitations of the options as well as find key features that could be used to devise new and more robust policies and designs.  Two examples are used to demonstrate the framework. The first case considers a sea-dike under uncertainty of rising sea level. The objective is to find the design and adaptation policies that fulfill strict safety criteria while keeping costs low. Several flexible and non-flexible design options are analyzed; each flexible option is represented by an initial and a maximum height, while the non-flexible options keep their particular size constant. The results show that the staggered expansion of the dike can provide economic benefits without affecting the reliability of the structure.
publishDate 2024
dc.date.accessioned.none.fl_str_mv 2024-08-02T19:34:23Z
dc.date.available.none.fl_str_mv 2024-08-02T19:34:23Z
dc.date.issued.none.fl_str_mv 2024-05-31
dc.type.none.fl_str_mv Trabajo de grado - Doctorado
dc.type.driver.none.fl_str_mv info:eu-repo/semantics/doctoralThesis
dc.type.version.none.fl_str_mv info:eu-repo/semantics/acceptedVersion
dc.type.coar.none.fl_str_mv http://purl.org/coar/resource_type/c_db06
dc.type.content.none.fl_str_mv Text
dc.type.redcol.none.fl_str_mv https://purl.org/redcol/resource_type/TD
format http://purl.org/coar/resource_type/c_db06
status_str acceptedVersion
dc.identifier.uri.none.fl_str_mv https://hdl.handle.net/1992/74927
dc.identifier.doi.none.fl_str_mv 10.57784/1992/74927
dc.identifier.instname.none.fl_str_mv instname:Universidad de los Andes
dc.identifier.reponame.none.fl_str_mv reponame:Repositorio Institucional Séneca
dc.identifier.repourl.none.fl_str_mv repourl:https://repositorio.uniandes.edu.co/
url https://hdl.handle.net/1992/74927
identifier_str_mv 10.57784/1992/74927
instname:Universidad de los Andes
reponame:Repositorio Institucional Séneca
repourl:https://repositorio.uniandes.edu.co/
dc.language.iso.none.fl_str_mv eng
language eng
dc.relation.references.none.fl_str_mv Samuel Torres and Mauricio Sánchez-Silva. “Review of Flexibility Measures for the Design and Operation of Infrastructure”. In: Proceedings of the Sixth International Symposium on Reliability Engineering and Risk Management (Singapore). Ed. by X.D. Qian, S.D. Pang, G.P. Ong, and K.K. Phoon Phoon. Research Publishing, 31 May–1 June 2018, pp. 531–536.
Samuel Torres and Mauricio Sánchez-Silva. “A discussion on the need for flexibility in infrastructure development”. In: Life Cycle Analysis and Assessment in Civil Engineering: Towards an Integrated Vision (Ghent, Belgium). Ed. by Robby Caspeele, Luc Taerwe, and Dan Frangopol. CRC Press, Oct. 2018, pp. 907–914.
Samuel Torres-Rincón, Mauricio Sánchez-Silva, and Daniel F. Villarraga. “Incorporating Flexibility in Life-cycle Analysis of Infrastructure”. In: Towards a Resilient Built Environment- Risk and Asset Management (Guimaraes, Portugal). Ed. by IABSE. Curran Associates, Mar. 2019, pp. 841–848.
Samuel Torres-Rincón, Mauricio Sánchez-Silva, and Daniel F. Villarraga. “A Multistage Stochastic Model for the Management of Flexibility in Infrastructure Systems”. In: Proceedings of the 13th International Conference on Applications of Statistics and Probability in Civil Engineering(ICASP13) (Seoul,South Korea). May 2019, pp. 481–488.
Samuel Torres-Rincón, Daniel Francisco Villarraga, and Mauricio Sánchez Silva. “Conceptual and Numerical Analysis of Flexibility in Infrastructure Systems”. In: Journal of Infrastructure Systems 26.2 (2020), p. 04020012.
Samuel Torres-Rincón, Mauricio Sánchez-Silva, and Emilio Bastidas-Arteaga. “A multistage stochastic program for the design and management of flexible infrastructure networks”. In: Reliability engineering & system safety 210 (2021), p. 107549.
Samuel Torres-Rincón, Emilio Bastidas-Arteaga, and Mauricio Sánchez-Silva. “A flexibility-based approach for the design and management of floating off shore wind farms”. In: Renewable Energy 175 (2021), pp. 910–925.
Samuel Torres-Rincón and Mauricio Sánchez-Silva. “A Reinforcement Learning-based Approach for the Design and Management of Flexible Engineering Assets under Deep Uncertainty”. In: In preparation (In prep.).
Dan Guo, Ming Shan, and Emmanuel Kingsford Owusu. “Resilience Assessment Frameworks of Critical Infrastructures: State-of-the-Art Review”. In:Buildings 11.10 (2021), p. 464.
Adel Mottahedi, Farhang Sereshki, Mohammad Ataei, Ali Nouri Qarahasanlou, and Abbas Barabadi. “The Resilience of Critical Infrastructure Systems: A Systematic Literature Review”. In: Energies 14.6 (2021), p. 1571.
Krishna B Khatri. “Current State and Future Direction for Building Resilient Water Resources and Infrastructure Systems”. In: Eng 3.1 (2022), pp. 175 195.
Warren E. Walker, Marjolijn Haasnoot, and Jan H. Kwakkel. “Adapt or Perish: A Review of Planning Approaches for Adaptation under Deep Uncertainty”. In: Sustainability 5.3 (2013), pp. 955–979.
ASCE. Climate-Resilient Infrastructure. Ed. by Bilal M. Ayyub. American Society of Civil Engineers, 2018.
Myles R. Allen and William J. Ingram. “Constraints on future changes in climate and the hydrologic cycle”. In: Nature 419.6903 (Sept. 2002), pp. 224 232.
David R.Easterling, Gerald A. Meehl, Camille Parmesan, Stanley A. Changnon, Thomas R. Karl, and Linda O. Mearns. “Climate Extremes: Observations,Modeling, and Impacts”. In: Science 289.5487 (Sept. 22, 2000), pp. 2068 2074.
Xuebin Zhang, Hui Wan, Francis W. Zwiers, Gabriele C. Hegerl, and Seung Ki Min. “Attributing Intensification of Precipitation Extremes to Human Influence”. In: Geophysical Research Letters 40.19 (Oct. 16, 2013), pp. 5252 5257.
Stephanie C. Herring, Nikolaos Christidis, Andrew Hoell, Martin P. Hoerling, and Peter A. Stott. “Explaining Extreme Events of 2017 from a Climate Perspective”. In: Bulletin of the American Meteorological Society 100.1 (2019), S1–S117.
Geert Jan Van Oldenborgh, Karin Van Der Wiel, Antonia Sebastian, Roop Singh, Julie Arrighi, Friederike Otto, Karsten Haustein, Sihan Li, Gabriel Vecchi, and Heidi Cullen. “Attribution of Extreme Rainfall from Hurricane Harvey, August 2017”. In: Environmental Research Letters 12.12 (Dec. 1, 2017), p. 124009.
Nikhil Kumar, Vikas Poonia, B.B. Gupta, and Manish Kumar Goyal. “A novel framework for risk assessment and resilience of critical infrastructure towards climate change”. In: Technological Forecasting and Social Change 165 (2021), p. 120532.
IPCC. Climate Change 2022: Impacts, Adaptation and Vulnerability. Summary for Policymakers. Cambridge, UK and New York, USA: Cambridge University Press, 2022, pp. 3–33.
Roger B Street and Carin Nilsson. “Introduction to the Use of Uncertainties to Informa Adaptation Decisions”. In: Adapting to an Uncertain Climate: Lessons From Practice. Ed. by Tiago Capela, Ana Rovisco, Annemarie Groot, Carin Nilsson, Hans-Martin Füssel, Leendert van Bree, and Roger B Street. Springer, 2014. Chap. 1, pp. 1–16.
Muriel C. Bonjean Stanton and Katy Roelich. “Decision Making under Deep Uncertainties: A Review of the Applicability of Methods in Practice”. In: Technological Forecasting and Social Change 171 (Oct. 2021), p. 120939.
Tyson R. Browning and Eric C. Honour. “Measuring the Life-Cycle Value of Enduring Systems”. In: Syst Eng 11.3 (2008), pp. 187–202.
Filip Babovic, Ana Mijic, and Kaveh Madani. “Decision Making under Deep Uncertainty for Adapting Urban Drainage Systems to Change”. In: Urban Water Journal 15.6 (July 3, 2018), pp. 552–560.
Mauricio Sánchez-Silva. “Managing Infrastructure Systems through Changeability”. In: Journal of Infrastructure Systems 25.1 (2019), p. 04018040.
Robert J. Lempert, Steven W. Popper, and Steven C. Bankes. Shaping the next One Hundred Years: New Methods for Quantitative, Long-Term Policy Analysis. Santa Monica, CA: RAND, 2003. 187 pp. [35] Shirin Malekpour, Warren E. Walker, Fjalar J. De Haan, Niki Frantzeskaki, and Vincent A.W.J. Marchau. “Bridging Decision Making under Deep Uncertainty (DMDU) and Transition Management (TM) to Improve Strategic Planning for Sustainable Development”. In: Environmental Science & Policy 107 (May 2020), pp. 158–167.
Vincent A W J Marchau,Warren E Walker,Peter J T M Bloemen,and Steven W Popper. “Introduction”. In: Decision Making under Deep Uncertainty: From Theory to Practice. Ed. by Vincent A W J Marchau, Warren E Walker, Peter J T M Bloemen, and Steven W Popper. Springer, 2019. Chap. 1, pp. 122.
Jerrel R Yzer, Warren E Walker, Vincent A W J Marchau, and Jan H Kwakkel. “Dynamic Adaptive Policies: A Way to Improve the Cost—Benefit Performance of Megaprojects?” In: Environment and Planning B: Planning and Design 41.4 (Aug. 2014), pp. 594–612.
Enayat A. Moallemi, Sondoss Elsawah, and Michael J. Ryan. “Robust Decision Making and Epoch–Era Analysis: A Comparison of Two Robustness Frameworks for Decision-Making under Uncertainty”. In: Technological Forecasting and Social Change 151 (Feb. 2020), p. 119797.
ASCE. Adapting Infrastructure and Civil Engineering Practice to a Changing Climate. Ed. by J. Rolf Olsen. American Society of Civil Engineers, 2015.
Samuel A. Markolf, Christopher Hoehne, Andrew Fraser, Mikhail V. Chester, and B. Shane Underwood. “Transportation resilience to climate change and extreme weather events– Beyond risk and robustness”. In: Transport Policy 74 (2019), pp. 174–186.
Marie Buhl and S. Markolf. “A review of emerging strategies for incorporating climate change considerations into infrastructure planning, design, and decision making”. In: Sustainable and Resilient Infrastructure 8.sup1 (2023), pp. 157–169.
Richard De Neufville and Stefan Scholtes. Flexibility in Engineering Design. English. 2011.
Mohammad Mortazavi-Naeini, George Kuczera, and Lijie Cui. “Application of multiobjective optimization to scheduling capacity expansion of urban water resource systems”. In: Water Resources Research 50 (2014), pp. 4624-4642.
Caetano C.S. Fraga, Josué Medellín-Azuara, and Guilherme F Marques. “Planning for infrastructure capacity expansion of urban water supply portfolios with an integrated simulation-optimization approach”. In: Sustainable Cities and Society 29 (2017), pp. 247–256.
Tohid Erfani, Kevis Pachos, and Julien J. Harou. “Real-Options Water Supply Planning: Multistage Scenario Trees for Adaptive and Flexible Capacity Expansion Under Probabilistic Climate Change Uncertainty”. In: Water Resources Research 54 (2018), pp. 5069–5087.
Mikhail V Chester and Braden Allenby. “Toward adaptive infrastructure: flexibility and agility in a non-stationarity age”. In: Sustainable and Resilient Infrastructure 4.4 (2019), pp. 173–191.
Richard DeNeufville. “Real Options: Dealing With Uncertainty in Systems Planning and Design”. In: Integrated Assessment 4.1 (2003), pp. 26–34.
Ernst Fricke and Armin P Schulz. “Design for Changeability (DfC): Principies To Enable Changes in Systems Throughout Their Entire Lifecycle”. In: Systems Engineering 8.4 (2005), pp. 342–359.
Michel-Alexandre Cardin, Mehdi Ranjbar-Bourani, and Richard De Neufville. “Improving the Lifecycle Performance of Engineering Projects with Flexible Strategies: Example of On-Shore LNG Production Design”. In: Systems Engineering 18.3 (2015), pp. 253–268.
Joseph H Saleh, Gregory Mark, and Nicole C Jordan. “Flexibility : a multidisciplinary literature review and a research”. In: Journal of Engineering Design 20.3 (2009), pp. 307–323.
Amro Nasr, Oskar Larsson Ivanov, Ivar Björnsson, and Dániel Honfi. “Towards a Conceptual Framework for Built Infrastructure Design in an Uncertain Climate: Challenges and Research Needs”. In: Sustainability 13 (2021), p. 11827.
Jingke Hong, Geoffrey Qiping Shen, Yong Feng, William Sin-tong Lau, and Chao Mao. “Greenhouse gas emissions during the construction phase of a building: a case study in China”. In: Journal of Cleaner Production 103 (2015). Carbon Emissions Reduction: Policies, Technologies, Monitoring, Assessment and Modeling, pp. 249–259.
Robert Lempert, Nebojsa Nakicenovic, Daniel Sarewitz, and Michael Schlesinger. “Characterizing Climate-Change Uncertainties for Decision-Makers. An Editorial Essay”. In: Climatic Change 65.1/2 (July 2004), pp. 1–9.
Casey Helgeson. “Structuring Decisions Under Deep Uncertainty”. In: Topoi 39.2 (Apr. 2020), pp. 257–269.
Kim Smet. “Engineering Options: A Proactive Planning Approach for Aging Water Resource Infrastructure Under Uncertainty”. PhD thesis. Harvard University, 2017.
Richard de Neufville and Kim Smet. “Enginnering Options Analysis (EOA)”. In: Decision Making under Deep Uncertainty: From Theory to Practice. Ed. by Vincent A W J Marchau, Warren E Walker, Peter J T M Bloemen, and Steven W Popper. Springer, 2019. Chap. 6, pp. 117–132.
Xian Yeow Lee, Aditya Balu, Daniel Stoecklein, Baskar Ganapathysubramanian, and Soumik Sarkar. “A Case Study of Deep Reinforcement Learning for Engineering Design: Application to Microfluidic Devices for Flow Sculpting”. In: Journal of Mechanical Design 141.11 (Nov. 1, 2019), p. 111401.
A.T.D.Perera, P.U. Wickramasinghe, Vahid M. Nik, and Jean-Louis Scartezzini. “Introducing Reinforcement Learning to the Energy System Design Process”. In: Applied Energy 262 (Mar. 2020), p. 114580.
Cesare Caputo and Michel-Alexandre Cardin. “Analyzing Real Options and Flexibility in Engineering Systems Design Using Decision Rules and Deep Reinforcement Learning”. In: Journal of Mechanical Design 144.2 (Feb. 1, 2022), p. 021705.
Sergio Hernández-García, Alfredo Cuesta-Infante, José Ángel Moreno-SanSegundo, and Antonio S. Montemayor. “Deep Reinforcement Learning for Automated Search of Model Parameters: Photo-Fenton Wastewater Disinfection Case Study”. In: Neural Computing and Applications 35.2 (Jan. 2023), pp. 1379-1394.
B. Flyvbjerg, A. Ansar, A. Budzier, S. Buhl, C. Cantarelli, M. Garbuio, C. Glenting, Holm S., D. Lovallo, D. Lunn, E. Molin, A. Rønnest, A. Stewart, and B. Weeh. “Five things you should know about cost overrun”. In: Transport Research Part A: Policy and Practice 118 (2018), pp. 174–190.
Berry Gersonius, Richard Ashley, Assela Pathirana, and Chris Zevenbergen. “Climate change uncertainty: Building flexibility into water and flood risk infrastructure”. In: Climate Change 116.2 (2013), pp. 411–423.
Ioannis Nicolaos Kessides. Reforming infrastructure: Privatization, regulation, and competition. World Bank Publications, 2004.
Enrico Zio. “Challenges in the vulnerability and risk analysis of critical infrastructures”. In: Reliability Engineering & System Safety 152 (2016), pp. 137-150.
RonaldInglehart. Modernization and Postmodernization: Cultural, Economic, and Political Change in 43 Societies. Princeton University Press, 1997.
Mark R Montgomery, National Research Council, et al. Cities transformed: demographic change and its implications in the developing world. Tech. rep. National Academy Press, 2003.
Dov Friedlander. “Demographic responses and population change”. In: Demography 6.4 (1969), pp. 359–381.
David Lam. “How the world survived the population bomb: Lessons from 50 years of extraordinary demographic history”. In: Demography 48.4 (2011), pp. 1231–1262.
OU Qiong. “A brief introduction to perception”. In: Studies in literature and language 15.4 (2017), pp. 18–28.
Calvin Clark, Patricia Mokhtarian, Giovanni Circella, and Kari Watkins. “User preferences for bicycle infrastructure in communities with emerging cycling cultures”. In: Transportation research record 2673.12 (2019), pp. 89-102.
Peter Ester, Ludwig Braun, and Peter Mohler. Globalization, Value Change and Generations: a cross-national and intergenerational perspective. Vol. 10. Brill, 2006.
M.D. Gerst, P. Wang, and M.E. Borsuk. “Discovering Plausible Energy and Economic Futures under Global Change Using Multidimensional Scenario Discovery”. In: Environmental Modelling & Software 44 (June 2013), pp. 76-86.
Xiaolong Xue, Ruixue Zhang, Rebecca Yang, and Jason Dai. “Innovation in construction: A critical review and future research”. In: International Journal of Innovation Science 6.2 (2014), pp. 111–126.
Aletha M Blayse and Karen Manley. “Key influences on construction innovation”. In: Construction innovation 4.3 (2004), pp. 143–154.
Kenichi Soga and Jennifer Schooling. “Infrastructure sensing”. In: Interface focus 6.4 (2016), p. 20160023.
Francesco Flammini, Concetta Pragliola, and Giovanni Smarra. “Railway infrastructure monitoring by drones”. In: 2016 International Conference on Electrical Systems for Aircraft, Railway, Ship Propulsion and Road Vehicles & International Transportation Electrification Conference (ESARS-ITEC). IEEE. 2016, pp. 1–6.
Theodore Zahariadis, Artemis Voulkidis, Panagiotis Karkazis, and Panagiotis Trakadas. “Preventive maintenance of critical infrastructures using 5G networks & drones”. In: 2017 14th IEEE International Conference on Advanced Video and Signal Based Surveillance (AVSS). IEEE. 2017, pp. 1–4.
Frank Hyneman Knight. Risk, uncertainty and profit. Vol. 31. Houghton Mifflin, 1921.
W.E. Walker, P. Harremoës, J. Rotmans, J.P. Van Der Sluijs, M.B.A. Van Asselt, P. Janssen, and M.P. Krayer Von Krauss. “Defining Uncertainty: A Conceptual Basis for Uncertainty Management in Model-Based Decision Support”. In: Integrated Assessment 4.1 (Mar. 2003), pp. 5–17.
Christopher P Weaver, Robert J Lempert, Casey Brown, John A Hall, David Revell, and Daniel Sarewitz. “Improving the contribution of climate model information to decision making: the value and demands of robust decision frameworks”. In: Wiley Interdisciplinary Reviews: Climate Change 4.1 (2013), pp. 39–60.
Adam M Ross, Donna H Rhodes, and Daniel E Hastings. “Defining Changeability : Reconciling Flexibility , Adaptability , Scalability , Modifiability , and Robustness for Maintaining System Lifecycle Value”. In: Systems Engineering 11.3 (2008), pp. 246–262.
John Von Neumann and Oskar Morgenstern. Theory of games and economic behavior. 2nd ed. Princeton university press, 1947.
Olaf Helmer et al. Analysis of the future: The Delphi method. 1967.
James A Dewar,Carl H Builder,William M Hix,and Morlie H Levin. Assumption based planning: a planning tool for very uncertain times. Rand, 1993.
James A Dewar. Assumption-based planning: A tool for reducing avoidable surprises. Cambridge University Press, 2002.
Steve Bankes. “Exploratory Modeling for Policy Analysis”. In: Operations Research 41.3 (June 1993), pp. 435–449.
Steve Bankes, Warren E. Walker, and Jan H. Kwakkel. “Exploratory Modeling and Analysis”. In: Encyclopedia of Operations Research and Management Science. Ed. by Saul I. Gass and Michael C. Fu. Boston, MA: Springer US, 2013, pp. 532–537.
Robert J Lempert, David G Groves, Steven W Popper, and Steve C Bankes. “A general, analytic method for generating robust strategies and narrative scenarios”. In: Management science 52.4 (2006), pp. 514–528.
Yakov Ben-Haim. Information-gap Decision Theory: Decisions Under Severe Uncertainty. Academic Press Series on Decision and Risk. Academic Press, 2001.
Yakov Ben-Haim. “Info-Gap Decision Theory (IG)”. In: Decision Making under Deep Uncertainty: From Theory to Practice. Ed. by Vincent A W J Marchau, Warren E Walker, Peter J T M Bloemen, and Steven W Popper. Springer, 2019. Chap. 5, pp. 93–115.
Warren E. Walker, S. Adnan Rahman,and Jonathan Cave. “Adaptive Policies, Policy Analysis, and Policy-Making”. In: European Journal of Operational Research 128.2 (Jan. 2001), pp. 282–289.
Lenos Trigeorgis. Real options: Managerial flexibility and strategy in resource allocation. MIT press, 1996.
Richard De Neufville, Stefan Scholtes, and Tao Wang. “Real options by spreadsheet: parking garage case example”. In: Journal of infrastructure systems 12.2 (2006), pp. 107–111.
James A Dewar and Morlie H Levin. Assumption-based planning for Army 21. Rand, 1992.
John E Peters, Eric Victor Larson, and James A Dewar. Futures Intelligence: Assessing Intelligence Support to Three Army Long-range Planning Communities. Rand, 1998.
D Groves, E Bloom, J R Fischbach, and D Knopman. “Adapting to a Changing Colorado River: Making Future Water Deliveries More Reliable Through Robust Management Strategies”. In: AGU Fall Meeting Abstracts 2013 (2013), H41K–1407.
David Hadka, Jonathan Herman, Patrick Reed, and Klaus Keller. “An open source framework for many-objective robust decision making”. In: Environmental Modelling & Software 74 (2015), pp. 114–129.
Robert Lempert, Nidhi Kalra, Suzanne Peyraud, Zhimin Mao, Sinh Bach Tan, Dean Cira, and Alexander Lotsch. “Ensuring robust flood risk management in Ho Chi Minh City”. In: World Bank Policy Research Working Paper 6465 (2013).
Suvendi Chinnappen-Rimer and Gerhard P Hancke. “Actor coordination using info-gap decision theory in wireless sensor and actor networks”. In: International Journal of Sensor Networks 10.4 (2011), pp. 177–191.
Dylan R Harp and Velimir V Vesselinov. “Contaminant remediation decision analysis using information gap theory”. In: Stochastic environmental research and risk assessment 27 (2013), pp. 159–168.
Vincent AWJ Marchau, Warren E Walker, and GP Van Wee. “Dynamic adaptive transport policies for handling deep uncertainty”. In: Technological forecasting and social change 77.6 (2010), pp. 940–950.
B Gersonius, R Ashley, A Jeuken, A Pathinara, and C Zevenbergen. “Accounting for uncertainty and flexibility in flood risk management: comparing Real-In-Options optimisation and Adaptation Tipping Points”. In: Journal of Flood Risk Management 8.2 (2015), pp. 135–144.
Scott A Stephens, Robert G Bell, and Judy Lawrence. “Developing signals to trigger adaptation to sea-level rise”. In: Environmental Research Letters 13.10 (2018), p. 104004.
Judy Lawrence and Marjolijn Haasnoot. “What it took to catalyse uptake of dynamic adaptive pathways planning to address climate change uncertainty”. In: Environmental Science & Policy 68 (2017), pp. 47–57.
Miriam Esders, Nicola Della Morte, and B Adey. “A methodology to ensure the consideration of flexibility and robustness in the selection of facility renewal projects”. In: International Journal of Architecture, Engineering and Construction 4.3 (2015), pp. 126–139.
David Geltner and Richard De Neufville. Flexibility and Real Estate Valuation under Uncertainty: A Practical Guide for Developers. Hoboken, NJ: John Wiley & Sons, 2018. 1 p.
Erin T Ryan,David R Jacques, and John M Colombi.“An Ontological Framework for Clarifying Flexibility-Related Terminology via Literature Survey”. In: Systems Engineering 16.1 (2013), pp. 99–110.
James E.Neumann,Paul Chinowsky, Jacob Helman, Margaret Black, Charles Fant, Kenneth Strzepek, and Jeremy Martinich. “Climate Effects on US Infrastructure: The Economics of Adaptation for Rail, Roads, and Coastal Development”. In: Climatic Change 167.3-4 (Aug. 2021), p. 44.
Kara N. Difrancesco and Desiree D. Tullos. “Assessment of Flood Management Systems’ Flexibility with Application to the Sacramento River Basin, California, USA”. In: International Journal of River Basin Management 13.3 (July 3, 2015), pp. 271–284.
Junfei Hu and Michel-Alexandre Cardin. “Generating Flexibility in the Design of Engineering Systems to Enable Better Sustainability and Lifecycle Performance”. In: Research in Engineering Design 26.2 (Apr. 2015), pp. 121-143.
Marjolijn Haasnoot, Gundula Winter, Sally Brown, Richard J. Dawson, Philip J. Ward, and Dirk Eilander. “Long-Term Sea-Level Rise Necessitates a Commitment to Adaptation: A First Order Assessment”. In: Climate Risk Management 34 (2021), p. 100355.
Nayled Acuña-Coll and Mauricio Sánchez-Silva. “Integrating Systems Thinking and Flexibility in Infrastructure Management”. In: Innovative Infrastructure Solutions 8.5 (May 2023), p. 144.
Walter Louis II Barnes. “Enabling flexibility through strategic management of complex engineering systems”. PhD thesis. Missouri University of Science and Technology, 2020.
Stephen J. Sapol and Zoe Szajnfarber. “Revisiting Flexibility in Design: An Analysis of the Impact of Implementation Uncertainty on the Value of Real Options”. In: Journal of Mechanical Design 142.12 (Dec. 1, 2020), p. 121701.
Albert Gailord Hart. “Anticipations, Business Planning, and the Cycle”. In: The Quarterly Journal of Economics 51.2 (Feb. 1937), p. 273.
Dragutin M Zelenović. “Flexibility a Condition for Effective Production Systems”. In: International Journal of Production Research 20.3 (1982), pp. 319-337.
R. E. Swaney and I. E. Grossmann. “An Index for Operational Flexibility in Chemical Process Design. Part 2: Computational Algorithms”. In: AIChE Journal 31.4 (1985), pp. 631–641.
Efstratios N Pistikopoulos and T Mazzuchi. “A Novel Flexibility Analysis Approach for Processes with Stochastic Parameters”. In: Computers & Chemical Engineering 14.9 (1990), pp. 991–1000.
Lenos Trigeorgis and S. P. Mason. Valuing Managerial Flexibility.
Stefan H. Thomke. “The Role of Flexibility in the Development of New Products: An Empirical Study”. In: Research Policy 26.1 (Mar. 1997), pp. 105-119.
Ronald Sanchez. “Strategic Flexibility, Real Options, and Product Based Strategy”. PhD thesis. Massachusets Institute of Technology, 1991.
Tao Wang. “Real Options "in" Projects and Systems Design- Identification of Options and Solution for Path Dependency”. PhD thesis. Massachusets Institute of Technology, 2005.
Andrew Olewnik and Kemper Lewis. “A decision support framework for flexible system design”. In: Journal of Engineering Design 17.1 (2006), pp. 75-97.
Roshanak Nilchiani and Daniel Hastings. “Measuring the Value of Flexibility in Space Systems: A Six-Element Framework”. In: Systems Engineering 10.1 (2007), pp. 26–44.
Matthew Fitzgerald. “Managing Uncertainty in Systems with a Valuation Approach for Strategic Changeability”. M.S. thesis. Massachusetts Institute of Technology, 2012, p. 144.
Karl Terzaghi and Ralph B Peck. “Soil mechanics”. In: Engineering Practice. John Wiley and Sons, Inc., New York (1948).
Ralph B Peck. “Advantages and limitations of the observational method in applied soil mechanics”. In: Geotechnique 19.2 (1969), pp. 171–187.
Dinesh Patel, D Nicholson, N Huybrechts, and J Maertens. “The observational method in geotechnics”. In: Proceedings of XIV European Conference on Soil Mechanics and Geotechnical Engineering, Madrid. 2007, pp. 24–27.
M Korff, E De Jong, and T Bles. “SWOT analysis observational method applications”. In: Proceedings of the 18th International Conference on Soil Mechanics and Geotechnical Engineering. 2013, pp. 1883–1888.
Olga Špačková and Daniel Straub. “Long-term adaption decisions via fully and partially observable Markov decision processes”. In: Sustainable and Resilient Infrastructure 2.1 (2017), pp. 37–58.
Sarah Fletcher, Kenneth Strzepek, Adnan Alsaati, and Olivier De Weck. “Learning and Flexibility for Water Supply Infrastructure Planning under Groundwater Resource Uncertainty”. In: Environmental Research Letters 14.11 (Nov. 1, 2019), p. 114022.
Jonathan Metzger, Annika Carlsson Kanyama, Per Wikman-Svahn, Karin Mossberg Sonnek, Christoffer Carstens, Misse Wester, and Christoffer Wedebrand. “The Flexibility Gamble: Challenges for Mainstreaming Flexible Approaches to Climate Change Adaptation”. In: Journal of Environmental Policy & Planning 23.4 (July 4, 2021), pp. 543–558.
Peter Linquiti and Nicholas Vonortas. “The value of flexibility in adapting to climate change: a real options analysis of investments in coastal defense”. In: Climate Change Economics 03.02 (May 2012), p. 1250008.
Vinod Kumar. “Entropic Measures of Manufacturing Flexibility”. In: International Journal of Production Research 25.7 (July 1987), pp. 957–966.
William Golden and Philip Powell. “Towards a definition of flexibility: in search of the Holy Grail?” In: Omega 28.4 (2000), pp. 373–384.
Özlen Erkal Sönmez and Vehbi Tufan Koç. “On quantifying manufacturing flexibility: An entropy based approach”. In: Proceedings of the world congress on engineering. Vol. 2. 2015, pp. 1–3.
Carmine Cavalliere, Guido Raffaele Dell’Osso, Fausto Favia, and Marco Lovicario. “BIM-based Assessment Metrics for the Functional Flexibility of Building Designs”. In: Automation in Construction 107 (Nov. 2019), p. 102925.
Olga Špačková, Beatrice Dittes, and Daniel Straub. “Risk based Optimization of Adaptable Protection Measures Against Natural Hazards”. In: 12th International Conference on Applications of Statistics and Probability in Civil Engineering, ICASP12. 2015.
E K Morlok and D J Chang. “Measuring capacity flexibility of a transportation system”. In: Transportation Research Part A 38.6 (2004), pp. 405–420.
Péter Babarczi, Markus Klügel, Alberto Martínez Alba, Mu He, Johannes Zerwas, Patrick Kalmbach, Andreas Blenk, and Wolfgang Kellerer. “A mathematical framework for measuring network flexibility”. In: Computer Communications 164 (2020), pp. 13–24.
Adam M. Ross. “Managing Unarticulated Value: Changeability in MultiAttribute Tradespace Exploration”. PhD thesis. Massachusets Institute of Technology, 2006.
Jochen Eckart. Flexible Urban Drainage Systems in New Land-Use Areas. University of South Florida, 2012.
Nathan D Niese and David J Singer. “Assessing changeability under uncertain exogenous disturbance”. In: Res Eng Des 25 (2014), pp. 241–258.
Carl F. Rehn, Sigurd S. Pettersen, Jose J. Garcia, Per O. Brett, Stein O. Erikstad, Bjørn E. Asbjørnslett, Adam M. Ross, and Donna H. Rhodes. “Quantification of Changeability Level for Engineering Systems”. In: Systems Engineering 22.1 (Jan. 2019), pp. 80–94.
Mu He, Alberto Martinez Alba, Arsany Basta, Andreas Blenk, and Wolfgang Kellerer. “Flexibility in Softwarized Networks: Classifications and Research Challenges”. In: IEEE Communications Surveys & Tutorials 21.3 (Aut. 2019), pp. 2600–2636.
Diane M. Lander David N. Ford and John J. Voyer. “A real options approach to valuing strategic flexibility in uncertain construction projects”. In: Construction Management and Economics 20.4 (2002), pp. 343–351.
José Martins, Rui Cunha Marques, and Carlos Oliveira Cruz. “Real Options in Infrastructure: Revisiting the Literature”. In: Journal of Infrastructure Systems 21.1 (Mar. 2015), p. 04014026.
B. Gersonius, T. Morselt, L. Van Nieuwenhuijzen, R. Ashley, and C. Zevenbergen. “How the Failure to Account for Flexibility in the Economic Analysis of Flood Risk and Coastal Management Strategies Can Result in Maladaptive Decisions”. In: Journal of Waterway, Port, Coastal, and Ocean Engineering 138.5 (Sept. 2012), pp. 386–393.
Luis A. Gomez Cunya, Hyun Woo Lee, and Arturo S. Leon. “A Real Options Based Framework to Evaluate Investments in River Flood Control under Uncertainty”. In: Vulnerability, Uncertainty, and Risk, pp. 1465–1474.
A. Kontogianni, C.H. Tourkolias, D. Damigos, and M. Skourtos. “Assessing Sea Level Rise Costs and Adaptation Benefits under Uncertainty in Greece”. In: Environmental Science & Policy 37 (Mar. 2014), pp. 61–78.
Taeil Park, Changyoon Kim, and Hyoungkwan Kim. “Valuation of Drainage Infrastructure Improvement Under Climate Change Using Real Options”. In: Water Resources Management 28.2 (Jan. 2014), pp. 445–457.
Michelle Woodward, Zoran Kapelan, and Ben Gouldby. “Adaptive Flood Risk Management Under Climate Change Uncertainty Using Real Options and Optimization”. In: Risk Analysis 34.1 (2014), pp. 75–92.
Miyuki Hino and Jim W. Hall. “Real Options Analysis of Adaptation to Changing Flood Risk: Structural and Nonstructural Measures”. In: ASCE-ASME Journal of Risk and Uncertainty in Engineering Systems, Part A: Civil Engineering 3.3 (Sept. 2017), p. 04017005.
Mengke Ni and Tohid Erfani. “Adaptive Short-Term Flood Defense Deployment Planning”. In: Journal of Water Resources Planning and Management 148.6 (2022), p. 04022030.
Stephen X. Zhang and Vladan Babovic. “A real options approach to the design and architecture of water supply systems using innovative water technologies under uncertainty”. In: Journal of Hydroinformatics 14.1 (Apr. 2011), pp. 13–29.
Marc Jeuland and Dale Whittington. “Water Resources Planning under Climate Change: Assessing the Robustness of Real Options for the Blue Nile”. In: Water Resources Research 50.3 (Mar. 2014), pp. 2086–2107.
J. Marques, M. Cunha, and D.A.Savić. “Decision Support for Optimal Design of Water Distribution Networks: A Real Options Approach”. In: Procedia Engineering 70 (2014). 12th International Conference on Computing and Control for the Water Industry, CCWI2013, pp. 1074–1083.
João Marques, Maria Cunha, and Dragan A. Savić. “Multi-objective optimization of water distribution systems based on a real options approach”. In: Environmental Modelling & Software 63 (2015), pp. 1–13.
Nam Lethanh and Bryan T Adey. “A real option approach to determine optimal intervention windows for multi-national rail corridors”. In: Journal of Civil Engineering and Management 22.1 (Dec. 2015), pp. 38–46.
Tong Zhao, Satheesh K. Sundararajan, and Chung-Li Tseng. “Highway Development Decision-Making under Uncertainty: A Real Options Approach”. In: Journal of Infrastructure Systems 10.1 (Mar. 2004), pp. 23–32.
Paulien M. Herder, Jeroen De Joode, Andreas Ligtvoet, Sigrid Schenk, and Poonam Taneja. “Buying Real Options– Valuing Uncertainty in Infrastructure Planning”. In: Futures 43.9 (Nov. 2011), pp. 961–969.
Michael J. Garvin and David N. Ford. “Real Options in Infrastructure Projects: Theory, Practice and Prospects”. In: Engineering Project Organization Journal 2.1-2 (June 2012), pp. 97–108.
Fleur Gijsen. “Added value of different approaches of real options in transportation infrastructure projects decision-making”. M.S. thesis. Delft University of Technology, 2016, p. 152.
Nikita Moriakov. “An application of Real Options to the valuation of an investment in electrical network”. M.S. thesis. Delft University of Technology, 2012, p. 89.
Aakil M. Caunhye and Michel-Alexandre Cardin. “An approach based on robust optimization and decision rules for analyzing real options in engineering systems design”. In: IISE Transactions 49.8 (2017), pp. 753–767.
E.A. Martínez-Ceseña and J. Mutale. “Application of an advanced real options approach for renewable energy generation projects planning”. In: Renewable and Sustainable Energy Reviews 15.4 (2011), pp. 2087–2094.
Trine Krogh Boomsma, Nigel Meade, and Stein-Erik Fleten. “Renewable energy investments under different support schemes: A real options approach”. In: European Journal of Operational Research 220.1 (2012), pp. 225–237.
Nivedya M. Kottayi, Rajib B. Mallick, Jennifer M. Jacobs, and Jo Sias Daniel. “Economics of Making Roadway Pavements Resilient to Climate Change: Use of Discounted Cash Flow and Real Options Analysis”. In: Journal of Infrastructure Systems 25.3 (2019), p. 04019017.
YinghanDeng,Michel-Alexandre Cardin, Vladan Babovic, Deepak Santhanakrishnan, Petra Schmitter, and Ali Meshgi. “Valuing Flexibilities in the Design of Urban Water Management Systems”. In: Water Research 47.20 (Dec. 2013), pp. 7162–7174.
Michel-Alexandre Cardin and Junfei Hu. “Analyzing the Tradeoffs Between Economies of Scale, Time-Value of Money, and Flexibility in Design Under Uncertainty: Study of Centralized Versus Decentralized Waste-to-Energy Systems”. In: Journal of Mechanical Design 138.1 (Jan. 1, 2016), p. 011401.
Liang-Chih Ma, Bernardo Castro-Dominguez, Nikolaos K. Kazantzis, and Yi Hua Ma. “Economic Performance Evaluation of Process System Design Flexibility Options under Uncertainty: The Case of Hydrogen Production Plants with Integrated Membrane Technology and CO2 Capture”. In: Computers & Chemical Engineering 99 (Apr. 2017), pp. 214–229.
Anna Evans. “The Value of Flexibility: Application of Real Options Analysis to Electricity Network Investments”. M.S. thesis. Massachusetts Institute of Technology, 2020, p. 62.
Mauricio Sánchez-Silva and Wilmar Calderón-Guevara. “Flexibility and Adaptability within the Context of Decision-Making in Infrastructure Management”. In: Structure and Infrastructure Engineering 18.7 (July 3, 2022), pp. 950–966.
Michel-Alexandre Cardin, Qihui Xie, Tsan Sheng Ng, and Shuming Wang. “An approach for analyzing and managing flexibility in engineering systems design based on decision rules and multistage stochastic programming”. In: IISE Trans 49.1 (2017), pp. 1–12.
Michel-Alexandre Cardin, Yinghan Deng, and Chang Sun. “Real Options and Flexibility Analysis in Design and Management of One-Way Mobility on-Demand Systems Using Decision Rules”. In: Transportation Research Part C: Emerging Technologies 84 (Nov. 2017), pp. 265–287.
Sixiang Zhao, William Benjamin Haskell, and Michel Alexandre Cardin. “Decision rule-based method for flexible multi-facility capacity expansion problem”. In: IISE Trans 50.7 (2018), pp. 553–569.
Matthew E Fitzgerald and Adam M Ross. “Sustaining Lifecycle Value: Valuable Changeability Analysis with Era Simulation”. In: 2012 IEEE International Systems Conference SysCon 2012. 2012 6th Annual IEEE Systems Conference (SysCon). Vancouver, BC, Canada: IEEE, Mar. 2012, pp. 1–7.
Marjolijn Haasnoot, Maaike Van Aalst, Julie Rozenberg, Kathleen Dominique, John Matthews, Laurens M. Bouwer, Jarl Kind, and N. LeRoy Poff. “Investments under Non-Stationarity: Economic Evaluation of Adaptation Pathways”. In: Climatic Change 161.3 (Aug. 2020), pp. 451–463.
Jan H. Kwakkel. “Is Real Options Analysis Fit for Purpose in Supporting Climate Adaptation Planning and Decision-making?” In: WIREs Climate Change 11.3 (May 2020), e638.
Jijun Lin, Olivier de Weck, Richard de Neufville, and Howard K. Yue. “Enhancing the value of offshore developments with flexible subsea tiebacks”. In: Journal of Petroleum Science and Engineering 102 (2013), pp. 73–83.
Matthew R. Silver and Olivier L. De Weck. “Time-expanded Decision Networks: A Framework for Designing Evolvable Complex Systems”. In: Systems Engineering 10.2 (June 2007), pp. 167–188.
Danguang Huang, Kalanithy Vairavamoorthy, and Seneshaw Tsegaye. “Flexible Design of Urban Water Distribution Networks”. In: World Environmental and Water Resources Congress 2010. World Environmental and Water Resources Congress 2010. Providence, Rhode Island, United States: American Society of Civil Engineers, May 14, 2010, pp. 4225–4236.
KiHyung Kim. “Strategic Flexibility”. PhD thesis. Purdue University, 2014.
Y.G. Melese, P.W. Heijnen, R.M. Stikkelman, and P.M. Herder. “Exploring for Real Options during CCS Networks Conceptual Design to Mitigate Effects of Path-Dependency and Lock-In”. In: International Journal of Greenhouse Gas Control 42 (Nov. 2015), pp. 16–25.
Y. G. Melese, P. W. Heijnen, R. M. Stikkelman, and P. M. Herder. “An Approach for Integrating Valuable Flexibility During Conceptual Design of Networks”. In: Networks and Spatial Economics 17.2 (June 2017), pp. 317–341.
David Allaverdi and Tyson R. Browning. “A methodology for identifying flexible design opportunities in large-scale systems”. In: Systems Engineering 23.5 (2020), pp. 534–556.
Julia Reisinger, Maximilian Knoll, and Iva Kovacic. “Design Space Exploration for Flexibility Assessment and Decision Making Support in Integrated Industrial Building Design”. In: Optimization and Engineering 22.3 (Sept. 2021), pp. 1693–1725.
Myung-Jin Kim, Robert J. Nicholls, John M. Preston, and Gustavo A. De Almeida. “Evaluation of Flexibility in Adaptation Projects for Climate Change”. In: Climatic Change 171.1-2 (Mar. 2022), p. 15.
D.B. Agusdinata, V.A.W.J. Marchau, and W.E. Walker. “Adaptive Policy Approach to Implementing Intelligent Speed Adaptation”. In: IET Intelligent Transport Systems 1.3 (2007), p. 186.
Jan H. Kwakkel and Erik Pruyt. “Exploratory Modeling and Analysis, an Approach for Model-Based Foresight under Deep Uncertainty”. In: Technological Forecasting and Social Change 80.3 (Mar. 2013), pp. 419–431.
Benjamin P. Bryant and Robert J. Lempert. “Thinking inside the Box: A Participatory, Computer-Assisted Approach to Scenario Discovery”. In: Technological Forecasting and Social Change 77.1 (Jan. 2010), pp. 34–49.
Jan H. Kwakkel, Willem L. Auping, and Erik Pruyt. “Dynamic Scenario Discovery under Deep Uncertainty: The Future of Copper”. In: Technological Forecasting and Social Change 80.4 (May 2013), pp. 789–800.
Enayat A. Moallemi, Sondoss Elsawah, and Michael J. Ryan. “Model-Based Multi-Objective Decision Making under Deep Uncertainty from a MultiMethod Design Lens”. In: Simulation Modelling Practice and Theory 84 (May 2018), pp. 232–250.
David G. Groves and Robert J. Lempert. “A new analytic method for finding policy-relevant scenarios”. In: Global Environmental Change 17.1 (2007). Uncertainty and Climate Change Adaptation and Mitigation, pp. 73–85.
Jerome H Friedman and Nicholas I Fisher. In: Statistics and Computing 9.2 (1999), pp. 123–143.
Robert J Lempert, Benjamin P Bryant, and Steven C Bankes. Comparing algorithms for scenario discovery. 2008.
P. C. D. Milly, Julio Betancourt, Malin Falkenmark, Robert M. Hirsch, Zbigniew W. Kundzewicz, Dennis P. Lettenmaier, and Ronald J. Stouffer. “Stationarity Is Dead: Whither Water Management?” In: Science 319.5863 (2008), pp. 573–574.
Vijaykumar Gullapalli. “A stochastic reinforcement learning algorithm for learning real-valued functions”. In: Neural Networks 3.6 (1990), pp. 671–692.
Gareth James, Daniela Witten, Trevor Hastie, Robert Tibshirani, and Jonathan Taylor. “Unsupervised Learning”. In: An Introduction to Statistical Learning: with Applications in Python. Cham: Springer International Publishing, 2023, pp. 503–556.
Richard S Sutton and Andrew G Barto. Reinforcement learning: An introduction. MIT press, 2018.
B. F. Skinner. The Behavior of Organisms: An Experimental Analysis. Oxford, England: Appleton-Century, 1938, p. 457. 457 pp.
Kai Arulkumaran, Marc Peter Deisenroth, Miles Brundage, and Anil Anthony Bharath. “Deep Reinforcement Learning: A Brief Survey”. In: IEEE Signal Processing Magazine 34.6 (Nov. 2017), pp. 26–38.
Ann Nowé and Tim Brys. “A Gentle Introduction to Reinforcement Learning”. In: Scalable Uncertainty Management. Ed. by Steven Schockaert and Pierre Senellart. Vol. 9858. Cham: Springer International Publishing, 2016, pp. 18–32.
Warren B Powell. Approximate Dynamic Programming: Solving the Curses of Dimensionality. 2nd ed. Wiley, 2011.
Richard S. Sutton. “Learning to predict by the methods of temporal differences”. In: Machine Learning 3.1 (Aug. 1988), pp. 9–44.
Gavin A Rummery and Mahesan Niranjan. On-line Q-learning using connectionist systems. Cambridge, UK, 1994.
Christopher J C H Watkins and Peter Dayan. “Q-learning”. en. In: Mach. Learn. 8.3-4 (May 1992), pp. 279–292.
Gdeorge Cybenko. “Approximation by superpositions of a sigmoidal function”. en. In: Math. Control Signals Systems 2.4 (Dec. 1989), pp. 303–314.
Volodymyr Mnih, Koray Kavukcuoglu, David Silver, Andrei A. Rusu, Joel Veness, Marc G. Bellemare, Alex Graves, Martin Riedmiller, Andreas K. Fidjeland, Georg Ostrovski, Stig Petersen, Charles Beattie, Amir Sadik, Ioannis Antonoglou, Helen King, Dharshan Kumaran, Daan Wierstra, Shane Legg, and Demis Hassabis. “Human-Level Control through Deep Reinforcement Learning”. In: Nature 518.7540 (Feb. 26, 2015), pp. 529–533.
John Tsitsiklis and Benjamin Van Roy. “Analysis of Temporal-Diffference Learning with Function Approximation”. In: Advances in Neural Information Processing Systems. Ed. by M.C. Mozer, M. Jordan, and T. Petsche. Vol. 9. MIT Press, 1996.
Long-Ji Lin. “Self-improving reactive agents based on reinforcement learning, planning and teaching”. en. In: Machine Learning 8.3-4 (May 1992), pp. 293– 321.
G Tesauro. “Temporal difference learning and TD-gammon”. In: ICGA J. 18.2 (June 1995), pp. 88–88.
David Silver, Aja Huang, Chris J Maddison, Arthur Guez, Laurent Sifre, George van den Driessche, Julian Schrittwieser, Ioannis Antonoglou, Veda Panneershelvam, Marc Lanctot, Sander Dieleman, Dominik Grewe, John Nham, Nal Kalchbrenner, Ilya Sutskever, Timothy Lillicrap, Madeleine Leach, Koray Kavukcuoglu, Thore Graepel, and Demis Hassabis. “Mastering the game of Go with deep neural networks and tree search”. en. In: Nature 529.7587 (Jan. 2016), pp. 484–489.
Oriol Vinyals, Igor Babuschkin, Wojciech M Czarnecki, Michaël Mathieu, Andrew Dudzik, Junyoung Chung, David H Choi, Richard Powell, Timo Ewalds, Petko Georgiev, Junhyuk Oh, Dan Horgan, Manuel Kroiss, Ivo Danihelka, Aja Huang, Laurent Sifre, Trevor Cai, John P Agapiou, Max Jaderberg, Alexander S Vezhnevets, Rémi Leblond, Tobias Pohlen, Valentin Dalibard, David Budden, Yury Sulsky, James Molloy, Tom L Paine, Caglar Gulcehre, Ziyu Wang, Tobias Pfaff, Yuhuai Wu, Roman Ring, Dani Yogatama, Dario Wünsch, Katrina McKinney, Oliver Smith, Tom Schaul, Timothy Lillicrap, Koray Kavukcuoglu, Demis Hassabis, Chris Apps, and David Silver. “Grandmaster level in StarCraft II using multi-agent reinforcement learning”. en. In: Nature 575.7782 (Nov. 2019), pp. 350–354.
Christopher Berner, Greg Brockman, Brooke Chan, Vicki Cheung, Przemysław Dębiak, Christy Dennison, David Farhi, Quirin Fischer, Shariq Hashme, Chris Hesse, Rafal Józefowicz, Scott Gray, Catherine Olsson, Jakub Pachocki, Michael Petrov, Henrique P. d. O. Pinto, Jonathan Raiman, Tim Salimans, Jeremy Schlatter, Jonas Schneider, Szymon Sidor, Ilya Sutskever, Jie Tang, Filip Wolski, and Susan Zhang. Dota 2 with Large Scale Deep Reinforcement Learning. 2019.
Sida I. Wang, Percy Liang, and Christopher D. Manning. Learning Language Games through Interaction. 2016.
Chen Liang, Jonathan Berant, Quoc Le, Kenneth D. Forbus, and Ni Lao. Neural Symbolic Machines: Learning Semantic Parsers on Freebase with Weak Supervision. 2017.
Bhaskar Mitra and Nick Craswell. Neural Models for Information Retrieval. 2017.
Rodrigo Nogueira and Kyunghyun Cho. Task-Oriented Query Reformulation with Reinforcement Learning. 2017.
Romain Paulus, Caiming Xiong, and Richard Socher. A Deep Reinforced Model for Abstractive Summarization. 2017.
Lisa Zhang, Gregory Rosenblatt, Ethan Fetaya, Renjie Liao, William Byrd, Matthew Might, Raquel Urtasun, and Richard Zemel. “Neural Guided Constraint Logic Programming for Program Synthesis”. In: Advances in Neural Information Processing Systems. Ed. by S. Bengio, H. Wallach, H. Larochelle, K. Grauman, N. Cesa-Bianchi, and R. Garnett. Vol. 31. Curran Associates, Inc., 2018.
Bhuwan Dhingra, Lihong Li, Xiujun Li, Jianfeng Gao, Yun-Nung Chen, Faisal Ahmed, and Li Deng. Towards End-to-End Reinforcement Learning of Dialogue Agents for Information Access. 2017.
Jiwei Li, Alexander H. Miller, Sumit Chopra, Marc’Aurelio Ranzato, and Jason Weston. Learning through Dialogue Interactions by Asking Questions. 2017.
Jason D. Williams, Kavosh Asadi, and Geoffrey Zweig. Hybrid Code Networks: practical and efficient end-to-end dialog control with supervised and reinforcement learning. 2017.
Kyunghyun Cho, Bart van Merrienboer, Caglar Gulcehre, Dzmitry Bahdanau, Fethi Bougares, Holger Schwenk, and Yoshua Bengio. Learning Phrase Representations using RNN Encoder-Decoder for Statistical Machine Translation. 2014.
Ilya Sutskever, Oriol Vinyals, and Quoc V Le. “Sequence to Sequence Learning with Neural Networks”. In: Advances in Neural Information Processing Systems. Ed. by Z. Ghahramani, M. Welling, C. Cortes, N. Lawrence, and K.Q. Weinberger. Vol. 27. Curran Associates, Inc., 2014.
Di He, Yingce Xia, Tao Qin, Liwei Wang, Nenghai Yu, Tie-Yan Liu, and WeiYing Ma. “Dual Learning for Machine Translation”. In: Advances in Neural Information Processing Systems. Ed. by D. Lee, M. Sugiyama, U. Luxburg, I. Guyon, and R. Garnett. Vol. 29. Curran Associates, Inc., 2016.
Yonghui Wu, Mike Schuster, Zhifeng Chen, Quoc V. Le, Mohammad Norouzi, Wolfgang Macherey, Maxim Krikun, Yuan Cao, Qin Gao, Klaus Macherey, Jeff Klingner, Apurva Shah, Melvin Johnson, Xiaobing Liu, Łukasz Kaiser, Stephan Gouws, Yoshikiyo Kato, Taku Kudo, Hideto Kazawa, Keith Stevens, George Kurian, Nishant Patil, Wei Wang, Cliff Young, Jason Smith, Jason Riesa, Alex Rudnick, Oriol Vinyals, Greg Corrado, Macduff Hughes, and Jeffrey Dean. Google’s Neural Machine Translation System: Bridging the Gap between Human and Machine Translation. 2016.
Jonas Gehring, Michael Auli, David Grangier, Denis Yarats, and Yann N. Dauphin. “Convolutional Sequence to Sequence Learning”. In: Proceedings of the 34th International Conference on Machine Learning. Ed. by Doina Precup and Yee Whye Teh. Vol. 70. Proceedings of Machine Learning Research. PMLR, June 2017, pp. 1243–1252.
Melvin Johnson, Mike Schuster, Quoc V. Le, Maxim Krikun, Yonghui Wu, Zhifeng Chen, Nikhil Thorat, Fernanda Viégas, Martin Wattenberg, Greg Corrado, Macduff Hughes, and Jeffrey Dean. “Google’s Multilingual Neural Machine Translation System: Enabling Zero-Shot Translation”. In: Transactions of the Association for Computational Linguistics 5 (Oct. 2017), pp. 339–351.
Guillaume Klein, Yoon Kim, Yuntian Deng, Jean Senellart, and Alexander M. Rush. OpenNMT: Open-Source Toolkit for Neural Machine Translation. 2017.
Marc’Aurelio Ranzato, Sumit Chopra, Michael Auli, and Wojciech Zaremba. Sequence Level Training with Recurrent Neural Networks. 2016.
Dzmitry Bahdanau, Philemon Brakel, Kelvin Xu, Anirudh Goyal, Ryan Lowe, Joelle Pineau, Aaron Courville, and Yoshua Bengio. An Actor-Critic Algorithm for Sequence Prediction. 2017.
Jiwei Li, Alexander H. Miller, Sumit Chopra, Marc’Aurelio Ranzato, and Jason Weston. Dialogue Learning With Human-In-The-Loop. 2017.
Lantao Yu, Weinan Zhang, Jun Wang, and Yong Yu. “SeqGAN: Sequence Generative Adversarial Nets with Policy Gradient”. In: Proceedings of the AAAI Conference on Artificial Intelligence 31.1 (Feb. 2017).
Shehroze Bhatti, Alban Desmaison, Ondrej Miksik, Nantas Nardelli, N. Siddharth, and Philip H. S. Torr. Playing Doom with SLAM-Augmented Deep Reinforcement Learning. 2016.
Mustafa Devrim Kaba, Mustafa Gokhan Uzunbas, and Ser Nam Lim. “A Reinforcement Learning Approach to the View Planning Problem”. In: Proceedings of the IEEE Conference on Computer Vision and Pattern Recognition (CVPR). July 2017.
Fangyu Liu, Shuaipeng Li, Liqiang Zhang, Chenghu Zhou, Rongtian Ye, Yuebin Wang, and Jiwen Lu. “3DCNN-DQN-RNN: A Deep Reinforcement Learning Framework for Semantic Parsing of Large-Scale 3D Point Clouds”. In: Proceedings of the IEEE International Conference on Computer Vision (ICCV). Oct. 2017.
Gino Brunner, Oliver Richter, Yuyi Wang, and Roger Wattenhofer. “Teaching a Machine to Read Maps With Deep Reinforcement Learning”. In: Proceedings of the AAAI Conference on Artificial Intelligence 32.1 (Apr. 2018).
J. Moody and M. Saffell. “Learning to trade via direct reinforcement”. In: IEEE Transactions on Neural Networks 12.4 (2001), pp. 875–889.
Michael W. Brandt, Amit Goyal, Pedro Santa-Clara, and Jonathan R. Stroud. “A Simulation Approach to Dynamic Portfolio Choice with an Application to Learning About Return Predictability”. In: The Review of Financial Studies 18.3 (May 2005), pp. 831–873.
Yue Deng, Feng Bao, Youyong Kong, Zhiquan Ren, and Qionghai Dai. “Deep Direct Reinforcement Learning for Financial Signal Representation and Trading”. In: IEEE Transactions on Neural Networks and Learning Systems 28.3 (2017), pp. 653–664.
Shangxing Wang, Hanpeng Liu, Pedro Henrique Gomes, and Bhaskar Krishnamachari. “Deep reinforcement learning for dynamic multichannel access”. In: International Conference on Computing, Networking and Communications (ICNC). 2017, pp. 257–265.
Jiang Zhu, Yonghui Song, Dingde Jiang, and Houbing Song. “A New DeepQ-Learning-Based Transmission Scheduling Mechanism for the Cognitive Internet of Things”. In: IEEE Internet of Things Journal 5.4 (2018), pp. 2375–2385.
Man Chu, Hang Li, Xuewen Liao, and Shuguang Cui. “Reinforcement LearningBased Multiaccess Control and Battery Prediction With Energy Harvesting in IoT Systems”. In: IEEE Internet of Things Journal 6.2 (2019), pp. 2009–2020.
Matteo Gadaleta, Federico Chiariotti, Michele Rossi, and Andrea Zanella. “D-DASH: A Deep Q-Learning Framework for DASH Video Streaming”. In: IEEE Transactions on Cognitive Communications and Networking 3.4 (2017), pp. 703–718.
Hongzi Mao, Ravi Netravali, and Mohammad Alizadeh. “Neural Adaptive Video Streaming with Pensieve”. In: Proceedings of the Conference of the ACM Special Interest Group on Data Communication. SIGCOMM ’17. Los Angeles, CA, USA: Association for Computing Machinery, 2017, pp. 197–210.
Sandeep Chinchali, Pan Hu, Tianshu Chu, Manu Sharma, Manu Bansal, Rakesh Misra, Marco Pavone, and Sachin Katti. “Cellular Network Traffic Scheduling With Deep Reinforcement Learning”. In: Proceedings of the AAAI Conference on Artificial Intelligence 32.1 (Apr. 2018).
Paulo Victor Rodrigues Ferreira, Randy Paffenroth, Alexander M. Wyglinski, Timothy M. Hackett, Sven G. Bilén, Richard C. Reinhart, and Dale J. Mortensen. “Multiobjective Reinforcement Learning for Cognitive Satellite Communications Using Deep Neural Network Ensembles”. In: IEEE Journal on Selected Areas in Communications 36.5 (2018), pp. 1030–1041.
Tianchi Huang, Rui-Xiao Zhang, Chao Zhou, and Lifeng Sun. “QARC: Video Quality Aware Rate Control for Real-Time Video Streaming Based on Deep Reinforcement Learning”. In: Proceedings of the 26th ACM International Conference on Multimedia. MM ’18. Seoul, Republic of Korea: Association for Computing Machinery, 2018, pp. 1208–1216.
Cheng Zhang, Zhi Liu, Bo Gu, Kyoko Yamori, and Yoshiaki Tanaka. “A deep reinforcement learning based approach for cost-and energy-aware multi-flow mobile data offloading”. In: IEICE Transactions on Communications 101.7 (2018), pp. 1625–1634.
Ji Li, Hui Gao, Tiejun Lv, and Yueming Lu. “Deep reinforcement learning based computation offloading and resource allocation for MEC”. In: 2018 IEEE Wireless Communications and Networking Conference (WCNC). 2018, pp. 1–6.
Xianfu Chen, Honggang Zhang, Celimuge Wu, Shiwen Mao, Yusheng Ji, and Mehdi Bennis. “Performance Optimization in Mobile-Edge Computing via Deep Reinforcement Learning”. In: 2018 IEEE 88th Vehicular Technology Conference (VTC-Fall). 2018, pp. 1–6.
Guoan Han, Liang Xiao, and H. Vincent Poor. “Two-dimensional anti-jamming communication based on deep reinforcement learning”. In: 2017 IEEE International Conference on Acoustics, Speech and Signal Processing (ICASSP). 2017, pp. 2087–2091.
Xin Liu, Yuhua Xu, Luliang Jia, Qihui Wu, and Alagan Anpalagan. “AntiJamming Communications Using Spectrum Waterfall: A Deep Reinforcement Learning Approach”. In: IEEE Communications Letters 22.5 (2018), pp. 998–1001.
Ye Chen, Yanda Li, Dongjin Xu, and Liang Xiao. “DQN-Based Power Control for IoT Transmission against Jamming”. In: 2018 IEEE 87th Vehicular Technology Conference (VTC Spring). 2018, pp. 1–5.
Wanrong Huang, Yanzhen Wang, and Xiaodong Yi. “Deep Q-Learning to Preserve Connectivity in Multi-Robot Systems”. In: Proceedings of the 9th International Conference on Signal Processing Systems. ICSPS 2017. Auckland, New Zealand: Association for Computing Machinery, 2017, pp. 45–50.
Chao Wang, Jian Wang, Xudong Zhang, and Xiao Zhang. “Autonomous navigation of UAV in large-scale unknown complex environment with deep reinforcement learning”. In: 2017 IEEE Global Conference on Signal and Information Processing (GlobalSIP). 2017, pp. 858–862.
Faris B. Mismar and Brian L. Evans. “Deep Q-Learning for Self-Organizing Networks Fault Management and Radio Performance Improvement”. In: 2018 52nd Asilomar Conference on Signals, Systems, and Computers. 2018, pp. 1457–1461.
Li-Yeh Chuang, Jui-Hung Tsai, and Cheng-Hong Yang. “Operon Prediction Using Particle Swarm Optimization and Reinforcement Learning”. In: 2010 International Conference on Technologies and Applications of Artificial Intelligence. 2010, pp. 366–372.
Celia Ghedini Ralha, Hugo Wruck Schneider, Maria Emilia Machado Telles Walter, and Ana Lucia Cetertich Bazzan. “Reinforcement Learning Method for BioAgents”. In: Proceedings of the 2010 Eleventh Brazilian Symposium on Neural Networks. SBRN ’10. USA: IEEE Computer Society, 2010, pp. 109–114.
Maria-Iuliana Bocicor, Gabriela Czibula, and Istvan-Gergely Czibula. “A Reinforcement Learning Approach for Solving the Fragment Assembly Problem”. In: 2011 13th International Symposium on Symbolic and Numeric Algorithms for Scientific Computing. 2011, pp. 191–198.
Fei Zhu, Quan Liu, Xiaofang Zhang, and Bairong Shen. “Protein-protein interaction network constructing based on text mining and reinforcement learning with application to prostate cancer”. In: 2014 IEEE International Conference on Bioinformatics and Biomedicine (BIBM). 2014, pp. 46–51.
Farhang Sahba, Hamid R Tizhoosh, and Magdy M A Salama. “Application of reinforcement learning for segmentation of transrectal ultrasound images”. en. In: BMC Med. Imaging 8.1 (Apr. 2008), p. 8.
Haoyang Zeng, Matthew D. Edwards, Ge Liu, and David K. Gifford. “Convolutional neural network architectures for predicting DNA–protein binding”. In: Bioinformatics 32.12 (June 2016), pp. i121–i127.
Yi-Fei Huang, Brad Gulko, and Adam Siepel. “Fast, scalable prediction of deleterious noncoding variants from functional and population genomic data”. en. In: Nature Genetics 49.4 (Apr. 2017), pp. 618–624.
Thomas Lampe, Lukas D.J. Fiederer, Martin Voelker, Alexander Knorr, Martin Riedmiller, and Tonio Ball. “A Brain-Computer Interface for High-Level Remote Control of an Autonomous, Reinforcement-Learning-Based Robotic System for Reaching and Grasping”. In: Proceedings of the 19th International Conference on Intelligent User Interfaces. IUI ’14. Haifa, Israel: Association for Computing Machinery, 2014, pp. 83–88.
Robert Bauer and Alireza Gharabaghi. “Reinforcement learning for adaptive threshold control of restorative brain-computer interfaces: a Bayesian simulation”. In: Frontiers in Neuroscience 9 (2015).
Jack DiGiovanna, Babak Mahmoudi, Jose Fortes, Jose C. Principe, and Justin C. Sanchez. “Coadaptive Brain–Machine Interface via Reinforcement Learning”. In: IEEE Transactions on Biomedical Engineering 56.1 (2009), pp. 54–64.
Yousuf M. Soliman. Personalized Medical Treatments Using Novel Reinforcement Learning Algorithms. 2014.
Regina Padmanabhan, Nader Meskin, and Wassim M. Haddad. “Learning based control of cancer chemotherapy treatment”. In: IFAC-PapersOnLine 50.1 (2017). 20th IFAC World Congress, pp. 15127–15132.
Brenden K. Petersen, Jiachen Yang, Will S. Grathwohl, Chase Cockrell, Claudio Santiago, Gary An, and Daniel M. Faissol. Precision medicine as a control problem: Using simulation and deep reinforcement learning to discover adaptive, personalized multi-cytokine therapy for sepsis. 2018.
S. A. Murphy. “An experimental design for the development of adaptive treatment strategies”. In: Statistics in Medicine 24.10 (2005), pp. 1455–1481.
A.John Rush, Maurizio Fava, Stephen R Wisniewski, Philip W Lavori, Madhukar H Trivedi, Harold A Sackeim, Michael E Thase, Andrew A Nieren218 berg, Frederic M Quitkin, T.Michael Kashner, David J Kupfer, Jerrold F Rosenbaum, Jonathan Alpert, Jonathan W Stewart, Patrick J McGrath, Melanie M Biggs, Kathy Shores-Wilson, Barry D Lebowitz, Louise Ritz, and George Niederehe. “Sequenced treatment alternatives to relieve depression (STAR*D): rationale and design”. In: Controlled Clinical Trials 25.1 (2004), pp. 119–142.
Susan M. Shortreed, Eric Laber, Daniel J. Lizotte, T. Scott Stroup, Joelle Pineau, and Susan A. Murphy. “Informing sequential clinical decision-making through reinforcement learning: an empirical study”. en. In: Machine Learning 84.1-2 (July 2011), pp. 109–136.
Phillip J. Schulte, Anastasios A. Tsiatis, Eric B. Laber, and Marie Davidian. “Q- and A-learning methods for estimating optimal dynamic treatment regimes”. en. In: Statistical Science 29.4 (Nov. 2014), pp. 640–661.
Matthieu Komorowski, Leo A. Celi, Omar Badawi, Anthony C. Gordon, and A. Aldo Faisal. “The Artificial Intelligence Clinician learns optimal treatment strategies for sepsis in intensive care”. en. In: Nature Medicine 24.11 (Nov. 2018), pp. 1716–1720.
Adam E. Gaweda, Mehmet K. Muezzinoglu, Alfred A. Jacobs, George R. Aronoff, and Michael E. Brier. “Model Predictive Control with Reinforcement Learning for Drug Delivery in Renal Anemia Management”. In: 2006 International Conference of the IEEE Engineering in Medicine and Biology Society. 2006, pp. 5177–5180.
Hideki Asoh, Masanori Shiro, Shotaro Akaho, Toshihiro Kamishima, Koiti Hashida, and Takahide Kohro. “Modeling Medical Records of Diabetes using Markov Decision Processes”. In: Proceedings of ICML2013 Workshop on Role of Machine Learning in Transforming Healthcare - (2013).
Chun-Hao Chang, Mingjie Mai, and Anna Goldenberg. Dynamic Measurement Scheduling for Adverse Event Forecasting using Deep RL. 2018.
Qingnan Sun, Marko V. Jankovic, João Budzinski, Brett Moore, Peter Diem, Christoph Stettler, and Stavroula G. Mougiakakou. “A Dual Mode Adaptive Basal-Bolus Advisor Based on Reinforcement Learning”. In: IEEE Journal of Biomedical and Health Informatics 23.6 (2019), pp. 2633–2641.
J. Boger, J. Hoey, P. Poupart, C. Boutilier, G. Fernie, and A. Mihailidis. “A planning system based on Markov decision processes to guide people with dementia through activities of daily living”. In: IEEE Transactions on Information Technology in Biomedicine 10.2 (2006), pp. 323–333.
David J. Reinkensmeyer, Emmanuel Guigon, and Marc A. Maier. “A computational model of use-dependent motor recovery following a stroke: Optimizing corticospinal activations via reinforcement learning can explain residual capacity and other strength recovery dynamics”. In: Neural Networks 29-30 (2012), pp. 60–69.
Shender Ávila-Sansores, Felipe Orihuela-Espina, and Luis Enrique-Sucar. “Patient Tailored Virtual Rehabilitation”. In: Converging Clinical and Engineering Research on Neurorehabilitation. Ed. by José L Pons, Diego Torricelli, and Marta Pajaro. Berlin, Heidelberg: Springer Berlin Heidelberg, 2013, pp. 879–883.
Georgios Naros and Alireza Gharabaghi. “Reinforcement learning of self regulated beta-oscillations for motor restoration in chronic stroke”. In: Frontiers in Human Neuroscience 9 (2015).
S.J. Fakih and T.K. Das. “LEAD: a methodology for learning efficient approaches to medical diagnosis”. In: IEEE Transactions on Information Technology in Biomedicine 10.2 (2006), pp. 220–228.
Elhadi M. Shakshuki, Malcolm Reid, and Tarek R. Sheltami. “An Adaptive User Interface in Healthcare”. In: Procedia Computer Science 56 (2015). The 10th International Conference on Future Networks and Communications (FNC 2015) / The 12th International Conference on Mobile Systems and Pervasive Computing (MobiSPC 2015) Affiliated Workshops, pp. 49–58.
Tianshu Chu, Jie Wang, and Jiayu Chen. “An adaptive online learning framework for practical breast cancer diagnosis”. In: Medical Imaging 2016: ComputerAided Diagnosis. Ed. by Georgia D. Tourassi and Samuel G. Armato III. Vol. 9785. International Society for Optics and Photonics. SPIE, 2016, p. 978524.
Zheng Wen, Daniel O’Neill, and Hamid Maei. “Optimal Demand Response Using Device-Based Reinforcement Learning”. In: IEEE Transactions on Smart Grid 6.5 (2015), pp. 2312–2324.
Zhijin Cheng, Qianchuan Zhao, Fulin Wang, Yi Jiang, Li Xia, and Jinlei Ding. “Satisfaction based Q-learning for integrated lighting and blind control”. In: Energy and Buildings 127 (2016), pp. 43–55.
Lukas Eller, Lydia C. Siafara, and Thilo Sauter. “Adaptive control for building energy management using reinforcement learning”. In: 2018 IEEE International Conference on Industrial Technology (ICIT). 2018, pp. 1562–1567.
Hussain Kazmi, Johan Suykens, Attila Balint, and Johan Driesen. “Multiagent reinforcement learning for modeling and control of thermostatically controlled loads”. In: Applied Energy 238 (2019), pp. 1022–1035.
A. Sheikhi, M. Rayati, and A.M. Ranjbar. “Dynamic load management for a residential customer; Reinforcement Learning approach”. In: Sustainable Cities and Society 24 (2016), pp. 42–51.
J. Bollenbacher and B. Rhein. “Optimal configuration and control strategy in a multi-carrier-energy system using reinforcement learning methods”. In: 2017 International Energy and Sustainability Conference (IESC). 2017, pp. 1–6.
Brida V. Mbuwir, Mahtab Kaffash, and Geert Deconinck. “Battery Scheduling in a Residential Multi-Carrier Energy System Using Reinforcement Learning”. In: 2018 IEEE International Conference on Communications, Control, and Computing Technologies for Smart Grids (SmartGridComm). 2018, pp. 1–6.
Haochen Hua, Yuchao Qin, Chuantong Hao, and Junwei Cao. “Optimal energy management strategies for energy Internet via deep reinforcement learning approach”. In: Applied Energy 239 (2019), pp. 598–609.
Marco Carvalho, Carlos Perez, and Adrian Granados. “An adaptive multiagent-based approach to smart grids control and optimization”. en. In: Energy Syst. 3.1 (Mar. 2012), pp. 61–76.
Byung-Gook Kim, Yu Zhang, Mihaela van der Schaar, and Jang-Won Lee. “Dynamic Pricing and Energy Consumption Scheduling With Reinforcement Learning”. In: IEEE Transactions on Smart Grid 7.5 (2016), pp. 2187–2198.
Renzhi Lu, Seung Ho Hong, and Xiongfeng Zhang. “A Dynamic pricing demand response algorithm for smart grid: Reinforcement learning approach”. In: Applied Energy 220 (2018), pp. 220–230.
Jian Sun, Zhiqin Zhu, Huaqing Li, Yi Chai, Guanqiu Qi, Huiwei Wang, and Yu Hen Hu. “An integrated critic-actor neural network for reinforcement learning with application of DERs control in grid frequency regulation”. In: International Journal of Electrical Power & Energy Systems 111 (2019), pp. 286–299.
Teng Liu, Yuan Zou, Dexing Liu, and Fengchun Sun. “Reinforcement learning–based energy management strategy for a hybrid electric tracked vehicle”. en. In: Energies 8.7 (July 2015), pp. 7243–7260.
Rui Xiong, Jiayi Cao, and Quanqing Yu. “Reinforcement learning-based realtime power management for hybrid energy storage system in the plug-in hybrid electric vehicle”. In: Applied Energy 211 (2018), pp. 538–548.
Namireddy Praveen Reddy, David Pasdeloup, Mehdi Karbalaye Zadeh, and Roger Skjetne. “An Intelligent Power and Energy Management System for Fuel Cell/Battery Hybrid Electric Vehicle Using Reinforcement Learning”. In: 2019 IEEE Transportation Electrification Conference and Expo (ITEC). 2019, pp. 1–6.
Fengwei Hung and Y. C. Ethan Yang. “Assessing Adaptive Irrigation Impacts on Water Scarcity in Nonstationary Environments—A Multi-Agent Reinforcement Learning Approach”. In: Water Resources Research 57.9 (2021), e2020WR029262.
Dylan Radovic, Lucas Kruitwagen, Christian Schroeder de Witt, Ben Caldecott, Shane Tomlinson, and Mark Workman. Revealing Robust Oil and Gas Company Macro-Strategies using Deep Multi-Agent Reinforcement Learning. 2022.
Nathan K. Brown, Anthony P. Garland, Georges M. Fadel, and Gang Li. ““Deep reinforcement learning for engineering design through topology optimization of elementally discretized design domains””. In: Materials & Design 218 (2022), p. 110672.
Melissa Chapman, Lily Xu, Marcus Lapeyrolerie, and Carl Boettiger. “Bridging Adaptive Management and Reinforcement Learning for More Robust Decisions”. In: Philosophical Transactions of the Royal Society B: Biological Sciences 378.1881 (July 17, 2023), p. 20220195.
D Bronitowski and J Moses. “Measuring Flexibility, Descriptive Complexity, and Rework Potential in Generic System Architectures”. In: Syst Eng 19.3 (2016), pp. 207–221.
Florida Department of Transportation. Cost per mile models reports. 2023. url: https://www.fdot.gov/programmanagement/estimates/documents/ costpermilemodelsreports (visited on 02/10/2024).
Jan H. Kwakkel. “The Exploratory Modeling Workbench: An open source toolkit for exploratory modeling, scenario discovery, and (multi-objective) robust decision making”. In: Environmental Modelling & Software 96 (2017), pp. 239–250.
Marten M Hillen, Sebastiaan N Jonkman, Wim Kanning, Matthijs Kok, MA Geldenhuys, and MJF Stive. “Coastal defence cost estimates: Case study of the Netherlands, New Orleans and Vietnam”. In: Communications on Hydraulic and Geotechnical Engineering, No. 2010-01 (2010).
Xianli Zhu, Matthew M. Linham, and Robert J. Nicholls. Technologies for climate change adaptation. Coastal erosion and flooding. Nov. 2010.
Stephane Hallegatte, Colin Green, Robert J. Nicholls, and Jan Corfee-Morlot. “Future flood losses in major coastal cities”. In: Nature Climate Change 3.9 (Sept. 2013), pp. 802–806.
Jochen Hinkel, Robert J. Nicholls, Richard S.J. Tol, Zheng B. Wang, Jacqueline M. Hamilton, Gerben Boot, Athanasios T. Vafeidis, Loraine McFadden, Andrey Ganopolski, and Richard J.T. Klein. “A global analysis of erosion of sandy beaches and sea-level rise: An application of DIVA”. In: Global and Planetary Change 111 (2013), pp. 150–158.
Kathleen L. McInnes, Christopher J. White, Ivan D. Haigh, Mark A. Hemer, Ron K. Hoeke, Neil J. Holbrook, Anthony S. Kiem, Eric C. J. Oliver, Roshanka Ranasinghe, Kevin J. E. Walsh, Seth Westra, and Ron Cox. “Natural hazards in Australia: sea level and coastal extremes”. In: Climatic Change 139.1 (Nov. 2016), pp. 69–83.
Intergovernmental Panel on Climate Change (IPCC). “Climate Change Information for Regional Impact and for Risk Assessment”. In: Climate Change 2021 – The Physical Science Basis: Working Group I Contribution to the Sixth Assessment Report of the Intergovernmental Panel on Climate Change. Cambridge University Press, 2023, pp. 1767–1926.
Michalis I. Vousdoukas, Lorenzo Mentaschi, Evangelos Voukouvalas, Martin Verlaan, Svetlana Jevrejeva, Luke P. Jackson, and Luc Feyen. “Global probabilistic projections of extreme sea levels show intensification of coastal flood hazard”. In: Nature Communications 9.1 (June 2018), p. 2360.
Sebastiaan N. Jonkman, Marten M. Hillen, Robert J. Nicholls, Wim Kanning, and Mathijs van Ledden. “Costs of Adapting Coastal Defences to Sea-Level Rise— New Estimates and Their Implications”. In: Journal of Coastal Research 29.5 (Apr. 2013), pp. 1212–1226.
Stephan Lenk, Diego Rybski, Oliver Heidrich, Richard J. Dawson, and Jürgen P. Kropp. “Costs of sea dikes – regressions and uncertainty estimates”. In: Natural Hazards and Earth System Sciences 17.5 (2017), pp. 765–779.
Shie Mannor. “k-Armed Bandit”. In: Encyclopedia of Machine Learning. Ed. by Claude Sammut and Geoffrey I. Webb. Boston, MA: Springer US, 2010, pp. 561–563.
Adam Paszke, Sam Gross, Francisco Massa, Adam Lerer, James Bradbury, Gregory Chanan, Trevor Killeen, Zeming Lin, Natalia Gimelshein, Luca Antiga, et al. “Pytorch: An imperative style, high-performance deep learning library”. In: Advances in neural information processing systems 32 (2019).
Ilya Loshchilov and Frank Hutter. Decoupled Weight Decay Regularization. 2019.
Diederik P. Kingma and Jimmy Ba. Adam: A Method for Stochastic Optimization. 2017.
Peter J. Huber. “Robust Estimation of a Location Parameter”. In: The Annals of Mathematical Statistics 35.1 (1964), pp. 73–101.
Anders Myhr, Catho Bjerkseter, Anders Agotnes, and Tor A Nygaard. “Levelised cost of energy for offshore floating wind turbines in a life cycle perspective”. In: Renewable Energy 66 (2014), pp. 714–728.
Mahmood Shafiee, Feargal Brennan, and Inés Armada Espinosa. “A parametric whole life cost model for offshore wind farms”. In: International Journal of Life Cycle Assessment 21 (2016), pp. 961–975.
International Renewable Energy Agency. Renewable Energy Statistics 2022. Tech. rep. Abu Dhabi: International Renewable Energy Agency, 2022.
Brian Snyder and Mark J Kaiser. “Ecological and economic cost-benefit analysis of offshore wind energy”. In: Renewable Energy 34 (2009), pp. 1567–1578.
Volker Krey and Leon Clarke. “Role of renewable energy in climate mitigation: a synthesis of recent scenarios”. In: Climate Policy 11.4 (2011), pp. 1131–1158.
Xiaojing Sun, Diangui Huang, and Guoqing Wu. “The current state of offshore wind energy technology development”. In: Energy 41.1 (2012). 23rd International Conference on Efficiency, Cost, Optimization, Simulation and Environmental Impact of Energy Systems, ECOS 2010, pp. 298–312.
Laura Castro-Santos, Almudena Filgueira-Vizoso, Isabel Lamas-Galdo, and Luis Carral-Couce. “Methodology to calculate the installation costs of offshore wind farms located in deep waters”. In: Journal of Cleaner Production 170 (2018), pp. 1124–1135.
C Maienza, A M Avossa, F Ricciardelli, D Coiro, G Troise, and C T Georgakis. “A life cycle cost model for floating offshore wind farms”. In: Applied Energy 266 (2020), p. 114716.
S. Rodrigues, C. Restrepo, E. Kontos, R. Teixeira Pinto, and P. Bauer. “Trends of offshore wind projects”. In: Renewable and Sustainable Energy Reviews 49 (2015), pp. 1114–1135.
C. Ng and L. Ran. “1 - Introduction to offshore wind energy”. In: Offshore Wind Farms. Ed. by Chong Ng and Li Ran. Woodhead Publishing, 2016, pp. 3–8.
Xuefuei Wang, Xiangwu Zeng, Jiale Li, Hu Yang, and Haijun Wang. “A review on recent advancements of substructures for offshore wind turbines”. In: Energy Conversion and Management 158 (2018), pp. 103–119.
Nuno Bento and Margarida Fontes. “Emergence of floating offshore wind energy: Technology and industry”. In: Renewable and Sustainable Energy Reviews 99 (2019), pp. 66–82.
Juan Gabriel Rueda-Bayona, Andres Guzmán, Juan José Cabello Eras, Rodolfo Silva-Casarín, Emilio Bastidas-Arteaga, and José Horrillo-Caraballo. “Renewables energies in Colombia and the opportunity for the offshore wind technology”. In: Journal of Cleaner Production 220 (2019), pp. 529–543.
Richard Green and Nicholas Vasilakos. “The economics of offshore wind”. In: Energy Policy 39.2 (2011). Special Section on Offshore wind power planning, economics and environment, pp. 496–502.
Jonathan Bosch, Iain Staffell, and Adam D Hawkes. “Global levelised cost of electricity from offshore wind”. In: Energy 189 (2019), p. 116357.
Bernd Möller, Lixuan Hong, Reinhard Lonsing, and Frede Hvelplund. “Evaluation of offshore wind resources by scale of development”. In: Energy 48.1 (2012). 6th Dubrovnik Conference on Sustainable Development of Energy Water and Environmental Systems, SDEWES 2011, pp. 314–322.
James Carroll, Alasdair McDonald, Iain Dinwoodie, David McMillan, Matthew Revie, and Iraklis Lazakis. “Availability, operation and maintenance costs of offshore wind turbines with different drive train configurations”. In: Wind Energy 20 (2017), pp. 361–378.
Anastasia Ioannou, Andrew Angus, and Feargal Brennan. “Stochastic Prediction of Offshore Wind Farm LCOE through an Integrated Cost Model”. In: Energy Procedia 107 (2017), pp. 383–389.
Frances Judge, Fiona Devoy McAuliffe, Iver Bakken Sperstad, Rachel Chester, Brian Flannery, Katie Lynch, and Jimmy Murphy. “A lifecycle financial analysis model for offshore wind farms”. In: Renewable and Sustainable Energy Reviews 103 (2019), pp. 370–383.
The Crown State. Offshore wind cost reduction, Pathways Study. The Crown State. 2012.
Benjamin K Sovacool, Peter Enevoldsen, Christian Koch, and Rebecca J Barthelmie. “Cost performance and risk in the construction of offshore and onshore wind farms”. In: Wind Energy 20 (2017), pp. 891–908.
James Carroll, Alasdair McDonald, and David McMillan. “Failure rate, repair time and unscheduled O&M cost analysis of offshore wind turbines”. In: Wind Energy 19 (2016), pp. 1107–1119.
Hugo Díaz, José Miguel Rodrigues, and Carlos Guedes Soares. “Preliminary cost assessment of an offshore floating wind farm installation on the Galician coast”. In: 2016, pp. 843–850.
Laura Castro-Santos and Vicente Diaz-Casas. “Life-cycle cost analysis of floating offshore wind farms”. In: Renewable Energy 66 (2014), pp. 41–48.
dc.rights.en.fl_str_mv Attribution-NonCommercial-NoDerivatives 4.0 International
dc.rights.uri.none.fl_str_mv http://creativecommons.org/licenses/by-nc-nd/4.0/
dc.rights.accessrights.none.fl_str_mv info:eu-repo/semantics/openAccess
dc.rights.coar.none.fl_str_mv http://purl.org/coar/access_right/c_abf2
rights_invalid_str_mv Attribution-NonCommercial-NoDerivatives 4.0 International
http://creativecommons.org/licenses/by-nc-nd/4.0/
http://purl.org/coar/access_right/c_abf2
eu_rights_str_mv openAccess
dc.format.extent.none.fl_str_mv 230 páginas
dc.format.mimetype.none.fl_str_mv application/pdf
dc.publisher.none.fl_str_mv Universidad de los Andes
dc.publisher.program.none.fl_str_mv Doctorado en Ingeniería
dc.publisher.faculty.none.fl_str_mv Facultad de Ingeniería
dc.publisher.department.none.fl_str_mv Departamento de Ingeniería Civil y Ambiental
publisher.none.fl_str_mv Universidad de los Andes
institution Universidad de los Andes
bitstream.url.fl_str_mv https://repositorio.uniandes.edu.co/bitstreams/e0eefb6d-a25e-44fd-b7c3-f8830ba82f2a/download
https://repositorio.uniandes.edu.co/bitstreams/52fcae1d-e3f3-463f-a674-dcc914764354/download
https://repositorio.uniandes.edu.co/bitstreams/3374de5c-3f03-40d0-943e-457fb04576ce/download
https://repositorio.uniandes.edu.co/bitstreams/0766b331-f719-4f17-a179-065c59aa7832/download
https://repositorio.uniandes.edu.co/bitstreams/b7cc8964-1a8e-482c-886a-76611d76e3ba/download
https://repositorio.uniandes.edu.co/bitstreams/c862833a-db2a-4507-b074-8b3c6c7636ad/download
https://repositorio.uniandes.edu.co/bitstreams/61cc96c0-edb4-4cc3-a8cd-9965cb5b4662/download
https://repositorio.uniandes.edu.co/bitstreams/8bc74697-63ee-4e7d-9968-13d2481405be/download
bitstream.checksum.fl_str_mv 29ac603101abbc60c78776808d835b4b
db8056f306d69aa73d07930a2bbf4d44
4460e5956bc1d1639be9ae6146a50347
ae9e573a68e7f92501b6913cc846c39f
2b620d2557ca9dd5f5d3912a64679dde
45eb3f04bf7adf838f816dd8366c25b9
665d15440af375d5ac0fabad1542f88e
09069f052ae01d95d08486ed4f5faeda
bitstream.checksumAlgorithm.fl_str_mv MD5
MD5
MD5
MD5
MD5
MD5
MD5
MD5
repository.name.fl_str_mv Repositorio institucional Séneca
repository.mail.fl_str_mv adminrepositorio@uniandes.edu.co
_version_ 1818111881935585280
spelling Sánchez Silva, Edgar Mauriciovirtual::19651-1Torres Rincón, Samuel FernandoMedaglia González, Andrés L.Gómez Castro, Camilo HernandoDamnjanovic, IvánBastidas Arteaga, Edgar EmilioFacultad de Ingeniería::Geomateriales y Sistemas de Infraestructura2024-08-02T19:34:23Z2024-08-02T19:34:23Z2024-05-31https://hdl.handle.net/1992/7492710.57784/1992/74927instname:Universidad de los Andesreponame:Repositorio Institucional Sénecarepourl:https://repositorio.uniandes.edu.co/This dissertation presents a framework for the long-term planning of infrastructure subject to conditions of deep uncertainty based on the concept of flexibility. The proposed framework combines ideas and methodologies from two fields that have evolved mostly separately from each other: decision-making under deep uncertainty (DMDU) and flexibility analysis. Concretely, existing DMDU methods do not consider technical options for the adaptation of infrastructure systems, while the complex issue of deep uncertainty has been overlooked in most flexibility analysis approaches. This work aims to address this gap by presenting a design framework that explicitly considers technical options that enable adaptations to the system and tests their performance under a diverse set of external conditions to account for the deep uncertainty ever present in long-term planning.  In particular, the proposed framework combines exploratory modeling with reinforcement learning to find policies that are robust over many different futures. The framework also introduces a quantitative measure of flexibility that characterizes the adaptation potential using a vector in $\mathbb{R}^{2}$. Combined with the results from the exploratory modeling simulations, this representation can be used to determine the value provided by flexibility. In addition to the technical options that enable flexibility, the framework also considers different policies that control the adaptation of the system depending on the evolution of the uncertain conditions and the stakeholders' preferences.  The framework utilizes multiple models for the system and the environment to consider both internal and external uncertainty. Using a scenario generator, it simulates the interaction between the system and several external conditions to produce various economic and technical outcomes. Based on these outcomes, potential designs and policies are identified; then, using scenario discovery methods, it finds subsets of environmental conditions that cause these policies to fail. Next, it uses reinforcement learning to improve upon these policies, first under the challenging environments and later under the full ensemble of conditions. The purpose is to understand the limitations of the options as well as find key features that could be used to devise new and more robust policies and designs.  Two examples are used to demonstrate the framework. The first case considers a sea-dike under uncertainty of rising sea level. The objective is to find the design and adaptation policies that fulfill strict safety criteria while keeping costs low. Several flexible and non-flexible design options are analyzed; each flexible option is represented by an initial and a maximum height, while the non-flexible options keep their particular size constant. The results show that the staggered expansion of the dike can provide economic benefits without affecting the reliability of the structure.Vicerrectoría de InvestigacionesDoctorado230 páginasapplication/pdfengUniversidad de los AndesDoctorado en IngenieríaFacultad de IngenieríaDepartamento de Ingeniería Civil y AmbientalAttribution-NonCommercial-NoDerivatives 4.0 Internationalhttp://creativecommons.org/licenses/by-nc-nd/4.0/info:eu-repo/semantics/openAccesshttp://purl.org/coar/access_right/c_abf2A framework for the long-term planning of infrastructure based on flexibilityTrabajo de grado - Doctoradoinfo:eu-repo/semantics/doctoralThesisinfo:eu-repo/semantics/acceptedVersionhttp://purl.org/coar/resource_type/c_db06Texthttps://purl.org/redcol/resource_type/TDFlexibilityAdaptabilityDeep uncertaintyInfrastructureIngenieríaSamuel Torres and Mauricio Sánchez-Silva. “Review of Flexibility Measures for the Design and Operation of Infrastructure”. In: Proceedings of the Sixth International Symposium on Reliability Engineering and Risk Management (Singapore). Ed. by X.D. Qian, S.D. Pang, G.P. Ong, and K.K. Phoon Phoon. Research Publishing, 31 May–1 June 2018, pp. 531–536.Samuel Torres and Mauricio Sánchez-Silva. “A discussion on the need for flexibility in infrastructure development”. In: Life Cycle Analysis and Assessment in Civil Engineering: Towards an Integrated Vision (Ghent, Belgium). Ed. by Robby Caspeele, Luc Taerwe, and Dan Frangopol. CRC Press, Oct. 2018, pp. 907–914.Samuel Torres-Rincón, Mauricio Sánchez-Silva, and Daniel F. Villarraga. “Incorporating Flexibility in Life-cycle Analysis of Infrastructure”. In: Towards a Resilient Built Environment- Risk and Asset Management (Guimaraes, Portugal). Ed. by IABSE. Curran Associates, Mar. 2019, pp. 841–848.Samuel Torres-Rincón, Mauricio Sánchez-Silva, and Daniel F. Villarraga. “A Multistage Stochastic Model for the Management of Flexibility in Infrastructure Systems”. In: Proceedings of the 13th International Conference on Applications of Statistics and Probability in Civil Engineering(ICASP13) (Seoul,South Korea). May 2019, pp. 481–488.Samuel Torres-Rincón, Daniel Francisco Villarraga, and Mauricio Sánchez Silva. “Conceptual and Numerical Analysis of Flexibility in Infrastructure Systems”. In: Journal of Infrastructure Systems 26.2 (2020), p. 04020012.Samuel Torres-Rincón, Mauricio Sánchez-Silva, and Emilio Bastidas-Arteaga. “A multistage stochastic program for the design and management of flexible infrastructure networks”. In: Reliability engineering & system safety 210 (2021), p. 107549.Samuel Torres-Rincón, Emilio Bastidas-Arteaga, and Mauricio Sánchez-Silva. “A flexibility-based approach for the design and management of floating off shore wind farms”. In: Renewable Energy 175 (2021), pp. 910–925.Samuel Torres-Rincón and Mauricio Sánchez-Silva. “A Reinforcement Learning-based Approach for the Design and Management of Flexible Engineering Assets under Deep Uncertainty”. In: In preparation (In prep.).Dan Guo, Ming Shan, and Emmanuel Kingsford Owusu. “Resilience Assessment Frameworks of Critical Infrastructures: State-of-the-Art Review”. In:Buildings 11.10 (2021), p. 464.Adel Mottahedi, Farhang Sereshki, Mohammad Ataei, Ali Nouri Qarahasanlou, and Abbas Barabadi. “The Resilience of Critical Infrastructure Systems: A Systematic Literature Review”. In: Energies 14.6 (2021), p. 1571.Krishna B Khatri. “Current State and Future Direction for Building Resilient Water Resources and Infrastructure Systems”. In: Eng 3.1 (2022), pp. 175 195.Warren E. Walker, Marjolijn Haasnoot, and Jan H. Kwakkel. “Adapt or Perish: A Review of Planning Approaches for Adaptation under Deep Uncertainty”. In: Sustainability 5.3 (2013), pp. 955–979.ASCE. Climate-Resilient Infrastructure. Ed. by Bilal M. Ayyub. American Society of Civil Engineers, 2018.Myles R. Allen and William J. Ingram. “Constraints on future changes in climate and the hydrologic cycle”. In: Nature 419.6903 (Sept. 2002), pp. 224 232.David R.Easterling, Gerald A. Meehl, Camille Parmesan, Stanley A. Changnon, Thomas R. Karl, and Linda O. Mearns. “Climate Extremes: Observations,Modeling, and Impacts”. In: Science 289.5487 (Sept. 22, 2000), pp. 2068 2074.Xuebin Zhang, Hui Wan, Francis W. Zwiers, Gabriele C. Hegerl, and Seung Ki Min. “Attributing Intensification of Precipitation Extremes to Human Influence”. In: Geophysical Research Letters 40.19 (Oct. 16, 2013), pp. 5252 5257.Stephanie C. Herring, Nikolaos Christidis, Andrew Hoell, Martin P. Hoerling, and Peter A. Stott. “Explaining Extreme Events of 2017 from a Climate Perspective”. In: Bulletin of the American Meteorological Society 100.1 (2019), S1–S117.Geert Jan Van Oldenborgh, Karin Van Der Wiel, Antonia Sebastian, Roop Singh, Julie Arrighi, Friederike Otto, Karsten Haustein, Sihan Li, Gabriel Vecchi, and Heidi Cullen. “Attribution of Extreme Rainfall from Hurricane Harvey, August 2017”. In: Environmental Research Letters 12.12 (Dec. 1, 2017), p. 124009.Nikhil Kumar, Vikas Poonia, B.B. Gupta, and Manish Kumar Goyal. “A novel framework for risk assessment and resilience of critical infrastructure towards climate change”. In: Technological Forecasting and Social Change 165 (2021), p. 120532.IPCC. Climate Change 2022: Impacts, Adaptation and Vulnerability. Summary for Policymakers. Cambridge, UK and New York, USA: Cambridge University Press, 2022, pp. 3–33.Roger B Street and Carin Nilsson. “Introduction to the Use of Uncertainties to Informa Adaptation Decisions”. In: Adapting to an Uncertain Climate: Lessons From Practice. Ed. by Tiago Capela, Ana Rovisco, Annemarie Groot, Carin Nilsson, Hans-Martin Füssel, Leendert van Bree, and Roger B Street. Springer, 2014. Chap. 1, pp. 1–16.Muriel C. Bonjean Stanton and Katy Roelich. “Decision Making under Deep Uncertainties: A Review of the Applicability of Methods in Practice”. In: Technological Forecasting and Social Change 171 (Oct. 2021), p. 120939.Tyson R. Browning and Eric C. Honour. “Measuring the Life-Cycle Value of Enduring Systems”. In: Syst Eng 11.3 (2008), pp. 187–202.Filip Babovic, Ana Mijic, and Kaveh Madani. “Decision Making under Deep Uncertainty for Adapting Urban Drainage Systems to Change”. In: Urban Water Journal 15.6 (July 3, 2018), pp. 552–560.Mauricio Sánchez-Silva. “Managing Infrastructure Systems through Changeability”. In: Journal of Infrastructure Systems 25.1 (2019), p. 04018040.Robert J. Lempert, Steven W. Popper, and Steven C. Bankes. Shaping the next One Hundred Years: New Methods for Quantitative, Long-Term Policy Analysis. Santa Monica, CA: RAND, 2003. 187 pp. [35] Shirin Malekpour, Warren E. Walker, Fjalar J. De Haan, Niki Frantzeskaki, and Vincent A.W.J. Marchau. “Bridging Decision Making under Deep Uncertainty (DMDU) and Transition Management (TM) to Improve Strategic Planning for Sustainable Development”. In: Environmental Science & Policy 107 (May 2020), pp. 158–167.Vincent A W J Marchau,Warren E Walker,Peter J T M Bloemen,and Steven W Popper. “Introduction”. In: Decision Making under Deep Uncertainty: From Theory to Practice. Ed. by Vincent A W J Marchau, Warren E Walker, Peter J T M Bloemen, and Steven W Popper. Springer, 2019. Chap. 1, pp. 122.Jerrel R Yzer, Warren E Walker, Vincent A W J Marchau, and Jan H Kwakkel. “Dynamic Adaptive Policies: A Way to Improve the Cost—Benefit Performance of Megaprojects?” In: Environment and Planning B: Planning and Design 41.4 (Aug. 2014), pp. 594–612.Enayat A. Moallemi, Sondoss Elsawah, and Michael J. Ryan. “Robust Decision Making and Epoch–Era Analysis: A Comparison of Two Robustness Frameworks for Decision-Making under Uncertainty”. In: Technological Forecasting and Social Change 151 (Feb. 2020), p. 119797.ASCE. Adapting Infrastructure and Civil Engineering Practice to a Changing Climate. Ed. by J. Rolf Olsen. American Society of Civil Engineers, 2015.Samuel A. Markolf, Christopher Hoehne, Andrew Fraser, Mikhail V. Chester, and B. Shane Underwood. “Transportation resilience to climate change and extreme weather events– Beyond risk and robustness”. In: Transport Policy 74 (2019), pp. 174–186.Marie Buhl and S. Markolf. “A review of emerging strategies for incorporating climate change considerations into infrastructure planning, design, and decision making”. In: Sustainable and Resilient Infrastructure 8.sup1 (2023), pp. 157–169.Richard De Neufville and Stefan Scholtes. Flexibility in Engineering Design. English. 2011.Mohammad Mortazavi-Naeini, George Kuczera, and Lijie Cui. “Application of multiobjective optimization to scheduling capacity expansion of urban water resource systems”. In: Water Resources Research 50 (2014), pp. 4624-4642.Caetano C.S. Fraga, Josué Medellín-Azuara, and Guilherme F Marques. “Planning for infrastructure capacity expansion of urban water supply portfolios with an integrated simulation-optimization approach”. In: Sustainable Cities and Society 29 (2017), pp. 247–256.Tohid Erfani, Kevis Pachos, and Julien J. Harou. “Real-Options Water Supply Planning: Multistage Scenario Trees for Adaptive and Flexible Capacity Expansion Under Probabilistic Climate Change Uncertainty”. In: Water Resources Research 54 (2018), pp. 5069–5087.Mikhail V Chester and Braden Allenby. “Toward adaptive infrastructure: flexibility and agility in a non-stationarity age”. In: Sustainable and Resilient Infrastructure 4.4 (2019), pp. 173–191.Richard DeNeufville. “Real Options: Dealing With Uncertainty in Systems Planning and Design”. In: Integrated Assessment 4.1 (2003), pp. 26–34.Ernst Fricke and Armin P Schulz. “Design for Changeability (DfC): Principies To Enable Changes in Systems Throughout Their Entire Lifecycle”. In: Systems Engineering 8.4 (2005), pp. 342–359.Michel-Alexandre Cardin, Mehdi Ranjbar-Bourani, and Richard De Neufville. “Improving the Lifecycle Performance of Engineering Projects with Flexible Strategies: Example of On-Shore LNG Production Design”. In: Systems Engineering 18.3 (2015), pp. 253–268.Joseph H Saleh, Gregory Mark, and Nicole C Jordan. “Flexibility : a multidisciplinary literature review and a research”. In: Journal of Engineering Design 20.3 (2009), pp. 307–323.Amro Nasr, Oskar Larsson Ivanov, Ivar Björnsson, and Dániel Honfi. “Towards a Conceptual Framework for Built Infrastructure Design in an Uncertain Climate: Challenges and Research Needs”. In: Sustainability 13 (2021), p. 11827.Jingke Hong, Geoffrey Qiping Shen, Yong Feng, William Sin-tong Lau, and Chao Mao. “Greenhouse gas emissions during the construction phase of a building: a case study in China”. In: Journal of Cleaner Production 103 (2015). Carbon Emissions Reduction: Policies, Technologies, Monitoring, Assessment and Modeling, pp. 249–259.Robert Lempert, Nebojsa Nakicenovic, Daniel Sarewitz, and Michael Schlesinger. “Characterizing Climate-Change Uncertainties for Decision-Makers. An Editorial Essay”. In: Climatic Change 65.1/2 (July 2004), pp. 1–9.Casey Helgeson. “Structuring Decisions Under Deep Uncertainty”. In: Topoi 39.2 (Apr. 2020), pp. 257–269.Kim Smet. “Engineering Options: A Proactive Planning Approach for Aging Water Resource Infrastructure Under Uncertainty”. PhD thesis. Harvard University, 2017.Richard de Neufville and Kim Smet. “Enginnering Options Analysis (EOA)”. In: Decision Making under Deep Uncertainty: From Theory to Practice. Ed. by Vincent A W J Marchau, Warren E Walker, Peter J T M Bloemen, and Steven W Popper. Springer, 2019. Chap. 6, pp. 117–132.Xian Yeow Lee, Aditya Balu, Daniel Stoecklein, Baskar Ganapathysubramanian, and Soumik Sarkar. “A Case Study of Deep Reinforcement Learning for Engineering Design: Application to Microfluidic Devices for Flow Sculpting”. In: Journal of Mechanical Design 141.11 (Nov. 1, 2019), p. 111401.A.T.D.Perera, P.U. Wickramasinghe, Vahid M. Nik, and Jean-Louis Scartezzini. “Introducing Reinforcement Learning to the Energy System Design Process”. In: Applied Energy 262 (Mar. 2020), p. 114580.Cesare Caputo and Michel-Alexandre Cardin. “Analyzing Real Options and Flexibility in Engineering Systems Design Using Decision Rules and Deep Reinforcement Learning”. In: Journal of Mechanical Design 144.2 (Feb. 1, 2022), p. 021705.Sergio Hernández-García, Alfredo Cuesta-Infante, José Ángel Moreno-SanSegundo, and Antonio S. Montemayor. “Deep Reinforcement Learning for Automated Search of Model Parameters: Photo-Fenton Wastewater Disinfection Case Study”. In: Neural Computing and Applications 35.2 (Jan. 2023), pp. 1379-1394.B. Flyvbjerg, A. Ansar, A. Budzier, S. Buhl, C. Cantarelli, M. Garbuio, C. Glenting, Holm S., D. Lovallo, D. Lunn, E. Molin, A. Rønnest, A. Stewart, and B. Weeh. “Five things you should know about cost overrun”. In: Transport Research Part A: Policy and Practice 118 (2018), pp. 174–190.Berry Gersonius, Richard Ashley, Assela Pathirana, and Chris Zevenbergen. “Climate change uncertainty: Building flexibility into water and flood risk infrastructure”. In: Climate Change 116.2 (2013), pp. 411–423.Ioannis Nicolaos Kessides. Reforming infrastructure: Privatization, regulation, and competition. World Bank Publications, 2004.Enrico Zio. “Challenges in the vulnerability and risk analysis of critical infrastructures”. In: Reliability Engineering & System Safety 152 (2016), pp. 137-150.RonaldInglehart. Modernization and Postmodernization: Cultural, Economic, and Political Change in 43 Societies. Princeton University Press, 1997.Mark R Montgomery, National Research Council, et al. Cities transformed: demographic change and its implications in the developing world. Tech. rep. National Academy Press, 2003.Dov Friedlander. “Demographic responses and population change”. In: Demography 6.4 (1969), pp. 359–381.David Lam. “How the world survived the population bomb: Lessons from 50 years of extraordinary demographic history”. In: Demography 48.4 (2011), pp. 1231–1262.OU Qiong. “A brief introduction to perception”. In: Studies in literature and language 15.4 (2017), pp. 18–28.Calvin Clark, Patricia Mokhtarian, Giovanni Circella, and Kari Watkins. “User preferences for bicycle infrastructure in communities with emerging cycling cultures”. In: Transportation research record 2673.12 (2019), pp. 89-102.Peter Ester, Ludwig Braun, and Peter Mohler. Globalization, Value Change and Generations: a cross-national and intergenerational perspective. Vol. 10. Brill, 2006.M.D. Gerst, P. Wang, and M.E. Borsuk. “Discovering Plausible Energy and Economic Futures under Global Change Using Multidimensional Scenario Discovery”. In: Environmental Modelling & Software 44 (June 2013), pp. 76-86.Xiaolong Xue, Ruixue Zhang, Rebecca Yang, and Jason Dai. “Innovation in construction: A critical review and future research”. In: International Journal of Innovation Science 6.2 (2014), pp. 111–126.Aletha M Blayse and Karen Manley. “Key influences on construction innovation”. In: Construction innovation 4.3 (2004), pp. 143–154.Kenichi Soga and Jennifer Schooling. “Infrastructure sensing”. In: Interface focus 6.4 (2016), p. 20160023.Francesco Flammini, Concetta Pragliola, and Giovanni Smarra. “Railway infrastructure monitoring by drones”. In: 2016 International Conference on Electrical Systems for Aircraft, Railway, Ship Propulsion and Road Vehicles & International Transportation Electrification Conference (ESARS-ITEC). IEEE. 2016, pp. 1–6.Theodore Zahariadis, Artemis Voulkidis, Panagiotis Karkazis, and Panagiotis Trakadas. “Preventive maintenance of critical infrastructures using 5G networks & drones”. In: 2017 14th IEEE International Conference on Advanced Video and Signal Based Surveillance (AVSS). IEEE. 2017, pp. 1–4.Frank Hyneman Knight. Risk, uncertainty and profit. Vol. 31. Houghton Mifflin, 1921.W.E. Walker, P. Harremoës, J. Rotmans, J.P. Van Der Sluijs, M.B.A. Van Asselt, P. Janssen, and M.P. Krayer Von Krauss. “Defining Uncertainty: A Conceptual Basis for Uncertainty Management in Model-Based Decision Support”. In: Integrated Assessment 4.1 (Mar. 2003), pp. 5–17.Christopher P Weaver, Robert J Lempert, Casey Brown, John A Hall, David Revell, and Daniel Sarewitz. “Improving the contribution of climate model information to decision making: the value and demands of robust decision frameworks”. In: Wiley Interdisciplinary Reviews: Climate Change 4.1 (2013), pp. 39–60.Adam M Ross, Donna H Rhodes, and Daniel E Hastings. “Defining Changeability : Reconciling Flexibility , Adaptability , Scalability , Modifiability , and Robustness for Maintaining System Lifecycle Value”. In: Systems Engineering 11.3 (2008), pp. 246–262.John Von Neumann and Oskar Morgenstern. Theory of games and economic behavior. 2nd ed. Princeton university press, 1947.Olaf Helmer et al. Analysis of the future: The Delphi method. 1967.James A Dewar,Carl H Builder,William M Hix,and Morlie H Levin. Assumption based planning: a planning tool for very uncertain times. Rand, 1993.James A Dewar. Assumption-based planning: A tool for reducing avoidable surprises. Cambridge University Press, 2002.Steve Bankes. “Exploratory Modeling for Policy Analysis”. In: Operations Research 41.3 (June 1993), pp. 435–449.Steve Bankes, Warren E. Walker, and Jan H. Kwakkel. “Exploratory Modeling and Analysis”. In: Encyclopedia of Operations Research and Management Science. Ed. by Saul I. Gass and Michael C. Fu. Boston, MA: Springer US, 2013, pp. 532–537.Robert J Lempert, David G Groves, Steven W Popper, and Steve C Bankes. “A general, analytic method for generating robust strategies and narrative scenarios”. In: Management science 52.4 (2006), pp. 514–528.Yakov Ben-Haim. Information-gap Decision Theory: Decisions Under Severe Uncertainty. Academic Press Series on Decision and Risk. Academic Press, 2001.Yakov Ben-Haim. “Info-Gap Decision Theory (IG)”. In: Decision Making under Deep Uncertainty: From Theory to Practice. Ed. by Vincent A W J Marchau, Warren E Walker, Peter J T M Bloemen, and Steven W Popper. Springer, 2019. Chap. 5, pp. 93–115.Warren E. Walker, S. Adnan Rahman,and Jonathan Cave. “Adaptive Policies, Policy Analysis, and Policy-Making”. In: European Journal of Operational Research 128.2 (Jan. 2001), pp. 282–289.Lenos Trigeorgis. Real options: Managerial flexibility and strategy in resource allocation. MIT press, 1996.Richard De Neufville, Stefan Scholtes, and Tao Wang. “Real options by spreadsheet: parking garage case example”. In: Journal of infrastructure systems 12.2 (2006), pp. 107–111.James A Dewar and Morlie H Levin. Assumption-based planning for Army 21. Rand, 1992.John E Peters, Eric Victor Larson, and James A Dewar. Futures Intelligence: Assessing Intelligence Support to Three Army Long-range Planning Communities. Rand, 1998.D Groves, E Bloom, J R Fischbach, and D Knopman. “Adapting to a Changing Colorado River: Making Future Water Deliveries More Reliable Through Robust Management Strategies”. In: AGU Fall Meeting Abstracts 2013 (2013), H41K–1407.David Hadka, Jonathan Herman, Patrick Reed, and Klaus Keller. “An open source framework for many-objective robust decision making”. In: Environmental Modelling & Software 74 (2015), pp. 114–129.Robert Lempert, Nidhi Kalra, Suzanne Peyraud, Zhimin Mao, Sinh Bach Tan, Dean Cira, and Alexander Lotsch. “Ensuring robust flood risk management in Ho Chi Minh City”. In: World Bank Policy Research Working Paper 6465 (2013).Suvendi Chinnappen-Rimer and Gerhard P Hancke. “Actor coordination using info-gap decision theory in wireless sensor and actor networks”. In: International Journal of Sensor Networks 10.4 (2011), pp. 177–191.Dylan R Harp and Velimir V Vesselinov. “Contaminant remediation decision analysis using information gap theory”. In: Stochastic environmental research and risk assessment 27 (2013), pp. 159–168.Vincent AWJ Marchau, Warren E Walker, and GP Van Wee. “Dynamic adaptive transport policies for handling deep uncertainty”. In: Technological forecasting and social change 77.6 (2010), pp. 940–950.B Gersonius, R Ashley, A Jeuken, A Pathinara, and C Zevenbergen. “Accounting for uncertainty and flexibility in flood risk management: comparing Real-In-Options optimisation and Adaptation Tipping Points”. In: Journal of Flood Risk Management 8.2 (2015), pp. 135–144.Scott A Stephens, Robert G Bell, and Judy Lawrence. “Developing signals to trigger adaptation to sea-level rise”. In: Environmental Research Letters 13.10 (2018), p. 104004.Judy Lawrence and Marjolijn Haasnoot. “What it took to catalyse uptake of dynamic adaptive pathways planning to address climate change uncertainty”. In: Environmental Science & Policy 68 (2017), pp. 47–57.Miriam Esders, Nicola Della Morte, and B Adey. “A methodology to ensure the consideration of flexibility and robustness in the selection of facility renewal projects”. In: International Journal of Architecture, Engineering and Construction 4.3 (2015), pp. 126–139.David Geltner and Richard De Neufville. Flexibility and Real Estate Valuation under Uncertainty: A Practical Guide for Developers. Hoboken, NJ: John Wiley & Sons, 2018. 1 p.Erin T Ryan,David R Jacques, and John M Colombi.“An Ontological Framework for Clarifying Flexibility-Related Terminology via Literature Survey”. In: Systems Engineering 16.1 (2013), pp. 99–110.James E.Neumann,Paul Chinowsky, Jacob Helman, Margaret Black, Charles Fant, Kenneth Strzepek, and Jeremy Martinich. “Climate Effects on US Infrastructure: The Economics of Adaptation for Rail, Roads, and Coastal Development”. In: Climatic Change 167.3-4 (Aug. 2021), p. 44.Kara N. Difrancesco and Desiree D. Tullos. “Assessment of Flood Management Systems’ Flexibility with Application to the Sacramento River Basin, California, USA”. In: International Journal of River Basin Management 13.3 (July 3, 2015), pp. 271–284.Junfei Hu and Michel-Alexandre Cardin. “Generating Flexibility in the Design of Engineering Systems to Enable Better Sustainability and Lifecycle Performance”. In: Research in Engineering Design 26.2 (Apr. 2015), pp. 121-143.Marjolijn Haasnoot, Gundula Winter, Sally Brown, Richard J. Dawson, Philip J. Ward, and Dirk Eilander. “Long-Term Sea-Level Rise Necessitates a Commitment to Adaptation: A First Order Assessment”. In: Climate Risk Management 34 (2021), p. 100355.Nayled Acuña-Coll and Mauricio Sánchez-Silva. “Integrating Systems Thinking and Flexibility in Infrastructure Management”. In: Innovative Infrastructure Solutions 8.5 (May 2023), p. 144.Walter Louis II Barnes. “Enabling flexibility through strategic management of complex engineering systems”. PhD thesis. Missouri University of Science and Technology, 2020.Stephen J. Sapol and Zoe Szajnfarber. “Revisiting Flexibility in Design: An Analysis of the Impact of Implementation Uncertainty on the Value of Real Options”. In: Journal of Mechanical Design 142.12 (Dec. 1, 2020), p. 121701.Albert Gailord Hart. “Anticipations, Business Planning, and the Cycle”. In: The Quarterly Journal of Economics 51.2 (Feb. 1937), p. 273.Dragutin M Zelenović. “Flexibility a Condition for Effective Production Systems”. In: International Journal of Production Research 20.3 (1982), pp. 319-337.R. E. Swaney and I. E. Grossmann. “An Index for Operational Flexibility in Chemical Process Design. Part 2: Computational Algorithms”. In: AIChE Journal 31.4 (1985), pp. 631–641.Efstratios N Pistikopoulos and T Mazzuchi. “A Novel Flexibility Analysis Approach for Processes with Stochastic Parameters”. In: Computers & Chemical Engineering 14.9 (1990), pp. 991–1000.Lenos Trigeorgis and S. P. Mason. Valuing Managerial Flexibility.Stefan H. Thomke. “The Role of Flexibility in the Development of New Products: An Empirical Study”. In: Research Policy 26.1 (Mar. 1997), pp. 105-119.Ronald Sanchez. “Strategic Flexibility, Real Options, and Product Based Strategy”. PhD thesis. Massachusets Institute of Technology, 1991.Tao Wang. “Real Options "in" Projects and Systems Design- Identification of Options and Solution for Path Dependency”. PhD thesis. Massachusets Institute of Technology, 2005.Andrew Olewnik and Kemper Lewis. “A decision support framework for flexible system design”. In: Journal of Engineering Design 17.1 (2006), pp. 75-97.Roshanak Nilchiani and Daniel Hastings. “Measuring the Value of Flexibility in Space Systems: A Six-Element Framework”. In: Systems Engineering 10.1 (2007), pp. 26–44.Matthew Fitzgerald. “Managing Uncertainty in Systems with a Valuation Approach for Strategic Changeability”. M.S. thesis. Massachusetts Institute of Technology, 2012, p. 144.Karl Terzaghi and Ralph B Peck. “Soil mechanics”. In: Engineering Practice. John Wiley and Sons, Inc., New York (1948).Ralph B Peck. “Advantages and limitations of the observational method in applied soil mechanics”. In: Geotechnique 19.2 (1969), pp. 171–187.Dinesh Patel, D Nicholson, N Huybrechts, and J Maertens. “The observational method in geotechnics”. In: Proceedings of XIV European Conference on Soil Mechanics and Geotechnical Engineering, Madrid. 2007, pp. 24–27.M Korff, E De Jong, and T Bles. “SWOT analysis observational method applications”. In: Proceedings of the 18th International Conference on Soil Mechanics and Geotechnical Engineering. 2013, pp. 1883–1888.Olga Špačková and Daniel Straub. “Long-term adaption decisions via fully and partially observable Markov decision processes”. In: Sustainable and Resilient Infrastructure 2.1 (2017), pp. 37–58.Sarah Fletcher, Kenneth Strzepek, Adnan Alsaati, and Olivier De Weck. “Learning and Flexibility for Water Supply Infrastructure Planning under Groundwater Resource Uncertainty”. In: Environmental Research Letters 14.11 (Nov. 1, 2019), p. 114022.Jonathan Metzger, Annika Carlsson Kanyama, Per Wikman-Svahn, Karin Mossberg Sonnek, Christoffer Carstens, Misse Wester, and Christoffer Wedebrand. “The Flexibility Gamble: Challenges for Mainstreaming Flexible Approaches to Climate Change Adaptation”. In: Journal of Environmental Policy & Planning 23.4 (July 4, 2021), pp. 543–558.Peter Linquiti and Nicholas Vonortas. “The value of flexibility in adapting to climate change: a real options analysis of investments in coastal defense”. In: Climate Change Economics 03.02 (May 2012), p. 1250008.Vinod Kumar. “Entropic Measures of Manufacturing Flexibility”. In: International Journal of Production Research 25.7 (July 1987), pp. 957–966.William Golden and Philip Powell. “Towards a definition of flexibility: in search of the Holy Grail?” In: Omega 28.4 (2000), pp. 373–384.Özlen Erkal Sönmez and Vehbi Tufan Koç. “On quantifying manufacturing flexibility: An entropy based approach”. In: Proceedings of the world congress on engineering. Vol. 2. 2015, pp. 1–3.Carmine Cavalliere, Guido Raffaele Dell’Osso, Fausto Favia, and Marco Lovicario. “BIM-based Assessment Metrics for the Functional Flexibility of Building Designs”. In: Automation in Construction 107 (Nov. 2019), p. 102925.Olga Špačková, Beatrice Dittes, and Daniel Straub. “Risk based Optimization of Adaptable Protection Measures Against Natural Hazards”. In: 12th International Conference on Applications of Statistics and Probability in Civil Engineering, ICASP12. 2015.E K Morlok and D J Chang. “Measuring capacity flexibility of a transportation system”. In: Transportation Research Part A 38.6 (2004), pp. 405–420.Péter Babarczi, Markus Klügel, Alberto Martínez Alba, Mu He, Johannes Zerwas, Patrick Kalmbach, Andreas Blenk, and Wolfgang Kellerer. “A mathematical framework for measuring network flexibility”. In: Computer Communications 164 (2020), pp. 13–24.Adam M. Ross. “Managing Unarticulated Value: Changeability in MultiAttribute Tradespace Exploration”. PhD thesis. Massachusets Institute of Technology, 2006.Jochen Eckart. Flexible Urban Drainage Systems in New Land-Use Areas. University of South Florida, 2012.Nathan D Niese and David J Singer. “Assessing changeability under uncertain exogenous disturbance”. In: Res Eng Des 25 (2014), pp. 241–258.Carl F. Rehn, Sigurd S. Pettersen, Jose J. Garcia, Per O. Brett, Stein O. Erikstad, Bjørn E. Asbjørnslett, Adam M. Ross, and Donna H. Rhodes. “Quantification of Changeability Level for Engineering Systems”. In: Systems Engineering 22.1 (Jan. 2019), pp. 80–94.Mu He, Alberto Martinez Alba, Arsany Basta, Andreas Blenk, and Wolfgang Kellerer. “Flexibility in Softwarized Networks: Classifications and Research Challenges”. In: IEEE Communications Surveys & Tutorials 21.3 (Aut. 2019), pp. 2600–2636.Diane M. Lander David N. Ford and John J. Voyer. “A real options approach to valuing strategic flexibility in uncertain construction projects”. In: Construction Management and Economics 20.4 (2002), pp. 343–351.José Martins, Rui Cunha Marques, and Carlos Oliveira Cruz. “Real Options in Infrastructure: Revisiting the Literature”. In: Journal of Infrastructure Systems 21.1 (Mar. 2015), p. 04014026.B. Gersonius, T. Morselt, L. Van Nieuwenhuijzen, R. Ashley, and C. Zevenbergen. “How the Failure to Account for Flexibility in the Economic Analysis of Flood Risk and Coastal Management Strategies Can Result in Maladaptive Decisions”. In: Journal of Waterway, Port, Coastal, and Ocean Engineering 138.5 (Sept. 2012), pp. 386–393.Luis A. Gomez Cunya, Hyun Woo Lee, and Arturo S. Leon. “A Real Options Based Framework to Evaluate Investments in River Flood Control under Uncertainty”. In: Vulnerability, Uncertainty, and Risk, pp. 1465–1474.A. Kontogianni, C.H. Tourkolias, D. Damigos, and M. Skourtos. “Assessing Sea Level Rise Costs and Adaptation Benefits under Uncertainty in Greece”. In: Environmental Science & Policy 37 (Mar. 2014), pp. 61–78.Taeil Park, Changyoon Kim, and Hyoungkwan Kim. “Valuation of Drainage Infrastructure Improvement Under Climate Change Using Real Options”. In: Water Resources Management 28.2 (Jan. 2014), pp. 445–457.Michelle Woodward, Zoran Kapelan, and Ben Gouldby. “Adaptive Flood Risk Management Under Climate Change Uncertainty Using Real Options and Optimization”. In: Risk Analysis 34.1 (2014), pp. 75–92.Miyuki Hino and Jim W. Hall. “Real Options Analysis of Adaptation to Changing Flood Risk: Structural and Nonstructural Measures”. In: ASCE-ASME Journal of Risk and Uncertainty in Engineering Systems, Part A: Civil Engineering 3.3 (Sept. 2017), p. 04017005.Mengke Ni and Tohid Erfani. “Adaptive Short-Term Flood Defense Deployment Planning”. In: Journal of Water Resources Planning and Management 148.6 (2022), p. 04022030.Stephen X. Zhang and Vladan Babovic. “A real options approach to the design and architecture of water supply systems using innovative water technologies under uncertainty”. In: Journal of Hydroinformatics 14.1 (Apr. 2011), pp. 13–29.Marc Jeuland and Dale Whittington. “Water Resources Planning under Climate Change: Assessing the Robustness of Real Options for the Blue Nile”. In: Water Resources Research 50.3 (Mar. 2014), pp. 2086–2107.J. Marques, M. Cunha, and D.A.Savić. “Decision Support for Optimal Design of Water Distribution Networks: A Real Options Approach”. In: Procedia Engineering 70 (2014). 12th International Conference on Computing and Control for the Water Industry, CCWI2013, pp. 1074–1083.João Marques, Maria Cunha, and Dragan A. Savić. “Multi-objective optimization of water distribution systems based on a real options approach”. In: Environmental Modelling & Software 63 (2015), pp. 1–13.Nam Lethanh and Bryan T Adey. “A real option approach to determine optimal intervention windows for multi-national rail corridors”. In: Journal of Civil Engineering and Management 22.1 (Dec. 2015), pp. 38–46.Tong Zhao, Satheesh K. Sundararajan, and Chung-Li Tseng. “Highway Development Decision-Making under Uncertainty: A Real Options Approach”. In: Journal of Infrastructure Systems 10.1 (Mar. 2004), pp. 23–32.Paulien M. Herder, Jeroen De Joode, Andreas Ligtvoet, Sigrid Schenk, and Poonam Taneja. “Buying Real Options– Valuing Uncertainty in Infrastructure Planning”. In: Futures 43.9 (Nov. 2011), pp. 961–969.Michael J. Garvin and David N. Ford. “Real Options in Infrastructure Projects: Theory, Practice and Prospects”. In: Engineering Project Organization Journal 2.1-2 (June 2012), pp. 97–108.Fleur Gijsen. “Added value of different approaches of real options in transportation infrastructure projects decision-making”. M.S. thesis. Delft University of Technology, 2016, p. 152.Nikita Moriakov. “An application of Real Options to the valuation of an investment in electrical network”. M.S. thesis. Delft University of Technology, 2012, p. 89.Aakil M. Caunhye and Michel-Alexandre Cardin. “An approach based on robust optimization and decision rules for analyzing real options in engineering systems design”. In: IISE Transactions 49.8 (2017), pp. 753–767.E.A. Martínez-Ceseña and J. Mutale. “Application of an advanced real options approach for renewable energy generation projects planning”. In: Renewable and Sustainable Energy Reviews 15.4 (2011), pp. 2087–2094.Trine Krogh Boomsma, Nigel Meade, and Stein-Erik Fleten. “Renewable energy investments under different support schemes: A real options approach”. In: European Journal of Operational Research 220.1 (2012), pp. 225–237.Nivedya M. Kottayi, Rajib B. Mallick, Jennifer M. Jacobs, and Jo Sias Daniel. “Economics of Making Roadway Pavements Resilient to Climate Change: Use of Discounted Cash Flow and Real Options Analysis”. In: Journal of Infrastructure Systems 25.3 (2019), p. 04019017.YinghanDeng,Michel-Alexandre Cardin, Vladan Babovic, Deepak Santhanakrishnan, Petra Schmitter, and Ali Meshgi. “Valuing Flexibilities in the Design of Urban Water Management Systems”. In: Water Research 47.20 (Dec. 2013), pp. 7162–7174.Michel-Alexandre Cardin and Junfei Hu. “Analyzing the Tradeoffs Between Economies of Scale, Time-Value of Money, and Flexibility in Design Under Uncertainty: Study of Centralized Versus Decentralized Waste-to-Energy Systems”. In: Journal of Mechanical Design 138.1 (Jan. 1, 2016), p. 011401.Liang-Chih Ma, Bernardo Castro-Dominguez, Nikolaos K. Kazantzis, and Yi Hua Ma. “Economic Performance Evaluation of Process System Design Flexibility Options under Uncertainty: The Case of Hydrogen Production Plants with Integrated Membrane Technology and CO2 Capture”. In: Computers & Chemical Engineering 99 (Apr. 2017), pp. 214–229.Anna Evans. “The Value of Flexibility: Application of Real Options Analysis to Electricity Network Investments”. M.S. thesis. Massachusetts Institute of Technology, 2020, p. 62.Mauricio Sánchez-Silva and Wilmar Calderón-Guevara. “Flexibility and Adaptability within the Context of Decision-Making in Infrastructure Management”. In: Structure and Infrastructure Engineering 18.7 (July 3, 2022), pp. 950–966.Michel-Alexandre Cardin, Qihui Xie, Tsan Sheng Ng, and Shuming Wang. “An approach for analyzing and managing flexibility in engineering systems design based on decision rules and multistage stochastic programming”. In: IISE Trans 49.1 (2017), pp. 1–12.Michel-Alexandre Cardin, Yinghan Deng, and Chang Sun. “Real Options and Flexibility Analysis in Design and Management of One-Way Mobility on-Demand Systems Using Decision Rules”. In: Transportation Research Part C: Emerging Technologies 84 (Nov. 2017), pp. 265–287.Sixiang Zhao, William Benjamin Haskell, and Michel Alexandre Cardin. “Decision rule-based method for flexible multi-facility capacity expansion problem”. In: IISE Trans 50.7 (2018), pp. 553–569.Matthew E Fitzgerald and Adam M Ross. “Sustaining Lifecycle Value: Valuable Changeability Analysis with Era Simulation”. In: 2012 IEEE International Systems Conference SysCon 2012. 2012 6th Annual IEEE Systems Conference (SysCon). Vancouver, BC, Canada: IEEE, Mar. 2012, pp. 1–7.Marjolijn Haasnoot, Maaike Van Aalst, Julie Rozenberg, Kathleen Dominique, John Matthews, Laurens M. Bouwer, Jarl Kind, and N. LeRoy Poff. “Investments under Non-Stationarity: Economic Evaluation of Adaptation Pathways”. In: Climatic Change 161.3 (Aug. 2020), pp. 451–463.Jan H. Kwakkel. “Is Real Options Analysis Fit for Purpose in Supporting Climate Adaptation Planning and Decision-making?” In: WIREs Climate Change 11.3 (May 2020), e638.Jijun Lin, Olivier de Weck, Richard de Neufville, and Howard K. Yue. “Enhancing the value of offshore developments with flexible subsea tiebacks”. In: Journal of Petroleum Science and Engineering 102 (2013), pp. 73–83.Matthew R. Silver and Olivier L. De Weck. “Time-expanded Decision Networks: A Framework for Designing Evolvable Complex Systems”. In: Systems Engineering 10.2 (June 2007), pp. 167–188.Danguang Huang, Kalanithy Vairavamoorthy, and Seneshaw Tsegaye. “Flexible Design of Urban Water Distribution Networks”. In: World Environmental and Water Resources Congress 2010. World Environmental and Water Resources Congress 2010. Providence, Rhode Island, United States: American Society of Civil Engineers, May 14, 2010, pp. 4225–4236.KiHyung Kim. “Strategic Flexibility”. PhD thesis. Purdue University, 2014.Y.G. Melese, P.W. Heijnen, R.M. Stikkelman, and P.M. Herder. “Exploring for Real Options during CCS Networks Conceptual Design to Mitigate Effects of Path-Dependency and Lock-In”. In: International Journal of Greenhouse Gas Control 42 (Nov. 2015), pp. 16–25.Y. G. Melese, P. W. Heijnen, R. M. Stikkelman, and P. M. Herder. “An Approach for Integrating Valuable Flexibility During Conceptual Design of Networks”. In: Networks and Spatial Economics 17.2 (June 2017), pp. 317–341.David Allaverdi and Tyson R. Browning. “A methodology for identifying flexible design opportunities in large-scale systems”. In: Systems Engineering 23.5 (2020), pp. 534–556.Julia Reisinger, Maximilian Knoll, and Iva Kovacic. “Design Space Exploration for Flexibility Assessment and Decision Making Support in Integrated Industrial Building Design”. In: Optimization and Engineering 22.3 (Sept. 2021), pp. 1693–1725.Myung-Jin Kim, Robert J. Nicholls, John M. Preston, and Gustavo A. De Almeida. “Evaluation of Flexibility in Adaptation Projects for Climate Change”. In: Climatic Change 171.1-2 (Mar. 2022), p. 15.D.B. Agusdinata, V.A.W.J. Marchau, and W.E. Walker. “Adaptive Policy Approach to Implementing Intelligent Speed Adaptation”. In: IET Intelligent Transport Systems 1.3 (2007), p. 186.Jan H. Kwakkel and Erik Pruyt. “Exploratory Modeling and Analysis, an Approach for Model-Based Foresight under Deep Uncertainty”. In: Technological Forecasting and Social Change 80.3 (Mar. 2013), pp. 419–431.Benjamin P. Bryant and Robert J. Lempert. “Thinking inside the Box: A Participatory, Computer-Assisted Approach to Scenario Discovery”. In: Technological Forecasting and Social Change 77.1 (Jan. 2010), pp. 34–49.Jan H. Kwakkel, Willem L. Auping, and Erik Pruyt. “Dynamic Scenario Discovery under Deep Uncertainty: The Future of Copper”. In: Technological Forecasting and Social Change 80.4 (May 2013), pp. 789–800.Enayat A. Moallemi, Sondoss Elsawah, and Michael J. Ryan. “Model-Based Multi-Objective Decision Making under Deep Uncertainty from a MultiMethod Design Lens”. In: Simulation Modelling Practice and Theory 84 (May 2018), pp. 232–250.David G. Groves and Robert J. Lempert. “A new analytic method for finding policy-relevant scenarios”. In: Global Environmental Change 17.1 (2007). Uncertainty and Climate Change Adaptation and Mitigation, pp. 73–85.Jerome H Friedman and Nicholas I Fisher. In: Statistics and Computing 9.2 (1999), pp. 123–143.Robert J Lempert, Benjamin P Bryant, and Steven C Bankes. Comparing algorithms for scenario discovery. 2008.P. C. D. Milly, Julio Betancourt, Malin Falkenmark, Robert M. Hirsch, Zbigniew W. Kundzewicz, Dennis P. Lettenmaier, and Ronald J. Stouffer. “Stationarity Is Dead: Whither Water Management?” In: Science 319.5863 (2008), pp. 573–574.Vijaykumar Gullapalli. “A stochastic reinforcement learning algorithm for learning real-valued functions”. In: Neural Networks 3.6 (1990), pp. 671–692.Gareth James, Daniela Witten, Trevor Hastie, Robert Tibshirani, and Jonathan Taylor. “Unsupervised Learning”. In: An Introduction to Statistical Learning: with Applications in Python. Cham: Springer International Publishing, 2023, pp. 503–556.Richard S Sutton and Andrew G Barto. Reinforcement learning: An introduction. MIT press, 2018.B. F. Skinner. The Behavior of Organisms: An Experimental Analysis. Oxford, England: Appleton-Century, 1938, p. 457. 457 pp.Kai Arulkumaran, Marc Peter Deisenroth, Miles Brundage, and Anil Anthony Bharath. “Deep Reinforcement Learning: A Brief Survey”. In: IEEE Signal Processing Magazine 34.6 (Nov. 2017), pp. 26–38.Ann Nowé and Tim Brys. “A Gentle Introduction to Reinforcement Learning”. In: Scalable Uncertainty Management. Ed. by Steven Schockaert and Pierre Senellart. Vol. 9858. Cham: Springer International Publishing, 2016, pp. 18–32.Warren B Powell. Approximate Dynamic Programming: Solving the Curses of Dimensionality. 2nd ed. Wiley, 2011.Richard S. Sutton. “Learning to predict by the methods of temporal differences”. In: Machine Learning 3.1 (Aug. 1988), pp. 9–44.Gavin A Rummery and Mahesan Niranjan. On-line Q-learning using connectionist systems. Cambridge, UK, 1994.Christopher J C H Watkins and Peter Dayan. “Q-learning”. en. In: Mach. Learn. 8.3-4 (May 1992), pp. 279–292.Gdeorge Cybenko. “Approximation by superpositions of a sigmoidal function”. en. In: Math. Control Signals Systems 2.4 (Dec. 1989), pp. 303–314.Volodymyr Mnih, Koray Kavukcuoglu, David Silver, Andrei A. Rusu, Joel Veness, Marc G. Bellemare, Alex Graves, Martin Riedmiller, Andreas K. Fidjeland, Georg Ostrovski, Stig Petersen, Charles Beattie, Amir Sadik, Ioannis Antonoglou, Helen King, Dharshan Kumaran, Daan Wierstra, Shane Legg, and Demis Hassabis. “Human-Level Control through Deep Reinforcement Learning”. In: Nature 518.7540 (Feb. 26, 2015), pp. 529–533.John Tsitsiklis and Benjamin Van Roy. “Analysis of Temporal-Diffference Learning with Function Approximation”. In: Advances in Neural Information Processing Systems. Ed. by M.C. Mozer, M. Jordan, and T. Petsche. Vol. 9. MIT Press, 1996.Long-Ji Lin. “Self-improving reactive agents based on reinforcement learning, planning and teaching”. en. In: Machine Learning 8.3-4 (May 1992), pp. 293– 321.G Tesauro. “Temporal difference learning and TD-gammon”. In: ICGA J. 18.2 (June 1995), pp. 88–88.David Silver, Aja Huang, Chris J Maddison, Arthur Guez, Laurent Sifre, George van den Driessche, Julian Schrittwieser, Ioannis Antonoglou, Veda Panneershelvam, Marc Lanctot, Sander Dieleman, Dominik Grewe, John Nham, Nal Kalchbrenner, Ilya Sutskever, Timothy Lillicrap, Madeleine Leach, Koray Kavukcuoglu, Thore Graepel, and Demis Hassabis. “Mastering the game of Go with deep neural networks and tree search”. en. In: Nature 529.7587 (Jan. 2016), pp. 484–489.Oriol Vinyals, Igor Babuschkin, Wojciech M Czarnecki, Michaël Mathieu, Andrew Dudzik, Junyoung Chung, David H Choi, Richard Powell, Timo Ewalds, Petko Georgiev, Junhyuk Oh, Dan Horgan, Manuel Kroiss, Ivo Danihelka, Aja Huang, Laurent Sifre, Trevor Cai, John P Agapiou, Max Jaderberg, Alexander S Vezhnevets, Rémi Leblond, Tobias Pohlen, Valentin Dalibard, David Budden, Yury Sulsky, James Molloy, Tom L Paine, Caglar Gulcehre, Ziyu Wang, Tobias Pfaff, Yuhuai Wu, Roman Ring, Dani Yogatama, Dario Wünsch, Katrina McKinney, Oliver Smith, Tom Schaul, Timothy Lillicrap, Koray Kavukcuoglu, Demis Hassabis, Chris Apps, and David Silver. “Grandmaster level in StarCraft II using multi-agent reinforcement learning”. en. In: Nature 575.7782 (Nov. 2019), pp. 350–354.Christopher Berner, Greg Brockman, Brooke Chan, Vicki Cheung, Przemysław Dębiak, Christy Dennison, David Farhi, Quirin Fischer, Shariq Hashme, Chris Hesse, Rafal Józefowicz, Scott Gray, Catherine Olsson, Jakub Pachocki, Michael Petrov, Henrique P. d. O. Pinto, Jonathan Raiman, Tim Salimans, Jeremy Schlatter, Jonas Schneider, Szymon Sidor, Ilya Sutskever, Jie Tang, Filip Wolski, and Susan Zhang. Dota 2 with Large Scale Deep Reinforcement Learning. 2019.Sida I. Wang, Percy Liang, and Christopher D. Manning. Learning Language Games through Interaction. 2016.Chen Liang, Jonathan Berant, Quoc Le, Kenneth D. Forbus, and Ni Lao. Neural Symbolic Machines: Learning Semantic Parsers on Freebase with Weak Supervision. 2017.Bhaskar Mitra and Nick Craswell. Neural Models for Information Retrieval. 2017.Rodrigo Nogueira and Kyunghyun Cho. Task-Oriented Query Reformulation with Reinforcement Learning. 2017.Romain Paulus, Caiming Xiong, and Richard Socher. A Deep Reinforced Model for Abstractive Summarization. 2017.Lisa Zhang, Gregory Rosenblatt, Ethan Fetaya, Renjie Liao, William Byrd, Matthew Might, Raquel Urtasun, and Richard Zemel. “Neural Guided Constraint Logic Programming for Program Synthesis”. In: Advances in Neural Information Processing Systems. Ed. by S. Bengio, H. Wallach, H. Larochelle, K. Grauman, N. Cesa-Bianchi, and R. Garnett. Vol. 31. Curran Associates, Inc., 2018.Bhuwan Dhingra, Lihong Li, Xiujun Li, Jianfeng Gao, Yun-Nung Chen, Faisal Ahmed, and Li Deng. Towards End-to-End Reinforcement Learning of Dialogue Agents for Information Access. 2017.Jiwei Li, Alexander H. Miller, Sumit Chopra, Marc’Aurelio Ranzato, and Jason Weston. Learning through Dialogue Interactions by Asking Questions. 2017.Jason D. Williams, Kavosh Asadi, and Geoffrey Zweig. Hybrid Code Networks: practical and efficient end-to-end dialog control with supervised and reinforcement learning. 2017.Kyunghyun Cho, Bart van Merrienboer, Caglar Gulcehre, Dzmitry Bahdanau, Fethi Bougares, Holger Schwenk, and Yoshua Bengio. Learning Phrase Representations using RNN Encoder-Decoder for Statistical Machine Translation. 2014.Ilya Sutskever, Oriol Vinyals, and Quoc V Le. “Sequence to Sequence Learning with Neural Networks”. In: Advances in Neural Information Processing Systems. Ed. by Z. Ghahramani, M. Welling, C. Cortes, N. Lawrence, and K.Q. Weinberger. Vol. 27. Curran Associates, Inc., 2014.Di He, Yingce Xia, Tao Qin, Liwei Wang, Nenghai Yu, Tie-Yan Liu, and WeiYing Ma. “Dual Learning for Machine Translation”. In: Advances in Neural Information Processing Systems. Ed. by D. Lee, M. Sugiyama, U. Luxburg, I. Guyon, and R. Garnett. Vol. 29. Curran Associates, Inc., 2016.Yonghui Wu, Mike Schuster, Zhifeng Chen, Quoc V. Le, Mohammad Norouzi, Wolfgang Macherey, Maxim Krikun, Yuan Cao, Qin Gao, Klaus Macherey, Jeff Klingner, Apurva Shah, Melvin Johnson, Xiaobing Liu, Łukasz Kaiser, Stephan Gouws, Yoshikiyo Kato, Taku Kudo, Hideto Kazawa, Keith Stevens, George Kurian, Nishant Patil, Wei Wang, Cliff Young, Jason Smith, Jason Riesa, Alex Rudnick, Oriol Vinyals, Greg Corrado, Macduff Hughes, and Jeffrey Dean. Google’s Neural Machine Translation System: Bridging the Gap between Human and Machine Translation. 2016.Jonas Gehring, Michael Auli, David Grangier, Denis Yarats, and Yann N. Dauphin. “Convolutional Sequence to Sequence Learning”. In: Proceedings of the 34th International Conference on Machine Learning. Ed. by Doina Precup and Yee Whye Teh. Vol. 70. Proceedings of Machine Learning Research. PMLR, June 2017, pp. 1243–1252.Melvin Johnson, Mike Schuster, Quoc V. Le, Maxim Krikun, Yonghui Wu, Zhifeng Chen, Nikhil Thorat, Fernanda Viégas, Martin Wattenberg, Greg Corrado, Macduff Hughes, and Jeffrey Dean. “Google’s Multilingual Neural Machine Translation System: Enabling Zero-Shot Translation”. In: Transactions of the Association for Computational Linguistics 5 (Oct. 2017), pp. 339–351.Guillaume Klein, Yoon Kim, Yuntian Deng, Jean Senellart, and Alexander M. Rush. OpenNMT: Open-Source Toolkit for Neural Machine Translation. 2017.Marc’Aurelio Ranzato, Sumit Chopra, Michael Auli, and Wojciech Zaremba. Sequence Level Training with Recurrent Neural Networks. 2016.Dzmitry Bahdanau, Philemon Brakel, Kelvin Xu, Anirudh Goyal, Ryan Lowe, Joelle Pineau, Aaron Courville, and Yoshua Bengio. An Actor-Critic Algorithm for Sequence Prediction. 2017.Jiwei Li, Alexander H. Miller, Sumit Chopra, Marc’Aurelio Ranzato, and Jason Weston. Dialogue Learning With Human-In-The-Loop. 2017.Lantao Yu, Weinan Zhang, Jun Wang, and Yong Yu. “SeqGAN: Sequence Generative Adversarial Nets with Policy Gradient”. In: Proceedings of the AAAI Conference on Artificial Intelligence 31.1 (Feb. 2017).Shehroze Bhatti, Alban Desmaison, Ondrej Miksik, Nantas Nardelli, N. Siddharth, and Philip H. S. Torr. Playing Doom with SLAM-Augmented Deep Reinforcement Learning. 2016.Mustafa Devrim Kaba, Mustafa Gokhan Uzunbas, and Ser Nam Lim. “A Reinforcement Learning Approach to the View Planning Problem”. In: Proceedings of the IEEE Conference on Computer Vision and Pattern Recognition (CVPR). July 2017.Fangyu Liu, Shuaipeng Li, Liqiang Zhang, Chenghu Zhou, Rongtian Ye, Yuebin Wang, and Jiwen Lu. “3DCNN-DQN-RNN: A Deep Reinforcement Learning Framework for Semantic Parsing of Large-Scale 3D Point Clouds”. In: Proceedings of the IEEE International Conference on Computer Vision (ICCV). Oct. 2017.Gino Brunner, Oliver Richter, Yuyi Wang, and Roger Wattenhofer. “Teaching a Machine to Read Maps With Deep Reinforcement Learning”. In: Proceedings of the AAAI Conference on Artificial Intelligence 32.1 (Apr. 2018).J. Moody and M. Saffell. “Learning to trade via direct reinforcement”. In: IEEE Transactions on Neural Networks 12.4 (2001), pp. 875–889.Michael W. Brandt, Amit Goyal, Pedro Santa-Clara, and Jonathan R. Stroud. “A Simulation Approach to Dynamic Portfolio Choice with an Application to Learning About Return Predictability”. In: The Review of Financial Studies 18.3 (May 2005), pp. 831–873.Yue Deng, Feng Bao, Youyong Kong, Zhiquan Ren, and Qionghai Dai. “Deep Direct Reinforcement Learning for Financial Signal Representation and Trading”. In: IEEE Transactions on Neural Networks and Learning Systems 28.3 (2017), pp. 653–664.Shangxing Wang, Hanpeng Liu, Pedro Henrique Gomes, and Bhaskar Krishnamachari. “Deep reinforcement learning for dynamic multichannel access”. In: International Conference on Computing, Networking and Communications (ICNC). 2017, pp. 257–265.Jiang Zhu, Yonghui Song, Dingde Jiang, and Houbing Song. “A New DeepQ-Learning-Based Transmission Scheduling Mechanism for the Cognitive Internet of Things”. In: IEEE Internet of Things Journal 5.4 (2018), pp. 2375–2385.Man Chu, Hang Li, Xuewen Liao, and Shuguang Cui. “Reinforcement LearningBased Multiaccess Control and Battery Prediction With Energy Harvesting in IoT Systems”. In: IEEE Internet of Things Journal 6.2 (2019), pp. 2009–2020.Matteo Gadaleta, Federico Chiariotti, Michele Rossi, and Andrea Zanella. “D-DASH: A Deep Q-Learning Framework for DASH Video Streaming”. In: IEEE Transactions on Cognitive Communications and Networking 3.4 (2017), pp. 703–718.Hongzi Mao, Ravi Netravali, and Mohammad Alizadeh. “Neural Adaptive Video Streaming with Pensieve”. In: Proceedings of the Conference of the ACM Special Interest Group on Data Communication. SIGCOMM ’17. Los Angeles, CA, USA: Association for Computing Machinery, 2017, pp. 197–210.Sandeep Chinchali, Pan Hu, Tianshu Chu, Manu Sharma, Manu Bansal, Rakesh Misra, Marco Pavone, and Sachin Katti. “Cellular Network Traffic Scheduling With Deep Reinforcement Learning”. In: Proceedings of the AAAI Conference on Artificial Intelligence 32.1 (Apr. 2018).Paulo Victor Rodrigues Ferreira, Randy Paffenroth, Alexander M. Wyglinski, Timothy M. Hackett, Sven G. Bilén, Richard C. Reinhart, and Dale J. Mortensen. “Multiobjective Reinforcement Learning for Cognitive Satellite Communications Using Deep Neural Network Ensembles”. In: IEEE Journal on Selected Areas in Communications 36.5 (2018), pp. 1030–1041.Tianchi Huang, Rui-Xiao Zhang, Chao Zhou, and Lifeng Sun. “QARC: Video Quality Aware Rate Control for Real-Time Video Streaming Based on Deep Reinforcement Learning”. In: Proceedings of the 26th ACM International Conference on Multimedia. MM ’18. Seoul, Republic of Korea: Association for Computing Machinery, 2018, pp. 1208–1216.Cheng Zhang, Zhi Liu, Bo Gu, Kyoko Yamori, and Yoshiaki Tanaka. “A deep reinforcement learning based approach for cost-and energy-aware multi-flow mobile data offloading”. In: IEICE Transactions on Communications 101.7 (2018), pp. 1625–1634.Ji Li, Hui Gao, Tiejun Lv, and Yueming Lu. “Deep reinforcement learning based computation offloading and resource allocation for MEC”. In: 2018 IEEE Wireless Communications and Networking Conference (WCNC). 2018, pp. 1–6.Xianfu Chen, Honggang Zhang, Celimuge Wu, Shiwen Mao, Yusheng Ji, and Mehdi Bennis. “Performance Optimization in Mobile-Edge Computing via Deep Reinforcement Learning”. In: 2018 IEEE 88th Vehicular Technology Conference (VTC-Fall). 2018, pp. 1–6.Guoan Han, Liang Xiao, and H. Vincent Poor. “Two-dimensional anti-jamming communication based on deep reinforcement learning”. In: 2017 IEEE International Conference on Acoustics, Speech and Signal Processing (ICASSP). 2017, pp. 2087–2091.Xin Liu, Yuhua Xu, Luliang Jia, Qihui Wu, and Alagan Anpalagan. “AntiJamming Communications Using Spectrum Waterfall: A Deep Reinforcement Learning Approach”. In: IEEE Communications Letters 22.5 (2018), pp. 998–1001.Ye Chen, Yanda Li, Dongjin Xu, and Liang Xiao. “DQN-Based Power Control for IoT Transmission against Jamming”. In: 2018 IEEE 87th Vehicular Technology Conference (VTC Spring). 2018, pp. 1–5.Wanrong Huang, Yanzhen Wang, and Xiaodong Yi. “Deep Q-Learning to Preserve Connectivity in Multi-Robot Systems”. In: Proceedings of the 9th International Conference on Signal Processing Systems. ICSPS 2017. Auckland, New Zealand: Association for Computing Machinery, 2017, pp. 45–50.Chao Wang, Jian Wang, Xudong Zhang, and Xiao Zhang. “Autonomous navigation of UAV in large-scale unknown complex environment with deep reinforcement learning”. In: 2017 IEEE Global Conference on Signal and Information Processing (GlobalSIP). 2017, pp. 858–862.Faris B. Mismar and Brian L. Evans. “Deep Q-Learning for Self-Organizing Networks Fault Management and Radio Performance Improvement”. In: 2018 52nd Asilomar Conference on Signals, Systems, and Computers. 2018, pp. 1457–1461.Li-Yeh Chuang, Jui-Hung Tsai, and Cheng-Hong Yang. “Operon Prediction Using Particle Swarm Optimization and Reinforcement Learning”. In: 2010 International Conference on Technologies and Applications of Artificial Intelligence. 2010, pp. 366–372.Celia Ghedini Ralha, Hugo Wruck Schneider, Maria Emilia Machado Telles Walter, and Ana Lucia Cetertich Bazzan. “Reinforcement Learning Method for BioAgents”. In: Proceedings of the 2010 Eleventh Brazilian Symposium on Neural Networks. SBRN ’10. USA: IEEE Computer Society, 2010, pp. 109–114.Maria-Iuliana Bocicor, Gabriela Czibula, and Istvan-Gergely Czibula. “A Reinforcement Learning Approach for Solving the Fragment Assembly Problem”. In: 2011 13th International Symposium on Symbolic and Numeric Algorithms for Scientific Computing. 2011, pp. 191–198.Fei Zhu, Quan Liu, Xiaofang Zhang, and Bairong Shen. “Protein-protein interaction network constructing based on text mining and reinforcement learning with application to prostate cancer”. In: 2014 IEEE International Conference on Bioinformatics and Biomedicine (BIBM). 2014, pp. 46–51.Farhang Sahba, Hamid R Tizhoosh, and Magdy M A Salama. “Application of reinforcement learning for segmentation of transrectal ultrasound images”. en. In: BMC Med. Imaging 8.1 (Apr. 2008), p. 8.Haoyang Zeng, Matthew D. Edwards, Ge Liu, and David K. Gifford. “Convolutional neural network architectures for predicting DNA–protein binding”. In: Bioinformatics 32.12 (June 2016), pp. i121–i127.Yi-Fei Huang, Brad Gulko, and Adam Siepel. “Fast, scalable prediction of deleterious noncoding variants from functional and population genomic data”. en. In: Nature Genetics 49.4 (Apr. 2017), pp. 618–624.Thomas Lampe, Lukas D.J. Fiederer, Martin Voelker, Alexander Knorr, Martin Riedmiller, and Tonio Ball. “A Brain-Computer Interface for High-Level Remote Control of an Autonomous, Reinforcement-Learning-Based Robotic System for Reaching and Grasping”. In: Proceedings of the 19th International Conference on Intelligent User Interfaces. IUI ’14. Haifa, Israel: Association for Computing Machinery, 2014, pp. 83–88.Robert Bauer and Alireza Gharabaghi. “Reinforcement learning for adaptive threshold control of restorative brain-computer interfaces: a Bayesian simulation”. In: Frontiers in Neuroscience 9 (2015).Jack DiGiovanna, Babak Mahmoudi, Jose Fortes, Jose C. Principe, and Justin C. Sanchez. “Coadaptive Brain–Machine Interface via Reinforcement Learning”. In: IEEE Transactions on Biomedical Engineering 56.1 (2009), pp. 54–64.Yousuf M. Soliman. Personalized Medical Treatments Using Novel Reinforcement Learning Algorithms. 2014.Regina Padmanabhan, Nader Meskin, and Wassim M. Haddad. “Learning based control of cancer chemotherapy treatment”. In: IFAC-PapersOnLine 50.1 (2017). 20th IFAC World Congress, pp. 15127–15132.Brenden K. Petersen, Jiachen Yang, Will S. Grathwohl, Chase Cockrell, Claudio Santiago, Gary An, and Daniel M. Faissol. Precision medicine as a control problem: Using simulation and deep reinforcement learning to discover adaptive, personalized multi-cytokine therapy for sepsis. 2018.S. A. Murphy. “An experimental design for the development of adaptive treatment strategies”. In: Statistics in Medicine 24.10 (2005), pp. 1455–1481.A.John Rush, Maurizio Fava, Stephen R Wisniewski, Philip W Lavori, Madhukar H Trivedi, Harold A Sackeim, Michael E Thase, Andrew A Nieren218 berg, Frederic M Quitkin, T.Michael Kashner, David J Kupfer, Jerrold F Rosenbaum, Jonathan Alpert, Jonathan W Stewart, Patrick J McGrath, Melanie M Biggs, Kathy Shores-Wilson, Barry D Lebowitz, Louise Ritz, and George Niederehe. “Sequenced treatment alternatives to relieve depression (STAR*D): rationale and design”. In: Controlled Clinical Trials 25.1 (2004), pp. 119–142.Susan M. Shortreed, Eric Laber, Daniel J. Lizotte, T. Scott Stroup, Joelle Pineau, and Susan A. Murphy. “Informing sequential clinical decision-making through reinforcement learning: an empirical study”. en. In: Machine Learning 84.1-2 (July 2011), pp. 109–136.Phillip J. Schulte, Anastasios A. Tsiatis, Eric B. Laber, and Marie Davidian. “Q- and A-learning methods for estimating optimal dynamic treatment regimes”. en. In: Statistical Science 29.4 (Nov. 2014), pp. 640–661.Matthieu Komorowski, Leo A. Celi, Omar Badawi, Anthony C. Gordon, and A. Aldo Faisal. “The Artificial Intelligence Clinician learns optimal treatment strategies for sepsis in intensive care”. en. In: Nature Medicine 24.11 (Nov. 2018), pp. 1716–1720.Adam E. Gaweda, Mehmet K. Muezzinoglu, Alfred A. Jacobs, George R. Aronoff, and Michael E. Brier. “Model Predictive Control with Reinforcement Learning for Drug Delivery in Renal Anemia Management”. In: 2006 International Conference of the IEEE Engineering in Medicine and Biology Society. 2006, pp. 5177–5180.Hideki Asoh, Masanori Shiro, Shotaro Akaho, Toshihiro Kamishima, Koiti Hashida, and Takahide Kohro. “Modeling Medical Records of Diabetes using Markov Decision Processes”. In: Proceedings of ICML2013 Workshop on Role of Machine Learning in Transforming Healthcare - (2013).Chun-Hao Chang, Mingjie Mai, and Anna Goldenberg. Dynamic Measurement Scheduling for Adverse Event Forecasting using Deep RL. 2018.Qingnan Sun, Marko V. Jankovic, João Budzinski, Brett Moore, Peter Diem, Christoph Stettler, and Stavroula G. Mougiakakou. “A Dual Mode Adaptive Basal-Bolus Advisor Based on Reinforcement Learning”. In: IEEE Journal of Biomedical and Health Informatics 23.6 (2019), pp. 2633–2641.J. Boger, J. Hoey, P. Poupart, C. Boutilier, G. Fernie, and A. Mihailidis. “A planning system based on Markov decision processes to guide people with dementia through activities of daily living”. In: IEEE Transactions on Information Technology in Biomedicine 10.2 (2006), pp. 323–333.David J. Reinkensmeyer, Emmanuel Guigon, and Marc A. Maier. “A computational model of use-dependent motor recovery following a stroke: Optimizing corticospinal activations via reinforcement learning can explain residual capacity and other strength recovery dynamics”. In: Neural Networks 29-30 (2012), pp. 60–69.Shender Ávila-Sansores, Felipe Orihuela-Espina, and Luis Enrique-Sucar. “Patient Tailored Virtual Rehabilitation”. In: Converging Clinical and Engineering Research on Neurorehabilitation. Ed. by José L Pons, Diego Torricelli, and Marta Pajaro. Berlin, Heidelberg: Springer Berlin Heidelberg, 2013, pp. 879–883.Georgios Naros and Alireza Gharabaghi. “Reinforcement learning of self regulated beta-oscillations for motor restoration in chronic stroke”. In: Frontiers in Human Neuroscience 9 (2015).S.J. Fakih and T.K. Das. “LEAD: a methodology for learning efficient approaches to medical diagnosis”. In: IEEE Transactions on Information Technology in Biomedicine 10.2 (2006), pp. 220–228.Elhadi M. Shakshuki, Malcolm Reid, and Tarek R. Sheltami. “An Adaptive User Interface in Healthcare”. In: Procedia Computer Science 56 (2015). The 10th International Conference on Future Networks and Communications (FNC 2015) / The 12th International Conference on Mobile Systems and Pervasive Computing (MobiSPC 2015) Affiliated Workshops, pp. 49–58.Tianshu Chu, Jie Wang, and Jiayu Chen. “An adaptive online learning framework for practical breast cancer diagnosis”. In: Medical Imaging 2016: ComputerAided Diagnosis. Ed. by Georgia D. Tourassi and Samuel G. Armato III. Vol. 9785. International Society for Optics and Photonics. SPIE, 2016, p. 978524.Zheng Wen, Daniel O’Neill, and Hamid Maei. “Optimal Demand Response Using Device-Based Reinforcement Learning”. In: IEEE Transactions on Smart Grid 6.5 (2015), pp. 2312–2324.Zhijin Cheng, Qianchuan Zhao, Fulin Wang, Yi Jiang, Li Xia, and Jinlei Ding. “Satisfaction based Q-learning for integrated lighting and blind control”. In: Energy and Buildings 127 (2016), pp. 43–55.Lukas Eller, Lydia C. Siafara, and Thilo Sauter. “Adaptive control for building energy management using reinforcement learning”. In: 2018 IEEE International Conference on Industrial Technology (ICIT). 2018, pp. 1562–1567.Hussain Kazmi, Johan Suykens, Attila Balint, and Johan Driesen. “Multiagent reinforcement learning for modeling and control of thermostatically controlled loads”. In: Applied Energy 238 (2019), pp. 1022–1035.A. Sheikhi, M. Rayati, and A.M. Ranjbar. “Dynamic load management for a residential customer; Reinforcement Learning approach”. In: Sustainable Cities and Society 24 (2016), pp. 42–51.J. Bollenbacher and B. Rhein. “Optimal configuration and control strategy in a multi-carrier-energy system using reinforcement learning methods”. In: 2017 International Energy and Sustainability Conference (IESC). 2017, pp. 1–6.Brida V. Mbuwir, Mahtab Kaffash, and Geert Deconinck. “Battery Scheduling in a Residential Multi-Carrier Energy System Using Reinforcement Learning”. In: 2018 IEEE International Conference on Communications, Control, and Computing Technologies for Smart Grids (SmartGridComm). 2018, pp. 1–6.Haochen Hua, Yuchao Qin, Chuantong Hao, and Junwei Cao. “Optimal energy management strategies for energy Internet via deep reinforcement learning approach”. In: Applied Energy 239 (2019), pp. 598–609.Marco Carvalho, Carlos Perez, and Adrian Granados. “An adaptive multiagent-based approach to smart grids control and optimization”. en. In: Energy Syst. 3.1 (Mar. 2012), pp. 61–76.Byung-Gook Kim, Yu Zhang, Mihaela van der Schaar, and Jang-Won Lee. “Dynamic Pricing and Energy Consumption Scheduling With Reinforcement Learning”. In: IEEE Transactions on Smart Grid 7.5 (2016), pp. 2187–2198.Renzhi Lu, Seung Ho Hong, and Xiongfeng Zhang. “A Dynamic pricing demand response algorithm for smart grid: Reinforcement learning approach”. In: Applied Energy 220 (2018), pp. 220–230.Jian Sun, Zhiqin Zhu, Huaqing Li, Yi Chai, Guanqiu Qi, Huiwei Wang, and Yu Hen Hu. “An integrated critic-actor neural network for reinforcement learning with application of DERs control in grid frequency regulation”. In: International Journal of Electrical Power & Energy Systems 111 (2019), pp. 286–299.Teng Liu, Yuan Zou, Dexing Liu, and Fengchun Sun. “Reinforcement learning–based energy management strategy for a hybrid electric tracked vehicle”. en. In: Energies 8.7 (July 2015), pp. 7243–7260.Rui Xiong, Jiayi Cao, and Quanqing Yu. “Reinforcement learning-based realtime power management for hybrid energy storage system in the plug-in hybrid electric vehicle”. In: Applied Energy 211 (2018), pp. 538–548.Namireddy Praveen Reddy, David Pasdeloup, Mehdi Karbalaye Zadeh, and Roger Skjetne. “An Intelligent Power and Energy Management System for Fuel Cell/Battery Hybrid Electric Vehicle Using Reinforcement Learning”. In: 2019 IEEE Transportation Electrification Conference and Expo (ITEC). 2019, pp. 1–6.Fengwei Hung and Y. C. Ethan Yang. “Assessing Adaptive Irrigation Impacts on Water Scarcity in Nonstationary Environments—A Multi-Agent Reinforcement Learning Approach”. In: Water Resources Research 57.9 (2021), e2020WR029262.Dylan Radovic, Lucas Kruitwagen, Christian Schroeder de Witt, Ben Caldecott, Shane Tomlinson, and Mark Workman. Revealing Robust Oil and Gas Company Macro-Strategies using Deep Multi-Agent Reinforcement Learning. 2022.Nathan K. Brown, Anthony P. Garland, Georges M. Fadel, and Gang Li. ““Deep reinforcement learning for engineering design through topology optimization of elementally discretized design domains””. In: Materials & Design 218 (2022), p. 110672.Melissa Chapman, Lily Xu, Marcus Lapeyrolerie, and Carl Boettiger. “Bridging Adaptive Management and Reinforcement Learning for More Robust Decisions”. In: Philosophical Transactions of the Royal Society B: Biological Sciences 378.1881 (July 17, 2023), p. 20220195.D Bronitowski and J Moses. “Measuring Flexibility, Descriptive Complexity, and Rework Potential in Generic System Architectures”. In: Syst Eng 19.3 (2016), pp. 207–221.Florida Department of Transportation. Cost per mile models reports. 2023. url: https://www.fdot.gov/programmanagement/estimates/documents/ costpermilemodelsreports (visited on 02/10/2024).Jan H. Kwakkel. “The Exploratory Modeling Workbench: An open source toolkit for exploratory modeling, scenario discovery, and (multi-objective) robust decision making”. In: Environmental Modelling & Software 96 (2017), pp. 239–250.Marten M Hillen, Sebastiaan N Jonkman, Wim Kanning, Matthijs Kok, MA Geldenhuys, and MJF Stive. “Coastal defence cost estimates: Case study of the Netherlands, New Orleans and Vietnam”. In: Communications on Hydraulic and Geotechnical Engineering, No. 2010-01 (2010).Xianli Zhu, Matthew M. Linham, and Robert J. Nicholls. Technologies for climate change adaptation. Coastal erosion and flooding. Nov. 2010.Stephane Hallegatte, Colin Green, Robert J. Nicholls, and Jan Corfee-Morlot. “Future flood losses in major coastal cities”. In: Nature Climate Change 3.9 (Sept. 2013), pp. 802–806.Jochen Hinkel, Robert J. Nicholls, Richard S.J. Tol, Zheng B. Wang, Jacqueline M. Hamilton, Gerben Boot, Athanasios T. Vafeidis, Loraine McFadden, Andrey Ganopolski, and Richard J.T. Klein. “A global analysis of erosion of sandy beaches and sea-level rise: An application of DIVA”. In: Global and Planetary Change 111 (2013), pp. 150–158.Kathleen L. McInnes, Christopher J. White, Ivan D. Haigh, Mark A. Hemer, Ron K. Hoeke, Neil J. Holbrook, Anthony S. Kiem, Eric C. J. Oliver, Roshanka Ranasinghe, Kevin J. E. Walsh, Seth Westra, and Ron Cox. “Natural hazards in Australia: sea level and coastal extremes”. In: Climatic Change 139.1 (Nov. 2016), pp. 69–83.Intergovernmental Panel on Climate Change (IPCC). “Climate Change Information for Regional Impact and for Risk Assessment”. In: Climate Change 2021 – The Physical Science Basis: Working Group I Contribution to the Sixth Assessment Report of the Intergovernmental Panel on Climate Change. Cambridge University Press, 2023, pp. 1767–1926.Michalis I. Vousdoukas, Lorenzo Mentaschi, Evangelos Voukouvalas, Martin Verlaan, Svetlana Jevrejeva, Luke P. Jackson, and Luc Feyen. “Global probabilistic projections of extreme sea levels show intensification of coastal flood hazard”. In: Nature Communications 9.1 (June 2018), p. 2360.Sebastiaan N. Jonkman, Marten M. Hillen, Robert J. Nicholls, Wim Kanning, and Mathijs van Ledden. “Costs of Adapting Coastal Defences to Sea-Level Rise— New Estimates and Their Implications”. In: Journal of Coastal Research 29.5 (Apr. 2013), pp. 1212–1226.Stephan Lenk, Diego Rybski, Oliver Heidrich, Richard J. Dawson, and Jürgen P. Kropp. “Costs of sea dikes – regressions and uncertainty estimates”. In: Natural Hazards and Earth System Sciences 17.5 (2017), pp. 765–779.Shie Mannor. “k-Armed Bandit”. In: Encyclopedia of Machine Learning. Ed. by Claude Sammut and Geoffrey I. Webb. Boston, MA: Springer US, 2010, pp. 561–563.Adam Paszke, Sam Gross, Francisco Massa, Adam Lerer, James Bradbury, Gregory Chanan, Trevor Killeen, Zeming Lin, Natalia Gimelshein, Luca Antiga, et al. “Pytorch: An imperative style, high-performance deep learning library”. In: Advances in neural information processing systems 32 (2019).Ilya Loshchilov and Frank Hutter. Decoupled Weight Decay Regularization. 2019.Diederik P. Kingma and Jimmy Ba. Adam: A Method for Stochastic Optimization. 2017.Peter J. Huber. “Robust Estimation of a Location Parameter”. In: The Annals of Mathematical Statistics 35.1 (1964), pp. 73–101.Anders Myhr, Catho Bjerkseter, Anders Agotnes, and Tor A Nygaard. “Levelised cost of energy for offshore floating wind turbines in a life cycle perspective”. In: Renewable Energy 66 (2014), pp. 714–728.Mahmood Shafiee, Feargal Brennan, and Inés Armada Espinosa. “A parametric whole life cost model for offshore wind farms”. In: International Journal of Life Cycle Assessment 21 (2016), pp. 961–975.International Renewable Energy Agency. Renewable Energy Statistics 2022. Tech. rep. Abu Dhabi: International Renewable Energy Agency, 2022.Brian Snyder and Mark J Kaiser. “Ecological and economic cost-benefit analysis of offshore wind energy”. In: Renewable Energy 34 (2009), pp. 1567–1578.Volker Krey and Leon Clarke. “Role of renewable energy in climate mitigation: a synthesis of recent scenarios”. In: Climate Policy 11.4 (2011), pp. 1131–1158.Xiaojing Sun, Diangui Huang, and Guoqing Wu. “The current state of offshore wind energy technology development”. In: Energy 41.1 (2012). 23rd International Conference on Efficiency, Cost, Optimization, Simulation and Environmental Impact of Energy Systems, ECOS 2010, pp. 298–312.Laura Castro-Santos, Almudena Filgueira-Vizoso, Isabel Lamas-Galdo, and Luis Carral-Couce. “Methodology to calculate the installation costs of offshore wind farms located in deep waters”. In: Journal of Cleaner Production 170 (2018), pp. 1124–1135.C Maienza, A M Avossa, F Ricciardelli, D Coiro, G Troise, and C T Georgakis. “A life cycle cost model for floating offshore wind farms”. In: Applied Energy 266 (2020), p. 114716.S. Rodrigues, C. Restrepo, E. Kontos, R. Teixeira Pinto, and P. Bauer. “Trends of offshore wind projects”. In: Renewable and Sustainable Energy Reviews 49 (2015), pp. 1114–1135.C. Ng and L. Ran. “1 - Introduction to offshore wind energy”. In: Offshore Wind Farms. Ed. by Chong Ng and Li Ran. Woodhead Publishing, 2016, pp. 3–8.Xuefuei Wang, Xiangwu Zeng, Jiale Li, Hu Yang, and Haijun Wang. “A review on recent advancements of substructures for offshore wind turbines”. In: Energy Conversion and Management 158 (2018), pp. 103–119.Nuno Bento and Margarida Fontes. “Emergence of floating offshore wind energy: Technology and industry”. In: Renewable and Sustainable Energy Reviews 99 (2019), pp. 66–82.Juan Gabriel Rueda-Bayona, Andres Guzmán, Juan José Cabello Eras, Rodolfo Silva-Casarín, Emilio Bastidas-Arteaga, and José Horrillo-Caraballo. “Renewables energies in Colombia and the opportunity for the offshore wind technology”. In: Journal of Cleaner Production 220 (2019), pp. 529–543.Richard Green and Nicholas Vasilakos. “The economics of offshore wind”. In: Energy Policy 39.2 (2011). Special Section on Offshore wind power planning, economics and environment, pp. 496–502.Jonathan Bosch, Iain Staffell, and Adam D Hawkes. “Global levelised cost of electricity from offshore wind”. In: Energy 189 (2019), p. 116357.Bernd Möller, Lixuan Hong, Reinhard Lonsing, and Frede Hvelplund. “Evaluation of offshore wind resources by scale of development”. In: Energy 48.1 (2012). 6th Dubrovnik Conference on Sustainable Development of Energy Water and Environmental Systems, SDEWES 2011, pp. 314–322.James Carroll, Alasdair McDonald, Iain Dinwoodie, David McMillan, Matthew Revie, and Iraklis Lazakis. “Availability, operation and maintenance costs of offshore wind turbines with different drive train configurations”. In: Wind Energy 20 (2017), pp. 361–378.Anastasia Ioannou, Andrew Angus, and Feargal Brennan. “Stochastic Prediction of Offshore Wind Farm LCOE through an Integrated Cost Model”. In: Energy Procedia 107 (2017), pp. 383–389.Frances Judge, Fiona Devoy McAuliffe, Iver Bakken Sperstad, Rachel Chester, Brian Flannery, Katie Lynch, and Jimmy Murphy. “A lifecycle financial analysis model for offshore wind farms”. In: Renewable and Sustainable Energy Reviews 103 (2019), pp. 370–383.The Crown State. Offshore wind cost reduction, Pathways Study. The Crown State. 2012.Benjamin K Sovacool, Peter Enevoldsen, Christian Koch, and Rebecca J Barthelmie. “Cost performance and risk in the construction of offshore and onshore wind farms”. In: Wind Energy 20 (2017), pp. 891–908.James Carroll, Alasdair McDonald, and David McMillan. “Failure rate, repair time and unscheduled O&M cost analysis of offshore wind turbines”. In: Wind Energy 19 (2016), pp. 1107–1119.Hugo Díaz, José Miguel Rodrigues, and Carlos Guedes Soares. “Preliminary cost assessment of an offshore floating wind farm installation on the Galician coast”. In: 2016, pp. 843–850.Laura Castro-Santos and Vicente Diaz-Casas. “Life-cycle cost analysis of floating offshore wind farms”. In: Renewable Energy 66 (2014), pp. 41–48.200820524Publicationhttps://scholar.google.es/citations?user=0qgd0wkAAAAJvirtual::19651-10000-0002-3626-6690virtual::19651-1https://scienti.minciencias.gov.co/cvlac/visualizador/generarCurriculoCv.do?cod_rh=0000076813virtual::19651-124c11e3d-0ed1-4dc6-8d0f-47041642d01fvirtual::19651-124c11e3d-0ed1-4dc6-8d0f-47041642d01fvirtual::19651-1ORIGINALautorizacion tesis.pdfautorizacion tesis.pdfHIDEapplication/pdf266248https://repositorio.uniandes.edu.co/bitstreams/e0eefb6d-a25e-44fd-b7c3-f8830ba82f2a/download29ac603101abbc60c78776808d835b4bMD52A Framework for the Long-term Planning of Infrastructure Based on Flexibility.pdfA Framework for the Long-term Planning of Infrastructure Based on Flexibility.pdfapplication/pdf5033816https://repositorio.uniandes.edu.co/bitstreams/52fcae1d-e3f3-463f-a674-dcc914764354/downloaddb8056f306d69aa73d07930a2bbf4d44MD53CC-LICENSElicense_rdflicense_rdfapplication/rdf+xml; charset=utf-8805https://repositorio.uniandes.edu.co/bitstreams/3374de5c-3f03-40d0-943e-457fb04576ce/download4460e5956bc1d1639be9ae6146a50347MD54LICENSElicense.txtlicense.txttext/plain; charset=utf-82535https://repositorio.uniandes.edu.co/bitstreams/0766b331-f719-4f17-a179-065c59aa7832/downloadae9e573a68e7f92501b6913cc846c39fMD55TEXTautorizacion tesis.pdf.txtautorizacion tesis.pdf.txtExtracted texttext/plain2047https://repositorio.uniandes.edu.co/bitstreams/b7cc8964-1a8e-482c-886a-76611d76e3ba/download2b620d2557ca9dd5f5d3912a64679ddeMD56A Framework for the Long-term Planning of Infrastructure Based on Flexibility.pdf.txtA Framework for the Long-term Planning of Infrastructure Based on Flexibility.pdf.txtExtracted texttext/plain100172https://repositorio.uniandes.edu.co/bitstreams/c862833a-db2a-4507-b074-8b3c6c7636ad/download45eb3f04bf7adf838f816dd8366c25b9MD58THUMBNAILautorizacion tesis.pdf.jpgautorizacion tesis.pdf.jpgGenerated Thumbnailimage/jpeg10987https://repositorio.uniandes.edu.co/bitstreams/61cc96c0-edb4-4cc3-a8cd-9965cb5b4662/download665d15440af375d5ac0fabad1542f88eMD57A Framework for the Long-term Planning of Infrastructure Based on Flexibility.pdf.jpgA Framework for the Long-term Planning of Infrastructure Based on Flexibility.pdf.jpgGenerated Thumbnailimage/jpeg7309https://repositorio.uniandes.edu.co/bitstreams/8bc74697-63ee-4e7d-9968-13d2481405be/download09069f052ae01d95d08486ed4f5faedaMD591992/74927oai:repositorio.uniandes.edu.co:1992/749272024-09-12 16:26:50.593http://creativecommons.org/licenses/by-nc-nd/4.0/Attribution-NonCommercial-NoDerivatives 4.0 Internationalopen.accesshttps://repositorio.uniandes.edu.coRepositorio institucional Sénecaadminrepositorio@uniandes.edu.coPGgzPjxzdHJvbmc+RGVzY2FyZ28gZGUgUmVzcG9uc2FiaWxpZGFkIC0gTGljZW5jaWEgZGUgQXV0b3JpemFjacOzbjwvc3Ryb25nPjwvaDM+CjxwPjxzdHJvbmc+UG9yIGZhdm9yIGxlZXIgYXRlbnRhbWVudGUgZXN0ZSBkb2N1bWVudG8gcXVlIHBlcm1pdGUgYWwgUmVwb3NpdG9yaW8gSW5zdGl0dWNpb25hbCBTw6luZWNhIHJlcHJvZHVjaXIgeSBkaXN0cmlidWlyIGxvcyByZWN1cnNvcyBkZSBpbmZvcm1hY2nDs24gZGVwb3NpdGFkb3MgbWVkaWFudGUgbGEgYXV0b3JpemFjacOzbiBkZSBsb3Mgc2lndWllbnRlcyB0w6lybWlub3M6PC9zdHJvbmc+PC9wPgo8cD5Db25jZWRhIGxhIGxpY2VuY2lhIGRlIGRlcMOzc2l0byBlc3TDoW5kYXIgc2VsZWNjaW9uYW5kbyBsYSBvcGNpw7NuIDxzdHJvbmc+J0FjZXB0YXIgbG9zIHTDqXJtaW5vcyBhbnRlcmlvcm1lbnRlIGRlc2NyaXRvcyc8L3N0cm9uZz4geSBjb250aW51YXIgZWwgcHJvY2VzbyBkZSBlbnbDrW8gbWVkaWFudGUgZWwgYm90w7NuIDxzdHJvbmc+J1NpZ3VpZW50ZScuPC9zdHJvbmc+PC9wPgo8aHI+CjxwPllvLCBlbiBtaSBjYWxpZGFkIGRlIGF1dG9yIGRlbCB0cmFiYWpvIGRlIHRlc2lzLCBtb25vZ3JhZsOtYSBvIHRyYWJham8gZGUgZ3JhZG8sIGhhZ28gZW50cmVnYSBkZWwgZWplbXBsYXIgcmVzcGVjdGl2byB5IGRlIHN1cyBhbmV4b3MgZGUgc2VyIGVsIGNhc28sIGVuIGZvcm1hdG8gZGlnaXRhbCB5L28gZWxlY3Ryw7NuaWNvIHkgYXV0b3Jpem8gYSBsYSBVbml2ZXJzaWRhZCBkZSBsb3MgQW5kZXMgcGFyYSBxdWUgcmVhbGljZSBsYSBwdWJsaWNhY2nDs24gZW4gZWwgU2lzdGVtYSBkZSBCaWJsaW90ZWNhcyBvIGVuIGN1YWxxdWllciBvdHJvIHNpc3RlbWEgbyBiYXNlIGRlIGRhdG9zIHByb3BpbyBvIGFqZW5vIGEgbGEgVW5pdmVyc2lkYWQgeSBwYXJhIHF1ZSBlbiBsb3MgdMOpcm1pbm9zIGVzdGFibGVjaWRvcyBlbiBsYSBMZXkgMjMgZGUgMTk4MiwgTGV5IDQ0IGRlIDE5OTMsIERlY2lzacOzbiBBbmRpbmEgMzUxIGRlIDE5OTMsIERlY3JldG8gNDYwIGRlIDE5OTUgeSBkZW3DoXMgbm9ybWFzIGdlbmVyYWxlcyBzb2JyZSBsYSBtYXRlcmlhLCB1dGlsaWNlIGVuIHRvZGFzIHN1cyBmb3JtYXMsIGxvcyBkZXJlY2hvcyBwYXRyaW1vbmlhbGVzIGRlIHJlcHJvZHVjY2nDs24sIGNvbXVuaWNhY2nDs24gcMO6YmxpY2EsIHRyYW5zZm9ybWFjacOzbiB5IGRpc3RyaWJ1Y2nDs24gKGFscXVpbGVyLCBwcsOpc3RhbW8gcMO6YmxpY28gZSBpbXBvcnRhY2nDs24pIHF1ZSBtZSBjb3JyZXNwb25kZW4gY29tbyBjcmVhZG9yIGRlIGxhIG9icmEgb2JqZXRvIGRlbCBwcmVzZW50ZSBkb2N1bWVudG8uPC9wPgo8cD5MYSBwcmVzZW50ZSBhdXRvcml6YWNpw7NuIHNlIGVtaXRlIGVuIGNhbGlkYWQgZGUgYXV0b3IgZGUgbGEgb2JyYSBvYmpldG8gZGVsIHByZXNlbnRlIGRvY3VtZW50byB5IG5vIGNvcnJlc3BvbmRlIGEgY2VzacOzbiBkZSBkZXJlY2hvcywgc2lubyBhIGxhIGF1dG9yaXphY2nDs24gZGUgdXNvIGFjYWTDqW1pY28gZGUgY29uZm9ybWlkYWQgY29uIGxvIGFudGVyaW9ybWVudGUgc2XDsWFsYWRvLiBMYSBwcmVzZW50ZSBhdXRvcml6YWNpw7NuIHNlIGhhY2UgZXh0ZW5zaXZhIG5vIHNvbG8gYSBsYXMgZmFjdWx0YWRlcyB5IGRlcmVjaG9zIGRlIHVzbyBzb2JyZSBsYSBvYnJhIGVuIGZvcm1hdG8gbyBzb3BvcnRlIG1hdGVyaWFsLCBzaW5vIHRhbWJpw6luIHBhcmEgZm9ybWF0byBlbGVjdHLDs25pY28sIHkgZW4gZ2VuZXJhbCBwYXJhIGN1YWxxdWllciBmb3JtYXRvIGNvbm9jaWRvIG8gcG9yIGNvbm9jZXIuPC9wPgo8cD5FbCBhdXRvciwgbWFuaWZpZXN0YSBxdWUgbGEgb2JyYSBvYmpldG8gZGUgbGEgcHJlc2VudGUgYXV0b3JpemFjacOzbiBlcyBvcmlnaW5hbCB5IGxhIHJlYWxpesOzIHNpbiB2aW9sYXIgbyB1c3VycGFyIGRlcmVjaG9zIGRlIGF1dG9yIGRlIHRlcmNlcm9zLCBwb3IgbG8gdGFudG8sIGxhIG9icmEgZXMgZGUgc3UgZXhjbHVzaXZhIGF1dG9yw61hIHkgdGllbmUgbGEgdGl0dWxhcmlkYWQgc29icmUgbGEgbWlzbWEuPC9wPgo8cD5FbiBjYXNvIGRlIHByZXNlbnRhcnNlIGN1YWxxdWllciByZWNsYW1hY2nDs24gbyBhY2Npw7NuIHBvciBwYXJ0ZSBkZSB1biB0ZXJjZXJvIGVuIGN1YW50byBhIGxvcyBkZXJlY2hvcyBkZSBhdXRvciBzb2JyZSBsYSBvYnJhIGVuIGN1ZXN0acOzbiwgZWwgYXV0b3IgYXN1bWlyw6EgdG9kYSBsYSByZXNwb25zYWJpbGlkYWQsIHkgc2FsZHLDoSBkZSBkZWZlbnNhIGRlIGxvcyBkZXJlY2hvcyBhcXXDrSBhdXRvcml6YWRvcywgcGFyYSB0b2RvcyBsb3MgZWZlY3RvcyBsYSBVbml2ZXJzaWRhZCBhY3TDumEgY29tbyB1biB0ZXJjZXJvIGRlIGJ1ZW5hIGZlLjwvcD4KPHA+U2kgdGllbmUgYWxndW5hIGR1ZGEgc29icmUgbGEgbGljZW5jaWEsIHBvciBmYXZvciwgY29udGFjdGUgY29uIGVsIDxhIGhyZWY9Im1haWx0bzpiaWJsaW90ZWNhQHVuaWFuZGVzLmVkdS5jbyIgdGFyZ2V0PSJfYmxhbmsiPkFkbWluaXN0cmFkb3IgZGVsIFNpc3RlbWEuPC9hPjwvcD4K