Suppr超能文献

通过自适应管理和强化学习实现更稳健的决策。

Bridging adaptive management and reinforcement learning for more robust decisions.

机构信息

Department of Environmental Science, Policy, and Management, University of California, Berkeley, CA 94720, USA.

School of Engineering and Applied Sciences, Harvard University, Cambridge, MA 02138, USA.

出版信息

Philos Trans R Soc Lond B Biol Sci. 2023 Jul 17;378(1881):20220195. doi: 10.1098/rstb.2022.0195. Epub 2023 May 29.

Abstract

From out-competing grandmasters in chess to informing high-stakes healthcare decisions, emerging methods from artificial intelligence are increasingly capable of making complex and strategic decisions in diverse, high-dimensional and uncertain situations. But can these methods help us devise robust strategies for managing environmental systems under great uncertainty? Here we explore how reinforcement learning (RL), a subfield of artificial intelligence, approaches decision problems through a lens similar to adaptive environmental management: learning through experience to gradually improve decisions with updated knowledge. We review where RL holds promise for improving evidence-informed adaptive management decisions even when classical optimization methods are intractable and discuss technical and social issues that arise when applying RL to adaptive management problems in the environmental domain. Our synthesis suggests that environmental management and computer science can learn from one another about the practices, promises and perils of experience-based decision-making. This article is part of the theme issue 'Detecting and attributing the causes of biodiversity change: needs, gaps and solutions'.

摘要

从在国际象棋中击败大师级选手,到为高风险的医疗保健决策提供信息,人工智能领域涌现出的新方法在复杂、战略和多样化、高维以及不确定的情况下,越来越能够做出决策。但是,这些方法是否可以帮助我们制定在巨大不确定性下管理环境系统的稳健策略?在这里,我们通过与自适应环境管理类似的视角来探索强化学习(RL)——人工智能的一个分支——是如何通过经验来解决决策问题的:通过经验学习,随着知识的更新逐渐改进决策。我们回顾了 RL 在改进基于证据的自适应管理决策方面的应用前景,即使在经典优化方法难以处理的情况下,以及在将 RL 应用于环境领域的自适应管理问题时出现的技术和社会问题。我们的综述表明,环境管理和计算机科学可以相互学习基于经验的决策制定的实践、前景和风险。本文是主题为“检测和归因生物多样性变化的原因:需求、差距和解决方案”的一部分。

相似文献

1
Bridging adaptive management and reinforcement learning for more robust decisions.
Philos Trans R Soc Lond B Biol Sci. 2023 Jul 17;378(1881):20220195. doi: 10.1098/rstb.2022.0195. Epub 2023 May 29.
2
The Lived Experience of Autistic Adults in Employment: A Systematic Search and Synthesis.
Autism Adulthood. 2024 Dec 2;6(4):495-509. doi: 10.1089/aut.2022.0114. eCollection 2024 Dec.
3
Perceptions and experiences of the prevention, detection, and management of postpartum haemorrhage: a qualitative evidence synthesis.
Cochrane Database Syst Rev. 2023 Nov 27;11(11):CD013795. doi: 10.1002/14651858.CD013795.pub2.
5
Can We Enhance Shared Decision-making for Periacetabular Osteotomy Surgery? A Qualitative Study of Patient Experiences.
Clin Orthop Relat Res. 2025 Jan 1;483(1):120-136. doi: 10.1097/CORR.0000000000003198. Epub 2024 Jul 23.
7
Shared decision-making interventions for people with mental health conditions.
Cochrane Database Syst Rev. 2022 Nov 11;11(11):CD007297. doi: 10.1002/14651858.CD007297.pub3.
8
Interventions to improve safe and effective medicines use by consumers: an overview of systematic reviews.
Cochrane Database Syst Rev. 2014 Apr 29;2014(4):CD007768. doi: 10.1002/14651858.CD007768.pub3.

引用本文的文献

1
Detecting and attributing the causes of biodiversity change: needs, gaps and solutions.
Philos Trans R Soc Lond B Biol Sci. 2023 Jul 17;378(1881):20220181. doi: 10.1098/rstb.2022.0181. Epub 2023 May 29.
2
Perspective: sustainability challenges, opportunities and solutions for long-term ecosystem observations.
Philos Trans R Soc Lond B Biol Sci. 2023 Jul 17;378(1881):20220192. doi: 10.1098/rstb.2022.0192. Epub 2023 May 29.
3
Economic factors underlying biodiversity loss.
Philos Trans R Soc Lond B Biol Sci. 2023 Jul 17;378(1881):20220197. doi: 10.1098/rstb.2022.0197. Epub 2023 May 29.

本文引用的文献

1
Camera trapping expands the view into global biodiversity and its change.
Philos Trans R Soc Lond B Biol Sci. 2023 Jul 17;378(1881):20220232. doi: 10.1098/rstb.2022.0232. Epub 2023 May 29.
2
Adaptive Management in Habitat Conservation Plans.
Conserv Biol. 2002 Feb;16(1):20-29. doi: 10.1046/j.1523-1739.2002.00350.x.
3
The forecast trap.
Ecol Lett. 2022 Jul;25(7):1655-1664. doi: 10.1111/ele.14024. Epub 2022 May 30.
4
The AI Economist: Taxation policy design via two-level deep multiagent reinforcement learning.
Sci Adv. 2022 May 6;8(18):eabk2607. doi: 10.1126/sciadv.abk2607. Epub 2022 May 4.
6
Magnetic control of tokamak plasmas through deep reinforcement learning.
Nature. 2022 Feb;602(7897):414-419. doi: 10.1038/s41586-021-04301-9. Epub 2022 Feb 16.
7
Deep learning for early warning signals of tipping points.
Proc Natl Acad Sci U S A. 2021 Sep 28;118(39). doi: 10.1073/pnas.2106140118.
8
Explainable AI and Reinforcement Learning-A Systematic Review of Current Approaches and Trends.
Front Artif Intell. 2021 May 20;4:550030. doi: 10.3389/frai.2021.550030. eCollection 2021.
9
Autonomous navigation of stratospheric balloons using reinforcement learning.
Nature. 2020 Dec;588(7836):77-82. doi: 10.1038/s41586-020-2939-8. Epub 2020 Dec 2.

文献AI研究员

20分钟写一篇综述,助力文献阅读效率提升50倍。

立即体验

用中文搜PubMed

大模型驱动的PubMed中文搜索引擎

马上搜索

文档翻译

学术文献翻译模型,支持多种主流文档格式。

立即体验