思想和行动往往是由一个决定,要么探索新的途径与未知的结果,或利用具有可预测结果的已知选项。然而,人类探索-开发权衡背后的神经机制仍然知之甚少。这是由于探索和开发作为心理建构的可操作性的可变性,以及用于研究这些选择行为的实验方案和范式的异质性。为了解决这个差距,在这里,我们将对文献进行全面回顾,以研究人类探索利用决策的神经基础。我们首先对强化学习期间健康成年人的探索与开发决策的功能神经影像学(fMRI)研究进行了系统回顾,信息搜索,和觅食。11项功能磁共振成像研究符合本综述的纳入标准。采用网络神经科学框架,综合这些研究的发现表明,基于探索的选择与注意力的参与有关,control,和显著性网络。相比之下,基于开发的选择与默认网络大脑区域的参与相关。我们在支持外部和内部定向认知过程之间的灵活切换的网络体系结构的背景下解释这些结果。适应所必需的,目标导向的行为。为了进一步研究探索-开发权衡的潜在神经机制,我们接下来调查了涉及神经发育的研究,神经心理学,和神经精神疾病,以及生命周期的发展,和神经退行性疾病。我们观察到这些人群的探索利用决策模式存在显著差异,再次表明这两种决策模式是由独立的神经回路支持的。一起来看,我们的综述强调了对与人类开发和探索相关的神经回路和行为相关性进行精确映射的必要性.表征探索与开发决策偏见可能会提供一种新颖的方法,跨诊断评估方法,监视,并对正常发育和临床人群的认知功能下降和功能障碍进行干预。
Thoughts and actions are often driven by a decision to either explore new avenues with unknown outcomes, or to exploit known options with predictable outcomes. Yet, the neural mechanisms underlying this exploration-exploitation trade-off in humans remain poorly understood. This is attributable to variability in the operationalization of exploration and exploitation as psychological constructs, as well as the heterogeneity of experimental protocols and paradigms used to study these choice behaviours. To address this gap, here we present a comprehensive
review of the literature to investigate the neural basis of explore-exploit decision-making in humans. We first conducted a systematic
review of functional magnetic resonance imaging (fMRI) studies of exploration-versus exploitation-based decision-making in healthy adult humans during foraging, reinforcement learning, and information search. Eleven fMRI studies met inclusion criterion for this
review. Adopting a network neuroscience framework, synthesis of the findings across these studies revealed that exploration-based choice was associated with the engagement of attentional, control, and salience networks. In contrast, exploitation-based choice was associated with engagement of default network brain regions. We interpret these results in the context of a network architecture that supports the flexible switching between externally and internally directed cognitive processes, necessary for adaptive, goal-directed behaviour. To further investigate potential neural mechanisms underlying the exploration-exploitation trade-off we next surveyed studies involving neurodevelopmental, neuropsychological, and neuropsychiatric disorders, as well as lifespan development, and neurodegenerative diseases. We observed striking differences in patterns of explore-exploit decision-making across these populations, again suggesting that these two decision-making modes are supported by independent neural circuits. Taken together, our
review highlights the need for precision-mapping of the neural circuitry and behavioural correlates associated with exploration and exploitation in humans. Characterizing exploration versus exploitation decision-making biases may offer a novel, trans-diagnostic approach to assessment, surveillance, and intervention for cognitive decline and dysfunction in normal development and clinical populations.