Value-based decision making

  • 文章类型: Journal Article
    受试者通常愿意为信息支付费用。在一个促进矛盾选择的程序中,动物选择更丰富的选项,然后是50%的时间奖励的提示(无信息)与一个更精简的选项,后跟两个提示之一,表明某些结果:一个总是奖励(100%),另一个从不奖励,0%(信息)。由于决策涉及在整合选项的所有特征后比较选项的主观价值,对信息的偏好可能依赖于皮质-杏仁核电路。为了测试这个,雄性和雌性大鼠在前扣带回皮质中制备双侧抑制性设计剂受体(DREADDs),眶额叶皮质,基底外侧杏仁核,或空病毒(控制)。在获得稳定的偏好后,我们抑制了这些区域。我们发现,对前扣带皮质的抑制会使雌性大鼠的选择偏好不稳定,而不会影响选择的潜伏期或对提示的反应率。逻辑回归拟合显示,在所有条件下,先前的选择都能预测当前的选择,然而,先前奖励的Info试验强烈预测了在所有条件下的偏好,除了前扣带回皮质抑制后的雌性大鼠。结果揭示了一个因果关系,前扣带皮质在涉及信息的决策中的性别依赖性作用。
    Subjects are often willing to pay a cost for information. In a procedure that promotes paradoxical choices, animals choose between a richer option followed by a cue that is rewarded 50% of the time (No Info) vs. a leaner option followed by one of two cues that signal certain outcomes: one always rewarded (100%) and the other never rewarded, 0% (Info). Since decisions involve comparing the subjective value of options after integrating all their features, preference for information may rely on cortico-amygdalar circuitry. To test this, male and female rats were prepared with bilateral inhibitory Designer Receptors Exclusively Activated by Designer Drugs (DREADDs) in the anterior cingulate cortex, orbitofrontal cortex, basolateral amygdala, or null virus (control). We inhibited these regions after stable preference was acquired. We found that inhibition of the anterior cingulate cortex destabilized choice preference in female rats without affecting latency to choose or response rate to cues. A logistic regression fit revealed that previous choice predicted current choice in all conditions, however previously rewarded Info trials strongly predicted preference in all conditions except in female rats following anterior cingulate cortex inhibition. The results reveal a causal, sex-dependent role for the anterior cingulate cortex in decisions involving information.
    导出

    更多引用

    收藏

    翻译标题摘要

    我要上传

       PDF(Pubmed)

  • 文章类型: Journal Article
    习惯对那些旨在理解人类行为的人来说是一个基本的难题。它们渗透到我们的日常生活中,主导着某些形式的精神病理学,但在实验室中极难引出。在本注册报告中,我们开发了基于计算模型的新实验范式,这表明习惯强度应该与行为的频率成正比,与以前的研究相比,独立于价值。具体来说,我们操纵了参与者在两个不同动作重复的任务中执行响应的频率,或者单独地,价值的变化。此外,我们询问了这种基于频率的习惯与基于价值的习惯操作以及现实生活中习惯行为的自我报告倾向之间的关系.我们发现,训练过程中的选择频率会增加测试中的习惯强度,并且这种习惯形式与基于价值的习惯操作几乎没有关系。我们的发现从经验上为习惯的构成提供了新颖的观点,并表明习惯可能在没有外部强化的情况下出现。我们进一步发现没有证据表明测量习惯的不同实验方法之间存在重叠,并且与自我报告的现实生活习惯没有关联。因此,我们的发现要求我们在实验室中对人类习惯性行为的理解和测量进行严格的重新评估。
    Habits pose a fundamental puzzle for those aiming to understand human behavior. They pervade our everyday lives and dominate some forms of psychopathology but are extremely hard to elicit in the lab. In this Registered Report, we developed novel experimental paradigms grounded in computational models, which suggest that habit strength should be proportional to the frequency of behavior and, in contrast to previous research, independent of value. Specifically, we manipulated how often participants performed responses in two tasks varying action repetition without, or separately from, variations in value. Moreover, we asked how this frequency-based habitization related to value-based operationalizations of habit and self-reported propensities for habitual behavior in real life. We find that choice frequency during training increases habit strength at test and that this form of habit shows little relation to value-based operationalizations of habit. Our findings empirically ground a novel perspective on the constituents of habits and suggest that habits may arise in the absence of external reinforcement. We further find no evidence for an overlap between different experimental approaches to measuring habits and no associations with self-reported real-life habits. Thus, our findings call for a rigorous reassessment of our understanding and measurement of human habitual behavior in the lab.
    导出

    更多引用

    收藏

    翻译标题摘要

    我要上传

       PDF(Pubmed)

  • 文章类型: Journal Article
    基于价值的决策取决于不同形式的记忆。然而,产生这些决定的记忆和评估过程各自的作用往往被模糊地描述,很少被联合调查。在这篇评论文章中,我们从神经经济学的角度来解决基于记忆的决策问题。我们首先描述需要记忆过程的决策所涉及的神经和认知过程,专注于情节记忆。根据系统研究计划的结果,然后我们聚焦记忆偏差的现象,对于可以更成功地从情节记忆中检索的选择选项的一般偏好。我们的发现表明,通过改变海马和腹内侧前额叶皮层之间的有效连接,失败的记忆回忆会偏向神经评估过程。这种偏见可以归因于关于主观价值与记忆之间关系的元认知信念以及不确定性厌恶。在总结了调查结果之后,我们概述了未来潜在的研究努力,以整合记忆和决策这两种研究传统。
    Value-based decisions depend on different forms of memory. However, the respective roles of memory and valuation processes that give rise to these decisions are often vaguely described and have rarely been investigated jointly. In this review article, we address the problem of memory-based decision making from a neuroeconomic perspective. We first describe the neural and cognitive processes involved in decisions requiring memory processes, with a focus on episodic memory. Based on the results of a systematic research program, we then spotlight the phenomenon of the memory bias, a general preference for choice options that can be retrieved from episodic memory more successfully. Our findings indicate that failed memory recall biases neural valuation processes as indicated by altered effective connectivity between the hippocampus and ventromedial prefrontal cortex. This bias can be attributed to meta-cognitive beliefs about the relationship between subjective value and memory as well as to uncertainty aversion. After summarizing the findings, we outline potential future research endeavors to integrate the two research traditions of memory and decision making.
    导出

    更多引用

    收藏

    翻译标题摘要

    我要上传

       PDF(Pubmed)

  • 文章类型: Editorial
    暂无摘要。
    导出

    更多引用

    收藏

    翻译标题摘要

    我要上传

       PDF(Pubmed)

  • 文章类型: Journal Article
    目标:低价值卫生技术的投资正在全球范围内增长。采用了不同的证据收集和评估方法来实施撤资举措,然而,不到一半的实证研究报告说,低价值服务的使用减少了。本范围审查旨在从现有的审查中综合有关医疗保健投资的概念和目的的信息,使用的方法和方法,利益相关者和促进者的作用以及实施过程中的障碍。
    方法:本范围审查由JoannaBriggs研究所证据综合手册和PRISMA范围审查声明指导。已发表的关于撤资的评论是从包括卫生技术评估(HTA)网站在内的科学数据库中使用术语“撤资,卫生技术重新评估,“和”医疗保健。“获得的数据是通过叙述方式合成的,以确定基于预先指定类别的方法的相似性和差异。
    结果:17项审查纳入了在16个国家中确定的34项举措,这些举措在不同的执行级别和活动负责机构中进行。促进非投资决策的两种最常用方法是计划预算和边际分析(PBMA)和HTA。利益相关者的参与是需要解决的最重要的方面,因为它既是撤资举措实施的促进者,也是壁垒。
    结论:撤资计划已经在多层次实施,涉及多方利益相关者,并使用多种方法,如PBMA和HTA。然而,与这些工具相关的技术分析的其他方面缺乏明确性。进一步的研究可以集中在医疗保健中的技术优化,作为整体卫生技术管理的一部分。
    OBJECTIVE: Disinvestment from low value health technologies is growing globally. Diverse evidence gathering and assessment methods were used to implement disinvestment initiatives, however, less than half of the empirical studies report reduced use of the low-value services. This scoping review aimed to synthesize the information from available reviews on the concepts and purposes of disinvestment in healthcare, the approaches and methods used, the role of stakeholders and facilitators and barriers in its implementation.
    METHODS: This scoping review was guided by the Joanna Briggs Institute Manual for Evidence Synthesis and PRISMA statement for scoping review. Published reviews on disinvestment were identified from scientific databases including health technology assessment (HTA) Web sites using the terms \"disinvestment,\" \"health technology reassessment,\" and \"healthcare.\" The data obtained was synthesized narratively to identify similarities and differences across the approaches based on the prespecified categories.
    RESULTS: Seventeen reviews were included with thirty-four initiatives identified across sixteen countries at various levels of implementation and responsible agencies for the activities. Two most used methods to facilitate disinvestment decisions are Programme Budgeting and Marginal Analysis (PBMA) and HTA. Stakeholder involvement is the most important aspect to be addressed, as it acts as both facilitator and barrier in disinvestment initiatives implementation.
    CONCLUSIONS: Disinvestment programs have been implemented at multilevel, involving multistakeholders and using multiple methods such as PBMA and HTA. However, there is a lack of clarity on the additional dimensions of technical analysis related to these tools. Further research could focus on technology optimization in healthcare as part of overall health technology management.
    导出

    更多引用

    收藏

    翻译标题摘要

    我要上传

    求助全文

  • 文章类型: Journal Article
    在决策神经科学中,电机系统主要被认为是参与执行选择行动。然而,一种相互竞争的观点表明,它参与了对期权的评估,传统上被认为是由大脑的估值系统执行的。这里,我们通过确定与先前确定的用于编码决策选项的感觉运动β振荡相关的神经电路,来研究运动系统在基于价值的决策中的作用.在同时进行的EEG-fMRI研究中,参与者评估了与即将采取的行动相关的回报和风险。在反应之前并与反应无关,发现了显着的感觉运动β去同步。β去同步水平显示出编码奖励水平的证据。这种β去同步变化,在逐个审判的层面上,在皮质-基底神经节-丘脑回路中具有BOLD活性。相比之下,估值网络内只有微弱的协变,尽管奖励水平对其BOLD活动进行了显着调节。这些结果表明,处理决策变量的方式在评估网络和皮质-基底神经节-丘脑回路中有所不同。我们认为,即使在做出响应之前,感觉运动β振荡也表明了对从决策变量计算出的选择行动的激励动机。它来自皮质-基底神经节-丘脑回路。
    In decision neuroscience, the motor system has primarily been considered to be involved in executing choice actions. However, a competing perspective suggests its engagement in the evaluation of options, traditionally considered to be performed by the brain\'s valuation system. Here, we investigate the role of the motor system in value-based decision making by determining the neural circuitries associated with the sensorimotor beta oscillations previously identified to encode decision options. In a simultaneous EEG-fMRI study, participants evaluated reward and risk associated with a forthcoming action. A significant sensorimotor beta desynchronization was identified prior to and independent of response. The level of beta desynchronization showed evidence of encoding the reward levels. This beta desynchronization covaried, on a trial-by-trial level, with BOLD activity in the cortico-basal ganglia-thalamic circuitry. In contrast, there was only a weak covariation within the valuation network, despite significant modulation of its BOLD activity by reward levels. These results suggest that the way in which decision variables are processed differs in the valuation network and in the cortico-basal ganglia-thalamic circuitry. We propose that sensorimotor beta oscillations indicate incentive motivational drive towards a choice action computed from the decision variables even prior to making a response, and it arises from the cortico-basal ganglia-thalamic circuitry.
    导出

    更多引用

    收藏

    翻译标题摘要

    我要上传

    求助全文

  • 文章类型: Journal Article
    背景:人们对月经周期生理学在食欲和肥胖中的重要性知之甚少。我们调查了体重指数(BMI)的影响,月经周期阶段和甜咸味对休闲食品货币价值的影响。
    方法:我们招募了72名女性,在应用纳入和排除标准后,仍有31名体重健康的参与者和25名肥胖的参与者。参与者完成了支付意愿(WTP)任务,以测量排卵前和黄体周期中期30种零食的主观价值。
    结果:广义线性混合模型(GLMM)分析显示,周期阶段和零食味道相互作用,影响WTP(-0.15[-0.22,-0.03],p=0.002)。因此,WTP与BMI呈负相关,但是这种关系的强度取决于周期和味道。健康体重的参与者对咸味的WTP在整个周期阶段发生变化,但甜味的WTP不受周期阶段的影响。此外,在肥胖参与者中,咸味零食的周期效应停止了。
    结论:BMI对休闲食品的WTP评估的负面影响与我们之前报道的相同女性的BMI对奶昔的愉悦评分的积极影响形成对比。这表明这两种措施反映了肥胖中与食物相关的价值处理的不同方面。此外,WTP数据表明,对于健康体重的个体,在月经周期的排卵前阶段,咸味零食的选择可能不同于甜味零食.周期阶段似乎不会影响肥胖参与者的食物评估。这些发现与了解和治疗女性肥胖有关。
    BACKGROUND: The importance of menstrual cycle physiology in appetite and obesity is poorly understood. We investigated the effects of body mass index (BMI), menstrual cycle phase and sweet and salty taste on monetary valuation of snack foods.
    METHODS: We recruited 72 women and after the application of in- and exclusion criteria 31 participants with healthy weight and 25 with obesity remained. The participants completed a willingness to pay (WTP) task to measure subjective value of 30 snack food items in the pre-ovulatory and mid-luteal cycle phases.
    RESULTS: Generalized linear mixed model (GLMM) analysis revealed that BMI, cycle phase and snack taste interacted to influence WTP (-0.15 [-0.22, -0.03], p = 0.002). Hence, WTP was inversely related to BMI, but the strength of the relation depended on cycle phase and taste. The WTP of participants with healthy weight for salty taste changed across cycle phase but the WTP for sweet taste was not affected by cycle phase. Moreover, the cycle effect for the salty snacks ceased in participants with obesity.
    CONCLUSIONS: The inverse effect of BMI on WTP valuation of snack foods contrasts with the positive effect of BMI on pleasantness ratings for milkshakes by the same women that we previously reported. This indicates that the two measures reflect different aspects of food-related valuative processing in obesity. Furthermore, the WTP data suggest that the selection of salty snacks may differ from that of sweet snacks in the pre-ovulatory phase of the menstrual cycle for individuals of healthy weight. The cycle phase does not seem to affect food valuation of participants with obesity. These findings are relevant to understanding and treating obesity in women.
    导出

    更多引用

    收藏

    翻译标题摘要

    我要上传

       PDF(Pubmed)

  • 文章类型: Journal Article
    与任务相关的信息广泛分布在大脑中,具有不同的编码属性,如坚持。我们在小鼠中发现,动作历史和价值的编码持久性在不同区域是可变的,学习阶段,和任务上下文,在进行基于价值的决策的专家小鼠的脾后皮质中,需要在整个试验中保持历史记录的持久性最高。持续编码也出现在被训练来执行类似鼠标的强化学习的人工网络中。持久性允许在神经元流形中进行时间上不缠结的值表示,其中种群活动表现出循环轨迹,这些轨迹在动作结果后沿值轴过渡,共同形成圆柱动力学。仿真表明,理顺的持久性有助于下游网络进行稳健的价值检索。即使通过非特定连接性泄漏持续维持的价值,也可能导致具有不同持久性水平的全脑分布式价值编码。这些结果表明,上下文相关,不纠结的持久性有助于可靠的信号编码及其在大脑中的分布。
    Task-related information is widely distributed across the brain with different coding properties, such as persistency. We found in mice that coding persistency of action history and value was variable across areas, learning phases, and task context, with the highest persistency in the retrosplenial cortex of expert mice performing value-based decisions where history needs to be maintained across trials. Persistent coding also emerged in artificial networks trained to perform mouse-like reinforcement learning. Persistency allows temporally untangled value representations in neuronal manifolds where population activity exhibits cyclic trajectories that transition along the value axis after action outcomes, collectively forming cylindrical dynamics. Simulations indicated that untangled persistency facilitates robust value retrieval by downstream networks. Even leakage of persistently maintained value through non-specific connectivity could contribute to the brain-wide distributed value coding with different levels of persistency. These results reveal that context-dependent, untangled persistency facilitates reliable signal coding and its distribution across the brain.
    导出

    更多引用

    收藏

    翻译标题摘要

    我要上传

       PDF(Pubmed)

  • 文章类型: Journal Article
    复杂环境中基于价值的决策,例如那些将奖励概率映射到期权上的不确定和不稳定的映射,可能会产生计算策略,这些策略在规范框架方面不一定是最佳的,但可以在有限的神经计算资源条件下确保有效的学习和行为灵活性。在这篇文章中,我们回顾了一种次优策略-将期权的奖励大小和奖励概率属性相加结合起来,以进行基于价值的决策。此外,我们介绍了最近开发的模型(称为MIX模型)的计算复杂性,该模型代表了在具有两个选项的顺序决策中加性策略的算法实现。我们还讨论了它的机会;和概念,推论,和泛化问题。此外,我们建议未来的研究将揭示MIX模型作为基于价值的选择的一般模型的潜力并为其进一步发展服务.
    Value-based decision making in complex environments, such as those with uncertain and volatile mapping of reward probabilities onto options, may engender computational strategies that are not necessarily optimal in terms of normative frameworks but may ensure effective learning and behavioral flexibility in conditions of limited neural computational resources. In this article, we review a suboptimal strategy - additively combining reward magnitude and reward probability attributes of options for value-based decision making. In addition, we present computational intricacies of a recently developed model (named MIX model) representing an algorithmic implementation of the additive strategy in sequential decision-making with two options. We also discuss its opportunities; and conceptual, inferential, and generalization issues. Furthermore, we suggest future studies that will reveal the potential and serve the further development of the MIX model as a general model of value-based choice making.
    导出

    更多引用

    收藏

    翻译标题摘要

    我要上传

       PDF(Pubmed)

  • 文章类型: Journal Article
    拖延是自愿但非理性地推迟一项任务,尽管意识到拖延会导致更糟糕的后果。它在心理学领域得到了广泛的研究,从促成因素来看,到理论模型。从基于价值的决策和强化学习(RL)的角度来看,拖延被认为是由认知限制导致的非最佳选择引起的。到底涉及什么样的认知限制,然而,仍然难以捉摸。在目前的研究中,我们检查了一种特定类型的认知限制,即,国家代表性不足导致估值不准确,会导致拖延。最近的工作表明,人类可以采用称为后继表示(SR)的特定类型的状态表示,并且人类可以学习通过相对低维的特征来表示状态。结合这些建议,我们假设了一个降维版本的SR。我们模拟了“学生”在学期期间做作业的一系列行为,当推迟执行任务时(即,拖延)是不允许的,在假期里,是否拖延可以自由选择。我们假设“学生”获得了每个州严格降低的SR,对应于完成作业的每个步骤,在没有拖延的政策下。“学生”学习了每个状态的近似值,该近似值是作为刚性简化SR中状态特征的线性函数计算的,通过时间差(TD)学习。假期期间,“学生”根据这些近似值在每个时间步做出是否拖延的决定。仿真结果表明,基于简化SR的RL模型产生了拖延行为,这种情况在不同的情节中恶化了。根据学生的近似值,“拖延是更好的选择,而根据真实值,不拖延大多更好。因此,当前模型产生的拖延行为是由不准确的值逼近引起的,这是由于采用减少的SR作为州代表。这些结果表明,降低的SR,或者更一般地,状态表示中的降维,可能是导致拖延的认知限制的潜在形式。
    Procrastination is the voluntary but irrational postponing of a task despite being aware that the delay can lead to worse consequences. It has been extensively studied in psychological field, from contributing factors, to theoretical models. From value-based decision making and reinforcement learning (RL) perspective, procrastination has been suggested to be caused by non-optimal choice resulting from cognitive limitations. Exactly what sort of cognitive limitations are involved, however, remains elusive. In the current study, we examined if a particular type of cognitive limitation, namely, inaccurate valuation resulting from inadequate state representation, would cause procrastination. Recent work has suggested that humans may adopt a particular type of state representation called the successor representation (SR) and that humans can learn to represent states by relatively low-dimensional features. Combining these suggestions, we assumed a dimension-reduced version of SR. We modeled a series of behaviors of a \"student\" doing assignments during the school term, when putting off doing the assignments (i.e., procrastination) is not allowed, and during the vacation, when whether to procrastinate or not can be freely chosen. We assumed that the \"student\" had acquired a rigid reduced SR of each state, corresponding to each step in completing an assignment, under the policy without procrastination. The \"student\" learned the approximated value of each state which was computed as a linear function of features of the states in the rigid reduced SR, through temporal-difference (TD) learning. During the vacation, the \"student\" made decisions at each time-step whether to procrastinate based on these approximated values. Simulation results showed that the reduced SR-based RL model generated procrastination behavior, which worsened across episodes. According to the values approximated by the \"student,\" to procrastinate was the better choice, whereas not to procrastinate was mostly better according to the true values. Thus, the current model generated procrastination behavior caused by inaccurate value approximation, which resulted from the adoption of the reduced SR as state representation. These findings indicate that the reduced SR, or more generally, the dimension reduction in state representation, can be a potential form of cognitive limitation that leads to procrastination.
    导出

    更多引用

    收藏

    翻译标题摘要

    我要上传

       PDF(Pubmed)

公众号