Conditioning, Operant

Conditioning,操作
  • 文章类型: Journal Article
    现代生活的特点是容易获得高度可口的能量密集的食物。与可口食物相关的环境线索增加了对这些食物(特定转移)和其他可口食物(一般转移)的寻求。我们进行了一系列研究,通过评估更广泛的风味协会(即咸味,甜味)引发一般转移效应。实验1是一个具有虚构奖励的在线实验,该实验测试了与不同食物奖励(薯片和巧克力点)相关的两个动作是否可以被其他食物的图像所激发,这些食物的味道与这些工具动作相关的食物相似或不同。我们观察到反应激发仅由类似风味的食物提示引起,而相对于对照提示,明显调味的食物提示抑制了反应率。实验2在课堂环境中证实了这一观察结果,在课堂环境中,真正的食物奖励取决于任务表现。实验3是一项在线研究,进一步证实了动力良好的样品效果的可靠性。在所有研究中,特定转移效应和一般转移效应之间存在中度到强烈的关联,这表明重叠的认知过程是两种转移效应的原因。这些数据提高了对广泛类别关联如何减轻食物线索对食物选择的影响的机械理解。这些知识可能有助于提高旨在减轻食物提示反应性影响的心理干预措施的准确性。
    Modern living is characterized by easy access to highly palatable energy-dense foods. Environmental cues associated with palatable foods increase seeking of those foods (specific transfer) and other palatable foods (general transfer). We conducted a series of studies testing the boundaries of food cue-reactivity by evaluating the impact of broader flavor associations (i.e. saltiness, sweetness) in eliciting general transfer effects. Experiment 1 was an online experiment with fictive rewards that tested if two actions associated with different food rewards (chip and chocolate points) could be provoked by images of other foods that were either similar or distinct in flavor from the foods associated with these instrumental actions. We observed that response excitation was only elicited by similarly flavored food cues, whereas distinctly flavored food cues inhibited response rates relative to control cues. Experiment 2 confirmed this observation in a classroom setting where real food rewards were contingent on task performance. Experiment 3 was an online study that further confirmed the reliability of the effects with a well powered sample. There were moderate-to-strong associations between specific and general transfer effects across all studies, suggesting overlapping cognitive processes are responsible for both transfer effects. These data improve the mechanistic understanding of how broad category associations can moderate the impact of food cues on food choices. This knowledge could be helpful for improving the precision of psychological interventions that seek to mitigate the impact of food cue-reactivity.
    导出

    更多引用

    收藏

    翻译标题摘要

    我要上传

    求助全文

  • 文章类型: Journal Article
    在第二长的时间尺度上精确跟踪时间对于准确的预测和相应的行动非常重要,然而神经生物学基础仍然未知。在本期的神经元中,Garcia-Garcia及其同事1表明,由苔藓纤维和攀爬纤维途径之间的相互作用引起的小脑计算有助于在操作条件下进行长时间的学习。
    Precisely tracking time over second-long timescales is important for accurate anticipation and consequential actions, yet the neurobiological underpinnings remain unknown. In this issue of Neuron, Garcia-Garcia and colleagues1 show that computations in the cerebellum resulting from interactions between the mossy fiber and climbing fiber pathways contribute to long-interval learning during operant conditioning.
    导出

    更多引用

    收藏

    翻译标题摘要

    我要上传

    求助全文

  • 文章类型: Journal Article
    我们对鸟鸣的理解,动物交流和学习神经生物学的模型系统,关键取决于可靠,验证了歌曲中使用的复杂多维音节之间的比较。然而,对歌曲相似性的大多数评估都是基于人类对频谱图的检查,或从人类直觉发展而来的计算方法。使用新颖的自动操作调节系统,我们收集了大量斑马雀(Taeniopygiaguttata)关于歌曲音节相似性的决定。我们使用此数据集来比较和外部验证广泛使用的公开可用软件(Raven,声音分析Pro,卢西尼亚)。虽然这些方法都比机会表现得更好,他们没有严格模仿鸟类的评估。然后,我们介绍了一种新颖的深度学习方法,该方法可以产生对此类鸟类决策进行训练的感知相似性判断。我们发现这种新方法在准确性上优于已建立的方法,并且更接近鸟类评估。不一致(因此模棱两可)的决策在动物行为数据中很常见;我们表明,适应这些的深度学习训练的修改会带来最强的表现。我们认为这种方法是验证比较歌曲相似性的方法的最佳方法,我们的数据集可以用来验证新的方法,一般方法可以很容易地推广到其他物种。
    Our understanding of bird song, a model system for animal communication and the neurobiology of learning, depends critically on making reliable, validated comparisons between the complex multidimensional syllables that are used in songs. However, most assessments of song similarity are based on human inspection of spectrograms, or computational methods developed from human intuitions. Using a novel automated operant conditioning system, we collected a large corpus of zebra finches\' (Taeniopygia guttata) decisions about song syllable similarity. We use this dataset to compare and externally validate similarity algorithms in widely-used publicly available software (Raven, Sound Analysis Pro, Luscinia). Although these methods all perform better than chance, they do not closely emulate the avian assessments. We then introduce a novel deep learning method that can produce perceptual similarity judgements trained on such avian decisions. We find that this new method outperforms the established methods in accuracy and more closely approaches the avian assessments. Inconsistent (hence ambiguous) decisions are a common occurrence in animal behavioural data; we show that a modification of the deep learning training that accommodates these leads to the strongest performance. We argue this approach is the best way to validate methods to compare song similarity, that our dataset can be used to validate novel methods, and that the general approach can easily be extended to other species.
    导出

    更多引用

    收藏

    翻译标题摘要

    我要上传

       PDF(Pubmed)

  • 文章类型: Journal Article
    新任务通常是分阶段学习的,每个阶段都反映了不同的学习挑战。因此,每个学习阶段都可能由不同的神经元过程介导。然而,大多数啮齿动物对目标导向学习的神经元相关性的研究集中在个体结局指标和个体大脑区域。这里,我们纵向研究了小鼠从幼稚到专家的头部固定表现,操作调理晶须辨别任务。除了跟踪刺激歧视的主要行为结果,我们跟踪并比较了一系列基于对象和基于时间的行为度量。这些行为分析确定了多个,在这个任务中部分重叠的学习阶段,与初始响应实施一致,早期刺激-反应概括,和后期反应抑制。为了开始理解这些学习过程的神经元基础,我们在整个学习过程中对背侧新皮质进行了宽视野Ca2+成像,并将行为测量值与神经元活动相关联.我们发现新皮层激活模式与各种行为措施之间存在明显而广泛的相关性。例如,感觉辨别的改善与目标刺激引起的反应相关皮质的激活以及干扰刺激引起的整体皮质抑制相关。我们的研究揭示了一个简单的目标导向学习任务的多维学习,并为这些各种学习过程背后的神经元调制生成了假设。
    New tasks are often learned in stages with each stage reflecting a different learning challenge. Accordingly, each learning stage is likely mediated by distinct neuronal processes. And yet, most rodent studies of the neuronal correlates of goal-directed learning focus on individual outcome measures and individual brain regions. Here, we longitudinally studied mice from naïve to expert performance in a head-fixed, operant conditioning whisker discrimination task. In addition to tracking the primary behavioral outcome of stimulus discrimination, we tracked and compared an array of object-based and temporal-based behavioral measures. These behavioral analyses identify multiple, partially overlapping learning stages in this task, consistent with initial response implementation, early stimulus-response generalization, and late response inhibition. To begin to understand the neuronal foundations of these learning processes, we performed widefield Ca2+ imaging of dorsal neocortex throughout learning and correlated behavioral measures with neuronal activity. We found distinct and widespread correlations between neocortical activation patterns and various behavioral measures. For example, improvements in sensory discrimination correlated with target stimulus evoked activations of response-related cortices along with distractor stimulus evoked global cortical suppression. Our study reveals multidimensional learning for a simple goal-directed learning task and generates hypotheses for the neuronal modulations underlying these various learning processes.
    导出

    更多引用

    收藏

    翻译标题摘要

    我要上传

       PDF(Pubmed)

  • 文章类型: Journal Article
    内源性大麻素系统与奖励系统相互作用,以调节对自然增强剂的反应,以及滥用药物。先前的临床前研究表明,直接阻断CB1大麻素受体(CB1R)可以作为治疗物质使用障碍的潜在药理学方法。但是由于严重的精神病副作用,这种策略在临床试验中失败了。已经出现了替代策略以通过开发变构调节剂来规避直接CB1结合的副作用。我们假设CB1R信号的负变构调节会降低吗啡的增强特性并减少与阿片类药物滥用相关的行为。通过对小鼠进行静脉内自我给药,我们研究了GAT358,一种功能偏置的CB1R负变构调节剂(NAM),吗啡摄入量,类似复发的行为和为吗啡输注工作的动机。在吗啡自我给药的维持阶段,GAT358在固定比例1的强化方案下减少了吗啡输注的摄入量。GAT358还减少了强制禁欲后的吗啡寻求行为。此外,GAT358剂量依赖性地降低了在渐进的强化比例下获得吗啡输注的动机。引人注目的是,GAT358在相同的渐进比例任务中不影响为食物奖励而工作的动机,这表明GAT358在减少阿片类药物自我给药方面的作用是奖励特异性的。此外,GAT58在转杆试验中没有产生运动性共济失调。我们的结果表明,CB1RNAMs降低了吗啡的增强特性,并且可以代表安全减少阿片类药物滥用的可行治疗途径。
    The endocannabinoid system interacts with the reward system to modulate responsiveness to natural reinforcers, as well as drugs of abuse. Previous preclinical studies suggested that direct blockade of CB1 cannabinoid receptors (CB1R) could be leveraged as a potential pharmacological approach to treat substance use disorder, but this strategy failed during clinical trials due to severe psychiatric side effects. Alternative strategies have emerged to circumvent the side effects of direct CB1 binding through the development of allosteric modulators. We hypothesized that negative allosteric modulation of CB1R signalling would reduce the reinforcing properties of morphine and decrease behaviours associated with opioid misuse. By employing intravenous self-administration in mice, we studied the effects of GAT358, a functionally-biased CB1R negative allosteric modulator (NAM), on morphine intake, relapse-like behaviour and motivation to work for morphine infusions. GAT358 reduced morphine infusion intake during the maintenance phase of morphine self-administration under a fixed ratio 1 schedule of reinforcement. GAT358 also decreased morphine-seeking behaviour after forced abstinence. Moreover, GAT358 dose dependently decreased the motivation to obtain morphine infusions under a progressive ratio schedule of reinforcement. Strikingly, GAT358 did not affect the motivation to work for food rewards in an identical progressive ratio task, suggesting that the effect of GAT358 in decreasing opioid self-administration was reward specific. Furthermore, GAT58 did not produce motor ataxia in the rotarod test. Our results suggest that CB1R NAMs reduced the reinforcing properties of morphine and could represent a viable therapeutic route to safely decrease misuse of opioids.
    导出

    更多引用

    收藏

    翻译标题摘要

    我要上传

       PDF(Pubmed)

  • 文章类型: Journal Article
    ABA更新效应发生在一种情况下训练行为时(A),在第二上下文(B)中熄灭,并且测试发生在训练上下文(A)中。解释ABA更新的两种机制是测试中的上下文求和和灭绝学习的上下文调制,如果两种情况都有相似的联想历史,则前者不太可能。在两个实验中,我们使用受试者内设计,参与者学会避免由离散视觉刺激(条件刺激[CSs])发出信号的大声噪音(非条件刺激),按计算机键盘上的空格键。培训是在两种情况下进行的,在每个上下文中训练一对不同的CS(CS+和CS-)。在灭绝期间,CS+和CS-刺激是在训练的替代背景下呈现的,参与者被允许自由回应,但是没有出现很大的噪音。最后,所有CS都在这两种情况下进行了测试,导致受试者内ABA与ABB的比较。在整个实验中,参与者在训练期间增加了回避反应,在灭绝期间减少了回避反应,尽管实验2揭示了较少的灭绝。在测试过程中,当CS+在训练环境(ABA)与灭绝环境(ABB)中测试时,反应更高,揭示了工具回避的更新。实验2还测量了回避测试后的期望,并揭示了回避反应和期望等级之间的显着相似性。这项研究表明人类工具回避的更新,结果表明,在更新中对上下文的调节作用,类似于通过上下文学习灭绝的场合设置。(PsycInfo数据库记录(c)2024APA,保留所有权利)。
    The ABA renewal effect occurs when behavior is trained in one context (A), extinguished in a second context (B), and the test occurs in the training context (A). Two mechanisms that explain ABA renewal are context summation at the test and contextual modulation of extinction learning, with the former being unlikely if both contexts have a similar associative history. In two experiments, we used within-subjects designs in which participants learned to avoid a loud noise (unconditioned stimulus) signaled by discrete visual stimuli (conditioned stimuli [CSs]), by pressing the space bar on the computer keyboard. The training was conducted in two contexts, with a different pair of CSs (CS+ and CS-) trained in each context. During extinction, CS+ and CS- stimuli were presented in the alternative context from that of training, and participants were allowed to freely respond, but no loud noise was presented. Finally, all CSs were tested in both contexts, resulting in a within-subjects ABA versus ABB comparison. Across experiments, participants increased avoidance responses during training and decreased them during extinction, although Experiment 2 revealed less extinction. During the test, responding was higher when CS+ were tested in the training context (ABA) versus the extinction context (ABB), revealing the renewal of instrumental avoidance. Experiment 2 also measured expectancy after the avoidance test and revealed a remarkable similarity between avoidance responses and expectancy ratings. This study shows the renewal of instrumental avoidance in humans, and the results suggest the operation of a modulatory role for the context in renewal, similar to the occasion setting of extinction learning by the context. (PsycInfo Database Record (c) 2024 APA, all rights reserved).
    导出

    更多引用

    收藏

    翻译标题摘要

    我要上传

    求助全文

  • 文章类型: Journal Article
    阿司匹林(乙酰水杨酸,ASA),一种广泛使用的非甾体抗炎药很容易进入污水中,因此有必要研究阿司匹林对水生生物行为的影响。先前对哺乳动物的研究表明,ASA可以改变恐惧和焦虑样行为。在大池塘蜗牛里,ASA已被证明可以阻断由脂多糖注射引起的“疾病状态”,该脂多糖会上调免疫和压力相关基因,从而改变行为反应。在Lymnaea,根据刺激类型和强度,引发生理压力可能会增强记忆形成或阻止其恢复。在这里,我们研究了在学习过程中,当ASA暴露伴随着捕食者提示引起的压力时,ASA是否会改变小龙虾捕食者经历过的Lymnaea中两种形式的联想学习记忆。这两个培训程序是:1)空中呼吸的操作条件;和2)更高的学习形式,称为配置学习,这取决于唤起恐惧反应。我们在这里表明,ASA本身不会改变稳态空中呼吸,摄食行为或长期记忆(LTM)形成的操作性条件空中呼吸。然而,ASA阻止了通常通过在捕食者线索中训练蜗牛而引起的LTM形成的增强。ASA还阻止了配置学习,它利用了捕食者线索引起的恐惧反应。因此,ASA改变了Lymnaea对捕食者检测的认知反应。
    Aspirin (Acetylsalicylic acid, ASA), one of the widely used non-steroid anti-inflammatory drugs can easily end up in sewage effluents and thus it becomes necessary to investigate the effects of aspirin on behaviour of aquatic organisms. Previous studies in mammals have shown ASA to alter fear and anxiety-like behaviours. In the great pond snail Lymnaea stagnalis, ASA has been shown to block a \'sickness state\' induced by lipopolysaccharide injection which upregulates immune and stress-related genes thus altering behavioural responses. In Lymnaea, eliciting physiological stress may enhance memory formation or block its retrieval depending on the stimulus type and intensity. Here we examine whether ASA will alter two forms of associative-learning memory in crayfish predator-experienced Lymnaea when ASA exposure accompanies predator-cue-induced stress during the learning procedure. The two trainings procedures are: 1) operant conditioning of aerial respiration; and 2) a higher form of learning, called configural learning, which here is dependent on evoking a fear response. We show here that ASA alone does not alter homeostatic aerial respiration, feeding behaviour or long-term memory (LTM) formation of operantly conditioned aerial respiration. However, ASA blocked the enhancement of LTM formation normally elicited by training snails in predator cue. ASA also blocked configural learning, which makes use of the fear response elicited by the predator cue. Thus, ASA alters how Lymnaea responds cognitively to predator detection.
    导出

    更多引用

    收藏

    翻译标题摘要

    我要上传

    求助全文

  • 文章类型: Journal Article
    药物滥用率的上升凸显了确定改进的治疗方法的紧迫性。可以在啮齿动物中模拟的大多数寻求药物的行为都利用了反复的静脉内自我给药(SA)。最近对中胚层途径的研究表明,Kv7/KCNQ通道可能有助于从娱乐性药物向慢性药物使用的过渡。然而,到目前为止,所有这些研究都使用了非偶然性,实验者交付的药物模型系统,这种效应在接受自我给药训练的大鼠中的推广程度尚不清楚。这里,我们测试了瑞替加滨(ezogagabine)的能力,Kv7通道开启器,调节雄性SpragueDawley大鼠的工具行为。我们首先在条件位置偏好(CPP)测定中验证了瑞替加滨靶向实验者递送的可卡因的能力,并发现瑞替加滨降低了对位置偏好的获得。接下来,我们在固定比例或渐进比例强化计划下对大鼠进行可卡因-SA训练,发现瑞替加滨预处理可使低剂量至中等剂量可卡因的SA减弱.这在平行实验中没有观察到,大鼠自行施用蔗糖,自然的奖励。与蔗糖-SA相比,可卡因-SA与伏隔核中Kv7.5亚基表达的减少有关,在Kv7.2和Kv7.3中没有更改。因此,这些研究揭示了SA行为的奖赏特异性降低,并支持Kv7是具有功能失调的人类精神疾病的潜在治疗靶点的观点.
    The increasing rates of drug misuse highlight the urgency of identifying improved therapeutics for treatment. Most drug-seeking behaviours that can be modelled in rodents utilize the repeated intravenous self-administration (SA) of drugs. Recent studies examining the mesolimbic pathway suggest that Kv7/KCNQ channels may contribute to the transition from recreational to chronic drug use. However, to date, all such studies used noncontingent, experimenter-delivered drug model systems, and the extent to which this effect generalizes to rats trained to self-administer drugs is not known. Here, we tested the ability of retigabine (ezogabine), a Kv7 channel opener, to regulate instrumental behaviour in male Sprague Dawley rats. We first validated the ability of retigabine to target experimenter-delivered cocaine in a conditioned place preference (CPP) assay and found that retigabine reduced the acquisition of place preference. Next, we trained rats for cocaine-SA under a fixed-ratio or progressive-ratio reinforcement schedule and found that retigabine pretreatment attenuated the SA of low to moderate doses of cocaine. This was not observed in parallel experiments, with rats self-administering sucrose, a natural reward. Compared with sucrose-SA, cocaine-SA was associated with reductions in the expression of the Kv7.5 subunit in the nucleus accumbens, without alterations in Kv7.2 and Kv7.3. Therefore, these studies reveal a reward-specific reduction in SA behaviour and support the notion that Kv7 is a potential therapeutic target for human psychiatric diseases with dysfunctional reward circuitry.
    导出

    更多引用

    收藏

    翻译标题摘要

    我要上传

       PDF(Pubmed)

  • 文章类型: Journal Article
    渴望的孵化是一种现象,描述了在长期的禁欲强化中对奖励的渴望加剧。动物模型使用渴望的工具标记来奖励线索来检查孵化,而人类范式依赖于主观的自我报告。这里,我们描述了一个受动物启发的人,新的人类范式显示了自我报告和渴望偏爱可口食物的工具标记之间的强烈正相关关系。Further,我们发现了自上次消费和自我报告以来与时间的一致非线性关系,以及时间和仪器反应之间的初步模式。这些发现为建立受动物启发的人类孵化模型提供了一种新颖的方法。
    Incubation of craving is a phenomenon describing the intensification of craving for a reward over extended periods of abstinence from reinforcement. Animal models use instrumental markers of craving to reward cues to examine incubation, while human paradigms rely on subjective self-reports. Here, we characterize an animal-inspired, novel human paradigm that showed strong positive relationships between self-reports and instrumental markers of craving for favored palatable foods. Further, we found consistent nonlinear relationships with time since last consumption and self-reports, and preliminary patterns between time and instrumental responses. These findings provide a novel approach to establishing an animal-inspired human model of incubation.
    导出

    更多引用

    收藏

    翻译标题摘要

    我要上传

       PDF(Pubmed)

  • 文章类型: Journal Article
    药物使用的个体差异在初次接触后很快出现,只有一小部分开始吸毒的人继续发展成物质使用障碍。在临床前啮齿动物模型中,建立药物自我管理行为的脆弱性也很明显。这种变异性的潜在特征以及早期药物使用模式与后期使用之间的关系尚不清楚。这里,我们试图确定在雄性Sprague-Dawley大鼠中建立可卡因自我给药的倾向是否与随后的可卡因自我给药行为相关(n=14).在开始培训之前,我们在一个新的开放领域测试中评估了基础运动和焦虑样行为。然后,我们训练大鼠在每天3小时的可卡因(0.75mg/kg/输注)自我给药过程中自我给药可卡因,直到满足采集标准(≥30个主动杠杆按压,一次活动杠杆响应≥70%),并根据其潜伏期的中位数分裂分析将大鼠分为早期和晚期组,以满足采集标准。在每只老鼠达到采集标准后,我们给他们每天增加10次可卡因自我给药.然后我们进行了累进比率,可卡因诱导的运动敏感性试验,和非强化可卡因寻求测试后两个星期的强制禁欲。早期学习者在急性注射可卡因后表现出明显更少的运动,但两组在其他行为参数方面没有差异.这些结果表明,可卡因自我给药获得潜伏期并不能预测随后的吸毒行为,但可能与生理因素有关,如药物敏感性,这些因素会使大鼠学习操作任务。
    Individual differences in drug use emerge soon after initial exposure, and only a fraction of individuals who initiate drug use go on to develop a substance use disorder. Variability in vulnerability to establishing drug self-administration behavior is also evident in preclinical rodent models. Latent characteristics that underlie this variability and the relationship between early drug use patterns and later use remain unclear. Here, we attempt to determine whether propensity to establish cocaine self-administration is related to subsequent cocaine self-administration behavior in male Sprague-Dawley rats (n = 14). Prior to initiating training, we evaluated basal locomotor and anxiety-like behavior in a novel open field test. We then trained rats to self-administer cocaine in daily 3 h cocaine (0.75 mg/kg/infusion) self-administration sessions until acquisition criteria (≥30 active lever presses with ≥70 % responding on the active lever in one session) was met and divided rats into Early and Late groups by median-split analysis based on their latency to meet acquisition criteria. After each rat met acquisition criteria, we gave them 10 additional daily cocaine self-administration sessions. We then conducted a progressive ratio, cocaine-induced locomotor sensitivity test, and non-reinforced cocaine seeking test after two weeks of forced abstinence. Early Learners exhibited significantly less locomotion after an acute injection of cocaine, but the groups did not differ in any other behavioral parameter examined. These results indicate that cocaine self-administration acquisition latency is not predictive of subsequent drug-taking behavior, but may be linked to physiological factors like drug sensitivity that can predispose rats to learn the operant task.
    导出

    更多引用

    收藏

    翻译标题摘要

    我要上传

    求助全文

公众号