Cues in the environment become predictors of biologically relevant stimuli, such as food, through associative learning. These cues can not only act as predictors but can also be attributed with incentive motivational value and gain control over behavior. When a cue is imbued with incentive salience, it attains the ability to elicit maladaptive behaviors characteristic of psychopathology. We can capture the propensity to attribute incentive salience to a reward cue in rats using a Pavlovian conditioned approach paradigm, in which the presentation of a discrete lever-cue is followed by the delivery of a food reward. Upon learning the cue-reward relationship, some rats, termed sign-trackers, develop a conditioned response directed towards the lever-cue; whereas others, termed goal-trackers, approach the food cup upon lever-cue presentation. Here, we assessed the effects of systemic corticosterone (CORT) on the acquisition and expression of sign- and goal-tracking behaviors in male and female rats, while examining the role of the vendor (Charles River or Taconic) from which the rats originated in these effects. Treatment naïve male and female rats from Charles River had a greater tendency to sign-track than those from Taconic. Administration of CORT enhanced the acquisition of sign-tracking behavior in males from Charles River and females from both vendors. Conversely, administration of CORT had no effect on the expression of the conditioned response. These findings demonstrate a role for CORT in cue-reward learning and suggest that inherent tendencies towards sign- or goal-tracking may interact with this physiological mediator of motivated behavior.

Animals, including humans, rely on contextual information to interpret ambiguous stimuli. Impaired context processing is a hallmark of several neuropsychiatric disorders, including schizophrenia, autism spectrum disorders, post-traumatic stress disorder, and addiction. While sex differences in the prevalence and manifestations of these disorders are well established, potential sex differences in context processing remain uncertain. Here, we examined sex differences in the contextual control over cue-evoked reward seeking and its neural correlates, in rats. Male and female rats were trained in a bidirectional occasion-setting preparation in which the validity of two auditory reward-predictive cues was informed by the presence, or absence, of a visual contextual feature (LIGHT: X+/DARK: X-/LIGHT: Y-/DARK: Y+). Females were significantly slower to acquire contextual control over cue-evoked reward seeking. However, once established, the contextual control over behavior was more robust in female rats; it showed less within-session variability (less influence of prior reward) and greater resistance to acute stress. This superior contextual control achieved by females was accompanied by an increased activation of the orbitofrontal cortex (OFC) compared to males. Critically, these behavioral and neural sex differences were specific to the contextual modulation process and not observed in simple, context-independent, reward prediction tasks. These results indicate a sex-biased trade-off between the speed of acquisition and the robustness of performance in the contextual modulation of cued reward seeking. The different distribution of sexes along the fast learning ↔ steady performance continuum might reflect different levels of engagement of the OFC, and might have implications for our understanding of sex differences in psychiatric disorders.

Pavlovian conditioning is typically distinguished from sensitization but a Pavlovian conditional stimulus (CS) also results in sensitization. A Pavlovian CS can sensitize responding to a probe stimulus that is related to the unconditional stimulus (US) or to the US itself. Pavlovian sensitization has been studied in the defensive, sexual, and feeding systems. In Pavlovian sensitization, the focus is not on a conditional response (CR) directly elicited by the CS but on the response mode that is activated by the CS. Activation of a response mode increases the probability of particular responses and also increases reactivity to various stimuli. Pavlovian sensitization reflects this increased stimulus reactivity. Pavlovian sensitization helps uncover successful learning in situations where a conventional CR does not occur. Pavlovian sensitization also encourages broadening our conceptions of Pavlovian conditioning to include changes in afferent processes. Implications for biological fitness and for basic and translational research are discussed.

Pavlovian fear conditioning and extinction represent learning mechanisms underlying exposure-based interventions. While increasing evidence indicates a pivotal role of disgust in the development of contamination-based obsessive-compulsive disorder (C-OCD), dysregulations in conditioned disgust acquisition and maintenance, in particular driven by higher-order conceptual processes, have not been examined. Here, we address this gap by exposing individuals with high (HCC, n = 41) or low (LCC, n = 41) contamination concern to a conceptual-level disgust conditioning and extinction paradigm. Conditioned stimuli (CS+) were images from one conceptual category partially reinforced by unconditioned disgust-eliciting stimuli (US), while images from another category served as non-reinforced conditioned stimuli (CS-). Skin conductance responses (SCRs), US expectancy and CS valence ratings served as primary outcomes to quantify conditioned disgust responses. Relative to LCC, HCC individuals exhibited increased US expectancy and CS+ disgust experience, but comparable SCR levels following disgust acquisition. Despite a decrease in conditioned responses from the acquisition phase to the extinction phase, both groups did not fully extinguish the learned disgust. Importantly, the extinction resilience of acquired disgust was more pronounced in HCC individuals. Together, our findings suggest that individuals with high self-reported contamination concern exhibit increased disgust acquisition and resistance to extinction. The findings provide preliminary evidence on how dysregulated disgust learning mechanism across semantically related concepts may contribute to C-OCD.

Adolescence marks a sensitive period for neurodevelopment wherein exposure to drugs of abuse may disrupt maturation and induce persistent changes in neurophysiology which may exacerbate the risk for developing substance use disorders in adulthood. Adolescent nicotine exposure (ANE) enhances motivation to obtain drugs of abuse, particularly opioids, and increases vulnerability for the development of opioid use disorder (OUD). Here, we characterized ANE effects on learning about the adverse consequences of opioid consumption in adulthood in the absence of further nicotine administration. First, we show that ANE engenders punishment resistant fentanyl self-administration in a heterogenous seeking-taking chain schedule of reinforcement at least at the tested dose of fentanyl (0.75 μg/kg). We found that ANE rats consumed significantly more fentanyl and contingent foot shock punishment was less efficacious in limiting fentanyl seeking in ANE rats, relative to nicotine-naïve controls. Next, we demonstrated that ANE limits learning about the deleterious consequences of acute opioid intoxication in adulthood. In a combined conditioned taste avoidance and place preference paradigm we found that ANE resulted in significant reductions in the strength of morphine-induced CTA, and a simultaneous enhancement of CPP at a higher dose that was less capable of driving reinforcement in naïve controls. Finally, we examined the expression of perineuronal nets (PNNs) within insular cortex (IC) and found ANE rats to have increased density of PNNs across the anterior IC and significantly more parvalbumin-labeled IC cells relative to naïve controls. Together, these data lay the framework for a mechanistic explanation of the extreme comorbidity between nicotine use and development of OUDs.

Instrumental appetitive extinction involves the reduction of a previously reinforced response when its occurrence is no longer rewarded. Two experiments with terrestrial toads (Rhinella arenarum) tested whether the occurrence of a nonreinforced response is necessary for response extinction by varying the time of exposure to nonrewarded goal-box stimuli across groups. In Experiment 1, toads that received the same acquisition training (15 sessions, 1 session/day, 300 s of access to water in the goal box) were randomly assigned to two groups. In Group 600 (n=12), animals spent 600 s in the goal box in 8 daily extinction sessions (water present but inaccessible). In Group 0 (n=11), toads performed the runway response (i.e., walking from the start to the goal box) but were removed as soon as they entered the goal box, thus having minimal exposure to nonrewarded goal-box stimuli. The runway response was weakened in Group 600 across extinction trials, but exhibited little change in Group 0. In Experiment 2, toads were randomly assigned to two groups after the same acquisition training. Group 0 (n=7) was treated the same as Group 0 in the previous experiment. In Group RI (retention interval, n=7), toads remained in their home cage for 13 days. Finally, all animals received 4 extinction sessions with 300 s in the empty goal box. There was little behavioral change in Group 0 during the 13 sessions with minimal exposure to the goal box. In extinction, both groups reduced their runway response at similar rates. Although the procedures were instrumental, extinction of the runway response in toads can be accounted for in terms of a Pavlovian approach response to stimuli paired with reward and nonreward in the goal box.

Continuous treatment with drugs is a crucial requirement for managing various clinical conditions, including chronic pain and neuropsychiatric disorders such as depression or schizophrenia. Associative learning processes, i.e. Pavlovian conditioning, can play an important role for the effects of drugs and could open new avenues for optimizing patient treatment. In this narrative literature review, we summarize available data in experimental animals regarding the behaviorally conditioned effects of psychostimulants such as d-amphetamine and cocaine, the dopamine receptor agonist apomorphine, the dopamine receptor antagonist haloperidol, morphine and antidepressant drugs. In each section, the drug under discussion is briefly introduced, followed by a detailed examination of conditioning features, including doses and dosing regimens, characteristics of the conditioning process such as test environments or specific conditioned stimuli, testing and conditioned response characteristics, possible extinction or reconditioning or reversal training, neural mechanisms, and finally, the potential clinical relevance of the research area related to the drug. We focus on key outcomes, delve into methodical issues, identify gaps in current knowledge, and suggest future research directions.

Dopamine and orexins (hypocretins) play important roles in regulating reward-seeking behaviors. It is known that hypothalamic orexinergic neurons project to dopamine neurons in the ventral tegmental area (VTA), where they can stimulate dopaminergic neuronal activity. Although there are reciprocal connections between dopaminergic and orexinergic systems, whether and how dopamine regulates the activity of orexin neurons is currently not known. Here we implemented an opto-Pavlovian task in which mice learn to associate a sensory cue with optogenetic dopamine neuron stimulation to investigate the relationship between dopamine release and orexin neuron activity in the lateral hypothalamus (LH). We found that dopamine release can be evoked in LH upon optogenetic stimulation of VTA dopamine neurons and is also naturally evoked by cue presentation after opto-Pavlovian learning. Furthermore, orexin neuron activity could also be upregulated by local stimulation of dopaminergic terminals in the LH in a way that is partially dependent on dopamine D2 receptors (DRD2). Our results reveal previously unknown orexinergic coding of reward expectation and unveil an orexin-regulatory axis mediated by local dopamine inputs in the LH.

The orosensory features of alcoholic drinks are potent relapse triggers because they acquire incentive properties during consumption, including enhanced palatability. Whether mice similarly perceive alcoholic drinks to be more palatable after repeated consumption is complicated by reports showing that alcohol elicits aversive taste reactivity responses and conditions flavor avoidance. Here, by analyzing the microstructure of alcohol consumption, we report a gradual increase in lick bout duration relative to water that is partially maintained by an alcohol-paired flavor in extinction. We interpret lick bout duration to reflect an increase in the palatability alcohol and an alcohol-paired flavor. This finding demonstrates that bout duration is amenable to Pavlovian conditioning and highlights the importance of considering the microstructure of alcohol consumption in preclinical models of alcohol misuse.

Pavlovian conditioning is thought to involve the formation of learned associations between stimuli and values, and between stimuli and specific features of outcomes. Here, we leveraged human single neuron recordings in ventromedial prefrontal, dorsomedial frontal, hippocampus, and amygdala while patients of both sexes performed an appetitive Pavlovian conditioning task probing both stimulus-value and stimulus-stimulus associations. Ventromedial prefrontal cortex encoded predictive value along with the amygdala, and also encoded predictions about the identity of stimuli that would subsequently be presented, suggesting a role for neurons in this region in encoding predictive information beyond value. Unsigned error signals were found in dorsomedial frontal areas and hippocampus, potentially supporting learning of non-value related outcome features. Our findings implicate distinct human prefrontal and medial temporal neuronal populations in mediating predictive associations which could partially support model-based mechanisms during Pavlovian conditioning.