New tasks are often learned in stages with each stage reflecting a different learning challenge. Accordingly, each learning stage is likely mediated by distinct neuronal processes. And yet, most rodent studies of the neuronal correlates of goal-directed learning focus on individual outcome measures and individual brain regions. Here, we longitudinally studied mice from naïve to expert performance in a head-fixed, operant conditioning whisker discrimination task. In addition to tracking the primary behavioral outcome of stimulus discrimination, we tracked and compared an array of object-based and temporal-based behavioral measures. These behavioral analyses identify multiple, partially overlapping learning stages in this task, consistent with initial response implementation, early stimulus-response generalization, and late response inhibition. To begin to understand the neuronal foundations of these learning processes, we performed widefield Ca2+ imaging of dorsal neocortex throughout learning and correlated behavioral measures with neuronal activity. We found distinct and widespread correlations between neocortical activation patterns and various behavioral measures. For example, improvements in sensory discrimination correlated with target stimulus evoked activations of response-related cortices along with distractor stimulus evoked global cortical suppression. Our study reveals multidimensional learning for a simple goal-directed learning task and generates hypotheses for the neuronal modulations underlying these various learning processes.

The endocannabinoid system interacts with the reward system to modulate responsiveness to natural reinforcers, as well as drugs of abuse. Previous preclinical studies suggested that direct blockade of CB1 cannabinoid receptors (CB1R) could be leveraged as a potential pharmacological approach to treat substance use disorder, but this strategy failed during clinical trials due to severe psychiatric side effects. Alternative strategies have emerged to circumvent the side effects of direct CB1 binding through the development of allosteric modulators. We hypothesized that negative allosteric modulation of CB1R signalling would reduce the reinforcing properties of morphine and decrease behaviours associated with opioid misuse. By employing intravenous self-administration in mice, we studied the effects of GAT358, a functionally-biased CB1R negative allosteric modulator (NAM), on morphine intake, relapse-like behaviour and motivation to work for morphine infusions. GAT358 reduced morphine infusion intake during the maintenance phase of morphine self-administration under a fixed ratio 1 schedule of reinforcement. GAT358 also decreased morphine-seeking behaviour after forced abstinence. Moreover, GAT358 dose dependently decreased the motivation to obtain morphine infusions under a progressive ratio schedule of reinforcement. Strikingly, GAT358 did not affect the motivation to work for food rewards in an identical progressive ratio task, suggesting that the effect of GAT358 in decreasing opioid self-administration was reward specific. Furthermore, GAT58 did not produce motor ataxia in the rotarod test. Our results suggest that CB1R NAMs reduced the reinforcing properties of morphine and could represent a viable therapeutic route to safely decrease misuse of opioids.

The ABA renewal effect occurs when behavior is trained in one context (A), extinguished in a second context (B), and the test occurs in the training context (A). Two mechanisms that explain ABA renewal are context summation at the test and contextual modulation of extinction learning, with the former being unlikely if both contexts have a similar associative history. In two experiments, we used within-subjects designs in which participants learned to avoid a loud noise (unconditioned stimulus) signaled by discrete visual stimuli (conditioned stimuli [CSs]), by pressing the space bar on the computer keyboard. The training was conducted in two contexts, with a different pair of CSs (CS+ and CS-) trained in each context. During extinction, CS+ and CS- stimuli were presented in the alternative context from that of training, and participants were allowed to freely respond, but no loud noise was presented. Finally, all CSs were tested in both contexts, resulting in a within-subjects ABA versus ABB comparison. Across experiments, participants increased avoidance responses during training and decreased them during extinction, although Experiment 2 revealed less extinction. During the test, responding was higher when CS+ were tested in the training context (ABA) versus the extinction context (ABB), revealing the renewal of instrumental avoidance. Experiment 2 also measured expectancy after the avoidance test and revealed a remarkable similarity between avoidance responses and expectancy ratings. This study shows the renewal of instrumental avoidance in humans, and the results suggest the operation of a modulatory role for the context in renewal, similar to the occasion setting of extinction learning by the context. (PsycInfo Database Record (c) 2024 APA, all rights reserved).

The increasing rates of drug misuse highlight the urgency of identifying improved therapeutics for treatment. Most drug-seeking behaviours that can be modelled in rodents utilize the repeated intravenous self-administration (SA) of drugs. Recent studies examining the mesolimbic pathway suggest that Kv7/KCNQ channels may contribute to the transition from recreational to chronic drug use. However, to date, all such studies used noncontingent, experimenter-delivered drug model systems, and the extent to which this effect generalizes to rats trained to self-administer drugs is not known. Here, we tested the ability of retigabine (ezogabine), a Kv7 channel opener, to regulate instrumental behaviour in male Sprague Dawley rats. We first validated the ability of retigabine to target experimenter-delivered cocaine in a conditioned place preference (CPP) assay and found that retigabine reduced the acquisition of place preference. Next, we trained rats for cocaine-SA under a fixed-ratio or progressive-ratio reinforcement schedule and found that retigabine pretreatment attenuated the SA of low to moderate doses of cocaine. This was not observed in parallel experiments, with rats self-administering sucrose, a natural reward. Compared with sucrose-SA, cocaine-SA was associated with reductions in the expression of the Kv7.5 subunit in the nucleus accumbens, without alterations in Kv7.2 and Kv7.3. Therefore, these studies reveal a reward-specific reduction in SA behaviour and support the notion that Kv7 is a potential therapeutic target for human psychiatric diseases with dysfunctional reward circuitry.

Incubation of craving is a phenomenon describing the intensification of craving for a reward over extended periods of abstinence from reinforcement. Animal models use instrumental markers of craving to reward cues to examine incubation, while human paradigms rely on subjective self-reports. Here, we characterize an animal-inspired, novel human paradigm that showed strong positive relationships between self-reports and instrumental markers of craving for favored palatable foods. Further, we found consistent nonlinear relationships with time since last consumption and self-reports, and preliminary patterns between time and instrumental responses. These findings provide a novel approach to establishing an animal-inspired human model of incubation.

Carnosine is a naturally occurring endogenous dipeptide with well-recognized anti-inflammatory, antioxidant, and neuroprotective effects at the central nervous system level. To date, very few studies have been focused on the ability of carnosine to rescue and/or enhance memory. Here, we used a well-known invertebrate model system, the pond snail Lymnaea stagnalis, and a well-studied associative learning procedure, operant conditioning of aerial respiration, to investigate the ability of carnosine to enhance long-term memory (LTM) formation and reverse memory obstruction caused by an immune challenge (i.e., lipopolysaccharide [LPS] injection). Exposing snails to 1 mM carnosine for 1 h before training in addition to enhancing memory formation resulted in a significant upregulation of the expression levels of key neuroplasticity genes (i.e., glutamate ionotropic receptor N-methyl-d-aspartate [NMDA]-type subunit 1-LymGRIN1, and the transcription factor cAMP-response element-binding protein 1-LymCREB1) in snails\' central ring ganglia. Moreover, pre-exposure to 1 mM carnosine before an LPS injection reversed the memory deficit brought about by inflammation, by preventing the upregulation of key targets for immune and stress response (i.e., Toll-like receptor 4-LymTLR4, molluscan defense molecule-LymMDM, heat shock protein 70-LymHSP70). Our data are thus consistent with the hypothesis that carnosine can have positive benefits on cognitive ability and be able to reverse memory aversive states induced by neuroinflammation.

Resurgence is an increase in an extinguished operant response resulting from a worsening of conditions (e.g., extinction) for a more recently reinforced alternative behavior. Previous research has shown that exposure to cycles of alternative reinforcement available versus unavailable (i.e., on/off alternative reinforcement) across sessions can reduce subsequent resurgence. Most previous assessments of the procedure have examined target operant responding during only single-session resurgence tests, and it remains unclear if exposure to relatively few cycles of on/off alternative reinforcement can maintain low rates of target behavior across extended exposure to extinction. This experiment with rats examined the effects of 4 or 8 cycles of on/off alternative reinforcement on subsequent resurgence during a 10-session extinction test. The results show that exposure to 4 cycles of on/off alternative reinforcement is as effective as 8 cycles in producing low rates of target behavior during treatment and across extended extinction. This result is consistent with extant theories of resurgence and suggests that on/off alternative reinforcement could have translational utility following relatively few cycles of exposure.

Compulsive behaviour may often be triggered by Pavlovian cues. Assessing how Pavlovian cues drive instrumental behaviour in obsessive-compulsive disorder (OCD) is therefore crucial to understand how compulsions develop and are maintained. An aversive Pavlovian-to-Instrumental transfer (PIT) paradigm, particularly one involving avoidance/cancellation of negative outcomes, can enable such investigation and has not previously been studied in clinical-OCD. Forty-one participants diagnosed with OCD (21 adults; 20 youths) and 44 controls (21 adults; 23 youths) completed an aversive PIT task. Participants had to prevent the delivery of unpleasant noises by moving a joystick in the correct direction. They could infer these correct responses by learning appropriate response-outcome (instrumental) and stimulus-outcome (Pavlovian) associations. We then assessed whether Pavlovian cues elicited specific instrumental avoidance responses (specific PIT) and induced general instrumental avoidance (general PIT). We investigated whether task learning and confidence indices influenced PIT strength differentially between groups. There was no overall group difference in PIT performance, although youths with OCD showed weaker specific PIT than youth controls. However, urge to avoid unpleasant noises and preference for safe over unsafe stimuli influenced specific and general PIT respectively in OCD, while PIT in controls was more influenced by confidence in instrumental and Pavlovian learning. Thus, in OCD, implicit motivational factors, but not learnt knowledge, may contribute to the successful integration of aversive Pavlovian and instrumental cues. This implies that compulsive avoidance may be driven by these automatic processes. Youths with OCD show deficits in specific PIT, suggesting cue integration impairments are only apparent in adolescence. These findings may be clinically relevant as they emphasise the importance of targeting such implicit motivational processes when treating OCD.

BACKGROUND: Social behaviour plays a key role in mental health and wellbeing, and developing greater understanding of mechanisms underlying social interaction-particularly social motivation-holds substantial transdiagnostic impact. Common rodent behavioural assays used to assess social behaviour are limited in their assessment of social motivation, whereas the social operant conditioning model can provide unique and valuable insights into social motivation. Further characterisation of common experimental parameters that may influence social motivation within the social operant model, as well as complementary methodological and analytical approaches, are warranted.
METHODS: This study investigated the effects of biological sex, housing condition, and time-of-day, on social motivation using the social operant model. This involved training rats to lever press (FR1) for 60-s access to a social reward (same-sex conspecific stimulus). Subjects were male and female Wistar rats, housed under individual or paired conditions, and sessions were conducted either in the mid-late light phase (ZT6-10) or early-mid dark phase (ZT13-17). A behavioural economics approach was implemented to measure social demand and the influence of stimulus partner sex (same- vs. opposite-sex stimulus) on social operant responding. Additionally, video tracking analyses were conducted to assess the degree of convergence between social appetitive and consummatory behaviours.
RESULTS: Biological sex, housing conditions, the interaction between sex and housing, and stimulus partner sex potently influenced social motivation, whereas time-of-day did not. Behavioural economics demonstrated that sex, housing, and their interaction influence both the hedonic set-point and elasticity of social demand. Video analysis of social interaction during social operant sessions revealed that social appetitive and consummatory behaviours are not necessarily convergent, and indicate potential social satiety. Lastly, oestrus phase of female experimental and stimulus rats did not impact social motivation within the model.
CONCLUSIONS: Social isolation-dependent sex differences exist in social motivation for rats, as assessed by social operant conditioning. The social operant model represents an optimal preclinical assay that comprehensively evaluates social motivation and offers a platform for future investigations of neurobiological mechanisms underlying sex differences in social motivation. These findings highlight the importance of continued consideration and inclusion of sex as a biological variable in future social operant conditioning studies. Humans are social creatures-our everyday interactions with others and the support this provides play a key role in our wellbeing. For those experiencing mental health conditions, people\'s motivation to engage with others can wane, which can lead them to withdraw from those who support them. Therefore, to develop better treatment strategies for these conditions, we need to gain a deeper understanding of social motivation. Studying social behaviour in animals can facilitate this investigation of social motivation as it allows for a causal understanding of underlying neurobiology that is not possible in human experiments. An optimal way to study social motivation in animals is using the social operant conditioning model, where rats learn to press a lever that opens a door and allows them to interact with another rat for a short time. This study characterised the social operant model by testing whether sex, housing conditions, time-of-day, and the sex of the stimulus partner influence rats\' motivation to seek interaction with another rat. We found that female rats were more socially motivated than males, and that rats living alone were more motivated than those living with another rat; interestingly, this effect of housing affected females more than males. Regardless of sex, rats were more motivated to interact with a rat of the opposite sex. These findings provide insights into sex differences in social motivation in rats and new insights into the social operant model which will help guide future research into social motivation and other mental health conditions.

In an animal model of compulsive drug use, a subset of rats continues to self-administer cocaine despite footshock consequences and is considered punishment resistant. We recently found that punishment resistance is associated with habits that persist under conditions that typically encourage a transition to goal-directed control. Given that random ratio (RR) and random interval (RI) schedules of reinforcement influence whether responding is goal-directed or habitual, we investigated the influence of these schedules on punishment resistance for cocaine or food. Male and female Sprague Dawley rats were trained to self-administer either intravenous cocaine or food pellets on a seeking-taking chained schedule of reinforcement, with the seeking lever requiring completion of either an RR20 or RI60 schedule. Rats were then given four days of punishment testing with footshock administered at the completion of seeking on a random one-third of trials. For cocaine-trained rats, the RI60 schedule led to greater punishment resistance (i.e., more trials completed) than the RR20 schedule in males and females. For food-trained rats, the RI60 schedule led to greater punishment resistance (i.e., higher reward rates) than the RR20 schedule in female rats, although male rats showed punishment resistance on both RR20 and RI60 schedules. For both cocaine and food, we found that seeking responses were suppressed to a greater degree than reward rate with the RI60 schedule, whereas response rate and reward rate were equally suppressed with the RR20 schedule. This dissociation between punishment effects on reward rate and response rate with the RI60 schedule can be explained by the nonlinear relation between these variables on RI schedules, but it does not account for the enhanced resistance to punishment. Overall, the results show greater punishment resistance with the RI60 schedule as compared to the RR20 schedule, indicating that schedules of reinforcement are an influencing factor on resistance to negative consequences.