The value associated with reward is sensitive to external factors, such as the time between the choice and reward delivery as classically manipulated in temporal discounting tasks. Subjective preference for two reward options is dependent on objective variables of reward magnitude and reward delay. Single neuron correlates of reward value have been observed in regions, including ventral striatum, orbital, and medial prefrontal cortex. Brain imaging studies show cortico-striatal-limbic network activity related to subjective preferences. To explore how oscillatory dynamics represent reward processing across brain regions, we measured local field potentials of rats performing a temporal discounting task. Our goal was to use a data-driven approach to identify an electrophysiological marker that correlates with reward preference. We found that reward-locked oscillations at beta frequencies signaled the magnitude of reward and decayed with longer temporal delays. Electrodes in orbitofrontal/medial prefrontal cortex, anterior insula, ventral striatum, and amygdala individually increased power and were functionally connected at beta frequencies during reward outcome. Beta power during reward outcome correlated with subjective value as defined by a computational model fit to the discounting behavior. These data suggest that cortico-striatal beta oscillations are a reward signal correlated, which may represent subjective value and hold potential to serve as a biomarker and potential therapeutic target.

Numerous neuroimaging studies have identified significant individual variability in intertemporal choice, often attributed to three neural mechanisms: (1) increased reward circuit activity, (2) decreased cognitive control, and (3) prospection ability. These mechanisms that explain impulsivity, however, have been primarily studied in the gain domain. This study extends this investigation to the loss domain. We employed a hierarchical Bayesian drift-diffusion model (DDM) and the inter-subject representational similarity approach (IS-RSA) to investigate the potential computational neural substrates underlying impulsivity in loss domain across two experiments (n = 155). These experiments utilized a revised intertemporal task that independently manipulated the amounts of immediate and delayed-loss options. Behavioral results demonstrated positive correlations between the drift rate, measured by the DDM, and the impulsivity index K in Exp. 1 (n = 97) and were replicated in Exp. 2 (n = 58). Imaging analyses further revealed that the drift rate significantly mediated the relations between brain properties (e.g., prefrontal cortex activations and gray matter volume in the orbitofrontal cortex and precuneus) and K in Exp. 1. IS-RSA analyses indicated that variability in the drift rate also mediated the associations between inter-subject variations in activation patterns and individual differences in K. These findings suggest that individuals with similar impulsivity levels are likely to exhibit similar value processing patterns, providing a potential explanation for individual differences in impulsivity within a loss framework.

Delay discounting refers to the behavioral tendency to devalue rewards as a function of their delay in receipt. Heightened delay discounting has been associated with substance use disorders and multiple co-occurring psychopathologies. Human and animal genetic studies have established that delay discounting is heritable, but only a few associated genes have been identified. We aimed to identify novel genetic loci associated with delay discounting through a genome-wide association study (GWAS) using Heterogeneous Stock (HS) rats, a genetically diverse outbred population derived from eight inbred founder strains. We assessed delay discounting in 650 male and female HS rats using an adjusting amount procedure in which rats chose between smaller immediate sucrose rewards or a larger reward at various delays. Preference switch points were calculated and both exponential and hyperbolic functions were fitted to these indifference points. Area under the curve (AUC) and the discounting parameter k of both functions were used as delay discounting measures. GWAS for AUC, exponential k, and one indifference point identified significant loci on chromosomes 20 and 14. The gene Slc35f1, which encodes a member of the solute carrier family, was the sole gene within the chromosome 20 locus. That locus also contained an eQTL for Slc35f1, suggesting that heritable differences in the expression might be responsible for the association with behavior. Adgrl3, which encodes a latrophilin subfamily G-protein coupled receptor, was the sole gene within the chromosome 14 locus. These findings implicate novel genes in delay discounting and highlight the need for further exploration.

Delay discounting (DD) refers to the tendency to devalue an outcome as a function of its delay. Most contemporary human DD research uses hypothetical money to assess individual rates of DD. However, nonmonetary outcomes such as food, substances of misuse, and sexual outcomes have been used as well, and have advantages because of their connections to health. This article reviews the literature on the use of nonmonetary outcomes of food, drugs, and sexual outcomes in relation to health and reinforcer pathologies such as substance use disorders, obesity, and sexual risk behaviors, respectively, and makes a case for their use in discounting research. First, food, substances, and sex may be more ecologically valid outcomes than money in terms of their connections to health problems and reinforcer pathologies. Second, consistent trends in commodity-specific (i.e., domain) effects, in which nonmonetary outcomes are discounted more steeply than money, enhance variation in discounting values. Third, commodity-specific changes in discounting with treatments designed to change health choices are described. Finally, methodological trends such as test-retest reliability, magnitude effects, the use of hypothetical versus real outcomes, and age-related effects are discussed in relation to the three outcome types and compared to trends with monetary discounting. Limitations that center around individual preferences, nonsystematic data, and deprivation are discussed. We argue that researchers can enhance their DD research, especially those related to health problems and reinforcer pathologies, with the use of nonmonetary outcomes. Recommendations for future directions of research are delineated.

Food cue reactivity, or behavioral sensitivity to conditioned food cues, is an eating pattern observed in those with obesity and binge-eating disorder. The reinforcer pathology model, which characterizes overconsumption of a reinforcer such as food may be relevant to food cue reactivity, especially in those with obesity and binge-eating disorder. The reinforcer pathology model posits that steep delay discounting (DD) and demand elasticity are processes involved in the overconsumption of food. Two of our recent studies examine the extent to which reactivity to conditioned food cues may be involved in food reinforcer pathologies. First, food cues were conditioned with Oreo cookies with binge-eating prone (BEP) and binge-eating resistant (BER) rats. Delay discounting was compared before and after conditioning. Food cues induced steeper DD for rats, though BEP rats showed some evidence for greater sensitivity to this effect than BER rats, albeit this difference was not significant. Second, healthy-weight humans and humans with overweight/obese BMI underwent conditioning of visual cues paired with M&M candies. After acquisition, cues induced greater demand intensity and inelasticity for food compared to baseline. Participants with overweight/obese BMI, compared to controls, also showed some evidence for greater sensitivity to this change ininelasticity compared to healthy-weight participants, but this difference was also not significant. Food cues, then, may induce changes in DD and economic demand, supporting the relevance of reinforcer pathologies.

Episodic future thinking (EFT) strengthens self-regulation abilities by increasing the perceived value of long-term reinforcements and reducing impulsive choice in delay discounting tasks. As such, EFT interventions have the potential to improve dietary and eating-related decision-making in individuals with obesity or binge eating symptoms, conditions associated with elevated delay discounting. Here, we meta-analyzed evidence from 12 studies that assessed whether EFT interventions improve delay discounting and real-world food choice compared to control interventions. Included studies involved 951 adults with overweight or obesity (body mass index [BMI] ≥25). There were no studies involving participants with binge eating disorder. EFT intervention pooled effects were significant, improving delay discounting with a medium effect, g = 0.55, p < 0.0001, and subsequent food choice outcomes with a small effect, g = 0.31, p < 0.01. Notably, our review is the first to analyze mechanisms of effect in this population, demonstrating that improvements were greater when temporal horizons of EFT episodes were aligned with delay discounting tasks and more distant horizons predicted far-transfer to subsequent dietary and eating-related choices. Our findings thus show that EFT is an effective intervention for individuals with higher weight at risk of adverse health consequences.

BACKGROUND: The ability to value rewards is crucial for adaptive behavior and is influenced by the time and effort required to obtain them. Impairments in these computations have been observed in patients with schizophrenia and may be present in individuals with subclinical psychotic symptoms (PS).
METHODS: In this study, we employed delay and effort-discounting tasks with food rewards in thirty-nine participants divided into high and low levels of PS. We investigated the underlying mechanisms of effort-discounting through computational modelling of dopamine prefrontal and subcortical circuits and the electrophysiological biomarker of both delay and effort-discounting alterations through resting-state frontal alpha asymmetry (FAA).
RESULTS: Results revealed greater delay discounting in the High PS group compared to the Low PS group but no differences in the effort discounting task. However, in this task, the same levels of estimated dopamine release were associated with a lower willingness to exert effort for high-calorie food rewards in High PS participants compared to Low PS participants. Although there were no significant differences in FAA between the High PS and Low PS groups, FAA was significantly associated with the severity of participants\' negative symptoms.
CONCLUSIONS: Our study suggests that the dysfunction in temporal and effort cost computations, seen in patients with schizophrenia, may be present in individuals with subclinical PS. These findings provide valuable insight into the early vulnerability markers (behavioral, computational, and electrophysiological) for psychosis, which may aid in the development of preventive interventions. These findings are preliminary and warrant further investigation.

Taste and health are critical factors to be considered when choosing foods. Prioritizing healthiness over tastiness requires self-control. It has also been suggested that self-control is guided by cognitive control. We then hypothesized that neural mechanisms underlying healthy food choice are associated with both self-control and cognitive control. Human participants performed a food choice task and a working memory task during functional MRI scanning. Their degree of self-control was assessed behaviorally by the value discount of delayed monetary rewards in intertemporal choice. Prioritizing healthiness in food choice was associated with greater activity in the superior, dorsolateral, and medial prefrontal cortices. Importantly, the prefrontal activity was greater in individuals with smaller delay discounting (i.e. high self-control) who preferred a delayed larger reward to an immediate smaller reward in intertemporal choice. On the other hand, working memory activity did not show a correlation with delay discounting or food choice activity, which was further supported by supplementary results that analyzed data from the Human Connectome Project. Our results suggest that the prefrontal cortex plays a critical role in healthy food choice, which requires self-control, but not working memory, for maximization of reward attainments in a remote future.

Choice impulsivity can be measured by offering a sequence of various binary choices between smaller, immediately available rewards and larger, later available rewards. An individual\'s delay discount (DD) rate reflects the aggregate decision-making tendency. Given the broad spectrum of disorders associated with a high DD rate, this may be an important transdiagnostic factor. This study aimed to establish whether post-decisional neurophysiological processes reflecting the presence of error monitoring are involved in delay discounting. A large sample (N = 97) was investigated, including 46 females and 51 males. The electroencephalogram (EEG) was recorded during the classic monetary choice questionnaire (MCQ-27). Error-related event-related potentials (ERPs) and event-related oscillations (EROs) following responses were analyzed. A modest relationship between error positivity (Pe) and DD rate was seen centro-parietal, with higher amplitude for low DD individuals after choosing immediate rewards. A robust association was found between DD rate and theta oscillation power increases. This was most prominent in low DD individuals after making an immediate reward choice. Theta power was positively associated with decision (reaction) time, suggesting an association between pre- and post-decisional conflict. No evidence was found for an error-related negativity (ERN) and delta oscillations. This study provides clear evidence for conflict monitoring as a post-decision process in delay discounting. Findings suggest that diminished theta band power bursts and lower Pe amplitude, observed after choosing an immediate reward, reflect the neurophysiological consequence and possibly the cause of steep delay discounting. High DD was characterized by prefrontal hypoactivation and appears to result from affective decision-making. Highlights.

BACKGROUND: Research on delay discounting (DD) is mixed on whether DD is a domain-specific component related to specific behaviors or a domain-general process that cuts across various behaviors. A pivotal group to test the associations between DD and unhealthy behaviors is individuals in recovery from substance use disorders (SUD), as they are moving away from a disorder toward a healthier state.
METHODS: Individuals in SUD recovery (n = 317) completed the Temptation Scale, the Health Behaviors Questionnaire, and an Adjusting Delay Discounting Task. An exhaustive model space search was performed using linear regression to examine associations between DD with temptation, engagement in unhealthy behaviors, and the total number of unhealthy behaviors participants engage in. We also tested whether remission status is associated with the total number of unhealthy behaviors participants engage in.
RESULTS: Results revealed that DD was positively associated with poor eating (p<.001), physical inactivity (p=.003), financial irresponsibility (p<.001), risky behaviors (p<.001), lack of personal development goals (p<.001), lack of household savings (p=.004), and lack of health behaviors (p=.003). DD was also positively associated with the total number of unhealthy behaviors participants engage in (p<.001). Participants who were not in remission engaged in more unhealthy behaviors compared to those who were in remission (p<.001).
CONCLUSIONS: In a sample of individuals in recovery from SUD, DD is not domain-specific and undergirds engagement in several maladaptive health behaviors that can negatively impact recovery. Thus, DD can be a target for interventions aiming to reduce other maladaptive behaviors in SUD recovery.