In a competitive game involving an animal and an opponent, the outcome is contingent on the choices of both players. To succeed, the animal must continually adapt to competitive pressure, or else risk being exploited and lose out on rewards. In this study, we demonstrate that head-fixed male mice can be trained to play the iterative competitive game “matching pennies” against a virtual computer opponent. We find that the animals’ performance is well described by a hybrid computational model that includes Q-learning and choice kernels. Comparing between matching pennies and a non-competitive two-armed bandit task, we show that the tasks encourage animals to operate at different regimes of reinforcement learning. To understand the involvement of neuromodulatory mechanisms, we measure fluctuations in pupil size and use multiple linear regression to relate the trial-by-trial transient pupil responses to decision-related variables. The analysis reveals that pupil responses are modulated by observable variables,...

Gonadotropin-releasing hormone (GnRH)-secreting neurons control fertility. The release of GnRH peptide regulates the synthesis and release of both luteinizing hormone (LH) and Follicle stimulation hormone (FSH) from the anterior pituitary. While it is known that dopamine regulates GnRH neurons, the specific dopamine receptor subtype(s) involved remain unclear. Previous studies in adult rodents have reported juxtaposition of fibers containing tyrosine hydroxylase (TH), a marker of catecholaminergic cells, onto GnRH neurons and that exogenous dopamine inhibits GnRH neurons postsynaptically through dopamine D1-like and/or D2-like receptors. Our microarray data from GnRH neurons revealed a high level of Drd4 transcripts [i.e., dopamine D4 receptor (D4R)]. Single-cell RT-PCR and immunocytochemistry confirmed GnRH cells express the Drd4 transcript and protein, respectively. Calcium imaging identified changes in GnRH neuronal activity during application of subtype-specific dopamine receptor agonists and antagonis...

Many fundamental human behaviors contain multiple sequences performed to reach a desired outcome, such as cooking. Reward is inherently associated with sequence completion and has been shown to generally enhance cognitive control. However, the impact of reward on cognitive sequence processing remains unexplored. To address this key question, we focused on the rostrolateral prefrontal cortex (RLPFC). This area is necessary and exhibits increasing (“ramping”) activation during sequences, a dynamic that may be related to reward processing in other brain regions. To separate these dynamics, we designed a task where reward was only provided after multiple four-item sequences (“iterations”), rather than each individual sequence. Using fMRI in humans, we investigated three possible interactions of reward and sequential control signals in RLPFC: (1) with the visibility of sequential cues, i.e., memory; (2) equally across individual sequence iterations; and (3) differently across individual sequence iterations (e.g...

As a predominately positive emotion, nostalgia serves various adaptive functions, including a recently revealed analgesic effect. The current fMRI study aimed to explore the neural mechanisms underlying the nostalgia-induced analgesic effect on noxious thermal stimuli of different intensities. Human participants’ (males and females) behavior results showed that the nostalgia paradigm significantly reduced participants’ perception of pain, particularly at low pain intensities. fMRI analysis revealed that analgesia was related to decreased brain activity in pain-related brain regions, including the lingual and parahippocampal gyrus. Notably, anterior thalamic activation during the nostalgia stage predicted posterior parietal thalamus activation during the pain stage, suggesting that the thalamus might play a key role as a central functional linkage in the analgesic effect. Moreover, while thalamus-PAG functional connectivity was found to be related to nostalgic strength, PAG-dlPFC functional connectivity was...

Pain-related sensory input is processed in the spinal dorsal horn (SDH) before being relayed to the brain. That processing profoundly influences whether stimuli are correctly or incorrectly perceived as painful. Significant advances have been made in identifying the types of excitatory and inhibitory neurons that comprise the SDH, and there is some information about how neuron types are connected, but it remains unclear how the overall circuit processes sensory input or how that processing is disrupted under chronic pain conditions. To explore SDH function, we developed a computational model of the circuit that is tightly constrained by experimental data. Our model comprises conductance-based neuron models that reproduce the characteristic firing patterns of spinal neurons. Excitatory and inhibitory neuron populations, defined by their expression of genetic markers, spiking pattern, or morphology, were synaptically connected according to available qualitative data. Using a genetic algorithm, synaptic weigh...

The human dorsolateral prefrontal cortex (DLPFC, approximately corresponding to Brodmann areas 9 and 46) has demonstrable roles in diverse executive functions such as working memory, cognitive flexibility, planning, inhibition, and abstract reasoning. However, it remains unclear whether this is the result of one functionally homogeneous region or whether there are functional subdivisions within the DLPFC. Here, we divided the DLPFC into seven areas along rostral-caudal and dorsal-ventral axes anatomically and explored their respective patterns of structural and functional connectivity. In vivo probabilistic tractography (11 females and 13 males) and resting-state functional magnetic resonance imaging (57 females and 21 males) were employed to map out the patterns of connectivity from each DLPFC subregion. Structural connectivity demonstrated graded intra-regional connectivity within the DLPFC. The patterns of structural connectivity between the DLPFC subregions and other cortical areas revealed that the do...

Transport of choline via the neuronal high-affinity choline transporter (CHT; SLC5A7 ) is essential for cholinergic terminals to synthesize and release acetylcholine (ACh). In humans, we previously demonstrated an association between a common CHT coding substitution (rs1013940; Ile89Val) and reduced attentional control as well as attenuated frontal cortex activation. Here, we used a CRISPR/Cas9 approach to generate mice expressing the I89V substitution and assessed, in vivo , CHT-mediated choline transport, and ACh release. Relative to wild type (WT) mice, CHT-mediated clearance of choline in male and female mice expressing one or two Val89 alleles was reduced by over 80% cortex and over 50% in striatum. Choline clearance in CHT Val89 mice was further reduced by neuronal inactivation. Deficits in ACh release, 5 and 10 min after repeated depolarization at a low, behaviorally relevant frequency, support an attenuated reloading capacity of cholinergic neurons in mutant mice. The density of CHTs in total synap...

The ability to comprehend phrases is an essential integrative property of the brain. Here we evaluate the neural processes that enable the transition from single word processing to a minimal compositional scheme. Previous research has reported conflicting timing effects of composition, and disagreement persists with respect to inferior frontal and posterior temporal contributions. To address these issues, 19 patients (10 male, 19 female) implanted with penetrating depth or surface subdural intracranial electrodes heard auditory recordings of adjective-noun, pseudoword-noun and adjective-pseudoword phrases and judged whether the phrase matched a picture. Stimulus-dependent alterations in broadband gamma activity, low frequency power and phase-locking values across the language-dominant left hemisphere were derived. This revealed a mosaic located on the lower bank of the posterior superior temporal sulcus (pSTS), in which closely neighboring cortical sites displayed exclusive sensitivity to either lexicality...

Paternal environmental perturbations can influence the physiology and behavior of offspring. For example, our previous work showed reduced cocaine reinforcement in male, but not female, progeny of rat sires that self-administered cocaine. The information transfer from sire to progeny may occur through epigenetic marks in sperm, encompassing alterations in small noncoding RNAs including microRNAs (miRNAs) and/or DNA methylation. Here, no reliable changes in miRNAs in the sperm of cocaine- relative to saline-experienced sires were identified. In contrast, 272 differentially methylated regions were observed in sperm between these groups. Two hypomethylated promoter regions in the sperm of cocaine-experienced rats were upstream of cyclin-dependent kinase inhibitor 1a ( Cdkn1a ). Cdkn1a mRNA also was selectively increased in the nucleus accumbens of cocaine-sired male (but not female) offspring. Cocaine self-administration also enhanced Cdkn1a expression in the accumbens of cocaine-sired rats. These results sug...

Electron microscopy (EM)-based connectomes provide important insights into how visual circuitry of fruit fly Drosophila computes various visual features, guiding and complementing behavioral and physiological studies. However, connectomic analyses of the lobula, a neuropil putatively dedicated to detecting object-like features, remains underdeveloped, largely because of incomplete data on the inputs to the brain region. Here, we attempted to map the columnar inputs into the Drosophila lobula neuropil by performing connectivity-based and morphology-based clustering on a densely reconstructed connectome dataset. While the dataset mostly lacked visual neuropils other than lobula, which would normally help identify inputs to lobula, our clustering analysis successfully extracted clusters of cells with homogeneous connectivity and morphology, likely representing genuine cell types. We were able to draw a correspondence between the resulting clusters and previously identified cell types, revealing previously und...