Operant (instrumental) and classical (Pavlovian) conditioning are taught as the simplest forms of associative learning. Recent research in several invertebrate model systems has now accumulated evidence that the dichotomy is not as simple as it seemed. During operant learning in the fruit fly Drosophila, at least two genetically distinct learning systems interact dynamically. Inspired by analogous results in three other research fields, we propose to term one of these systems world-learning (assigning value to sensory stimuli) and the other self-learning (assigning value to a specific action or movement). During the goal-directed phase of operant learning, world-learning inhibits self-learning (in Drosophila via the mushroom-body neuropil), to allow for flexible generalization. Extended training overcomes this inhibition in a phase transition akin to habit formation in vertebrates, allowing self-learning to transform spontaneous actions to habitual responses. In part, these insights were achieved by reducing operant experiments beyond the traditional set-ups (i.e., 'pure' operant learning) and using modern, molecular and/or genetic model systems.

Download full-text PDF

Source
http://www.ncbi.nlm.nih.gov/pmc/articles/PMC2889970PMC
http://dx.doi.org/10.4161/cib.3.2.10334DOI Listing

Publication Analysis

Top Keywords

operant learning
12
model systems
8
operant
5
learning
5
biology psychology
4
psychology 'simple'
4
'simple' conditioning?
4
conditioning? operant
4
operant instrumental
4
instrumental classical
4

Similar Publications

The use of supervised machine learning to approximate poses in video recordings allows for rapid and efficient analysis of complex behavioral profiles. Currently, there are limited protocols for automated analysis of operant self-administration behavior. We provide methodology to 1) obtain videos of training sessions via Raspberry Pi microcomputers or GoPros 2) obtain pose estimation data using the supervised machine learning software packages DeepLabCut (DLC) and Simple Behavioral Analysis (SimBA) with local high performance computer cluster, 3) comparison of standard MedPC lever response vs quadrant time data generated from pose estimation regions of interest and 4) generation of predictive behavioral classifiers.

View Article and Find Full Text PDF

Direct Pathway Neurons in the Mouse Ventral Striatum Are Active During Goal-Directed Action but Not Reward Consumption During Operant Conditioning.

Biomedicines

December 2024

Department of Psychiatry, Division of Molecular Therapeutics, New York State Psychiatric Institute, Columbia University, New York, NY 10032, USA.

Background/objectives: Learning is classically modeled to consist of an acquisition period followed by a mastery period when the skill no longer requires conscious control and becomes automatic. Dopamine neurons projecting to the ventral striatum (VS) produce a teaching signal that shifts from responding to rewarding or aversive events to anticipating cues, thus facilitating learning. However, the role of the dopamine-receptive neurons in the ventral striatum, particularly in encoding decision-making processes, remains less understood.

View Article and Find Full Text PDF

The zebrafish model is rapidly advancing numerous areas of basic and translational research, including toxicology, drug discovery, molecular genetics, genomic research, developmental biology, and the study of human diseases (reviewed in [...

View Article and Find Full Text PDF

Temporal distribution of schedule-induced behavior depends on the essential value of the reinforcer.

J Exp Anal Behav

January 2025

Animal Learning and Behavior Laboratory, Departamento de Psicología Básica I, Facultad de Psicología, Universidad Nacional de Educación a Distancia (UNED), Madrid, Spain.

The development of schedule-induced drinking depends on different variables affecting the food delivered at the end of the interfood interval. There are mixed results concerning the effects of varying magnitude and/or preference of different reinforcers in the development of schedule-induced drinking, with some studies showing higher levels and other studies showing lower levels of drinking. The purpose of this study was to observe how differences in preference for a flavor of equally nutritious food pellets influence the development and maintenance of schedule-induced drinking.

View Article and Find Full Text PDF

Cue reactivity is the maladaptive neurobiological and behavioral response upon exposure to drug cues and is a major driver of relapse. A widely accepted assumption is that drugs of abuse result in disparate dopamine responses to cues that predict drug vs. natural rewards.

View Article and Find Full Text PDF

Want AI Summaries of new PubMed Abstracts delivered to your In-box?

Enter search terms and have AI summaries delivered each week - change queries or unsubscribe any time!