Accumulating evidence by sampling from temporally organized memory.

A recent study by Shushruth et al. (2022, Current Biology 32[9], 1949-1960) demonstrated that monkeys postpone evidence accumulation until the relevant motor actions are revealed and then sequentially sample the evidence from memory. Here, we reflect on the insights this work provides into reinforcement learning in evidence accumulation tasks and neural mechanisms for the temporal organization of memory.

Scanning a compressed ordered representation of the future.

Several authors have suggested a deep symmetry between the psychological processes that underlie our ability to remember the past and make predictions about the future. The judgment of recency (JOR) task measures temporal order judgments for the past by presenting pairs of probe stimuli; participants choose the probe that was presented more recently. We performed a short-term relative JOR task and introduced a novel judgment of imminence (JOI) task to study temporal order judgments for the future.

Conjunctive representation of what and when in monkey hippocampus and lateral prefrontal cortex during an associative memory task.

Adaptive memory requires the organism to form associations that bridge between events separated in time. Many studies show interactions between hippocampus (HPC) and prefrontal cortex (PFC) during formation of such associations. We analyze neural recording from monkey HPC and PFC during a memory task that requires the monkey to associate stimuli separated by about a second in time.

A temporal record of the past with a spectrum of time constants in the monkey entorhinal cortex.

Episodic memory is believed to be intimately related to our experience of the passage of time. Indeed, neurons in the hippocampus and other brain regions critical to episodic memory code for the passage of time at a range of timescales. The origin of this temporal signal, however, remains unclear.

Evidence accumulation in a Laplace domain decision space.

Evidence accumulation models of simple decision-making have long assumed that the brain estimates a scalar decision variable corresponding to the log-likelihood ratio of the two alternatives. Typical neural implementations of this algorithmic cognitive model assume that large numbers of neurons are each noisy exemplars of the scalar decision variable. Here we propose a neural implementation of the diffusion model in which many neurons construct and maintain the Laplace transform of the distance to each of the decision bounds.

Estimating Scale-Invariant Future in Continuous Time.

Natural learners must compute an estimate of future outcomes that follow from a stimulus in continuous time. Widely used reinforcement learning algorithms discretize continuous time and estimate either transition functions from one step to the next (model-based algorithms) or a scalar value of exponentially discounted future reward using the Bellman equation (model-free algorithms). An important drawback of model-based algorithms is that computational cost grows linearly with the amount of time to be simulated.

A neural microcircuit model for a scalable scale-invariant representation of time.

Scale-invariant timing has been observed in a wide range of behavioral experiments. The firing properties of recently described time cells provide a possible neural substrate for scale-invariant behavior. Earlier neural circuit models do not produce scale-invariant neural sequences.

Is working memory stored along a logarithmic timeline? Converging evidence from neuroscience, behavior and models.

A growing body of evidence suggests that short-term memory does not only store the identity of recently experienced stimuli, but also information about when they were presented. This representation of 'what' happened 'when' constitutes a neural timeline of recent past. Behavioral results suggest that people can sequentially access memories for the recent past, as if they were stored along a timeline to which attention is sequentially directed.

Compressed Timeline of Recent Experience in Monkey Lateral Prefrontal Cortex.

Cognitive theories suggest that working memory maintains not only the identity of recently presented stimuli but also a sense of the elapsed time since the stimuli were presented. Previous studies of the neural underpinnings of working memory have focused on sustained firing, which can account for maintenance of the stimulus identity, but not for representation of the elapsed time. We analyzed single-unit recordings from the lateral prefrontal cortex of macaque monkeys during performance of a delayed match-to-category task.

Sequential Firing Codes for Time in Rodent Medial Prefrontal Cortex.

A subset of hippocampal neurons, known as "time cells" fire sequentially for circumscribed periods of time within a delay interval. We investigated whether medial prefrontal cortex (mPFC) also contains time cells and whether their qualitative properties differ from those in the hippocampus and striatum. We studied the firing correlates of neurons in the rodent mPFC during a temporal discrimination task.

Biological conservation law as an emerging functionality in dynamical neuronal networks.

Scientists strive to understand how functionalities, such as conservation laws, emerge in complex systems. Living complex systems in particular create high-ordered functionalities by pairing up low-ordered complementary processes, e.g.

Time Cells in Hippocampal Area CA3.

Unlabelled: Studies on time cells in the hippocampus have so far focused on area CA1 in animals performing memory tasks. Some studies have suggested that temporal processing within the hippocampus may be exclusive to CA1 and CA2, but not CA3, and may occur only under strong demands for memory. Here we examined the temporal and spatial coding properties of CA3 and CA1 neurons in rats performing a maze task that demanded working memory and a control task with no explicit working memory demand.

A simple biophysically plausible model for long time constants in single neurons.

Recent work in computational neuroscience and cognitive psychology suggests that a set of cells that decay exponentially could be used to support memory for the time at which events took place. Analytically and through simulations on a biophysical model of an individual neuron, we demonstrate that exponentially decaying firing with a range of time constants up to minutes could be implemented using a simple combination of well-known neural mechanisms. In particular, we consider firing supported by calcium-controlled cation current.

A unified mathematical framework for coding time, space, and sequences in the hippocampal region.

The medial temporal lobe (MTL) is believed to support episodic memory, vivid recollection of a specific event situated in a particular place at a particular time. There is ample neurophysiological evidence that the MTL computes location in allocentric space and more recent evidence that the MTL also codes for time. Space and time represent a similar computational challenge; both are variables that cannot be simply calculated from the immediately available sensory information.

Influence of extracellular oscillations on neural communication: a computational perspective.

Neural communication generates oscillations of electric potential in the extracellular medium. In feedback, these oscillations affect the electrochemical processes within the neurons, influencing the timing and the number of action potentials. It is unclear whether this influence should be considered only as noise or it has some functional role in neural communication.