Associative memory model with arbitrary Hebbian length.

Phys Rev E

PMI Lab, School of Physics, Sun Yat-sen University, Guangzhou 510275, People's Republic of China.

Published: December 2021

Conversion of temporal to spatial correlations in the cortex is one of the most intriguing functions in the brain. The learning at synapses triggering the correlation conversion can take place in a wide integration window, whose influence on the correlation conversion remains elusive. Here we propose a generalized associative memory model of pattern sequences, in which pattern separations within an arbitrary Hebbian length are learned. The model can be analytically solved, and predicts that a small Hebbian length can already significantly enhance the correlation conversion, i.e., the stimulus-induced attractor can be highly correlated with a significant number of patterns in the stored sequence, thereby facilitating state transitions in the neural representation space. Moreover, an anti-Hebbian component is able to reshape the energy landscape of memories, akin to the memory regulation function during sleep. Our work thus establishes the fundamental connection between associative memory, Hebbian length, and correlation conversion in the brain.

Download full-text PDF

Source
http://dx.doi.org/10.1103/PhysRevE.104.064306DOI Listing

Publication Analysis

Top Keywords

hebbian length
16
correlation conversion
16
associative memory
12
memory model
8
arbitrary hebbian
8
conversion
5
model arbitrary
4
hebbian
4
length
4
length conversion
4

Similar Publications

Cortical development in the structural model and free energy minimization.

Cereb Cortex

October 2024

Centre for Brain Research, School of Medicine, University of Auckland, 85 Park Road, Grafton, Auckland, New Zealand.

Article Synopsis
  • A model integrating Friston's Free Energy Principle with Barbas et al.'s Structural Model explores neocortical development through neural fields that utilize Hebbian and anti-Hebbian plasticity to enhance synchronization and reduce axonal length via apoptotic selection.
  • The emergence of a primary Markov blanket differentiates synaptic activity patterns between various layers of the neocortex, influencing the unique properties of neurons in dorsal versus ventral regions.
  • As development advances, complex systems of mirror symmetry and layered Markov blankets form, contributing to the columnar structure and adaptive response mechanisms characteristic of the neocortex.
View Article and Find Full Text PDF

Markov Blankets and Mirror Symmetries-Free Energy Minimization and Mesocortical Anatomy.

Entropy (Basel)

March 2024

School of Social Sciences, Faculty of Arts, Business, Law and Education, University of Western Australia, Perth, WA 6009, Australia.

A theoretical account of development in mesocortical anatomy is derived from the free energy principle, operating in a neural field with both Hebbian and anti-Hebbian neural plasticity. An elementary structural unit is proposed, in which synaptic connections at mesoscale are arranged in paired patterns with mirror symmetry. Exchanges of synaptic flux in each pattern form coupled spatial eigenmodes, and the line of mirror reflection between the paired patterns operates as a Markov blanket, so that prediction errors in exchanges between the pairs are minimized.

View Article and Find Full Text PDF

Competitive learning to generate sparse representations for associative memory.

Neural Netw

November 2023

INESC-id & Instituto Superior Tecnico, University of Lisbon, Av. Rovisco Pais 1, Lisbon, 1049-001, Portugal. Electronic address:

One of the most well established brain principles, Hebbian learning, has led to the theoretical concept of neural assemblies. Based on it, many interesting brain theories have spawned. Palm's work implements this concept through multiple binary Willshaw associative memories, in a model that not only has a wide cognitive explanatory power but also makes neuroscientific predictions.

View Article and Find Full Text PDF

Eigenvalue spectrum of neural networks with arbitrary Hebbian length.

Phys Rev E

December 2021

PMI Lab, School of Physics, Sun Yat-sen University, Guangzhou 510275, People's Republic of China.

Associative memory is a fundamental function in the brain. Here, we generalize the standard associative memory model to include long-range Hebbian interactions at the learning stage, corresponding to a large synaptic integration window. In our model, the Hebbian length can be arbitrarily large.

View Article and Find Full Text PDF

Associative memory model with arbitrary Hebbian length.

Phys Rev E

December 2021

PMI Lab, School of Physics, Sun Yat-sen University, Guangzhou 510275, People's Republic of China.

Conversion of temporal to spatial correlations in the cortex is one of the most intriguing functions in the brain. The learning at synapses triggering the correlation conversion can take place in a wide integration window, whose influence on the correlation conversion remains elusive. Here we propose a generalized associative memory model of pattern sequences, in which pattern separations within an arbitrary Hebbian length are learned.

View Article and Find Full Text PDF

Want AI Summaries of new PubMed Abstracts delivered to your In-box?

Enter search terms and have AI summaries delivered each week - change queries or unsubscribe any time!