Iterative Retrieval and Block Coding in Autoassociative and Heteroassociative Memory.

07:00 EST 8th November 2019 | BioPortfolio

Summary of "Iterative Retrieval and Block Coding in Autoassociative and Heteroassociative Memory."

Neural associative memories (NAM) are perceptron-like single-layer networks with fast synaptic learning typically storing discrete associations between pairs of neural activity patterns. Gripon and Berrou (2011) investigated NAM employing block coding, a particular sparse coding method, and reported a significant increase in storage capacity. Here we verify and extend their results for both heteroassociative and recurrent autoassociative networks. For this we provide a new analysis of iterative retrieval in finite autoassociative and heteroassociative networks that allows estimating storage capacity for random and block patterns. Furthermore, we have implemented various retrieval algorithms for block coding and compared them in simulations to our theoretical results and previous simulation data. In good agreement of theory and experiments, we find that finite networks employing block coding can store significantly more memory patterns. However, due to the reduced information per block pattern, it is not possible to significantly increase stored information per synapse. Asymptotically, the information retrieval capacity converges to the known limits and also for block coding. We have also implemented very large recurrent networks up to neurons, showing that maximal capacity bit per synapse occurs for finite networks having a size similar to cortical macrocolumns.


Journal Details

This article was published in the following journal.

Name: Neural computation
ISSN: 1530-888X
Pages: 1-56


DeepDyve research library

PubMed Articles [5534 Associated PubMed Articles listed on BioPortfolio]

Muscarinic activity in hippocampus and entorhinal cortex is crucial for spatial and fear memory retrieval.

Hippocampus and entorhinal cortex are key players of learning and memory. Despite their established role in memory processes, the contribution of muscarinic receptor activity in these brain regions du...

Prefrontal Pathways Provide Top-Down Control of Memory for Sequences of Events.

We remember our lives as sequences of events, but it is unclear how these memories are controlled during retrieval. In rats, the medial prefrontal cortex (mPFC) is positioned to influence sequence mem...

REM sleep deprivation impairs retrieval, but not reconsolidation, of methamphetamine reward memory in male rats.

Susceptibility to interference can be a result of memory retrieval and reconsolidation. Given the fact that addiction develops through the neural mechanisms of learning and memory, it would not be sur...

Direct and generative autobiographical memory retrieval: How different are they?

Theories of autobiographical memory have emphasised effortful generative retrieval, but recent research indicates that subjectively effortless direct retrieval is common. We compared the processes of ...

Decoding the tradeoff between encoding and retrieval to predict memory for overlapping events.

When new events overlap with past events, there is a natural tradeoff between encoding the new event and retrieving the past event. Given the ubiquity of overlap among memories, this tradeoff between ...

Clinical Trials [4147 Associated Clinical Trials listed on BioPortfolio]

Investigating the Neural Correlates in Memory Retrieval After HD-tDCS

The overall objective of this study is to investigate the neural correlate in retrieval memory task. The aim of the study is to understand the undergoing changes in late positive ERP comp...

Methadone Induced Memory Retrieval-extinction Procedure in Heroin Addicts

The study assessed the efficacy of a methadone-induced memory retrieval-extinction procedure on heroin craving and relapse. Male participants aged 18-55 years old and prescribed MMT to tre...

Investigating HD-tDCS in Improving Word Finding and Memory Retrieval in Individuals With MCI

This study is attempting to improve word finding and memory retrieval problems persons with mild cognitive impairment (MCI) may have.

Effects of THC on Emotional Memory Retrieval

The purpose of this study was to examine the effects of THC on the retrieval of emotional and neutral memories in healthy young adults.

Investigating Memory Retrieval Improvement in Healthy Subjects

The purpose of this study is to investigate whether we can accelerate learning and improve associative memory performance in healthy subjects by applying transcranial Direct Current Stimul...

Medical and Biotech [MESH] Definitions

Type of declarative memory, consisting of personal memory in contrast to general knowledge.

An area in the temporal lobe that is important for memory encoding and retrieval. It is bordered caudally by the parahippocampal cortex (see HIPPOCAMPUS) and ventrally and medially by the ENTORHINAL CORTEX.

Interruption of sympathetic pathways, by local injection of an anesthetic agent, at any of four levels: peripheral nerve block, sympathetic ganglion block, extradural block, and subarachnoid block.

Systems used to prompt or aid the memory. The systems can be computerized reminders, color coding, telephone calls, or devices such as letters and postcards.

A neuropsychological test designed to assess different memory functions. It may incorporate an optional cognitive exam (Brief Cognitive Status Exam) that helps to assess memory related cognitive function.

Quick Search

DeepDyve research library

Relevant Topic

Collaborations in biotechnology
Commercial and academic collaborations are used throughout the biotechnology and pharmaceutical sector to enhance research and product development. Collaborations can take the form of research and evaluation agreements, licensing, partnerships etc. ...

Searches Linking to this Article