Coding with transient trajectories in recurrent neural networks.

07:00 EST 13th February 2020 | BioPortfolio

Summary of "Coding with transient trajectories in recurrent neural networks."

Following a stimulus, the neural response typically strongly varies in time and across neurons before settling to a steady-state. While classical population coding theory disregards the temporal dimension, recent works have argued that trajectories of transient activity can be particularly informative about stimulus identity and may form the basis of computations through dynamics. Yet the dynamical mechanisms needed to generate a population code based on transient trajectories have not been fully elucidated. Here we examine transient coding in a broad class of high-dimensional linear networks of recurrently connected units. We start by reviewing a well-known result that leads to a distinction between two classes of networks: networks in which all inputs lead to weak, decaying transients, and networks in which specific inputs elicit amplified transient responses and are mapped onto output states during the dynamics. Theses two classes are simply distinguished based on the spectrum of the symmetric part of the connectivity matrix. For the second class of networks, which is a sub-class of non-normal networks, we provide a procedure to identify transiently amplified inputs and the corresponding readouts. We first apply these results to standard randomly-connected and two-population networks. We then build minimal, low-rank networks that robustly implement trajectories mapping a specific input onto a specific orthogonal output state. Finally, we demonstrate that the capacity of the obtained networks increases proportionally with their size.


Journal Details

This article was published in the following journal.

Name: PLoS computational biology
ISSN: 1553-7358
Pages: e1007655


DeepDyve research library

PubMed Articles [10281 Associated PubMed Articles listed on BioPortfolio]

Iterative Retrieval and Block Coding in Autoassociative and Heteroassociative Memory.

Neural associative memories (NAM) are perceptron-like single-layer networks with fast synaptic learning typically storing discrete associations between pairs of neural activity patterns. Gripon and Be...

Recurrent transform learning.

Recurrent neural networks (RNN) model time series by feeding back the representation from the previous time instant as an input for the current instant along with exogenous inputs. Two main shortcomin...

A Taxonomy for Neural Memory Networks.

An increasing number of neural memory networks have been developed, leading to the need for a systematic approach to analyze and compare their underlying memory structures. Thus, in this paper, we fir...

Gated spiking neural network using Iterative Free-Energy Optimization and rank-order coding for structure learning in memory sequences (INFERNO GATE).

We present a framework based on iterative free-energy optimization with spiking neural networks for modeling the fronto-striatal system (PFC-BG) for the generation and recall of audio memory sequences...

Toward Training Recurrent Neural Networks for Lifelong Learning.

Catastrophic forgetting and capacity saturation are the central challenges of any parametric lifelong learning system. In this work, we study these challenges in the context of sequential supervised l...

Clinical Trials [5408 Associated Clinical Trials listed on BioPortfolio]

Early Discrimination of Periprosthetic Hip Infections Using Neural Networks (SEPTIC-ANNR)

The study is about the role of cellular neural networks-genetic algorithm in the diagnosis of periprosthetic hip infections. A retrospective case series of septic and aseptic loosening of ...

Neural Mechanisms Underlying the Antidepressant Effects of Sleep Deprivation

From 40 to 60% of patients with depression experience a rapid and significant improvement of mood with one night of sleep deprivation (SD). The neural mechanisms underlying this effect hav...

Insulin Resistance and Accelerated Cognitive Aging

Premature and accelerated brain aging trajectories have been observed among people with metabolic dysfunction, but mechanisms of these altered trajectories are not understood. Insulin resi...

Calorie-restricted, Ketogenic Diet and Transient Fasting During Reirradiation for Patients With Recurrent Glioblastoma

Increased glucose metabolism is characteristic for solid tumors. Thereby, glucose is important for the generation of ATP, supply of anabolic substrates and defense against reactive oxygen ...

Evaluation of a Bio-inspired Coding Strategy for Cochlear Implant Users

This study will determine the facilitation, refractoriness and spatial spread effects of auditory nerve fiber responses to electrical stimulation via a cochlear implant. The performance o...

Medical and Biotech [MESH] Definitions

A computer architecture, implementable in either hardware or software, modeled after biological neural networks. Like the biological system in which the processing capability is a result of the interconnection strengths between arrays of nonlinear processing nodes, computerized neural networks, often called perceptrons or multilayer connectionist models, consist of neuron-like units. A homogeneous group of units makes up a layer. These networks are good at pattern recognition. They are adaptive, performing tasks by example, and thus are better for decision-making than are linear learning machines or cluster analysis. They do not require explicit programming.

An early embryonic developmental process of CHORDATES that is characterized by morphogenic movements of ECTODERM resulting in the formation of the NEURAL PLATE; the NEURAL CREST; and the NEURAL TUBE. Improper closure of the NEURAL GROOVE results in congenital NEURAL TUBE DEFECTS.

The two longitudinal ridges along the PRIMITIVE STREAK appearing near the end of GASTRULATION during development of nervous system (NEURULATION). The ridges are formed by folding of NEURAL PLATE. Between the ridges is a neural groove which deepens as the fold become elevated. When the folds meet at midline, the groove becomes a closed tube, the NEURAL TUBE.

A tube of ectodermal tissue in an embryo that will give rise to the CENTRAL NERVOUS SYSTEM, including the SPINAL CORD and the BRAIN. Lumen within the neural tube is called neural canal which gives rise to the central canal of the spinal cord and the ventricles of the brain. For malformation of the neural tube, see NEURAL TUBE DEFECTS.

The region in the dorsal ECTODERM of a chordate embryo that gives rise to the future CENTRAL NERVOUS SYSTEM. Tissue in the neural plate is called the neuroectoderm, often used as a synonym of neural plate.

Quick Search

DeepDyve research library

Searches Linking to this Article