Can multisensory training aid visual learning? A computational investigation.

08:00 EDT 3rd September 2019 | BioPortfolio

Summary of "Can multisensory training aid visual learning? A computational investigation."

Although real-world environments are often multisensory, visual scientists typically study visual learning in unisensory environments containing visual signals only. Here, we use deep or artificial neural networks to address the question, Can multisensory training aid visual learning? We examine a network's internal representations of objects based on visual signals in two conditions: (a) when the network is initially trained with both visual and haptic signals, and (b) when it is initially trained with visual signals only. Our results demonstrate that a network trained in a visual-haptic environment (in which visual, but not haptic, signals are orientation-dependent) tends to learn visual representations containing useful abstractions, such as the categorical structure of objects, and also learns representations that are less sensitive to imaging parameters, such as viewpoint or orientation, that are irrelevant for object recognition or classification tasks. We conclude that researchers studying perceptual learning in vision-only contexts may be overestimating the difficulties associated with important perceptual learning problems. Although multisensory perception has its own challenges, perceptual learning can become easier when it is considered in a multisensory setting.


Journal Details

This article was published in the following journal.

Name: Journal of vision
ISSN: 1534-7362
Pages: 1


DeepDyve research library

PubMed Articles [13044 Associated PubMed Articles listed on BioPortfolio]

Advantage of Early Focus on Visual Information in Bi-Modal Training of Bimanual Coordination.

Previous studies have shown that learning bimanual coordination is modality-specific, and both visual and kinesthetic information about relative phase can be used to facilitate learning. However, an e...

Explaining the Effect of Likelihood Manipulation and Prior Through a Neural Network of the Audiovisual Perception of Space.

Results in the recent literature suggest that multisensory integration in the brain follows the rules of Bayesian inference. However, how neural circuits can realize such inference and how it can be l...

Causal topography of visual cortex in perceptual learning.

Individuals are able to improve their visual skill with practice, a phenomenon called Visual Perceptual Learning (VPL). We previously observed that after training on a difficult shape identification t...

Vestibular training promotes adaptation of multisensory integration in postural control.

Postural stability depends on the integration of the multisensory system to produce motor outputs. When visual and somatosensory input is reliable, this reduces reliance on the vestibular system. Desp...

Perceptual Learning of Visual Span Improves Chinese Reading Speed.

Evidence has indicated that the size of the visual span (the number of identifiable letters without movement of the eyes) and reading speed can be boosted through perceptual learning in alphabetic scr...

Clinical Trials [9466 Associated Clinical Trials listed on BioPortfolio]

Multisensory Perceptual Training in the Elderly

Aging impacts our unisensory perceptual abilities as well as our ability to correctly combine signals from multiple sensory modalities to obtain a coherent percept of external events. Elde...

Effect of Multisensory Stimulation on Upper Extremity Motor Recovery in Stroke Patient: a Preliminary Testing

Despite the advances in stroke rehabilitation, post-stroke upper extremity impairment is still a major challenge. Increasing evidence can be found supporting stimulation of the afferent re...

Self-motion Perception in Parkinson's Disease

Parkinson's Disease as well as being a disorder of motor function also causes a wide range of non-motor disturbances many of which are involved in the prodromal stage prior to the onset of...

A New Rehabilitation Treatment Following Stroke

Stroke is the number one cause of disability in the United Nations with about 1 million new cases each year. Following stroke, patients with perceptual and cognitive impairments have the w...

Visual Perceptual Learning for the Treatment of Visual Field Defect

This study evaluates the efficacy of visual perceptual learning for the treatment of visual field defect caused by brain damage. Half of participants will receive visual perceptual trainin...

Medical and Biotech [MESH] Definitions

Process in which individuals take the initiative, in diagnosing their learning needs, formulating learning goals, identifying resources for learning, choosing and implementing learning strategies and evaluating learning outcomes (Knowles, 1975)

A MACHINE LEARNING paradigm used to make predictions about future instances based on a given set of unlabeled paired input-output training (sample) data.

A MACHINE LEARNING paradigm used to make predictions about future instances based on a given set of labeled paired input-output training (sample) data.

SUPERVISED MACHINE LEARNING algorithm which learns to assign labels to objects from a set of training examples. Examples are learning to recognize fraudulent credit card activity by examining hundreds or thousands of fraudulent and non-fraudulent credit card activity, or learning to make disease diagnosis or prognosis based on automatic classification of microarray gene expression profiles drawn from hundreds or thousands of samples.

A controlled learning environment that closely represents reality.

Quick Search

DeepDyve research library

Searches Linking to this Article