Object-based auditory facilitation of visual search for pictures and words with frequent and rare targets.
Summary of "Object-based auditory facilitation of visual search for pictures and words with frequent and rare targets."
Auditory and visual processes demonstrably enhance each other based on spatial and temporal coincidence. Our recent results on visual search have shown that auditory signals also enhance visual salience of specific objects based on multimodal experience. For example, we tend to see an object (e.g., a cat) and simultaneously hear its characteristic sound (e.g., "meow"), to name an object when we see it, and to vocalize a word when we read it, but we do not tend to see a word (e.g., cat) and simultaneously hear the characteristic sound (e.g., "meow") of the named object. If auditory-visual enhancements occur based on this pattern of experiential associations, playing a characteristic sound (e.g., "meow") should facilitate visual search for the corresponding object (e.g., an image of a cat), hearing a name should facilitate visual search for both the corresponding object and corresponding word, but playing a characteristic sound should not facilitate visual search for the name of the corresponding object. Our present and prior results together confirmed these experiential association predictions. We also recently showed that the underlying object-based auditory-visual interactions occur rapidly (within 220ms) and guide initial saccades towards target objects. If object-based auditory-visual enhancements are automatic and persistent, an interesting application would be to use characteristic sounds to facilitate visual search when targets are rare, such as during baggage screening. Our participants searched for a gun among other objects when a gun was presented on only 10% of the trials. The search time was speeded when a gun sound was played on every trial (primarily on gun-absent trials); importantly, playing gun sounds facilitated both gun-present and gun-absent responses, suggesting that object-based auditory-visual enhancements persistently increase the detectability of guns rather than simply biasing gun-present responses. Thus, object-based auditory-visual interactions that derive from experiential associations rapidly and persistently increase visual salience of corresponding objects.
Department of Psychology, Northwestern University, Evanston, IL, United States.
This article was published in the following journal.
Name: Acta psychologica
- PubMed Source: http://www.ncbi.nlm.nih.gov/pubmed/20864070
- DOI: http://dx.doi.org/10.1016/j.actpsy.2010.07.017
Medical and Biotech [MESH] Definitions
The recorded electrical responses from nerve, muscle, SENSORY RECEPTOR, or area of the CENTRAL NERVOUS SYSTEM following stimulation. They range from less than a microvolt to several microvolts. The evoked potential can be auditory (EVOKED POTENTIALS, AUDITORY), somatosensory (EVOKED POTENTIALS, SOMATOSENSORY), visual (EVOKED POTENTIALS, VISUAL), or motor (EVOKED POTENTIALS, MOTOR), or other modalities that have been reported. Often used synonymously to event-related potentials which are associated with higher level cognitive processes.
The selecting and organizing of visual stimuli based on the individual's past experience.
Auditory and visual instructional materials.
A visual symptom in which a single object is perceived by the visual cortex as two objects rather than one. Disorders associated with this condition include REFRACTIVE ERRORS; STRABISMUS; OCULOMOTOR NERVE DISEASES; TROCHLEAR NERVE DISEASES; ABDUCENS NERVE DISEASES; and diseases of the BRAIN STEM and OCCIPITAL LOBE.
Motion Pictures As Topic
The art, technique, or business of producing motion pictures for entertainment, propaganda, or instruction.
The emotional Stroop effect denotes slower responses to the colour of negative words (e.g., death) compared to neutral words (e.g., mug). Popular explanations assume a general power of negative words...
The "pip-and-pop effect" refers to the facilitation of search for a visual target (a horizontal or vertical bar whose color changes frequently) among multiple visual distractors (tilted bars also chan...
In humans, as well as most animal species, perception of object motion is critical to successful interaction with the surrounding environment. Yet, as the observer also moves, the retinal projections...
The effect of audiovisual interactions on size perception has yet to be examined, despite its fundamental importance in daily life. Previous studies have reported that object length can be estimated s...
Presenting an auditory or tactile cue in temporal synchrony with a change in the color of a visual target can facilitate participants' visual search performance. In the present study, we compared the...
Patients with Alzheimer's disease (AD) perform poorly on tasks dependent on access to, and utilization of, previously acquired knowledge and skills. It has been commonly assumed that impa...
This project will systematically examine the therapeutic effect of altered auditory feedback provided by the in-the-ear device on the speech impairments in patients with Parkinson's diseas...
Background: - The brain has natural rhythms called brain waves. An electroencephalogram (EEG) can record these rhythms. When people identify the picture of a familiar object shown on a co...
This is a randomized trial testing the efficacy of a modified 12-step facilitation therapy for individuals with serious mental illness and alcohol use disorders, compared to usual treatmen...
This study will look at how tumors in the chest and abdomen move when you breathe. Your doctors are studying if extra 4D CT scans and instructions on how to breathe can help predict this t...