Parallel linear dynamic models can mimic the McGurk effect in clinical populations

Nicholas Altieri, Cheng Ta Yang

Research output: Contribution to journalArticlepeer-review

5 Citations (Scopus)

Abstract

One of the most common examples of audiovisual speech integration is the McGurk effect. As an example, an auditory syllable /ba/ recorded over incongruent lip movements that produce “ga” typically causes listeners to hear “da”. This report hypothesizes reasons why certain clinical and listeners who are hard of hearing might be more susceptible to visual influence. Conversely, we also examine why other listeners appear less susceptible to the McGurk effect (i.e., they report hearing just the auditory stimulus without being influenced by the visual). Such explanations are accompanied by a mechanistic explanation of integration phenomena including visual inhibition of auditory information, or slower rate of accumulation of inputs. First, simulations of a linear dynamic parallel interactive model were instantiated using inhibition and facilitation to examine potential mechanisms underlying integration. In a second set of simulations, we systematically manipulated the inhibition parameter values to model data obtained from listeners with autism spectrum disorder. In summary, we argue that cross-modal inhibition parameter values explain individual variability in McGurk perceptibility. Nonetheless, different mechanisms should continue to be explored in an effort to better understand current data patterns in the audiovisual integration literature.

Original languageEnglish
Pages (from-to)143-155
Number of pages13
JournalJournal of Computational Neuroscience
Volume41
Issue number2
DOIs
Publication statusPublished - 2016 Oct 1

All Science Journal Classification (ASJC) codes

  • Sensory Systems
  • Cognitive Neuroscience
  • Cellular and Molecular Neuroscience

Fingerprint Dive into the research topics of 'Parallel linear dynamic models can mimic the McGurk effect in clinical populations'. Together they form a unique fingerprint.

Cite this