A question that has emerged over recent years is whether audiovisual (AV) speech perception is a special case of multi-sensory perception. Electrophysiological (ERP) studies have found that auditory neural activity (N1 component of the ERP) induced by speech is suppressed and speeded up when a speech sound is accompanied by concordant lip movements. In Experiment 1, we show that this AV interaction is not speech-specific. Ecologically valid nonspeech AV events (actions performed by an actor such as handclapping) were associated with a similar speeding-up and suppression of auditory N1 amplitude as AV speech (syllables). Experiment 2 demonstrated that these AV interactions were not influenced by whether A and V were congruent or incongruent. In Experiment 3 we show that the AV interaction on N1 was absent when there was no anticipatory visual motion, indicating that the AV interaction only occurred when visual anticipatory motion preceded the sound. These results demonstrate that the visually induced speeding-up and suppression of auditory N1 amplitude reflect multisensory integrative mechanisms of AV events that crucially depend on whether vision predicts when the sound occurs.

译文

近年来出现的一个问题是,视听 (AV) 语音感知是否是多感官感知的特例。电生理 (ERP) 研究发现,当语音伴随着一致的嘴唇运动时,语音引起的听觉神经活动 (ERP的N1成分) 会受到抑制并加快。在实验1中,我们表明这种AV交互不是特定于语音的。生态上有效的非语音AV事件 (演员执行的动作,例如拍手) 与AV语音 (音节) 类似的听觉N1振幅的加速和抑制有关。实验2表明,这些AV相互作用不受A和V是否一致的影响。在实验3中,我们表明,当没有预期的视觉运动时,N1上的AV相互作用不存在,这表明AV相互作用仅在视觉预期运动先于声音时才发生。这些结果表明,视觉引起的听觉N1振幅的加速和抑制反映了AV事件的多感觉统合机制,这在很大程度上取决于视觉是否能预测声音何时发生。

+1
+2
100研值 100研值 ¥99课程
检索文献一次
下载文献一次

去下载>

成功解锁2个技能,为你点赞

《SCI写作十大必备语法》
解决你的SCI语法难题!

技能熟练度+1

视频课《玩转文献检索》
让你成为检索达人!

恭喜完成新手挑战

手机微信扫一扫,添加好友领取

免费领《Endnote文献管理工具+教程》

微信扫码, 免费领取

手机登录

获取验证码
登录