Cross-modal correspondences refer to associations between apparently unrelated stimulus features in different senses. For example, high and low auditory pitches are associated with high and low visual elevations, respectively. Here we examined how this crossmodal correspondence between visual elevation and auditory pitch relates to auditory elevation. We used audiovisual combinations of high- or low-frequency bursts of white noise and a visual stimulus comprising a white circle. Auditory and visual stimuli could each occur at high or low elevations. These multisensory stimuli could be congruent or incongruent for three correspondence types: cross-modal featural (auditory pitch/visual elevation), within-modal featural (auditory pitch/auditory elevation) and cross-modal spatial (auditory and visual elevation). Participants performed a 2AFC speeded classification (high or low) task while attending to auditory pitch, auditory elevation, or visual elevation. We tested for modulatory interactions between the three correspondence types. Modulatory interactions were absent when discriminating visual elevation. However, the within-modal featural correspondence affected the cross-modal featural correspondence during discrimination of auditory elevation and pitch, while the reverse modulation was observed only during discrimination of auditory pitch. The cross-modal spatial correspondence modulated the other two correspondences only when auditory elevation was being attended, was modulated by the cross-modal featural correspondence only during attention to auditory pitch, and was modulated by the within-modal featural correspondence while performing discrimination of either auditory elevation or pitch. We conclude that the cross-modal correspondence between auditory pitch and visual elevation interacts strongly with auditory elevation.

译文

跨模态对应关系是指在不同意义上表面上不相关的刺激特征之间的关联。例如,高听觉音高和低听觉音高分别与高和低视觉高程相关联。在这里,我们研究了视觉高度和听觉音调之间的这种跨模对应关系与听觉高度之间的关系。我们使用了白噪声的高频或低频突发与包含白色圆圈的视觉刺激的视听组合。听觉和视觉刺激都可能发生在高海拔或低海拔。对于三种对应类型,这些多感觉刺激可能是一致的或不一致的: 跨模态特征 (听觉音调/视觉高度),模态内特征 (听觉音调/听觉高度) 和跨模态空间 (听觉和视觉高度)。参与者在处理听觉音高,听觉抬高或视觉抬高时执行了2AFC加速分类 (高或低) 任务。我们测试了三种对应类型之间的调节交互。区分视觉高度时,没有调节相互作用。但是,模态内特征对应关系在识别听觉高度和音高时会影响跨模态特征对应关系,而仅在识别听觉音调时才观察到反向调制。跨模态空间对应仅在注意听觉升高时才对其他两个对应进行调制,仅在注意听觉音调时才通过跨模态特征对应进行调制,并在进行识别时通过模态内特征对应进行调制。听觉升高或音调。我们得出的结论是,听觉音调和视觉高度之间的跨模态对应关系与听觉高度强烈相互作用。

+1
+2
100研值 100研值 ¥99课程
检索文献一次
下载文献一次

去下载>

成功解锁2个技能,为你点赞

《SCI写作十大必备语法》
解决你的SCI语法难题!

技能熟练度+1

视频课《玩转文献检索》
让你成为检索达人!

恭喜完成新手挑战

手机微信扫一扫,添加好友领取

免费领《Endnote文献管理工具+教程》

微信扫码, 免费领取

手机登录

获取验证码
登录