几千年来,跨越一系列学科,人们普遍渴望联系,或之间的翻译,感官以一种有意义的方式,而不是任意。早期的例子往往受到生动的启发,但大多是特质,用联觉表达的跨模态匹配,经常被作家用于审美目的,艺术家,和作曲家。另一种方法来自那些试图在感知体验的结构相似维度(例如音高和颜色)之间进行翻译的学术评论员。然而,这两种方法都没有成功地提供协商一致的跨模式匹配。因此,需要一种感官翻译的替代方法。在这篇叙事性的历史回顾中,专注于试听和视觉之间的翻译,我们试图通过解决以下三个问题来阐明该主题:(1)感觉翻译的主题与通感有关,多感官整合,和跨模态关联?(2)是否存在跨感官的共同处理机制,可以帮助保证感官翻译的成功,或者,更确切地说,是由所谓的普遍性介导的感官之间的映射(例如,amodal)刺激维度?(3)在跨感官映射的背景下,术语“翻译”是隐喻还是字面上使用?鉴于整个审查中讨论的一般机制和概念,我们得出的关于视听翻译性质的答案可能也适用于其他可能不太频繁研究的模态配对之间的翻译。
Across the millennia, and across a range of disciplines, there has been a widespread desire to connect, or translate between, the senses in a manner that is meaningful, rather than arbitrary. Early examples were often inspired by the vivid, yet mostly idiosyncratic, crossmodal matches expressed by synaesthetes, often exploited for aesthetic purposes by writers, artists, and composers. A separate approach comes from those academic commentators who have attempted to translate between structurally similar dimensions of perceptual experience (such as pitch and colour). However, neither approach has succeeded in delivering consensually agreed crossmodal matches. As such, an alternative approach to sensory translation is needed. In this narrative historical review, focusing on the translation between audition and vision, we attempt to shed light on the topic by addressing the following three questions: (1) How is the topic of sensory translation related to synaesthesia, multisensory integration, and crossmodal associations? (2) Are there common processing mechanisms across the senses that can help to guarantee the success of sensory translation, or, rather, is mapping among the senses mediated by allegedly universal (e.g., amodal) stimulus dimensions? (3) Is the term \'translation\' in the context of cross-sensory mappings used metaphorically or literally? Given the general mechanisms and concepts discussed throughout the review, the answers we come to regarding the nature of audio-visual translation are likely to apply to the translation between other perhaps less-frequently studied modality pairings as well.