Delogu Franco, Raffone Antonino, Belardinelli Marta Olivetti
Department of Psychology, Sapienza University of Rome, Rome, Italy.
Memory. 2009 Aug;17(6):655-63. doi: 10.1080/09658210902998054. Epub 2009 Jun 17.
In spite of a large body of empirical research demonstrating the importance of multisensory integration in cognition, there is still little research about multimodal encoding and maintenance effects in working memory. In this study we investigated multimodal encoding in working memory by means of an immediate serial recall task with different modality and format conditions. In a first non-verbal condition participants were presented with sequences of non-verbal inputs representing familiar (concrete) objects, either in visual, auditory or audio-visual formats. In a second verbal condition participants were presented with written, spoken, or bimodally presented words denoting the same objects represented by pictures or sounds in the non-verbal condition. The effects of articulatory suppression were assessed in both conditions. We found a bimodal superiority effect on memory span with non-verbal material, and a larger span with auditory (or bimodal) versus visual presentation with verbal material, with a significant effect of articulatory suppression in the two conditions.
尽管大量实证研究表明多感官整合在认知中具有重要性，但关于工作记忆中的多模态编码和维持效应的研究仍然很少。在本研究中，我们通过一个具有不同模态和格式条件的即时系列回忆任务，对工作记忆中的多模态编码进行了研究。在第一个非言语条件下，向参与者呈现代表熟悉（具体）物体的非言语输入序列，这些序列采用视觉、听觉或视听格式。在第二个言语条件下，向参与者呈现书面、口头或双模态呈现的单词，这些单词表示在非言语条件下由图片或声音所代表的相同物体。在两种条件下均评估了发音抑制的效果。我们发现，对于非言语材料，记忆广度存在双模态优势效应；对于言语材料，听觉（或双模态）呈现相对于视觉呈现具有更大的记忆广度，并且在两种条件下发音抑制均有显著效应。
