文字動畫中動態韻律與音樂節奏的搭配對記憶性之影響

Abstract

視覺與聽覺一直都是人類重要的感覺器官，而且在知覺層次上兩者之間具有許多相互聯絡、交互影響的例子。在今日，許多媒體皆經由整合視聽官能的方式來傳播訊息，然而只要將視覺與聽覺互相整合就真的可以產生良好傳播效果嗎？還是視、聽訊息同時必須滿足一些條件才能製造最強烈的印象？因此本研究的目的即為針對文字動畫媒體，從視、聽共感覺與互動性的角度，探討其中動態韻律與音樂節奏的搭配對於記憶效果的影響。 本研究探討以下變項：（1）視聽同步配合與否、（2）文字動畫之視覺動態效果的種類、（3）文字配樂的旋律與節奏的種類等三方面對於記憶性的影響。研究結果顯示：在視覺與聽覺的結合中，文字動態律動與音樂節奏是以「同步配合」的方式呈現，能夠帶來較佳的記憶性，因此，視覺與聽覺在動態韻律上的共感覺特性，可以成為視、聽互動中一個提高記憶效果的機制，此外也從分析的數據中得知，為避免感知疲乏影響記憶性，此視、聽同步配合呈現的時間應以簡短為原則；視覺的層面中，不同的文字動畫動態效果種類會影響記憶程度，其中「等比縮放」的動態效果比「垂直縮放」的動態效果可以帶來較佳的記憶性；聽覺的層面中，旋律種類對於記憶程度會造成顯著影響，節奏種類則不會。

Vision and audition are the two most important senses for humans. There are many lines of evidence showing that there are intricate interactions between vision and audition. In the media world, it has become more and more common to integrate visual and audio modalities to achieve better communication. Good communication efficiency is certainly not warranted by simply lumping visual and audio information together. There must be some constraints to meet for a multi-modality presentation to be effective. The goal of this study was to spell out some of these underlying constraints. We have investigate the effect of the following variables on the memory of a word list: (1) Whether there was a kinetic congruency between visual and musical rhythms or not. (2) The type of motion associated with the words. (3) The melody and the rhythm of the accompanying music. The results showed that kinetic congruency gave rise to a better memory performance. However, the enhancement diminished as the duration was lengthened. Therefore, it is important to keep the presentation time within a short range to prevent the perceptional weariness. We also found that the type of motion could have an effect on memory, the “enlarging” type being more effective than the “elongating” type. As for the musical variables, melody appeared to have some effect on memory performance. Rhythm did not seem to have any significant effect on memory.