以演算法作曲為基礎的華文詩詞與書法之可聽化研究

Abstract

自古至今，中華文字在藝術上的精緻表現以詩詞與書法著稱。然而，對於視 覺障礙或不熟悉華文的人們來說，體驗中華文字之美卻總是困難重重。本研究分 別針對五言絕句與草書提出兩種可聽化的方法，目的在於萃取出詩詞字裡行間的 韻律之美以及書法揮毫紙上的線條之美，將其映射為數字化資料，並以演算法作 曲化數字為旋律。 本論文在詩詞可聽化的過程中，一方面透過文字平仄的格律分析，依據馬可 夫鍊判斷節奏的連接、控制音符音量大小與音程變化的範圍；另一方面藉由語音 聲韻的共振峰分析，以歐基里得距離挑選出最佳五音調式，並運用篩選理論篩選 出符合最佳調式的音高。在書法可聽化的過程中，運用影像分析將二維空間領域 的影像資訊轉換成時間領域與頻率領域的聲音資訊。 透過詩詞與書法的可聽化研究，除了提供視覺障礙或不熟悉華文的人們另一 種途徑來欣賞中華文字的藝術表現之外，也使得詩詞與書法在文字與圖像上可以 透過聲音的輔助讓鑑賞者能更即時地感知其中的意境，甚至建立出一套沉浸式華 文詩詞與書法學習環境。

Chinese characters are remarkable for their two forms of art — the classical poetry and the calligraphy painting. However, it is difficult for the visually impaired and people who are unfamiliar with Chinese to experience the beauty of the Chinese characters. In this study, two Sonification schemes, Tx2Ms and Im2Ms, are proposed to extract the melody between the lines, i.e., both the lines in verses and the lines in strokes. In Tx2Ms, the movement of multi-dimensional musical elements such as durations, dynamics and interval relations are modeled by Markov Chain for stochastic algorithmic composition based on the poesy analysis. In addition, the best pentatonic mode for a specific poem is recommended according to the formants analysis. In Im2Ms, the two-dimensional spatial image information is transformed into the temporal music acoustics domain based on artistic conception and human perception among space, color and sound. Therefore, the Sonification of Chinese Classical Poetry and Chinese Calligraphy Painting not only provide a free access for the visually impaired and people who are unfamiliar with Chinese to appreciation but also enrich the state of mind and imagery in the delivery process. Thus, an immersive learning environment of Chinese Classical Poetry and Calligraphy Painting can be further developed.