人類內在感受與外在情緒表達有落差時的語音特徵: 影像刺激條件下分析母音共振峰之特性

Abstract

生活中常聽到疑似表裡不一的詞語，像是朋友變胖了，卻要當面問我的看法。為了避免對方難過，只好說體態維持很好。這些話自己聽起來覺得心虛，與平常說話的語調有差異，卻又無法具體說明差別在哪。能否發展出一種工具來輔助我們判斷說話者語調透露出的訊息? 為此，提出一個表裡不一實驗，分為Baseline和Deception兩階段。Baseline會問受測者一些簡單問題，如早餐吃什麼，其目的為蒐集心情平靜且真誠無隱瞞的聲音。Deception階段要求受測者選出十張不喜歡的圖片，接著假裝很喜歡這些圖片，且要說出喜歡的原因。全程採用中文來提問與答覆，並且錄音，再將錄音檔切割出所對應的聲音區塊加以分析。錄音檔用Praat軟體將16個母音(ㄚㄛㄜㄝㄞㄟㄠㄡㄢㄣㄤㄥㄦㄧㄨㄩ)進行JTFA轉換以獲得個別母音的f0、f1與f2，並請一位執業14年的心理諮商師重新聽二階段的聲音，採五分法來判讀表裡不一的程度。在交大REC中心的同意下共招募30人參與此實驗，結果呈現，(1) 以“ㄣㄟㄜ”之(f1,f2)為座標所圍成之向量面積，在30人當中有25人(83%)出現Dec_area > Bas_area，統計檢定結果為p= .01，可當成識別「表裡不一」的指標；(2)若在不考量樣本數量的條件下，則研究所p = 0.000015(11人)；大學p = 0.000083(12人)；專科p = 0.0074(5人)；國、高中p = 0.21(2人)。隨著學歷下降，p-value有逐漸上升的趨勢，統計檢定顯示，隨著學歷越高，對說謊特徵的掌握度就越好。

We often hear some deceptive speechs in our lives. Just like a friend looks fat, but when he asked me about how fat he is, I pretended not to think so. When we lie, the tone of these speech sounds strange but we do not unaware ourself. Is it possible to develop a tool for helping us to judge the speaker's insight thoughts? To this end, designed a deceptive experiment. The experiment is divided into two stages: Baseline and Deception. Baseline stage will ask the subject some simple questions, such as what to eat at breakfast, the purpose is to collect non-deceptive voice. The Deception stage requires the subjects to select ten pictures they do not like, and then pretend to like the pictures, and say why they like them. The course of the experiment records speaker’s speech and PPG information. JTFA is performed with the Praat software to obtain f0, f1 and f2 of the 16 vowels (ㄚㄛㄜㄝㄞㄟㄠㄡㄢㄣㄤㄥㄦㄧㄨㄩ). And find a psychological counselor (14 years of qualification) to listen to the sound of two stages to determine the extent of Deception in 1 to 5 points. The results show, (1) 25 of the 30 people showed a greater trend in Dec_area (f1,f2) vector area under“ㄣㄟㄜ”,and there were statistically significant differences (p=.01). The (f1, f2) vector area can be used as a criterion for identifying " Deception "; (2) If we do not consider the sample size, the higher the degree of education, the higher the ability to lie.