台灣地區華人情緒與相關心理生理資料庫－－基本情緒聲調

Taiwan Corpora of Chinese Emotions and Relevant Psychophysiological Data–Prosody for Basic Emotions

本研究主要目的是收集具情緒聲調之口說刺激材料，進行情緒類別評量篩選以建立台灣本土基本情緒的聲調刺激資料庫。本研究第一部分蒐集3,541句包括中性及七種基本情緒之聲調刺激，第二部分由162位參與者分別對部分之材料進行情緒類別與強度之評量，經篩選進一步分析其中424個聲調錄音刺激及其評量之多數情緒類別熵值，結果發現總平均數為1.14，介於0.00與2.71之間，其中生氣熵值最低，輕蔑、厭惡熵值最高。第三部分由60位參與者分別對320個影音刺激之材料進行情緒類別與強度之評量，經篩選進一步分析其中254個聲調錄音刺激及其評量之多數情緒類別之熵值，結果發現總平均數為1.26，介於0.05與2.71之間，快樂熵值最低，厭惡熵值最高。然後對影音刺激原情緒類別與評定情緒類別之一致性進行變異數分析，結果發現情緒類別與聲調刺激性別之主要效果及兩者間交互作用。快樂、生氣、驚訝與中性聲調較高，厭惡與害怕較低。對女性聲調的評量一致性低於對男性之一致性。追蹤交互作用發現對女性生氣與厭惡聲調影音刺激的評量一致性較對男性生氣與厭惡刺激的評量一致性為高；對於男性之輕蔑與驚訝聲調影音刺激的評量一致性則較對女性輕蔑與驚訝之聲調影音刺激評量一致性為高。聲調錄音及影音刺激收列於情緒聲調刺激資料庫。

The purpose of the present study aimed to collect emotional prosody of sentences and conduct subjective evaluation to establish a Taiwanese database of emotional prosody. In the first phase, there were 3,541 emotional vocal stimuli of the seven basic emotions collected. In the second phase, 162 college students each rated randomly selected stimuli of their emotional category and intensity. Based on the ratings, we screened 424 stimuli and computed entropy values for each stimulus. The obtained total averaged entropy values was 1.14 ranged between 0.00 and 2.71. The averaged entropy of anger was the lowest, the entropy of disgust and contempt stimuli were the highest. In the third phase, 320 short videos of emotional prosody with its facial expressions were developed and evaluated by 60 participants. We then screened and selected 254 video stimuli, the obtained total averaged entropy values was 1.26, ranged between 0.05 and 2.71. The averaged entropy of happiness stimuli was the lowest, and the averaged entropy of disgust stimuli was the highest. We then conducted analysis on the scores of consistency between the original performed emotion and the evaluated emotion of the types of emotion, the gender of the stimuli, and the sex of the participants. Results found main effects of the emotion and gender of the stimuli as well as an interaction between them. Happy, angry, surprised and neutral stimuli were found higher of their consistency and disgust and fearful stimuli were lower in consistency. The consistency was found lower on female stimuli than those of male stimuli. Fellow-up the interaction found higher consistency in female angry, and disgust stimuli than to those of male stimuli, whereas higher consistency to male contempt and surprised stimuli were found than those of female stimuli. Emotional prosody voice and video stimuli were both collected in database for further research.