基於人工智慧之動畫元件生成系統於教育戲劇之英語教學應用

AI-based Animation Component Generation System for Educational Drama in English Teaching Application

過去研究顯示，多媒體元件可以增加觀看者的興趣，在學習新事物時可以產生至關重要的作用。講師經常要花費大量時間來準備合適的多媒體元件來描述教材內容以製作簡報。本研究基於人工智慧提出了一種新穎的多媒體元件生成系統於簡報插圖之應用，根據講者簡報中敘述之文字內容，自動生成多媒體元件，並整合至新的簡報。本系統所產生的多媒體元件共分為兩類：一般圖像元件是從使用者所提供的圖庫中檢索取得；而動畫元件則是從我們的人工智慧系統自動生成對嘴型的動畫角色。我們提供了案例來呈現本研究貢獻的使用場景，顯示所開發之系統可以應用在支援教育戲劇之英語教學活動上，如角色扮演和劇本表演。這些活動不僅可以提升學生的詞彙和文法等語言技能，還可以培養其溝通能力。

Previous studies show that multimedia components play a vital role in learning and can increase learners' interest. Instructors often spend considerable time preparing suitable multimedia components for their slide presentations, which requires substantial effort. In this paper, we use artificial intelligence to propose a novel system that automatically generates illustrated slides by gathering the suggested multimedia components from their course descriptions. Our provided multimedia components have two types. One, the common image components, is retrieved from an existing gallery provided by users; The other, the speaking animation components, is a lip-synced animation character generated by our AI system. We provide use-cases to indicate the contribution scenarios of our paper. It indicates that our system can be utilized to support the activities (such as role-play and scripted play) for educational drama in English teaching. Such activities not only improve linguistic skills like vocabulary and grammar in context but also develop communicative competence of students.