體感語音式操控學習策略對提升英文影片理解之研究

A Gesture-speech Navigated Learning Strategy for Improving the Comprehension of English Videos

由於自然人機介面技術的成熟，學習者得以利用體感操作方式進行以肢體活動為媒介之學習應用，藉此讓學習者使用更直覺、自然的方式與學習系統互動。在英文影片學習中，目前仍以鍵盤與滑鼠操作為主，雖然此類操作介面已被廣泛應用，對於多媒體學習而言，直覺性與操作性依然有改善空間。因此，本研究將自然人機介面與語言學習策略進行結合，進而提出「體感語音式操控學習策略」用以促進學習者於觀看英文學習影片時對內容之理解。本研究招募75位大學生與碩士生為實驗對象，結果顯示，在單純改變操作介面的體感操作學習方式下，能改善學習者於學習過程中之認知負荷。學習者在體感語音式操控學習策略的輔助下，學習成效獲得顯著地提升；相較於僅改變操作介面之體感操作學習方式，認知負荷並無顯著地增加。

Learners now can use gestures and speech to intuitively interact with learning system because of the spectacular progress of natural user interface (NUI) technology. Compared with keyboard / mouse, NUI make the interaction between learners and learning system more naturally. Although keyboard / mouse has been widely adopted for a long time, there still has room for improving intuition and operational experience in a multimedia learning environment. This study therefore explores and proposes a new approach by integrating language learning strategies into a gesture-speech navigated learning system for improving learners’ comprehension of English videos content. An experiment was conducted with 75 undergraduate and postgraduate students. The result showed that the gesture-speech navigated learning strategy can significantly improve learners’ comprehension of English videos. Meanwhile, the cognitive load is also under control and acceptable without significant increase.