「國民中學學生基本學力測驗寫作測驗」信度與效度分析研究

The Reliability and Validity of Writing Assessment of Basic Competence Test for Junior High School Students

「國民中學學生基本學力測驗」自2007年正式加考寫作測驗以來，外界對於 寫作測驗的評分者一致性，以及每次只考一個題目是否足以評量到考生的寫作能 力，始終非常的關心。加上國中基測屬於高風險測驗，考生人數眾多，影響極鉅， 以及國內外在寫作測驗信效度研究上的不足，因此實有必要進行寫作測驗信效度之 研究。本研究之研究目的有二 ：首先為探討「國民中學學生基本學力測驗寫作測 驗」（筒稱「國中基測寫作測驗」）的信度，以類推性理論為主，辅以評分者一致 率與評分者間相關等數據，作為驗證信度的依據；其次，蒐集命題設計、評分流 程、寫作分數與其他效標的關聯等各種效度證據，以驗證寫作測驗之效度。期望透 過本研究結果，一方面能提供測驗實務界關於高風險考試中如何監控與提升寫作測 驗信度與效度的作法，另一方面可以讓社會相關人士了解「國中基測寫作測驗」的 信度、效度之實徵證據。而研究結果也顯示「國中基測寫作測驗」確實具有良好之 信度與效度。

Since writing assessment of Basic Competence Test for Junior High School Students (BCTEST-WA) has been implemented from 2007， its reliability and validity has been one of the most concerning issues to public. Due to the reason that BCTEST-WA is a large-scale high-stake exam， but existing researches on reliability and validity of writing assessment are insufficient， the purpose of this study is to validate the reliability and validity of BCTEST-WA. Three approaches to validate the reliability include gen-eralizability theory， raters’ consensus， and raters’ consistency. The exam validity was illustrated through collecting evidences based on test content， responses processes， and relations to other variables. The results show that BCTEST-WA， as a large-scale high-stake exam， has high reliability and validity. This paper does not only present the evidences on the good reliability and validity of BCTEST-WA， but it also provides references on how to monitor and improve reliability and validity of high-stake writing assessments.