英文摘要 |
The demand for reliable and valid writing assessing methods of Chinese as a foreign language has grown significantly in recent years. This article reports the construction and the subsequent evaluation of the analytic rating scale based on ACTFL (American Council on the Teaching of Foreign Languages) writing proficiency guidelines. A corpus of 402 writing scripts from different levels at the Mandarin Training Center at National Taiwan Normal University, but all in response to the same writing task, was collected and graded by five professional raters. Each writing test is independently rated by two raters. The validity of the scale is rigidly controlled throughout the construction and raters training process. The grading results provide qualitative analysis of two main points. On the one hand, the reliability of the assessment is examined in terms of the percentage of agreement between raters as well as generalizability and decision studies. On the other, a number of major issues involved in the development of a rating scale are explored for the purpose of this paper, especially on the examination of analytic rating scale against holistic rating scale, as well as the exploration of rating criteria. |