國中綜合活動領域教師學科教學知識量表編製暨效度分析

Development and Validation of the Integrative Activity Pedagogical Content Knowledge Scale for Junior High School Teachers

本研究目的在建構「國中綜合活動領域學科教學知識（Integrative Activities Pedagogical Content Knowledge, IAPCK）」量表，並植基於試題反應理論取向檢驗量表信度與效度。本研究採用探索性序列混合研究設計，共分為三階段進行。首先，以半結構式訪談，匯集十位不同教學經驗的綜合活動領域教師對於IAPCK所涵蓋面向的觀點，歸納綜合活動領域教師學科教學知識的面向與內涵，並使用內容分析法找出IAPCK的核心主題類目；其次，依據前階段內容分析結果、參酌過往綜合活動領域相關實務研究，編擬量表試題。預試量表邀請內容領域與教學實務專家共5位，協助進行專家內容效度檢核以及數位職前與現職國中綜合活動領域教師協助提供量表的使用回饋以確保表面效度；最後，以試題反應理論分析取向蒐集所編製量表的信、效度支持證據。量表共進行預試與正式兩階段施測，各階段受試人數分別為176位與591位綜合活動領域在職與職前教師。資料分析結果發現，本研究編製的「國中綜合活動領域教師學科教學知識量表」，具備適切的試題品質以及良好試題與受試者區分信度。此外，本研究提供內容和結構效度證據、本質效度、類推效度、差異群體比較等效度支持證據，八向度的IAPCK量表能作為綜合活動領域在職教師檢測自身學科教學知識的診斷工具。

After two decades of curriculum development, integrative activity (IA) has become integral to the curriculum followed in Taiwan’s junior high schools. IA aims to engage students in courses that foster multiple intelligences; life skills; and competencies in communication, negotiation, critical thinking, and problem-solving to help them cope with overwhelming pressure. This aim aligns with the recommendations of major international organizations, such as the Organization for Economic Cooperation and Development, which emphasizes the importance of developing life skills in children. Pedagogical content knowledge, which was initially proposed by Shulman (1986, 1987), refers to knowledge for teaching purposes—practical wisdom that teachers internalize through dynamic pedagogical activities and processes, from class preparation and teaching to reflection. However, few studies have defined or measured junior high school teachers’pedagogical content knowledge regarding IAs. Moreover, studies on the content or dimensions of this knowledge are rare. Therefore, in this study, we constructed the Integrative Activity Pedagogical Content Knowledge (IAPCK) scale for junior high school teachers and examined its reliability and validity on the basis of item–response theory. Moreover, we investigated whether teachers with different backgrounds perform differently on the IAPCK scale.
This exploratory sequential mixed-methods study was conducted in three stages. In Stage 1, semistructured interviews were conducted with 10 IA teachers who had varying experience levels. Their practical knowledge about IAPCK was evaluated, and core themes were identified through content analysis. In Stage 3, the IAPCK scale was constructed using the results of Stage 1. A focus group was conducted to validate the content of the preliminary version of the scale. The focus group comprised five domain knowledge and teaching experts. Face validity was assessed on the basis of input from IA teachers and preservice teachers. In Stage 3, a pilot test was conducted with 176 school teachers and preservice teachers specializing in IA. A total of 591 school teachers and preservice teachers completed a survey conducted using the final version of the IAPCK scale.
On the basis of a systematic review of the literature and the results of the semistructured interview, we constructed the IAPCK scale to cover the following eight dimensions: Knowledge of curriculum and objectives, knowledge of content, knowledge of instructional strategies, knowledge of instructional representations, knowledge of learners and their characteristics, knowledge of evaluation, knowledge of instructional media, and knowledge of educational contexts. The preliminary scale was subjected to item analysis; a total of 41 items were retained in the final version. An analysis performed using the multidimensional partial credit model revealed that three items were misfit for the scale; these items were subsequently deleted.
The final version of the IAPCK scale comprised 38 items across eight dimensions. The item separation reliability was .992, which indicated good item separation. The person separation reliability values for the individual dimensions were as follows: Knowledge of curriculum and objectives, .89; knowledge of pedagogical content, .93; knowledge of instructional strategies, .94; knowledge of instructional representations, .93; knowledge of learners and their characteristics, .93; knowledge of evaluation, .88; knowledge of instructional media, .94; and knowledge of educational contexts, .84. These values highlight the scale’s ability to differentiate between different levels of a latent trait. Our scale demonstrated good reliability and validity, supported by substantive content and structural evidence. The results also indicated that in-service teachers performed better on the IAPCK scale than did preservice teachers, confirming the construct validity of the scale.
We further investigated if teachers with different backgrounds perform differently on the IAPCK scale. The following results were obtained:
1. Male in-service IA teachers significantly outperformed female teachers; differences were observed in knowledge of instructional media.
2. No significant difference was observed among IA teachers with different education levels.
3. No significant difference was noted in IA teachers with different experience levels.
4. Significant differences were noted among teachers with different years of service in terms of their performance on various IAPCK dimensions, except for knowledge of curriculum and objectives and knowledge of pedagogical content.
5. The IAPCK performance of IA teachers with different expertise levels varied significantly, although not on each dimension, according to an F test.
6. No significant difference was observed among IA teachers employed in different districts.
7. IA teachers who had received on-the-job training on pedagogical knowledge and skills outperformed those who had never received such training.
This paragraph highlights the significance of our study. First, we investigated the specific implications of IAPCK at the junior high school level. Through semistructured interviews, we deduced the distinct characteristics of IA pedagogical knowledge. Second, the IAPCK scale was developed through a systematic content analysis, which closely aligned with the practical teaching context. This approach facilitated the comprehensive representation of the characteristics of IA pedagogical knowledge. Furthermore, in contrast to previous measurement methods that solely relied on participants’self-reported data, our approach involved an objective scoring method to evaluate teachers’curriculum and objective knowledge as well as situational knowledge. Nonetheless, for the other dimensions of knowledge, the traditional measurement approach was used for assessing IA pedagogical knowledge: Participants completed the survey on the basis of congruence. We used the multidimensional partial credit item–response theory model for data analysis; this facilitated the establishment of the objective scale, which not only addresses the challenge of inconsistent scoring methods for different items within the scale—a problem encountered in traditional item analysis—but also ensures that the scale possesses the characteristics of equidistance and objective measurement. Third, we further confirmed that our scale has adequate item quality and good item and person separation reliability. Additionally, substantive evidence, criterion-related validity, interpretability evidence, and generalizability evidence supported the potential of the eight IAPCK dimensions in evaluating the IA pedagogical content knowledge of junior high school teachers. The IAPCK can serve as a self-evaluation tool for both preservice and in-service IA teachers. By answering questions under each dimension, teachers can monitor their IAPCK development and improve their weak areas. In addition, this scale can be used as a measurement tool in future studies. Finally, the IAPCK scale can be valuable for educational institutions—for example, during re-entry programs to assess the effectiveness of efforts investigated in enhancing re-entry education. By using a multidimensional radar chart to evaluate the performance of in-service teachers across different subject knowledge dimensions before and after their participation in a re-entry education program, the program organizers can gain insights to better align their future planning with the specific needs of the participants. This targeted and demand-driven approach would facilitate the organization of effective re-entry education programs.
Nonetheless, we only conducted a preliminary overview analysis of junior high school teachers’background information and their performance on the IAPCK scale. Further studies are needed to clarify the specific aspects of IAPCK. Future studies should include a broad range of variables and explore factors that potentially influence teachers’performance in the IA domain. Additionally, the long-term effects of re-entry education on teachers’instructional practices and student outcomes should be investigated to gain key insights for educational policy development and practice.