The study mainly explored the origins and development of the “National Teacher In-service Training Program” for the primary and secondary school teachers in China, and analyzed the connotation, supporting measures and implementation outcomes of the national training plan. Finally, the writers summarized the above findings, pointing out their implications to teacher in-service training for the primary and secondary school teachers of Taiwan. Using qualitative research method, the research strategies adopted in this study included literature review, field investigation, document analysis, and semi-structured interviews. Field studies to visit Shaanxi Normal University, Southwest of China University of Teacher Education Research Laboratory, teacher education centers, and primary and secondary schools were conducted in 2012, involving interviews with university professors and graduate students, officials, and primary and secondary school teachers. Diversified information sources and data were included to help the triangulation process. Moreover, the authors always kept in mind the mutual benefit and mutual respect in order to maintain the research ethics. The program was conducted by the central government while trainees were acquired through universities of education. On the other hand, local governments were in charge of contacting the teachers and managing the time of training as well as the interns to substitute the classes so that teachers could attend the training willingly with no doubts. The study suggested that the “National Teacher In-service Training Program” of primary and secondary schools in China can be improved along the gollowing lines. First, there should be a hierarchical classification and adaptive training in terms of contents and objectives. In addition, in order to enhance teachers’ motivation and subjectivity, their feedback and choices should be taken into consideration, regarding the training institutions and trainees as a continuous and dynamic process of mutual exchange. Finally, it is necessary to set up a systematical mechanism and management methods responsible for the evaluation of the training program in order to ensure its effectiveness. Although the regime of China is different from that of Taiwan, the spirits and modes of the teacher training system in these two countries are similar, and therefore the national teacher in-service training program in China is worthy to be the reference for Taiwan in the future.