The impact of industry structural change on productivity growth has been regarded as an important issue in the literature of economic growth. Previous relevant Taiwan studies have emphasized on the source of economic growth analysis and productivity measurement. This paper attempts to measure capital and labor reallocation effects from the perspective of cross industry resource movement due to industry structural change. Utilizing the Taiwan KLEMS Database with 30 industry level input output data in 1981-2015, we adopt Jorgenson et al. (2007) productivity measurement framework to measure the aggregate and industry level productivity growth as well as the capital and labor reallocation effects in different periods. Empirical results indicate that internal productivity growth within industry is the major source of Taiwan’s aggregate productivity growth in 1981-2015, whereas cross industry resource reallocation effect contributes averagely 16% of productivity growth despite the size of such effect may vary in different periods. Among resource reallocation effects, labor reallocation has been the main contributor before the year of 2000, however, after 2001 capital reallocation plays the key role. The labor reallocation effect even became negative after 2011, which implies that a demand for government to promote labor smooth movement industrial policy in the future. Results also find that ICT sectors have contributed more than 50% of aggregated productivity growth of Taiwan after 1991, whereas the contribution from ICT producing sectors is greater than that from ICT using sectors. Particularly, the Electronic and Optical Equipment Industry, an ICT producing manufacturing industry, performed the most contribution to aggregate productivity growth in Taiwan after 2001.