Corporate social responsibility (CSR) has emerged and developed worldwide since the early 1990s. With most bank deposits coming from the general public, CSR is playing an even more important role in the banking industry. The purpose of this study is to investigate the effect of CSR programs on the cost efficiency of Taiwanese banks, by employing the stochastic frontier approach (SFA) of Battese and Coelli (1995) and the stochastic metafrontier approach (SMF) of Huang et al. (2014) on a sample of 15 financial holding company (FHC) subsidiary banks and 21 independent banks from 2006 to 2012. The empirical results indicate that FHC subsidiary banks and independent banks differ significantly based on four dimensions: corporate governance, sustainability, public welfare, and disclosure of CSR information. We find that independent director and CSR report increase the cost efficiency of FHC subsidiary banks, but reduce that of independent banks. Bigger board size and longer years of establishment decrease the cost efficiency of FHC subsidiary banks, but increase that of independent banks. In contrast, government-imposed penalties reduce the cost efficiency of FHC subsidiary banks more than independent banks, however, the cost efficiencies of both types of banks fall with higher risk and rise with labor union. Overall, the results of the metafrontier approach show that FHC subsidiary banks outperform independent banks in terms of technology gap ratio (TGR) and metafrontier cost efficiency (MCE).