While the Southern Dynasties continued to use the special military regions for border peoples (man fu) inherited from the Jin dynasty, they also established a system of zuojun and zuoxian (commanderies and counties of the "left") to govern the Man ("barbarian") peoples residing along the Yangtze River basin. The Liu-Song dynasty established the zuo system, using it especially in the Yuzhou region, where these units were operated in combination with military regions to muster resources needed for war with the Northern Wei. The Man peoples rebelled fiercely under this policy. In contrast to existing research, this study pays close attention to changes in the names of these commanderies and counties, showing how these changes reflect instability in the zuo system. Additionally, it is shown that the heads of zuo localities were not always from the Man people. The zuo system was expanded in the Southern Qi dynasty, but came to an end under the Liang, when some zuo units were regularized, while others fell into enemy hands. The restructuring of the zuo system was a complex process, and we should not regard it merely as the result of the sinicization of the Man peoples.