Over the past three decades, China has spared no efforts to fulfill the nine-year mandatory education in rural areas. But along with the impressive statistic, reports have shown various kinds of problems. The glaring gap between rural schools and city schools has caused great concern and criticism. This paper adopts historical institutionism along with two-year field studies to analyze the origin, formation, and changes of China's urban-rural dualistic education system over the past half century.