Abstract: The political legitimacy is a universal issue and is the foundation and premise for the existence, continuation, stability and development for any political system. It originated mainly from system foundation (from the recognition of rules), government achievements (government effectiveness) and conception foundation (from ideology). Today’s China should also pay attention to the conception legitimacy. And in the time with multi-values and various ideological trends, China should further integrate and enhance the functions of ideological education in an attempt to stimulate people’s strong recognition and beliefs, and hence consolidate the conception foundation of political legitimacy, transform them into supportive forces to our party, and make the historical and people’s choice solid and lasting.