Preventive care service is considered pivotal on the background of demographic ageing and a rise in chronic diseases in China. The disparity in utilization of preventive care services between urban and rural in China is a serious issue. In this paper, we explored factors associated with urban–rural disparity in utilization of preventive care services in China, and determined how much of the urban–rural disparity was attributable to each determinant of utilization in preventive care services. Using representative sample data from China Health and Nutrition Survey in 2011 (N = 12,976), the present study performed multilevel logistic model to examine the factors that affected utilization of preventive care services in last 4 weeks. Blinder–Oaxaca decomposition method was applied to divide the utilization of preventive care disparity between urban and rural residents into a part that can be explained by differences in observed covariates and unobserved part. The percentage of rural residents utilizing preventive care service in last 4 weeks was lower than that of urban residents (5.1% vs 9.3%). Female, the aged, residents with higher education level and household income, residents reporting self-perceived illness in last 4 weeks and physician-diagnosed chronic disease had higher likelihood of utilizing preventive care services. Household income was the most important factor accounting for 26.6% of urban–rural disparities in utilization of preventive care services, followed by education (21.5%), self-perceived illness in last 4 weeks (7.8%), hypertension (4.4%), diabetes (3.3%), other chronic diseases (0.8%), and health insurance (−1.0%). Efforts to reduce financial barriers for low-income individuals who cannot afford preventive services, increasing awareness of the importance of obtaining preventive health services and providing more preventive health services covered by health insurance, may help to reduce the gap of preventive care services utilization between urban and rural.