Background: Critical thinking helps medical students and professionals overcome the effects of personal values and beliefs when exercising clinical judgment. The lack of effective instruments to measure critical thinking disposition in medical students has become an obstacle for training and evaluating students in undergraduate programs in China. The aim of this study was to evaluate the psychometric properties of the CTDA test.Methods: A total of 278 students participated in this study and responded the CTDA test. Cronbach’s a coefficient, internal consistency, test-retest reliability, floor effects and ceiling effects were measured to assess the reliability of the questionnaire. Construct validity of the pre-specified three-domain structure of the CTDA was evaluated by the confirmatory factor analysis (CFA). The concurrent validity, convergent validity and discriminant validity were also analyzed.Results: Cronbach’s alpha coefficient for the entire questionnaire was 0.923, all of the domains showed excellent internal consistency (0.814-0.861), and the test-retest reliability indicated acceptable intra-class correlation coefficients (ICCs) (0.710-0.795, p<0.01). The CFA demonstrated that the three-domain model fitted the data adequately. All dimensions were significantly correlated with the Self-assessment Scale on Active Learning and Critical Thinking (SSACT) and subscales (p<0.01), and the instrument showed satisfactory convergent and discriminant validity.Conclusions: The CTDA has acceptable psychometric characteristics and is a reliable and valid questionnaire to evaluate medical students’ disposition towards critical thinking in China. The CTDA could be applied in critical thinking programs and medical education research.