The Residency and Immersion Program (PRIme) is an induction for new school principals serving their first year. PRIme was implemented in 2014, and it requires a comprehensive evaluation for program improvement. Hence, this study aims to assess the validity and reliability of the PRIme assessment instrument. The assessment data of content validity by professional experts and face validity by new principals were analyzed using CVR, CVI, and FVI methods. Meanwhile, pilot study data was obtained from 53 respondents and further analyzed using the Rasch measurement model. The questionnaire includes 102 items for assessing the domains of input (courses, coaching, and mentoring), process (type of leadership practiced), and product (leadership and organizational management) in the implementation of PRIme. The Rasch analysis results showed that the items in the questionnaire have good content validity, construct validity, and reliability. Therefore, the Rasch analysis has proven that this questionnaire can be used as an instrument to assess PRIme in an effort to enhance the quality of new principals in Malaysia.