Development and Initial Validation of the Intake Objective-Structured Clinical Examination

Development and preliminary testing of a virtual reality measurement for assessing intake assessment skills

“…The design of the VSP station was based on a depression case of standardised vignettes, following the diagnosis of DSM‐5 criteria. Modified from the standardised patient station of the Intake OSCE (Lan et al, 2015), we created a new VSP named “YoYo” to interact with participants and assess their PACs during the intake assessment. YoYo is a young woman suffering from major depressive disorder and seeks help from psychologists at a local hospital.…”

“…The initial development of the VSP‐Intake OSCE consists of a 20‐minute VSP station and a 40‐minute follow‐up written station to measure PACs required for master's‐level psychologists during an intake assessment. Based on the Intake OSCE developed by Lan et al (2015), we modified this test and created its VSP version to ensure the content validity of the VSP‐Intake OSCE. In the initial stage of VSP implementations, we included eight of the 10 competency domains (see Table 2) from the Intake OSCE into the VSP‐Intake OSCE.…”

“…Participants' performances on the VSP station were evaluated based on the scoring sheet of the VSP station by three licensed psychologists who received an OSCE rater training from the first author. The scoring sheet of the VSP station was modified from the scoring sheet of the standardised patient station developed by Lan et al (2015). It contained two domains, “history taking” and “communication skills.” Each domain score ranges from 0 to 100.…”

“…The use of OSCEs for teaching and assessment has gone from being a questionable idea to being well‐accepted by faculty members and students for high‐fidelity simulation of clinical scenarios (Hodges et al, 2014). In the past 10 years, OSCEs have been gradually adopted in professional psychology as suitable competency‐based assessments to measure student competencies in motivational interviewing (Roberts et al, 2020); psychological assessment (Lan et al, 2015; Sheen et al, 2015; Yap et al, 2012); and psychological intervention (Yap et al, 2012). OSCEs have also been integrated into psychology curricula to promote competency‐based training to enhance student learning (Roberts et al, 2020).…”

“…This nine‐factor model was in line with Wright's (2022) model to contain essential PACs (e.g., knowledge of psychological testing, technical assessment skills and interpersonal relationship) for master's‐level psychologists to provide high‐quality assessment services in practice. These domains were also included in Lan et al's (2015) study to examine master's‐level students' competencies in psychological assessment. Lan et al followed Hodges et al's (2002) suggestions to develop a new objective structured clinical examination (OSCE) for assessing PACs of master's‐level psychologists when conducting an intake assessment.…”