Performance and views of examiners in the Applied Knowledge Test for the nMRCGP licensing examination

Siriwardena, Aloysius Niroshan; Dixon, Hilton; Blow, Carol; Irish, Bill; Milne, Paul

doi:10.3399/bjgp09x395111

Cited by 8 publications

(5 citation statements)

References 16 publications

Supporting

Mentioning

Contrasting

Order By: Relevance

“…In the NL and the UK there is robust evidence for the reliability and validity of the different assessment methods, whereas there is less evidence for the assessment methods used in DE, DK and PL [ 9 ], [ 10 ], [ 11 ], [ 12 ], [ 13 ], [ 14 ], [ 15 ], [ http://www.rcgp.org.uk cited 2014 August 12]. The process of qualification of examiners differs also from only formal qualifications of examiners in DE, to facultative trainers’ courses in PL and mandatory trainers’ courses in DK, the NL and the UK.…”

Section: Resultsmentioning

confidence: 99%

“…Evidence published to date validates the knowledge test, the communication skills test and the competency assessment list, “Compass” in the NL [ 9 ], [ 10 ], [ 11 ], [ 12 ], [ 13 ] and assessment methods in the UK [ 14 ], [ 15 ], [ [http://www.rcgp.org.uk cited 2014 August 12]. Otherwise, many FM assessment methods have been reported in scattered surveys, although final conclusions or recommendations are yet to emerge [ 16 ].…”

Section: Discussionmentioning

confidence: 99%

See 1 more Smart Citation

Assessing family medicine trainees – what can we learn from the European neighbours?

Flum

Maagaard

Godycki-Cwirko

et al. 2015

GMS Zeitschrift Für Medizinische Ausbildung; 32(2):Doc21; ISSN 1860-3572

View full text Add to dashboard Cite

Section: Resultsmentioning

confidence: 99%

Section: Discussionmentioning

confidence: 99%

Assessing family medicine trainees – what can we learn from the European neighbours?

Flum

Maagaard

Godycki-Cwirko

et al. 2015

GMS Zeitschrift Für Medizinische Ausbildung; 32(2):Doc21; ISSN 1860-3572

View full text Add to dashboard Cite

“…[28]2005Clinical reasoningSTFAEMUG,5Siriwardena, et al . [29]2009All disciplinesCFKCEMCQGGilmer, et al . [30]2003NursingCG, UGordon and Eisenberg[31]1987Pulmonary MedicineSAKCCMUG, 3Devitt and Palmer[32]1998Clinical skillsCSK…”

Section: Appendix Imentioning

confidence: 99%

Systematic review of computer based assessments in medical education

Alamri

Ali

2016

Saudi J Med Med Sci

View full text Add to dashboard Cite

Medical schools, postgraduate training institutes, licensing and certification bodies have developed and implemented many new methods for accurate, reliable, and timely assessments of the competence of medical professionals and practicing physicians. The underlying objective of all these assessments is to not only evaluate the students’ learning and educational goals but also to establish the graduating individual's skills and professionalism. Computer based assessment (CBA) has emerged in recent years as a viable alternative to traditional assessment techniques. It has also infiltrated and influenced the medical curriculum where it has been employed for assessment tasks. This study presents how CBA offers pedagogical opportunities and analyzes its usage pattern over the past three decades. We examined 47 CBAs in medical education and analyzed several assessment components, including application area, assessment purpose, assessment type, assessment format, student level, and emphasized the interplay among these components. Our analysis determined that formative assessment is the most frequently used type and 75% of all assessment types employed used the multiple choice questions format.

show abstract

“…The AKT, in its new mode of delivery and as a licensing assessment, was piloted with volunteer practising GPs from the panel of MRCGP examiners, confirming the acceptability, feasibility and criterion validity of the AKT 14 .…”

Section: Comparison With Existing Literaturementioning

confidence: 99%

Quality assurance of the Applied Knowledge Test (AKT) of the MRCGP examination – an immediate post-test questionnaire evaluation of the candidates’ views

Dixon¹,

Blow²,

Milne

et al. 2015

Education for Primary Care

Self Cite

View full text Add to dashboard Cite

The AKT is a high-stakes computer-based test for licensing UK general practitioners (GPs) and forms part of the Membership of the Royal College of General Practitioners examinationThe AKT uses different question formats and consistently demonstrates high reliability Pre-trialling of new questions has been shown to be unnecessary due to a systematic process of test construction WHAT THIS WORK ADDSThere was a high response rate from candidates asked their views immediately after its completion.A computer based evaluation questionnaire immediately after each test enables candidates' views to be easily measured over time.Feedback from candidates completing the test suggested the assessment was valid and highlighted areas for improvement.Candidates identified training and knowledge needs particularly around research and practice administrationWe are not aware of any similar evaluation of a high-stakes postgraduate licensing examination SUGGESTIONS FOR FURTHER RESEARCHThe relationship between changes in the AKT and candidates' views of the assessment.Comparison of AKT performance in candidates who have had different experiences of general practice prior to or during specialty training. 3 AbstractThe Applied Knowledge Test (AKT) of the MRCGP examination is a computer-based assessment delivered three times a year. A computerised questionnaire, administered immediately after the test, sought candidates' views as part of the test evaluation.Of 1681 candidates taking the test 1418 (84%) responded. Most candidates believed that the test assessed their knowledge of problems relevant to general practice. Their feedback highlighted areas where improvements could be made.Candidates' views of postgraduate specialty medical examinations in the UK are rarely sought or published. We are not aware of other published evidence.The use of computer based testing enables immediate candidate feedback and can be used routinely to evaluate the test validity and formats.The views of candidates are an important component of quality assurance in reviewing the content, format and educational experience of a high stakes examination.

show abstract

Performance and views of examiners in the Applied Knowledge Test for the nMRCGP licensing examination

Cited by 8 publications

References 16 publications

Assessing family medicine trainees – what can we learn from the European neighbours?

Assessing family medicine trainees – what can we learn from the European neighbours?

Systematic review of computer based assessments in medical education

Quality assurance of the Applied Knowledge Test (AKT) of the MRCGP examination – an immediate post-test questionnaire evaluation of the candidates’ views

Contact Info

Product

Resources

About