Students' performance during practical examination on whole slide images using view path tracking

Abstract

BackgroundWhole slide images (WSIs) used in medical education can provide new insights into how histological slides are viewed by students. We created software infrastructure which tracks viewed WSI areas, used it during a practical exam in oral pathology and analyzed collected data to discover students’ viewing behavior.MethodsA view path tracking solution, which requires no specialized equipment, has been implemented on a virtual microscopy software platform (WebMicroscope, Fimmic Ltd, Helsinki, Finland). Our method dynamically tracks view paths across the whole WSI area and all zoom levels, while collecting the viewing behavior data centrally from many simultaneous WSI users. We used this approach during the exam to track how all students (N = 88) viewed WSIs (50 per student) when answering exam questions (with no time limit). About 74,000 records with information about subsequently displayed WSI areas were saved in the central database. Gathered data was processed and analyzed in multiple ways. Generated images and animations showed view fields and paths marked on WSI thumbnails, either for a single student or multiple students answering the same question. A set of statistics was designed and implemented to automatically discover certain viewing patterns, especially for multiple students and WSIs. Calculated metrics included average magnification level on which a WSI was displayed, dispersion of view fields, total viewing time, total number of view fields and a measure depicting how much a student was focused on diagnostic areas of a slide.ResultsGenerated visualizations allowed us to visually discover some characteristic viewing patterns for selected questions and students. Calculated measures confirmed certain observations and enabled generalization of some findings across many students or WSIs. In most questions selected for the analysis, students answering incorrectly tended to view the slides longer, go through more view fields, which were also more dispersed – all compared to students who answered the questions correctly.ConclusionsDesigned and implemented view path tracking appeared to be a useful method of uncovering how students view WSIs during an exam in oral pathology. Proposed analysis methods, which include visualizations and automatically calculated statistics, were successfully used to discover viewing patterns.Virtual slidesThe virtual slide(s) for this article can be found here: http://www.diagnosticpathology.diagnomx.eu/vs/13000_2014_208Electronic supplementary materialThe online version of this article (doi:10.1186/s13000-014-0208-6) contains supplementary material, which is available to authorized users.

Dermatopathology education in the era of modern technology

“…More than just a solid teaching modality (either as an online database or integration into a formalized atlas), VM has the unique capability to serve as an important research tool in furthering educational endeavors in DP and pathology. Notably, assessment of learning can be extended to investigate how users “interact” with digital images—evaluating slide exploration strategies, perceptual information gathering, and cognitive decision‐making of both trainees and expert pathologists . As histopathology is a visual discipline at its core, the skilled interpretation of slides is dependent on the honing of visual perception and processing, and pattern recognition skills over time.…”

“…In this way, VM can help to identify “biomarkers of expertise” and more objectively assess differences in image search patterns between novices and skilled pathologists—for example, which perceptual and cognitive mechanisms are active, in addition to how visual expertise is acquired and improved over time. By incorporating “tracking tools” with VM technologies, educators can more effectively monitor their trainees’ progress, and enhance learning through focused instruction and feedback . Simplistically, experts develop a “recognize/detect‐then‐search” approach to slide/image review—“after quick recognition of relevant patterns, the rest of the image is scanned for anything that contradicts schema.” Compared with novices, who typically use “search‐then‐detect” methods, experts are known to show different types of eye movements, spend more time at lower magnifications, fixate less on irrelevant features, show fewer panning and zooming movements, and make quicker and more accurate diagnoses .…”

Técnicas de ensino e atividades em sala de aula para disciplina de patologia na graduação: revisão de literatura / Teaching techniques and classroom activities for the pathology course on undergraduate programs: a literature review

“…Foi utilizado um software que era capaz de quantificar o tempo que o aluno permaneceu em cada lâmina, além da quantidade de vezes que necessitou mudar o aumento e a extensão dos campos analisados. Constatou-se que aqueles que demoravam mais e lançavam mão de mais campos para tentar chegar à resposta da questão acabavam por respondê-la erroneamente (22) .…”

Emerging Themes in Image Informatics and Molecular Analysis for Digital Pathology

“…Recently, researchers introduced an Internet-based training tool called Score the Core, which employs tissue microarrays to train pathologists to visually score estrogen receptor, progesterone receptor (percent positive), and Ki-67 (percent positive) (80). A software infrastructure for tracking viewed regions in WSI and, using the regions tracked during a practical exam in oral pathology (81), analyzed the collected data to discover students' viewing behavior.…”