Video training and certification program improves reliability of postischemic neurologic deficit measurement in the rat

Abstract

Scoring systems are used to measure behavioral deficits in stroke research. Video-assisted training is used to standardize stroke-related neurologic deficit scoring in humans. We hypothesized that a video-assisted training and certification program can improve inter-rater reliability in assessing neurologic function after middle cerebral artery occlusion in rats. Three expert raters scored neurologic deficits in post-middle cerebral artery occlusion rats using three published systems having different complexity levels (3, 18, or 48 points). The system having the highest point estimate for the correlation between neurologic score and infarct size was selected to create a video-assisted training and certification program. Eight trainee raters completed the video-assisted training and certification program. Inter-rater agreement (i score) and agreement with expert consensus scores were measured before and after video-assisted training and certification program completion. The 48-point system correlated best with infarct size. Video-assisted training and certification improved agreement with expert consensus scores (pretraining ¼ 65 AE 10, posttraining ¼ 87 AE 14, 112 possible scores, P < 0.0001), median number of trainee raters with scores within AE2 points of the expert consensus score (pretraining ¼ 4, posttraining ¼ 6.5, P < 0.01), categories with i > 0.4 (pretraining ¼ 4, posttraining ¼ 9), and number of categories with an improvement in the i score from pretraining to posttraining (n ¼ 6). Video-assisted training and certification improved trainee inter-rater reliability and agreement with expert consensus behavioral scores in rats after middle cerebral artery occlusion. Video-assisted training and certification may be useful in multilaboratory preclinical studies.

Activation of the ATF6 branch of the unfolded protein response in neurons improves stroke outcome

“…To extensively evaluate functional outcome at this early recovery interval after stroke, we used a 48-point scoring system that consists of 14 categories, and includes several behavioral tests. 19 After testing, ATF6-KI mice showed better neurologic function (Figure 3(c); p = 0.0002). Together, our findings demonstrated that the ATF6 UPR branch plays an important role in protection of the brain from ischemic damage and in restoration of neurologic function impaired by ischemia.…”

“…Neurologic assessment was performed at 24 h post MCAO using a 48-point scoring system as recently detailed. 19 Before evaluation, an observer who was blind to the genotype of the animals completed the video-assisted training and certification program in order to standardize the scoring process. This comprehensive scoring system evaluates general status (spontaneous activity, body symmetry, gait; 0–12), simple motor deficit (forelimb asymmetry, circling, hind limb placement; 0–14), complex motor deficit (vertical screen climbing, beam walking; 0–8), and sensory deficit (hind limb, trunk, vibrissae, and face touch; 0–14).…”

A novel evaluation of two related and two independent algorithms for eye movement classification during reading

“…They studied the reliability of experienced oculomotor researchers at a single point in time, without any rater training or consensus discussions. There is a very large literature on the beneficial effects of rater training (Abaza & Ross, 2009;Abbo, Okello, & Nakku, 2013;Alcott, Swann, & Grafham, 1999;Angkaw, Tran, & Haaga, 2006;Bank et al, 2002;Buijze, Guitton, van Dijk, Ring, & the Science of Variation Group, 2012;Chan & Yiu, 2002;Chapman et al, 2016;Cusick, Vasquez, Knowles, & Wallen, 2005;Degenhardt, Snider, Snider, & Johnson, 2005;Haj-Ali & Feil, 2006;Istriana et al, 2013;Iwarsson & Reinholt Petersen, 2012;Lievens, 2001;Lou et al, 2014;Lundh, Kowalski, Sundberg, & Landen, 2012;Magnan & Maklebust, 2009;Mist, Ritenbaugh, & Aickin, 2009;Rosen et al, 2008;Sattler, McKnight, Naney, & Mathis, 2015;Schredl, Burchert, & Gabatin, 2004;Solah et al, 2015;Staelens et al, 2014;Store-Valen et al, 2015;Taninishi et al, 2016). There is also a literature on the beneficial effects of having consensus discussions and employing consensus guidelines (Beerbaum et al, 2009;Degenhardt et al, 2005;Foppen, van der Schaaf, Beek, Verkooijen, & Fischer, 2016;Iwarsson & Reinholt Petersen, 2012;Meade et al, 2000;Weinstock et al, 2001).…”

ROS-responsive exogenous functional mitochondria can rescue neural cells post-ischemic stroke

“…For neurological scores, a 48-point scoring system was used to evaluate neurological deficits, as detailed previously (Taninishi et al, 2016;Wang Y. C. et al, 2020). Briefly, this comprehensive scoring system assesses general status, motor deficits, and sensory deficits.…”