We examined data from a nationally implemented mentoring program over a 4‐year period, to identify demographic and relationship characteristics associated with premature termination. Data were drawn from a sample of 82,224 mentor and mentees. We found matches who reported shared racial or ethnic identities were associated with lower likelihood of premature termination as was mentee's positive feelings of the relationship. We also found that, if data were used as a screening tool, the data were suboptimal for accuracy classifying premature closure with sensitivity and specificity values equal to 0.43 and 0.75. As programs and policymakers consider ways to improve the impact of mentoring programs, these results suggest programs consider the types of data being collected to improve impact of care.
School climate surveys have become widely used in U.S.schools, but there is little information on whether school leaders engage teachers and other staff in the process of reviewing and making use of survey results. This mixedmethods study examined staff interest, viewing, and use of survey results in a state that administers a school climate survey. Semistructured interviews with 15 staff members were conducted to gain insight into quantitative results from 16,525 staff members in 318 high schools. Survey data showed that although 84% of school staff were interested in seeing the results of their school climate survey, fewer than one-third reported seeing the results or using them for school planning or improvement. Administrators were more likely than teachers and other staff to have seen and used survey results. Content coding of the qualitative data elaborated on staff interest in reviewing and using climate data. These findings highlight the need for school leaders to collaborate with school staff on interpreting and using survey results for school climate improvement efforts.
Though much effort is often put into designing psychological studies, the measurement model and scoring approach employed are often an afterthought, especially when short survey scales are used (Flake & Fried, 2020). One possible reason that measurement gets downplayed is that there is generally little understanding of how calibration/scoring approaches could impact common estimands of interest, including treatment effect estimates, beyond random noise due to measurement error. Another possible reason is that the process of scoring is complicated, involving selecting a suitable measurement model, calibrating its parameters, then deciding how to generate a score, all steps that occur before the score is even used to examine the desired psychological phenomenon. In this study, we provide three motivating examples where surveys are used to understand individuals' underlying social emotional and/or personality constructs to demonstrate the potential consequences of measurement/scoring decisions. These examples also mean we can walk through the different measurement decision stages and, hopefully, begin to demystify them. As we show in our analyses, the decisions researchers make about how to calibrate and score the survey used has consequences that are often overlooked, with likely implications both for conclusions drawn from individual psychological studies and replications of studies.
School-based mentoring programs are one of the most popular types of prevention programs offered to support students' social-emotional and academic success. Because a high-quality mentoring relationship is thought to be a mechanism for improving youth outcomes, we investigated how mentor-and menteerelationship quality develops over time. In addition, we examined how relationship development varied as a function of three approaches to selecting mentoring activities (i.e., mentor-directed, program-directed, or jointly determined). We used a random-intercepts crossed-lagged panel model to test how mentor and mentee reports of relationship quality developed over three time points across one school year. Data were gathered from 2014 to 2018 and included 47,699 youth (56% female; 51% Black or Hispanic) who participated in Big Brothers Big Sisters-which provides school-based mentoring services to youth across the U.S. Results indicated that mentors' positive appraisals of the mentoring relationships led to positive appraisals from the mentee at the subsequent time point. In addition, when mentors and mentees jointly determined activities, we found evidence that mentors' and mentees' positive appraisals at one time point led to positive appraisals at the following time point. These results suggest that school-based mentoring programs should consider ways to support joint decision-making among mentors and mentees participating in school-based mentoring programs. Impact and ImplicationsThis study found that mentors and mentees participating in school-based mentoring programs tended to report stronger relationships over time when they reported making decisions jointly.
National interest in using school climate as an accountability measure makes it important to understand how school leaders view and make use of school climate data. The purpose of this study was to investigate how school and district administrators use climate data in Virginia, where a statewide school climate survey is annually administered. School principals ( N = 283) completed surveys concerning their use of the school climate results for their school. Simultaneously, semi-structured interviews were conducted with school division leaders and school administrators ( N = 10) to deepen our understanding of how the school climate results were being used. Qualitative content analysis was used to identify patterns in the data. Study results reflect a consensus by educational leaders on the utility of receiving school climate data in order to make data-based decisions to improve outcomes for students. Participants provided thoughtful and constructive feedback on the importance of student relationships, perceptions of student subgroups, comparing their data with other schools, and ways to facilitate data-based decision-making. Participants also expressed a desire for additional support in understanding statistical results and generating recommendations for school improvement. These findings suggest that increasing the clarity and comprehensiveness of school climate data reports and providing support for interpreting the results will increase educational leaders’ ability to use school climate surveys.
scite is a Brooklyn-based organization that helps researchers better discover and understand research articles through Smart Citations–citations that display the context of the citation and describe whether the article provides supporting or contrasting evidence. scite is used by students and researchers from around the world and is funded in part by the National Science Foundation and the National Institute on Drug Abuse of the National Institutes of Health.
hi@scite.ai
10624 S. Eastern Ave., Ste. A-614
Henderson, NV 89052, USA
Copyright © 2024 scite LLC. All rights reserved.
Made with 💙 for researchers
Part of the Research Solutions Family.