Evaluating leadership development using the Most Significant Change technique

Choy, Sarojni; Lidstone, John

doi:10.1016/j.stueduc.2013.09.001

Cited by 15 publications

(17 citation statements)

References 18 publications

(18 reference statements)

Supporting

Mentioning

Contrasting

Order By: Relevance

“…Based on Mthoko and Khene () evaluated opinion, quantifying MSC needs participatory approach that attempts to develop understanding from the important trials and measures that have happened instead of using preidentified indicators. Whilst MSC is participatory at every level, focusing on the importance of analysis and not just information collection is critical (Johnston, ), since traditional evaluation tools do not allow this level of in‐depth criticality (Choy & Lidstone, ). MSC produces diverse, unexpected, and emergent impacts from a community's perspectives, which might not be catered for using other orthodox research approaches based on success related prestated indicators (Tabassum & Yeo, ).…”

Section: Methodsmentioning

confidence: 99%

The indirect and intangible impacts of a telecentre on a rural community

Tabassum

Kulathuramaiyer

Harris

et al. 2019

E J Info Sys Dev Countries

View full text Add to dashboard Cite

The paper explores the impact of a telecentre on the community living in Bario, a small village in the highlands of Malaysian Borneo. Specifically, it addresses indirect and intangible impacts on non-users of telecentre. Thus, far most research studies have primarily focused on direct and tangible impacts of telecentre on its users whilst impact on non-users is least covered and understood. Consequently, it was equally essential to study the concept of unquantifiable intangible impacts experienced by the non-users. Sen's "Capability Approach" (CA) was adopted to understand the impact of telecentre on human development. "The Most Significant Change" (MSC) was employed as a tool for collecting data in the form of stories from the telecentre users and non-users. The process involved gathering stories about the telecentre impact from the Bario community people. The MSC stories with significance relevance were identified and selected with the help of the community. Those were then analysed using the content analysis technique and Leximancer to identify the patterns of change experienced by the respondents. The results of the study on the whole suggests that the Bario community has benefited from the use of the telecentre, both directly and indirectly, including intangible impacts such as connectedness, a sense of belongingness, strengthened social ties, and psychological empowerment (selfesteem and self-efficacy). The theoretical approach together with methodological approach provided a base for understanding ways to conceptualize the development and determine the ways in which telecentre contributed directly or indirectly to the social and economic development of the community inhabitants.

show abstract

Section: Methodsmentioning

confidence: 99%

The indirect and intangible impacts of a telecentre on a rural community

Tabassum

Kulathuramaiyer

Harris

et al. 2019

E J Info Sys Dev Countries

View full text Add to dashboard Cite

show abstract

“…This practice review summarizes practical experience of five aspects of using MSC in participatory health initiatives in different settings, including recruitment (who contributes stories), the questions asked, mechanics of story collection, quality control and analysis. The Montreal meeting echoed some issues already raised in the MSC literature outside of the health sector [ 13 , 17 , 18 ]. There is already ample recognition of the value of careful training of fieldworkers and the value of regular quality checks during MSC stories data collection [ 34 ].…”

Section: Discussionmentioning

confidence: 98%

“…Development research [ 11 , 12 ], conservation [ 13 , 14 ] and education [ 15 – 17 ] have integrated local narratives into evaluation for decades. The Most Significant Change (MSC) technique can document how people experience complex interventions [ 18 ].…”

Section: Introductionmentioning

confidence: 99%

How beneficiaries see complex health interventions: a practice review of the Most Significant Change in ten countries

et al. 2021

View full text Add to dashboard Cite

Background The Most Significant Change is a story-based evaluation approach used in many international development programs. This practice review summarises practical experience with the approach in complex health interventions in ten countries, with the objective of making it more accessible in evaluation of other complex health interventions. Results Participatory research practitioners and trainees discussed five themes following brief presentations by each of the seven attendees who led the exercise: (i) sampling and recruitment; (ii) phrasing the questions to elicit stories; (iii) story collection strategies; (iv) quality assurance; and (v) analysis. Notes taken during the meeting provided the framework for this article. Recruitment strategies in small studies included universal engagement and, in larger studies, a purposive, systematic or random sampling. Meeting attendees recommended careful phrasing and piloting of the question(s) as this affects the quality and focus of the stories generated. They stressed the importance of careful training and monitoring of fieldworkers collecting stories to ensure full stories are elicited and recorded. For recording, in most settings they preferred note taking with back-checking or self-writing of stories by story tellers, rather than audio-recording. Analysis can combine participatory selection of a small number of stories, deductive or inductive thematic analysis and discourse analysis. Meeting attendees noted that involvement in collection of the stories and their analysis and discussion had a positive impact for research team members. Conclusions Our review confirms the plasticity, feasibility and acceptability of the Most Significant Change technique across different sociopolitical, cultural and environmental contexts of complex interventions. Although the approach can surface unexpected impacts, it is not a 360-degree evaluation. Its strength lies in characterising the changes, where these happen, in the words of the beneficiaries. We hope this distillation of our practice makes the technique more readily available to health sector researchers.

show abstract

“…An increasing body of research documents lessons-learned from use of MSC (Willetts and Crawford 2007, Hall 2014, Wilder and Walpole 2008, Wrigley 2006, Choy and Lidstone 2013, Kloosterman et al 2012. This paper is intended to add to that body of knowledge, with specific focus on MSC's usefulness for influencing staff and project development.…”

Section: History Methodology and Theory Of Most Significant Changementioning

confidence: 99%

Most Significant Change in conflict settings: staff development through monitoring and evaluation

Kraft¹,

Prytherch²

2015

Development in Practice

View full text Add to dashboard Cite

Abstract:Capoeira4Refugees is an NGO that uses the Afro-Brazilian art-form of Capoeira to promote psychosocial well-being in children affected by conflict and occupation. Capoeira4Refugees introduced the Most Significant Change (MSC) methodology to monitor and evaluate project implementation and impact across two locations in the Middle East. Analysis of interviews conducted with five field staff revealed that in line with, and building on previous research, MSC became an empowering tool that led to staff development. The potential for MSC to build staff reflexivity, independence and leadership has implications for other organisations working in conflict areas, particularly in situations of remote management.

show abstract

Evaluating leadership development using the Most Significant Change technique

Cited by 15 publications

References 18 publications

The indirect and intangible impacts of a telecentre on a rural community

The indirect and intangible impacts of a telecentre on a rural community

How beneficiaries see complex health interventions: a practice review of the Most Significant Change in ten countries

Most Significant Change in conflict settings: staff development through monitoring and evaluation

Contact Info

Product

Resources

About