Most Significant Change in conflict settings: staff development through monitoring and evaluation

Kraft, Kathryn; Prytherch, Hannah

doi:10.1080/09614524.2016.1114591

Cited by 10 publications

(6 citation statements)

References 16 publications

Supporting

Mentioning

Contrasting

Order By: Relevance

“…There is an increasing body of research that presents the lessons learnt from the use of MSC (Choy & Lidstone 2013;Hall 2014;Kraft & Prytherch 2016;Wilder & Walpole 2008;Willetts & Crawford 2007;Wrigley 2006).…”

Section: The Most Significant Change Techniquementioning

confidence: 99%

“…Low-density areas in cities make transport networks extremely inefficient, resulting in high transport costs and long commuting hours, according to the Government Technical Advisory Centre (Republic of South Africa 2013:1), which has determined that '[t]he higher costs, combined with affordability constraints, mean that passenger fares tend to cover a smaller proportion of the operating costs of public transport in South African cities'. To cover operating cost, government spent nearly R140 billion on public transport subsidies in major cities between 2012and 2016 (Republic of South Africa 2013. Subsidisation is mostly through the conditional Public Transport Operations Grant (PTOG) that 'subsidise public transport services in poor communities thus making these services accessible and affordable' (Republic of South Africa 2017:112).The Western Cape Department of Transport and Public Works (DTPW) 'is responsible for the management and administration of road-based subsidised public transport and the associated PTOG allocation' (Western Cape Government 2017a:52).…”

mentioning

confidence: 99%

See 1 more Smart Citation

Benefits of transport subsidisation: Comparing findings from a customer perception survey and Most Significant Change Technique interviews

Rabie

Burger

2019

African Evaluation Journal

View full text Add to dashboard Cite

BackgroundPre-1994 spatial development policies that separated racial groups into geographically segregated neighbourhoods left South Africa with sprawling cities that increase the cost of public service delivery. Low-density areas in cities make transport networks extremely inefficient, resulting in high transport costs and long commuting hours, according to the Government Technical Advisory Centre (Republic of South Africa 2013:1), which has determined that '[t]he higher costs, combined with affordability constraints, mean that passenger fares tend to cover a smaller proportion of the operating costs of public transport in South African cities'. To cover operating cost, government spent nearly R140 billion on public transport subsidies in major cities between 2012and 2016 (Republic of South Africa 2013. Subsidisation is mostly through the conditional Public Transport Operations Grant (PTOG) that 'subsidise public transport services in poor communities thus making these services accessible and affordable' (Republic of South Africa 2017:112).The Western Cape Department of Transport and Public Works (DTPW) 'is responsible for the management and administration of road-based subsidised public transport and the associated PTOG allocation' (Western Cape Government 2017a:52). Department of Transport and Public Works applies the PTOG to subsidise bus services in the City of Cape Town through financial support to Golden Arrow Bus Services (GABS) (Western Cape Government 2017a). Golden Arrow Background: An evaluation of a transport subsidisation programme in the Western Cape, South Africa, was undertaken to capture the outcomes and benefits of the service from the perspective of the bus user.Objectives: The objective of this article was to compare the findings from the adopted parallel mixed-methods design that included a perception survey and the Most Significant Change (MSC) technique. The article presented the advantages of each approach and reflected on the benefits and challenges in applying the MSC technique.Method: Data on the intended outcomes of the Provincial Transport Operations Grant programme were collected from 458 commuters on four bus routes through a structured close-ended questionnaire. The MSC technique was applied to collect 69 stories of change that captured changes regarded as most significant by beneficiaries of the public transport subsidy.Results: It was found that the survey better captured the intended and predetermined objectives of the programme, while the large response group allowed for comparisons and cross-tabulations. The MSC interviews better captured the real-life experience of participants and identified the benefits most valued by commuters, including outcomes not specifically anticipated by the programme. It also served to clarify contradicting responses or ratings on the closed-ended questionnaire and informed further bivariate analysis of the structured questionnaire data. Conclusion:To maximise benefits from the MSC technique, sufficient time is needed to solicit value responses f...

show abstract

Section: The Most Significant Change Techniquementioning

confidence: 99%

mentioning

confidence: 99%

Benefits of transport subsidisation: Comparing findings from a customer perception survey and Most Significant Change Technique interviews

Rabie

Burger

2019

African Evaluation Journal

View full text Add to dashboard Cite

show abstract

“…3–5 We could find no literature applying the MSC to the evaluation of faculty development programs in health professions education. We believe our interpretation of the MSC fits with the developers’ invitation to innovate and refine the technique in other fields and local contexts.…”

Section: Problemmentioning

confidence: 99%

Evaluating the Impact of the Medical Education Partnership Initiative at the University of Zimbabwe College of Health Sciences Using the Most Significant Change Technique

et al. 2017

View full text Add to dashboard Cite

Problem In medical education, evaluating outcomes from programs intended to transform attitudes or influence career trajectories using conventional methods of monitoring is often difficult. To address this problem, the authors adapted the most significant change (MSC) technique to gain a more comprehensive understanding of the impact of the Medical Education Partnership Initiative (MEPI) program at the University of Zimbabwe College of Health Sciences. Approach In 2014–2015, the authors applied the MSC to systematically examine the personal significance and level of positive transformation individuals attributed to their MEPI participation. Interviews were conducted with 28 participants nominated by MEPI program leaders. The authors coded results inductively for prevalent themes in participants’ stories and prepared profiles with representative quotes to place the stories in context. Stakeholders selected 9 themes and 18 stories to illustrate the most significant changes. Outcomes Six themes (or outcomes) were expected, as they aligned with MEPI goals—becoming a better teacher, becoming a better clinician, increased interest in teaching, increased interest in research, new career pathways (including commitment to practice in Zimbabwe), and improved research skills. However, three themes were unexpected—increased confidence, expanded interprofessional networks, and improved interpersonal interactions. Next Steps We found the MSC to be a useful and systematic evaluation approach for large, complex, and transformative initiatives like MEPI. The MSC seemed to encourage participant reflection, support values inquiry by program leaders, and provide insights into the personal and cultural impacts of MEPI. Additional trial applications of the MSC technique in academic medicine are warranted.

show abstract

“…Development research [ 11 , 12 ], conservation [ 13 , 14 ] and education [ 15 – 17 ] have integrated local narratives into evaluation for decades. The Most Significant Change (MSC) technique can document how people experience complex interventions [ 18 ].…”

Section: Introductionmentioning

confidence: 99%

How beneficiaries see complex health interventions: a practice review of the Most Significant Change in ten countries

et al. 2021

View full text Add to dashboard Cite

Background The Most Significant Change is a story-based evaluation approach used in many international development programs. This practice review summarises practical experience with the approach in complex health interventions in ten countries, with the objective of making it more accessible in evaluation of other complex health interventions. Results Participatory research practitioners and trainees discussed five themes following brief presentations by each of the seven attendees who led the exercise: (i) sampling and recruitment; (ii) phrasing the questions to elicit stories; (iii) story collection strategies; (iv) quality assurance; and (v) analysis. Notes taken during the meeting provided the framework for this article. Recruitment strategies in small studies included universal engagement and, in larger studies, a purposive, systematic or random sampling. Meeting attendees recommended careful phrasing and piloting of the question(s) as this affects the quality and focus of the stories generated. They stressed the importance of careful training and monitoring of fieldworkers collecting stories to ensure full stories are elicited and recorded. For recording, in most settings they preferred note taking with back-checking or self-writing of stories by story tellers, rather than audio-recording. Analysis can combine participatory selection of a small number of stories, deductive or inductive thematic analysis and discourse analysis. Meeting attendees noted that involvement in collection of the stories and their analysis and discussion had a positive impact for research team members. Conclusions Our review confirms the plasticity, feasibility and acceptability of the Most Significant Change technique across different sociopolitical, cultural and environmental contexts of complex interventions. Although the approach can surface unexpected impacts, it is not a 360-degree evaluation. Its strength lies in characterising the changes, where these happen, in the words of the beneficiaries. We hope this distillation of our practice makes the technique more readily available to health sector researchers.

show abstract

Most Significant Change in conflict settings: staff development through monitoring and evaluation

Cited by 10 publications

References 16 publications

Benefits of transport subsidisation: Comparing findings from a customer perception survey and Most Significant Change Technique interviews

Benefits of transport subsidisation: Comparing findings from a customer perception survey and Most Significant Change Technique interviews

Evaluating the Impact of the Medical Education Partnership Initiative at the University of Zimbabwe College of Health Sciences Using the Most Significant Change Technique

How beneficiaries see complex health interventions: a practice review of the Most Significant Change in ten countries

Contact Info

Product

Resources

About