Reflections on conducting evaluations for rural development interventions in China

Luo, Lixin; Liu, Lin

doi:10.1016/j.evalprogplan.2014.06.004

Cited by 9 publications

(5 citation statements)

References 6 publications

Supporting

Mentioning

Contrasting

Order By: Relevance

“…Program theory requires analyzing a complex chain of causality, often not adequately spelled out much less subject to rigorous evaluation ( Forss, Marra, & Schwartz, 2011 ). Others who have evaluated complex rural development interventions ( Luo & Liu, 2014 ) have also commented on these challenges.…”

Section: Introductionmentioning

confidence: 99%

Planning an integrated agriculture and health program and designing its evaluation: Experience from Western Kenya

Cole

Levin

Loechl

et al. 2016

Evaluation and Program Planning

View full text Add to dashboard Cite

HighlightsComplex, integrated development programs present planning and evaluation challenges and opportunities.Multiple evaluation components are needed to respond to different disciplinary cultures of evidence in cross-sectoral programs.Delineating impact pathways helps visualize cross-sectoral outcomes and guides implementation monitoring.Feedback meetings are critical to build understanding across sectors and problem-solve in real time.

show abstract

Section: Introductionmentioning

confidence: 99%

Planning an integrated agriculture and health program and designing its evaluation: Experience from Western Kenya

Cole

Levin

Loechl

et al. 2016

Evaluation and Program Planning

View full text Add to dashboard Cite

show abstract

“…A thorough analysis and synthesis of local conditions and applicable lessons learned from evaluations of similar initiatives should be the starting point for developing a solid theory of change (Mahmoud et al 1978). The design and implementation of evaluation mechanisms should consider the national context since they help yield relevant and meaningful data (Luo and Liu 2014). Culturally responsive evaluation enhances the quality of assessment while also promoting equity and fairness.…”

Section: Post-implementation Phase A) Independent Evaluationmentioning

confidence: 99%

Barriers Affecting the Effectiveness of Digital Literacy Training Programs (DLTPs) for Marginalised Populations: A Systematic Literature Review

Choudhary

Bansal

2022

JTET

View full text Add to dashboard Cite

The governments and private sectors have taken several national or regional digital literacy training programs (DLTPs) to mitigate digital inequalities. However, there are noticeable differences in impact and outcomes produced by programs. Since digital literacy is essential for any technical vocational education and training (TVET), this study explores possible barriers influencing the effectiveness of DLTPs at different level levels. Relevant publications were synthesized and coded using a systematic literature review to link main research findings with specific barrier categories. It was found that at the administrative level, policy planning and administrative designing, whereas at the training level, infrastructure followed by training and pedagogy emerged as the most critical determinants for the effectiveness of DLTPs. At an individual level, lack of family support significantly affect learning behaviour. A strategic model for the effective implementation of DLTPs is provided. This study constitutes an essential input for research on the digital literacy training literature providing educators and program stakeholders with a reinforced understanding of various ways to manage DLTPs at different levels. Consequently, it closes some identified knowledge gaps and offers additional insights to improve the DLTPs performance at the community level.

show abstract

“…• Tremblay and Gutberlet (2010) show how community outreach, capacity building, and interviews helped in tandem over time to improve a recycling project. • Luo and Liu (2014) argue that cultural awareness and touching base with local cultural differentiation are extremely important, and that contextually wellgrounded participatory research will help make the interventions effective. • Nathan et al (2013, p. 3) used a "Research Reference Group comprising representatives from grant partners and participating schools formally … to advise on proposed study measures and recruitment of study participants."…”

Section: Rebutting Three Misunderstandingsmentioning

confidence: 99%

Bridging to Action Requires Mixed Methods, Not Only Randomised Control Trials

Olsen

2019

Eur J Dev Res

View full text Add to dashboard Cite

Development evaluation refers to evaluating projects and programmes in development contexts. Some evaluations are too narrow. Narrow within-discipline impact evaluations are weaker than multidisciplinary, mixed-methods evaluations. A twostep process leads toward profoundly better arguments in assessing the impact of a development intervention. The first step is setting out the arena for discussion, including what the various entities are in the social, political, cultural and natural environment surrounding the chosen problem. The second step is that, once this arena has been declared, the project and triangulation of data can be brought to bear upon logical arguments with clear, transparent reasoning leading to a set of conclusions. In this second step, we do need scientific methods such as peer review, data and so on, but, crucially, the impact evaluation process must not rest upon a single data type, such as survey data. It is dangerous and undesirable to have the entire validity of the conclusions resting upon randomised control trials, or even a mixture of data types. Different contributions to knowledge exist within the evaluation process, including the interaction of people during action research, ethnography, case-study methods, process tracing and qualitative methods. The cement holding my argument together is that multiple logics are used (retroductive, deductive, and inductive, in particular). Deductive mathematics should not dominate the evaluation of an intervention, as randomised controlled trials on their own lend themselves to worrying fallacies about causality. I show this using Boolean fuzzy set logic. An indicator of high-quality development evaluation is the use of multiple logics in a transparent way. Keywords Evaluation • Randomised control trials • Comparative case-study research • Methodology • Retroduction • Mixed-methods • Impact evaluation Resume L'évaluation du développement se réfère à l'évaluation de projets et programmes dans le contexte du développement. Certaines évaluations sont trop restreintes. Les évaluations étroites, au sein de la même discipline, sont plus faibles que les évalua-Extended author information available on the last page of the article terventions en matière de développement, un procédé a deux étapes nous aide à bâtir des argumentations beaucoup plus fortes. La première étape est d'établir l'espace de la discussion, y compris les organismes sociales, politiques, culturales et naturels qui encerclent le problème choisi. La deuxième étape, une fois cet espace est défini, est d'utiliser le projet et la triangulation des données de forme logique, produisant un raisonnement transparent et clair qui nous amène à des conclusions. Cette deuxième étape nécessite de méthodologies scientifiques tels que la révision par des pairs, l'utilisation des données, etc. C'est crucial que le processus d'évaluation des impacts ne s'appuie pas que sur un seul type de données, comme par exemple les données d'enquête. Que l'ensemble de la validité des conclusions soit basé que sur des e...

show abstract

Reflections on conducting evaluations for rural development interventions in China

Cited by 9 publications

References 6 publications

Planning an integrated agriculture and health program and designing its evaluation: Experience from Western Kenya

Planning an integrated agriculture and health program and designing its evaluation: Experience from Western Kenya

Barriers Affecting the Effectiveness of Digital Literacy Training Programs (DLTPs) for Marginalised Populations: A Systematic Literature Review

Bridging to Action Requires Mixed Methods, Not Only Randomised Control Trials

Contact Info

Product

Resources

About