Internal and External Validity in Economics Research: Tradeoffs between Experiments, Field Experiments, Natural Experiments, and Field Data

Roe, Brian E.; Just, David R.

doi:10.1111/j.1467-8276.2009.01295.x

Cited by 176 publications

(104 citation statements)

References 5 publications

Supporting

Mentioning

Contrasting

Unclassified

Order By: Relevance

“…In this way, we increase the potential for players to learn about the real-life behaviour of one another through the role-play. Using the terminology of Roe and Just (2009), we increase our ecological validity to the extent that the context of the research is similar to the context of interest. As a consequence, the possibility to replicate our results is limited.…”

Section: Discussionmentioning

confidence: 99%

Congruence of appropriation and provision in collective water provision in Central Namibia

Falk

Lohmann

Azebaze

2016

International Journal of the Commons

View full text Add to dashboard Cite

Achieving cooperation in natural resource management is always a challenge when incentives exist for an individual to maximise her short term benefits at the cost of a group. We study a public good social dilemma in water infrastructure provision on land reform farms in Namibia. In the context of the Namibian land reform, arbitrarily mixed groups of livestock farmers have to share the operation and maintenance of water infrastructure. Typically, water is mainly used for livestock production, and livestock numbers are subject to high fluctuations due to the given environmental conditions. Our paper assesses how alternative payment systems with differing congruence of provision and appropriation support the cooperation in the group given the ever-changing equilibria. In a first step, we conducted an exploratory overview of the social-ecological system of central Namibian land reform projects. The Social Ecological System (SES) Framework served as a guideline for this assessment (Ostrom 2009). Taking the complexity of the cooperation situation into account, in the second step we designed a role-play that is based on a social-ecological simulation model. The role-play simulates the real-life decision situations of land reform beneficiaries wherein equilibria are permanently changing. This approach helped us to not only better understand the cooperation challenges of Namibian land reform beneficiaries, but also supported 72 Thomas Falk et al.stakeholders in their decision making and institution building. Our study provides evidence to support that land reform beneficiaries increase their contributions as they own more livestock and as other group members increase their payments. Nevertheless, only groups with relatively homogeneous livestock endowments manage to agree on payment rules. Interestingly, the dominant rule is an "equal payment per farmer" and not a "payment per head of livestock", though the latter would imply a higher congruence of provision and appropriation.

show abstract

Section: Discussionmentioning

confidence: 99%

Congruence of appropriation and provision in collective water provision in Central Namibia

Falk

Lohmann

Azebaze

2016

International Journal of the Commons

View full text Add to dashboard Cite

show abstract

“…This chain is parallel to another that spans a theoretical range of increasing "external validity" toward one end, and increasing "internal validity" toward the other (Mesoudi 2011;Roe and Just 2009). In archaeology, the artifactual record might be considered to have high "external validity": it is the most direct, empirical (i.e., tangible) evidence that we have of what actually took place in the past.…”

Section: What Is Stone-tool Replication?mentioning

confidence: 99%

Test, Model, and Method Validation: The Role of Experimental Stone Artifact Replication in Hypothesis-driven Archaeology

et al. 2016

View full text Add to dashboard Cite

“…On the other hand, it is also necessary that the research findings correctly reflect the correlations between elements of these methods, processes and tools (internal validity). But unfortunately, there often exists a tradeoff in empirical research between the internal validity, which can be achieved through laboratory studies or experiments and the external validity, which can be ensured through the conduction of various field studies or case studies (Roe and Just, 2009). To relax this harsh trade-off between internal and external validity, Live-Labs were developed as validation environments for design research (Walter et al, 2016).…”

Section: Introductionmentioning

confidence: 99%

Live-Labs as Real-World Validation Environments for Design Methods

Albers¹,

Walter²,

Wilmsen³

et al. 2018

Proceedings of the DESIGN 2018 15th International Design Conference

View full text Add to dashboard Cite

Laboratory studies and field studies make a major contribution to the validation of new design processes, methods and tools, but are confronted with limited transferability of validation results to corporate practice. In contrast, Live-Labs are validation environments that promise a high degree of external validity, but have not yet been able to systematically justify it. This article presents a procedure model and a categorisation framework that allows existing Live-Labs to be designed in such a way that the transferability of the results of Live-Lab studies to companies can be optimised.

show abstract

Internal and External Validity in Economics Research: Tradeoffs between Experiments, Field Experiments, Natural Experiments, and Field Data

Cited by 176 publications

References 5 publications

Congruence of appropriation and provision in collective water provision in Central Namibia

Congruence of appropriation and provision in collective water provision in Central Namibia

Test, Model, and Method Validation: The Role of Experimental Stone Artifact Replication in Hypothesis-driven Archaeology

Live-Labs as Real-World Validation Environments for Design Methods

Contact Info

Product

Resources

About