Transitions towards sustainability are urgently needed to address the interconnected challenges of economic development, ecological integrity, and social justice, from local to global scales. Around the world, collaborative science-society initiatives are forming to conduct experiments in support of sustainability transitions. Such experiments, if carefully designed, provide significant learning opportunities for making progress on transition efforts. Yet, there is no broadly applicable evaluative scheme available to capture this critical information across a large number of cases, and to guide the design of transition experiments. To address this gap, the article develops such a scheme, in a tentative form, drawing on evaluative research and sustainability transitions scholarship, alongside insights from empirical cases. We critically discuss the scheme's key features of being generic, comprehensive, operational, and formative. Furthermore, we invite scholars and practitioners to apply, reflect and further develop the proposed tentative scheme -making evaluation and experiments objects of learning.

Various experimental approaches of transformative research in real-world settings have emerged. Yet, similarities, differences, and specific contributions remain unclear. A characteristic-based comparison reveals complementarities and provides orientation.Real-world laboratories (RwLs, German Reallabore) belong to a family of increasingly popular experimental and transdisciplinary research approaches at the science-society interface. As these approaches in general, and RwLs in particular, often lack clear definitions of key characteristics and their operationalization, we make two contributions in this article. First, we identify five core characteristics of RwLs: contribution to transformation, experimental methods, transdisciplinary research mode, scalability and transferability of results, as well as scientific and societal learning and reflexivity. Second, we compare RwLs to similar research approaches according to the five characteristics. In this way, we provide an orientation on experimental and transdisciplinary research for societal transformations, and reveal the contributions of this type of research in supporting societal change. Our findings enable learning across the different approaches and highlight their complementarities, with a particular focus on RwLs.

The transdisciplinary research mode has gained prominence in the research on and for sustainability transformations. Yet, solution-oriented research addressing complex sustainability problems has become complex itself, with new transdisciplinary research formats being developed and tested for this purpose. Application of new formats offers learning potentials from experience. To this end, we accompanied fourteen research projects conceptualized as real-world labs (RwLs) from 2015 to 2018. RwLs were part of a funding program on ‘Science for Sustainability’ in the German federal state of Baden-Württemberg. Here, we combine conceptual and empirical work to a structured collection of experiences and provide a comprehensive account of RwLs. First, we outline characteristics of RwLs as transformation oriented, transdisciplinary research approach, using experiments, enabling learning and having a long-term orientation. Second, we outline eleven success factors and concrete design notes we gained through a survey of the 14 RwLs: (1) find the right balance between scientific and societal aims, (2) address the practitioners needs and restrictions, (3) make use of the experimentation concept, (4) actively communicate, (5) develop a ‘collaboration culture’, (6) be attached to concrete sites, (7) create lasting impact and transferability, (8) plan for sufficient time and financial means, (9) adaptability, (10) research-based learning, and (11) recognize dependency on external actors. Characteristics and success factors are combined to illustrate practical challenges in RwLs. Third, we show which methods could be used to cope with challenges in RwLs. We conclude discussing the state of debate on RwLs and outline future avenues of research.

No abstract

There is a strong trend towards research in society-based laboratories, especially in relation to sustainability. Semantic analysis reveals related discourses and emerging lines of inquiry, namely transformative potential, transdisciplinarity and learning. Real-world laboratories are a dynamic example of this research. Contributions of how to deepen and broaden their analysis are presented.