Sustainability indicators are well recognized for their potential to assess and monitor sustainable development of agricultural systems. A large number of indicators are proposed in various sustainability assessment frameworks, which raises concerns regarding the validity of approaches, usefulness and trust in such frameworks. Selecting indicators requires transparent and well-defined procedures to ensure the relevance and validity of sustainability assessments. The objective of this study, therefore, was to determine whether 123Environ Dev Sustain DOI 10.1007/s10668-016-9803-x experts agree on which criteria are most important in the selection of indicators and indicator sets for robust sustainability assessments. Two groups of experts (Temperate Agriculture Research Network and New Zealand Sustainability Dashboard) were asked to rank the relative importance of eleven criteria for selecting individual indicators and of nine criteria for balancing a collective set of indicators. Both ranking surveys reveal a startling lack of consensus amongst experts about how best to measure agricultural sustainability and call for a radical rethink about how complementary approaches to sustainability assessments are used alongside each other to ensure a plurality of views and maximum collaboration and trust amongst stakeholders. To improve the transparency, relevance and robustness of sustainable assessments, the context of the sustainability assessment, including prioritizations of selection criteria for indicator selection, must be accounted for. A collaborative design process will enhance the acceptance of diverse values and prioritizations embedded in sustainability assessments. The process by which indicators and sustainability frameworks are established may be a much more important determinant of their success than the final shape of the assessment tools. Such an emphasis on process would make assessments more transparent, transformative and enduring.

Abstract:Questions have been raised on what role the knowledge provided by sustainability science actually plays in the transition to sustainability and what role it may play in the future. In this paper we investigate different approaches to sustainability transformation of food systems by analyzing the rationale behind transformative acts-the ground that the direct agents of change act upon-and how the type of rationale is connected to the role of research and how the agents of change are involved. To do this we employ Max Weber's distinction between instrumental rationality and value-rationality in social action. In particular, we compare two different approaches to the role of research in sustainability transformation: (1) Performance-based approaches that measure performance and set up sustainability indicator targets and benchmarks to motivate the agents in the food system to change; (2) Values-based approaches that aim at communicating and mediating sustainability values to enable coordinated and cooperative action to transform the food system. We identify their respective strengths and weaknesses based on a cross-case analysis of four cases, and propose that the two approaches, like Weber's two types of rationality, are complementary-because they are based on complementary observer stances-and that an optimal in-between approach therefore cannot be found. However, there are options for reflexive learning by observing one perspective-and its possible blind spots-from the vantage point of the other, so we suggest that new strategies for sustainability transformation can be found based on reflexive rationality as a third and distinct type of rationality.Keywords: complementarity; food systems; perspectives; rationality; sustainability assessment; sustainability transformation; sustainability transition; sustainability science "Like any action, social action may be determined as: (1) instrumentally rational through expectations of the behavior of objects in the environment and of other human beings, and the use of these expectations as "conditions" or "means" to attain one's own rationally pursued and calculated ends; (2) value-rational through a conscious belief in

This is an open access article under the terms of the Creat ive Commo ns Attri bution License, which permits use, distribution and reproduction in any medium, provided the original work is properly cited.

Our review concludes that organic standards need to account for a broader set of criteria in order to retain claims to 'sustainability'. Measurements of the ecological, economic and social outcomes from over 96 kiwifruit, sheep/beef and dairy farms in New Zealand between 2004 and 2012 by The Agricultural Research Group on Sustainability (ARGOS) project showed some enhanced ecosystem services from organic agriculture that will assist a "land-sharing" approach for sustainable land management. However, the efficiency of provisioning services is reduced in organic systems and this potentially undermines a "land-sparing" strategy to secure food security and ecosystem services. Other aspects of the farm operation that are not considered in the organic standards sometimes had just as much or even a greater effect on ecosystem services than restriction of chemical inputs and synthetic fertilisers. An organic farming version of the New Zealand Sustainability Dashboard will integrate organic standards and wider agricultural best practice into a broad and multidimensional sustainability assessment framework and package of learning tools. There is huge variation in performance of farms within a given farming system. Therefore improving ecosystem services depends as much on locally tuned learning and adjustments of farm practice on individual farms as on uptake of organic or Integrated Management farming system protocols.

No abstract