A qualitative evaluation approach for energy system modelling frameworks

Abstract

Background: The research field of energy system analysis is faced with the challenge of increasingly complex systems and their sustainable transition. The challenges are not only on a technical level but also connected to societal aspects. Energy system modelling plays a decisive role in this field, and model properties define how useful it is in regard to the existing challenges. For energy system models, evaluation methods exist, but we argue that many decisions upon properties are rather made on the model generator or framework level. Thus, this paper presents a qualitative approach to evaluate frameworks in a transparent and structured way regarding their suitability to tackle energy system modelling challenges. Methods: Current main challenges and framework properties that potentially contribute to tackle these challenges are derived from a literature review. The resulting contribution matrix and the described application procedure is then applied exemplarily in a case study in which the properties of the Open Energy Modelling Framework are checked for suitability to each challenge. Results: We identified complexity (1), scientific standards (2), utilisation (3), interdisciplinary modelling (4), and uncertainty (5) as the main challenges. We suggest three major property categories of frameworks with regard to their capability to tackle the challenges: open-source philosophy (1), collaborative modelling (2), and structural properties (3). General findings of the detailed mapping of challenges and properties are that an open-source approach is a precondition for complying with scientific standards and that approaches to tackle the challenges complexity and uncertainty counteract each other. More research in the field of complexity reduction within energy system models is needed. Furthermore, while framework properties can support to address problems of result communication and interdisciplinary modelling, an important part can only be addressed by communication and organisational structures, thus, on a behavioural and social level. Conclusions: We conclude that the relevance of energy system analysis tools needs to be reviewed critically. Their suitability for tackling the identified challenges deserves to be emphasised. The approach presented here is one contribution to improve current evaluation methods by adding this aspect.

Grid-based multi-energy systems—modelling, assessment, open source modelling frameworks and challenges

“…The definitions of model, model generator and framework are taken from [29]. Models are simplified replicas of real world systems and may consist of several hard-or soft-linked sub-models.…”

Model Based Dispatch Optimisation for Residential Districts – Analysing the Integration of Electricity Storage Systems and their Environmental Impact

“…Real-world systems are usually represented by models (Wiese, Hilpert, Kaldemeyer, & Pleßmann, 2018). There is a variety of models, model generators or frameworks available to create and calculate energy system models (Hall & Buckley, 2016).…”

Open Power System Data – Frictionless data for electricity system modelling

“…In recent years, energy system modelling has been increasingly criticised for its black box character in comparison to other fields [18]. The openness of code and data are identified as key requirements for energy system models [19] to comply with scientific standards like improved reproducibility and greater scrutiny [20]. By allowing reuse and collaborative development, open models and data can increase productivity and -through greater transparency [21] -also increase credibility in the policy discourse [22].…”