Abstract:The introduction of Agenda 2030 has impacted the public and private sectors. Agenda 2030 is a document that aims to promote collaboration and partnership between countries and the population for the achievement of 17 SDGs, which cover all the three dimensions of sustainability: environmental, social, and economic. Within the public organizations, higher education institutions (HEIs) have shown certain attention on the topic. In particular, for many HEIs, the publication of sustainability reports has represente… Show more
“…the Talloires Declaration, the Halifax Declaration, the SDG Accord and the Abuja Declaration) designed to foster sustainable development (SD) and education for sustainable development has increased over time (Lozano et al, 2015). Linked to the sustainability actions, the publication of reports is another instrument for institutions to disclose and publicise their commitment to sustainability and, by extension, the SDGs (Caputo et al, 2021). However, universities have been slow to adopt sustainability practices IJSHE 23,8 (Lozano, 2006;Velazquez et al, 2006) due to a resistance to change and a lack of awareness, interest and funding.…”
Purpose
This study aims to analyse and evaluate the methodology followed by the Times Higher Education Impact Rankings (THE-IR), as well as the coverage obtained and the data offered by this ranking, to determine if its methodology reflects the degree of sustainability of universities, and whether their results are accurate enough to be used as a data source for research and strategic decision-making.
Design/methodology/approach
A summative content analysis of the THE-IR methodology was conducted, paying special attention to the macro-structure (university score) and micro-structure (sustainable development goals [SDG] score) levels of the research-related metrics. Then, the data published by THE-IR in the 2019, 2020 and 2021 edition was collected via web scraping. After that, all the data was statistically analysed to find out performance rates, SDGs’ success rates and geographic distributions. Finally, a pairwise comparison of the THE-IR against the Times Higher Education World University Rankings (THE-WUR) was conducted to calculate overlap measures.
Findings
Severe inconsistencies in the THE-IR methodology have been found, offering a distorted view of sustainability in higher education institutions, allowing different strategic actions to participate in the ranking (interested, strategic, committed and outperformer universities). The observed growing number of universities from developing countries and the absence of world-class universities reflect an opportunity for less-esteemed institutions, which might have a chance to gain reputation based on their efforts towards sustainability, but from a flawed ranking which should be avoided for decision-making.
Practical implications
University managers can be aware of the THE-IR validity when demanding informed decisions. University ranking researchers and practitioners can access a detailed analysis of the THE-IR to determine its properties as a ranking and use raw data from THE-IR in other studies or reports. Policy makers can use the main findings of this work to avoid misinterpretations when developing public policies related to the evaluation of the contribution of universities to the SDGs. Otherwise, these results can help the ranking publisher to improve some of the inconsistencies found in this study.
Social implications
Given the global audience of the THE-IR, this work contributes to minimising the distorted vision that the THE-IR projects about sustainability in higher education institutions, and alerts governments, higher education bodies and policy makers to take precautions when making decisions based on this ranking.
Originality/value
To the best of the authors’ knowledge, this contribution is the first providing an analysis of the THE-IR’s methodology. The faults in the methodology, the coverage at the country-level and the overlap between THE-IR and THE-WUR have unveiled the existence of specific strategies in the participation of universities, of interest both for experts in university rankings and SDGs.
“…the Talloires Declaration, the Halifax Declaration, the SDG Accord and the Abuja Declaration) designed to foster sustainable development (SD) and education for sustainable development has increased over time (Lozano et al, 2015). Linked to the sustainability actions, the publication of reports is another instrument for institutions to disclose and publicise their commitment to sustainability and, by extension, the SDGs (Caputo et al, 2021). However, universities have been slow to adopt sustainability practices IJSHE 23,8 (Lozano, 2006;Velazquez et al, 2006) due to a resistance to change and a lack of awareness, interest and funding.…”
Purpose
This study aims to analyse and evaluate the methodology followed by the Times Higher Education Impact Rankings (THE-IR), as well as the coverage obtained and the data offered by this ranking, to determine if its methodology reflects the degree of sustainability of universities, and whether their results are accurate enough to be used as a data source for research and strategic decision-making.
Design/methodology/approach
A summative content analysis of the THE-IR methodology was conducted, paying special attention to the macro-structure (university score) and micro-structure (sustainable development goals [SDG] score) levels of the research-related metrics. Then, the data published by THE-IR in the 2019, 2020 and 2021 edition was collected via web scraping. After that, all the data was statistically analysed to find out performance rates, SDGs’ success rates and geographic distributions. Finally, a pairwise comparison of the THE-IR against the Times Higher Education World University Rankings (THE-WUR) was conducted to calculate overlap measures.
Findings
Severe inconsistencies in the THE-IR methodology have been found, offering a distorted view of sustainability in higher education institutions, allowing different strategic actions to participate in the ranking (interested, strategic, committed and outperformer universities). The observed growing number of universities from developing countries and the absence of world-class universities reflect an opportunity for less-esteemed institutions, which might have a chance to gain reputation based on their efforts towards sustainability, but from a flawed ranking which should be avoided for decision-making.
Practical implications
University managers can be aware of the THE-IR validity when demanding informed decisions. University ranking researchers and practitioners can access a detailed analysis of the THE-IR to determine its properties as a ranking and use raw data from THE-IR in other studies or reports. Policy makers can use the main findings of this work to avoid misinterpretations when developing public policies related to the evaluation of the contribution of universities to the SDGs. Otherwise, these results can help the ranking publisher to improve some of the inconsistencies found in this study.
Social implications
Given the global audience of the THE-IR, this work contributes to minimising the distorted vision that the THE-IR projects about sustainability in higher education institutions, and alerts governments, higher education bodies and policy makers to take precautions when making decisions based on this ranking.
Originality/value
To the best of the authors’ knowledge, this contribution is the first providing an analysis of the THE-IR’s methodology. The faults in the methodology, the coverage at the country-level and the overlap between THE-IR and THE-WUR have unveiled the existence of specific strategies in the participation of universities, of interest both for experts in university rankings and SDGs.
“…As evidenced by the Principles for Responsible Management Education (PRME), HEIs can influence students with responsible and sustainable business practices (Parkes et al 2017). The coexistence of different themes directly or indirectly related to the CSR paradigm underlined HEIs' social role (Caputo et al 2021; Rete delle Università per lo Sviluppo Sostenibile 2021). Contributing to the multidimensional goals identified by policymakers requires a holistic approach to evaluate the real contribution provided by companies to society (Cottafava et al 2019).…”
In the last few years, policymakers have underlined the need for new soft and hard skills about corporate social responsibility (CSR). The main debate about CSR education has been driven by the 2030 Agenda, which explicitly recognized Higher Education Institutions (HEIs) as having a pivotal role. In particular, many academics started to develop qualitative and quantitative studies to evaluate the integration of CSR contents in business schools’ curricula. The paper aims to contribute to the existing debate through the analysis of the contribution provided by Italian HEIs to CSR Education. In particular, we adopted qualitative methods to evaluate the specific contribution provided by Economia Aziendale scholars.
“…Sustainability Evaluation: After measuring the extent to which the objectives have been achieved from the use of information and communication technology in the learning room, then the madrasah determines whether the program using this information and communication technology will be continued or discontinued or replaced with other programs (Caputo et al, 2021). The evaluation analysis of the sustainability of this program concluded that given the importance of information and communication technology to be used in learning spaces, this program continued with several notes that must be improved.…”
Section: Product Evaluation the Use Of Information And Communication ...mentioning
These stages in Terry's management function are known as Planning, Organizing, Actuating, and Controlling (POAC). To measure the success of the use of information and communication technology in the learning space, an evaluation of the management stages that are carried out is needed. Stufflebeam's Model or CIPP Model is an evaluation model that can be used to evaluate the extent to which an educational program can achieve its goals. Madrasah Aliyah (MA) Al-Musthofa is one of the madrasas that used information and communication technology in the learning room. The management stages become a reference for Madrasah aliyah Al-Musthofa in the use of information and communication technology in the learning room. This research with a descriptive qualitative approach provides an evaluation description that the management function has been carried out well by Madrasah Aliyah Al-Musthofa but there are still various shortcomings and weaknesses both in terms of human resources and other resources. These shortcomings and weaknesses have an impact on not achieving the objectives of the use of information and communication technology in the learning space at Madrasah aliyah al-Musthofa.
scite is a Brooklyn-based organization that helps researchers better discover and understand research articles through Smart Citations–citations that display the context of the citation and describe whether the article provides supporting or contrasting evidence. scite is used by students and researchers from around the world and is funded in part by the National Science Foundation and the National Institute on Drug Abuse of the National Institutes of Health.