Methodology to Analyze the Effectiveness of ESD in a Higher Degree in Education: A Case Study

Abstract

This paper presents a methodology to evaluate (1) to what extent students of a higher degree in the field of education acquire sustainability competencies, and (2) to determine whether the subjects that develop the ESD achieve their learning objectives. The methodology is applied to a case study. The instruments used are the sustainability survey and the sustainability presence map developed by the EDINSOST project. The survey consists of 18 questions, and has been answered by 104 first-year students and 86 fourth-year students belonging to the Bachelor Degree in Primary Education Teaching at the University of Sevilla. The Mann-Whitney U test has been used to compare the results of the two groups, and Cohen's D has been used to measure the effect size. Students only obtain significant improvements, with 95% confidence, in three questions (Q4, Q5 and Q6), all concerning critical thinking and creativity. An improvement is also detected in question Q11, with a confidence of 90%. However, no subject in the curriculum develops the learning outcomes concerning questions Q4, Q5 and Q6, and only one subject develops the learning outcomes regarding question Q11. On the other hand, up to five subjects declare development of the learning outcomes regarding questions in which there is no improvement in student learning. These results suggest that the subjects are failing to reach their ESD learning objectives, and that the students are either trained in sustainability outside the university or the subject learning guides do not reflect the work done by the students throughout their studies