The development and evaluation of a scale to assess job satisfaction in public universities with item response theory: a Brazilian study

Abstract

PurposeThis study aimed to develop a psychometrically reliable job satisfaction (JS) measure for university employees, guiding administrative decisions and monitoring satisfaction over time in public universities.Design/methodology/approachA JS survey developed by a Brazilian federal university’s sustainability committee containing 58 items across physical, cognitive and organizational domains was longitudinally tested with 1,214 responses collected. The data were analyzed using Item Response Theory (IRT) analysis, employing the Graded Response Model, with tools such as frequency analysis, item characteristic curve, and full-information factor analysis in RStudio. The scale’s criterion validity was also established via expert qualitative interpretation.FindingsThe instrument’s internal consistency was confirmed as the results demonstrated its high reliability with a marginal reliability coefficient of 0.95. Significant findings revealed that recognition and supervisor relationships were key discriminators of JS and that workers began to perceive satisfaction when basic environmental conditions were met.Research limitations/implicationsIt is important to mention that the application of this scale is specifically limited to higher education institutions and may not be directly applicable to other educational settings or industry sectors without modifications.Originality/valueAlthough numerous measures and scales have been developed to assess JS, one elaborated by using IRT in a public university environment was lacking. Due to shifting dynamics in the workplace, traditional measurement of JS has proven inadequate, necessitating a more precise, accessible and updated tool. The developed scale allows precisely targeted interventions to improve JS and can be reapplied to evaluate their effectiveness. This research thus contributes a valuable tool for academic organizational psychology, enhancing the understanding of the measurement of JS.