How can organizations measure the integration of environmental, social, and governance (ESG) criteria? Validation of an instrument using item response theory to capture workers' perception

Abstract

Evaluation of corporate sustainability parameters has become part of organizational management. Item Response Theory (IRT) serves as a valuable approach for quantifying and exploring observable variables associated with these parameters. Therefore, this article aims to propose, apply, and validate an instrument utilizing IRT to measure environmental, social, and governance (ESG) impacts on corporate sustainability performance, using the perspective of workers. Workers were chosen as key stakeholders for the present study, as they were pointed by previous research as central to corporate sustainability decisions. The present paper addresses a literature gap by introducing, implementing, and validating a research instrument, along with a comparative scale, to assess the effects of integrating ESG criteria on corporate sustainability performance. Workers of two major Brazilian electricity sector companies were respondents for this instrument. Multigroup IRT method was used to assess item discrimination and difficulty levels, and to construct a scale reflecting workers' perceptions of integrating ESG criteria. The questionnaire consisted of 15 items, demonstrating Content Validity Coefficients (CVC) above .97, confirming the instrument's content effectiveness. Cronbach's Alpha and McDonald's Omega were greater than .94 for both companies. Questionnaire items demonstrated satisfactory discrimination ability and varying difficulty levels, resulting in a five‐level scale to gauge the impacts of ESG criteria. This research contributes through the introduction and validation of the research instrument, the latent trait assessment scale, and the evaluation of workers' perceptions regarding ESG criteria impacts on corporate sustainability performance. In conclusion, the proposed instrument showed robust psychometric properties, displaying favorable reliability and validity parameters. It effectively measures the impacts of ESG criteria, providing interpretable levels aligned with the unique characteristics of its constituent items

Item response theory-based validation of a quality of digital marketing actions on Instagram business accounts measurement instrument

“…The highlight is related to items Q4 (feed update) and Q18 (interaction with followers in the form of likes and comments), as they were the most di cult attributes for the accounts evaluated to meet. The IRT scales are cumulative (Silva et al, 2023;Barbosa et al, 2024). Therefore, to meet the attributes of items Q4 and Q18, the accounts tend to meet the other criteria described in the Instrument's items.…”