Ordinal scales and fuzzy set systems to measure agreement: An application to the evaluation of teaching activity

Lalla, Michele; Facchinetti, Gisella; Mastroleo, Giovanni

doi:10.1007/s11135-005-8103-6

Cited by 65 publications

(31 citation statements)

References 34 publications

Supporting

Mentioning

Contrasting

Unclassified

Order By: Relevance

“…Fuzzy rating scales have been intensively applied in higher education context to measure quality related issues (see e.g. Basaran et al,2011;Lalla et al, 2005;Yu et al, 2016;Lupo, 2013;Liu et al, 2015;Venkatesan and Fragomeni, 2008). Based on the relevant literature the next research issue was addressed by applying a fuzzy-scale in case of student evaluations in the framework of the peer review program and analyze the benefits of fuzzy scales compared to traditional Likert scales.…”

Section: Responsibility Of the Organizing Committee Of The Conferencementioning

confidence: 99%

Enhancing The Reliability Of Measurements And Evaluations Based On Service Quality Models

Tóth¹,

Árva²,

Surman³

2017

European Proceedings of Social and Behavioural Sciences

View full text Add to dashboard Cite

Problem statement: The application of different service quality measurements and evaluations in higher educational context and the utilization and reliability of results are examined.Research questions: What are the difficulties in the measurement and evaluation of specific service quality dimensions? How can the reliability of such service quality measurements be enhanced?Purpose of the study: This paper introduces the application and the results of a student satisfaction questionnaire based on fuzzy Likert scale used for evaluating lecturers' performance at the Budapest University of Technology and Economics.Research methods: In order to capture and accurately measure the diversity, subjectivity and imprecision inherent to students' evaluations, a methodology based on fuzzy numbers having sigmoid membership functions has been proposed. By applying the principles of Dombi's Pliant Arithmetics, the evaluations can be aggregated and statistically analysed in a convenient way.Findings: Fuzzy-numbers based questionnaires result in a more precise reflection of human thinking and judgement. The Pliant Arithmetic-based approach allows us to aggregate the parameters of the left and right hand sides of the fuzzy number separately. This property results in a much simpler statistical analysis of the gathered data than the methods previously proposed in the literature.Conclusions: The proposed methodology can be utilized in two ways. It can either be applied to identify lecturers' strengths and weaknesses in order to develop their teaching skills or to compare and analyse various students' evaluations. The results can serve as a base for establishing teaching regulations and discovering best practices as well.

show abstract

Section: Responsibility Of the Organizing Committee Of The Conferencementioning

confidence: 99%

Enhancing The Reliability Of Measurements And Evaluations Based On Service Quality Models

Tóth¹,

Árva²,

Surman³

2017

European Proceedings of Social and Behavioural Sciences

View full text Add to dashboard Cite

show abstract

“…Recent studies have applied multilevel modeling to SET (Marsh and Hattie, 2002;Tings, 2000;Toland and De Ayala, 2005) and other works have been carried out using models estimated through ordinary statistical techniques (Lalla et al, 2004;Göb et al, 2007).…”

Section: Reliability Validity and Multidimensionality Of Setmentioning

confidence: 99%

A multivariate method for analyzing and improving the use of student evaluation of teaching questionnaires: a case study

et al. 2010

View full text Add to dashboard Cite

show abstract

“…In most cases we opted for closed questions (about 40 in total), which are quick to fill in and easy to analyze. Even though Likert-like scales have some debated issues (Lalla et al 2004), they were simple enough for all users, and allowed us to capture subjective perceptions in a comparable way. To prevent users from filling in questions using neutral answers as a shortcut, the scalar answers provided contained an even number of options (6), so that users would have to choose between "under the average" and "over the average").…”

Section: Model Implementationmentioning

confidence: 99%

Peer activities on Web-learning platforms—Impact on collaborative writing and usability issues

2008

View full text Add to dashboard Cite

The importance of groupware tools in e-learning practice is increasing, because of their educational relevance and of the importance of group abilities in today's job activities. The paper addresses some critical issues of asynchronous collaborative tools hosted in Web-learning platforms. A model to capture user quality perceptions for these tools is presented, and an investigation conducted in three case studies where e-learning platforms were used to share and comment on written works is reported in detail. Quantitative and qualitative data are used in a complementary way to capture the complexity of educational collaborative activities. The impact of technologies on work organization, writing and peer-feedback activities is discussed. Users dedicated more time to feedback activities than they would have in real-life contexts, and paid more attention to the style and content of their writing. Communication was more focused and honest than in real life (even though more distant and at the risk of misunderstanding), and its indirectness encouraged shy and impaired people. Usability problems emerged from platform design, educators' choices and server-side settings; Web-based systems seem to pose specific usability issues when users are required a strong active role; compatibility issues highlight the need for a closer Web standard compliance.

show abstract

Ordinal scales and fuzzy set systems to measure agreement: An application to the evaluation of teaching activity

Abstract: teaching evaluation, Likert scale, neutral position, fuzzy set theory,

Cited by 65 publications

References 34 publications

Enhancing The Reliability Of Measurements And Evaluations Based On Service Quality Models

Enhancing The Reliability Of Measurements And Evaluations Based On Service Quality Models

A multivariate method for analyzing and improving the use of student evaluation of teaching questionnaires: a case study

Peer activities on Web-learning platforms—Impact on collaborative writing and usability issues

Contact Info

Product

Resources

About