Fleiss’s Kappa: Assessing The Concept Of Technology Enabled Active Learning (Teal)

Hassan, Nurfarhana; Puteh, Saifullizam; Sanusi, Amanina Binti Muhamad

doi:10.30880/jtet.2019.11.01.014

Cited by 7 publications

(5 citation statements)

References 21 publications

Supporting

Mentioning

Contrasting

Order By: Relevance

“…The resulting Kappa values provide a measurable scale for the instrument's validity in assessing lecturer competencies in the OBE context. The expert agreement review formula using Fleiss Kappa coefficient (Davies & Fleiss, 1982;Hassan et al, 2019;Stemler, 2001) K = (Fa-Fc)/(N-Fc) K = Kappa Agreement Coefficient Value Fa = Agreement Units N = Transcription Units Fc = 50% of Expected Agreement…”

Section: Methodsmentioning

confidence: 99%

The Validity of the Competency Instrument for Construction Technology Program Lecturers in the Practice of Outcome-based Education (OBE)

Che Sobry,

Che Kob,

Mohd Rokeman

2024

IJARBSS

View full text Add to dashboard Cite

This research aims to evaluate the validity of the Competency Instrument for lecturers in the Construction Technology program in the context of Outcome-Based Education (OBE) at Malaysian Vocational Colleges. This evaluation measures the instrument's effectiveness in assessing the three elements of competence: knowledge, skills, and attitudes. Outcomebased education has been adopted by the Vocational College since the introduction of the diploma program in 2014. Seven experts reviewed each item of the instrument, and the Fleiss Kappa coefficient value was used to analyze the findings. The resulting Kappa values were k=0.83 for the knowledge construct, k=0.83 for the skills construct, and k=0.91 for the attitudes construct, with an overall Fleiss Kappa value of k=0.85, indicating that the instrument is at a good level. The study's findings suggest that the instrument is suitable for implementing a pilot study and can effectively measure the competence of lecturers in the Construction Technology program within the OBE framework. Furthermore, this instrument can serve as a useful reference for evaluating lecturer practices in other Higher Education Institutions.

show abstract

Section: Methodsmentioning

confidence: 99%

The Validity of the Competency Instrument for Construction Technology Program Lecturers in the Practice of Outcome-based Education (OBE)

Che Sobry,

Che Kob,

Mohd Rokeman

2024

IJARBSS

View full text Add to dashboard Cite

show abstract

“…Inter-rater reliability was calculated using Cohen’s Kappa for the resultant codes. Kappa for the initial coding was “very strong” (0.76) (Hassan et al , 2019). Both coders subsequently agreed the identification of the above three themes.…”

Section: Methodsmentioning

confidence: 99%

Exploring children’s reactions to sponsorship transition: a study of interpersonal and pro-social demands

Thomas

White

Samuel³

2020

View full text Add to dashboard Cite

Purpose The purpose of this study is to evaluate children’s perceptions and attitudes towards sponsorship transition, specifically the change from Nike to PUMA as kit sponsors for Manchester City Football Club (MCFC) in July 2019. Design/methodology/approach A sample of 368 children, between 7 and 16 years of age were recruited for the study. Using electronic diaries, 1,577 diary entries were captured between February 2019 and March 2020. Findings Data reveals that children conceptualise sponsorship as a social exchange, with sponsoring brands seen as human entities and interaction with them reflecting the dynamism of social and familial relationships. Consequently, children in this study demanded prosocial and interpersonal behaviours from sponsors and sponsee during the transition period. Research limitations/implications The research has an immediate and direct application for brand managers and the sponsee when considering terminating long-term sponsorship. Both the departing and incoming sponsors can maximise their relationships with these younger fans through an orchestrated departure, arrival and dedicated handover. Practical implications The findings enable marketing brand managers to effectively evaluate sponsor transition to maximise opportunities to maintain, and indeed start, brand relationships with younger fans. Originality/value This is the first study that has examined sponsorship children’s responses to sponsorship transition.

show abstract

“…To confirm the robustness of the research approach, Cohen's kappa was calculated (Hassan et al, 2019;Schwartz et al, 2019). Values of kappa range between 0 (complete disagreement) and 1 (complete agreement): values of >0.6 may be classified as "substantial" (Landis and Koch, 1977), 0.41-0.75 as "good" and >0.75 "very good" (Fleiss et al, 2003).…”

Section: Research Question Conceptual Frameworkmentioning

confidence: 99%

Human capital neurodiversity: an examination of stereotype threat anticipation

Priscott

Allen

2021

View full text Add to dashboard Cite

PurposeThe purpose of the study was to test the assumption of similarities between neurodivergents and other minority groups regarding their reaction to stereotype threat. In addition, it aimed to identify the source of stereotype threat and the neurodivergent's response to it.Design/methodology/approachTwo studies were conducted. Study 1 employed three exercises consisting of brochures, learning sets and posters to test organisational cues, notions of intelligence and situational cues. It collected data from 53 participants to establish whether stereotype threat observed in visible difference such as race, gender and intelligence is equally relevant to neurodiversity. Study 2 consisted of interviews with 44 participants to establish stereotype threat source, reaction and effect on declaration of invisible difference.FindingsNeurodivergents, defined by their invisible difference, react similarly to those with a visible difference with respect to organisational cues and stereotype threat. They will cognisantly define their behaviours depending upon those cues and stereotype threat. In doing so, they draw upon previous personal and work experiences. After the event, they will make a comparison to their assessment. If it is similar to their assessment, it reinforces it; however, if it is dissimilar, the neurodivergent will make an adjustment to the assessment. In both cases, the experience will form part of a future threat assessment.Research limitations/implicationsThe research is limited by its interpretivist nature and sample comprising personnel within a UK government organisation.Practical implicationsThe research has practical implications for employers, providing managers with a model to understand the impact a neurodivergents' previous experiences can have on their ability to interact within the workplace. Such understanding can provide insight into how best to utilise human capital.Originality/valueThis study makes a contribution to theory by expanding knowledge of neurodiversity in the workplace and by identifying the neurodivergents' reaction to the anticipation of a stereotype threat. In addition, it offers the stereotype threat anticipation conceptual model as a representation of the cognitive decisions made by neurodivergents to conceal or reveal their invisible difference.

show abstract

Fleiss’s Kappa: Assessing The Concept Of Technology Enabled Active Learning (Teal)

Cited by 7 publications

References 21 publications

The Validity of the Competency Instrument for Construction Technology Program Lecturers in the Practice of Outcome-based Education (OBE)

The Validity of the Competency Instrument for Construction Technology Program Lecturers in the Practice of Outcome-based Education (OBE)

Exploring children’s reactions to sponsorship transition: a study of interpersonal and pro-social demands

Human capital neurodiversity: an examination of stereotype threat anticipation

Contact Info

Product

Resources

About