Determining Validity and Reliability of Data Gathering Instruments Used by Program Evaluation Studies in Turkey

Yaşar, Şefik; Çöğenli, Aslı Gündoğan

doi:10.1016/j.sbspro.2014.04.156

Cited by 5 publications

(3 citation statements)

References 1 publication

Supporting

Mentioning

Contrasting

Order By: Relevance

“…Consequently, many studies concerned with the development of instruments used in research have been focusing on testing their instruments' validity and reliability. Yasar and Cogenli (2014) conducted a study by examining 12 articles and 38 theses focused on evaluation program in Turkey. Findings revealed prevalent use of content validity for validity assessment and the Cronbach Alpha coefficient for reliability.…”

Section: The Importance Of Validity and Reliability For Research Inst...mentioning

confidence: 99%

Needs Analysis for Developing a Teaching Speaking Module for Chinese EFL Business English Undergraduates from the Teachers’ Perspective: Assessing the Validity and Reliability

Ke,

AlSaqqaf

2023

IJARPED

View full text Add to dashboard Cite

A dearth of research has carried out to identify the learning and target needs in oral business English (OBE) courses for Chinese EFL undergraduates from the perspectives of teachers. Furthermore, assessing the validity and reliability of the needs-analysis instruments has been neglected, though needs analysis is considered as one of the major concerns in teaching English for specific purposes (ESP). Accordingly, this study aims at investigating the content validity, construct validity, and reliability of the research instrument. Based on the rigorous review of previous literature, the researchers determined the prospective constructs and questionnaire items that attribute to the measurement of Chinese EFL students' needs in OBE courses as perceived by teachers. The content validity of the Chinese EFL students' needs questionnaire containing 17 items based on a 5-point Likert scale was examined by three Ph.D. holders with expertise in ESP fields. For data collection, a total of 36 teacher respondents from Business English department involved in the study. Exploratory Factor Analysis (EFA) was utilized to examine the construct of the questionnaire where a total of three constructs have been extracted: i) perceived teaching of speaking, ii) perceived performance of students, iii) perceived use of materials with the factor loading ranging from 0.448 to 0.972. In terms of instrument reliability, Cronbach's alpha (α) fell in a range of 0.80 to 0.90, which indicates a high level of reliability. It is hoped that the results of this study could be insightful to developing research instrument for ESP studies.

show abstract

Section: The Importance Of Validity and Reliability For Research Inst...mentioning

confidence: 99%

Needs Analysis for Developing a Teaching Speaking Module for Chinese EFL Business English Undergraduates from the Teachers’ Perspective: Assessing the Validity and Reliability

Ke,

AlSaqqaf

2023

IJARPED

View full text Add to dashboard Cite

show abstract

“…Before performing spatial geostatistical analysis, the household data were tested for normality, multicollinearity, and goodness of fit using Statistical Package for the Social Sciences (SPSS) software. Subsequently, we used the Exploratory Regression Statistics tool in ArcGIS software to test these variables for residual spatial autocorrelation, residual normality, and global multicollinearity (of less The quality of data is influenced by the validity and reliability of the method and instruments used to collect data [33]. During fieldwork data collection, data quality management was addressed in various ways.…”

Section: A Geocoded Sampling Design For Household Interviewsmentioning

confidence: 99%

A Spatially Explicit Approach for Targeting Resource-Poor Smallholders to Improve Their Participation in Agribusiness: A Case of Nyando and Vihiga County in Western Kenya

Mathenge

Sonneveld

Broerse

2020

IJGI

View full text Add to dashboard Cite

The majority of smallholder farmers in Sub-Saharan Africa face myriad challenges to participating in agribusiness markets. However, how the spatially explicit factors interact to influence household decision choices at the local level is not well understood. This paper’s objective is to identify, map, and analyze spatial dependency and heterogeneity in factors that impede poor smallholders from participating in agribusiness markets. Using the researcher-administered survey questionnaires, we collected geo-referenced data from 392 households in Western Kenya. We used three spatial geostatistics methods in Geographic Information System to analyze data—Global Moran’s I, Cluster and Outliers Analysis, and geographically weighted regression. Results show that factors impeding smallholder farmers exhibited local spatial autocorrelation that was linked to the local context. We identified distinct local spatial clusters (hot spots and cold spots clusters) that were spatially and statistically significant. Results affirm that spatially explicit factors play a crucial role in influencing the farming decisions of smallholder households. The paper has demonstrated that geospatial analysis using geographically disaggregated data and methods could help in the identification of resource-poor households and neighborhoods. To improve poor smallholders’ participation in agribusiness, we recommend policymakers to design spatially targeted interventions that are embedded in the local context and informed by locally expressed needs.

show abstract

“…Content validity is the most crucial step in developing an instrument because at this step analysis of the suitability between items with the characteristics that are wanted to be measured (Xie, 2018;Yasar & Gundogan, 2014). This content validation is evaluated by qualified experts in the assessment domain, HOTS, and biochemistry.…”

Section: Content Validitymentioning

confidence: 99%

The Development and Validation of Critical and Creative Thinking Skills Test in Enzyme for Undergraduate Chemistry Students

et al. 2019

View full text Add to dashboard Cite

The aim of this study was to develop and validate a test of studentsâ€™ critical and creative thinking skills on enzyme. This study was conducted using development and validation methods through six steps, i.e. (1) defining the construct and formulating objectives, (2) formatting items, (3) constructing items, (4) creating a scoring guide, (5) Judging items by experts, and (6) calculating validity, reliability, level of difficulty and discrimination by empirical study. This test was constructed two-tier test, which consists of the first tier as a multiple choice and the second tier as the reason from the first tier option. The participants were 61 undergraduate chemistry students who studied enzyme in a chemistry department. The results showed that item CVI value was 0.86 and item Cronbachsâ€™ Alpha value was 0.843 (very high category). Item difficulty index (P) was 0.501, and Item discrimination index (D) was 0.328 which showed that the level of difficulty item in the medium category and level of discrimination in the good category. Out of initial 14 items, 3 items were excluded after the analysis of CVI, item difficulty index and item discrimination index. The revised 11-item test was found to have sufficient validity, reliability, item difficulty index and item discrimination index to measurement of enzyme concept mastery, critical thinking skills, and creative thinking skills.

show abstract

Determining Validity and Reliability of Data Gathering Instruments Used by Program Evaluation Studies in Turkey

Cited by 5 publications

References 1 publication

Needs Analysis for Developing a Teaching Speaking Module for Chinese EFL Business English Undergraduates from the Teachers’ Perspective: Assessing the Validity and Reliability

Needs Analysis for Developing a Teaching Speaking Module for Chinese EFL Business English Undergraduates from the Teachers’ Perspective: Assessing the Validity and Reliability

A Spatially Explicit Approach for Targeting Resource-Poor Smallholders to Improve Their Participation in Agribusiness: A Case of Nyando and Vihiga County in Western Kenya

The Development and Validation of Critical and Creative Thinking Skills Test in Enzyme for Undergraduate Chemistry Students

Contact Info

Product

Resources

About