Let’s get technical: Enhancing program evaluation through the use and integration of internet and mobile technologies

Materia, Frank T.; Miller, Elizabeth; Runion, Megan C.; Chesnut, Ryan P.; Irvin, Jamie; Richardson, Cameron; Perkins, Daniel F.

doi:10.1016/j.evalprogplan.2016.03.004

Cited by 11 publications

(11 citation statements)

References 30 publications

Supporting

Mentioning

Contrasting

Order By: Relevance

“…Shyu and Chou (2008) stated that well-organized course content will be ensured by a better e-learning design. Students will elaborate, schematize and reveal the new knowledge from the cognitive perspective by skimming through the previous knowledge given by learning materials (Harder et al, 2016;Van Nuland and Rogers, 2016;Materia et al, 2016). Thus, student and content interaction too, is an important factor in an e-learning environment.…”

Section: Student-instructor Interactionmentioning

confidence: 99%

The role of usability on e-learning user interactions and satisfaction: a literature review

Gunesekera

Bao²,

Kibelloh

2019

JSIT

View full text Add to dashboard Cite

Purpose The purpose of this study is to review the effect of usability factors on e-learning user relationships, namely, student–student interaction (SSI), student–instructor interaction (SII) and student–content interaction (SCI), in the existing e-learning literature. Further, this study intended to identify whether usability contributes to the satisfaction of e-learners. Design/methodology/approach This study has undertaken a systematic review using the PRISMA methodology to filter the literature in the domain of e-learning with respect to usability concerns using six databases. An analytical framework has been formulated to evaluate the literature against different dimensions of interactions and usability. Findings Results reveal that while SSI has grabbed 71.4 per cent research attention with respect to usability factors of e-learning systems, SCI has been given the least focus, i.e. 26.6 per cent. According to the results, e-learning systems’ usability issues influence the user relationships and affect the user satisfaction, which will lead to lack of user continuity. Practical implications The findings of this review will provide insights to instructional designers to construct more satisfied learning content for the users. The analysis framework of this study will encourage researchers to drive future research in e-learning along with the concern of usability. Originality/value This research emphasizes on the importance of SCI to focus future e-learning research on a different angle, in addition to SSI and SII. The analysis framework of this study will provide different dimensions, specifically for the empirical research in the domain of e-learning.

show abstract

Section: Student-instructor Interactionmentioning

confidence: 99%

The role of usability on e-learning user interactions and satisfaction: a literature review

Gunesekera

Bao²,

Kibelloh

2019

JSIT

View full text Add to dashboard Cite

show abstract

“…Technology also allows adjustments during evaluation, improves interventions and results, ensures feasible evaluations [ 6 ], ensures broad coverage during data collection (ie, inclusion of vulnerable groups and those who are difficult to reach) [ 2 ], and brings new voices and social participation (ie, diverse information) [ 6 ]. Technology can facilitate integration of different data sources to create a more comprehensive evaluation system [ 3 ], store large amounts of data [ 31 ], facilitate access and rapid exchange of information [ 1 , 4 , 32 ], and encourage evaluators to share public data [ 6 ].…”

Section: Discussionmentioning

confidence: 99%

“…Functionalities within the PMAQ-AB app allowed better integration of information, minimum inconsistencies, and secure data collection. Evaluators and app developers must guarantee adequate storage (ie, server security) [ 3 ], mainly due to the possibility of storing large amounts of data.…”

Section: Discussionmentioning

confidence: 99%

“…Consistencies are automatically verified with the advancement of digitalized evaluation, and data presenting discrepancies can be identified during collection, contributing to their integrity [ 30 ]. Some authors consider app development relevant because the questionnaire can be applied in specific time intervals, and unanswered questions are signaled to the interviewer [ 3 ]. This scenario of greater control due to technology can create opportunities to improve the accountability of those involved with the evaluation [ 29 ].…”

Section: Discussionmentioning

confidence: 99%

See 1 more Smart Citation

Using the PMAQ-AB Mobile App and Management System to Evaluate the Quality of Primary Health Care in Brazil: Qualitative Case Study

Júnior¹,

Silva²,

Martiniano³

et al. 2022

JMIR Form Res

View full text Add to dashboard Cite

Background The application of cell phones, similar portable devices (ie, tablets), apps, the internet, and GPS in evaluation have established new ways of collecting, storing, retrieving, transmitting, and processing data or information. However, evidence is incipient as to which technological resources remain at the center of assessment practice and the factors that promote their use by the assessment community. Objective This study aimed to analyze the relationship between the use of the National Program for Improving Primary Healthcare Access and Quality’s (PMAQ-AB; Programa Nacional de Melhoria do Acesso e da Qualidade da Atenção Básica) mobile app and management system and the external evaluation quality of Brazil’s PMAQ-AB. Methods We conducted a qualitative case study during the external evaluation of Brazil’s PMAQ-AB. Data collection consisted of interviews, focus groups, and document analysis. A total of 7 members from the Department of Primary Care of the Ministry of Health and 47 researchers from various higher education and research institutions across the country participated in the study. Data were categorized using the ATLAS.ti software program, according to the quality standards of the Joint Committee on Standards for Educational Evaluation, following the content analysis approach by Bardin. Results The results related to feasibility, thematic scope, field activity management, standardized data collection, data consistency, and transparency. They demonstrated improvements and opportunities for advancements in evaluation mediated by the use of information technology (IT), favored the emergence of new practices and remodeling of existing ones, and took into account the multiple components required by the complex assessment of access and quality in primary health care. Difficulties in technology operation, inoperative systems, and lack of investment in equipment and human resources posed challenges to increasing the effectiveness of IT in evaluation. Conclusions The use of technology-based tools—the app and the management system—during the external evaluation offered evaluators a greater opportunity for stakeholder engagement. This also allowed the insertion of different organizational, operational, and methodological components that are capable of triggering influences and confluences. In addition, this allowed connections in collaborative and synergistic networks to increase the quality and allow the development of a more consistent and efficient evaluation process with greater possibility of incorporating the results into public health policies.

show abstract

“…The system uses basic polling software and response devices which were used for engagement, audience assessment and data collection purposes. It was chosen as it provides anonymous real‐time information from participants and was thought to be more interactive and less burdensome than paper‐based surveys 22 . However, hard copy surveys were also available as an alternative when required.…”

Section: Methodsmentioning

confidence: 99%

Adaptation and evaluation of a nutrition and physical activity program for early childhood education settings in Aboriginal and Torres Strait Islander communities in remote Far North Queensland

Murtha

Thompson²,

Cleland

et al. 2020

Health Prom J of Aust

View full text Add to dashboard Cite

Issue addressed: Good nutrition, physical activity and adequate sleep are essential for the healthy growth and development of young children. Due to complex cultural, historical, social factors, Aboriginal and Torres Strait Islander children face additional challenges to optimal health, particularly in remote areas of Australia. 'Learning, Eating, Active Play and Sleep' (LEAPS) was a Queensland-wide professional development program designed to support early childhood education and care (ECEC) educators to implement and reinforce healthy nutrition and physical activity in their services. This article describes the adaptation, implementation and evaluation of LEAPS for remote ECEC settings in Cape York. Methods: An Aboriginal and Torres Strait Islander Reference Group was commissioned to provide advice about the appropriateness of the existing program for Aboriginal and Torres Strait Islander ECEC settings. Based on the advice of the Reference Group, the program was adapted for use in Cape York and was evaluated using the RE-AIM framework and a combination of data sources. Quantitative data provided information about changes to participant knowledge and confidence regarding nutrition and physical activity and in-depth interviews allowed further insights into enablers and challenges for successful program implementation. Conclusion: A tailored LEAPS program increased participants' knowledge and confidence regarding nutrition and physical activity in ECEC settings. The importance of community consultation, building relationships and face-to-face delivery of training were highlighted as key enablers. The evaluation identified a number of challenges relating to competing priorities, limited support for ongoing implementation and adoption of improved practices. So what?: Poor nutrition and growth in children in remote Aboriginal and Torres Strait Islander communities indicates the need for the ongoing commitment to and investment in nutrition and physical activity across a range of community settings. To achieve success, this requires a dedicated preventative health workforce supporting

show abstract

Let’s get technical: Enhancing program evaluation through the use and integration of internet and mobile technologies

Cited by 11 publications

References 30 publications

The role of usability on e-learning user interactions and satisfaction: a literature review

The role of usability on e-learning user interactions and satisfaction: a literature review

Using the PMAQ-AB Mobile App and Management System to Evaluate the Quality of Primary Health Care in Brazil: Qualitative Case Study

Adaptation and evaluation of a nutrition and physical activity program for early childhood education settings in Aboriginal and Torres Strait Islander communities in remote Far North Queensland

Contact Info

Product

Resources

About