A semantic analysis approach for assessing professionalism using free-form text entered online

Blake, Roger; Gutiérrez, Óscar

doi:10.1016/j.chb.2011.07.004

Cited by 15 publications

(9 citation statements)

References 38 publications

Supporting

Mentioning

Contrasting

Unclassified

Order By: Relevance

“…Again, LSA was applied by [25] for assessing the professionalism, depending on five attitudinal categories of free-form text responses from participants in a professional development program. In this work, a previous preprocessing step based on standardization, stop word removal and Porter stemming was applied to obtain the term-document matrix.…”

Section: Related Workmentioning

confidence: 99%

Including Content-Based Methods in Peer-Assessment of Open-Response Questions

Luaces

Díez

Alonso-Sanz

et al. 2015

2015 IEEE International Conference on Data Mining Workshop (ICDMW)

View full text Add to dashboard Cite

Abstract-Massive Open Online Courses (MOOCs) are attracting the attention of a huge number of students all around the world. These courses include different types of assignments in order to evaluate the student's knowledge. However, these assignments are designed to allow a straightforward automatic evaluation. But, in this way it is not possible to evaluate some skills that would require answering open-response questions. Peerassessment (the students are asked to assess other assignments), is an effective method to overcome the impossibility of having staff graders for this task. Additionally, students gain a deeper knowledge about the subject of the assignments that they have to read critically. However, the grades given by student-graders must be filtered to avoid bias due to a lack of experience in assessment tasks. There are a number of approaches to do this. In this paper we present a factorization approach that in addition to the grades given by graders is able to incorporate a representation of the contents of the responses given by students using a Vector Space Model of the assignments. So we fill the gap between peer-assessment and content-based methods that use a shallow linguistic processing. The paper includes a report of the results obtained using this approach in a real world dataset collected in 3 universities of Spain, A Coruña, Pablo de Olavide at Sevilla, and Oviedo at Gijón. The scores obtained by the method presented here were compared with those provided by the staff of these universities. We report a considerable improvement whenever we use the content-based approach. In any case, we conclude that there is no evidence that staff grading would have led to more accurate grading outcomes than the assessment produced by our models.

show abstract

Section: Related Workmentioning

confidence: 99%

Including Content-Based Methods in Peer-Assessment of Open-Response Questions

Luaces

Díez

Alonso-Sanz

et al. 2015

2015 IEEE International Conference on Data Mining Workshop (ICDMW)

View full text Add to dashboard Cite

show abstract

“…The concept of professionalism has been defined in various ways, but elements common to all include knowledge, skills, trustworthiness, commitment to the profession, self-regulation, autonomy, a belief in public service, and the use of a professional association as a referent (Beaton, 2010;Blake and Gutierrez, 2011;Hamilton, 2013).…”

Section: Professional Identity and Professionalismmentioning

confidence: 99%

The impact of library associations: preliminary findings of a qualitative study

Henczel

2014

Performance Measurement and Metrics

View full text Add to dashboard Cite

Purpose -The purpose of this paper is to provide an overview, including methodology and preliminary findings, of a current and ongoing doctoral research study of the impact of national library associations. The study uses the impact assessment framework provided by ISO16439:2014 Methods and procedures for assessing the impact of libraries. Design/methodology/approach -If the professional associations supporting the profession are to become sustainable we need to understand the difference they make to the individual members of the profession, to the employers of those individuals and to the profession of librarianship. This study applies the framework provided by ISO 16439:2014 to the national library association environment to explore and gather evidence of impact. To align with the ISO model, impact is differentiated into impact on individuals; social impact -institution (library or employing organization); and social impact -community (the profession). Preliminary findings show evidence of impact in all categories. Findings -Data were gathered through semi-structured interviews that were conducted with members of national library associations in Australia, New Zealand, the UK and the USA during the third quarter of 2013. Originality/value -This study contributes to research methodologies by testing the use of a qualitative assessment tool in a way that could be transferable to other associations both within and external to the library environment and to enable it to be adapted more broadly for other purposes within the library and information environment.

show abstract

“…A pilot LSA study that evaluated six students' answers to three questions in the computer science domain reported high precision despite a small dataset [26]. LSA was also used to assess participants in a professional development program according to five attitudinal categories of free-form text responses [27], with preprocessing -based on standardization, stop-word removal and Porter stemming -implemented in order to obtain the term-document matrix. Pérez et al [28] proposed combining BLEU and LSA to assess open-ended answers.…”

Section: Related Workmentioning

confidence: 99%