Development of a Psychometrically Valid Training Needs Analysis Instrument for Use with Primary Health Care Teams

Abstract

The growing demand for professional updating and training within the health service has created a proliferation of post-registration courses, many of which fail to reach the appropriate personnel or the real training objectives of the participants and their managers. One reason behind this problem relates to the fact that many such courses are constructed and delivered in a haphazard way, without systematic reference to the direct and indirect consumers of the educational programmes. A more rational approach to post-experience provision of this sort might involve the methodical collection of information regarding the training needs of target health professional populations. Such a data base would afford a global overview of competencies and deficiencies, both within and between individuals. From this the content, level and focus of training could be customized to meet the reported needs, thereby streamlining the commissioning process to enhance efficiency and effectiveness. Previous attempts to rationalize provision through the prior use of training needs analysis instruments have been compromised by the shortcomings of the analysis tool. This study, then, was an attempt to redress this problem, using a training needs analysis instrument developed along traditional psychometric principles. The tool was intended to be used with primary health care teams because of the increasing role this sector of the health service will play in the future delivery of care, although this would not preclude its use with other health care professionals (following appropriate modification), since the principles behind its construction and format are transferable. The instrument has demonstrable construct, content and face validity and significant reliability. Moreover, preliminary investigations suggest that it also has criterion validity in the areas tested. These findings suggest that the instrument is unique of its kind. Early use of the tool has demonstrated its value in a variety of ways, such as in team building exercises and skill mix reviews as well as in precise and effective commissioning of training and education in a range of areas.

Translating and validating a Training Needs Assessment tool into Greek

“…To determine the questionnaire's criterion validity, the same methodology as outlined by the original developers was followed [6]. Information about the respondents' research experience contained in two questions in the biographical cover sheet of the questionnaire was coded by two of the researchers along a 6-point scale (0 = no research involvement, 5 = significant involvement).…”

“…A thorough literature search did not reveal any relevant instrument in the Greek language, whereas there were several studies using an English psychometrically valid and reliable instrument, developed by Hicks, Hennessy and Barwell [6]. The Training Needs Assessment (TNA) questionnaire has been adapted and used in several English-speaking countries and its record of use with various health care professionals is well-documented [7-9].…”

The research potential of practice nurses

“…A mix of open and closed questions was employed, with open questions used to identify respondents’ research priorities and factors affecting their ability to undertake research. Questions were developed around themes identified in the literature (Hunt 1991, Hicks et al . 1996, Hagen & Hunt 1998).…”

Personnel planning in general practices: development and testing of a skill mix analysis method

“…The findings were sub-divided into three categories, indicating whether the method measures need (for example [12, 13]), confronts demand and supply (for example [14, 15]), or determines skill mix (for example [16, 17]). None of the methods identified systematically aligned demand and skill mix in general practice.…”