Conducting a pilot study: case study of a novice researcher

Abstract

Pilot studies play a vital role in health research, but are often misused, mistreated and misrepresented. A well-conducted pilot study with clear aims and objectives within a formal framework ensures methodological rigour, can lead to higher-quality research and scientifically valid work that is publishable and can benefit patients and health service delivery. A pilot study contributes valuable information to assist researchers in the conduct of their study. Conducting a pilot study provides the researcher with the opportunity to develop and enhance the skills necessary before commencing the larger study. By conducting a pilot the researcher obtains preliminary data, can evaluate their data-analysis method and clarify the financial and human resources required. This article presents an overview of pilot studies, why they are conducted, what to consider when reporting pilot studies and the authors' experience of conducting a pilot study. To conduct a successful study, researchers need to develop their skills, choose the right methods and carefully plan for all aspects of the process.

Pilot Testing for Feasibility in a Study of Student Retention and Attrition in Online Undergraduate Programs

“…Researchers have come to understand that not only can pilots help answer methodological questions that could guide the researcher toward "empirically determined non-arbitrary answers to design issues" that need to be addressed (Prescott & Soeken, 1989, p. 60), pilot studies can serve other important purposes (Doody & Doody, 2015). An investigator might undertake a pilot in order to evaluate the execution of the methods and feasibility of recruitment, randomization, retention, measurement, and assessment procedures; the implementation of new procedures and interventions (Leon, Davis, & Kraemer, 2011); refining new and existing tools (Polit & Beck, 2004), or widening or narrowing eligibility criteria for the recruitment of participants (Conn, Algase, Rawl, Zerwic, & Wyman 2010).…”

“…A pilot study is often performed to test the feasibility of techniques, methods, questionnaires, and interviews and how they function together in a particular context; it can also reveal ethical and practical issues that could hamper the main study (Doody & Doody, 2015). Therefore, pilot studies help researchers identify design flaws, refine data collection and analysis plans; gain experience with and train the research team; assess recruitment processes; and learn important information about participant burden prior to undertaking the larger study (Prescott & Soeken, 1989;Beebe, 2007).…”

“…Publishing is important for a number of reasons, not the least of which is that learning from the results of other pilot projects could potentially conserve time, energy, and research resources (Hinds & Gattuso, 1991;Doody & Doody, 2015;Eldridge et al, 2016). Additionally, the publishing of pilot outcomes in one field could facilitate collaborative projects with individuals in other areas once they are informed of the researcher's interests; what is learned in one profession or disciplinary area can be applied to other fields.…”

“…Sharing key information, including pitfalls, can prevent unnecessary duplication of efforts and over-expenditure of public resources. More importantly, in research involving humans, it can minimize the impact on human subjects (Connelly, 2008;Conn et al, 2010;Wolfe, 2013;Doody & Doody, 2015) and facilitate culturally competent research (Kim, 2011). Therefore, researchers have both scientific and ethical obligations to try to publish the results of every research endeavor (Thabane et al, 2010).…”

“…Although course examinations and expected outcomes might be somewhat standardized, educational interventions are meant to be student-centered and highly individualized as opposed to highly standardized. Nevertheless, as described above, properly conducted Doody & Doody, 2015). In the next section, we describe the process and outcomes of a pilot study conducted prior to the main study on attrition and retention in two undergraduate programs offered by distance education.…”