Response Rates and Response Bias for 50 Surveys of Pediatricians

Abstract

Research Objective. To track response rates across time for surveys of pediatricians, to explore whether response bias is present for these surveys, and to examine whether response bias increases with lower response rates. Data Source/Study Setting. A total of 63,473 cases were gathered from 50 different surveys of pediatricians conducted by the American Academy of Pediatrics (AAP) since 1994. Thirty-one surveys targeted active U.S. members of the AAP, six targeted pediatric residents, and the remaining 13 targeted AAP-member and nonmember pediatric subspecialists. Information for the full target samples, including nonrespondents, was collected using administrative databases of the AAP and the American Board of Pediatrics. Study Design. To assess bias for each survey, age, gender, location, and AAP membership type were compared for respondents and the full target sample. Correlational analyses were conducted to examine whether surveys with lower response rates had increasing levels of response bias. Principal Findings. Response rates to the 50 surveys examined declined significantly across survey years (1994)(1995)(1996)(1997)(1998)(1999)(2000)(2001)(2002). Response rates ranged from 52 to 81 percent with an average of 68 percent. Comparisons between respondents and the full target samples showed the respondent group to be younger, to have more females, and to have less specialty-fellow members. Response bias was not apparent for pediatricians' geographical location. The average response bias, however, was fairly small for all factors: age (0.45 years younger), gender (1.4 percentage points more females), and membership type (1.1 percentage points fewer specialty-fellow members). Gender response bias was found to be inversely associated with survey response rates (r 5 À 0.38). Even for the surveys with the lowest response rates, amount of response bias never exceeded 5 percentage points for gender, 3 years for age, or 3 percent for membership type. Conclusions. While response biases favoring women, young physicians, and nonspecialty-fellow members were found across the 52-81 percent response rates examined in this study, the amount of bias was minimal for these factors that could be tested. At least for surveys of pediatricians, more attention should be devoted by investigators to assessments of response bias rather than relying on response rates as a proxy of response bias.

Impact Of Pediatricians’ Perceived Self-Efficacy and Confidence on Violence Prevention Counseling: A National Study

“…Also, since the response rate was only 53%, attitudes and perceptions of non-respondents may have differed from respondents. But, although some non-response bias was found with females being more likely to respond to the survey, this tendency is consistent with previous AAP surveys where the non-response bias was examined and found to be minimal [38]. Finally, results from this study are based on AAP membership, which constitutes a large subset but not all U.S. pediatricians and no family physicians.…”

Stigma and treatment of eating disorders in Ireland: healthcare professionals’ knowledge and attitudes

“…Second, as there is no available information about the characteristics of non-responders, it is not possible to determine whether those who did respond were demographically or professionally distinctive in some way. However, other studies have found that low response rates in surveys of healthcare professionals only minimally increase the risk of response bias (Cull et al 2005). In addition, our results correspond with findings from other jurisdictions relating to both knowledge (e.g.…”

Indomethacin Use for the Management of Patent Ductus Arteriosus in Preterms: A Web-Based Survey of Practice Attitudes Among Neonatal Fellowship Program Directors in the United States

“…The response rate we observed is comparable to reported response rates from other Web-based surveys of physicians and surveys involving neonatologists [7,15,36]. Response rates for physician surveys are on average more than 10% lower than those for nonphysician surveys and have declined during the past decade [3,11]. Due to limited resources, we were not able to employ multiple Because variations in practice attitudes that are due to insufficient evidence may have important implications for long-term outcomes of these vulnerable premature infants, there is a need to conduct studies on the use of multiple courses of indomethacin for PDA closure and the use of indomethacin for reopened PDA beyond the first 2 weeks.…”

“…We did not solicit identifying information from the participants per institutional review board policies for exempt research, and therefore we were not able to target nonresponders. Previous studies of nonresponse to pediatrician surveys have found that low response rates are not necessarily an indicator of response bias [11].…”