W ith the increasing emphasis on "using evidence" and "value for money" in health services, it is essential that researchers, clinicians, health system managers and public policy-makers be able to retrieve relevant, high-quality reports of health services research (HSR). Efficiently retrieved research evidence can aid in decisionmaking about which services to provide and in the resource allocation decisions to support those services, reducing the need for arbitrary decisions and aiding collaboration with clinicians and consumers.1 MEDLINE is a huge and expanding bibliographic resource that is freely available to all with Internet access. Yet the volume of the literature often overwhelms both clinicians and health system decisionmakers. 2,3 End-users of MEDLINE and other large bibliographic databases have difficulty executing precise searches 2,3 and are often unaware of what kind of information to seek, where to find it 3,4 and how to judge its quality.
3HSR has been defined as the scientific study of the effect of health care delivery; the organization and management of health care access, quality, cost and financing; and the evaluation of the impact of health services and technology (Allmang NA, Koonce TY. Health services research topic searches. Bethesda [MD]: National Library of Medicine; 2000. Unpublished report). More recently, HSR has been defined as the multidisciplinary field of scientific investigation that studies how social factors, financing systems, organizational structures and processes, health technologies and personal behaviours affect access to health care, the quality and cost of health care and, ultimately, health and well-being.5 HSR articles constitute only a tiny fraction of the MEDLINE database and are spread through a large number of journals; hence, MEDLINE searching is challenging. Conversely, journal browsing is impractical as a means of retrieving all relevant studies for a given question or staying abreast of the literature. Our aim was to develop methodologic search filters for MEDLINE to enable endusers to efficiently retrieve articles of relevance to clinical practice guidelines (CPGs) and the appropriateness, process, outcomes, cost and economics of health services.
MethodsWe compared the retrieval performance of methodologic search terms and phrases in MEDLINE with a manual review of each article in each issue of 68 journal titles for the year 2000 for the study categories of appropriateness, process assessment, outcome assessment, CPGs, cost and economics of care.
Search termsCandidate content and methodologic terms (text words and Medical Subject Headings [MeSH] [exploded and nonexploded], publication types) were compiled by reviewing "gold standard" articles and their MEDLINE indexing, the definitions in Table 1 and the criteria in Table 2; by consulting experts in bibliographic database searching for HSR topics (mainly health sciences librari- rently thinly spread through many journals, making it difficult for health services researchers, managers and policy-makers to fin...