Procedural Surgical RCTs in Daily Practice

Abstract

OBJECTIVE: To assess the adoption of recommendation from randomized clinical trials (RCTs) and investigate factors favoring or preventing adoption. BACKGROUND: RCT are considered to be the cornerstone of evidence-based medicine by representing the highest level of evidence. As such, we expect RCT's recommendations to be followed rigorously in daily surgical practice. METHODS: We performed a structured search for RCTs published in the medical and surgical literature from 2009 to 2013, allowing a minimum of 5-year follow-up to convincingly test implementation. We focused on comparative technical or procedural RCTs trials addressing the domains of general, colorectal, hepatobiliary, upper gastrointestinal and vascular surgery. In a second step we composed a survey of 29 questions among ESA members as well as collaborators from their institutions to investigate the adoption of surgical RCTs recommendation. RESULTS: The survey based on 36 RCTs (median 5-yr citation index 85 (24-474), from 21 different countries, published in 15 high-ranked journals with a median impact factor of 3.3 (1.23-7.9) at the time of publication. Overall, less than half of the respondents (47%) appeared to adhere to the recommendations of a specific RCT within their field of expertise, even when included in formal guidelines. Adoption of a new surgical practice was favored by watching videos (46%) as well as assisting live operations (18%), while skepticism regarding the methodology of a surgical RCT (40%) appears to be the major reason to resist adoption. CONCLUSION: In conclusion, surgical RCTs appear to have moderate impact on daily surgical practice. While RCTs are still accepted to provide the highest level of evidence, alternative methods of evaluating surgical innovations should also be explored.

Completion pancreatectomy or a pancreas-preserving procedure during relaparotomy for pancreatic fistula after pancreatoduodenectomy: a multicentre cohort study and meta-analysis

“…Randomized trials on surgical strategies during relaparotomy for pancreatic fistula after pancreatoduodenectomy are not currently available. Such a trial would be difficult to perform as this critically ill population is increasingly rare, and it seems unlikely that surgeons will accept that the surgical strategy in this population is randomized 55 . Although the systematic review summarized the evidence on this topic, it should be noted that the included studies were all small, observational and heterogeneous.…”

HIPEC in Ovarian Cancer Is the Future… and Always Will Be? Results from a Spanish Multicentric Survey

“…It seems reasonable to think that, after an RCT, this clinical practice would be strengthened or weakened by the published results. However, the modification of clinical practice based on the results of an RCT is an unusual practice, especially in the field of surgery [ 16 ]. In addition, one-fifth of surgical clinical trials must be stopped early, and of those that manage to run to completion, one-third will never be published, and it is difficult to contact the principal investigators to obtain valuable information that may be important for the type of patients included in their study [ 17 ].…”

A formula for survival in surgery

“…New knowledge that documents improved care needs to be implemented outside the environment where this knowledge emerged. Unfortunately, data suggest that few RCTs have immediate impact on surgical practice [ 20 ]. This may be the result of the RCTs per se if perceived as not being generalizable in design or inconclusive in results.…”