The Penn Medicine COVID-19 Therapeutics Committee—an inter-specialty, clinician-pharmacist, and specialist–front line primary care collaboration—has served as a forum for rapid evidence review and the production of dynamic practice recommendations during the three-year COVID-19 public health emergency. We describe the process by which the Committee went about its work and how it navigated specific challenging scenarios. Our target audiences are clinicians, hospital leaders, public health officials, and researchers invested in preparedness for inevitable future threats. Our objectives are to discuss the logistics and challenges of forming an effective committee, undertaking a rapid evidence review process, aligning evidence-based guidelines with operational realities, and iteratively revising recommendations in response to changing pandemic data. We specifically discuss: the arc of evidence for corticosteroids; the noble beginnings and dangerous misinformation end of hydroxychloroquine and ivermectin; monoclonal antibodies and emerging viral variants; and patient screening and safety processes for tocilizumab, baricitinib, and nirmatrelvir-ritonavir.