Background: Natural language processing models such as ChatGPT can generate text-based content and are poised to become a major information source in medicine and beyond. The accuracy and completeness of ChatGPT for medical queries is not known. Methods: Thirty-three physicians across 17 specialties generated 284 medical questions that they subjectively classified as easy, medium, or hard with either binary (yes/no) or descriptive answers. The physicians then graded ChatGPT-generated answers to these questions for accuracy (6-point Likert scale; range 1 – completely incorrect to 6 – completely correct) and completeness (3-point Likert scale; range 1 – incomplete to 3 - complete plus additional context). Scores were summarized with descriptive statistics and compared using Mann-Whitney U or Kruskal-Wallis testing. Results: Across all questions (n=284), median accuracy score was 5.5 (between almost completely and completely correct) with mean score of 4.8 (between mostly and almost completely correct). Median completeness score was 3 (complete and comprehensive) with mean score of 2.5. For questions rated easy, medium, and hard, median accuracy scores were 6, 5.5, and 5 (mean 5.0, 4.7, and 4.6; p=0.05). Accuracy scores for binary and descriptive questions were similar (median 6 vs. 5; mean 4.9 vs. 4.7; p=0.07). Of 36 questions with scores of 1-2, 34 were re-queried/re-graded 8-17 days later with substantial improvement (median 2 vs. 4; p<0.01). Conclusions: ChatGPT generated largely accurate information to diverse medical queries as judged by academic physician specialists although with important limitations. Further research and model development are needed to correct inaccuracies and for validation.

No abstract

Despite revolutionizing cancer management, immunotherapies dysregulate the immune system leading to immune-mediated adverse events. These common and potentially dangerous toxicities are often treated with corticosteroids, which are among the most prescribed drugs in oncology for a wide range of cancer and non-cancer indications. While steroids exert several mechanisms to reduce immune activity, immunotherapies, such as immune checkpoint inhibitors (ICI), are designed to enhance the immune system’s inherent antitumor activity. Because ICI requires an intact and robust immune response, the immunosuppressive properties of steroids have led to a widespread concern they may interfere with antitumor responses. However, the existing data of the effect of systemic steroids on immunotherapy efficacy remain somewhat conflicted and unclear. To inform clinical decision making and improve outcomes, we review the impact of steroids on antitumor immunity, recent advances in the knowledge of their impact on ICI efficacy in unique populations and settings, associated precautions, and steroid-sparing treatment approaches.

SummaryImmune checkpoint inhibitors have transformed cancer therapy, but their optimal use is still constrained by lack of response and toxicity. Biomarkers of response may facilitate drug development by allowing appropriate therapy selection and focusing clinical trial enrollment. However, aside from PD‐L1 staining in a subset of tumors and rarely mismatch repair deficiency, no biomarkers are routinely used in the clinic. In addition, severe toxicities may cause severe morbidity, therapy discontinuation, and even death. Here, we review the state of the field with a focus on our research in therapeutic biomarkers and toxicities from immune checkpoint inhibitors.

No abstract

No abstract

ImportanceAnti–programmable cell death-1 (anti–PD-1) improves relapse-free survival when used as adjuvant therapy for high-risk resected melanoma. However, it can lead to immune-related adverse events (irAEs), which become chronic in approximately 40% of patients with high-risk melanoma treated with adjuvant anti–PD-1.ObjectiveTo determine the incidence, characteristics, and long-term outcomes of chronic irAEs from adjuvant anti–PD-1 therapy.Design, Setting, and ParticipantsThis retrospective multicenter cohort study analyzed patients treated with adjuvant anti–PD-1 therapy for advanced and metastatic melanoma between 2015 and 2022 from 6 institutions in the US and Australia with at least 18 months of evaluable follow-up after treatment cessation (range, 18.2 to 70.4 months).Main Outcomes and MeasuresIncidence, spectrum, and ultimate resolution vs persistence of chronic irAEs (defined as those persisting at least 3 months after therapy cessation). Descriptive statistics were used to analyze categorical and continuous variables. Kaplan-Meier curves assessed survival, and Wilson score intervals were used to calculate CIs for proportions.ResultsAmong 318 patients, 190 (59.7%) were male (median [IQR] age, 61 [52.3-72.0] years), 270 (84.9%) had a cutaneous primary, and 237 (74.5%) were stage IIIB or IIIC at presentation. Additionally, 226 patients (63.7%) developed acute irAEs arising during treatment, including 44 (13.8%) with grade 3 to 5 irAEs. Chronic irAEs, persisting at least 3 months after therapy cessation, developed in 147 patients (46.2%; 95% CI, 0.41-0.52), of which 74 (50.3%) were grade 2 or more, 6 (4.1%) were grade 3 to 5, and 100 (68.0%) were symptomatic. With long-term follow-up (median [IQR], 1057 [915-1321] days), 54 patients (36.7%) experienced resolution of chronic irAEs (median [IQR] time to resolution of 19.7 [14.4-31.5] months from anti–PD-1 start and 11.2 [8.1-20.7] months from anti–PD-1 cessation). Among patients with persistent irAEs present at last follow-up (93 [29.2%] of original cohort; 95% CI, 0.25-0.34); 55 (59.1%) were grade 2 or more; 41 (44.1%) were symptomatic; 24 (25.8%) were using therapeutic systemic steroids (16 [67%] of whom were on replacement steroids for hypophysitis (8 [50.0%]) and adrenal insufficiency (8 [50.0%]), and 42 (45.2%) were using other management. Among the 54 patients, the most common persistent chronic irAEs were hypothyroid (38 [70.4%]), arthritis (18 [33.3%]), dermatitis (9 [16.7%]), and adrenal insufficiency (8 [14.8%]). Furthermore, 54 [17.0%] patients experienced persistent endocrinopathies, 48 (15.1%) experienced nonendocrinopathies, and 9 (2.8%) experienced both. Of 37 patients with chronic irAEs who received additional immunotherapy, 25 (67.6%) experienced no effect on chronic irAEs whereas 12 (32.4%) experienced a flare in their chronic toxicity. Twenty patients (54.1%) experienced a distinct irAE.Conclusions and RelevanceIn this cohort study of 318 patients who received adjuvant anti–PD-1, chronic irAEs were common, affected diverse organ systems, and often persisted with long-term follow-up requiring steroids and additional management. These findings highlight the likelihood of persistent toxic effects when considering adjuvant therapies and need for long-term monitoring and management.

No abstract