Do Not Lose Your Nerve, Be Callus: Insights Into Neural Regulation of Fracture Healing

Self Cite

Purpose of Review With the recent explosion in the use of artificial intelligence (AI) and specifically ChatGPT, we sought to determine whether ChatGPT could be used to assist in writing credible, peer-reviewed, scientific review articles. We also sought to assess, in a scientific study, the advantages and limitations of using ChatGPT for this purpose. To accomplish this, 3 topics of importance in musculoskeletal research were selected: (1) the intersection of Alzheimer’s disease and bone; (2) the neural regulation of fracture healing; and (3) COVID-19 and musculoskeletal health. For each of these topics, 3 approaches to write manuscript drafts were undertaken: (1) human only; (2) ChatGPT only (AI-only); and (3) combination approach of #1 and #2 (AI-assisted). Articles were extensively fact checked and edited to ensure scientific quality, resulting in final manuscripts that were significantly different from the original drafts. Numerous parameters were measured throughout the process to quantitate advantages and disadvantages of approaches. Recent Findings Overall, use of AI decreased the time spent to write the review article, but required more extensive fact checking. With the AI-only approach, up to 70% of the references cited were found to be inaccurate. Interestingly, the AI-assisted approach resulted in the highest similarity indices suggesting a higher likelihood of plagiarism. Finally, although the technology is rapidly changing, at the time of study, ChatGPT 4.0 had a cutoff date of September 2021 rendering identification of recent articles impossible. Therefore, all literature published past the cutoff date was manually provided to ChatGPT, rendering approaches #2 and #3 identical for contemporary citations. As a result, for the COVID-19 and musculoskeletal health topic, approach #2 was abandoned midstream due to the extensive overlap with approach #3. Summary The main objective of this scientific study was to see whether AI could be used in a scientifically appropriate manner to improve the scientific writing process. Indeed, AI reduced the time for writing but had significant inaccuracies. The latter necessitates that AI cannot currently be used alone but could be used with careful oversight by humans to assist in writing scientific review articles.

Section: Human-generated and Written Review Articlesmentioning

confidence: 99%

“…(2) neural regulation of fracture healing [16][17][18]; and (3) COVID-19 and musculoskeletal health [19,20]. With this background, we hypothesized that the human paper would take the most time and require the fewest changes between the first and final drafts.…”

Section: Introductionmentioning

confidence: 99%

The Use of Artificial Intelligence in Writing Scientific Review Articles

Kacena,

Plotkin,

Fehrenbacher

2024

Self Cite

“…To test this possibility in scientific writing, we created an experiment to see if the current state of LLMs, and more specifically ChatGPT 4.0, would be able to increase the efficiency of writing scientific review articles. To accomplish this, we first identified 3 topics of importance to the musculoskeletal research field: (1) COVID-19 and musculoskeletal health [ 4 , 5 ]; (2) the intersection of Alzheimer’s disease and bone [ 6 – 8 ]; and (3) the neural regulation of fracture healing [ 9 – 11 ]. We then implemented 3 approaches to write the first draft of review articles on each topic: (1) human only; (2) ChatGPT 4.0 only (AI-only or AIO); and (3) a combination of approaches 1 and 2 (AI-assisted or AIA).…”

Section: Introductionmentioning

confidence: 99%

The Utility of AI in Writing a Scientific Review Article on the Impacts of COVID-19 on Musculoskeletal Health

Awosanya,

Harris,

Creecy

et al. 2024

Self Cite

Purpose of Review There were two primary purposes to our reviews. First, to provide an update to the scientific community about the impacts of COVID-19 on musculoskeletal health. Second, was to determine the value of using a large language model, ChatGPT 4.0, in the process of writing a scientific review article. To accomplish these objectives, we originally set out to write three review articles on the topic using different methods to produce the initial drafts of the review articles. The first review article was written in the traditional manner by humans, the second was to be written exclusively using ChatGPT (AI-only or AIO), and the third approach was to input the outline and references selected by humans from approach 1 into ChatGPT, using the AI to assist in completing the writing (AI-assisted or AIA). All review articles were extensively fact-checked and edited by all co-authors leading to the final drafts of the manuscripts, which were significantly different from the initial drafts. Recent Findings Unfortunately, during this process, it became clear that approach 2 was not feasible for a very recent topic like COVID-19 as at the time, ChatGPT 4.0 had a cutoff date of September 2021 and all articles published after this date had to be provided to ChatGPT, making approaches 2 and 3 virtually identical. Therefore, only two approaches and two review articles were written (human and AI-assisted). Here we found that the human-only approach took less time to complete than the AI-assisted approach. This was largely due to the number of hours required to fact-check and edit the AI-assisted manuscript. Of note, the AI-assisted approach resulted in inaccurate attributions of references (about 20%) and had a higher similarity index suggesting an increased risk of plagiarism. Summary The main aim of this project was to determine whether the use of AI could improve the process of writing a scientific review article. Based on our experience, with the current state of technology, it would not be advised to solely use AI to write a scientific review article, especially on a recent topic.

Use of AI Language Engine ChatGPT 4.0 to Write a Scientific Review Article Examining the Intersection of Alzheimer’s Disease and Bone

Margetts,

Karnik,

Wang

et al. 2024

Purpose of Review This Comment represents three review articles on the relationship between Alzheimer’s disease, osteoporosis, and fracture in an exploration of the benefits that AI can provide in scientific writing. The first drafts of the articles were written (1) entirely by humans; (2) entirely by ChatGPT 4.0 (AI-only or AIO); and (3) by humans and ChatGPT 4.0 whereby humans selected literature references, but ChatGPT 4.0 completed the writing (AI-assisted or AIA). Importantly, each review article was edited and carefully checked for accuracy by all co-authors resulting in a final manuscript which was significantly different from the original draft. Recent Findings The human-written article took the most time from start to finish, the AI-only article took the least time, and the AI-assisted article fell between the two. When comparing first drafts to final drafts, the AI-only and AI-assisted articles had higher percentages of different text than the human article. The AI-only paper had a higher percentage of incorrect references in the first draft than the AI-assisted paper. The first draft of the AI-assisted article had a higher similarity score than the other two articles when examined by plagiarism identification software. Summary This writing experiment used time tracking, human editing, and comparison software to examine the benefits and risks of using AI to assist in scientific writing. It showed that while AI may reduce total writing time, hallucinations and plagiarism were prevalent issues with this method and human editing was still necessary to ensure accuracy.