Use of AI Language Engine ChatGPT 4.0 to Write a Scientific Review Article Examining the Intersection of Alzheimer’s Disease and Bone

Abstract

Purpose of Review This Comment represents three review articles on the relationship between Alzheimer’s disease, osteoporosis, and fracture in an exploration of the benefits that AI can provide in scientific writing. The first drafts of the articles were written (1) entirely by humans; (2) entirely by ChatGPT 4.0 (AI-only or AIO); and (3) by humans and ChatGPT 4.0 whereby humans selected literature references, but ChatGPT 4.0 completed the writing (AI-assisted or AIA). Importantly, each review article was edited and carefully checked for accuracy by all co-authors resulting in a final manuscript which was significantly different from the original draft. Recent Findings The human-written article took the most time from start to finish, the AI-only article took the least time, and the AI-assisted article fell between the two. When comparing first drafts to final drafts, the AI-only and AI-assisted articles had higher percentages of different text than the human article. The AI-only paper had a higher percentage of incorrect references in the first draft than the AI-assisted paper. The first draft of the AI-assisted article had a higher similarity score than the other two articles when examined by plagiarism identification software. Summary This writing experiment used time tracking, human editing, and comparison software to examine the benefits and risks of using AI to assist in scientific writing. It showed that while AI may reduce total writing time, hallucinations and plagiarism were prevalent issues with this method and human editing was still necessary to ensure accuracy.

The Use of Artificial Intelligence in Writing Scientific Review Articles

“…Once a complete first draft was written, the manuscript underwent extensive editing and fact checking by all co-authors. Please see the associated Comment for each of the review articles to see the respective first drafts [21][22][23]. Reference citations were inserted into the manuscript using EndNote.…”

“…An author without an extensive AI background began by experimenting to determine the best queries for generating their AI-only review articles [14,17]. Please refer to the Comments for each review topic [21][22][23] for a complete listing of all queries used to generate the AIO review articles. The AI model that was used to write first drafts of papers was the ChatGPT Plus version using the GPT-4 language model (OpenAI).…”

“…The first step of the AI-only paper was to generate an outline and a title for the review article. While each set of authors (for the 3 different review topics) used different query strategies [21][22][23], an example from the "Neural regulation of fracture healing" topic is provided below: You are a PhD-level biological researcher who has experience writing sophisticated research paper outlines. Write a 2.5-page outline for a paper on the neural regulation of fracture healing.…”

“…Reference citations were inserted into the manuscript using EndNote. Of note, the unedited, first drafts of all articles are provided in the Comment associated with each review topic [21][22][23].…”

“…Slight differences in queries were utilized between authors but the general system described below was used. Again, please see the Comment associated with each review topic to see a complete listing of queries used [21][22][23].…”