How the Connectedness Between Humans and Nature Can Be Increased? Comparing ChatGPT’s Language Use to Scientific Literature

Abstract

The artificial intelligence chatbot ChatGPT can answer questions and solve tasks posed by the user within seconds. Using an exemplary task, this study investigates the reliability and con-sistency of the answers given by ChatGPT. For this purpose, it was analyzed whether the an-swers differ when a question is asked repeatedly and whether selected content categories and associated word combinations coincide with those from scientific literature. ChatGPT was asked 400 times, how the connectedness between humans and nature can be increased. The responses were classified into a categorization system and the most frequently occurring word combina-tions for each category were extracted. These word combinations were used for a search of re-lated scientific literature. In addition, the Normalized Mutual Information (NMI) between the 400 individual responses was calculated. The results show that the phrases used by ChatGPT within the categories are also found in the scientific literature, however, the number of mentions between scientific literature and ChatGPT differs. In addition, the NMI suggested that there are large differences between the categories mentioned in the individual answers. These results in-dicate that ChatGPT currently still has difficulties in answering complex questions and cannot yet replace scientific literature research or academic writing.