“…Additional work with helping student writing and its connections to critical thinking using a several step assignment and regular feedback to students has also been studied and reported. 13 In addition to these observations, a few articles have appeared that suggest avenues for enhancing student learning by leveraging GAI tools. 14−16 In one case, several possible ways to incorporate GAI are suggested.…”
Section: ■ Introductionmentioning
confidence: 99%
“…As has been noted in several other studies, there are specific aspects of the narrative needed to describe organic mechanistic reasoning where GAI does not yet appear to be sufficiently trained. Additional work with helping student writing and its connections to critical thinking using a several step assignment and regular feedback to students has also been studied and reported …”
In the field of education, ChatGPT has become a topic of debate for its usefulness as a learning tool. This article focuses on non-science majors' (n = 29) perceptions of a ChatGPT enabled final exam, where, prior to the exam, students wrote papers on science and sustainability and, during the final exam, students were asked to compare their paper to one produced on the same topic by ChatGPT. Thus, the underlying chemistry, its broader impacts, and connection to sustainability and writing styles were compared. Students' perceptions were analyzed through a developed coding framework that enabled the visualization of emerging themes. The most common themes revealed that students believed the ChatGPT essay did not read as "human-like", used more intricate words, and often did not include enough science to support its arguments. Students also noted that their essays provided more chemistry details and were easier to read as they focused on connecting chemistry concepts to their essay topic as well as sustainable policies and practices. Students were impressed, however, by ChatGPT's ability to discuss various sustainability solutions, policies, and practices. The final exam inspired self-reflection for the students to improve not only their writing but also their analysis of sustainability responses. Overall, students rated the comparative activity as a final exam to be favorable and remarked on the importance of analyzing AI generated work for the future of learning.
“…Additional work with helping student writing and its connections to critical thinking using a several step assignment and regular feedback to students has also been studied and reported. 13 In addition to these observations, a few articles have appeared that suggest avenues for enhancing student learning by leveraging GAI tools. 14−16 In one case, several possible ways to incorporate GAI are suggested.…”
Section: ■ Introductionmentioning
confidence: 99%
“…As has been noted in several other studies, there are specific aspects of the narrative needed to describe organic mechanistic reasoning where GAI does not yet appear to be sufficiently trained. Additional work with helping student writing and its connections to critical thinking using a several step assignment and regular feedback to students has also been studied and reported …”
In the field of education, ChatGPT has become a topic of debate for its usefulness as a learning tool. This article focuses on non-science majors' (n = 29) perceptions of a ChatGPT enabled final exam, where, prior to the exam, students wrote papers on science and sustainability and, during the final exam, students were asked to compare their paper to one produced on the same topic by ChatGPT. Thus, the underlying chemistry, its broader impacts, and connection to sustainability and writing styles were compared. Students' perceptions were analyzed through a developed coding framework that enabled the visualization of emerging themes. The most common themes revealed that students believed the ChatGPT essay did not read as "human-like", used more intricate words, and often did not include enough science to support its arguments. Students also noted that their essays provided more chemistry details and were easier to read as they focused on connecting chemistry concepts to their essay topic as well as sustainable policies and practices. Students were impressed, however, by ChatGPT's ability to discuss various sustainability solutions, policies, and practices. The final exam inspired self-reflection for the students to improve not only their writing but also their analysis of sustainability responses. Overall, students rated the comparative activity as a final exam to be favorable and remarked on the importance of analyzing AI generated work for the future of learning.
“…As chatbots evolve, they are beginning to be adopted within chemistry education. ,− Its diffusion into the lives of chemistry instructors and students is complicated and ever-changing. ,, Within the chemistry classroom, instructors have utilized chatbots to benefit students’ understanding of chemistry. , Chemistry education researchers have also reflected on the potential of chatbots to benefit students; potentially instructors could use chatbots to create more personalized learning experiences. , This implies a variety of instructional possibilities including: accommodating language differences, tailoring projects to the interests of groups, and giving real-time personalized feedback on assignments and assessments. Further, researchers have argued that the thoughtful incorporation of chatbots within a chemistry curriculum could decrease students’ cognitive load and emphasize students’ problem-solving and reasoning skills. , One specific study has found that a chatbot-centered assignment improved students’ confidence in their problem-solving and reasoning skills, yet there was insignificant improvement in students’ confidence in their creativity and ability to distinguish biased, unreliable, or inaccurate information . Some educators have commented on the potential of embracing the technology as a comprehensive tutoring system for students .…”
Instructors
use of Artificial Intelligence (AI) language models
(i.e., chatbots) as an educational resource will require an understanding
of students’ AI literacy, namely their ability to critically
reflect on the relevance, trustworthiness, and quality of these tools
in the context of chemistry. This study sought to describe students'
AI literacy via open-ended surveys of general chemistry I students
and students in an upper-level chemistry elective. Thematic analysis
was used to create a deeper understanding of chemistry students’
AI literacy when considering chatbots. Based on students’ responses,
they were categorized as either with reservations toward chatbots
or without reservations toward chatbots. Thematically, students tended
to either reason with the utility/benefit of the tool or reason with
concern toward the accuracy of the tool. Results suggest that students
are more of a range between these two extremes. This new deeper understanding
of AI literacy in chemistry can support instructional practices and
inform future research efforts in AI literacy.
“…With the emergence of these new technologies, students have the capability to use GAI tools to generate responses to questions that are meant to use the writing process to support and promote student learning. This raises academic integrity concerns for many educators. − However, some educators posit that GAI-based chatbots may be beneficial to help students develop programming skills, enhance critical thinking skills, , and improve conceptual understanding of chemical concepts . Alasadi and Baiz believe that GAI technologies can help create personalized learning experiences through adaptive learning, provide real-time feedback and assessment, and aid English-as-an-additional language learners in overcoming language barriers. − Emenike and Emenike hypothesize that these technologies can also benefit instructors in their teaching (e.g., creating assessment items and scoring rubrics), research (e.g., as a tool to create summaries of text-based data), and professional activities (e.g., generate text for job application statements and letters of recommendation) …”
The chemistry education research community values and emphasizes the role of constructing explanations and mechanistic reasoning to support students' learning of organic chemistry. Emerging large language model (LLM) and generative artificial intelligence (GAI) technologies are uniquely equipped to advance the teaching and learning of chemistry. GAI-based chatbots, such as ChatGPT, have the potential to help students learn mechanistic reasoning through their generated responses. This study investigates the extent to which 255 ChatGPTgenerated responses are accurate explanations of 85 different reaction mechanisms and exhibit mechanistic reasoning as categorized by the levels of explanation sophistication framework. The study also explores the effects of prompt engineering on mechanism accuracy and explanation sophistication through three types of prompt cueing. Study findings show that (1) a quarter of responses are fully accurate explanations of reaction mechanisms and the majority contain predominantly accurate explanations of chemical phenomena and identification of nucleophiles and electrophiles, (2) responses exhibit high levels of explanation sophistication, and (3) prompt engineering plays a significant role in eliciting high levels of explanation sophistication but not mechanism description accuracy. Results are situated in mechanistic reasoning and prompt engineering frameworks with a focus on how these new technologies can be integrated into the chemistry classroom.
scite is a Brooklyn-based organization that helps researchers better discover and understand research articles through Smart Citations–citations that display the context of the citation and describe whether the article provides supporting or contrasting evidence. scite is used by students and researchers from around the world and is funded in part by the National Science Foundation and the National Institute on Drug Abuse of the National Institutes of Health.