An Evaluation of ChatGPT’s Proficiency in English Language Testing of The Vietnamese National High School Graduation Examination

Dao, Xuan-Quy; Le, Ngoc-Bich; Phan, Xuan-Dung; Ngo, Bac-Bien

doi:10.2139/ssrn.4473369

Cited by 19 publications

(30 citation statements)

References 2 publications

Supporting

Mentioning

Contrasting

Unclassified

Order By: Relevance

“…To assess the effectiveness of Google Bard, the VNHSGE Vietnamese dataset [10] consisting of biology questions from the VNHSGE was selected.…”

Section: Methodsmentioning

confidence: 99%

“…Quy et al [10], [11], [12] meticulously evaluated the performance of ChatGPT and Bing Chat in the context of the VNHSGE, encompassing a wide range of subjects, including mathematics [13], literature, English [14], physics [15], chemistry [16], biology, history, geography, and civic education [11]. The outcomes of their comprehensive investigations reveal a remarkable level of proficiency displayed by both ChatGPT and Bing Chat across the diverse spectrum of the VNHSGE Examination, attaining an average score ranging from 6 to 7 for both natural and social science combinations ( [11], [12]).…”

Section: Introductionmentioning

confidence: 99%

“…In [17], Quy et al conducted an in-depth assessment of the performance of Large Language Models (LLMs) using the VNHSGE English dataset [10]. The results obtained from their investigation unveiled that Bing Chat exhibited the most impressive performance, achieving a notable score of 92.4%.…”

Section: Introductionmentioning

confidence: 99%

See 2 more Smart Citations

Evaluation of Google Bard on Vietna mese High School Biology Examination

Hana,

Nguyen,

Nguyen

et al. 2023

Preprint

View full text Add to dashboard Cite

This paper presents an evaluation of the performance of Google Bard on the biology test of the Vietnamese National High School Graduation Examination (VNHSGE). The study aims to assess the accuracy and effectiveness of Google Bard in solving biology problems commonly encountered in the Vietnamese curriculum. To facilitate the evaluation, the VNHSGE dataset was translated from Vietnamese to English, as Google Bard currently lacks support for the Vietnamese language. The findings reveal that Google Bard achieved a performance rate of 49.5%, trailing behind competing models such as ChatGPT and BingChat, which achieved relatively higher scores of 58% and 69%, respectively. Notably, the translation process from Vietnamese to English might have impacted Bard's performance. Therefore, it is not recommended for Vietnamese students to solely depend on Google Bard for solving biology problems, especially if the Vietnamese language is not supported. Students should consider using language models explicitly designed for biology, such as ChatGPT or BingChat.

show abstract

“…To assess the effectiveness of Google Bard, the VNHSGE Vietnamese dataset [10] consisting of biology questions from the VNHSGE was selected.…”

Section: Methodsmentioning

confidence: 99%

Section: Introductionmentioning

confidence: 99%

See 1 more Smart Citation

Evaluation of Google Bard on Vietna mese High School Biology Examination

Hana,

Nguyen,

Nguyen

et al. 2023

Preprint

View full text Add to dashboard Cite

show abstract

“…When a complex question is asked, the answer will be complex. 17 Some of these restrictions in the field of health can have irreparable damages. For example, with limited knowledge of ChatGPT, if the patient performs treatment based on ChatGPT responses and that treatment is not suitable for the person, it can worsen the condition for him.…”

Section: Disadvantages Of Using Chatgpt In Healthcarementioning

confidence: 99%

What are the applications of ChatGPT in healthcare: Gain or loss?

Montazeri,

Galavi,

Ahmadian

2024

Health Science Reports

View full text Add to dashboard Cite

ChatGPT is a large language model developed by Open AI, based on the GPT (Generative Pre-trained Transformer) architecture. It is an AI system that can understand natural language and generate coherent and contextually appropriate responses to a wide range of prompts and questions. 1,2 Today, this language model is in the center of attention in healthcare and other domains. Although this language model has several advantages in healthcare and medical education, it also has disadvantages. In this article, we discuss on these issues and provide some recommendations regarding this topic.

show abstract

“…Hana et al [2], [3], [4] conducted several studies exploring the role of ChatGPT in Vietnamese education and identified its potential contributions to administrators, teachers, and students. Quy et al, in a series of studies [5], [6], [7], [8], [9], [10], evaluated the performance of ChatGPT on the Vietnamese National High School Graduation Examination, which covers subjects such as mathematics, literature, English, physics, chemistry, biology, history, geography, and civic education. The findings from these studies indicate that ChatGPT demonstrates a general proficiency in the examination, achieving an average score of 6-7 for both natural and social science combinations.…”

Section: Introductionmentioning

confidence: 99%

Potential of ChatGPT in Biology Teaching and Learning at the Vietnamese High School

Nguyen,

Cao

et al. 2023

Preprint

View full text Add to dashboard Cite

The use of artificial intelligence (AI) technologies in education has gained significant attention in recent years. In this paper, we explore the potential of ChatGPT, a language model based on the GPT-3.5 architecture, in biology teaching and learning at Vietnamese high schools. We discuss the capabilities of ChatGPT in biology as well as potential directions for using this technology in the classroom. We believe that ChatGPT has the potential to be a valuable tool for biology education in Vietnam and can help to improve the quality of education for students. It could be used to provide personalized learning for students, offer feedback on student work, or generate practice questions. ChatGPT could also be used to create interactive learning experiences that engage students and help them to better understand biological concepts.

show abstract

An Evaluation of ChatGPT’s Proficiency in English Language Testing of The Vietnamese National High School Graduation Examination

Cited by 19 publications

References 2 publications

Evaluation of Google Bard on Vietna mese High School Biology Examination

Evaluation of Google Bard on Vietna mese High School Biology Examination

What are the applications of ChatGPT in healthcare: Gain or loss?

Potential of ChatGPT in Biology Teaching and Learning at the Vietnamese High School

Contact Info

Product

Resources

About