Evaluation of Mathematics Performance of Google Bard on The Mathematics Test of the Vietnamese National High School Graduation Examination

Abstract

<p>This paper presents an evaluation of the mathematics performance of Google Bard on the Mathematics Test of the Vietnamese National High School Graduation Examination. The objective was to assess the accuracy and effectiveness of Google Bard in solving mathematical problems commonly found in the Vietnamese curriculum. To facilitate this evaluation, the VNHSGE Vietnamese dataset was translated into English since Bard does not currently support Vietnamese. The results indicate that Bard achieved a performance of 38.8%, lagging behind ChatGPT and BingChat, which achieved relatively higher scores of 58.8% and 60% respectively. It is important to note that this performance may be influenced by the translation process from Vietnamese to English. As a result, it is not recommended for Vietnamese students to rely on Google Bard for mathematics problem-solving.</p>

Leveraging Large Language Models for Educational Enhancement: A Case Study of ChatGPT, BingChat, and Bard

“…Other research: Other research on LLMs in education, [5][6][7][8][9][10][11][12][13][14][15][16][17][18][19][20], has demonstrated their capabilities in various settings, such as generating personalized learning materials, providing feedback to students on their writing, and helping teachers to assess student learning.…”

Exploring the Impact of ChatGPT on Mathematics Performance: The Influential Role of Student Interest

“…ChatGPT, while serving as a linchpin for augmenting students' interest in mathematics, is not posited as a replacement for conventional classroom instruction. It functions as an expansive online repository, offering unfettered access to educational resources across various domains, including Science, Technology, Engineering, and Mathematics (STEM), as well as in fields like management and accounting education, as elucidated by Nguyen et al (2023).…”

The Influence of ChatGPT and AI Tools on Vietnamese Education

“…Furthermore, previous research efforts have undertaken comprehensive evaluations of these large language models across a wide spectrum of topics and domains [17], [18], [19], [20], [21], [22], [23]. In the specific context of Vietnamese education, the capabilities of language models such as ChatGPT, Bing Chat, and Bard have been systematically assessed [24], [25], [26], [27], [28], [29], [30], [31], [32], [33], [34], [35], [35], [36], [37], [38]. These evaluations contribute valuable insights into the potential applications and limitations of LLMs in the Vietnamese educational landscape.…”