Evaluation of Mathematics Performance of Google Bard on The Mathematics Test of the Vietnamese National High School Graduation Examination

Abstract

<p>This paper presents an evaluation of the mathematics performance of Google Bard on the Mathematics Test of the Vietnamese National High School Graduation Examination. The objective was to assess the accuracy and effectiveness of Google Bard in solving mathematical problems commonly found in the Vietnamese curriculum. To facilitate this evaluation, the VNHSGE Vietnamese dataset was translated into English since Bard does not currently support Vietnamese. The results indicate that Bard achieved a performance of 38.8%, lagging behind ChatGPT and BingChat, which achieved relatively higher scores of 58.8% and 60% respectively. It is important to note that this performance may be influenced by the translation process from Vietnamese to English. As a result, it is not recommended for Vietnamese students to rely on Google Bard for mathematics problem-solving.</p>

Leveraging Large Language Models for Educational Enhancement: A Case Study of ChatGPT, BingChat, and Bard

“…Other research: Other research on LLMs in education, [5][6][7][8][9][10][11][12][13][14][15][16][17][18][19][20], has demonstrated their capabilities in various settings, such as generating personalized learning materials, providing feedback to students on their writing, and helping teachers to assess student learning.…”