Bard_mathematics.pdf (313.9 kB)

Evaluation of Mathematics Performance of Google Bard on The Mathematics Test of the Vietnamese National High School Graduation Examination

Download (313.9 kB)
posted on 2023-07-20, 19:59 authored by Phong NguyenPhong Nguyen, Phuong Nguyen, Philippe Bruneau, Linh Cao, Jin Wang, Hana Truong

This paper presents an evaluation of the mathematics performance of Google Bard on the Mathematics Test of the Vietnamese National High School Graduation Examination. The objective was to assess the accuracy and effectiveness of Google Bard in solving mathematical problems commonly found in the Vietnamese curriculum. To facilitate this evaluation, the VNHSGE Vietnamese dataset was translated into English since Bard does not currently support Vietnamese. The results indicate that Bard achieved a performance of 38.8%, lagging behind ChatGPT and BingChat, which achieved relatively higher scores of 58.8% and 60% respectively. It is important to note that this performance may be influenced by the translation process from Vietnamese to English. As a result, it is not recommended for Vietnamese students to rely on Google Bard for mathematics problem-solving.


Email Address of Submitting Author

Submitting Author's Institution


Submitting Author's Country

  • France

Usage metrics