GPT-4 Can Clear up Math Issues — However Not in All Languages | by Yennie Jun | Oct, 2023

A couple of experiments making GPT-4 resolve math issues in 16 completely different languages

This text was initially posted on my personal website.

It’s mentioned that mathematics is a universal language — mathematical ideas, theorems, and definitions will be expressed as symbols which are comprehensible no matter language.

On this article, I check the mathematical capabilities of GPT-4 in sixteen completely different languages.

Early experiments confirmed GPT-4 scoring highly on the SAT Math and AP Calculus tests and on undergraduate-level mathematics. Nevertheless, the vast majority of these experiments check GPT-4’s mathematical capabilities solely in English. To raised perceive GPT-4’s mathematical capabilities past English, I immediate it on the identical math issues in fifteen different languages.

So, how good is GPT-4 at math in several languages? In idea, it must be equally good (or dangerous) throughout all languages, however sadly (as you may need guessed), this isn’t the case. GPT-4 is significantly better at fixing math issues in English. Relying on the language, GPT-4 may resolve a few of the issues. For historically under-resourced languages, nonetheless, similar to Burmese and Amharic, GPT-4 was unable to resolve the issues I gave it.

I take advantage of mathematical issues from the Project Euler web site to check GPT-4. (That is additionally a throwback to certainly one of my one of my earlier articles from this year, the place I used immediate engineering utilizing ChatGPT to resolve just a few Undertaking Euler issues). Undertaking Euler, named for the eponymous mathematician, is a web site with lots of of mathematical and laptop programming issues ranging in problem. Began in 2001, they boast over 850 issues (as of October 2023) and launch a brand new query roughly each week.

The wonderful thing about Undertaking Euler questions is that every downside has a numerically “right” reply — this makes it straightforward to test if GPT-4’s reply is objectively right or not. Additionally they are usually much more difficult than high-school or college-level math issues. Presently, there isn’t any large-scale complete…