After ChatGPT released late last year, it quickly made headlines for its ability to take — and often pass — high-level academic exams, including law school tests, the U.S. Medical Licensing Exam, and Ivy League MBA finals.
This week, OpenAI unveiled the new, advanced version of its chatbot technology, called GPT-4, and put the artificial intelligence model to the test before its debut.
GPT-4 took a wide range of simulated exams, from sommelier assessments to graduate school admission tests. Here's how it scored, compared to the older model that ChatGPT uses, called GPT-3.5.
And while ChatGPT did poorly on the Uniform Bar Examination, scoring in the lower 10th percentile, GPT-4 scored in the 90th percentile.
GPT-4 didn't improve on ChatGPT's performance for the AP English Language or Literature exams (it got a 2 out of 5 on both), or the writing portion of the Graduate Record Examination (GRE).
It also didn't score well on an advanced Leetcode exam, which tests developers' skills to prepare them for technical interviews.