ChatGPT talks its way through Wharton MBA, medical exams
OpenAI's chat software ChatGPT, if let loose on the world, would score between a B and a B- on Wharton business school's Operations Management exam, and would approach or exceed the score needed to pass the US Medical Licensing Exam (USMLE).
While this may say more about the static, document-centric nature of testing material than the intellectual prowess of software, it's nonetheless a matter of concern and interest for educators, and just about everyone else living in the age of automation.
Academics have been fretting that assistive systems like ChatGPT and GitHub's Copilot (based on an OpenAI model called Codex) will require teachers to reevaluate how they teach and mark exams because assistive technology based on machine learning has become so capable.
In educational settings, AI advice is becoming commonplace: The Stanford Daily just reported, "a large number of students have already used ChatGPT on their final exams." An estimated 17 percent of students, based on an anonymous poll of 4,497 respondents, said they had used ChatGPT to assist in fall quarter assignments and exams, with 5 percent saying they had submitted material directly from ChatGPT with little or no editing – which is presumably an honor code violation.
