ChatGPT Is Still a Bullshit Machine

How many U.S. states include the letter “R” in their name? You may not know the answer off the top of your head, but any literate adult could figure it out with a list of the states and minimal effort. Unfortunately, OpenAI’s ChatGPT doesn’t know the answer, even its new GPT-5 model. Because generative AI is still a deeply flawed tool, despite being sold by its creators as a god-like entity that can answer literally anything.

I was inspired to ask the question after seeing a Bluesky post on Thursday, not long after GPT-5 was released earlier that day. The user said they asked GPT-5 how many American states used the letter R, and it included Indiana, Illinois, and Texas on the list. I tried it myself and ChatGPT replied that there were 21 states (which is accurate), but with a list that included Illinois, Massachusetts, and Minnesota, none of which contain the letter R. I decided to dig deeper.

The bot ended its response to my question with “If you want, I can also show you a neat trick for counting them without missing any.” I replied “ok” and it responded with these tips, all of which were normal and reasonable:

Leave a Comment