Which LLM is the best? From the rankings of LMArena ChatGPT is the clear winner. But when you do a vibe check Claude is often stronger in coding and

TabGPT: Ask ChatGPT, Gemini and Claude at the same time with one click (Part I)

submited by

Style Pass

2024-10-03 00:30:03

Which LLM is the best? From the rankings of LMArena ChatGPT is the clear winner. But when you do a vibe check Claude is often stronger in coding and sounds more natural. So when using chat models I tend to paste my code often into ChatGPT and Claude. Fun fact: Claude offers 10-20 free questions, so does ChatGPT and Gemini? At some point my OpenAI subscription ended and I kept cycling between the three.

And this only the leaderboard between three companies. Each having different strength, with Gemini specialized on very long context (more than a million tokens), ChatGPT leading the charts and Claude being more human and pragmatic. If they are so good which should I use?

So on a Sunday night lightning struck me. I coded this Chrome extension to query all models. Very simple, prompt it and it will locally open 3 tabs and ask every model and compile the answers. Voila!