We are experimenting with short essays at higher frequency, for Latent Space supporters. It gives you a more realtime peek into our thinking and work.

Why GPT Wrappers Are Good, Actually - Latent Space

submited by
Style Pass
2024-11-16 15:00:02

We are experimenting with short essays at higher frequency, for Latent Space supporters. It gives you a more realtime peek into our thinking and work.

When I wrote the AI Engineer essay in 2023, I was writing partially to counter the prevailing narrative of the rise of the “prompt engineer” title. However, I was also countering a narrative on the other side of the technical spectrum, the idea that you had to train models or otherwise “do serious ML” to be of any worth in the new AI economy. This attitude persists to this day, in various forms.

In 2023 people constantly derided GPT wrapper companies (where is the moat?), and startups launched raising $30-$100m in funding just to hand it over to NVIDIA for GPUs to train their own proprietary models. The final nail in the GPT Wrapper coffin came at DevDay when OpenAI seemingly let anyone create their own GPT Wrappers inside of ChatGPT.

the model training startups Character, Adept, Inflection, and Stability have been execuhired, and custom GPTs are generally regarded to have failed,

Leave a Comment