The largest openly available foundation model to date, Llama 3.1 405B, is now available on Groq. Groq is proud to partner on this key industry launch making the latest Llama 3.1 models, including 405B Instruct, 70B Instruct, and 8B Instruct, available to the community running at Groq speed. The three models are accessible on GroqCloud Dev Console , a community of over 300K developers already building on Groq® systems, and on GroqChat for the general public.
“I'm really excited to see Groq's ultra-low-latency inference for cloud deployments of the Llama 3.1 models. This is an awesome example of how our commitment to open source is driving innovation and progress in AI. By making our models and tools available to the community, companies like Groq can build on our work and help push the whole ecosystem forward.”
The Llama 3.1 models are a significant step forward in terms of capabilities and functionality. As the largest and most capable openly available Large Language Model (LLM) to date, Llama 3.1 405B rivals industry-leading closed-source models. For the first time, enterprises, startups, researchers, and developers can access a model of this scale and capability without proprietary restrictions, enabling unprecedented collaboration and innovation. With Groq, AI innovators can now tap into the immense potential of Llama 3.1 405B, running at record speeds, on GroqCloud to build more sophisticated and powerful applications.