Meta is now releasing the larger OPT-66B language model, following the OPT 125 million to 30 billion parameter models (see news below). According to Meta, it is the largest open-source AI language model accessible without restrictions to date.
You can download the 66 billion parameter model and all smaller variants from the OPT Github page. As before, the largest model with 175 billion parameters is only accessible upon request.
Meta’s AI department publishes an extensively trained language model to drive research, particularly on the vulnerabilities of language AI.
OpenAI’s GPT-3 speech AI was a milestone in the development of natural language AI systems. For the first time, an AI model was able to formulate short texts in such a believable and coherent way that they could no longer be recognized by humans as AI-generated. Subsequently, the model proved flexible for many other applications, such as code generation with only minor fine-tuning.
OpenAI has therefore seen a business model in GPT-3 for the first time and offers the speech AI via an API. The actual model is not available to researchers – but this would benefit scientific progress.