Elon Musk’s xAI has open-sourced the bottom code of Grok AI mannequin, however with none coaching code. The corporate described it because the “314 billion parameter Mixture-of-Expert model” on GitHub.
In a weblog put up, xAI mentioned that the mannequin wasn’t tuned for any specific utility akin to utilizing it for conversations. The corporate famous that Grok-1 was educated on a “custom” stack with out specifying particulars. The mannequin is licensed underneath Apache License 2.0, which allows industrial use instances.
Final week, Musk famous on X that xAI meant to open-source the Grok model this week. The corporate launched Grok in a chatbot form last year, accessible to Premium+ customers of X social community. Notably, the chatbot may entry a few of the X knowledge, however the open-source mannequin doesn’t embrace connections to the social community.
Many notable corporations have open-sourced a few of their AI fashions together with Meta’s LLaMa, Mistral, Falcon, and AI2. In February, Google additionally launched two new open fashions known as Gemma2B and Gemma7B.
Some AI-powered software makers are already speaking about utilizing Grok of their options. Perplexity CEO Arvind Srinivas posted on X that the corporate will fine-tune Grok for conversational search and make it accessible to Professional customers.
Musk has been in a authorized battle with OpenAI and sued the company earlier this month over the “betrayal” of the nonprofit AI goal. Since then, he has known as out OpenAI and Sam Altman on X multiple times.
