Elon Musk’s company, xAI, has recently open-sourced the foundational code of their highly coveted Grok AI model. This release, however, does not include any training code. In an official blog post, xAI revealed that the model, which is being referred to as the “314 billion parameter Mixture-of-Expert model,” can now be accessed on GitHub.
The company emphasized that the Grok-1 model has not been specifically tuned for any particular use, such as conducting conversations. Furthermore, xAI disclosed that Grok-1 was trained on a “custom” stack, but did not provide further details. It is important to note that the model is made available under the Apache License 2.0, which permits commercial usage.
Just a week ago, Musk announced on social media platform X that xAI is planning to open-source the Grok model within the following week. This chatbot model was previously released in a chatbot form last year exclusively for Premium+ users of X’s network. However, the newly accessible open-source model does not have any connections to the social network.
It is worth mentioning that various prominent companies have previously released open-source versions of their own AI models, such as Meta’s LLaMa, Mistral, Falcon, and AI2. In February of this year, Google also joined in by unveiling their two new open models, known as Gemma2B and Gemma7B.
Several toolmakers, powered by AI, have already expressed their interest in utilizing the Grok model in their solutions. One of them is CEO Arvind Srinivas from Perplexity, who posted on X that they are planning to fine-tune Grok specifically for conversational search and make it accessible to their Pro users.
In a tweet, Srinivas expressed gratitude towards Elon Musk and the xAI team for open-sourcing the base model for Grok. They plan to optimize the inference and make it available for all Pro users.
Musk has been engaged in a legal battle with OpenAI and had filed a lawsuit against them for what he perceived as a “betrayal” of the nonprofit AI goal earlier this month. Since then, he has taken to X multiple times to call out OpenAI and Sam Altman.
[…] Microsoft, Anthropic, and Google. In February, Apple’s CEO Tim Cook announced that the company would be introducing Gen-AI features “later this […]