Elon Musk’s xAI made the base code of its AI model Grok open-source on GitHub on Sunday, which is seen as a game-changing move in the future of artificial intelligence by the X owner. He earlier announced on March 11 that xAI will open-source its AI model Grok within a week.
This week, @xAI will open source Grok
— Elon Musk (@elonmusk) March 11, 2024
This open release will now allow researchers to leverage the model. Notably, Grok is an AI model in the race to compete with the models from OpenAI, Meta, and Google, among others.
The blog post shared by the company states that Grok is made from scratch by them. xAI stated,
We are releasing the base model weights and network architecture of Grok-1, our large language model. Grok-1 is a 314 billion parameter Mixture-of-Experts model trained from scratch by xAI.
The firm further stated that the model is not fine-tuned for performing tasks such as conversation. The released raw base model was finished in October 2023. Going into the details, the company said that Grok was,
Trained from scratch by xAI using a custom training stack on top of JAX and Rust in October 2023.
xAI has released the model under the Apache License 2.0. This way, the model can be used for commercial purposes. The AI chatbot was released in November last year, initially only for X Premium+ subscribers.
After buying X, formerly Twitter, Elon Musk has condemned companies that do not open-source their artificial intelligence models, including OpenAI.
Notably, Musk founded OpenAI with Sam Altman but is now suing. In a court filing, Musk alluded to the fact that Altman and other executives were breaking the founding agreement, which was to make OpenAI open-source. Musk said that the company is focusing on personal benefits and not working for the development of humanity.
However, many other major companies have open-sourced several artificial intelligence models. They include Meta’s LLaMa, Mistral, Falcon, and AI2 and Google’s Gemma 2B and Gemma 7B, which were released in February this year.
