xAI open sources base model of Grok, but without any training code

xAI opensources the base code of Grok AI model without any training code. The company describes it as the 314 billion parameter Mixture-of-Expert model on GitHub. However, the model isn’t tuned for specific applications like conversation usage. It was trained on a “custom” stack without providing further details. The model is licensed under Apache License 2.0, allowing commercial use cases.

Elon Musk’s xAI planned to release the Grok model this week after announcing it last year through the chatbot form, accessible only to Premium+ users of his social network, X. Unlike the chatbot, the open-source model won’t connect to the social network. Other noteworthy companies, including Meta and Google, have also open-sourced some of their AI models.

Some AI-tool creators are considering incorporating Grok into their solutions. For instance, Perplexity CEO Aravind Srinivas plans to fine-tune Grok for conversational search and offer it to Pro users. As xAI continues to contribute to the advancement of AI technology, we can expect more developments from them soon.

xAI open sources base model of Grok, but without any training code