IBM releases new open source Granite Large Language Model (LLM) enhancements every few months. Granite 3.1 is the latest generation model that builds on the success of Granite 3.0. This model provides enhanced functionality and performance optimized for business applications.
Also: Gemini Advanced users now have access to Google’s most experimental models
The Granite 3.1 model family features a 128K token context window, which is a significant increase compared to the previous generation. This expansion enables the model to process and understand even larger amounts of text (equivalent to approximately 85,000 English words), enabling more comprehensive analysis and generation tasks. By comparison, OpenAI’s ChatGPT 3, which sparked the AI revolution, could only process 2,000 tokens.
Outperform your competitors
Big Blue claims its new Granite 8B Instruct model outperforms rival products such as Google Gemma 2, Meta Llama 3.1, and Qwen 2.5 on HuggingFace’s OpenLLM Leaderboard benchmark.
Also: Want to integrate Generative AI LLM with your business data? You need RAG
The Granite 3.1 family includes high-density models and Mixture of Experts (MoE) variants. IBM says the Granite 2B and 8B models are text-only, dense LLMs trained on more than 12 trillion data tokens. The dense model is designed to support tool-based use cases and streamline search augmentation generation (RAG), code generation, transformations, and bug fixes.
The MoE model is trained on over 10 trillion data tokens. IBM claims these models are ideal for deployment in low-latency, on-device applications.
Improved graphics and language features
The new release also introduces image input/text output functionality, expanding the model’s applicability to graphics-based enterprises.
Granite 3.1 also improves foreign language proficiency. In addition to English, we now support over a dozen languages, including German, Spanish, French, Japanese, Portuguese, Arabic, Czech, Italian, Korean, Dutch, and Simplified Chinese. Ta. So, if you have an international business, IBM has an LLM that you can use.
As before, the new Granite LLM is licensed under the Apache 2 Open Source License. IBM also maintains its commitment to openness by making training datasets publicly available and providing comprehensive documentation of model development and performance.
Generative AI also poses new risks for everyone. Here’s how to stay safe
If you’re concerned about intellectual property issues and AI, IBM provides uncapped coverage for third-party IP claims related to the use of your models. You may not be worried about such potential legal issues yet, but you definitely will be.
Powerful and reliable AI for enterprises
Granite 3.1 models are available on IBM’s Watsonx platform. Cloud service providers such as Google Vertex AI. AI platforms include Hugging Face, NVIDIA (as a NIM microservice), Ollama, and Replicate.
The release of Granite 3.1 is set to accelerate AI adoption in enterprise environments. By combining these models with their own data using technologies such as IBM’s InstructLab, companies have the potential to achieve task-specific performance comparable to larger models at a fraction of the cost.
As the AI landscape rapidly evolves, IBM’s Granite 3.1 represents a major step forward in providing enterprises with powerful, efficient, and reliable AI tools to drive innovation and solve complex business challenges. I am.
