IBM continues to push the boundaries of enterprise-focused artificial intelligence with its latest release: IBM Granite 3.3. This significant update expands the Granite family’s capabilities, introducing powerful new features for speech processing, refining reasoning abilities, and offering innovative tools to enhance retrieval-augmented generation (RAG).
Staying true to IBM’s commitment, all Granite 3.3 models and tools are open source under the Apache 2.0 license, empowering developers and businesses worldwide. Let’s dive into what makes this release exciting.

Table of contents
Introducing Granite Speech 3.3 8B: Hearing and Understanding Clearly
The headline feature of this release is Granite Speech 3.3 8B, IBM’s first official speech-to-text (STT) model under the Granite banner. This isn’t just about converting spoken words to text; it’s about doing it accurately and efficiently for real-world business needs.

Key Capabilities: Transcription and Translation
Granite Speech 3.3 excels in two primary areas:
- Automatic Speech Recognition (ASR): Converting spoken language into written text. IBM’s internal testing shows Granite Speech consistently delivering high accuracy, often outperforming well-known open and closed models on standard datasets.
- Automatic Speech Translation (AST): Translating spoken English into various other languages, including French, Spanish, Italian, German, Portuguese, Japanese, and Mandarin. Performance here is competitive with leading proprietary models.
This makes Granite Speech a versatile tool for applications dealing with audio input, from meeting transcriptions to multilingual customer support analysis.
Smart Design for Better Performance
Under the hood, Granite Speech 3.3 uses a clever two-pass design. It combines a specialized speech encoder and projector with the powerful Granite 3.3 8B Instruct large language model (LLM).
If you give the model an audio file, it first transcribes it using the speech components. Then, if you ask questions about the audio, it uses the LLM to analyze the transcribed text. This separation ensures that the model’s text understanding capabilities remain top-notch, avoiding performance drops often seen in combined multimodal models.
Another significant advantage? Granite Speech can handle audio inputs longer than the typical 30-second limit found in many Whisper-based models. While IBM suggests sticking to 1-minute chunks for optimal accuracy currently (as it’s not yet fine-tuned on very long audio), it can technically process much longer files without the artificial cuts that can introduce errors.
The Future of Granite Speech
IBM is already working on enhancements for future versions, including:
- Handling audio input in multiple languages directly.
- Using better and more diverse training data.
- Integrating audio understanding more deeply into the model from the start.
- Adding the ability to detect emotions in speech.
Granite 3.3 Instruct: Smarter Text Models with New Tricks
Alongside the speech model, IBM released updated text-only models: Granite 3.3 8B Instruct and its smaller sibling, Granite 3.3 2B Instruct. These models build upon previous versions with enhanced reasoning and a brand-new capability.
Filling in the Blanks: Fill-in-the-Middle (FIM)
Most language models predict the next word in a sequence. Granite 3.3 Instruct models can now also “fill in the middle.” This means they can predict missing text based on the text that comes before and after it.
This FIM capability is incredibly useful, especially for coding tasks like:
- Repairing code or fixing errors.
- Refactoring or restructuring code.
- Generating boilerplate code snippets quickly.
- Inserting function arguments or documentation strings.
IBM also released the base versions of these models, allowing developers to fine-tune them for their own specific FIM or other text-generation needs.
Even Better Reasoning
Building on the reasoning improvements introduced in Granite 3.2, the 3.3 Instruct models have been further refined using advanced techniques like Thought Preference Optimization (TPO) and Group Relative Policy Optimization (GRPO).
The result? These models show significant improvements, particularly on complex mathematical reasoning tasks. For instance, Granite 3.3 8B Instruct performs impressively on the MATH500 benchmark, holding its own against much larger models and surpassing many popular competitors.

Importantly, this enhanced “thinking” capability can be toggled on or off, allowing developers to choose between deeper reasoning for complex tasks or faster, more cost-efficient responses for simpler ones.
Supercharging RAG with LoRA Adapters
Retrieval-Augmented Generation (RAG) is a popular technique where LLMs use external documents to provide more accurate and context-aware answers. IBM is making RAG even better for Granite users by releasing a suite of specialized Low-Rank Adaptation (LoRA) adapters for the Granite 3.2 8B Instruct model (with adapters for 3.3 coming soon).
LoRAs are small, efficient add-ons that fine-tune a model for specific tasks without retraining the entire thing. The new RAG-focused LoRAs include:
- RAG Hallucination Detection: Scores how faithfully the model’s answer reflects the provided documents, helping to identify potential inaccuracies.
- RAG Query Rewrite: Automatically rephrases conversational user queries into standalone questions for better results from retrieval systems.
- RAG Citation Generation: Adds citations to the model’s output, showing which parts of the source documents support each sentence.
- RAG Answerability Prediction: Determines if a question can actually be answered using the provided documents before generating a response.
- Uncertainty Prediction: Provides a score indicating how confident the model is in its answer based on its training data.
Introducing Activated LoRAs (aLoRAs)
IBM Research also developed an experimental new type called activated LoRAs (aLoRAs). These offer the same task-specific benefits but allow for seamless switching between different adapters without the usual performance slowdown, saving time and computing resources.
Smarter Workflows with Multiple LoRAs
These adapters aren’t just meant to be used in isolation. IBM envisions workflows where multiple LoRAs are chained together. For example, you could first use Query Rewrite, then generate an answer, then use Hallucination Detection to check it, and finally use Citation Generation before showing the user the result. This multi-step process can lead to significantly more reliable and useful RAG applications.
Open Source Access and Getting Started
IBM remains committed to the open-source community.
- Where to Find Them: All new Granite 3.3 models and LoRA adapters are available on Hugging Face. The Instruct models are also integrated into IBM watsonx.ai (where you can try the 8B model in the Granite Playground) and platform partners like LMStudio, Ollama, and Replicate.
- Resources: Developers can find helpful guides, recipes, and tutorials in the Granite docs and the Granite Snack Cookbook on GitHub. Check out tutorials on transcribing podcasts with Granite Speech or building research agents with Granite Reasoning and Vision models.
What’s Next for IBM Granite?
The innovation doesn’t stop here. IBM Research is already training Granite 4.0, promising significant advances in speed, the amount of context models can handle, and overall capacity. Expect more powerful, yet practical and efficient, models designed for real-world enterprise deployment later this year.
Conclusion: A Leap Forward for Enterprise AI
IBM Granite 3.3 marks a significant expansion of IBM’s open-source AI toolkit. With the introduction of sophisticated speech recognition and translation via Granite Speech, enhanced reasoning and the versatile FIM capability in Granite Instruct, and powerful RAG-enhancing LoRA adapters, IBM is providing developers with more tools to build robust, reliable, and efficient AI applications. Whether you’re focused on audio processing, complex text tasks, or building smarter RAG systems, the Granite 3.3 release offers compelling new capabilities worth exploring.
| Latest From Us
- Forget Towers: Verizon and AST SpaceMobile Are Launching Cellular Service From Space

- This $1,600 Graphics Card Can Now Run $30,000 AI Models, Thanks to Huawei

- The Global AI Safety Train Leaves the Station: Is the U.S. Already Too Late?

- The AI Breakthrough That Solves Sparse Data: Meet the Interpolating Neural Network

- The AI Advantage: Why Defenders Must Adopt Claude to Secure Digital Infrastructure


