Here are four key takeaways from the article:
- ByteDance has launched BAGEL, a powerful 7B-parameter open-source multimodal AI model capable of advanced image generation and understanding, similar to GPT-4o.
- BAGEL excels beyond basic generation, offering superior image editing, free-form visual manipulation, future frame prediction, and 3D manipulation.
- The model’s robust performance is built on a Mixture-of-Transformer-Experts (MoT) architecture and extensive training on trillions of interleaved multimodal data.
- BAGEL demonstrates “emerging properties,” where complex reasoning and editing capabilities appear in later training stages, underscoring the impact of scale and rich data.
The AI landscape is buzzing with ByteDance’s latest innovation: BAGEL. This new open-source multimodal foundation model is making waves with its impressive image generation and understanding capabilities, positioning itself as a strong contender alongside models like OpenAI’s GPT-4o. BAGEL isn’t just another model; it’s a significant step forward in democratizing advanced AI.
With 7 billion active parameters (14B total), BAGEL has been trained on vast amounts of large-scale interleaved multimodal data, including text, images, videos, and web data. This extensive training allows it to excel in a variety of complex tasks. Let’s dive into what makes the ByteDance BAGEL model a game-changer.

Table of contents
- What is the ByteDance BAGEL Model?
- BAGEL’s Key Capabilities: Beyond Basic Generation
- How Does BAGEL Perform? A Look at the Benchmarks
- The Technology Powering BAGEL
- Unlocking “Emerging Properties” with BAGEL
- Getting Started with the ByteDance BAGEL Model
- Why BAGEL Matters for the AI Community
- The Future is Multimodal with BAGEL
What is the ByteDance BAGEL Model?
BAGEL, which stands for Bridge to Advanced Generative and Editing Learning, is a unified, decoder-only model. Developed by ByteDance Seed, it natively supports both multimodal understanding and generation. This means BAGEL can process and comprehend information from different modalities (like text and images) and also generate new content in these forms.
The release of BAGEL as an open-source project is particularly exciting. It allows researchers, developers, and AI enthusiasts worldwide to access, use, and build upon this powerful technology. You can find its resources on GitHub and Hugging Face.

BAGEL’s Key Capabilities: Beyond Basic Generation
ByteDance’s BAGEL model isn’t just about generating images from text. Its capabilities are far-reaching and demonstrate a sophisticated level of AI.
Superior Image Editing and Generation
BAGEL has shown remarkable qualitative results in classical image editing scenarios. It often outperforms leading open-source models like Flux and even competes with specialized generators such as SD3 in text-to-image quality. The model can handle nuanced editing requests, making it a versatile tool for creative professionals.
Advanced Multimodal Reasoning
One of BAGEL’s standout features is its capacity for complex multimodal reasoning. This allows it to go beyond simple tasks and engage in:
- Free-form visual manipulation: Intuitively edit images based on complex instructions.
- Future frame prediction: Anticipate subsequent frames in a video sequence.
- 3D manipulation: Understand and interact with 3D concepts.
- World navigation: Exhibit capabilities that constitute “world-modeling,” understanding spatial relationships and navigating within conceptual environments.
These advanced reasoning abilities open up new possibilities for AI applications, from smarter content creation tools to more intuitive virtual assistants.
How Does BAGEL Perform? A Look at the Benchmarks
The ByteDance BAGEL model has been rigorously tested against various industry benchmarks, and the results are impressive.
Visual Understanding
In visual understanding tasks, BAGEL has demonstrated strong performance, often surpassing other top-tier open-source Vision Language Models (VLMs) like Qwen2.5-VL and InternVL-2.5.
- MME: BAGEL scores 2388.
- MMBench: Achieves a score of 85.0.
- MMMU: Records 55.3.
- MM-Vet: Scores 67.2.
- MathVista: Impressively scores 73.1.
These scores highlight BAGEL’s robust ability to comprehend and interpret visual information in conjunction with text.
Text-to-Image Generation
When it comes to generating images from text, BAGEL holds its own against strong competitors.
- GenEval: BAGEL, especially when using Chain-of-Thought (CoT) reasoning, achieves a score of 0.88, outperforming models like Janus-Pro-7B (0.80) and SD3-Medium (0.74).
- WISE: On the WISE benchmark, which evaluates complex semantic understanding and world knowledge in T2I, BAGEL with CoT scores 0.70. Without CoT, it still achieves a respectable 0.52, ahead of FLUX-1-dev (0.50).
Image Editing
BAGEL truly shines in image editing benchmarks.
- GEdit-Bench-EN: It scores 7.36 (SC), 6.83 (PQ), and 6.52 (O), showing competitive performance.
- IntelligentBench: This is where BAGEL, particularly with CoT, excels, scoring 55.3. This significantly outperforms models like Step1X-Edit (14.9) and is competitive with proprietary models in certain aspects.
These benchmark results underscore the power and versatility of the ByteDance BAGEL model.

The Technology Powering BAGEL
The impressive capabilities of BAGEL are a result of its sophisticated architecture and training methodology.
Mixture-of-Transformer-Experts (MoT) Architecture
BAGEL utilizes a Mixture-of-Transformer-Experts (MoT) architecture. This design is key to maximizing the model’s capacity to learn from diverse and rich multimodal information. It allows different “experts” within the model to specialize in handling various types of data and tasks, leading to more efficient and effective learning.
To further enhance its capacity, BAGEL employs two separate encoders: one for capturing pixel-level features of an image and another for semantic-level features. The overall framework follows a Next Group of Token Prediction paradigm, where the model is trained to predict the next sequence of language or visual tokens.
Rigorous Training Regimen
BAGEL’s proficiency comes from a multi-stage training process involving trillions of interleaved multimodal tokens:
- Pre-training: Building foundational knowledge from vast datasets.
- Continued Training: Further refining capabilities on more specialized data.
- Supervised Finetuning: Honing the model for specific tasks and improving instruction following.
This comprehensive training enables BAGEL to not only perform well on standard benchmarks but also to exhibit advanced in-context multimodal abilities.
Unlocking “Emerging Properties” with BAGEL
A fascinating aspect of scaling up models like BAGEL is the appearance of “emerging properties.” ByteDance researchers observed that as BAGEL’s pretraining progressed with more multimodal tokens, different capabilities emerged at distinct stages:
- Early Stages: Multimodal understanding and basic generation capabilities appear first.
- Mid Stages: Basic image editing functionalities start to surface.
- Later Stages: Complex, intelligent editing and advanced reasoning emerge.
This staged progression suggests that advanced multimodal reasoning builds upon well-formed foundational skills. Ablation studies further revealed that combining VAE (Variational Autoencoder) and ViT (Vision Transformer) features significantly enhances intelligent editing. This highlights the critical role of visual-semantic context in enabling complex multimodal reasoning and the emergence of these advanced capabilities.
Getting Started with the ByteDance BAGEL Model
ByteDance has made it easy for the community to explore and utilize BAGEL.
- Set up your environment: Clone the GitHub repository and install the necessary requirements.
git clone https://github.com/bytedance-seed/BAGEL.gitcd BAGELconda create -n bagel python=3.10 -yconda activate bagelpip install -r requirements.txt
- Download the pretrained checkpoint: Use the Hugging Face Hub to download the model weights.
from huggingface_hub import snapshot_downloadsave_dir = "/path/to/save/BAGEL-7B-MoT" # Specify your save directoryrepo_id = "ByteDance-Seed/BAGEL-7B-MoT"cache_dir = save_dir + "/cache"snapshot_download(cache_dir=cache_dir, local_dir=save_dir, repo_id=repo_id, local_dir_use_symlinks=False, resume_download=True, allow_patterns=["*.json", "*.safetensors", "*.bin", "*.py", "*.md", "*.txt"], )
- Start experimenting: The inference.ipynb notebook in the GitHub repository provides a starting point for playing with BAGEL.
The BAGEL team also encourages users to share any “bad cases” or instances where the model performs poorly to help further improve it.
Why BAGEL Matters for the AI Community
The release of the ByteDance BAGEL model is significant for several reasons:
- Open Source: It provides widespread access to a state-of-the-art multimodal model, fostering innovation and research.
- Advanced Capabilities: It pushes the boundaries of what open-source models can achieve in image generation, editing, and complex reasoning.
- Competition and Progress: It offers a powerful alternative to proprietary models, driving further competition and accelerating progress in the AI field.
- Understanding AI: Studying BAGEL’s architecture and its “emerging properties” can provide deeper insights into how large AI models learn and develop complex skills.
The Future is Multimodal with BAGEL
The ByteDance BAGEL model is a testament to the rapid advancements in multimodal AI. Its ability to seamlessly understand and generate content across different data types, coupled with its sophisticated reasoning skills, makes it an invaluable tool for a wide range of applications. As an open-source project, BAGEL empowers the global AI community to explore new frontiers and build the next generation of intelligent systems. The journey of multimodal AI is just beginning, and BAGEL is set to play a pivotal role in shaping its future.
| Latest From Us
- Forget Towers: Verizon and AST SpaceMobile Are Launching Cellular Service From Space

- This $1,600 Graphics Card Can Now Run $30,000 AI Models, Thanks to Huawei

- The Global AI Safety Train Leaves the Station: Is the U.S. Already Too Late?

- The AI Breakthrough That Solves Sparse Data: Meet the Interpolating Neural Network

- The AI Advantage: Why Defenders Must Adopt Claude to Secure Digital Infrastructure


