Digital Product Studio

Stable Diffusion SDXL v1.0 and ComfyUI: How to Install and Use

In the world of advanced AI image generation, the convergence of technology reaches new heights with the fusion of Stable Diffusion SDXL v1.0 and the revolutionary ComfyUI interface. ComfyUI provides a user-friendly interface to use the advanced image generation capabilities of SDXL 1.0, allowing users to create more realistic and detailed images with improved ease and efficiency.

The combination of SDXL v1.0 and ComfyUI together enables users to experiment with various parameters and create custom workflows for different use cases. So, when SDXL 1.0 and ComfyUI team up, it’s like they open the door to a world of creativity where anyone can make their own awesome pictures without any hard stuff.

In this article, we will delve into how these two amazing things work together to create fantastic images and how to install and use them together. But firstly, we will have a look at their short introduction and how they are powerful together. So without any further wait, let’s get started!

How to Install and Use SDXL v1.0 and ComfyUI together
Learn How to Install and Use Stable Diffusion SDXL v1.0 and ComfyUI Together in our Comprehensive Guide

SDXL v1.0 and ComfyUI: Basic Intro

SDXL v1.0

  • SDXL 1.0 is the latest version of the Stable Diffusion XL model released by Stability.ai on July 26, 2023.
  • It provides improved image generation capabilities, including the ability to generate legible text within images, better representation of human anatomy, and a variety of artistic styles.
  • SDXL 1.0 also has a better understanding of shorter prompts, reducing the need for lengthy text to achieve desired results.

ComfyUI

  • ComfyUI is a powerful and modular GUI for Stable Diffusion, allowing users to create advanced workflows using a node/graph interface.
  • It fully supports the latest Stable Diffusion models, including SDXL 1.0 and lets users chain together different operations like upscaling, inpainting, and model mixing within a single UI.
  • ComfyUI’s node-based workflow builder makes it easy to experiment with different generative pipelines for state-of-the-art results.

How ComfyUI is Different Than Other Stable Diffusion UIs

Unlike other Stable Diffusion interfaces, ComfyUI offers a node-based workflow builder, which provides more flexibility and control over the creation and execution of workflows.

ComfyUI also supports a wider range of operations and models, including the latest SDXL 1.0, which can be seamlessly integrated into the workflows.

So, by using ComfyUI with/in SDXL 1.0, users can save and reload their entire layout of nodes in ComfyUI, enabling them to reuse complex workflows across multiple images.

Install and Use SDXL v1.0 and ComfyUI together
SDXL Generated Image through the fusion of SDXL v1.0 and ComfyUI together

How to Install and Use Stable Diffusion SDXL v1.0 and ComfyUI Together? Complete Step-by-Step Guide

To install and use ComfyUI and SDXL 1.0 together, you will need to follow these steps:

Step 1: Download SDXL v1.0

You will need to download both the base and the refiner models. These models are essential for the two-step process of generating the image and then refining it. The base model generates noisy latents that are processed by the refiner model to denoise and enhance the image’s detail and sharpness. Links are given below

  • SDXL v1.0 Base Model: (sd_xl_base_1.0.safetensors)

https://huggingface.co/stabilityai/stable-diffusion-xl-base-1.0/tree/main

  • SDXL v1.0 Refiner Model: (sd_xl_refiner_1.0.safetensors)

https://huggingface.co/stabilityai/stable-diffusion-xl-refiner-1.0/tree/main

After opening these links, scroll down until you find the file names I mentioned in brackets. 

Step 2: Download ComfyUI

Now, you need to download ComfyUI. Go to the GitHub page for ComfyUI. Scroll down until you find WINDOWS under installing and these click the “Direct link to download.” 

Downloading ComfyUI Using GitHub Download Link
Downloading ComfyUI Using GitHub Download Link

ComfyUI is a node-based user interface created to understand how Stable Diffusion works, and it closely follows the underlying mechanics of generation. After the download is finished, extract or unzip the ComfyUI file using WinRAR or 7-Zip.

Note: Direct download only works for NVIDIA GPUs. For AMD (Linux only) or Mac, check the beginner’s guide to ComfyUI.

Step 3: Install Dependencies

After downloading ComfyUI, you need to install its dependencies. Open your terminal in the ComfyUI folder and install the dependencies. If you have another UI installed and working with its own python venv, you can use that venv to run ComfyUI without installing any dependencies.

Step 4: Copy SDXL 0.1 Base and Refiner Models to the ComfyUI file

Copy the sd_xl_base_1.0.safetensors and sd_xl_refiner_1.0.safetensors files to the ComfyUI file which is present with name ComfyUI_windows_portable file. Locate this file, then follow the following path:

  • ComfyUI_windows_portable > ComfyUI > models > checkpoints

Now paste these models into the “Checkpoints” subfolder

Step 5: Choose and Run GPU or CPU Version

When you are done copying and pasting the models, then inside the “ComfyUI” folder, locate the batch files for running the software.

Depending on your hardware, choose the appropriate version:

  • For GPU, run the “run Nvidia GPU.bat” file.
  • For CPU, run the “run Nvidia CPU.bat” file.

After this, a ComfyUI environment will open itself, but it does not contain workflow yet. It is shown in the following figure:

ComfyUI and SDXL v1.0

Step 4: Download and Use SDXL Workflow

Instead of creating a workflow from scratch, you can download a workflow optimised for SDXL v1.0. You can use the popular Sytan SDXL workflow or any other existing ComfyUI workflow with SDXL. The workflow is provided as a .json file which is easily loadable into the ComfyUI environment.

  • GitHub Sytan SDXL Workflow Link: 

https://github.com/SytanSD/Sytan-SDXL-ComfyUI

Downloading Sytan SDXL Workflow from GitHub

Step 5: Load the Workflow

After downloading, you can load the workflow into ComfyUI. This can be done by dragging and dropping the downloaded .json file into the ComfyUI environment or using the “Load button.”

Sutan SDXL Workflow After loading into ComfyUI
Sytan SDXL Workflow After loading into ComfyUI

Step 6: Select Models in Load Model Nodes

Once the workflow is loaded, make sure to select your base and refiner models from the dropdowns in the Load Model nodes.

Setting SDXL v1.0 Base and Refiner models into Load Model Nodes of ComfyUI
Setting SDXL v1.0 Base and Refiner models into Load Model Nodes of ComfyUI

Step 7: Generate Images

After all the above steps are completed, you should be able to generate SDXL images with one click. Open the ComfyUI software. Familiarise yourself with the UI and the available settings.

Set Up Prompts

  • In the “Positive Prompt” field, enter a description of the image you want to create.
  • Optionally, enter keywords in the “Negative Prompt” field to exclude specific elements from the image.
  • Configure other settings like seed numbers, CFG values, and steps for the sampler.

Click Quene Prompt to Start Generating Images

  • Once you are done with prompts and settings, click the “Queue Prompt” button to start image generation.
  • The software will start processing your prompt and generate the image.
  • Depending on the complexity, the process might take a few minutes. Subsequent image generations tend to be faster.

Review and Edit Images

  • Once the processing will be done, two images will be generated as output separately in both models at a time which can save you time.
  • Review the image and make any necessary adjustments to your prompt or settings for desired results.
Fusion of SDXL v1.0 and ComfyUI Generated Images for Both Base and Refiner Together
Fusion of SDXL v1.0 and ComfyUI Generated Images for Both Base and Refiner Together

Save and Share

  • Save the generated images to your “output” folder using the “SAVE” button.
  • Share your creations on social media or use them for personal projects.

Remember, ComfyUI is extensible, and many people have written some great custom nodes for it. You can explore and use these custom nodes/extensions as needed.

Refiner Image

Final Verdict

Now that you know how to install SDXL v1.0 and use it with ComfyUI, you’re all set to make amazing artwork. With these tools, you can create artworks that are so good you might even want to sell them! SDXL v1.0 makes cool pictures, and ComfyUI helps you use it easily. So, whether you’re just having fun or thinking about selling your art, these tools help you make awesome stuff that people will love. Try it out, and see what incredible art you can make!

Also, Check out some of the amazing artworks below:

ComfyUI and SDXL v1.0
Image 1
Stable diffusion SDXL v1.0 and ComfyUI
Image 2

If you want to learn more about SDXL, do check our following articles below:

We hope you enjoyed reading this article. For more, you can stay tuned with us because we DigiAlps LTD, are providing you with the latest information through our articles on AI and more trending topics.

SUBSCRIBE TO OUR NEWSLETTER

Stay updated with the latest news and exclusive offers!


* indicates required
Picture of Faizan Ali Naqvi
Faizan Ali Naqvi

Research is my hobby and I love to learn new skills. I make sure that every piece of content that you read on this blog is easy to understand and fact checked!

3 Responses

Leave a Reply

Your email address will not be published. Required fields are marked *


The reCAPTCHA verification period has expired. Please reload the page.

Cohere AI Drops Command A, The AI That’s Smarter, Faster and More Affordable

In this fast-moving world of AI today, a powerful AI system needs tons of expensive computer equipment to run properly. Companies have to spend a fortune on hardware just to keep these advanced AI systems running. So, they are always looking for technology that works great without breaking the bank. They need AI that can do impressive things with minimal computing needs. This balance is tricky to get right. But what if there is an AI model that is just as smart and fast but needs way less computing power? That’s exactly what Cohere AI has accomplished with its newest model, Command A.

Meet Command A by Cohere AI

Command A is the newest and most impressive AI model by Cohere AI. It is super smart, really fast, and more secure than earlier versions, like Command R and Command R+. What makes it special is that it works similar to or even better than famous AI models like GPT-4o and DeepSeek-V3 but doesn’t need nearly as much computing power. This gives businesses powerful AI without the huge electric bills and expensive computer equipment.

Key Features of Command A for Enterprises

This model is designed with businesses in mind. It has several features that make it perfect for companies:

1. Command A’s Chat Capabilities

Out of the box, Command A works as a conversational AI with interactive behavior. This setup is perfect for chatbots and other dialogue applications. The model takes text inputs and creates text outputs using an optimized architecture. It has two safety modes: contextual mode allows wider-ranging interactions while maintaining core protections, and strict mode avoids all sensitive topics.

2. 256k Context Window

Under the hood, it has some impressive specs. It has 111 billion parameters and can handle really long texts – up to 256,000 characters at once. Most competing AIs can only handle half that amount.

3. Advanced RAG Capabilities

Command A comes with “retrieval-augmented generation” (RAG). It can look up information and include references for its answers. People who tested found it better than GPT-4o at this task. Its answers were smoother, more accurate, and more useful.

4. Multilingual Excellence

Global companies need AI that works in many languages. Command A supports 23 languages spoken by most of the world’s population. It consistently answers in any of the 23 languages you ask for. In tests, people preferred it over DeepSeek-V3 across most languages for business tasks.

5. Enhanced Code Generation Capabilities

Command A is much better at coding tasks than previous models, outperforming similar-sized models on business-relevant tasks like SQL generation and code translation. Users can ask for code snippets, explanations, or rewrites and get better results by using certain settings for code-related requests.

6. Enterprise-Grade Security

Command A has strong security features to protect sensitive business information. It can also connect with other business tools and apps, making it a versatile addition to existing systems.

7. Agentic Tool Use

The real magic happens when Command A powers AI agents within a company. It works seamlessly with North, Cohere’s platform for secure AI agents. This lets businesses build custom AI helpers that can work inside their secure systems, connecting to customer databases, inventory systems, and search tools.

How Well Command A Performs

When tested side-by-side with the biggest names in AI, like GPT-4o and DeepSeek-V3, Command A holds its own and often comes out on top. It performed better on business tasks, science problems, and computer coding challenges. 

Cohere AI Drops Command A, The AI That’s Smarter, Faster and More Affordable

The model matches or beats the bigger and slower AI models while working much more efficiently.

  • Command A processes information up to 156 tokens per second – that’s 1.75 times faster than GPT-4o and 2.4 times faster than DeepSeek-V3.
  • It only needs two GPUs to run, while other AIs might need up to 32!

Moreover, this tool does great on standard tests for following instructions, working with other tools, and acting as a helpful assistant.

Cohere AI Drops Command A, The AI That’s Smarter, Faster and More Affordable

How to Get Started With Command A

Command A is available right now through several channels. You can try it chat in the Conhere AI’s playground here. You can also try it out through the Hugging Face Space demo here. Soon, it will be available through major cloud providers. Companies that want to install it on their own servers can contact Cohere’s sales team.

Command A Pricing Structure

Cohere AI has set competitive prices for using Command A:

  • Input tokens: $2.50 per million
  • Output tokens: $10.00 per million

This pricing lets businesses predict costs based on how much they’ll use the system, making budget planning easier.

The Command A Advantage

Cohere AI worked hard to make Command A super efficient. They wanted it to be powerful but not power-hungry. The result? An AI that gives answers much faster than its competitors. For businesses thinking about installing Command A on their own computers instead of using it through the internet, they can save up to 50% on costs compared to paying for each use. What does this mean in real life? Businesses using Command A can:

  • Get answers for customers more quickly
  • Spend less money on fancy computers
  • Grow their AI use without huge cost increases
  • Save money overall

Wrapping Up

As more businesses bring AI into their daily operations, tools like Command A will become more important. In a crowded AI market, its ability to deliver great results with minimal resources addresses one of the biggest challenges in business AI adoption.

By putting efficiency first without sacrificing performance, Cohere AI has created a solution that fits perfectly with what modern businesses actually need. For sure, this practical tool can help businesses stay competitive in our AI-powered world.

| Latest From Us

Picture of Faizan Ali Naqvi
Faizan Ali Naqvi

Research is my hobby and I love to learn new skills. I make sure that every piece of content that you read on this blog is easy to understand and fact checked!

Google Launches Gemma 3, A Powerful Yet Lightweight Family of AI Models

Google has just launched the latest addition to the Gemma family of generative AI models, Gemma 3. It is a collection of lightweight, super-smart AI models based on Gemini 2.0. With a remarkable 100 million downloads within its first year and an impressive community that has crafted over 60,000 variants, Gemma has established itself as a cornerstone in the realm of AI development. Gemma 3 is specially designed to run directly on your devices, including phones, laptops, and desktop computers. This means you don’t need expensive cloud servers to use powerful AI models. 

Gemma 3 AI Models

These models comes in four sizes (1B, 4B, 12B, and 27B) and five precision levels, from full 32-bit down to 4-bit. Bigger models with higher precision generally work better but need more computing power and memory. Smaller models with lower precision use fewer resources but might not be quite as capable. You can pick the one that works best for your device and what you want to do.

The memory needed varies a lot depending on which model you choose. The smallest version (Gemma 3 1B in 4-bit precision) needs only about 861 MB of memory – less than a typical smartphone has! The largest version (Gemma 3 27B in full 32-bit precision) needs about 108 GB – that’s like needing a high-end server.

Key Features of Gemma 3

1. Run on a Single GPU

The Gemma models work better than much bigger models like Llama-405B, DeepSeek-V3, and o3-mini. This means these can run on just one GPU or TPU, making good AI cheaper and more accessible for everyone.

2. Multimodal Capabilities

The models (except the smallest 1B size) can understand both pictures and text. This lets apps do cool things like recognize objects in photos, read text from images, and answer questions about pictures.

3. Expanded Context Window

With a 128k-token context window, Gemma 3 can remember and understand lots of information at once. This is 16 times bigger than older Gemma models! You could feed it several multi-page articles, larger single documents, or hundreds of images in a single prompt.

4. Multilingual Support

The models can speak over 35 languages right out of the box and has been trained on more than 140 languages in total. This lets users build apps that can talk to users in their own language, which opens up their apps to many more people.

5. Function Calling Support

Gemma 3 supports “function calling,” which means it can trigger other programs to do things. This facilitates the automation of complex tasks, enhancing the overall functionality and utility of applications built with it.

6. Quantization Support

The models come in “quantized” versions that use less memory and computing power while still being accurate. These versions range from full 32-bit precision down to tiny 4-bit versions, so developers can choose what works best for their needs.

7. Easy Integration with Existing Tools

It plays nicely with lots of popular development tools like Hugging Face Transformers, Ollama, JAX, Keras, PyTorch, Google AI Edge, UnSloth, vLLM, and Gemma.cpp. 

8. Easy to Customize

It comes with recipes for fine-tuning and running it efficiently. Developers can train and adapt the model using platforms like Google Colab, Vertex AI, or even a gaming GPU. 

9. Works Great on NVIDIA GPUs

NVIDIA has specially optimized these models to work well on all their GPUs, from the small Jetson Nano to their newest Blackwell chips. 

How Gemma 3 Compares to Other AI Models

This family has scored impressively on AI benchmarks. The 27B version scored 1338 on the Chatbot Arena Elo leaderboard, putting it in the same league as much bigger models. What’s really amazing is that while some competing models need up to 32 huge NVIDIA H100 GPUs (which cost thousands of dollars each), the 27B variant needs just one GPU. That’s like getting sports car performance for the price of a compact car!

Real-World Uses for Gemma 3

1. Smart Apps on Your Phone

Gemma 3’s efficiency makes it perfect for creating smart apps that run directly on your phone. Developers can build AI assistants, language translators, content creators, and image analyzers that work quickly without needing to connect to the cloud all the time.

2. Edge Computing

For Internet of Things (IoT) devices and edge computing, it lets AI processing happen right where the data is collected. This reduces the need to send data back and forth, which saves bandwidth and keeps private data local.

3. AI for Small Businesses

Gemma 3 makes advanced AI available to organizations with limited resources. Small and medium businesses can now use sophisticated AI without spending a fortune on cloud computing. They can run its applications on the computers they already have.

4. Educational Tools

Schools and universities can use it to help students learn about AI. Students can experiment with cutting-edge AI on regular school computers, and researchers can innovate without needing super expensive systems.

Getting Started With Gemma 3

Developers can try them instantly in their web browser using Google AI Studio. No complicated setup needed! They can also get an API key from Google AI Studio to use it with Google’s GenAI SDK.

For those who want to adapt it to their specific needs, the models are available for download from Hugging Face, Ollama, or Kaggle. You can easily fine-tune and adapt the model using Hugging Face’s Transformers library or other tools you prefer.

| Latest From Us

Picture of Faizan Ali Naqvi
Faizan Ali Naqvi

Research is my hobby and I love to learn new skills. I make sure that every piece of content that you read on this blog is easy to understand and fact checked!

Alibaba Introduces VACE, The Ultimate AI Model That Takes Video Editing to the Next Level

Alibaba is on fire when it comes to AI. The company keeps dropping one AI model after another, including image generators, video generators, chatbots, and much more. Now, they have introduced VACE, a super cool all-in-one AI model for creating and editing videos. Whether you want to generate new videos, edit existing ones, or manipulate specific parts of a clip, VACE has got you covered. Most AI video tools focus on just one or two tasks, maybe simple editing, image generation, basic animation, or color adjustments. But Alibaba’s VACE does it all in one place. 

Key Features of Alibaba VACE for Video Creation and Editing

VACE comes packed with amazing features that change how we make and edit videos. It handles tasks like reference-to-video generation (R2V), video-to-video editing (V2V), and masked video-to-video editing (MV2V). Moreover, it offers cool features like Move-Anything, Swap-Anything, Reference-Anything, Expand-Anything, and Animate-Anything.

1. Text-to-Video Generation (T2V)

VACE includes an amazing Text-to-Video Generation (T2V) feature, which is one of the most basic yet powerful video creation capabilities. You just provide a text prompt, and the video is generated accordingly.

2. Reference-to-Video Generation Feature

VACE’s Reference-to-Video (R2V) feature lets users generate new videos based on reference images. If you have a certain style or aesthetic in mind, VACE can analyze that and create videos that match it.

2. Video-to-Video Editing Feature

This feature lets users make changes to existing videos. It can help you apply a new visual style, change elements in a scene, or tweak colors. The best part? It does all of this while keeping edits smooth and natural, with no weird jumps or inconsistencies.

3. Masked Video-to-Video Editing Feature

This feature lets you edit specific parts of a video. You can define a specific area in the video and make changes to just that part, leaving the rest untouched. This makes it perfect for everything from fixing mistakes to adding new creative elements.

Alibaba Introduces VACE, The Ultimate AI Model That Takes Video Editing to the Next Level

4. Move-Anything Feature

This feature lets users grab objects in a video and move them around while keeping everything looking smooth and natural. Just select, move, and watch the AI do the heavy lifting. It even understands perspective and occlusions, so objects blend right into their new spots without looking out of place. 

5. Swap-Anything Feature

This feature swaps anything out of a video without it looking fake. Whether it’s changing a person’s outfit, replacing a background, or switching out objects, the AI ensures the new elements match the original’s motion, lighting, and surroundings. This is a game-changer, especially for virtual try-ons.

6. Reference-Anything Feature

This feature takes style transfer to the next level. Instead of just applying a filter, VACE lets users bring in colors, textures, and even composition elements from one video or image and apply them to another.

7. Expand-Anything Feature

This feature helps you adjust a video’s aspect ratio without awkward cropping or stretching. It extends the frame, generating new visuals that match the existing scene. Whether you’re repurposing a landscape video for a vertical format or adjusting a shot to fit different screens, this feature makes sure everything looks natural and cohesive. 

8. Animate-Anything Feature

This feature turns still images into moving visuals. With Animate-Anything, VACE analyzes a static image, figures out what could move naturally, and creates realistic motion sequences. You can add subtle movement or full-blown animations. This is perfect for breathing life into any photo.

Performance Evaluation of VACE

What makes VACE stand out? Most AI models focus on just one or two specific tasks. VACE is being built to unify multiple video-editing functions within a single framework. To test its performance, researchers developed the VACE-Benchmark, a framework designed to evaluate video generation quality across multiple factors. 

Compared to task-specific models like I2VGenXL, CogVideoX-I2V, ProPainter, and Control-A-Video, VACE has demonstrated competitive or even superior results in human and automated evaluations. The model showed impressive performance across aesthetic quality, background consistency, dynamic degree, imaging quality, motion smoothness, overall consistency, subject consistency, and temporal flickering, marking it as the best all-in-one tool.

Alibaba Introduces VACE, The Ultimate AI Model That Takes Video Editing to the Next Level

Potential Applications of VACE

VACE has the potential to shake up multiple creative fields. Here’s how it could be used:

1. Film and Video Production

It can help streamline post-production workflows by enabling seamless editing and video generation.

2. Advertising

The Alibaba VACE can create high-quality video ads with specific reference materials and controlled stylistic elements.

3. Gaming and Animation

It can generate animated sequences or game cinematics based on reference imagery or existing footage.

4. Social Media Content

This video model can help creators quickly produce and edit high-quality videos for various platforms.

5. Virtual Reality

It can expand the possibilities for creating immersive visual experiences.

By combining multiple video editing and generation tools into one model, VACE could become a go-to solution for industries that need speed, quality, and creative flexibility

Accessibility and Availability

While VACE has been introduced, it’s not publicly available yet. But, the model and code are expected to be released soon, along with support for ComfyUI workflow, VACE-Benchmark, Wan-VACE Model Inference, and LTX-VACE Model Inference. If the early tests are any indication, this could be one of the biggest leaps in AI-driven video editing yet. Stay tuned for updates!

For more technical details, you can check the model paper.

| Latest From Us

Picture of Faizan Ali Naqvi
Faizan Ali Naqvi

Research is my hobby and I love to learn new skills. I make sure that every piece of content that you read on this blog is easy to understand and fact checked!

Don't Miss Out on AI Breakthroughs!

Advanced futuristic humanoid robot

*No spam, no sharing, no selling. Just AI updates.