The world of artificial intelligence is constantly evolving, and one of the most fascinating developments in this field is the creation of deepfake videos. These videos, which use AI to manipulate faces and voices, have garnered significant attention and have been used in a variety of contexts, from entertainment to news reporting. In this article, we’ll guide you on how to create deepfake videos with Stable Diffusion Mov2Mov extension and ReActor extension.
Table of Contents
- Stable Diffusion Mov2Mov Extension
- Stable Diffusion ReActor Extension
- How to Create Deepfake Videos With Stable Diffusion Mov2Mov & ReActor Extensions? Step-by-Step Guide
- Step 1: Open Stable Diffusion Web UI
- Step 2: Get Mov2Mov Extension
- Step 3: Confirm the Mov2Mov Extension Installation
- Step 4: Install ReActor Extension
- Step 6: Upload a Video to Mov2Mov Tab
- Step 7: Adjust Mov2Mov Settings
- Step 8: Upload an Image to ReActor Dropdown
- Step 9: Adjust ReActor Settings
- Step 10: Select Checkpoint
- Step 11: Generate the Deepfake Video
- Step 12: Locate the Deepfake Video
First, get to know a bit about these extensions.
Stable Diffusion Mov2Mov Extension
Mov2Mov is a video-to-video extension for Stable Diffusion that allows you to manipulate existing videos to create new ones. You can use it to change the appearance of objects, add or remove objects, or change the background. It is an automated solution for video-to-video tasks, allowing you to transform videos into impressive animated videos with ease. It directly processes frames from videos and offers video editing features that can help reduce video flicker by keyframe compositing.
Stable Diffusion ReActor Extension
ReActor is a face-swapping extension for Stable Diffusion that lets you swap the face of one person in a video with the face of another person. It can be used to create deepfakes, funny or creative videos, or educational or informative videos. By avoiding the SD pipeline, ReActor can help prevent the smushing of the original image’s details, leading to better-quality deepfake videos.
| Also Read: Stable Diffusion Creator Enters AI Video Generation Realm
How to Create Deepfake Videos With Stable Diffusion Mov2Mov & ReActor Extensions? Step-by-Step Guide
Before heading to the Stable Diffusion Deepfake Video Creation process, let’s know the requirements first.
- Stable Diffusion platform
- Stable Diffusion Mov2Mov extension
- Stable Diffusion ReActor extension
- Initial video for applying the face swap
- Image to swap in video
Below is a step-by-step guide to creating high-quality deepfake videos using Stable Diffusion with the Mov2Mov and ReActor extensions:
Step 1: Open Stable Diffusion Web UI
Open the Stable Diffusion Web UI in order to start creating deepfake videos.
Step 2: Get Mov2Mov Extension
Head to the Extension tab. Opt for “Install from URL” and input the dedicated Mov2Mov extension URL. Initiate the installation and wait for it to finalize.
- GitHub URL for Mov2Mov extension: https://github.com/Scholar01/sd-webui-mov2mov
Step 3: Confirm the Mov2Mov Extension Installation
Navigate to the “Installed” tab to update and restart the UI for seamless integration. To ensure a smooth installation, perform a complete restart of the web UI after the update. Confirm the successful installation by checking for the added “Mov2Mov” tab in the navigation bar.
Step 4: Install ReActor Extension
Perform step 1 again to install the ReActor extension in the same way. The ReActor extension, designed for face swaps, is essential.
- GitHub URL for ReActor extension: https://github.com/Gourieff/sd-webui-ReActor
After you’re done installing, go to the “Installed” section. Select “Apply and restart UI” button to restart the User Interface. This makes sure the successful integration of ReActor extension gets added correctly. When it’s all set up, you’ll observe the ReActor expansion panel showing up in the “txt2img” and “img2img” tabs in the Stable Diffusion UI.
Step 6: Upload a Video to Mov2Mov Tab
To proceed Stable Diffusion Deepfake video creation, have your initial video ready to start the face swap process. Open the “Mov2Mov” tab in Stable Diffusion and place your video on the canvas.
Step 7: Adjust Mov2Mov Settings
Utilize the DDIM sampling method. Set sampling steps to 30 and maintain an aspect ratio of width and height as per your choice. Configure settings like CFG scale and denoising strength. CFG scale is set to 7, and the denoising strength is set to 0 to preserve the video’s original state. Set the Movie FPS to 7 and leave the Max FPS and Seed at their default values of -1.
Step 8: Upload an Image to ReActor Dropdown
Access the ReActor extension dropdown. Upload the preferred face image for the swap. Enable the extension after uploading.
Step 9: Adjust ReActor Settings
Set source and target image parameters to zero. Leave the remaining ReActor settings can remain at their default configuration.
Step 10: Select Checkpoint
Choose an appropriate checkpoint to create a realistic video. You can use Realistic Vision 5.1. Due to zero denoising strength, leave positive and negative prompts empty to avoid unintended alterations.
Step 11: Generate the Deepfake Video
Initiate the generation process by clicking the “Generate” button. Rendering will take some time depending on your graphics card.
Step 12: Locate the Deepfake Video
After completion, find the resulting face-swapped video in Stable Diffusion’s Mov2Mov Videos directory.
- stable-diffusion-webui > outputs > mov2mov-videos
Last But Not Least
Creating deepfake videos using Stable Diffusion Mov2Mov and ReActor extensions is a powerful way to manipulate video content uniquely and creatively. Deepfake videos created with Stable Diffusion Mov2Mov and ReActor extensions can serve as a form of artistic expression. They allow users to create unique and creative works that combine video editing with AI technology. However, it’s important to use this tool responsibly and ethically. Deepfakes have the potential to be misused, and it’s crucial to consider the ethical implications of creating and sharing deepfake videos. Remember to use this responsibly and consider the ethical implications of your work.
- Deepfake(faceswap) any video in just one click with this incredible tool!
- Stable Diffusion AI – Tool to Generate Amazing Images
- Midjourney vs Stable Diffusion: Same Prompt, Different Results
- Stable Diffusion SDXL v1.0 and ComfyUI: How to Install and Use
- Stable Diffusion SDXL 1.0: How to run SDXL 1.0 with AUTOMATIC1111 WebUI
- Roop-Unleashed: An Uncensored Face-Swapping(DeepFake) Tool