SCAIL-2: motion transfer & character replacement — built for minute-long video re-rendering
黎黎原上咩
0:00 / 0:00
SCAIL-2: motion transfer & character replacement — built for minute-long video re-rendering
4 032 просмотра · 2 месяца назад
黎黎原上咩
19,6 тыс. подписчиков
4 032 просмотра · 2 месяца назад
Motion transfer and character replacement have always been the most popular use cases in AIGC video generation. After all, who wouldn't want to use different characters to dance the latest trending hand-gesture dance, imitate classic movie clips, or even pull off a fight scene? SCAIL-2 is currently the strongest open-source solution in this field. I've done a lot of testing in my local ComfyUI recently. Even with just the most basic workflow, the results are quite good. If you tweak the flow and pair it with looping to extend the video, you can crank out a several-minute-long video in one go, with no jarring hard cuts. In today's video, we'll start with the model download and environment setup. Then, building on the simplest workflow, we'll walk through the details and finally use a looping workflow to finish a minute-scale re-render. Of course, we'll also cover parameter intros, a comparison of motion transfer versus character replacement, demos across different scenarios like single-person and multi-person, and recommendations for handy third-party plugins.
It has undoubtedly replaced WanAnimate as the open-source ceiling for motion transfer and character replacement. The motion transfer is close to the level of closed-source commercial models, and with looping you can re-render minute-scale content. In my local 16GB VRAM setup, I reserved 8GB to simulate low VRAM — I really pushed it — and it still easily finished long videos, hitting 512x896 at 393 frames. The downsides are that after multiple loops, degradation is unavoidable, consistency drift always creeps in — especially on pure white backgrounds, where artifacts show up easily. And since it's built on the Wan series of models, it runs slowly, the VRAM requirements aren't low enough, and it can't directly output video above 1080P.
Plugins:
MieNodes: https://github.com/MieMieeeee/ComfyUI...
KJNodes: https://github.com/kijai/ComfyUI-KJNodes
Model: https://huggingface.co/Comfy-Org/SCAI...
Workflow: https://drive.google.com/drive/folder...
Prompt instructions:
https://github.com/zai-org/SCAIL-2/bl...
00:00 Results showcase and model intro
02:26 Model download
04:49 Environment setup and basic demo
08:05 Motion transfer in detail
21:50 Character replacement in detail
26:21 Looping workflow
29:18 Color matching and third-party plugins
30:40 Model summary