What's this?

Face Swap is a pretty popular task, but since it only swaps the face, things like body shape and skin tone stay the same. If you want to be more precise, you’d actually need to swap the whole body.

There are techniques that let you swap the entire person, but they also transfer the clothes — and I wanted to swap the person without changing their outfit.

So, I put together this workflow.

Basically, it swaps the person using ACE++, and then changes the outfit with catvton-flux. (You could switch the order if you like.)

As you might notice, pose preservation using ControlNet isn’t perfect yet, and skin tones don’t transfer flawlessly either — so there are still a lot of challenges.

Still, I hope you find the idea of a "Clothing-Preserving Body Swap" interesting!

Workflow

1st step

• 🟪Swap the person using ACE++.
• 🟦Since ACE++ alone tends to change the pose, I'm also using ControlNet OpenPose to help preserve it.

2nd step

• 🟪Change the outfit using catvton-flux.
• You can do outfit swapping with ACE++ too, but personally I find catvton-flux more stable and the quality is better.
• 🟥 For masking the clothing area, I’m using a combo of SAM-2 + Florence-2.