Picture Me Turbo (InstantID with Image2Image)
5.0
0 reviewsDescription
Put your likeness into your favourite painting or re-imagine yourself in a variety of professions
It is based on the nodes from https://github.com/cubiq/ComfyUI_InstantID and  https://github.com/comfyanonymous/ComfyUI_experiments. It requires 12GB VRAM to run this workflow.
Starting from an empty latent we take a square crop of a target pose and apply InstantID. The pair of driving image and pose gives a stable location in latent space, allowing for highly controlled alteration of the clothing and backgrounds.
I could only get (smiling:1.2) & (laughing:1.2) to change the facial expression without altering the whole image. This gives some potential for keyframes to drive a simple animation.
Be careful when using 'spicy' checkpoints. It is too easy for even innocent sounding words to produce images of the chosen subject in the nude.
Tips:
- The prompt should be simple like 'cowboy' or 'firewoman'. If you add things like man or woman dressed as X, then the checkpoint concepts of man or woman will dilute your likeness.
- A high CFG (for Turbo) might be needed to get a good likeness, so the rescale CFG node is used to pull the CFG down to prevent image 'burn-in'.
- You will need to try a variety of checkpoints and images of yourself in until you find a pair that can reasonably  reproduce your likeness.
- Square crop both the pose image and the face for best results. The face needs to be no larger than 640 pixels to be detected.
Discussion
(No comments yet)
Loading...
Resources (2)
Reviews
No reviews yet
Versions (1)
- latest (2 years ago)
Node Details
Primitive Nodes (1)
Reroute (1)
Custom Nodes (23)
ComfyUI
- CLIPVisionLoader (1)
- ControlNetLoader (1)
- VAEDecode (1)
- SaveImage (1)
- ControlNetApplyAdvanced (1)
- CLIPVisionEncode (1)
- KSampler (1)
- EmptyLatentImage (1)
- unCLIPConditioning (1)
- VAEEncode (1)
- CheckpointLoaderSimple (1)
- CLIPTextEncode (2)
- LoadImage (2)
- PreviewImage (1)
- FaceKeypointsPreprocessor (1)
- InstantIDModelLoader (1)
- InstantIDFaceAnalysis (1)
- ApplyInstantID (1)
- RescaleClassifierFreeGuidanceTest (1)
- Image Resize (2)
Model Details
Checkpoints (1)
sdxl_dpo_turbo.safetensors
LoRAs (0)