My stuff

  • My Workflows

  • Liked Workflows

  • Following Workflows

Go to OpenArt main site
Upload workflow

Picture Me Turbo (InstantID with Image2Image)

5.0

0 reviews
39
11.5K
2.7K
3
Description

Put your likeness into your favourite painting or re-imagine yourself in a variety of professions

It is based on the nodes from https://github.com/cubiq/ComfyUI_InstantID and  https://github.com/comfyanonymous/ComfyUI_experiments. It requires 12GB VRAM to run this workflow.

Starting from an empty latent we take a square crop of a target pose and apply InstantID. The pair of driving image and pose gives a stable location in latent space, allowing for highly controlled alteration of the clothing and backgrounds.

I could only get (smiling:1.2) & (laughing:1.2) to change the facial expression without altering the whole image. This gives some potential for keyframes to drive a simple animation.

Be careful when using 'spicy' checkpoints. It is too easy for even innocent sounding words to produce images of the chosen subject in the nude.


Tips:

  • The prompt should be simple like 'cowboy' or 'firewoman'. If you add things like man or woman dressed as X, then the checkpoint concepts of man or woman will dilute your likeness.
  • A high CFG (for Turbo) might be needed to get a good likeness, so the rescale CFG node is used to pull the CFG down to prevent image 'burn-in'.
  • You will need to try a variety of checkpoints and images of yourself in until you find a pair that can reasonably  reproduce your likeness.
  • Square crop both the pose image and the face for best results. The face needs to be no larger than 640 pixels to be detected.
Discussion

(No comments yet)

Loading...

Author

6
9.1K
105
46.1K
    girl-4342895_781.jpg (144.2 kB)
    bali-1865755_640.jpg (39.3 kB)

No reviews yet

  • - latest (2 years ago)

Primitive Nodes (1)

Reroute (1)

Custom Nodes (23)

ComfyUI

  • - CLIPVisionLoader (1)

  • - ControlNetLoader (1)

  • - VAEDecode (1)

  • - SaveImage (1)

  • - ControlNetApplyAdvanced (1)

  • - CLIPVisionEncode (1)

  • - KSampler (1)

  • - EmptyLatentImage (1)

  • - unCLIPConditioning (1)

  • - VAEEncode (1)

  • - CheckpointLoaderSimple (1)

  • - CLIPTextEncode (2)

  • - LoadImage (2)

  • - PreviewImage (1)

ComfyUI InstantID (Native Support)

  • - FaceKeypointsPreprocessor (1)

  • - InstantIDModelLoader (1)

  • - InstantIDFaceAnalysis (1)

  • - ApplyInstantID (1)

  • - RescaleClassifierFreeGuidanceTest (1)

  • - Image Resize (2)

Checkpoints (1)

sdxl_dpo_turbo.safetensors

LoRAs (0)