Check out this page to see how to get "Instant Id" running and what is required.

https://github.com/cubiq/ComfyUI_InstantID

Try different settings of the "Instant Id" nodes end_at for example as well as Stepps and CFG Scale.

I have tested the following models and found them to be good.

turbovisionxlSuperFastXLBasedOnNew_tvxlV431Bakedvae.safetensors

juggernautXL_v8Rundiffusion.safetensors

rundiffusionXL_beta.safetensors

IMG to TXT is optional and can be deactivated.

The first image is the input, the four below are the results