Go to OpenArt main site
Upload workflow

(flux)Turn your photo to clay style(照片转黏土风格flux版)

2.0

1 reviews
18
5.2K
851
0
Description

step1:

With vision model and language model,  the description of the picture are converted into clay style prompt.

step2:

With flux controlnet and lora, we can transform the style of the image while maintaining similarity.

step3:

Crop and enlarge the face, and redraw the face to maintain similarity through sdxl and instant id models.


主要分三步:

1、通过视觉模型和大语言模型,实现prompt 的风格转换

2、通过Flux/lora/controlnet,在转换风格同时保持相似度。

3、通过对脸部采取放大重绘再贴回,这一步使用sdxl模型和instantid模型,来恢复脸部相似度。


flux lora:

https://www.liblib.art/modelinfo/9e0e6f29c0a245d3bb74bad9c7e2313e?from=personal_page&versionUuid=e0087451768a4bb3844bd084ebd79962

sdxl checkpoint:

https://www.liblib.art/modelinfo/36404bfb74f64c168cad048312eb5f42?from=personal_page&versionUuid=3414d7c35b1245a3b3bfcf11c980cd5b

sdxl lora:

https://www.liblib.art/modelinfo/235e784744304cc9833e6eaad5d9b58b?from=personal_page&versionUuid=29269f9228b84c8cad139a15c3372551


手机端H5在线使用链接(flux模型叠加sdxl模型会有点慢):

https://tt.9syun.com/app/index.php?i=66&c=entry&do=mobile&m=tech_huise&r=index.index.index#/pages/zhixing/zhixing?id=3155&tg=0&v=2


Discussion

(No comments yet)

Loading...

Author

4
13.4K
317
57.6K

No reviews yet

  • - latest (a month ago)

  • - v20241008-144146

Primitive Nodes (6)

BizyAirJoyCaption (1)

BizyAirSiliconCloudLLMAPI (1)

ControlNetApplySD3 (1)

Fast Groups Bypasser (rgthree) (1)

Note (2)

Custom Nodes (52)

ComfyUI

  • - ControlNetLoader (2)

  • - PreviewImage (7)

  • - DualCLIPLoader (1)

  • - ImageScaleToTotalPixels (4)

  • - UNETLoader (1)

  • - VAELoader (1)

  • - CLIPTextEncode (4)

  • - VAEEncode (1)

  • - SaveImage (1)

  • - LoraLoaderModelOnly (2)

  • - CheckpointLoaderSimple (1)

  • - MaskToImage (1)

  • - VAEDecode (2)

  • - ImageScale (1)

  • - KSampler (2)

  • - InpaintModelConditioning (1)

  • - LoadImage (1)

ComfyUI Easy Use

  • - easy promptConcat (1)

  • - easy imageSize (1)

  • - easy humanSegmentation (2)

  • - InstantIDFaceAnalysis (1)

  • - InstantIDModelLoader (1)

  • - ApplyInstantID (1)

  • - LayerUtility: RestoreCropBox (1)

  • - LayerUtility: CropByMask V2 (2)

  • - AV_ControlNetPreprocessor (1)

  • - ComfyUI_Image_Round__ImageRound (1)

  • - String Literal (3)

  • - Seed Generator (2)

Checkpoints (1)

ReminiClay黏土风_SDXL_V1.0.safetensors

LoRAs (2)

ReminiClay黏土风_SDXL_LoRA_Dim128.safetensors

flux\Flux_Remini_clay_v1.safetensors