My stuff

  • My Workflows

  • Liked Workflows

  • Following Workflows

Go to OpenArt main site
Upload workflow

Silly Tavern Character image creator V3 (with all 32 "emotion images") WIP

4.0

1 reviews
61
59.7K
7.8K
21
Description

V3

A chap reached out to me and asked if I could up date this. I had to remake it from scratch due to changes in comfyui, but that was for the best!

Notes are in the workflow but it now uses qwen edit 2509 and the results are remarkable.

Its image in only, as you can create the original image easy enough with any other workflow, i dropped the llm aspect for compatability.

I added a gguf loader for those on low ram (q2 gguf of qwen 2509 works with 7gb of vram... and is surprisingly good for this task, I would recommend using higher if you can but for something like this its not fully needed.

Links for the needed models are in the notes (all hugging face links.

It uses the lightning lora so images are done in about 12 to 20 seconds each, depending on your chosen model.

Removed the back ground removal for now, that can be re-added later... though if you want to add one in, just put it between the emotion modules and the save image.


Notes from the Workflow v3:
Notes:
1) Qwen edit is amazing for this task, if you have lower vram use a gguf version.
2) Why add a stance? Well I feel a standing person can express emotion better. Meh its optional.
3) Why add nudity, thats not an emotion? In honour of my friends original request. Its disabled by default.
4) Why she and her and not he and him? Good question, I make things I want to use, I am into women, be they safe for work or of the adult variety are with female characters, it would add too much complexity to add a pronoun option....however, its easy to edit the workflow. You do you or him, or her, or them or giant space speghetti monster, like the farmer who filled his animals with hellium said, what ever floats your goat. (Edit: switched to They and Them, this covers genders and groups)
5) Filename.... that first _ in the file name you need to make that a - I cant change that in the workflow.
in linux you can run:
for file in *_*; do mv "$file" "${file/_/-}"; done
in windows tou can run:
FOR %f IN (*_*) DO FOR /F "tokens=1,* delims=_" %a IN ("%f") DO REN "%f" "%a-%b" 
these run in the directory your images are saved in.... or just swap the first _ with a - in each image
6) You can change the clothes, by specifying them in the prompt "They are now in a catwoman outfit" or "Now dressed in a clown costume and holding a red balloon" Qwen is VERY good at editing images. 

****Original description and valid for v2 and bellow****

Created for a friend of mine who wanted a way to create a character and all the expressions with ease.


This is a work in progress, however it already works well 80% of the time (have had the odd person get extra arms when sad lol)

I have done testing using photo realistic people however the goal i was set was anime.... I dont know much about anime so I am open to pointers on how to improve the prompts for that style.


Notes from the workflow (and in the workflow)

1) First there is an adult section, you will want to make sure that group is disabled when creating characters that would be inappropriate for!

Why is there an adult section when Silly Tavern does not support a nude/underwear/topless emotions? Well it was asked for, meh why not?


2) Keep the person description and clothing description separate.


3) It will put the emotions into a folder called emotions, that needs to be renamed to match the name of your character in silly tavern.


4) In the renamed folder create a .ps1 file with the text: get-childitem *.png | foreach { rename-item $_ $_.Name.Replace("_00001_", "") }

right click that and choose run with powershell to remove the _00001_ from the filenames, Only way I could do it.

NOTE THIS SHOULD NOW BE DONE FOR YOU! (EDIT....it should...but alas its not lol)


5) Should handle any style your model supports.


6) Bottom of the groups is a step setting, more steps mean better detail (to a degree) les means faster.


7) This is not a fast process! It is also not flawless! I am doing my best.


8) you can disable the groups, I tried to separate core emotions from extras, and adult is sperate too.


9) missing nodes? red boxes? use comfy manager to install custom nodes, I am using a lot to achieve this.


10) SDXL resolution node. This sets the resolution of the images, should you wish to use the old, outdated 1.5 then remove that node and atach the two primitive nodes under it to the width and height of empty latent. set as desired.


11) yes its messy, yes it gives OCD people nightmares.... but its a WIP


12) It is important to add neutral expression to the physical description or it will effect the emotion pictures.


13) a few methods have come out for changing the face, which could be used for expressions, I may look into that as an alternative. But this is 32 images, that would take even longer!


14) This is set up for the open dalle model, you may need to change cfg and lower step count for a different model.

15) The local LLM option is at the mercy of your used LLM. I have specified ages and the AI has then adjusted that to something less appropirate. I recommend leaving the adult section bypassed if using LLM's as far as i can tell Silly tavern does not use those anyway?

TODO:

Get a good way to remove the background so I am left with just the person. DONE

Work on making the pose match the emotion, not just the face.

Allow for more to be customised with ease.... annoyingly tricky.

Fix the emotions so they always show.

Find a way to keep the same clothes that doesn't cause massive slow down.

CHANGE LOG

V2:

Added the ability to use an existing image, follow the notes in the workflow.

Added a warning about the LLM and how it can and does change ages.

Moved a couple of bits about and added re-routers to enable the existing image input to be used with releitive easea

Discussion

(No comments yet)

Loading...

Author

1
7.8K
61
59.7K

No reviews yet

  • - latest (a month ago)

  • - v20240108-222710

  • - v20240106-160927

Primitive Nodes (221)

1034e48f-41ca-40b3-b070-6166913e1617 (1)

18fa0898-c485-47b2-b694-967bfaa28f7e (1)

1bcb603b-6dc0-4c94-a536-ffd2ede027e7 (1)

280e6d15-e853-43a7-bc00-e928dc777340 (1)

301a5970-ebb0-4a46-864f-9275c14e9453 (1)

318fe80a-8668-4672-bbc1-9d1077a7ea31 (1)

3486328d-46ea-4033-96dc-7813bbb0a825 (1)

3558c030-3eda-4ce7-835b-47daedbe85c4 (1)

3a10b0f2-265a-44e9-a6fc-b76df152f684 (1)

3fec44e2-2cd6-49c6-a833-33fc8ef32875 (1)

4adc56c5-ce83-4f63-b419-10c9141e7c8e (1)

4e843332-8975-43f0-b2d4-e52e9954454a (1)

4e92cf21-1bdb-480a-87f1-c6cd78bc210f (1)

61d67e87-5947-4a51-921c-e0c7f22d7e7e (1)

6ac30957-6140-41d6-8524-717693f4dd87 (1)

6d08c4c1-89b7-4c36-8289-f4e4e752f78a (1)

6e572cef-2357-4ee7-84e3-e8e1aaf53424 (1)

724a6888-63ae-4172-8bbc-598321fce6f2 (1)

9fcc9dbd-8eb0-4ff4-8533-08e600cccd7d (1)

CLIPLoaderGGUF (1)

Note (6)

Reroute (183)

UnetLoaderGGUF (1)

bc173db9-9abd-46e3-b06b-1b36b8de4d1c (1)

c742453e-5fb0-49ee-bd18-12a1f6e3b1ea (1)

cc2d756a-ea1e-4577-baa2-6efbfa9d089e (1)

cec53461-6072-4fd9-9950-84e2db479704 (1)

d4e285ad-35ed-4ebe-8694-648c111da9ac (1)

d5020597-0061-405f-98b0-bd6d9478393a (1)

d7101d07-a5d3-4fea-b671-ca5195ac0bf6 (1)

d940432c-95d9-4697-b497-f989d06b01ca (1)

d9b893b7-a4a4-41af-9c05-55a5a8ce784c (1)

daa80c69-ae81-4adb-a859-2c9531bcbd05 (1)

f342e1c3-d581-422f-b2ba-13ccdfd8bf88 (1)

Custom Nodes (39)

ComfyUI

  • - SaveImage (30)

  • - LoraLoader (1)

  • - CLIPLoader (1)

  • - LoraLoaderModelOnly (1)

  • - VAELoader (1)

  • - LoadImage (1)

  • - UNETLoader (1)

ComfyUI-Logic

  • - String (3)

Checkpoints (0)

LoRAs (2)

Qwen-Image-Edit-2509-Lightning-4steps-V1.0-bf16.safetensors

qwen/Qwen_Snofs_1_2.safetensors