My stuff

  • My Workflows

  • Liked Workflows

  • Following Workflows

Go to OpenArt main site
Upload workflow

Image to Music Workflow

5.0

0 reviews
28
6.4K
1.3K
1
Description

New node:

LLaVA -> LLM -> Audio


Update the VLM Nodes from github.

https://github.com/gokayfem/ComfyUI_VLM_nodes


Download both from the link below mmproj-model-f16.gguf and llava-v1.6-mistral-7b.Q5_K_M.gguf model and put them into models/LLavacheckpoints

https://huggingface.co/cjpais/llava-1.6-mistral-7b-gguf/tree/main

It will automatically download the necessary files into

custom_nodes/ComfyUI_VLM_nodes/nodes/files_for_audioldm2

Discussion

(No comments yet)

Loading...

Author

7
7.5K
98
41.4K

No reviews yet

  • - latest (2 years ago)

Primitive Nodes (0)

Custom Nodes (12)

ComfyUI

  • - LoadImage (1)

VLM_nodes

  • - LlavaClipLoader (1)

  • - SimpleText (3)

  • - LLavaSamplerSimple (1)

  • - ViewText (2)

  • - LLava Loader Simple (1)

  • - LLMSampler (1)

  • - PlayMusic (1)

  • - AudioLDM2Node (1)

Checkpoints (0)

LoRAs (0)