My stuff

  • My Workflows

  • Liked Workflows

  • Following Workflows

Go to OpenArt main site
Upload workflow

LTX 9.1 + LLM Movie Directors

5.0

0 reviews
14
3.8K
834
3
Description

Hello, I am sharing my first workflow of the year. My goal was to use LLama 3.2 11B Vision and have it act as movie directors by describing images the way one would do it.

I have written a few different "Directors", each of them have their own style, play with them and see which one you like best. This idea was borrowed from the way LTXStudio creates videos.

---
Example of a director prompt:
(Cinematic Visual Focus)

Act as a visionary film director describing only the visual elements in the provided image. Focus on:

- Composition and framing (close-up, wide shot, etc.).

- Lighting, shadows, and color palette.

- Movement: capture the precise moment the subject(s) are caught mid-motion.

- Background/foreground details, set design, and spatial depth.

Avoid any emotional or narrative commentary; concentrate strictly on how the scene looks and how the camera might capture it.
---

This tool allows you to quickly create storyboards and short stories, what it also does is to generate 4 videos for every images you decide to animate. https://app.ltx.studio/


Nodes:

https://github.com/Lightricks/ComfyUI-LTXVideo

https://github.com/justUmen/Bjornulf_custom_nodes

https://github.com/SeanScripts/ComfyUI-PixtralLlamaMolmoVision

https://github.com/Kosinkadink/ComfyUI-VideoHelperSuite


Discussion

(No comments yet)

Loading...

Author

3
14.3K
105
57.3K
    LTX_LLM_DIRECTOR.json (229.6 kB)

No reviews yet

  • - latest (10 months ago)

Primitive Nodes (189)

Bjornulf_ShowStringText (4)

ImageConcatMulti (3)

LTXVApplySTG (1)

LTXVLoader (1)

LTXVModelConfigurator (4)

LTXVShiftSigmas (4)

LlamaVisionGenerateText (4)

LlamaVisionModelLoader (1)

Note (11)

Reroute (152)

STGGuider (4)

Custom Nodes (64)

ComfyUI

  • - CLIPTextEncode (8)

  • - BasicScheduler (4)

  • - VAEDecode (4)

  • - SamplerCustomAdvanced (4)

  • - KSamplerSelect (1)

  • - RandomNoise (1)

  • - CLIPLoader (1)

  • - LoadImage (1)

ComfyUI Easy Use

  • - easy cleanGpuUsed (10)

  • - PreviewBridge (1)

  • - VHS_VideoCombine (7)

  • - ImageResizeKJ (1)

  • - String Replace (mtb) (16)

  • - StringFunction|pysssss (4)

  • - Load Image Batch (1)

Checkpoints (0)

LoRAs (0)