Concept Video Maker(ollama)
5.0
1 reviewsDescription
A workflow for using LLM to make short videos. You just need to give a concept and do nothing. Chinese or other language can be used for prompt.
The workflow is to make the AI think it is a director to make a film, which requires eight scenes, generates corresponding pictures, and lets the AI add special effects to each scene. Finally, the special effects instructions are added to the PromptSchedule to generate a complete video.
The current revised workflow version no longer takes up a lot of VRAM, and the local default uses the smaller phi LLM model and Dreamshpaer SD 1.5 model.
==
一个使用AI制作小短片的工作流,你只要给个概念就可以,可使用中文。
工作流是让AI认为它是一个导演,需要6个场景,产生相对应的图片,并让AI在每个场景里面添加特效,最后做成特效的指令加入PromptSchedule,以生成整段完整的影片。
目前修正的工作流版本已不会占用大量VRAM,本地预设使用较小的phi LLM模型及Dreamshpaer SD 1.5模型
==
Example Concept:
1、Deep in the universe full of flowers and firework
2、宇宙中開滿了花朵
3、girls wearing kimono in summer
4、Nightstreet
5、The birth of earth
Discussion
(No comments yet)
Loading...
Reviews
No reviews yet
Versions (4)
- latest (2 years ago)
- v20240515-044441
- v20240514-161530
- v20240514-091631
Node Details
Primitive Nodes (0)
Custom Nodes (45)
- ADE_AnimateDiffUniformContextOptions (1)
- ADE_AnimateDiffLoaderWithContext (1)
- ADE_EmptyLatentImageLarge (1)
- CR Text Concatenate (3)
ComfyUI
- VAEDecode (2)
- FreeU_V2 (2)
- CheckpointLoaderSimple (1)
- PreviewImage (1)
- ImageListToImageBatch (1)
- KSamplerAdvanced //Inspire (2)
- OllamaGenerate (2)
- OllamaGenerateAdvance (2)
- IPAdapterWeights (1)
- IPAdapterPromptScheduleFromWeightsStrategy (1)
- IPAdapterNoise (1)
- IPAdapterBatch (2)
- IPAdapterUnifiedLoader (1)
- ACN_SparseCtrlLoaderAdvanced (1)
- ACN_SparseCtrlSpreadMethodNode (1)
- ACN_AdvancedControlNetApply (1)
- ScaledSoftControlNetWeights (1)
- TextSplitByDelimiter (1)
- VHS_VideoCombine (1)
- Efficient Loader (1)
- BatchPromptSchedule (1)
- ShowText|pysssss (5)
- StringFunction|pysssss (1)
- String Literal (5)
- SDXLPromptStyler (1)
Model Details
Checkpoints (1)
imp_v10.safetensors
LoRAs (0)