ComfyUI - FLUX NF4 Model - Lighter and faster !

5.0

0 reviews
27
34.8K
9.3K
7
Description

"flux1-dev-bnb-nf4" is a new Flux model that is nearly 4 times faster than the Flux Dev version and 3 times faster than the Flux Schnell version.

*****************************************************

"bitsandbytes_NF4" custom node download:

https://github.com/comfyanonymous/ComfyUI_bitsandbytes_NF4

*****************************************************

"flux1-dev-bnb-nf4" model download:

https://huggingface.co/lllyasviel/flux1-dev-bnb-nf4/blob/main/flux1-dev-bnb-nf4.safetensors

*****************************************************

Download Flux nf4 workflow.

Click on below link for video tutorials:

https://www.youtube.com/@CgTopTips/videos

Node Diagram
Discussion
E
Eh Ke8 months ago

Same speed if you have enough vram but yes reduces vram like %20-30, so that's why its much faster if you run out of vram.  Quality wise i couldn't notice much difference it is still great.

👍1
强强任笑天7 months ago

Error occurred when executing CheckpointLoaderNF4:

load_checkpoint_guess_config() got an unexpected keyword argument 'model_options'

File "G:\ComfyUI\execution.py", line 152, in recursive_execute
output_data, output_ui = get_output_data(obj, input_data_all)
File "G:\ComfyUI\execution.py", line 82, in get_output_data
return_values = map_node_over_list(obj, input_data_all, obj.FUNCTION, allow_interrupt=True)
File "G:\ComfyUI\execution.py", line 75, in map_node_over_list
results.append(getattr(obj, func)(**slice_dict(input_data_all, i)))
File "G:\ComfyUI\custom_nodes\ComfyUI_bitsandbytes_NF4\__init__.py", line 178, in load_checkpoint
out = comfy.sd.load_checkpoint_guess_config(ckpt_path, output_vae=True, output_clip=True, embedding_directory=folder_paths.get_folder_paths("embeddings"), model_options={"custom_operations": OPS})
关闭

🤣1
J
JUNFEI CHEN7 months ago

我遇到跟你一样的问题,尝试了各种办法,升级comfyui,操作都没办法解决.....

I confirm what the guy wrote above uses less ram. But when you have enough ram for fp8 the difference for me is 0-2 seconds. On the plus side it generates very similar images, differences in detail.

worked just fine last night, today:

Error occurred when executing CheckpointLoaderNF4: Expecting value: line 1 column 1 (char 0) File "D:\COMFY\ComfyUI\ComfyUI_windows_portable\ComfyUI\execution.py", line 152, in recursive_execute output_data, output_ui = get_output_data(obj, input_data_all)

other error messgae here but the above is problaby the key

H
Hossein Hajian7 months ago

wolf

Author

99
423.2K
3.4K
1.4M

Reviews

No reviews yet

Versions (1)

  • - latest (8 months ago)

Primitive Nodes (3)

CheckpointLoaderNF4 (1)

FluxGuidance (1)

ModelSamplingFlux (1)

Custom Nodes (10)

ComfyUI

  • - SamplerCustomAdvanced (1)

  • - BasicScheduler (1)

  • - VAELoader (1)

  • - BasicGuider (1)

  • - KSamplerSelect (1)

  • - RandomNoise (1)

  • - CLIPTextEncode (1)

  • - EmptyLatentImage (1)

  • - VAEDecode (1)

  • - PreviewImage (1)

Checkpoints (1)

flux\flux1-dev-bnb-nf4.safetensors

LoRAs (0)