This commit is contained in:
kijai
2024-10-11 15:55:51 +03:00
+53 -4
View File
@@ -1,16 +1,17 @@
# ComfyUI wrapper nodes for Pyramid-Flow
# NOT FULLY FUNCTIONAL YET
![image](https://github.com/user-attachments/assets/f863b596-6417-4d02-91ba-f9143f696d68)
https://github.com/user-attachments/assets/ab66fed8-4a91-4b45-9c08-77086257833f
todo
- refactor to use comfy text encoding instead
- optimize memory use
Besides text encoder, this should already run at 10-12GB VRAM
Besides text encoder, this should already run at 10-12GB VRAM when using 1280x768.
With fp8 and 384p model it can fit under 10GB too.
Model loading has not been optimized at all yet, currently needs everything from here:
Model loading has not been optimized at all yet, currently needs everything (choose either of the transformers) from here:
https://huggingface.co/rain1011/pyramid-flow-sd3/tree/main
@@ -18,4 +19,52 @@ to:
`ComfyUI/models/pyramidflow/pyramid-flow-sd3`
So that the directory structure is as follows:
```
\ComfyUI\models\pyramidflow\pyramid-flow-sd3
├───causal_video_vae
│ config.json
│ diffusion_pytorch_model.safetensors
│
├───diffusion_transformer_384p
│ config.json
│ diffusion_pytorch_model.safetensors
│
├───diffusion_transformer_768p
│ config.json
│ diffusion_pytorch_model.safetensors
│
├───text_encoder
│ config.json
│ model.safetensors
│
├───text_encoder_2
│ config.json
│ model.safetensors
│
├───text_encoder_3
│ config.json
│ model-00001-of-00002.safetensors
│ model-00002-of-00002.safetensors
│ model.safetensors.index.json
│
├───tokenizer
│ merges.txt
│ special_tokens_map.json
│ tokenizer_config.json
│ vocab.json
│
├───tokenizer_2
│ merges.txt
│ special_tokens_map.json
│ tokenizer_config.json
│ vocab.json
│
└───tokenizer_3
special_tokens_map.json
spiece.model
tokenizer.json
tokenizer_config.json
```
Original repo: https://github.com/jy0205/Pyramid-Flow