From 339b13cb24d09d3fe469241c9ad1771f609f7f4d Mon Sep 17 00:00:00 2001 From: =?UTF-8?q?Jukka=20Sepp=C3=A4nen?= <40791699+kijai@users.noreply.github.com> Date: Fri, 11 Oct 2024 11:16:28 +0300 Subject: [PATCH] Update README.md --- README.md | 55 +++++++++++++++++++++++++++++++++++++++++++++++++++---- 1 file changed, 51 insertions(+), 4 deletions(-) diff --git a/README.md b/README.md index 76212f3..5a2a32f 100644 --- a/README.md +++ b/README.md @@ -1,16 +1,15 @@ # ComfyUI wrapper nodes for Pyramid-Flow -# NOT FULLY FUNCTIONAL YET - ![image](https://github.com/user-attachments/assets/f863b596-6417-4d02-91ba-f9143f696d68) todo - refactor to use comfy text encoding instead - optimize memory use -Besides text encoder, this should already run at 10-12GB VRAM +Besides text encoder, this should already run at 10-12GB VRAM when using 1280x768. +With fp8 and 384p model it can fit under 10GB too. -Model loading has not been optimized at all yet, currently needs everything from here: +Model loading has not been optimized at all yet, currently needs everything (choose either of the transformers) from here: https://huggingface.co/rain1011/pyramid-flow-sd3/tree/main @@ -18,4 +17,52 @@ to: `ComfyUI/models/pyramidflow/pyramid-flow-sd3` +So that the directory structure is as follows: +``` +\ComfyUI\models\pyramidflow\pyramid-flow-sd3 +├───causal_video_vae +│ config.json +│ diffusion_pytorch_model.bin +│ +├───diffusion_transformer_384p +│ config.json +│ diffusion_pytorch_model.bin +│ +├───diffusion_transformer_768p +│ config.json +│ diffusion_pytorch_model.bin +│ +├───text_encoder +│ config.json +│ model.safetensors +│ +├───text_encoder_2 +│ config.json +│ model.safetensors +│ +├───text_encoder_3 +│ config.json +│ model-00001-of-00002.safetensors +│ model-00002-of-00002.safetensors +│ model.safetensors.index.json +│ +├───tokenizer +│ merges.txt +│ special_tokens_map.json +│ tokenizer_config.json +│ vocab.json +│ +├───tokenizer_2 +│ merges.txt +│ special_tokens_map.json +│ tokenizer_config.json +│ vocab.json +│ +└───tokenizer_3 + special_tokens_map.json + spiece.model + tokenizer.json + tokenizer_config.json +``` + Original repo: https://github.com/jy0205/Pyramid-Flow