nodes/GiusTex-ComfyUI-DiffusersImageOutpaint
1
0
Fork 0
Code Issues Pull Requests Packages Projects Releases Wiki Activity

Update README.md

Browse Source
This commit is contained in:
GiusTex
2024-10-20 20:48:50 +02:00
committed by GitHub
parent 1e1bac8d6e
commit 80a754cab4
1 changed files with 5 additions and 12 deletions
Download Patch File Download Diff File Expand all files Collapse all files
README.md
+5 -12
View File
@@ -2,13 +2,14 @@ ComfyUI nodes for outpainting images with diffusers, based on [diffusers-image-o
![DiffusersImageOutpaint-Nodes-Screen](https://github.com/user-attachments/assets/2722e07c-1d6a-416e-a9d8-f26aaa9a45a7)
#### Update:
- You don't need any more the diffusers vae, and can use the extension in low vram mode using `sequential_cpu_offload` (also thanks to [zmwv823](https://github.com/GiusTex/ComfyUI-DiffusersImageOutpaint/pull/4)) that pushes the vram usage from *8,3 gb* down to **_6 gb_**.
- If your `text_encoder` and `text_encoder_2` names contain `.fp16.` or other things before `safetensors`, you need to remove it (see the table below).
#### Updates:
- 20/10/2024: No more need to download tokenizers nor text encoders! Now comfyui clip loader works, and you can use your clip models.
- 10/2024: You don't need any more the diffusers vae, and can use the extension in low vram mode using `sequential_cpu_offload` (also thanks to [zmwv823](https://github.com/GiusTex/ComfyUI-DiffusersImageOutpaint/pull/4)) that pushes the vram usage from *8,3 gb* down to **_6 gb_**.
- 10/2024: If your `text_encoder` and `text_encoder_2` names contain `.fp16.` or other things before `safetensors`, you need to remove it (see the table below).
## Installation
- Download this extension or `git clone` it in comfyui/custom_nodes, then (if comfyui-manager didn't already install the requirements or you have missing modules), from comfyui virtual env write `cd your/path/to/this/extension` and `pip install -r requirements.txt`.
- Download models in the **`comfyui/models/diffusion_models`** folder, following the grid below (you can use the links to download the suggested models; you can also change the main model, but you need the specified vae and controlnet since the extension is hardcoded to use them. You can always change the code to use different models):
- Download models in the **`comfyui/models/diffusion_models`** folder, following the grid below (you can use the links to download the suggested models; you can also change the main model, but you need the specified controlnet since the extension is hardcoded to use it, for now):
| **main model** | **controlnet model** |
| :-----: | :-----: |
| **[Diffuser Model folder](https://huggingface.co/SG161222/RealVisXL_V5.0_Lightning/tree/main)** (you can change this model) | **[Diffuser Controlnet folder](https://huggingface.co/xinsir/controlnet-union-sdxl-1.0/tree/main)** (you need this model) |
@@ -17,14 +18,6 @@ ComfyUI nodes for outpainting images with diffusers, based on [diffusers-image-o
| config.json, diffusion_pytorch_model.fp16.safetensors | |
| **Scheduler folder** | |
| scheduler_config.json | |
| **Text encoder folder** | |
| config.json, ~model.fp16.safetensors~ -> model.safetensors | |
| **Text encoder 2 folder** | |
| config.json, ~model.fp16.safetensors~ -> model.safetensors | |
| **Tokenizer folder** | |
| merges.txt, special_tokens_map.json, tokenizer_config.json, vocab.json | |
| **Tokenizer 2 folder** | |
| merges.txt, special_tokens_map.json, tokenizer_config.json, vocab.json | |
## Overview
- **Minimum VRAM**: 6 gb with 1280x720 image, rtx 3060, RealVisXL_V5.0_Lightning, sdxl-vae-fp16-fix, controlnet-union-sdxl-promax using `sequential_cpu_offload`, otherwise 8,3 gb;