From 5a8206515817cc7f8d3a6059c067ac32457d410c Mon Sep 17 00:00:00 2001 From: shiimizu Date: Wed, 4 Sep 2024 18:18:42 -0700 Subject: [PATCH] Update README.md --- README.md | 22 +++++++++++++++------- 1 file changed, 15 insertions(+), 7 deletions(-) diff --git a/README.md b/README.md index 0c574d6..9eaab89 100644 --- a/README.md +++ b/README.md @@ -4,18 +4,20 @@ Check out the [SD-WebUI extension](https://github.com/pkuliyi2015/multidiffusion This extension enables **large image drawing & upscaling with limited VRAM** via the following techniques: -1. SOTA diffusion tiling algorithms: [Mixture of Diffusers](https://github.com/albarji/mixture-of-diffusers) Mixture of Diffusers Paper, [MultiDiffusion](https://github.com/omerbt/MultiDiffusion) MultiDiffusion Paper, and [SpotDiffusion](https://arxiv.org/abs/2407.15507) SpotDiffusion Paper -2. pkuliyi2015 & Kahsolt's Tiled VAE algorithm. -3. ~~pkuliyi2015 & Kahsolt's TIled Noise Inversion for better upscaling.~~ +- Reproduced SOTA Tiled Diffusion methods + - [MultiDiffusion](https://github.com/omerbt/MultiDiffusion) MultiDiffusion Paper + - [Mixture of Diffusers](https://github.com/albarji/mixture-of-diffusers) Mixture of Diffusers Paper +- pkuliyi2015 & Kahsolt's Tiled VAE algorithm +- ~~pkuliyi2015 & Kahsolt's TIled Noise Inversion method~~ > [!NOTE] > Sizes/dimensions are in pixels and then converted to latent-space sizes. ## Features -- [x] Model support + +- [x] Supported models - [x] SD1.x, SD2.x, SDXL, SD3 - - [x] Stable Cascade - [x] FLUX - [x] ControlNet support - [ ] ~~StableSR support~~ @@ -60,9 +62,11 @@ If you have the [Math Expression](https://github.com/pythongosssss/ComfyUI-Custo ### SpotDiffusion -A fast tiling algortihm that eliminates seams by shifting the denoise window per timestep. +[Paper](https://arxiv.org/abs/2407.15507) -To get the most out of SpotDiffusion, you'll want nice, clean tiles with no "overlaps". Overlaps are treated as another tile. Set `tile_overlap` to 0 and adjust `tile_width` and `tile_height` so your input image/latent is nicely divisible by it. That should result in faster gens. +A tiling algorithm that attempts to eliminate seams by randomly shifting the denoise window per timestep. It is mainly used for fast inferences by setting `tile_overlap` to 0; otherwise, it's better to stick with the other tiling strategies as they produce better outputs. + +This additional feature is experimental, in testing, and subject to change. ## Tiled VAE @@ -105,6 +109,10 @@ The following images can be loaded in ComfyUI.

4x upscale. 3 passes.

+## License +Great thanks to all the contributors! 🎉🎉🎉 +The implementation of MultiDiffusion, Mixture of Diffusers, and Tiled VAE code is currently under [Creative Commons Attribution-NonCommercial-ShareAlike 4.0 International License](https://creativecommons.org/licenses/by-nc-sa/4.0/) since it was borrowed from the wonderful [SD-WebUI extension](https://github.com/pkuliyi2015/multidiffusion-upscaler-for-automatic1111/). Anything else GPLv3. + ## Citation ```bibtex