ComfyUI-MixMod

ComfyUI-MixMod provides a powerful way to combine multiple models during sampling.

VRAM requirement: Around 8gb vram is minimum. You might need to replace some models with gguf, I got 1sdxl, 1sdxlgguf and pixart sigma with gguf te running on 8gb vram.

Features

Mix multiple models during sampling
SD1.5+SDXL (use https://huggingface.co/ostris/sdxl-sd1-vae-lora to align the latents)
SDXL+Pixart sigma for increased prompt adherence, needs GGUF and ExtraModels for Comfyui
Scheduling everything
Multiple experimental modes.

Installation

Clone this repository into your ComfyUI's custom_nodes directory:

cd ComfyUI/custom_nodes
git clone https://github.com/Kantsche/comfyui-mixmod.git

Restart ComfyUI if it's already running.

Tips

Different models excel at different aspects - try mixing a detail-focused model with a composition-focused one
For FFT modes, base models work well for low frequencies, style models for high frequencies
Experiment with weights and CFG values to find the best balance
Schedule models to activate at different sampling steps for creative control

Compatibility

Tested with SD 1.5, SDXL and Pixart Sigma
Works with different model architectures (base, inpainting, etc.)
Only tested on Windows

Example workflow with pixart sigma:

It improves the prompt adherence of sdxl in general prompts:

Example with Ponyv6 and NoobAI:

Only Pony, Pony+Noob, Only Noob image

Credits

Created by Kantsche

README.md