Searge-SDXL: EVOLVED v4.x v3.991 for ComfyUI

Custom nodes extension for ComfyUI, including a workflow to use SDXL 1.0 with both the base and refiner checkpoints.

Public test version 3.991

This version is the first public test version of the huge update to version 4.0 and is 95% feature complete.

Missing features

Right now the following features are still missing and are planned for the complete v4.0 release:

  • Prompt Styles - loading and applying style templates from a file
  • More Prompting Modes - many of the unique prompting modes from v3.x are still missing and need to be re-implemented in the new architecture of this extension
  • Condition Mixing - this is the foundation for re-introducing the v3.x prompting modes, but it's planned to have an even more flexible system to design your own custom prompting modes

Table of Content

Version 4.0 3.991

Instead of having separate workflows for different tasks, everything is integrated in one workflow file.

Always use the latest version of the workflow json file with the latest version of the custom nodes!

Installing and Updating

Checkpoints and Models for these Workflows

This workflow depends on certain checkpoint files to be installed in ComfyUI, here is a list of the necessary files that the workflow expects to be available.

If any of the mentioned folders does not exist in ComfyUI/models, create the missing folder and put the downloaded file into it.

I recommend to download and copy all these files (the required, recommended, and optional ones) to make full use of all features included in the workflow!

Direct Downloads

(from Huggingface)

  • (required) download SDXL 1.0 Base with 0.9 VAE (7 GB) and copy it into ComfyUI/models/checkpoints

    • (this should be pre-selected as the base model on the workflow already)
  • (recommended) download SDXL 1.0 Refiner with 0.9 VAE (6 GB) and copy it into ComfyUI/models/checkpoints

    • (you should select this as the refiner model on the workflow)
  • (optional) download Fixed SDXL 0.9 vae (335 MB) and copy it into ComfyUI/models/vae

    • (instead of using the VAE that's embedded in SDXL 1.0, this one has been fixed to work in fp16 and should fix the issue with generating black images)
  • (optional) download SDXL Offset Noise LoRA (50 MB) and copy it into ComfyUI/models/loras

    • (the example lora that was released alongside SDXL 1.0, it can add more contrast through offset-noise)
  • (recommended) download 4x-UltraSharp (67 MB) and copy it into ComfyUI/models/upscale_models

    • (you should select this as the primary upscaler on the workflow)
  • (recommended) download 4x_NMKD-Siax_200k (67 MB) and copy it into ComfyUI/models/upscale_models

    • (you should select this as the secondary upscaler on the workflow)
  • (recommended) download 4x_Nickelback_70000G (67 MB) and copy it into ComfyUI/models/upscale_models

    • (you should select this as the high-res upscaler on the workflow)
  • (optional) download 1x-ITF-SkinDiffDetail-Lite-v1 (20 MB) and copy it into ComfyUI/models/upscale_models

    • (you can select this as the detail processor on the workflow)
  • (required) download ControlNetHED (30 MB) and copy it into ComfyUI/models/annotators

    • (this will be used by the controlnet nodes)
  • (required) download res101 (531 MB) and copy it into ComfyUI/models/annotators

    • (this will be used by the controlnet nodes)
  • (recommended) download clip_vision_g (3.7 GB) and copy it into ComfyUI/models/clip_vision

    • (you should select this as the clip vision model on the workflow)
  • (recommended) download control-lora-canny-rank256 (774 MB) and copy it into ComfyUI/models/controlnet

    • (you should select this as the canny checkpoint on the workflow)
  • (recommended) download control-lora-depth-rank256 (774 MB) and copy it into ComfyUI/models/controlnet

    • (you should select this as the depth checkpoint on the workflow)
  • (recommended) download control-lora-recolor-rank256 (774 MB) and copy it into ComfyUI/models/controlnet

    • (you should select this as the recolor checkpoint on the workflow)
  • (recommended) download control-lora-sketch-rank256 (774 MB) and copy it into ComfyUI/models/controlnet

    • (you should select this as the sketch checkpoint on the workflow)
  • (optional) download OpenPoseXL2 (5 GB) and copy it into ComfyUI/models/controlnet

    • (you can select this as the custom controlnet checkpoint on the workflow)

Now everything should be prepared, but you may to have to adjust some file names in the different model selector boxes on the workflow. Do so by clicking on the filename in the workflow UI and selecting the correct file from the list.

Updates

Find information about the latest changes here.

What's new in v4.0 3.991?

Major Highlights

  • A complete re-write of the custom node extension and the SDXL workflow
  • Highly optimized processing pipeline, now up to 20% faster than in older workflow versions
  • Support for Controlnet and Revision, up to 5 can be applied together
  • Multi-LoRA support with up to 5 LoRA's at once
  • ... (TODO: list more major highlights)

Smaller Changes and Additions

  • Workflows created with this extension and metadata embeddings in generated images are forward-compatible with future updates of this project
  • The custom node extension included in this project is backward-compatible with every workflow since version v3.3
  • ... (TODO: list more smaller changes)


(5 multi-purpose image inputs for revision and controlnet)

The Workflow File

The workflow is included as a .json file in the workflow folder.

After updating Searge SDXL, always make sure to load the latest version of the json file if you want to benefit from the latest features, updates, and bugfixes.

(you can check the version of the workflow that you are using by looking at the workflow information box)

Workflow Version

Documentation

Click this link to see the documentation

(the main UI of the workflow)

Workflow Details

The EVOLVED v4.x workflow is a new workflow, created from scratch. It requires the latest additions to the SeargeSDXL custom node extension, because it makes use of some new node types.

The interface for using this new workflow is also designed in a different way, with all parameters that are usually tweaked to generate images tightly packed together. This should make it easier to have every important element on the screen at the same time without scrolling.

(more advanced UI elements right next to the main UI)

Operating Modes

Workflow Version

Text to Image Mode

In this mode you can generate images from text descriptions. The source image and the mask (next to the prompt inputs) are not used in this mode.

(example of using text-to-image in the workflow)


(result of the text-to-image example)

Image to Image Mode

In this mode you can generate images from text descriptions and a source image. The mask (next to the prompt inputs) is not used in this mode.

(example of using image-to-image in the workflow)


(result of the image-to-image example)

Inpainting Mode

In this mode you can generate images from text descriptions and a source image. Both, the source image and the mask (next to the prompt inputs) are used in this mode.

This is similar to the image to image mode, but it also lets you define a mask for selective changes of only parts of the image.

(example of using inpainting in the workflow)


(result of the inpainting example)

More Example Images

A small collection of example images (with embedded workflow) can be found in the examples folder. Here is an overview of the included images.

S
Description
No description provided
Readme MIT
184 MiB
Languages
Python 99.8%
Batchfile 0.2%