Diffusers Format Checkpoint Loaders for ComfyUI

This project aims to create loaders for diffusers format checkpoint models, making it easier for ComfyUI users to use diffusers format checkpoints instead of the standard checkpoint formats.

This project was created to understand how the DiffusersLoader available in comfyUI works and enhance the functionality by making usable loaders.

Table of Contents

Introduction

This project provides tools and loaders for integrating diffusers format checkpoint models with ComfyUI. It helps users who already have diffusers format checkpoints to seamlessly use them without needing to convert them to the standard format.

Installation

Follow these steps to install and set up the project:

  1. Download the node via ComfyUI-Manager by searching: DiffusersLoader: image

  2. Add nodes to your workflow by:

  • Add Nodes -> DiffusersLoader -> Combined -> CombinedDiffusersLoader
  • image

Features

The CombinedDiffusersLoader supports loading of diffusers checkpoints for:

  • SD 1.5
  • SD 2.1
  • SDXL
  • SD3
  • AuraFlow
  • Flux

Workflow Example

The combined loader work in the same manner as existing checkpoints loader as seen in this workflow:

image

Select the name of the diffusers checkpoint folder from the dropdown list and connect the nodes.

Take note for SD3, AuraFlow and Flux:

  • The first run through will be slightly slower due to creation of a combined_safetensors.safetensors

Limitations & Future Improvements

Add support for other compatible diffusers format checkpoints For AuraFlow and SD3, the loading and combining for the combined_model.safetensors will have a delay for low-vram or low-system ram machines

Contributing

Contributions are always welcome! Please follow the contributing guidelines to submit issues or pull requests.

License

This project is licensed under the MIT License.

Contact the Author

Hafiz Saffie - hafiz.safs@gmail.com

Project Link: https://github.com/Scorpinaus/ComfyUI-DiffusersLoader

Version History

21/8 - Compatibility Update With ComfyUI, Addition of Flux Support

S
Description
No description provided
Readme
108 KiB
Languages
Python 100%