Diffusers Format Checkpoint Loaders for ComfyUI
This project aims to create loaders for diffusers format checkpoint models, making it easier for ComfyUI users to use diffusers format checkpoints instead of the standard checkpoint formats.
This project was created to understand how the DiffusersLoader avaliable in comfyUI works and enhance the functionality by making usable loaders.
Table of Contents
Introduction
This project provides tools and loaders for integrating diffusers format checkpoint models with ComfyUI. It helps users who already have diffusers format checkpoints to seamlessly use them without needing to convert them to the standard format.
Installation
Follow these steps to install and set up the project:
-
Download the node via ComfyUI-Manager by searching: DiffusersLoader:
-
Add nodes to your workflow by:
- Add Nodes -> DiffusersLoader -> Combined -> CombinedDiffusersLoader
Features
The CombinedDiffusersLoader supports loading of diffusers checkpoints for:
- SD 1.5
- SD 2.1
- SDXL
- SD3
- AuraFlow
Workflow Example
The combined loader work in the same manner as existing checkpoints loader as seen in this workflow:
Select the name of the diffusers checkpoint folder from the dropdown list and connect the nodes.
Take note for SD3:
- You have the option for the T5 encoder (text_encoder_3) to select either part_1, part_2, or all (both).
- Selecting all will create a combined T5 encoder in the same folder named combined_text_encoder.safetensors for the first use.
Limitations & Future Improvements
Add support for other compatible diffusers format checkpoints For AuraFlow and SD3, the loading and combining for the combined_model.safetensors will have a delay for low-vram or low-system ram machines
Contributing
Contributions are always welcome! Please follow the contributing guidelines to submit issues or pull requests.
License
This project is licensed under the MIT License.
Contact the Author
Hafiz Saffie - hafiz.safs@gmail.com
Project Link: https://github.com/Scorpinaus/ComfyUI-DiffusersLoader