From c56c8df8095504be17d49df4e7150481e1fd7daa Mon Sep 17 00:00:00 2001 From: Sumeth Sathnindu <65599800+LucipherDev@users.noreply.github.com> Date: Tue, 10 Dec 2024 00:51:11 +0530 Subject: [PATCH] Add image comparisons --- README.md | 19 +++++++++++++++---- 1 file changed, 15 insertions(+), 4 deletions(-) diff --git a/README.md b/README.md index c78b377..921ade8 100644 --- a/README.md +++ b/README.md @@ -1,5 +1,5 @@ # ComfyUI-Golden-Noise -ComfyUI Custom Node for ["Golden Noise for Diffusion Models: A Learning Framework"](https://arxiv.org/abs/2411.09502) and most of the code is adapted from [here]( https://github.com/xie-lab-ml/Golden-Noise-for-Diffusion-Models). This node refines the initial latent noise in the diffusion process, enhancing both image quality and semantic coherence. +ComfyUI Custom Node for ["Golden Noise for Diffusion Models: A Learning Framework"](https://arxiv.org/abs/2411.09502). Most of the code for this node is adapted from [here]( https://github.com/xie-lab-ml/Golden-Noise-for-Diffusion-Models). This node refines the initial latent noise in the diffusion process, enhancing both image quality and semantic coherence. ## Installation @@ -19,15 +19,15 @@ cd ComfyUI-Golden-Noise pip install -r requirements.txt ``` -### Or Install using ComfyUI Manager +### Or Install via ComfyUI Manager ## Usage -Download Safetensors of the pre-trained NPNet weights of Stable Diffusion XL, DreamShaper-xl-v2-turbo, and Hunyuan-DiT from Huggingface [LucipherDev/Golden-Noise-NPNets](https://huggingface.co/LucipherDev/Golden-Noise-NPNets) and put them in the **models/npnets** folder. +Download the safetensors of the pre-trained NPNet weights of Stable Diffusion XL, DreamShaper-xl-v2-turbo, and Hunyuan-DiT from Huggingface [LucipherDev/Golden-Noise-NPNets](https://huggingface.co/LucipherDev/Golden-Noise-NPNets) and put them in the **models/npnets** folder. The node can be found in "sampling/custom_sampling/noise" category as "GoldenNoise". -Look at the example workflow for more info. +Take a look at the example workflow for more info. ### Inputs @@ -37,6 +37,17 @@ Look at the example workflow for more info. - **npnet_model**: Pretrained NPNet model - **device**: "cuda", "cpu" +## Image Comparisons + +![comparison](https://github.com/user-attachments/assets/1e285c39-b044-43c3-bc5c-2986e387cacb) +**Comparisons from the node* + +This is a small comparison with only 50 images for each prompt, with and without using the golden noise node. The images were generated using the provided workflow (the random noise used to generate the first image is fed into the GoldenNoise node to generate the golden noise), and then each image was scored using [ImageReward](https://github.com/THUDM/ImageReward). The mean scores for with and without the node are shown in the comparison. From this, we can see that when using the node, the overall image quality is increased. However, The sample size is admittedly small, but it's all I can do with the resources and time I have. + +Another comparison. This is taken from the original paper. +![x1](https://github.com/user-attachments/assets/a031e0c0-8ccc-4c4f-b861-e7e72f7c5a9d) +**Comparisons from the original paper* + ## Citation Original Paper.