From d095b68094c71e66a08fe79d547993c4a8ed465e Mon Sep 17 00:00:00 2001 From: LK Studio <163685473+lks-ai@users.noreply.github.com> Date: Tue, 11 Jun 2024 18:01:55 +0100 Subject: [PATCH 1/4] Update README.md --- README.md | 19 ++++++++++++++----- 1 file changed, 14 insertions(+), 5 deletions(-) diff --git a/README.md b/README.md index 47e5210..7eb4f32 100644 --- a/README.md +++ b/README.md @@ -1,10 +1,9 @@ # ComfyUI-StableAudioSampler The New Stable Audio Open 1.0 Sampler In a ComfyUI Node. Make some beats! ![image](https://github.com/lks-ai/ComfyUI-StableAudioSampler/assets/163685473/477272f3-46c5-46e5-8de9-d74a93e91716) - +## An Example I Pasted Together +In this workflow, I got random `cfg_scale`, `sigma_min` and `step` values making variations on the same 16 beats; same `prompt` and `seed`. +https://github.com/lks-ai/ComfyUI-StableAudioSampler/assets/163685473/a930b798-b25a-492c-8b03-d4fd27b78491 # Caveats - The longer your audio, the more VRAM you need to stitch it together @@ -36,12 +35,21 @@ This is not an official StableAudioOpen repository. - A Prompt Node: Pipes conditioning - A Model Loading Node: Includes repo options and scans `models/audio_checkpoints` for models and config.json files - `control_after_generate` option -- Audio to Audio (like in the Gradio Example) +- Audio to Audio (like in the Gradio Example) **Still working on fix for this** - Can still use HF env key if you want - Generates audio and outputs raw bytes and a sample rate for use with VHS - Includes all of the original Stable Audio Open parameters - Sampler outputs a Spectrogram image (experimental) - Can save audio to file +- New Prefix Templates for save file naming +- Outputs a temporary `wav` to `temp/stableaudiosampler.wav` you can use for looping like in [this video](https://www.youtube.com/watch?v=_eR6tP-c8W4). + +### Example Workflows +#### [Exploring Same Prompt and Seed](https://github.com/lks-ai/ComfyUI-StableAudioSampler/blob/main/workflows/audio-space-exploration.json) + +The part I use AnyNode for is just getting random values within a range for `cfg_scale`, `steps` and `sigma_min` thanks to feedback from the community and some tinkering, I think I found a way in this workflow to just get endless sequences of the same seed/prompt in any key (because I mentioned what key the synth lead needed to be in). + +With the new save prefix templating, it makes it easy to just look at the file and know what settings (since wav doesn't have PNGinfo) ## Roadmap and Requested Features Keeping track of requests and ideas as they come in: @@ -54,6 +62,7 @@ Keeping track of requests and ideas as they come in: - Possibly Clipping at some dB - Cleaning up some of the current options with selectors, etc. - Upfi (upscaling fidelity) +- Audio Preview Node? We are very open to anyone who wants to contribute from the open source community. Make your forks and pull requests. We will build something cool. From 386b1230bbcf15bc6100e1d8937f4e49c14a749d Mon Sep 17 00:00:00 2001 From: LK Studio <163685473+lks-ai@users.noreply.github.com> Date: Tue, 11 Jun 2024 18:04:03 +0100 Subject: [PATCH 2/4] Update README.md --- README.md | 6 ++++-- 1 file changed, 4 insertions(+), 2 deletions(-) diff --git a/README.md b/README.md index 7eb4f32..39a9e0c 100644 --- a/README.md +++ b/README.md @@ -1,9 +1,11 @@ # ComfyUI-StableAudioSampler The New Stable Audio Open 1.0 Sampler In a ComfyUI Node. Make some beats! ![image](https://github.com/lks-ai/ComfyUI-StableAudioSampler/assets/163685473/477272f3-46c5-46e5-8de9-d74a93e91716) + ## An Example I Pasted Together -In this workflow, I got random `cfg_scale`, `sigma_min` and `step` values making variations on the same 16 beats; same `prompt` and `seed`. -https://github.com/lks-ai/ComfyUI-StableAudioSampler/assets/163685473/a930b798-b25a-492c-8b03-d4fd27b78491 +In this [workflow](https://github.com/lks-ai/ComfyUI-StableAudioSampler/blob/main/workflows/audio-space-exploration.json), I got random `cfg_scale`, `sigma_min` and `step` values making variations on the same 16 beats; same `prompt` and `seed`. + +https://github.com/lks-ai/ComfyUI-StableAudioSampler/assets/163685473/5f43db75-cc35-47f3-999b-6f65f91420eb # Caveats - The longer your audio, the more VRAM you need to stitch it together From ea6f9066957ce1e6a5cbb512977131b481287535 Mon Sep 17 00:00:00 2001 From: LK Studio <163685473+lks-ai@users.noreply.github.com> Date: Tue, 11 Jun 2024 18:04:31 +0100 Subject: [PATCH 3/4] Update README.md --- README.md | 2 +- 1 file changed, 1 insertion(+), 1 deletion(-) diff --git a/README.md b/README.md index 39a9e0c..b457ab2 100644 --- a/README.md +++ b/README.md @@ -3,7 +3,7 @@ The New Stable Audio Open 1.0 Sampler In a ComfyUI Node. Make some beats! ![image](https://github.com/lks-ai/ComfyUI-StableAudioSampler/assets/163685473/477272f3-46c5-46e5-8de9-d74a93e91716) ## An Example I Pasted Together -In this [workflow](https://github.com/lks-ai/ComfyUI-StableAudioSampler/blob/main/workflows/audio-space-exploration.json), I got random `cfg_scale`, `sigma_min` and `step` values making variations on the same 16 beats; same `prompt` and `seed`. +In this [workflow](https://github.com/lks-ai/ComfyUI-StableAudioSampler/blob/main/workflows/audio-space-exploration.json), I got random `cfg_scale`, `sigma_min` and `step` values making variations on the same 16 beats; same `prompt` and `seed`. **VOLUME WARNING!** https://github.com/lks-ai/ComfyUI-StableAudioSampler/assets/163685473/5f43db75-cc35-47f3-999b-6f65f91420eb From 2330b0e3942ccdcd0c0c814d2594eadf3184f28a Mon Sep 17 00:00:00 2001 From: LK Studio <163685473+lks-ai@users.noreply.github.com> Date: Thu, 13 Jun 2024 14:01:19 +0100 Subject: [PATCH 4/4] Update README.md --- README.md | 18 +++++++++++++++--- 1 file changed, 15 insertions(+), 3 deletions(-) diff --git a/README.md b/README.md index b457ab2..baf9090 100644 --- a/README.md +++ b/README.md @@ -64,9 +64,21 @@ Keeping track of requests and ideas as they come in: - Possibly Clipping at some dB - Cleaning up some of the current options with selectors, etc. - Upfi (upscaling fidelity) -- Audio Preview Node? - -We are very open to anyone who wants to contribute from the open source community. Make your forks and pull requests. We will build something cool. +- Audio Preview Node + +## Error: `progressbar` +If you get the `progressbar` error, you can use our new utility from the latest update. +```bash +cd ComfyUI/custom_modules/ComfyUI-StableAudioSampler +python util_discrepancies.py progressbar +``` +You will see something like this... +![Screenshot from 2024-06-13 13-02-30](https://github.com/lks-ai/ComfyUI-StableAudioSampler/assets/163685473/5ce10eb3-d841-4d21-bd48-93d697cff3d8) +In this screenshot, you see `protobuf` but that is only because I don't have version issues with `progressbar`. +**Note**: If I install one of those version suggestions, StableAudioSampler should work, but at the same time, it might make other packages not work. + +# Contributions +We are very open to anyone who wants to contribute from the open source community. Make your forks and pull requests. We will build something cool. If it's already on the roadmap, chances are we're already working on it, so check in with us. We will start a dev branch. # Feature Requests If you have a request for a feature, open an issue about it and it will be seen.