Update comfyui_integration.md

This commit is contained in:
AIrjen
2023-08-04 22:07:02 +02:00
committed by GitHub
parent dd28375367
commit 9fbbaa91ac
+31 -19
View File
@@ -1,7 +1,7 @@
# ComfyUI integration
In this codebase there is a custom node, that can be used in ComfyUI.
Work is still in progress for all features to work flawlessly in ComfyUI, but a start has been made.
One Button Prompt is now also a ComfyUI extension.
There are 3 nodes currently availabe, with One Button Prompt node being the main one.
You can slam it in every workflow, where you replace it with the Positive Prompt node.
![image](https://github.com/AIrjen/OneButtonPrompt/assets/130234949/a9c6b449-772b-495c-b39d-eda0be38a203)
@@ -9,32 +9,44 @@ You can slam it in every workflow, where you replace it with the Positive Prompt
## Installing in ComfyUI
Navigate to your ComfyUI directory, and run the following command:
Navigate to your ComfyUI\custom_nodes\ directory, and run the following command:
```
git clone https://github.com/AIrjen/OneButtonPrompt
```
This should create a OneButtonPrompt directory in the ComfyUI folder.
This should create a OneButtonPrompt directory in the ComfyUI\custom_nodes\ folder.
![image](https://github.com/AIrjen/OneButtonPrompt/assets/130234949/5d9cfdd3-8342-4aff-a9a4-ecbbc7151856)
It could like something like this
From this folder, manually copy the file
```
OneButtonPrompt-node.py
```
Into the ComfyUI\custom_nodes\ folder.
That should look like this:
![image](https://github.com/AIrjen/OneButtonPrompt/assets/130234949/f2c9630e-790b-4a34-b46f-54dbb18b87d5)
![image](https://github.com/AIrjen/OneButtonPrompt/assets/130234949/50f9d8b4-dd0a-4c87-b8c4-25a159c71d75)
After that, restart ComfyUI, and you are ready to go.
It should be available in ComfyUI manager soonish as well.
## Custom nodes
### One Button Prompt
### Create Prompt Variant
You can use the "Create Prompt Variant" node, to create variants based on a prompt you input. The strength of the variant is set with the "insanity level" slider. Simply connect it between the positive prompt and the CLIP encoder module.
It will automatically create a small variance in the prompt, based on magic. It might not work for every prompt.
![image](https://github.com/AIrjen/OneButtonPrompt/assets/130234949/a0191a18-eac9-4261-ab26-4dfdd997dad0)
Here is an example of ComfyUI standard prompt "beautiful scenery nature glass bottle landscape, , purple galaxy bottle,"
These are all generated with the same model, same settings, same seed. But some of these have the Create Prompt Variant node included.
![image](https://github.com/AIrjen/OneButtonPrompt/assets/130234949/dfe7fc06-face-4949-a048-d310504d3c3c)
Here is an example of the entire example workflow.
![image](https://github.com/AIrjen/OneButtonPrompt/assets/130234949/117fc612-5a7d-4b0d-b163-adf8ff84555c)
### Known issues
1. ComfyUI does NOT store the prompt in the image, but the workflow. Since the prompt is not in the workflow, it is not saved. I am unsure wether there is a custom node for this.
2. There is a SEED option in the One Button Prompt node, this is a hacky thing. It is just there to make sure it is refired each time you generate an image.
3. Prompts are styled for Automatic1111, so it uses prompt switching, which is not supported by ComfyUI.
4. Easy installer not yet available.
1. There is a SEED option in the One Button Prompt node, this is a hacky thing. It is just there to make sure it is refired each time you generate an image.
Issues will be investigated over time.