From 4ba549766d4443f826710d560428fb141f0caa2d Mon Sep 17 00:00:00 2001 From: AIrjen <130234949+AIrjen@users.noreply.github.com> Date: Tue, 13 Jun 2023 19:06:38 +0200 Subject: [PATCH 1/3] Create the_next_generation_img2img_and_controlnet.md --- ..._next_generation_img2img_and_controlnet.md | 40 +++++++++++++++++++ 1 file changed, 40 insertions(+) create mode 100644 user_guides/the_next_generation_img2img_and_controlnet.md diff --git a/user_guides/the_next_generation_img2img_and_controlnet.md b/user_guides/the_next_generation_img2img_and_controlnet.md new file mode 100644 index 0000000..9b1040e --- /dev/null +++ b/user_guides/the_next_generation_img2img_and_controlnet.md @@ -0,0 +1,40 @@ +# Combining One Button Prompt with IMG2IMG and ControlNET + +Since One Button Prompt does nothing more than generate a prompt, means we can combine it with most other tools and extensions available. In this document, I'd like to show you some possibilities of using it with IMG2IMG functionality and ControlNET. +Hopefully this will lead to additional inspiration and new ways to approach these tools. + +## Generating skulls with IMG2IMG + +In this example, I'm using a picture of a skull found on the internet. I'm using this one, since it has loads of background noise, which can create interesting stuff. + + + +I load up this image in IMG2IMG. I kept the Denoise strength at 0.75 for this example. + +In One Button Prompt, I use the following settings: + +As a __"Subject Type"__ I select __"object"__, because we are generating a skull, and a skull is an object. At least, from One Button Prompt's perspective. + +For __"Artists"__ I select __"all"__. I want to get surprised, so I leave this to all. + +As __"Type of image"__ I select __"portrait"__, so that it will always default to a portrait image. Since we want a close up of the skull, that matches the picture. + +As the __"Subject override"__ I write down __skull__, so it will start generating skulls. If you want, you can change this to something else, or leave blank for interesting results. + +![image](https://github.com/AIrjen/OneButtonPrompt/assets/130234949/f490c699-8cfb-4913-8519-05d19780bb56) + +Example output images: + + + + +> portrait,close up of a Baroque skull, designed by Lamborghini, floating in space, Golden ratio, plain deep yellow background, at Twilight, Ultrarealistic, Golden ratio + +> portrait,close up of a Authentic Chinoiserie skull, dark orange and Orange background, Berlin Secession, Rembrandt lighting, Desaturated, made of Concrete, masterpiece + + + + +> art by Gail Simone, portrait,close up of a Visually Stimulating Visually Stimulating skull, Sharp details, [garden|jungle], at Sunrise, telephoto lens + +> art by Kim Keever, portrait,close up of a Enthralling Tang Dynasty skull, Happy From 4f351643ac2edc417ca20a8d580ff4cd9d765a63 Mon Sep 17 00:00:00 2001 From: AIrjen <130234949+AIrjen@users.noreply.github.com> Date: Tue, 13 Jun 2023 19:25:53 +0200 Subject: [PATCH 2/3] Update the_next_generation_img2img_and_controlnet.md added ControlNET stormtrooper images --- ..._next_generation_img2img_and_controlnet.md | 45 +++++++++++++++++++ 1 file changed, 45 insertions(+) diff --git a/user_guides/the_next_generation_img2img_and_controlnet.md b/user_guides/the_next_generation_img2img_and_controlnet.md index 9b1040e..6fe77ea 100644 --- a/user_guides/the_next_generation_img2img_and_controlnet.md +++ b/user_guides/the_next_generation_img2img_and_controlnet.md @@ -3,6 +3,10 @@ Since One Button Prompt does nothing more than generate a prompt, means we can combine it with most other tools and extensions available. In this document, I'd like to show you some possibilities of using it with IMG2IMG functionality and ControlNET. Hopefully this will lead to additional inspiration and new ways to approach these tools. +In these examples, I am all using the [deliberate](https://civitai.com/models/4823/deliberate) model. + +I've set the Sampling method to "DPM++ SDE Karras", Sampling steps to "30" and used the standard CFG Scale "7", + ## Generating skulls with IMG2IMG In this example, I'm using a picture of a skull found on the internet. I'm using this one, since it has loads of background noise, which can create interesting stuff. @@ -38,3 +42,44 @@ Example output images: > art by Gail Simone, portrait,close up of a Visually Stimulating Visually Stimulating skull, Sharp details, [garden|jungle], at Sunrise, telephoto lens > art by Kim Keever, portrait,close up of a Enthralling Tang Dynasty skull, Happy + +## Generating Stormtrooper helmet based images with ControlNET +In this case, we are going back to using TXT2IMG. Please note, that most of these images came out amazing. + +I've configured ControlNET to use this Stormtrooper helmet: + + + +I've set it to use the __"Depth"__ ControlNET model. In this case I'm using __"depth_midas"__, this is what it defaulted to. + +I've set __"Ending Control Step"__ to __0,75__, meaning that ControlNET will stop doing it's thing 75% through all steps. + +I'm using the setting __"My prompt is more important"__ + +![image](https://github.com/AIrjen/OneButtonPrompt/assets/130234949/6a2ea3f4-c398-4be3-b3f4-4b58a58b9505) + +I've set up One Button Prompt to the following settings: + +As a __"Subject Type"__ I select __"object"__, however, you could try __all__ to get even wierder results. + +For __"Artists"__ I select __"all"__. I want to get surprised, so I leave this to all. + +As __"Type of image"__ I select __"all"__, more surprises in store for us. + +![image](https://github.com/AIrjen/OneButtonPrompt/assets/130234949/2b769bd4-e8fa-4346-9751-4298f6161518) + +Example images: + + + + +> art by Kazuo Oga, Golden ratio, Obscene hypercar, concept art, from inside of a Elite Dalaran, Summer, Grim, Auroracore, Sun Rays, Kodak Ektar + +> Cycles render, Messy Ecuadorian Volkswagen of Guilt, concept art, Funk Art, bloom, art by Shepard Fairey + + + + +> art by Alejandro Burdisio, (art by Alex Schomburg:1.0), voxel art, Alluring Entrancing Castle of Haste, smooth, Folded street, Lens Flare + +> art by Vanessa Bell, (art by Jhonen Vasquez:1.0), grand Octane render, Unpredictable Taiwanese Snow plow, intricate details, Smug, Reflected light, matte, Bright design From 3238fee65fbd2a4d957001010fd15d3adfd3ccdd Mon Sep 17 00:00:00 2001 From: AIrjen <130234949+AIrjen@users.noreply.github.com> Date: Tue, 13 Jun 2023 19:26:37 +0200 Subject: [PATCH 3/3] Update the_next_generation_img2img_and_controlnet.md --- user_guides/the_next_generation_img2img_and_controlnet.md | 2 +- 1 file changed, 1 insertion(+), 1 deletion(-) diff --git a/user_guides/the_next_generation_img2img_and_controlnet.md b/user_guides/the_next_generation_img2img_and_controlnet.md index 6fe77ea..7e9197d 100644 --- a/user_guides/the_next_generation_img2img_and_controlnet.md +++ b/user_guides/the_next_generation_img2img_and_controlnet.md @@ -44,7 +44,7 @@ Example output images: > art by Kim Keever, portrait,close up of a Enthralling Tang Dynasty skull, Happy ## Generating Stormtrooper helmet based images with ControlNET -In this case, we are going back to using TXT2IMG. Please note, that most of these images came out amazing. +In this case, we are going back to using TXT2IMG. Please note, that most of these images came out amazing. You can use this trick to win almost anything on \r\sdbattles\ I've configured ControlNET to use this Stormtrooper helmet: