From 7987da94c9fe06bba3d07b9fe73a22ca92129536 Mon Sep 17 00:00:00 2001 From: "Dr. Peter Netz" <152088022+zentrocdot@users.noreply.github.com> Date: Mon, 10 Feb 2025 21:35:46 +0100 Subject: [PATCH] Aktualisieren von README.md --- README.md | 55 ++++++++++++++++++++++++++++++++++++++++++++++++++++--- 1 file changed, 52 insertions(+), 3 deletions(-) diff --git a/README.md b/README.md index 1737a42..383387f 100644 --- a/README.md +++ b/README.md @@ -1,7 +1,7 @@ > [!IMPORTANT] >

🚧 This documentation is still under -> construction. The development of the upscaler is a ongoing -> activity. There might be small differenes in comparison of +> construction. The development of the node is a little bit +> ongoing. There might be small differenes in comparison of > node and documentation.

# Preface @@ -10,16 +10,62 @@ what one is able to do with Moondream. One important thing is the Image To Prompt feature of Moondream.

+# Motivation + +Image To Prompt can be used in different ways. One can get an +idea how to change or improve a Prompt by suggestions from Image +To Prompt. It is also possible to get informations about the art +and style of the image. This can be helpful to get the right key +words for further work. + +# Introductory Words + +The node is using the CPU and not the GPU. First way, the proposed one, +can be done with Moon dream directly. For the second way one needs +Hugging face. + +In the first versions of the node the model cannot be selected. At the moment +there are four models available. In one of the following versions I will add the +support for all of the four models. + +In the future I need something like a download node, which should be offer the +possibility to download and monitor the process of the download in the node and +not in the terminal window. + # Node Preview +Figure 1 shows a preview of the node. Over the connector on +the left side one can load the image of interest. The connectors +on the right side have as output + +* Answer (to a question or Prompt) +* Short caption +* Normal caption + node preview

Figure 1: Node preview

+Like I have done it in the example workflow one should output all three +to get the best answer or caption for each case. + # Workflow Preview +Figure 2 shows the simple case of a workflow. From my point of view it +is not helpful to create in an automatic way new images from the given +answer or caption. + workflow preview

Figure 2: Example workflow preview

+Read the next section why I do not propose to use a automatic image generation. + +What the Workflow/Node Does + +Each time one let run the workflow Moon dream is generating a new answer. +No two answers will be the same. This way it make sense to run the workflow +different times untill one get an answer which one likes more than an other +answer. + # Installation ## Model Directory @@ -57,7 +103,10 @@ git clone https://github.com/zentrocdot/ComfyUI-Simple_Image_To_Prompt # Do-Do -Improvement of the documentation. +Improvement of the documentation. The open issue that I did not found a way to +unload a loaded model makes much more test runs necessary. + +The algorithm I found works well for the moment. Some approaches before that not. # References