nodes/lks-ai-anynode
1
0
Fork 0
Code Issues Pull Requests Packages Projects Releases Wiki Activity

Update README.md

Browse Source
This commit is contained in:
LK Studio
2024-06-01 13:01:33 +01:00
committed by GitHub
parent 49060b0b4f
commit 68b0d2bb53
1 changed files with 7 additions and 7 deletions
Download Patch File Download Diff File Expand all files Collapse all files
README.md
+7 -7
View File
@@ -14,13 +14,6 @@ A ComfyUI Node that uses the power of LLMs to do anything with your input to mak
### [Join our Discord](https://discord.gg/RFpe6gsK5x)
## Update: Day 3 - Local LLMs Generating Nodes!
![Screenshot from 2024-05-27 13-32-58](https://github.com/lks-ai/anynode/assets/163685473/70cb508e-b2af-470a-b777-1ddebe1cd59c)
We now have an `AnyNode 🍄 (Gemini)` Node and our big star: The `AnyNode 🍄 (Local LLM)` Node.
This was the most requested feature since Day 1. The classic `AnyNode 🍄` will still use OpenAI directly.
- You can set each LocalLLM node to use a different local or hosted service as long as it's OpenAI compatible
- This means you can use [Ollama](https://ollama.com/), [vLLM](https://github.com/vllm-project/) and any other LocalLLM server from wherever you want
## Install: Update (We just got on ComfyUI Manager!)
1. Clone this repository into `comfy/custom_nodes` *or* Just search for `AnyNode` on ComfyUI Manager
@@ -42,6 +35,13 @@ This was the most requested feature since Day 1. The classic `AnyNode 🍄` will
`AnyNode 🍄 (Gemini)` is still being tested so it probably contains bugs. I will update this today.
## Local LLMs
![Screenshot from 2024-05-27 13-32-58](https://github.com/lks-ai/anynode/assets/163685473/70cb508e-b2af-470a-b777-1ddebe1cd59c)
We now have an `AnyNode 🍄 (Gemini)` Node and our big star: The `AnyNode 🍄 (Local LLM)` Node.
This was the most requested feature since Day 1. The classic `AnyNode 🍄` will still use OpenAI directly.
- You can set each LocalLLM node to use a different local or hosted service as long as it's OpenAI compatible
- This means you can use [Ollama](https://ollama.com/), [vLLM](https://github.com/vllm-project/) and any other LocalLLM server from wherever you want
### A Note about Security for the Local LLM variant
The way that AnyNode works, is that it executes code which happens externally from python that is coming back from the `server` on a ChatCompletions endpoint. To put that into perspective, wherever you point it, you are giving some sort of control in python to that place. **BE CAREFUL** that if you are not pointing it to `localhost` that you absolutely trust the address that you put into `server`.