科林_Cyril Pilgrim
f6d72ef002
Motivation: The save button's style was originally an overly bright gradient, making it feel out of place compared to the frosted glass aesthetics. Additionally, the user requested the ability to close the modal using the Escape key. Implementation: 1. Updated '.llm-pm-actions-right button:last-child' CSS to use a restrained translucent background similar to the sidebar items, keeping it cohesive with the glassmorphism design. 2. Added a global 'keydown' listener on 'Escape' inside 'ProviderManager.show()' which correctly triggers 'closeModal()' (also checking for unsaved changes) and automatically removes itself when closed.
ComfyUI-LLMs-Toolkit
Language
Bring the power of Large Language Models into your ComfyUI workflows — no GPU needed.
What is this?
ComfyUI-LLMs-Toolkit lets you call mainstream LLMs (like DeepSeek, Qwen, GPT, Moonshot, and many more) directly from your ComfyUI workflows using simple API connections.
Whether you want to generate text, translate content, process images with vision models, or build structured JSON — this toolkit has you covered.
Key Features
- Built-in Provider Manager — Manage all your API providers visually from ComfyUI's menu bar. No config files to edit.
- 12 Providers Pre-configured — Qwen, DeepSeek, GLM, Doubao, Spark, Moonshot, Baichuan, MiniMax, StepFun, SenseChat, iFlow, ModelScope.
- Smart Model Dropdown — Select a provider, and the model list updates automatically.
- Vision Support — Send images to multimodal LLMs with the Image Preprocessor node.
- Won't Crash Your Workflow — If an API call fails, you get a readable error message instead of a broken workflow.
- Multi-turn Memory — Enable conversation memory for chat-style interactions.
Installation
Option A: ComfyUI Manager (Recommended)
- Open ComfyUI Manager
- Search for
ComfyUI-LLMs-Toolkit - Click Install → Restart ComfyUI
Option B: Manual Install
cd ComfyUI/custom_nodes/
git clone https://github.com/HuangYuChuh/ComfyUI-LLMs-Toolkit.git
cd ComfyUI-LLMs-Toolkit
pip install -r requirements.txt
Then restart ComfyUI.
Getting Started
Step 1: Open the Provider Manager
After installation, you'll see a LLMs_Manager button in ComfyUI's top menu bar. Click it to open the settings panel.
Step 2: Set Up Your Provider
- Pick a provider from the left sidebar (e.g., DeepSeek)
- Enter your API Key (get one from the provider's website)
- Click Check API to make sure it works ✅
- Add or edit the models you want to use
- Click Save and toggle Enable in Nodes on
Step 3: Add Nodes to Your Workflow
- Right-click in ComfyUI →
Add Node→🚦ComfyUI_LLMs_Toolkit - Add an OpenAI Compatible Adapter node
- Select your provider and model from the dropdowns
- Type your prompt, connect the output, and hit Queue!
Where to Get API Keys
| Provider | Website | Free Credits |
|---|---|---|
| DeepSeek | platform.deepseek.com | ¥500 free |
| Qwen | dashscope.aliyun.com | 1M tokens/month |
| GLM | open.bigmodel.cn | 5M tokens/month |
| Moonshot | platform.moonshot.cn | Free trial |
| OpenAI | platform.openai.com | $5 trial |
Available Nodes
LLM Nodes
| Node | What it does |
|---|---|
| OpenAI Compatible Adapter | The main node — send prompts to any OpenAI-compatible LLM and get text responses. Supports system prompts, multi-turn memory, and vision input. |
| LLMs Loader | Helper node for advanced config (outputs provider settings as a connection). |
| LLM Translator | Quick one-shot translation using any configured LLM. |
Vision
| Node | What it does |
|---|---|
| Image Preprocessor | Converts ComfyUI images to a format that vision LLMs can understand. Connect it to the adapter node's prep_img input. |
JSON Tools
| Node | What it does |
|---|---|
| JSON Builder (Simple / Medium / Large) | Create structured JSON data with 1, 5, or 10 key-value pairs. |
| JSON Combine | Merge multiple JSON objects into one. |
| JSON Extractor | Pull specific values out of a JSON string. |
| JSON Fixer | Automatically repair broken JSON that LLMs sometimes output. |
Text Tools
| Node | What it does |
|---|---|
| String Template | Fill in template strings with variables, e.g., "Hello {name}!" → "Hello Alice!" |
FAQ
My workflow keeps saying "API Key is missing"
Make sure you've:
- Opened the LLMs_Manager panel
- Selected your provider and entered the API key
- Clicked Save
- Toggled Enable in Nodes to ON
Can I use local models like Ollama?
Yes! Add a Custom Provider in the LLMs_Manager, set the Base URL to your local endpoint (e.g., http://localhost:11434/v1), and add your model names. Any OpenAI-compatible API works.
The model dropdown shows wrong models
Make sure to refresh the browser (Cmd+R / Ctrl+R) after making changes in the Provider Manager. The model list updates dynamically based on the selected provider.
A Note on Security
Your API keys are stored locally on your machine in config/providers.json. This file is excluded from Git by default, so your keys won't be accidentally shared if you push your code. Just be careful not to share this file manually.
Changelog
v1.2.0 — 2026-03-02
- Built-in Provider Manager UI with Cherry-Studio-style design
- Dynamic model filtering by provider
- Custom modal dialogs replacing native browser prompts
- Simplified node interface (removed redundant custom inputs)
v1.1.0 — 2026-03-01
- DeepSeek reasoning content extraction
- o1/o3 model system role compatibility
- Shared API client with smart retry
- Graceful error handling (no more workflow crashes)
- Fixed multi-turn memory and token display bugs
License
GNU Affero General Public License v3.0 (AGPL-3.0) — Free to use, modify, and share. If you modify or include this code in a service over a network, you must make the complete source code of your changes open and available under the same license.
If this project helps you, please give it a Star!
Made with ❤️ for the ComfyUI community