nodes/hekmon-comfyui-openai-api
1
0
Fork 0
Code Issues Pull Requests Packages Projects Releases Wiki Activity

docs: replace deprecated TGI with SGLang

Browse Source 
The TGI repository was archived on 2026-03-21 and is in maintenance
mode since late 2025; Hugging Face now recommends vLLM and SGLang
as forward inference engines.
This commit is contained in:
hekmon
2026-10-15 13:16:48 +00:00
parent 3052053430
commit c4f2fb1dfd
2 changed files with 2 additions and 2 deletions
Download Patch File Download Diff File Expand all files Collapse all files
README.md
+1 -1
View File
@@ -12,7 +12,7 @@ Thanks to its simplicity the project has a low footprint: it only has 1 external
## Usage
The default `base_url` parameter value targets the official OpenAI API endpoint by default but by changing it, you can also use this project with any OpenAI API compatible servers like Ollama, vLLM, TGI, etc...
The default `base_url` parameter value targets the official OpenAI API endpoint by default but by changing it, you can also use this project with any OpenAI API compatible servers like Ollama, vLLM, SGLang, etc...
Multiples images are supported as long as they are fed batched to the chat completion node.
pyproject.toml
+1 -1
View File
@@ -1,6 +1,6 @@
[project]
name = "openai-api"
description = "Call LLM and VLM from ComfyUI using the OpenAI API standard. Compatible with custom inference servers like Ollama, vLLM or TGI thru their support of their OpenAI API implementation."
description = "Call LLM and VLM from ComfyUI using the OpenAI API standard. Compatible with custom inference servers like Ollama, vLLM or SGLang thru their support of the OpenAI API implementation."
version = "3.0.0"
license = { file = "LICENSE" }
# Numpy and Pillow same as ComfyUI