slahiriandClaude Opus 4.5
9d134da3e8
Major refactor consolidating 8+ nodes into 3 unified nodes: NEW NODES: - SID_LLM_API: Unified cloud provider (15+ APIs including Anthropic, OpenAI, Gemini, Grok, Ollama, LM Studio) - SID_LLM_Local: Unified local models (Florence-2, Moondream2, SmolVLM, Phi-3.5, QwenVL) - SID_ZImagePromptGenerator: Unified prompt generator with auto Single-Shot/Agentic pipeline selection DEPRECATED (removed): - SID_Anthropic_LLM → use SID_LLM_API - SID_OpenAI_Compatible_LLM → use SID_LLM_API - SID_Grok_LLM → use SID_LLM_API - SID_GGUF_LLM → use SID_LLM_Local - SID_QwenVL_LLM → use SID_LLM_Local - SID_ZImagePromptGenerator_Advanced_V2 → use SID_ZImagePromptGenerator SPEED OPTIMIZATIONS (SID_LLM_Local): - CUDA optimizations (cudnn.benchmark, TF32) - BF16 auto-selection for Ampere+ GPUs - Flash Attention 2 / SDPA auto-selection - KV cache enabled for all models - Memory cleanup on model switch 🤖 Generated with [Claude Code](https://claude.com/claude-code) Co-Authored-By: Claude Opus 4.5 <noreply@anthropic.com>
30 lines
951 B
Python
30 lines
951 B
Python
"""
|
|
LLM Provider Models for ComfyUI-AI-Photography-Toolkit.
|
|
|
|
This module contains modular LLM provider nodes that can be connected
|
|
to SID_ZImagePromptGenerator for flexible provider selection.
|
|
|
|
Nodes:
|
|
- SID_LLM_API: Unified cloud LLM provider (Anthropic, OpenAI, Gemini, Grok, etc.)
|
|
- SID_LLM_Local: Local vision models (Florence-2, Moondream2, SmolVLM, Phi-3.5, QwenVL)
|
|
"""
|
|
|
|
from .llm_model_type import LLMModelConfig, LLM_MODEL
|
|
from .base_llm_provider import BaseLLMProvider
|
|
from .sid_llm_api import SID_LLM_API
|
|
from .sid_llm_local import SID_LLM_Local, LocalModelClient, LOCAL_MODELS
|
|
|
|
__all__ = [
|
|
# Types
|
|
"LLMModelConfig",
|
|
"LLM_MODEL",
|
|
# Base class
|
|
"BaseLLMProvider",
|
|
# Provider nodes (only 2 nodes)
|
|
"SID_LLM_API", # Unified cloud LLM provider
|
|
"SID_LLM_Local", # Local vision models (Florence-2, Moondream2, SmolVLM, Phi-3.5, QwenVL)
|
|
# Local model utilities
|
|
"LocalModelClient",
|
|
"LOCAL_MODELS",
|
|
]
|