slahiri-ComfyUI-AI-Photography-Toolkit/Technical_Details.md

Technical Details

This document contains detailed technical information for advanced users. For basic usage, see the README.

Cloud Providers (SID_LLM_API)

The unified SID_LLM_API node supports 15+ providers:

Provider	API Key Required	Models
Anthropic	Yes	Claude 4.x Sonnet, Opus, Haiku
OpenAI	Yes	GPT-4o, GPT-4o-mini, o1, o3
Google Gemini	Yes	Gemini 2.0, 1.5 Pro, Flash
xAI Grok	Yes	grok-2-vision, grok-vision-beta
Mistral	Yes	pixtral-large, pixtral-12b
Together AI	Yes	Llama Vision, Qwen-VL
Fireworks	Yes	Llama, Qwen models
Groq	Yes	Llama 4 multimodal
Ollama	No (local)	Use custom_model field
LM Studio	No (local)	Use custom_model field
OpenRouter	Yes	Multiple providers
Custom	Optional	Any OpenAI-compatible endpoint

Provider Setup Examples

Anthropic Claude

Provider: Anthropic
API Key: sk-ant-xxx (from console.anthropic.com)
Model: claude-sonnet-4-5-20250929
Enable Reasoning: On (for agentic analysis)

OpenAI GPT-4

Provider: OpenAI
API Key: sk-xxx (from platform.openai.com)
Model: gpt-4o

Ollama (Local)

Provider: Ollama
Custom Model: llava (or your installed model name)
(No API key required - runs locally)

LM Studio (Local)

Provider: LM Studio
Custom Model: your-loaded-model-name
(No API key required - runs locally)

Local Models (SID_LLM_Local)

The SID_LLM_Local node runs vision models locally without API keys:

Model	VRAM	Description
Qwen3-VL-8B-Instruct	~8GB	Best quality prompts
Florence-2 Large	~4GB	Microsoft's efficient vision model
Moondream2	~4GB	Lightweight, fast inference
SmolVLM	~4GB	Compact vision-language model
Phi-3.5 Vision	~8GB	Microsoft's capable VLM (fastest)

Recommendation: QwenVL produces the best quality prompts. Phi-3.5 Vision is the fastest. Use with reasoning disabled (single-shot mode) for optimal results.

Quantization (CUDA only)

• Auto: Automatic based on VRAM
• None: Full precision (most VRAM)
• 4-bit: Lowest VRAM usage
• 8-bit: Balance of quality/VRAM

Prompt Generator Options

Analysis Modes

Mode	Components Analyzed	Use Case
Quick	Subject, setting	Fast previews
Standard	+ pose, clothing, lighting	General use
Detailed	+ all components	Quality output
Extreme	All + multiple passes	Maximum detail

Preset Styles

Preset	Focus Areas
Auto-Detect	Intelligent detection
Portrait	Face, expression, skin
Fashion & Outfit	Clothing, accessories
Artistic Style	Lighting, composition
NSFW/Detailed	Comprehensive body analysis

Auto Pipeline Selection

The node automatically chooses the pipeline based on LLM capabilities:

• Agentic Pipeline (reasoning enabled): Multi-step analysis with comprehensive component breakdown
• Single-Shot Pipeline (standard): Fast, direct prompt generation

This is controlled by the Enable Reasoning toggle on the LLM provider nodes.

Note: Local models perform better with reasoning disabled (single-shot mode). The agentic/reasoning mode requires structured JSON output which local models struggle with.

Node Settings Reference

SID_LLM_API Settings

Setting	Description
provider	Cloud provider selection
api_key	Provider API key
model	Model selection (provider-specific)
custom_model	Override model name
custom_api_url	Custom endpoint URL
max_tokens_preset	Output length (Short/Medium/Long/Very Long/Maximum)
temperature	Creativity (0.0-2.0)
enable_reasoning	Enable extended thinking for agentic analysis

SID_LLM_Local Settings

Setting	Description
model	Local model selection
max_tokens_preset	Output length preset
temperature	Creativity (0.0-2.0)
quantization	4-bit/8-bit/None/Auto
enable_reasoning	Enable reasoning mode (disabled by default)

Prompt Generator Inputs

Input	Options	Description
image	-	Source image to analyze
llm_model	-	Connect from SID_LLM_API or SID_LLM_Local
analysis_mode	Quick, Standard, Detailed, Extreme	Analysis depth
preset_style	Auto-Detect, Portrait, Fashion, Artistic, NSFW	Style preset
user_guidance	text	Optional custom instructions
seed	number	Reproducibility seed

Outputs

Output	Description
prompt	Generated Z-Image narrative prompt
width	Image width
height	Image height

Dependencies

All dependencies auto-install on first load:

• anthropic - Claude API
• openai - OpenAI-compatible APIs
• google-generativeai - Gemini API
• requests - HTTP library
• pyyaml - Configuration
• transformers - Local models
• accelerate - GPU optimization

Migration from v4.1.x

The following nodes have been removed and replaced with unified alternatives:

Deprecated Node	Replacement
SID_ZImagePromptGenerator (basic)	SID_ZImagePromptGenerator (unified)
SID_ZImagePromptGenerator_Advanced	SID_ZImagePromptGenerator (unified)
SID_ZImagePromptGenerator_Advanced_V2	SID_ZImagePromptGenerator (unified)
SID_Anthropic_LLM	SID_LLM_API (provider: Anthropic)
SID_OpenAI_Compatible_LLM	SID_LLM_API (provider: OpenAI/Custom)
SID_Grok_LLM	SID_LLM_API (provider: xAI Grok)
SID_GGUF_LLM	SID_LLM_Local
SID_QwenVL_LLM	SID_LLM_Local (model: QwenVL)

Migration Steps

Before (v4.1.x):

SID_Anthropic_LLM ─→ SID_ZImagePromptGenerator_Advanced_V2

After (v4.2.0):

SID_LLM_API ─→ SID_ZImagePromptGenerator

Simply:

1. Replace individual LLM nodes with SID_LLM_API or SID_LLM_Local
2. Replace any prompt generator with SID_ZImagePromptGenerator
3. Reconnect image and LLM model inputs