Major Release - Complete Advanced Node Redesign ✨ New Features: - Advanced node: 4 operation modes (expand/refine/modify_style/add_details) - Advanced node: Clear detail levels (concise/moderate/detailed/exhaustive) - Advanced node: Optional image input with Qwen3-VL integration - Video nodes: Emphasis syntax preservation (keyword:1.5) - Video nodes: Alternation syntax support {option1|option2} 🔧 Changes: - Replaced confusing tier system with intuitive detail levels - Added operation modes for modifying existing prompts - Removed manual mode selection (auto-detected from image presence) - Added Qwen3-VL backend for image analysis - Backward compatible tier name mapping in expansion_engine 📚 Documentation: - README.md completely rewritten - docs/ADVANCED_NODE_REDESIGN.md - Complete redesign guide - docs/BUGFIX_ADVANCED_NODE.md - Syntax preservation details - Organized old docs into docs/archive/ 🐛 Fixes: - Emphasis syntax now properly preserved through LLM processing - Alternation syntax for random element selection - Image-to-video mode now functional with Qwen3-VL ⚡ Breaking Changes: None (fully backward compatible) See RELEASE_NOTES_v1.8.0.md for complete details.
213 lines
6.1 KiB
Markdown
213 lines
6.1 KiB
Markdown
# Quick Start Guide
|
|
|
|
Get up and running with AI Video Prompt Expander in 5 minutes!
|
|
|
|
## Step 1: Install LLM Backend
|
|
|
|
### Option A: LM Studio (Recommended for Beginners)
|
|
1. Download from https://lmstudio.ai/
|
|
2. Install and open LM Studio
|
|
3. Go to "Models" tab → Search for "llama-3-8b"
|
|
4. Download a model (recommended: Meta-Llama-3-8B-Instruct)
|
|
5. Go to "Local Server" tab → Select your model → Click "Start Server"
|
|
6. Note the endpoint (default: http://localhost:1234)
|
|
|
|
### Option B: Ollama (Better for Advanced Users)
|
|
1. Download from https://ollama.ai/
|
|
2. Install Ollama
|
|
3. Open terminal/command prompt
|
|
4. Run: `ollama pull llama3`
|
|
5. Server starts automatically (endpoint: http://localhost:11434)
|
|
|
|
### Option C: Local Qwen3-VL Vision Backend (Optional)
|
|
Use this if you want the image-to-video or image-to-image nodes to caption images without calling LM Studio/Ollama.
|
|
1. Install Python packages: `pip install transformers accelerate huggingface_hub bitsandbytes`
|
|
2. Download a Qwen3-VL model (e.g., `Qwen/Qwen3-VL-4B-Instruct`)
|
|
3. In the node, set `vision_backend` to `qwen3_vl`
|
|
4. Set `vision_model_name` to the repo or local path (append `@4bit`/`@8bit` if desired)
|
|
5. Use the `vision_endpoint` field for optional overrides like `quant=4bit;attn=sdpa`
|
|
|
|
## Step 2: Verify Installation
|
|
|
|
1. Open terminal in the video_prompter directory
|
|
2. Run: `python test_setup.py`
|
|
3. Choose your LLM backend and test connection
|
|
4. You should see "✅ ALL TESTS COMPLETED"
|
|
|
|
## Step 3: Restart ComfyUI
|
|
|
|
1. If ComfyUI is running, close it
|
|
2. Start ComfyUI
|
|
3. You should see the node load without errors
|
|
|
|
## Step 4: Add Node to Workflow
|
|
|
|
1. Right-click in ComfyUI → Add Node
|
|
2. Navigate to: **video → prompting → AI Video Prompt Expander**
|
|
3. The node will appear with all inputs ready
|
|
|
|
## Step 5: Basic Usage
|
|
|
|
### Your First Prompt Expansion
|
|
|
|
**Simple Setup:**
|
|
```
|
|
basic_prompt: "A cat playing piano in a cozy room"
|
|
preset: cinematic
|
|
expansion_tier: auto
|
|
mode: text-to-video
|
|
llm_backend: lm_studio (or ollama)
|
|
model_name: llama3
|
|
api_endpoint: http://localhost:1234/v1 (LM Studio) or http://localhost:11434/api (Ollama)
|
|
temperature: 0.7
|
|
positive_keywords: (leave empty for now)
|
|
negative_keywords: (leave empty for now)
|
|
num_variations: 1
|
|
save_to_file: true
|
|
filename_base: my_first_prompt
|
|
```
|
|
|
|
**Click "Queue Prompt"**
|
|
|
|
The node will:
|
|
1. Connect to your LLM
|
|
2. Analyze your input
|
|
3. Expand it to a detailed cinematic prompt
|
|
4. Generate a negative prompt
|
|
5. Save everything to a file
|
|
6. Show status with file location
|
|
|
|
### Check Your Output
|
|
|
|
Look at the outputs:
|
|
- **positive_prompt_1**: Your enhanced prompt (connect to video generation)
|
|
- **negative_prompt**: Auto-generated negatives (connect to video generation)
|
|
- **status**: Shows success and file save location
|
|
|
|
Open the saved file in `ComfyUI/output/video_prompts/` to see the full breakdown!
|
|
|
|
## Step 6: Connect to Video Generation
|
|
|
|
```
|
|
[AI Video Prompt Expander]
|
|
↓ positive_prompt_1 → [Your Video Gen Node] → prompt
|
|
↓ negative_prompt → [Your Video Gen Node] → negative_prompt
|
|
```
|
|
|
|
Now generate your video!
|
|
|
|
## Common First-Time Issues
|
|
|
|
### "Cannot connect to LM Studio"
|
|
- Make sure LM Studio's server is running (green indicator)
|
|
- Check the endpoint matches (http://localhost:1234/v1)
|
|
- Try clicking "Test Connection" in LM Studio
|
|
|
|
### "Cannot connect to Ollama"
|
|
- Run `ollama serve` in terminal if needed
|
|
- Check if Ollama is running: `ollama list`
|
|
- Verify endpoint: http://localhost:11434/api
|
|
|
|
### "Model not found"
|
|
- In LM Studio: Make sure model is selected in Local Server tab
|
|
- In Ollama: Run `ollama list` to see available models
|
|
- Match the model_name exactly as shown
|
|
|
|
### Node doesn't appear in ComfyUI
|
|
- Restart ComfyUI completely
|
|
- Check for error messages in ComfyUI console
|
|
- Verify all files are in custom_nodes/video_prompter/
|
|
|
|
## Next Steps
|
|
|
|
Once you have basic expansion working:
|
|
|
|
1. **Try Different Presets**
|
|
- Change preset to "noir", "action", "surreal"
|
|
- See how dramatically the style changes
|
|
|
|
2. **Experiment with Tiers**
|
|
- Compare "basic", "enhanced", "advanced", "cinematic"
|
|
- See the detail increase with each tier
|
|
|
|
3. **Add Keywords**
|
|
- If using LoRAs, add triggers to positive_keywords
|
|
- Try style keywords like "professional, high-quality"
|
|
|
|
4. **Generate Variations**
|
|
- Set num_variations to 2 or 3
|
|
- Connect each output to different video gen nodes
|
|
- Pick the best result
|
|
|
|
5. **Adjust Temperature**
|
|
- Lower (0.3-0.5) for consistent style
|
|
- Higher (0.8-1.2) for creative variations
|
|
|
|
## Example Workflows
|
|
|
|
### Workflow 1: Single Video
|
|
```
|
|
[AI Video Prompt Expander]
|
|
↓ (positive_prompt_1)
|
|
[CogVideoX Text2Video]
|
|
↓
|
|
[Save Video]
|
|
```
|
|
|
|
### Workflow 2: Multiple Variations
|
|
```
|
|
[AI Video Prompt Expander] (num_variations: 3)
|
|
↓ (positive_prompt_1) → [Video Gen] → [Save as version_1]
|
|
↓ (positive_prompt_2) → [Video Gen] → [Save as version_2]
|
|
↓ (positive_prompt_3) → [Video Gen] → [Save as version_3]
|
|
```
|
|
|
|
### Workflow 3: Image-to-Video
|
|
```
|
|
[Load Image]
|
|
↓
|
|
[AI Video Prompt Expander] (mode: image-to-video)
|
|
↓ (positive_prompt_1)
|
|
[Image2Video Node]
|
|
↓
|
|
[Save Video]
|
|
```
|
|
|
|
## Tips for Success
|
|
|
|
1. **Start Simple**: Let the node do the work
|
|
2. **Use Auto Tier**: It's smart about detecting complexity
|
|
3. **Save Prompts**: Build a library for reference
|
|
4. **Try Presets**: Each one is dramatically different
|
|
5. **Read Status**: It tells you exactly what happened
|
|
6. **Check Files**: Saved prompts include full breakdown
|
|
|
|
## Resources
|
|
|
|
- **Full Documentation**: See README.md
|
|
- **Configuration Guide**: See CONFIGURATION.md
|
|
- **Presets Reference**: See presets.py
|
|
- **Test Your Setup**: Run test_setup.py
|
|
|
|
## Getting Help
|
|
|
|
If something isn't working:
|
|
|
|
1. Run `python test_setup.py` - it will identify issues
|
|
2. Check the **status** output - it shows errors clearly
|
|
3. Review your LLM backend connection
|
|
4. Check ComfyUI console for error messages
|
|
5. Verify model is loaded and endpoint is correct
|
|
|
|
## Success!
|
|
|
|
If you:
|
|
- ✅ See the node in ComfyUI
|
|
- ✅ Get a status message like "✅ Generated 1 variation(s)..."
|
|
- ✅ Have text in positive_prompt_1 output
|
|
- ✅ See a saved file in output/video_prompts/
|
|
|
|
**You're ready to create amazing video prompts!** 🎬
|
|
|
|
Now go make something awesome! 🚀
|