# ComfyUI Seed API Integration This ComfyUI custom node provides comprehensive integration with Seed AI APIs, including both video generation (Seedance), image generation (Seedream/SeedEdit), and chat models (Seed 1.6). ## Features ### Video Generation (Seedance) - **Text-to-Video Generation**: Create videos from text descriptions - **Image-to-Video Generation**: Generate videos using input images as first frames - **First+Last Frame Generation**: Create videos between two specific frames - **Reference Images Generation**: Generate videos based on multiple reference images - **High-Quality Pro Models**: Access to premium Seedance Pro model ### Image Generation - **Text-to-Image Generation**: Create high-quality images from text prompts using Seedream 3.0 - **Image-to-Image Editing**: Edit and transform existing images with text descriptions using SeedEdit 3.0 - **Frame Extraction**: Convert video URLs to individual frames for further processing ## Installation 1. Clone this repository into your ComfyUI custom_nodes directory: ```bash cd ComfyUI/custom_nodes/ git clone https://github.com/FloyoAI/ComfyUI-Seed-API.git ``` 2. Install requirements: ```bash cd ComfyUI-Seed-API pip install -r requirements.txt ``` 3. Configure your BytePlus API key: - Get your API key from: https://www.byteplus.com/ - Edit `config.ini` and replace `` with your actual API key - Or set the environment variable: `export BYTEPLUS_API_KEY="your_key_here"` 4. Restart ComfyUI ## Available Nodes ### Video Generation Nodes (Seed/VideoGeneration) - **Seedance Lite Text-to-Video**: Generate videos from text prompts only - Input: Text prompt, resolution, ratio, duration, FPS, seed, camera settings - Output: Video URL (STRING) - Use case: Create videos from scratch using descriptive text - **Seedance Lite Image-to-Video**: Generate videos from a starting image - Input: Text prompt, input image, resolution, ratio, duration, FPS, seed, camera settings - Output: Video URL (STRING) - Use case: Animate static images or create videos with specific starting frames - **Seedance Lite First+Last Frame**: Generate videos between two keyframes - Input: Text prompt, first frame image, last frame image, resolution, ratio, duration - Output: Video URL (STRING) - Use case: Create smooth transitions between two specific images - **Seedance Lite Reference Images**: Generate videos using multiple reference images - Input: Text prompt, 2-4 reference images, resolution, ratio, duration - Output: Video URL (STRING) - Use case: Generate videos that maintain style/appearance consistency with reference materials - **Seedance Pro Text/Image-to-Video**: High-quality video generation - Input: Text prompt, mode selection, optional input image, resolution, ratio, duration - Output: Video URL (STRING) - Use case: Premium quality video generation for professional use ### Image Generation Nodes (Seed/ImageGeneration) - **Seedream Text-to-Image**: Generate images from text descriptions - Input: Text prompt, size selection, optional seed - Output: Generated image (IMAGE) - Use case: Create high-quality images from detailed text descriptions - **SeedEdit Image-to-Image**: Edit and transform existing images - Input: Text prompt, input image, size selection, guidance scale, optional seed - Output: Edited image (IMAGE) - Use case: Modify existing images based on text instructions (change colors, add/remove objects, style transfer) ### Chat & Vision Nodes (Seed/Chat) - **Seed 1.6 Chat**: Unified chat node with vision support and session memory - Input: Model selection, user message, session ID, optional system message, up to 4 images - Output: Response text, full conversation, session status - Models: seed-1-6-250615, seed-1-6-flash-250715 - Features: Session-based conversation memory, multimodal support, external history import - Use case: All chat scenarios - text generation, image analysis, complex conversations ### Utility Nodes (Seed/Video) - **Video URL to Frames**: Extract all frames from a video URL - Input: Video URL (STRING) - Output: Frame batch (IMAGE), frame count (INT), FPS (FLOAT) - Use case: Convert generated videos into individual frames for further image processing ## Usage Guide ### Video Generation Workflow 1. **Choose the appropriate video node** based on your input type: - Text only → Seedance Lite Text-to-Video - Single image → Seedance Lite Image-to-Video - Two images → Seedance Lite First+Last Frame - Multiple references → Seedance Lite Reference Images - High quality → Seedance Pro 2. **Configure parameters**: - **Prompt**: Describe what you want in the video - **Resolution**: 480p, 720p, or 1080p - **Ratio**: Aspect ratio (16:9, 1:1, 9:16, etc.) - **Duration**: 3-12 seconds 3. **Connect the output** to other nodes: - Use output URL directly with video preview nodes - Connect to "Video URL to Frames" to extract individual frames - Save video using external video saving nodes ### Image Generation Workflow 1. **For new images**: Use Seedream Text-to-Image - Write detailed prompts for best results - Experiment with different sizes for various use cases - Use seed values for reproducible results 2. **For image editing**: Use SeedEdit Image-to-Image - Load your source image - Describe the changes you want in the prompt - Adjust guidance scale (higher = more prompt adherence) - Size can be "adaptive" to maintain original dimensions 3. **Process results**: - Images output as standard ComfyUI IMAGE tensors - Compatible with all ComfyUI image processing nodes - Can be saved, edited, or used as input for video generation ### Chat & Vision Workflow 1. **Session management**: - **Session ID**: Use unique identifiers for different conversations (e.g., "project1", "analysis2") - **Session Memory**: Toggle on/off to maintain conversation context across multiple runs - **Clear Session**: Reset conversation memory when starting new topics 2. **Model selection**: - **seed-1-6-250615**: Balanced performance and quality - **seed-1-6-flash-250715**: Faster responses, optimized for speed 3. **Configure thinking and reasoning**: - **Thinking mode**: Enable for deeper reasoning (default: enabled) - **Reasoning effort**: Adjust computational intensity (low/medium/high) 4. **Use multimodal features**: - Attach up to 4 images simultaneously - Set image detail level (auto/high/low) based on your needs - High detail for analysis, low detail for simple recognition 5. **Conversation continuity**: - **Built-in memory**: Automatically remembers previous messages in the session - **External history**: Import conversations from other sources - **Full conversation output**: Get formatted conversation history for export/review ## Requirements - ComfyUI - Python 3.8+ - BytePlus API key - Required packages (see requirements.txt) ## Key Features - **No External Dependencies**: Base64 image conversion means no external hosting required - **Automatic Task Polling**: Video generation waits until completion automatically - **Comprehensive Error Handling**: Graceful degradation with detailed error messages - **ComfyUI Integration**: - Video outputs as URL strings compatible with video preview nodes - Image outputs as standard IMAGE tensors compatible with all image nodes - **Flexible Sizing**: Support for various aspect ratios and resolutions - **Seed Control**: Reproducible results with optional seed parameters ## Tips for Best Results ### Video Generation - **Be specific in prompts**: Include details about movement, camera angles, and style - **Use appropriate ratios**: Match your intended use case (16:9 for landscape, 9:16 for mobile, etc.) - **Leverage reference images**: For consistent character/style appearance across videos ### Image Generation - **Detailed prompts work better**: Include style, lighting, composition details - **Use SeedEdit for modifications**: Better than text-to-image for specific edits - **Guidance scale tuning**: Start with default 5.5, increase for more prompt adherence - **Size selection**: Use "adaptive" for SeedEdit to maintain original proportions ### Chat & Vision - **Session management**: Use descriptive session IDs and enable memory for ongoing conversations - **Model choice**: Use seed-1-6-flash-250715 for speed, seed-1-6-250615 for quality - **Image detail settings**: High detail for analysis tasks, low for simple recognition - **Thinking mode**: Keep enabled for complex reasoning, disable for simple responses - **System prompts**: Use for role-playing, context setting, and output formatting - **Memory limits**: Sessions automatically trim to last 20 messages to prevent memory bloat ## Troubleshooting - **API Key Issues**: Ensure your BytePlus API key is correctly set in config.ini or environment variables - **Empty Results**: Check ComfyUI console for detailed error messages - **Image Quality**: Try different prompts, seeds, or guidance scale values for better results