ComfyUI Seed API Integration

This ComfyUI custom node provides comprehensive integration with Seed AI APIs, including both video generation (Seedance), image generation (Seedream/SeedEdit), and chat models (Seed 1.6).

Features

Video Generation (Seedance)

• Text-to-Video Generation: Create videos from text descriptions
• Image-to-Video Generation: Generate videos using input images as first frames
• First+Last Frame Generation: Create videos between two specific frames
• Reference Images Generation: Generate videos based on multiple reference images
• High-Quality Pro Models: Access to premium Seedance Pro model

Image Generation

• Text-to-Image Generation: Create high-quality images from text prompts using Seedream 3.0
• Image-to-Image Editing: Edit and transform existing images with text descriptions using SeedEdit 3.0
• Frame Extraction: Convert video URLs to individual frames for further processing

Installation

1. Clone this repository into your ComfyUI custom_nodes directory:

cd ComfyUI/custom_nodes/
git clone https://github.com/FloyoAI/ComfyUI-Seed-API.git

2. Install requirements:

cd ComfyUI-Seed-API
pip install -r requirements.txt

3. Configure your BytePlus API key:

   • Get your API key from: https://www.byteplus.com/
   • Edit config.ini and replace <your_byteplus_api_key_here> with your actual API key
   • Or set the environment variable: export BYTEPLUS_API_KEY="your_key_here"

4. Restart ComfyUI

Available Nodes

Video Generation Nodes (Seed/VideoGeneration)

• Seedance Lite Text-to-Video: Generate videos from text prompts only

  • Input: Text prompt, resolution, ratio, duration, FPS, seed, camera settings
  • Output: Video URL (STRING)
  • Use case: Create videos from scratch using descriptive text

• Seedance Lite Image-to-Video: Generate videos from a starting image

  • Input: Text prompt, input image, resolution, ratio, duration, FPS, seed, camera settings
  • Output: Video URL (STRING)
  • Use case: Animate static images or create videos with specific starting frames

• Seedance Lite First+Last Frame: Generate videos between two keyframes

  • Input: Text prompt, first frame image, last frame image, resolution, ratio, duration
  • Output: Video URL (STRING)
  • Use case: Create smooth transitions between two specific images

• Seedance Lite Reference Images: Generate videos using multiple reference images

  • Input: Text prompt, 2-4 reference images, resolution, ratio, duration
  • Output: Video URL (STRING)
  • Use case: Generate videos that maintain style/appearance consistency with reference materials

• Seedance Pro Text/Image-to-Video: High-quality video generation

  • Input: Text prompt, mode selection, optional input image, resolution, ratio, duration
  • Output: Video URL (STRING)
  • Use case: Premium quality video generation for professional use

Image Generation Nodes (Seed/ImageGeneration)

• Seedream Text-to-Image: Generate images from text descriptions

  • Input: Text prompt, size selection, optional seed
  • Output: Generated image (IMAGE)
  • Use case: Create high-quality images from detailed text descriptions

• SeedEdit Image-to-Image: Edit and transform existing images

  • Input: Text prompt, input image, size selection, guidance scale, optional seed
  • Output: Edited image (IMAGE)
  • Use case: Modify existing images based on text instructions (change colors, add/remove objects, style transfer)

Chat & Vision Nodes (Seed/Chat)

• Seed 1.6 Chat: Unified chat node with vision support and session memory
  • Input: Model selection, user message, session ID, optional system message, up to 4 images
  • Output: Response text, full conversation, session status
  • Models: seed-1-6-250615, seed-1-6-flash-250715
  • Features: Session-based conversation memory, multimodal support, external history import
  • Use case: All chat scenarios - text generation, image analysis, complex conversations

Utility Nodes (Seed/Video)

• Video URL to Frames: Extract all frames from a video URL
  • Input: Video URL (STRING)
  • Output: Frame batch (IMAGE), frame count (INT), FPS (FLOAT)
  • Use case: Convert generated videos into individual frames for further image processing

Usage Guide

Video Generation Workflow

1. Choose the appropriate video node based on your input type:

   • Text only → Seedance Lite Text-to-Video
   • Single image → Seedance Lite Image-to-Video
   • Two images → Seedance Lite First+Last Frame
   • Multiple references → Seedance Lite Reference Images
   • High quality → Seedance Pro

2. Configure parameters:

   • Prompt: Describe what you want in the video
   • Resolution: 480p, 720p, or 1080p
   • Ratio: Aspect ratio (16:9, 1:1, 9:16, etc.)
   • Duration: 3-12 seconds

3. Connect the output to other nodes:

   • Use output URL directly with video preview nodes
   • Connect to "Video URL to Frames" to extract individual frames
   • Save video using external video saving nodes

Image Generation Workflow

1. For new images: Use Seedream Text-to-Image

   • Write detailed prompts for best results
   • Experiment with different sizes for various use cases
   • Use seed values for reproducible results

2. For image editing: Use SeedEdit Image-to-Image

   • Load your source image
   • Describe the changes you want in the prompt
   • Adjust guidance scale (higher = more prompt adherence)
   • Size can be "adaptive" to maintain original dimensions

3. Process results:

   • Images output as standard ComfyUI IMAGE tensors
   • Compatible with all ComfyUI image processing nodes
   • Can be saved, edited, or used as input for video generation

Chat & Vision Workflow

1. Session management:

   • Session ID: Use unique identifiers for different conversations (e.g., "project1", "analysis2")
   • Session Memory: Toggle on/off to maintain conversation context across multiple runs
   • Clear Session: Reset conversation memory when starting new topics

2. Model selection:

   • seed-1-6-250615: Balanced performance and quality
   • seed-1-6-flash-250715: Faster responses, optimized for speed

3. Configure thinking and reasoning:

   • Thinking mode: Enable for deeper reasoning (default: enabled)
   • Reasoning effort: Adjust computational intensity (low/medium/high)

4. Use multimodal features:

   • Attach up to 4 images simultaneously
   • Set image detail level (auto/high/low) based on your needs
   • High detail for analysis, low detail for simple recognition

5. Conversation continuity:

   • Built-in memory: Automatically remembers previous messages in the session
   • External history: Import conversations from other sources
   • Full conversation output: Get formatted conversation history for export/review

Requirements

• ComfyUI
• Python 3.8+
• BytePlus API key
• Required packages (see requirements.txt)

Key Features

• No External Dependencies: Base64 image conversion means no external hosting required
• Automatic Task Polling: Video generation waits until completion automatically
• Comprehensive Error Handling: Graceful degradation with detailed error messages
• ComfyUI Integration:
  • Video outputs as URL strings compatible with video preview nodes
  • Image outputs as standard IMAGE tensors compatible with all image nodes
• Flexible Sizing: Support for various aspect ratios and resolutions
• Seed Control: Reproducible results with optional seed parameters

Tips for Best Results

Video Generation

• Be specific in prompts: Include details about movement, camera angles, and style
• Use appropriate ratios: Match your intended use case (16:9 for landscape, 9:16 for mobile, etc.)
• Leverage reference images: For consistent character/style appearance across videos

Image Generation

• Detailed prompts work better: Include style, lighting, composition details
• Use SeedEdit for modifications: Better than text-to-image for specific edits
• Guidance scale tuning: Start with default 5.5, increase for more prompt adherence
• Size selection: Use "adaptive" for SeedEdit to maintain original proportions

Chat & Vision

• Session management: Use descriptive session IDs and enable memory for ongoing conversations
• Model choice: Use seed-1-6-flash-250715 for speed, seed-1-6-250615 for quality
• Image detail settings: High detail for analysis tasks, low for simple recognition
• Thinking mode: Keep enabled for complex reasoning, disable for simple responses
• System prompts: Use for role-playing, context setting, and output formatting
• Memory limits: Sessions automatically trim to last 20 messages to prevent memory bloat

Troubleshooting

• API Key Issues: Ensure your BytePlus API key is correctly set in config.ini or environment variables
• Empty Results: Check ComfyUI console for detailed error messages
• Image Quality: Try different prompts, seeds, or guidance scale values for better results