APZmedia-Comfyui-LightDirection-estimation/docs/Enhanced-Light-Estimation-Workflow-Guide.md

Enhanced Light Estimation Workflow Guide

Overview

This guide explains the new Enhanced Light Estimation Workflow that combines traditional normal map analysis with advanced IRE shadow analysis for comprehensive lighting assessment.

Workflow Structure

The enhanced workflow (TEST-Enhanced-Light-Estimation-v3.json) provides:

🔄 Dual Analysis Approach

1. Enhanced Light Estimator: Combined normal map + IRE analysis
2. Standalone IRE Shadow Analyzer: Pure IRE shadow analysis for comparison

📊 Comprehensive Outputs

• Traditional light direction analysis
• IRE-based shadow characterization
• False color visualizations
• Shadow transition analysis
• Combined confidence scoring

Workflow Components

1. Input Processing Section

LoadImage → ImageResizeKJv2 → RMBG → LBM_DepthNormal + rgb2x

Purpose: Prepare input images and generate required data

• LoadImage: Load source image
• ImageResizeKJv2: Resize to standard dimensions (1280x1280)
• RMBG: Background removal for clean analysis
• LBM_DepthNormal: Generate normal map from depth
• rgb2x: Convert to irradiance for luma analysis

2. Enhanced Light Estimator (Combined Analysis)

EnhancedLightEstimator Node

Inputs:

• normal_map: From LBM_DepthNormal
• luma_image: From ImageResizeKJv2
• exclusion_mask: From RMBG

Key Parameters:

• luma_threshold: 0.5 (standard)
• curve_type: "s_curve" (enhanced mid-tones)
• shadow_ire_threshold: 20.0 (IRE units)
• transition_sensitivity: 0.1 (balanced)
• analysis_method: "combined" (both normal + IRE)
• ire_analysis_weight: 0.5 (equal weighting)

Outputs:

• Direction Analysis: X/Y direction, combined direction
• Quality Analysis: Hard/soft index, confidence scores
• IRE Analysis: Shadow character, transition quality
• Visualizations: Debug masks, false color, threshold previews
• Combined Results: Final shadow character, light quality

3. Standalone IRE Shadow Analyzer

IREShadowAnalyzer Node

Purpose: Pure IRE-based shadow analysis for comparison

Parameters:

• shadow_ire_threshold: 20.0 IRE
• transition_sensitivity: 0.1
• analysis_mode: "full"

Outputs:

• False color IRE visualization
• Shadow masks (soft/hard)
• IRE legend
• Shadow characterizations
• Quantitative metrics

4. Results & Visualizations Section

Text Outputs

• X/Y Direction results
• Combined direction
• Hard/Soft index
• Shadow character (IRE-based)
• Transition quality
• Final combined results

Image Outputs

• Debug mask (lit areas)
• Lit normals visualization
• Cluster delta chart
• Threshold previews (X/Y)
• False color IRE visualization
• Shadow masks (soft/hard)
• IRE legend

Key Features

🎯 Enhanced Analysis Capabilities

1. Combined Normal Map + IRE Analysis

• Geometric Analysis: Surface normal distribution
• Luminance Analysis: IRE-based shadow transitions
• Weighted Combination: User-controllable weighting
• Consistency Checking: Validates agreement between methods

2. IRE Shadow Analysis

• False Color Visualization: 7-zone IRE color mapping
• Transition Analysis: Gradient-based soft/hard detection
• Quantitative Metrics: Ratios, percentages, confidence scores
• Professional Standards: Broadcast/video industry IRE standards

3. Advanced Visualizations

• Debug Masks: Show which areas are analyzed
• Threshold Previews: Visualize classification zones
• False Color IRE: Professional exposure analysis
• Shadow Masks: Separate soft/hard shadow areas
• IRE Legend: Color mapping reference

📈 Analysis Parameters

Enhanced Light Estimator Parameters

{
  "luma_threshold": 0.5,           // Luma masking threshold
  "curve_type": "s_curve",         // Luma processing curve
  "x_threshold": 0.4,              // X direction sensitivity
  "y_threshold_upper": 0.1,       // Y direction (upper)
  "y_threshold_lower": 0.1,       // Y direction (lower)
  "central_threshold": 0.3,       // Central lighting detection
  "hard_light_threshold": 0.15,   // Hard light detection
  "soft_light_threshold": 0.35,   // Soft light detection
  "shadow_ire_threshold": 20.0,   // IRE shadow threshold
  "transition_sensitivity": 0.1,   // IRE transition sensitivity
  "analysis_method": "combined",   // Analysis mode
  "ire_analysis_weight": 0.5      // IRE analysis weighting
}

IRE Shadow Analyzer Parameters

{
  "shadow_ire_threshold": 20.0,   // IRE threshold for shadows
  "transition_sensitivity": 0.1,   // Transition detection sensitivity
  "analysis_mode": "full"         // Analysis scope
}

Usage Instructions

Step 1: Load and Prepare Image

1. Use LoadImage to load your source image
2. ImageResizeKJv2 resizes to 1280x1280 for consistent analysis
3. RMBG removes background for clean analysis

Step 2: Generate Analysis Data

1. LBM_DepthNormal creates normal map from depth information
2. rgb2x converts to irradiance for luma analysis

Step 3: Run Enhanced Analysis

1. Enhanced Light Estimator provides combined analysis
2. IRE Shadow Analyzer provides standalone IRE analysis
3. Compare results for validation

Step 4: Interpret Results

Direction Analysis

• X Direction: Left/Center/Right lighting
• Y Direction: Above/Center/Below lighting
• Combined: Full directional classification

Quality Analysis

• Hard/Soft Index: 0.0 (hard) to 1.0 (soft)
• Confidence Scores: Analysis reliability
• Spread Value: Normal distribution spread

IRE Shadow Analysis

• Shadow Character: Very Soft/Soft/Medium/Hard
• Transition Quality: Very Gradual to Very Sharp
• IRE Range: Actual IRE values in image
• Shadow Coverage: Percentage of shadow areas

Combined Results

• Final Shadow Character: Weighted combination
• Final Light Quality: Integrated assessment
• Combined Confidence: Overall reliability
• Analysis Consistency: Agreement between methods

Advanced Usage

Parameter Tuning

For Soft Shadow Detection

{
  "shadow_ire_threshold": 15.0,    // Lower threshold
  "transition_sensitivity": 0.05,  // More sensitive
  "ire_analysis_weight": 0.7       // Favor IRE analysis
}

For Hard Shadow Detection

{
  "shadow_ire_threshold": 25.0,    // Higher threshold
  "transition_sensitivity": 0.2,  // Less sensitive
  "ire_analysis_weight": 0.3       // Favor normal analysis
}

For Balanced Analysis

{
  "shadow_ire_threshold": 20.0,    // Standard threshold
  "transition_sensitivity": 0.1,    // Balanced sensitivity
  "ire_analysis_weight": 0.5       // Equal weighting
}

Workflow Customization

Add IRE Shadow Comparison

• Use IREShadowComparison node to compare two images
• Analyze shadow differences between lighting setups
• Validate lighting changes

Modular Analysis

• Use individual nodes for specific analysis
• LightImageProcessor for image preparation
• LightDistributionAnalyzer for distribution analysis
• IREShadowAnalyzer for pure IRE analysis

Troubleshooting

Common Issues

"No shadows detected"

• Lower shadow_ire_threshold (try 15.0)
• Check image contrast and exposure
• Verify IRE range in image

"Incorrect shadow classification"

• Adjust transition_sensitivity (0.05-0.3)
• Check ire_analysis_weight balance
• Verify normal map quality

"Poor analysis consistency"

• Check image quality and lighting
• Adjust parameter sensitivity
• Use higher resolution images

Performance Optimization

• Use appropriate image resolution (512x512 to 1024x1024)
• Process images in batches for efficiency
• Monitor GPU memory usage for large images
• Use exclusion masks to focus analysis areas

Professional Applications

Cinematography

• Lighting setup validation
• Shadow quality assessment
• Exposure analysis using IRE standards
• Professional workflow integration

Photography

• Portrait lighting analysis
• Shadow correction workflows
• Exposure zone analysis
• Professional retouching

Computer Graphics

• Lighting validation for 3D renders
• Shadow quality assessment
• Professional lighting workflows
• Industry-standard analysis

This enhanced workflow provides comprehensive lighting analysis suitable for professional applications while maintaining ease of use for general purposes.