- Fixes a TypeError in the advanced generator by removing the 'compiled_model' kwarg before the function call.
- Adds automatic model downloading to the HunyuanVideoFoleyModelLoader, ensuring the advanced workflow can self-initialize. This resolves issue #22.
This commit addresses several critical issues to improve stability, user experience, and memory management.
- Implements a robust automatic model downloader to prevent errors on first-time use.
- Adds an adaptive compatibility layer for the 'transformers' library, resolving the 'get_image_features' AttributeError without forcing dependency versions.
- Overhauls memory management with proactive VRAM cleanup and a 'ping-pong' offloading strategy to drastically reduce peak VRAM usage and prevent leaks between runs.
- Fixes a data type error during video creation from image tensors.
- Resolves multiple TypeErrors related to incorrect function arguments.
- Corrects a state management bug that caused failures on sequential runs in advanced workflows.
- Fix AttributeDict handling in TorchCompile node to prevent .copy() errors
- Fix duplicate model loading in GeneratorAdvanced causing memory allocation failures
- Update model loader to properly handle preloaded models from pipeline
- Fix DAC VAE compilation (was looking for 'vae' key instead of 'dac_model')
- Make model_path and config_path optional parameters with proper defaults
- Add better error handling and validation throughout the pipeline
- Prevent unnecessary model reloading when using pre-compiled models
The advanced pipeline now works correctly:
ModelLoader → DependenciesLoader → TorchCompile → GeneratorAdvanced
Co-Authored-By: if@impactframes <if@impactframes.ai>
- Add HunyuanVideoFoleyModelLoader with FP8 weight-only quantization (fp8_e4m3fn, fp8_e5m2)
- Add HunyuanVideoFoleyDependenciesLoader for modular component loading
- Add HunyuanVideoFoleyTorchCompile for ~30% inference speedup
- Add HunyuanVideoFoleyGeneratorAdvanced that accepts pre-loaded models
- Keep original HunyuanVideoFoley node fully functional for backward compatibility
- Fix model path to use ComfyUI's foley/hunyuanvideo-foley-xxl directory structure
- Support both standalone and pipeline-based workflows
Co-Authored-By: if@impactframes <if@impactframes.ai>
- Fix map_location conflict in DAC model loading with fallback manual loading
- Revert _extract_frames_from_image_input() to original PR #3 simple approach
- Fix indentation errors in exception handling blocks
- Resolve black screen issues with VHS node frame input processing