Commit Graph
142 Commits
Author SHA1 Message Date
Adrien Toupet 12aefc08bb Merge pull request #107 from lihaoyun6/main
Keep weights and arguments on the same device when 'preserve_vram' is ON
Restored compatibility with FP8 safetensors for MPS backend
Added multi-gpu support for ComfyUI nodes
Added FPS calculation
Set use_non_blocking to False by default to prevent memory leaks (temp fix)
Moved some parms from main node to extra args node
2025-08-18 21:27:23 +02:00
lihaoyun6 facbc1a824 Fix FPS calculation 2025-08-19 00:58:02 +08:00
lihaoyun6 e723e176cc Added FPS calculation 2025-08-19 00:23:27 +08:00
lihaoyun6 286a0186de Set use_non_blocking to False by default to prevent memory leaks 2025-08-18 23:18:36 +08:00
lihaoyun6 3ea159d763 Fix incorrect variable names 2025-08-18 22:14:01 +08:00
lihaoyun6 add941dc6e Fix incorrect variable names 2025-08-18 20:53:18 +08:00
lihaoyun6 1cfde3d1c7 Added multi-gpu support for ComfyUI nodes 2025-08-15 21:06:16 +08:00
lihaoyun6 176562f829 Restored compatibility with FP8 safetensors for MPS backend; Changed the way to detect MPS device 2025-08-13 00:53:05 +08:00
lihaoyun6 8ae90c3af2 Keep weights and arguments on the same device when 'preserve_vram' is ON 2025-08-12 23:12:12 +08:00
Adrien Toupet 4eef2ca85c Merge pull request #103 from lihaoyun6/main
Added MPS backend support (for running on macOS)
2025-08-12 16:44:24 +02:00
lihaoyun6 3db50c3849 update .gitignore 2025-08-12 22:32:36 +08:00
lihaoyun6 e328545582 Delete .DS_Store file 2025-08-12 22:31:40 +08:00
lihaoyun6 3b0699ead9 Merge remote-tracking branch 'upstream/nightly' 2025-08-12 22:28:36 +08:00
Adrien Toupet 6412f03484 Merge pull request #92 & #106
**Architecture & Performance:**
- Unified debug system with categorized logging and memory tracking
- FP8 models now stay in FP8, convert to BF16 only for math operations (faster, less memory)
- Fixed memory leaks
- Removed ComfyUI dependency for standalone compatibility
- Better VRAM management between batches

**New Features:**
- VAE tiling for larger/longer video upscaling
- Multi-repo model support (numz/ and AInVFX/)
- Model auto-discovery in ComfyUI folder
- CLI: BlockSwap options, temporal overlap blending, prepend_frames for better first frames
- `enable_debug` and `cache_model` moved to main node

**Code Organization:**
- New modular structure: `constants.py`, `model_registry.py`, `debug.py`
- Removed legacy code and dead files
- Added mixed FP8 models to fix 7B artifacts
2025-08-12 14:59:37 +02:00
Adrien Toupet 58fbd215c3 Merge pull request #85 from AInVFX/requirements
Lower min diffusers version, added min version for rotary_embedding_torch & removed comments for compatibility.
Resolves https://github.com/numz/ComfyUI-SeedVR2_VideoUpscaler/issues/79 and https://github.com/numz/ComfyUI-SeedVR2_VideoUpscaler/issues/89
2025-08-12 14:41:50 +02:00
Adrien Toupet 0029dd6283 Added nightly disclaimer 2025-08-12 08:26:25 -04:00
not-ski 54cd9083ea Added tiled VAE options to Comfy node 2025-08-12 03:44:02 +02:00
Benjamin Herb 3b8c8c96a3 fix: VAE tiling memory fixes
- use a 2D tensor for count (for norm) without unnecessary additional dimensions
- apply the mask separable to avoid creating a bigger tensor
2025-08-11 20:22:25 +02:00
Benjamin Herb cd2671bbe1 fix: fixed tiling issue and added smoother blending
- Fixed issue that would lead to a white border around the image due to
  improper tile blending
- Added smoother blending (hann ramp) for the tiles and temporal
  overlaps
2025-08-10 23:54:17 +02:00
Benjamin Herb 3eedf74ad6 fix: resolve slicing_encode memory leak and VRAM usage of final video concatenation
- Fix memory leak in slicing_decode by cleaning memory of InflatedCausalConv3d
- Prevent OOM errors during final video concatenation by keeping the tensors on CPU
2025-08-10 21:28:34 +02:00
Benjamin Herb 126ebfc10e feat: add separate height/width control to vae tile size and overlap
- use h/w tuples to specify tiling size and overlap to allow for finer
    control
  - added OneOrTwoValues class to handle CLI input of single values or h/w
    pairs
2025-08-10 21:27:54 +02:00
Benjamin Herb afafa67dd8 fix: VAE tiling cleanup and fixes
- Fix issues with unnecessary VAE blocks at the boundarys
- Updated VAE encode/decode logic to more closely match the original flow
- Better skip_frame log info
2025-08-09 19:23:25 +02:00
Benjamin Herb 7737efd22a feat: Add temporal overlap with blending and prepend frame options to CLI
- Add temporal overlap with crossfading (works with multi GPU)
- Add option to prepend frames to avoid artifacts at the start
2025-08-09 04:12:37 +02:00
Benjamin Herb ad62a12a3e feat: Add VAE tiling support
- Add VAE encode/decode tiling based on @Luke2642 approach
- Fix issues when tiling sequences
- Add CLI arguments for VAE tiling configuration
2025-08-09 02:30:28 +02:00
Benjamin Herb fe67b2a042 feat: Add BlockSwap support for standalone CLI and update logging
- Add BlockSwap CLI arguments and activation
- Fix imports to work without ComfyUI dependencies
- Update to new debugging framework
2025-08-09 02:27:42 +02:00
Adrien Toupet 4716d1820e Removed ComfyUI dependency + improved VRAM clearing between batch 2025-08-08 00:53:48 +02:00
Adrien Toupet 28d3d5db2a Update Readme Updates section 2025-08-08 00:53:19 +02:00
Adrien Toupet 6d8c278a4e Fix QC bugs post updates 2025-08-08 00:53:19 +02:00
Adrien Toupet 1da2cdaf12 Fix VRAM memory leak when using cache_model, added log_memory_state detailed_tensors debug output for troubleshooting 2025-08-08 00:51:02 +02:00
Adrien Toupet d075dde799 feat: Extract model caching to main node + add hierarchical debug system
- Move cache_model and enable_debug options from BlockSwap to main SeedVR2 node

- cache_model: Keep models in RAM between runs (skip reload for faster iterations)

- enable_debug: Show detailed memory/timing tracking with hierarchical display

- Replace hardcoded debug statements with unified Debug class

- Add visual icons for log categorization

- Implement parent-child timing relationships for operation breakdown

- Add VRAM/RAM usage tracking with before/after comparisons

Model caching now available for all workflows, not just BlockSwap users.

Debug system provides granular performance insights when enabled.
2025-08-08 00:49:46 +02:00
Adrien Toupet 4118595968 Revert to 5c65c44 and fix integration issues
- Resolved merge conflicts

- Added missing constants.py and model_registry.py files

- Added graceful error handling for failed model downloads
2025-08-08 00:49:46 +02:00
Adrien Toupet fc252417bd Updating minversion rotary_embedding_torch to fix issues/89 2025-08-07 09:48:19 -04:00
lihaoyun6 7534ab5b87 Fixed dtype mangling on MPS backend 2025-08-07 12:19:39 +08:00
lihaoyun6 3ae18bc845 Fixed BlockSwap on MPS backend 2025-08-06 23:54:57 +08:00
lihaoyun6 3b530dc983 Added MPS backend support (for running on macOS) 2025-08-06 18:52:33 +08:00
NumZ 4df5cef593 Update blockswap.py 2025-07-29 19:49:37 +02:00
NumZ 3c5ff9d415 Update blockswap.py fix commandline 2025-07-29 18:22:32 +02:00
NumZ 9a129bfacf Update memory_manager.py for stand alone 2025-07-29 17:19:38 +02:00
Adrien Toupet ee55981bf6 Lower min diffusers version & removed comments for compatibility 2025-07-24 22:24:05 -04:00
Adrien Toupet c3f771286a Merge pull request #82 from numz/revert-81-models
Revert "Models update - FP8, GGUF, Artifacts" - was merged by error
2025-07-24 12:55:34 -04:00
Adrien Toupet 7b63eeea4c Revert "Models update - FP8, GGUF, Artifacts" 2025-07-24 12:53:46 -04:00
Adrien Toupet 413aa84a47 Merge branch 'models' into main 2025-07-24 12:52:19 -04:00
Adrien Toupet cdff055675 Reverting files to fix merge conflict 2025-07-24 12:46:20 -04:00
NumZ be6af5536c Update requirements.txt 2025-07-24 18:37:22 +02:00
Adrien Toupet 5c65c446e6 refactor: centralize model registry and improve dynamic model discovery
- Add model registry with metadata for all SeedVR2 models in different HF repos

- Support dynamic discovery of .safetensors and .gguf files

- Centralize constants and remove duplicate model lists

- Simplify download logic with clear manual fallback instructions
2025-07-24 11:54:43 -04:00
Adrien Toupet bc8f0aa6d0 Optimized RoPE stability fix and Patch RoPE for blockswap 2025-07-24 09:32:18 -04:00
Adrien Toupet b551e32ae1 Fixed scoping in _stabilize_rope_computations 2025-07-24 01:05:49 -04:00
Adrien Toupet 99938bf175 Apply RoPE stability fix universally to prevent artifacts in all precision modes 2025-07-23 22:01:55 -04:00
Adrien Toupet 09a9bf081d Fix artifacts when using mixed precision model without blockswap 2025-07-23 21:09:27 -04:00
Adrien Toupet bc292f26bd Fix artifacts when using mixed precision model without blockswap 2025-07-23 20:56:02 -04:00