Commit Graph
15 Commits
Author SHA1 Message Date
Adrien Toupet 5595d58597 refactor: streamline generation pipeline and improve dtype handling
- Merge generation setup log steps: combine "Model Configuration" and "Input Preparation" into unified "Generation Setup" step
- Simplify dtype handling: remove redundant vae_dtype variable, VAE now uses configured dtype consistently
- Remove platform-specific VAE dtype logic (MPS special case)
- Unify VAE encode/decode: remove autocast wrapper and target_dtype parameter, both now use configured dtype
- Add consistent docstrings for vae_encode and vae_decode methods
- Improve precision logging: show both DiT and VAE dtypes, rename model_dtype to dit_dtype
- Optimize text embeddings movement: only move when preserve_vram is active (BlockSwap handles model layers separately)
- Load text embeddings directly to CPU when preserve_vram is enabled
- Update logging consistency: uppercase device names, unified category names, clearer messages
- Clarify FP8 RoPE conversion log message: specify "from FP8 to BFloat16"
2025-08-25 17:11:29 -04:00
Adrien Toupet 2053a80f38 refactor(WIP): Improve debug logging consistency and reduce redundancy
- Remove "Force move weights to device" in FP8CompatibleDiT forward() to avoid clash with blockswap - This was used for preserve_vram but will refactor preserve_vram in a separate commit
- Remove duplicate dtype detection in generation_step (now passed from generation_loop)
- Add device checks before CPU moves to avoid redundant operations
- Improve debug.log and debug.log_memory_state()  formatting, content, and categories for better visibility
- Remove unused imports and excessive clear_memory() calls
- Clean up non-essential logs from always display
2025-08-22 15:38:00 -04:00
Benjamin Herb 22aa85abb7 fix: Updates --prepend_frames logic 2025-08-21 08:12:07 +02:00
lihaoyun6 3b0699ead9 Merge remote-tracking branch 'upstream/nightly' 2025-08-12 22:28:36 +08:00
Benjamin Herb cd2671bbe1 fix: fixed tiling issue and added smoother blending
- Fixed issue that would lead to a white border around the image due to
  improper tile blending
- Added smoother blending (hann ramp) for the tiles and temporal
  overlaps
2025-08-10 23:54:17 +02:00
Benjamin Herb 126ebfc10e feat: add separate height/width control to vae tile size and overlap
- use h/w tuples to specify tiling size and overlap to allow for finer
    control
  - added OneOrTwoValues class to handle CLI input of single values or h/w
    pairs
2025-08-10 21:27:54 +02:00
Benjamin Herb afafa67dd8 fix: VAE tiling cleanup and fixes
- Fix issues with unnecessary VAE blocks at the boundarys
- Updated VAE encode/decode logic to more closely match the original flow
- Better skip_frame log info
2025-08-09 19:23:25 +02:00
Benjamin Herb 7737efd22a feat: Add temporal overlap with blending and prepend frame options to CLI
- Add temporal overlap with crossfading (works with multi GPU)
- Add option to prepend frames to avoid artifacts at the start
2025-08-09 04:12:37 +02:00
Benjamin Herb ad62a12a3e feat: Add VAE tiling support
- Add VAE encode/decode tiling based on @Luke2642 approach
- Fix issues when tiling sequences
- Add CLI arguments for VAE tiling configuration
2025-08-09 02:30:28 +02:00
Benjamin Herb fe67b2a042 feat: Add BlockSwap support for standalone CLI and update logging
- Add BlockSwap CLI arguments and activation
- Fix imports to work without ComfyUI dependencies
- Update to new debugging framework
2025-08-09 02:27:42 +02:00
lihaoyun6 3b530dc983 Added MPS backend support (for running on macOS) 2025-08-06 18:52:33 +08:00
luchuanzhao 59850f6e40 Fix multi GPUs OOM 2025-07-11 11:29:13 +08:00
NumZ f3c704a502 Fix linux 2025-07-03 14:41:49 +02:00
NumZ ee70d2a72c Add MultiGPU Standalone inference 2025-07-03 04:48:34 +02:00
NumZ 5c27397a40 Add MultiGPU Standalone inference 2025-07-03 04:22:28 +02:00