5 Commits
Author SHA1 Message Date
ThereforeGames afc8d7ff01 Add MOSS support, native W6A8 and W4A8 mixed modes
Add W6A8 checkpoint loading, conversion, inference, LoRA requantization, compile compatibility, and export, plus architecture-aware w4a8_mixed selection. Add MOSS-Image detection and quantization presets, update documentation, tests, and version to 2.4.0.
2026-10-28 02:22:45 -04:00
ThereforeGames 1282af30d8 Require ComfyUI 0.32.0; use CastBiasWeightContext
Bump package and docs to version 2.2.2 and raise the minimum ComfyUI requirement to 0.32.0. Replace manual cast/uncast calls with comfy.ops.CastBiasWeightContext so weight/bias cleanup runs even when execution raises. Update runtime error messages and imports accordingly. Add a unit test ensuring the cast cleanup runs on exception. Update CHANGELOG and README to reflect the changes.
2026-08-13 20:46:55 -04:00
ThereforeGames 3137889b50 Add experimental W4A8 (asym_w4a8_int8) support
Introduce experimental asymmetric 4-bit W4A8 format (asym_w4a8_int8) across the toolkit: native quantization, state-dict round-trip, LoRA handling, save/load, lazy-compile handling, and runtime dispatch. Add a temporary torch.compile compatibility shim (w4a8_compile_compat.py) that provides a toolkit custom-op / FakeTensor boundary while upstream compiler-safe operator support is missing. Update int8_quant, model adapter, LoRA patching, lazy compile, model save, loaders, and tests; add docs/benchmarks.md, README/CHANGELOG updates, and unit tests for W4A8 compile compat. Bump package version to 2.2.0. Requires ComfyUI 0.31.0 / compatible comfy-kitchen; marked experimental.
2026-08-08 13:18:09 -04:00
ThereforeGames dc1c2cc498 Add MiniMax H3 support and ConvRot validation
Introduce MODEL_TYPE_MINIMAX_H3, keep-float/int4-sensitive presets, and automatic adapter detection; bump package version to 2.1.0 and update changelog. Add robust ConvRot group-size validation (_validate_convrot_group_size), stricter Hadamard shape checks, and improved error handling when loading/saving native INT8 ConvRot metadata. Add unit tests covering ConvRot metadata round-trips, invalid metadata rejection, save-time consistency checks, and MiniMax H3 detection.
2026-08-07 06:51:09 -04:00
ThereforeGames 722dadcbc5 Rebrand, add INT4 support & quantization modes
Rebrand the project as "ComfyUI Quantization Toolkit" and introduce native INT4 (ConvRot W4A4) support, mixed INT4/INT8 modes, and expanded quantization policies. Add an INT4 torch.compile compatibility shim, INT4-aware lazy-compile changes, richer LoRA stack nodes with autogrow, and a Quantized LoRA entry/apply pair. Replace ad-hoc prints with structured logging, bump package metadata to 2.0.0, and add documentation (advanced usage, checkpoints, policies) plus many unit tests for compile, lazy-compile, LoRA, adapter caching, saving, and modes. Misc: kernel config, model save/load, and numerous runtime/adapter refactors and robustness fixes.
2026-08-04 07:11:56 -04:00