ThereforeGames
af86f99fa6
Add a new INT8 Lazy Torch Compile node and register it in the package; update README to document lazy compile, runtime backends, LoRA order, and usage guidance. Improve Triton fused kernels with safer tail handling, optional legacy-unsafe mode, support for prepacked weight layouts, and contiguous input handling; expose HAS_MN_TAIL / LEGACY_UNSAFE kernel flags and adjust launch parameters. Add runtime/backend controls to the INT8 model adapter (runtime_backend, small_batch_fallback, prepack_int8_weights), persist prepacked weight buffer on quantized modules, print/reset runtime stats, and wire those options through adapter state and UI defaults. Add stable dynamic LoRA UUIDs for runtime tracking. Misc: update __init__ mappings, example workflow asset, and various CLI/README clarifications to reflect new defaults and features.
