nodes/city96-ComfyUI-GGUF
1
0
Fork 0
Code Issues Pull Requests Packages Projects Releases Wiki Activity
186 Commits 4 Branches 0 Tags
ca582bcb6d1ec29986a180a901f2ebfa260ddde2
Commit Graph
186 Commits
This Branch
This Branch
All Branches
Author SHA1 Message Date
City ca582bcb6d Merge branch 'main' into stable 2025-11-03 15:58:26 +01:00
rattus 100c06cda8 nodes: mmap detach weights before they are pinned (#355) 
Comfy core recently introduced a feature where weights may be pinned
when loading, particularly for the case of offloading.

Intercept this, and immediately detached each weight before the pinning.
This avoids a crash that at least some users are experiencing.

Use a little dict on the modules to keep track of whats already done,
and when the catch-all detacher loop comes through, use this dict
(which has already done modules removed) as the iterator basis.
 2025-11-03 15:57:29 +01:00
blepping be2a08330d Fix dequant_dtype handling (#334) 
* Fix dequant_dtype handling

* Simplify dequant dtype selection expression
 2025-09-14 23:10:50 +02:00
blepping 6b778afdc9 Fix attempt to create a tensor with dtype "target" (#330) 
* Fix attempt to create a tensor with dtype "target"

* Check if dequant_dtype is None before string comparison with target
 2025-09-09 07:07:45 +02:00
City 10606d77d0 Update pyproject.toml 2025-08-20 01:36:07 +02:00
City 5a8de41066 Merge branch 'main' into stable 2025-08-20 01:35:39 +02:00
City d247022e3f Better mmproj detection logic 
#317
 2025-08-20 00:51:28 +02:00
City 0ca2aeb797 Qwen2-VL vision support 
#317
 2025-08-19 17:50:55 +02:00
City df44c9d8dc Update pyproject.toml 2025-08-05 15:36:53 +02:00
City bdb8f62fde Merge branch 'main' into stable 2025-08-05 15:36:32 +02:00
City cf0573351a Qwen2-VL text model support 2025-08-05 15:34:19 +02:00
City ad34e98355 Update pyproject.toml 2025-08-05 14:31:01 +02:00
City bf846d54a8 Merge branch 'main' into stable 2025-08-05 14:30:37 +02:00
City 79ba1d4b17 Qwen image arch string 2025-08-05 12:44:57 +02:00
sfinktah f1377afd9b Updated quantizing tool guide to compile with Visual Studio 2022 (#288) 2025-08-05 12:44:09 +02:00
spawner b1350f6f5a Merge pull request #304 from spawner1145/main 
support lumina-image-2.0
 2025-08-05 12:42:40 +02:00
City c51a948233 Update pyproject.toml 2025-06-15 01:02:28 +02:00
City 7be358d3b5 Merge branch 'main' into stable 2025-06-15 01:01:52 +02:00
City b3ec875a68 Cosmos convert logic 2025-06-15 00:09:45 +02:00
City 4a6c6513bb Update pyproject.toml 
match existing node on registry
 2025-05-09 05:37:16 +02:00
City 1126c12cb9 Update pyproject.toml 
Test version bump
 2025-05-09 01:22:04 +02:00
City c6437f7211 ComfyUI Registry publish workflow 2025-05-09 01:20:44 +02:00
City ee3de95597 Set initial version for registry 2025-05-09 01:15:34 +02:00
City a2b75978fd Create pyproject.toml 2025-05-09 01:08:35 +02:00
City 6570efec69 Better warning for incompatible models 
#256
 2025-05-07 05:13:08 +02:00
City 03842fab0a Remove old workaround 2025-05-07 04:42:20 +02:00
City 3d673c5c09 Wan FLF2V convert logic 
Forgot to commit this, also fixes print -> logging
 2025-04-26 21:16:43 +02:00
City 54a4854e0c Allow embedding shape mismatch 
#269
 2025-04-22 15:50:05 +02:00
City 66c50234a4 Merge pull request #266 from city96/llama_oom_hotfix 
- Apply umt5 hotfix of the token embed runtime cost being too large to llama as well
- Force model size to be re-calculated after the initial patcher is loaded to avoid issue with empty linear layers not being counted
 2025-04-21 23:30:02 +02:00
City 220f78ec70 Force recalculation of model size on clone 2025-04-21 15:22:11 +02:00
City 9d282bcdfd LLaMA OOM hotfix 2025-04-21 04:25:30 +02:00
City a355f8b5ea Skip unlink logic if load/offload dev match 
i.e. when forcing it to run on CPU or highvram enabled
 2025-04-18 23:53:12 +02:00
City 3564e95b26 Dynamic CLIP input types (#263) 2025-04-18 23:48:53 +02:00
City e29f526c68 Disable mixing scaled FP8 + GGUF 2025-04-16 16:07:51 +02:00
City 47bec61475 HiDream text encoder support 
LLaMA GGUF logic already works due to being used for HunYuan
 2025-04-16 06:10:28 +02:00
City 3605bfbead Keep ffn down for HiDream 2025-04-16 02:22:31 +02:00
City 2ef5a66a9f HiDream support 
#248
 2025-04-16 01:43:15 +02:00
City 794fc28536 Clean up logging 
Also fixes numpy warning
 2025-04-13 23:01:15 +02:00
City 6de4bdba30 Merge pull request #216 from city96/convert_refactor_new 
convert.py/patch refactor
 2025-04-10 08:11:58 +02:00
City ca97e050b3 Update README.md 2025-04-10 08:04:17 +02:00
City de33c984c1 Merge branch 'main' into convert_refactor_new 2025-04-10 07:12:14 +02:00
City 624687939f Refactor 5D patch and save loop 2025-04-10 07:12:10 +02:00
Xiangxi Guo (Ryan) 0c3bdf336e Enable more torch.compile optimization by reducing graph breaks (#243) 
As title, there were 2 fundamental sources of graph breaks:
1. using a pre-existing set in a `torch.compile` region, this is a
   [known issue](https://github.com/pytorch/pytorch/issues/145761) in
   PyTorch and the fix is WIP, but it's a lot easier to change the set
   into a tuple here to fix the graph break.
2. using tensor subclass `GGMLTensor`. The full support of tensor
   subclass has been gated for `torch.compile`, but with [a recent WIP
   stack](https://github.com/pytorch/pytorch/pull/149792),
   we'll be able to remove the gating and have `torch.compile` fully
   support the `GGMLTensor` in this repo. The only required change here
   is avoid changing the `__class__` attribute, and instead using
   `torch.Tensor` to convert the subclass object back to Tensor.
 2025-04-10 02:46:33 +02:00
City 862e4147c4 Make 5D tensor fix less fragile 2025-04-03 00:38:46 +02:00
City c36b7236e6 Update README.md 2025-03-30 18:46:09 +02:00
City f3b968e137 Merge branch 'main' into convert_refactor_new 2025-03-30 18:43:44 +02:00
City bbd89ae547 Update .gitignore 2025-03-30 18:42:17 +02:00
City 65a2bc20bb wan bf16 fix 2025-03-28 04:21:26 +01:00
City 1c873edeb6 Expose strip prefix as function 
For external convert/detection logic
 2025-03-22 20:40:24 +01:00
City bc5223b0e3 Fix qtype logging on newer gguf-py 2025-03-16 20:14:33 +01:00