nodes/city96-ComfyUI-GGUF
1
0
Fork 0
Code Issues Pull Requests Packages Projects Releases Wiki Activity
97 Commits 4 Branches 0 Tags
98333480059a2ccafb4718924ebcb9cdcb9b1f43
Commit Graph
47 Commits
Author SHA1 Message Date
City 9833348005 Fix for text encoder folder name change 
#151
 2024-11-03 14:03:42 +01:00
City 0ef158d793 Add SD3 to loader arch list 2024-10-22 22:00:37 +02:00
City d090a910ac Rewrite convert.py to work properly with dev de-distill 
Original logic was triggering SDXL specific code to reshape img_in weight, causing forge not to work with it.
Tagging @blepping since this might change how the SDXL code is evaluated, but based on a quick check it should work.
 2024-10-15 03:56:54 +02:00
City d2aaeb0f13 Always init tenc on offload device 
#83
needs updated ComfyUI as well to fix it, issue was with the direct load logic in model management putting the model on the GPU before the weights were loaded, at which point the loading would overwrite the weights with the CPU ones
 2024-09-17 15:26:39 +02:00
City 0342f0a183 never double patch 
#98
Instead of adding/removing patches, sync with `self.patches[key]` - old patch should be GC'd. Most likely no legitimate reasons for double patching. Can simplify logic in ops.py if no issues.
 2024-09-06 18:10:02 +02:00
City b46c206dd7 double patch issue fix for lowvram 
Potential fix, lowvram weights are called via `patch_weight_to_device` on each run and it was possible to apply the same patch multiple times on subsequent generations.
 2024-09-05 05:32:01 +02:00
City 717a0e1d0b Temporarily disable instant patch logic 
Seems to break VRAM estimation and needs more involved fix with upstream ComfyUI repo.
 2024-09-03 17:00:20 +02:00
City c8923a4cd7 mmap unload fix for lowvram 2024-09-03 16:37:35 +02:00
City 6dbb4ba989 Temp fix for disable smart memory 
Model management seems to expect `unpatch_model` to put model on specified device after unpatching. Needs different way to avoid patch reload.
 2024-09-03 05:28:49 +02:00
City 35007f2659 Refactor model loading 
Should make it more readable. Moved import under if to avoid changes to stuff in `tools` breaking normal models.
 2024-09-02 03:44:07 +02:00
City df3378da6b Detect quant 2024-09-02 03:17:16 +02:00
blepping fa1671d63e Sync with upstream 2024-09-01 18:44:31 -06:00
City ba8ce44b4c Rename move_patch function 2024-09-02 02:22:32 +02:00
City c7b902bf9a Patch load/unload fix 
May break other things. For some reason T5 decided to run on the CPU with this change, but only like once and I can't for the life of me reproduce it.
 2024-09-02 02:00:10 +02:00
City 43427eff52 Better patch clear logic 
Reduces RAM overhead
 2024-09-02 01:37:16 +02:00
blepping 3bad1b4e04 Fix loading GGUF t5xxl 
Can't use squeeze proj workaround for stable-diffusion.cpp SD15
 2024-09-01 06:46:50 -06:00
blepping 436ecb4913 Merge upstream ops_refactor 2024-09-01 03:02:59 -06:00
blepping ed0702fefc Merge branch 'city96:main' into feat_load_stable_diffusion.cpp 2024-09-01 02:47:16 -06:00
City 6618801f1c Don't dequantize token embed on load 2024-08-30 06:25:19 +02:00
blepping b88cb9a344 Remove require_prefix in gguf_sd_loader 2024-08-28 12:50:39 -06:00
blepping e814fc1264 Revert ggml_tensor_name addition 2024-08-28 12:34:08 -06:00
City abe5c6a6c9 Fix weights not being copied for lowvram patch 
This can probably be improved since the weights themselves never need to be copied as they cannot be changed anyway.
 2024-08-28 20:23:08 +02:00
blepping f7d8fbe740 Workaround for stable-diffusion.cpp SDXL GGUF files 2024-08-28 11:56:51 -06:00
blepping 6ae0c733b0 Support loading u-net from stable-diffusion.cpp GGUF files 
Small cleanups
 2024-08-28 10:34:58 -06:00
City 3d9869240b Always patch weight 
Should help with #33
 2024-08-28 17:12:24 +02:00
blepping c1693d0f55 Use a GGUF array for orig shape metadata 2024-08-25 13:18:35 -06:00
blepping 0aec56ec4c Split orig shape metadata into individual fields 2024-08-25 12:00:28 -06:00
blepping f3cf802dd6 Cleanups, refactoring 2024-08-25 07:53:19 -06:00
blepping 2832969aea Sync with main 2024-08-25 04:35:52 -06:00
City 0ba6f64974 Advanced loader with optimizations 
It may help with speed but it may also increase VRAM usage or degrade image quality.
Fastest would be target/target/true.
 2024-08-24 18:39:34 +02:00
blepping c93e622a19 SD1/SDXL fixes 2024-08-23 20:19:48 -06:00
blepping cea1b47ab3 Add support for SD1x and SDXL models 2024-08-23 11:59:21 -06:00
City 377862a06d Cast to device 
forgot this
 2024-08-23 03:23:49 +02:00
City 3aafaf9133 Fix LoRA loading on new versions 
Again
 2024-08-23 03:20:15 +02:00
City 6b499ec49e Hotfix to work as normal tensor 
Fixes [ViT-L-14-BEST...] not working
 2024-08-23 02:13:48 +02:00
City 1ebce77a44 Fix for single CLIP Loader 
#52
 2024-08-20 18:14:07 +02:00
City e7906b43eb Hotfix for missing text_projection in clip 
Also adds the triple text encode node for the 5 people still using SD3
 2024-08-20 03:38:59 +02:00
City 2e5e599b54 CLIP Loaders 2024-08-20 02:23:37 +02:00
City dc8b18d512 Move to top 2024-08-19 21:51:03 +02:00
City 4b239d2d75 Fix name change / regular unet list crosstalk 
#39
 2024-08-18 05:02:34 +02:00
City 4e848f7c95 Change model patcher logic 
Janky MethodType -> Inheritance
#31
 2024-08-17 11:43:51 +02:00
City 96b0ba1021 Allow using the native LoRA loader node 2024-08-17 07:56:38 +02:00
City 22e2c885f0 Async patch load with GPU support 2024-08-17 07:38:55 +02:00
City fed8ff1e70 Add LoRA support 
Initial, will need to change weight function
 2024-08-17 05:28:46 +02:00
City 2877c18573 Less fragile logic 2024-08-17 04:42:59 +02:00
City de5f6e9dcc mmap loading, lowvram support 
This should fix both types of OOM issues!
 2024-08-16 04:29:14 +02:00
City a8ce4e8d7c Initial commit 2024-08-15 05:50:54 +02:00