Fix vram usage with higher context

2024-05-17 22:55:50 +02:00
parent c005e3c637
commit d7413b2ebc
2 changed files with 9 additions and 19 deletions
@@ -1 +1 @@
-exllamav2>=0.0.16; platform_system == "Linux"
+exllamav2>=0.0.17; platform_system == "Linux"