nodes/Zuellni-ComfyUI-ExLlama-Nodes
1
0
Fork 0
Code Issues Pull Requests Packages Projects Releases Wiki Activity

Update to ExLlamaV2, loras currently not supported

Browse Source
This commit is contained in:
Zuellni
2023-09-27 15:55:24 +02:00
parent eaac644f6b
commit 89120f2474
4 changed files with 44 additions and 108 deletions
Download Patch File Download Diff File Expand all files Collapse all files
requirements.txt
+4 -6
View File
@@ -1,6 +1,4 @@
https://github.com/jllllll/exllama/releases/download/0.0.17/exllama-0.0.17+cu121-cp311-cp311-win_amd64.whl; platform_system == "Windows" and python_version == "3.11"
https://github.com/jllllll/exllama/releases/download/0.0.17/exllama-0.0.17+cu118-cp310-cp310-win_amd64.whl; platform_system == "Windows" and python_version == "3.10"
https://github.com/jllllll/exllama/releases/download/0.0.17/exllama-0.0.17+cu121-cp311-cp311-linux_x86_64.whl; platform_system == "Linux" and python_version == "3.11"
https://github.com/jllllll/exllama/releases/download/0.0.17/exllama-0.0.17+cu118-cp310-cp310-linux_x86_64.whl; platform_system == "Linux" and python_version == "3.10"
colorama
sentencepiece
https://github.com/turboderp/exllamav2/releases/download/v0.0.4/exllamav2-0.0.4+cu121-cp311-cp311-win_amd64.whl; platform_system == "Windows" and python_version == "3.11"
https://github.com/turboderp/exllamav2/releases/download/v0.0.4/exllamav2-0.0.4+cu118-cp310-cp310-win_amd64.whl; platform_system == "Windows" and python_version == "3.10"
https://github.com/turboderp/exllamav2/releases/download/v0.0.4/exllamav2-0.0.4+cu121-cp311-cp311-linux_x86_64.whl; platform_system == "Linux" and python_version == "3.11"
https://github.com/turboderp/exllamav2/releases/download/v0.0.4/exllamav2-0.0.4+cu118-cp310-cp310-linux_x86_64.whl; platform_system == "Linux" and python_version == "3.10"