added cpu batch for llama_cpp

This commit is contained in:
Nuked
2023-10-26 19:50:29 +02:00
parent 833203dc02
commit ae64a47e83
4 changed files with 33 additions and 3 deletions
+7 -3
View File
@@ -7,10 +7,14 @@ A suite of custom nodes for ComfyUI, for now i just put Integer, string and floa
`git clone https://github.com/Nuked88/ComfyUI-N-Nodes.git`
to your ComfyUI `custom_nodes` directory
2. **IMPORTANT**: If you want the GPT node you need to run **install_dependency bat file**.
There are 2 versions: ***install_dependency_ggml_models.bat*** for the old ggmlv3 models and ***install_dependency_new_models.bat*** for all the new models (GGUF).
2. **IMPORTANT**: If you want the GPT nodes on GPU you'll need to run **install_dependency bat files**.
There are 2 versions: ***install_dependency_ggml_models.bat*** for the old ggmlv3 models and ***install_dependency_gguf_models.bat*** for all the new models (GGUF).
YOU CAN ONLY USE ONE OF THEM AT A TIME!
Since _llama-cpp-python_ needs to be compiled from source code to enable it to use the GPU, you will first need to have [CUDA](https://developer.nvidia.com/cuda-downloads?target_os=Windows&target_arch=x86_64) and visual studio 2019 or 2022 (in the case of my bat) installed to compile it. For details and the full guide you can go [HERE](https://github.com/abetlen/llama-cpp-python) . This bats are made for the official portable windows version of ComfyUI
Since _llama-cpp-python_ needs to be compiled from source code to enable it to use the GPU, you will first need to have [CUDA](https://developer.nvidia.com/cuda-downloads?target_os=Windows&target_arch=x86_64) and visual studio 2019 or 2022 (in the case of my bat) installed to compile it. For details and the full guide you can go [HERE](https://github.com/abetlen/llama-cpp-python) .
If you want the GPT nodes on CPU you'll need to run ***install_dependency_cpu_only_gguf_models.bat*** or ***install_dependency_cpu_only_ggml_models***
This bats are made for the official portable windows version of ComfyUI.
ComfyUI will then automatically load all custom scripts and nodes at the start.
@@ -0,0 +1,13 @@
@echo off
cd /d %~dp0
git pull
cd ../../../python_embeded
python.exe -s -m pip install scikit-build
python.exe -s -m pip install cmake moviepy
python.exe -s -m pip install llama-cpp-python==0.1.78 --force-reinstall --upgrade --no-cache-dir
rem fix for was dependency
python.exe -s -m pip install numpy==1.25
PAUSE
@@ -0,0 +1,13 @@
@echo off
cd /d %~dp0
git pull
cd ../../../python_embeded
python.exe -s -m pip install scikit-build
python.exe -s -m pip install cmake moviepy
python.exe -s -m pip install llama-cpp-python==0.1.84 --force-reinstall --upgrade --no-cache-dir
rem fix for was dependency
python.exe -s -m pip install numpy==1.25
PAUSE