added cpu batch for llama_cpp
This commit is contained in:
@@ -7,10 +7,14 @@ A suite of custom nodes for ComfyUI, for now i just put Integer, string and floa
|
||||
`git clone https://github.com/Nuked88/ComfyUI-N-Nodes.git`
|
||||
to your ComfyUI `custom_nodes` directory
|
||||
|
||||
2. **IMPORTANT**: If you want the GPT node you need to run **install_dependency bat file**.
|
||||
There are 2 versions: ***install_dependency_ggml_models.bat*** for the old ggmlv3 models and ***install_dependency_new_models.bat*** for all the new models (GGUF).
|
||||
2. **IMPORTANT**: If you want the GPT nodes on GPU you'll need to run **install_dependency bat files**.
|
||||
There are 2 versions: ***install_dependency_ggml_models.bat*** for the old ggmlv3 models and ***install_dependency_gguf_models.bat*** for all the new models (GGUF).
|
||||
YOU CAN ONLY USE ONE OF THEM AT A TIME!
|
||||
Since _llama-cpp-python_ needs to be compiled from source code to enable it to use the GPU, you will first need to have [CUDA](https://developer.nvidia.com/cuda-downloads?target_os=Windows&target_arch=x86_64) and visual studio 2019 or 2022 (in the case of my bat) installed to compile it. For details and the full guide you can go [HERE](https://github.com/abetlen/llama-cpp-python) . This bats are made for the official portable windows version of ComfyUI
|
||||
Since _llama-cpp-python_ needs to be compiled from source code to enable it to use the GPU, you will first need to have [CUDA](https://developer.nvidia.com/cuda-downloads?target_os=Windows&target_arch=x86_64) and visual studio 2019 or 2022 (in the case of my bat) installed to compile it. For details and the full guide you can go [HERE](https://github.com/abetlen/llama-cpp-python) .
|
||||
|
||||
If you want the GPT nodes on CPU you'll need to run ***install_dependency_cpu_only_gguf_models.bat*** or ***install_dependency_cpu_only_ggml_models***
|
||||
|
||||
This bats are made for the official portable windows version of ComfyUI.
|
||||
|
||||
ComfyUI will then automatically load all custom scripts and nodes at the start.
|
||||
|
||||
|
||||
@@ -0,0 +1,13 @@
|
||||
@echo off
|
||||
|
||||
cd /d %~dp0
|
||||
git pull
|
||||
cd ../../../python_embeded
|
||||
|
||||
python.exe -s -m pip install scikit-build
|
||||
python.exe -s -m pip install cmake moviepy
|
||||
python.exe -s -m pip install llama-cpp-python==0.1.78 --force-reinstall --upgrade --no-cache-dir
|
||||
rem fix for was dependency
|
||||
python.exe -s -m pip install numpy==1.25
|
||||
|
||||
PAUSE
|
||||
@@ -0,0 +1,13 @@
|
||||
@echo off
|
||||
|
||||
cd /d %~dp0
|
||||
git pull
|
||||
cd ../../../python_embeded
|
||||
|
||||
python.exe -s -m pip install scikit-build
|
||||
python.exe -s -m pip install cmake moviepy
|
||||
python.exe -s -m pip install llama-cpp-python==0.1.84 --force-reinstall --upgrade --no-cache-dir
|
||||
rem fix for was dependency
|
||||
python.exe -s -m pip install numpy==1.25
|
||||
|
||||
PAUSE
|
||||
Reference in New Issue
Block a user