From ae64a47e83efff2c33564cb2c372b03ec4b3c8ff Mon Sep 17 00:00:00 2001 From: Nuked Date: Thu, 26 Oct 2023 19:50:29 +0200 Subject: [PATCH] added cpu batch for llama_cpp --- README.md | 10 +++++++--- install_dependency_cpu_only_ggml_models.bat | 13 +++++++++++++ install_dependency_cpu_only_gguf_models.bat | 13 +++++++++++++ ...models.bat => install_dependency_gguf_models.bat | 0 4 files changed, 33 insertions(+), 3 deletions(-) create mode 100644 install_dependency_cpu_only_ggml_models.bat create mode 100644 install_dependency_cpu_only_gguf_models.bat rename install_dependency_new_models.bat => install_dependency_gguf_models.bat (100%) diff --git a/README.md b/README.md index 12aed12..7c433de 100644 --- a/README.md +++ b/README.md @@ -7,10 +7,14 @@ A suite of custom nodes for ComfyUI, for now i just put Integer, string and floa `git clone https://github.com/Nuked88/ComfyUI-N-Nodes.git` to your ComfyUI `custom_nodes` directory -2. **IMPORTANT**: If you want the GPT node you need to run **install_dependency bat file**. -There are 2 versions: ***install_dependency_ggml_models.bat*** for the old ggmlv3 models and ***install_dependency_new_models.bat*** for all the new models (GGUF). +2. **IMPORTANT**: If you want the GPT nodes on GPU you'll need to run **install_dependency bat files**. +There are 2 versions: ***install_dependency_ggml_models.bat*** for the old ggmlv3 models and ***install_dependency_gguf_models.bat*** for all the new models (GGUF). YOU CAN ONLY USE ONE OF THEM AT A TIME! -Since _llama-cpp-python_ needs to be compiled from source code to enable it to use the GPU, you will first need to have [CUDA](https://developer.nvidia.com/cuda-downloads?target_os=Windows&target_arch=x86_64) and visual studio 2019 or 2022 (in the case of my bat) installed to compile it. For details and the full guide you can go [HERE](https://github.com/abetlen/llama-cpp-python) . This bats are made for the official portable windows version of ComfyUI +Since _llama-cpp-python_ needs to be compiled from source code to enable it to use the GPU, you will first need to have [CUDA](https://developer.nvidia.com/cuda-downloads?target_os=Windows&target_arch=x86_64) and visual studio 2019 or 2022 (in the case of my bat) installed to compile it. For details and the full guide you can go [HERE](https://github.com/abetlen/llama-cpp-python) . + +If you want the GPT nodes on CPU you'll need to run ***install_dependency_cpu_only_gguf_models.bat*** or ***install_dependency_cpu_only_ggml_models*** + +This bats are made for the official portable windows version of ComfyUI. ComfyUI will then automatically load all custom scripts and nodes at the start. diff --git a/install_dependency_cpu_only_ggml_models.bat b/install_dependency_cpu_only_ggml_models.bat new file mode 100644 index 0000000..a31adf5 --- /dev/null +++ b/install_dependency_cpu_only_ggml_models.bat @@ -0,0 +1,13 @@ +@echo off + +cd /d %~dp0 +git pull +cd ../../../python_embeded + +python.exe -s -m pip install scikit-build +python.exe -s -m pip install cmake moviepy +python.exe -s -m pip install llama-cpp-python==0.1.78 --force-reinstall --upgrade --no-cache-dir +rem fix for was dependency +python.exe -s -m pip install numpy==1.25 + +PAUSE \ No newline at end of file diff --git a/install_dependency_cpu_only_gguf_models.bat b/install_dependency_cpu_only_gguf_models.bat new file mode 100644 index 0000000..09dda59 --- /dev/null +++ b/install_dependency_cpu_only_gguf_models.bat @@ -0,0 +1,13 @@ +@echo off + +cd /d %~dp0 +git pull +cd ../../../python_embeded + +python.exe -s -m pip install scikit-build +python.exe -s -m pip install cmake moviepy +python.exe -s -m pip install llama-cpp-python==0.1.84 --force-reinstall --upgrade --no-cache-dir +rem fix for was dependency +python.exe -s -m pip install numpy==1.25 + +PAUSE \ No newline at end of file diff --git a/install_dependency_new_models.bat b/install_dependency_gguf_models.bat similarity index 100% rename from install_dependency_new_models.bat rename to install_dependency_gguf_models.bat