Update README.md
This commit is contained in:
@@ -7,10 +7,11 @@ The purpose of this package is to collect the most necessary and atomic nodes fo
|
||||
**In this Level Pixel Advanced node pack you will find:**
|
||||
LLM nodes, LLaVa and other VLM nodes
|
||||
|
||||
Recommend that you install the main node package from Level Pixel:
|
||||
Recommend that you install the main node package from Level Pixel:\
|
||||
[https://github.com/LevelPixel/ComfyUI-LevelPixel](https://github.com/LevelPixel/ComfyUI-LevelPixel)
|
||||
|
||||
The official repository of the current node package is located at this link:
|
||||
|
||||
The official repository of the current node package is located at this link:\
|
||||
[https://github.com/LevelPixel/ComfyUI-LevelPixel-Advanced](https://github.com/LevelPixel/ComfyUI-LevelPixel-Advanced)
|
||||
|
||||
## Contacts:
|
||||
@@ -25,16 +26,16 @@ levelpixel.dev@gmail.com
|
||||
|
||||
Before running ComfyUI with this node package, you should make sure that you have the following programs and libraries installed so that ComfyUI can compile the necessary libraries and programs for llama-cpp-python (the main library that allows you to use any current gguf models and neural network architectures):
|
||||
|
||||
* `CUDA drivers` - install the latest version.
|
||||
* `CUDA drivers` - install the latest version.\
|
||||
Download: [https://developer.nvidia.com/cuda-downloads](https://developer.nvidia.com/cuda-downloads)
|
||||
* `Visual Studio 2022 Community IDE` with libraries for compiling C++ programs, specifically with individual components (select them in Visual Studio Installer when installing/modifying Visual Studio 2022):
|
||||
MSVC v143 - VS 2022 C++ x64/x86 build tools (Latest)
|
||||
MSVC v143 - VS 2022 C++ x64/x86 build tools (v14.38-17.8)
|
||||
C++ Cmake tools for Windows
|
||||
C++ Cmake tools for Linux and Mac
|
||||
Download: [https://visualstudio.microsoft.com/downloads/](https://visualstudio.microsoft.com/downloads/)
|
||||
* `CMAKE official distribution` - download and install the latest version.
|
||||
Download: [https://cmake.org/download/](https://cmake.org/download/)
|
||||
C++ Cmake tools for Linux and Mac\
|
||||
Download: [https://visualstudio.microsoft.com/downloads](https://visualstudio.microsoft.com/downloads)
|
||||
* `CMAKE official distribution` - download and install the latest version.\
|
||||
Download: [https://cmake.org/download](https://cmake.org/download)
|
||||
|
||||
### Installation Using ComfyUI Manager (recommended):
|
||||
|
||||
@@ -106,17 +107,25 @@ The core functionality is taken from [ComfyUI_VLM_nodes](https://github.com/goka
|
||||
|
||||
How to use LLaVa nodes:
|
||||
|
||||
1. **Download the Qwen 2.5 VL gguf file**:
|
||||
1. **Download the Qwen 2.5 VL gguf file**:\
|
||||
[https://huggingface.co/Mungert/Qwen2.5-VL-7B-Instruct-GGUF/tree/main
|
||||
](https://huggingface.co/Mungert/Qwen2.5-VL-7B-Instruct-GGUF/tree/main)Choose a gguf file without the mmproj in the name
|
||||
Example gguf file : [https://huggingface.co/Mungert/Mungert/Qwen2.5-VL-7B-Instruct-GGUF/resolve/main/Qwen2.5-VL-7B-Instruct-q8_0.gguf
|
||||
](https://huggingface.co/Mungert/Mungert/Qwen2.5-VL-7B-Instruct-GGUF/resolve/main/Qwen2.5-VL-7B-Instruct-q8_0.gguf)Copy this file to ComfyUI/model/Llavacheckpoint.
|
||||
2. **Download the Qwen 2.5 VL mmproj file (this is clip model)**
|
||||
](https://huggingface.co/Mungert/Qwen2.5-VL-7B-Instruct-GGUF/tree/main)\
|
||||
Choose a gguf file **without** the mmproj in the name\
|
||||
Example gguf file:\
|
||||
[https://huggingface.co/Mungert/Mungert/Qwen2.5-VL-7B-Instruct-GGUF/resolve/main/Qwen2.5-VL-7B-Instruct-q8_0.gguf
|
||||
](https://huggingface.co/Mungert/Mungert/Qwen2.5-VL-7B-Instruct-GGUF/resolve/main/Qwen2.5-VL-7B-Instruct-q8_0.gguf)\
|
||||
Copy this file to ComfyUI/model/Llavacheckpoint.
|
||||
|
||||
2. **Download the Qwen 2.5 VL mmproj file (this is clip model):**\
|
||||
[https://huggingface.co/Mungert/Qwen2.5-VL-7B-Instruct-GGUF/tree/main
|
||||
](https://huggingface.co/Mungert/Qwen2.5-VL-7B-Instruct-GGUF/tree/main)Choose a file with mmproj in the name
|
||||
Example mmproj file : [https://huggingface.co/Mungert/Qwen2.5-VL-7B-Instruct-GGUF/resolve/main/Qwen2.5-VL-7B-Instruct-mmproj-bf16.gguf
|
||||
](https://huggingface.co/Mungert/Qwen2.5-VL-7B-Instruct-GGUF/resolve/main/Qwen2.5-VL-7B-Instruct-mmproj-bf16.gguf)Copy this file to ComfyUI/model/Llavacheckpoint.
|
||||
3. Run ComfyUI and add to workflow node LLava Advanced [LP]. Choose ckpt model and clip, pin image and write prompt.
|
||||
](https://huggingface.co/Mungert/Qwen2.5-VL-7B-Instruct-GGUF/tree/main)\
|
||||
Choose a file **with** mmproj in the name\
|
||||
Example mmproj file:\
|
||||
[https://huggingface.co/Mungert/Qwen2.5-VL-7B-Instruct-GGUF/resolve/main/Qwen2.5-VL-7B-Instruct-mmproj-bf16.gguf
|
||||
](https://huggingface.co/Mungert/Qwen2.5-VL-7B-Instruct-GGUF/resolve/main/Qwen2.5-VL-7B-Instruct-mmproj-bf16.gguf)\
|
||||
Copy this file to ComfyUI/model/Llavacheckpoint.
|
||||
|
||||
3. **Run ComfyUI and add to workflow node LLava Advanced [LP]. Choose ckpt model and clip, pin image and write prompt.**
|
||||
|
||||
# Credits
|
||||
|
||||
|
||||
Reference in New Issue
Block a user