24 lines
1.1 KiB
Plaintext
24 lines
1.1 KiB
Plaintext
# Core dependencies for Hugging Face transformers based nodes (e.g., Hermes-2-Pro-Llama-3-8B)
|
|
transformers>=4.38.0 # Or a specific version you know works
|
|
torch>=2.0.0 # Or a specific version you know works
|
|
# Optional, for quantization with transformers (e.g., 4-bit)
|
|
# bitsandbytes # Uncomment if you use BitsAndBytesConfig in local_llm_connector.py
|
|
# accelerate # Often needed with transformers, especially for device_map
|
|
|
|
# Core dependency for GGUF based nodes (e.g., Mistral-7B-Instruct-Q8.gguf)
|
|
llama-cpp-python>=0.1.0 # Or a specific version
|
|
|
|
# Optional: For downloading models from Hugging Face Hub
|
|
huggingface_hub
|
|
|
|
# Optional: If your package uses any specific utility libraries
|
|
# (Although deepdiff, pillow, etc. might be pulled in by ComfyUI or other nodes)
|
|
# deepdiff
|
|
# pillow
|
|
|
|
# Notes for Users:
|
|
# For llama-cpp-python with GPU support (CUDA), installation is more complex.
|
|
# Example for CUDA 11.8 (check llama-cpp-python docs for your version):
|
|
# CMAKE_ARGS="-DLLAMA_CUBLAS=on" pip install llama-cpp-python
|
|
# Example for CUDA 12.1:
|
|
# CMAKE_ARGS="-DLLAMA_CUDA=on" pip install llama-cpp-python |