comfyui_davcha_llm

vLLM nodes for comfyui using llama-cpp-python

Please install llama-cpp-python with cuda enabled. Can be found here for windows: https://github.com/dougeeai/llama-cpp-python-wheels