🔥OpenVINO Node for ComfyUI🔥

This node is designed for optimizing the performance of model inference in ComfyUI by leveraging Intel OpenVINO toolkits.

---

• OpenVINO Node for ComfyUI
  • Supported Hardware
  • Install
    • Comfy Registry
    • ComfyUI-Manager
    • Manual
  • Instruction
  • Q&A

💻Supported Hardware

This node can support running model on Intel CPU, GPU and NPU device.You can find more detailed informantion in OpenVINO System Requirements.

🚗Install

Prererquisites

• Install comfy-cli

The recommended installation method is to use the Comfy Registry.

Comfy Registry

These nodes can be installed via the Comfy Registry.

comfy node registry-install comfyui-openvino

ComfyUI-Manager

This node can be installed via ComfyUI-Manager in the UI or via the CLI:

comfy node install comfyui-openvino

Manual

This node can also be installed manually by copying them into your custom_nodes folder and then installing dependencies:

cd ComfyUI/custom_nodes
git clone https://github.com/openvino-dev-samples/comfyui_openvino 
cd comfyui_openvino
pip install -r requirements.txt

🚀Instruction

To trigger OpenVINO Node for ComfyUI, you can follow the example as reference:

1. Start a ComfyUI server.

   • lanuch from source:

   cd ComfyUI
   python3 main.py --cpu --use-pytorch-cross-attention
   

   • lanuch from comfy-cli:

   comfy launch -- --cpu --use-pytorch-cross-attention
   

2. Prepare a standard workflow in ComfyUI.

   

3. Add OpenVINO Node.

   

4. Connect TorchCompileDiffusionOpenVINO with Diffusion model and TorchCompileVAEOpenVINO with VAE model

   

5. Run workflow. Please notice it may need an additional warm-up inference after switching new model.

   

🤔Q&A

1. Does it support LoRA loader ?

   Yes, and you can refer the following picture to add it into a workflow of OpenVINO node.

   

2. How to install ComfyUI-OpenVINO via ComfyUI-Manager in the Portable version of ComfyUI?

ComfyUI-Manager is not enabled by default in the Portable version. Follow the official guide to enable it first.

Portable ComfyUI builds may not include Git, which is required for ComfyUI-Manager to work. It is recommended to download Portable Git and explicitly set its path in your .bat launcher before starting ComfyUI:

set GIT_PYTHON_GIT_EXECUTABLE=C:\path\to\portable-git\bin\git.exe

After installing the extension via the Manager, make sure that the installed dependencies match the versions specified in:

ComfyUI_windows_portable\ComfyUI\custom_nodes\comfyui-openvino\requirements.txt

If newer versions were installed automatically, downgrade them to match. Note that the extension currently requires torch <=2.6.0 and torchaudio <=2.6.0 specifically; if newer versions are already installed, downgrade them.

3. RuntimeError: Compiler: 'cl' is not found at higher resolutions — how to fix?

   At low resolutions (e.g. 512×512) the extension works fine. At higher resolutions, PyTorch's inductor triggers a JIT C++ compilation step that requires MSVC (cl.exe).

   Fix: Install Visual Studio (Community edition is sufficient) or the standalone MSVC Build Tools. During installation, make sure to select the "Desktop development with C++" workload — this is what actually installs cl.exe and the required C++ components. Then activate the MSVC environment in your .bat launcher before starting ComfyUI:

   call "C:\Program Files\Microsoft Visual Studio\18\Community\VC\Auxiliary\Build\vcvars64.bat"
   

   Adjust the path to match your Visual Studio version and edition.

4. C++ compile error due to a space in the torchinductor cache folder name — how to fix?

   If your Windows display name (Full Name) contains a space (e.g. John Doe), PyTorch will create a temp folder like:

   C:\Users\John\AppData\Local\Temp\torchinductor_John Doe
   

   The space in the path breaks the MSVC compiler.

   Fix: Override USERNAME in your .bat launcher before starting ComfyUI:

   set USERNAME=User
   

   This only affects the current session and does not change your Windows account. After this, PyTorch will create the temp folder as:

   C:\Users\John\AppData\Local\Temp\torchinductor_User
   

   If your Windows account folder name (e.g. C:\Users\John Doe\) also contains a space, overriding USERNAME alone is not enough — the temp path will still be broken. In that case, redirect the temp directory to a path without spaces:

   set TEMP=C:\tmp
   set TMP=C:\tmp
   

   Make sure the folder C:\tmp exists before launching ComfyUI.

5. python_embeded is missing Python headers/libraries for C++ compilation — how to fix?

   Portable ComfyUI uses a stripped-down embedded Python that is missing the include and libs directories required for C++ compilation.

   Fix:

   1. Download the full Python installer for the same version as your python_embeded.
   2. Copy the include and libs folders from the full Python installation into your ComfyUI_windows_portable\python_embeded\ directory.

   After this, cl.exe will be able to compile successfully.

   📄 Example run_cpu.bat with all fixes applied

   call "C:\Program Files\Microsoft Visual Studio\18\Community\VC\Auxiliary\Build\vcvars64.bat"
   set USERNAME=User
   set GIT_PYTHON_GIT_EXECUTABLE=C:\Users\John\ComfyUI_windows_portable\git\bin\git.exe
   .\python_embeded\python.exe -s ComfyUI\main.py --cpu --windows-standalone-build --enable-manager --use-pytorch-cross-attention
   pause