VrchStudio-comfyui-web-viewer/docs/model_nodes.md

Model Nodes

TensorRT Auto Loader @ vrch.ai

Loads a selected local TensorRT Engine when available while keeping the original ComfyUI MODEL as a fallback.

Inputs

• model (MODEL): Original model used by pytorch mode and by auto fallback.
• load_mode:
  • auto: Load the selected TensorRT Engine; use the original model if loading is unavailable or fails.
  • tensorrt: Require the selected TensorRT Engine and stop the prompt if it cannot be loaded.
  • pytorch: Bypass TensorRT and use the original model.
• engine_name: TensorRT Engine from the host's ComfyUI output/tensorrt directory or another registered TensorRT model path.
• debug: Print concise loader, cache, and fallback diagnostics to the ComfyUI server console.

Outputs

• model (MODEL): TensorRT model or the original model selected by load_mode.
• backend (STRING): Actual backend, tensorrt or pytorch.
• status (STRING): Loading result or fallback reason.

Behavior

The node is independent of Live Console Maintenance and does not require custom frontend JavaScript. Engine choices use ComfyUI's native dropdown. Refresh the ComfyUI frontend after adding a new Engine so the dropdown is rebuilt.

An Engine name saved by another host or removed later is accepted by the workflow. In auto mode it safely falls back to the input model; in tensorrt mode it reports an error. TensorRT inference errors that occur after the model has loaded are not retried with PyTorch.

The current implementation infers the TensorRT model family from the input MODEL. The installed TensorRTLoader remains responsible for Engine deserialization and compatibility.