Files
PozzettiAndrea-ComfyUI-Dept…/dev/macos-cpu/session.log
T
2026-05-10 20:52:09 +00:00

1114 lines
173 KiB
Plaintext

[00:00] Crash dump logging enabled: /Users/runner/work/comfy-gpu-ci/comfy-gpu-ci/comfy-test-logs/DepthAnythingV3-2043/dev/macos-cpu/crash_dump.log
[00:00]
[00:00] [1/5] SYNTAX
[00:00] ----------------------------------------
[00:00]
[DEBUG] server=None, server_url=None, api=None
[00:00] Found pyproject.toml (modern format)
[00:00] Found requirements.txt (legacy format)
[00:00] Unicode check: OK (all characters cp1252-safe)
[00:00] Forbidden patterns check: OK
[00:00] [SYNTAX] PASSED
[00:00]
[00:00] [2/5] INSTALL
[00:00] ----------------------------------------
[00:00]
[DEBUG] server=None, server_url=None, api=None
[00:00]
Setting up ComfyUI...
[00:00] Cloning ComfyUI (latest)...
[00:00] Running: git clone --depth 1 https://github.com/comfyanonymous/ComfyUI.git /Users/runner/work/comfy-gpu-ci/comfy-gpu-ci/test_workspaces/DepthAnythingV3-2043/ComfyUI
[00:01] Creating virtual environment...
[00:01] Running: /Library/Frameworks/Python.framework/Versions/3.11/bin/python -m venv /Users/runner/work/comfy-gpu-ci/comfy-gpu-ci/test_workspaces/DepthAnythingV3-2043/venv
[00:03] Installing uv into venv...
[00:03] Running: /Users/runner/work/comfy-gpu-ci/comfy-gpu-ci/test_workspaces/DepthAnythingV3-2043/venv/bin/python -m pip install uv
[00:04] Installing PyTorch...
[00:04] Running: /Users/runner/work/comfy-gpu-ci/comfy-gpu-ci/test_workspaces/DepthAnythingV3-2043/venv/bin/python -m uv pip install torch torchvision torchaudio
[00:09] Installing ComfyUI requirements...
[00:09] Running: /Users/runner/work/comfy-gpu-ci/comfy-gpu-ci/test_workspaces/DepthAnythingV3-2043/venv/bin/python -m uv pip install -r /Users/runner/work/comfy-gpu-ci/comfy-gpu-ci/test_workspaces/DepthAnythingV3-2043/ComfyUI/requirements.txt
[00:20]
Installing custom node...
[00:20] Copying ComfyUI-DepthAnythingV3 to custom_nodes/...
[00:20] Installing node requirements...
[00:20] Running: /Users/runner/work/comfy-gpu-ci/comfy-gpu-ci/test_workspaces/DepthAnythingV3-2043/venv/bin/python -m uv pip install -r /Users/runner/work/comfy-gpu-ci/comfy-gpu-ci/test_workspaces/DepthAnythingV3-2043/ComfyUI/custom_nodes/ComfyUI-DepthAnythingV3/requirements.txt
[00:20]
Running install.py...
[00:20] Running: /Users/runner/work/comfy-gpu-ci/comfy-gpu-ci/test_workspaces/DepthAnythingV3-2043/venv/bin/python /Users/runner/work/comfy-gpu-ci/comfy-gpu-ci/test_workspaces/DepthAnythingV3-2043/ComfyUI/custom_nodes/ComfyUI-DepthAnythingV3/install.py
[00:21]
[00:21] Installing 3 node dependencies...
[00:21] Cloning ComfyUI-VideoHelperSuite...
[00:22] Installing requirements for ComfyUI-VideoHelperSuite...
[00:23] Cloning ComfyUI-KJNodes...
[00:24] Installing requirements for ComfyUI-KJNodes...
[00:26] Cloning ComfyUI-GeometryPack...
[00:28] Installing requirements for ComfyUI-GeometryPack...
[00:29] Running install.py for ComfyUI-GeometryPack...
[00:30] [comfy-env] _discover: scanning /Users/runner/work/comfy-gpu-ci/comfy-gpu-ci/test_workspaces/DepthAnythingV3-2043/ComfyUI/custom_nodes
[00:30] [comfy-env] _discover: ComfyUI-DepthAnythingV3 -> depthanythingv3-nodes (custom_nodes/ComfyUI-DepthAnythingV3/nodes/comfy-env.toml)
[00:30] [comfy-env] _discover: ComfyUI-GeometryPack -> geometrypack-nodes (custom_nodes/ComfyUI-GeometryPack/nodes/comfy-env.toml)
[00:30] [comfy-env] _discover: ComfyUI-KJNodes: no comfy-env.toml found
[00:30] [comfy-env] _discover: ComfyUI-VideoHelperSuite: no comfy-env.toml found
[00:30] [comfy-env] Workspace: /Users/runner/work/comfy-gpu-ci/comfy-gpu-ci/test_workspaces/DepthAnythingV3-2043/ComfyUI/.ce
[00:30] [comfy-env] ComfyUI: /Users/runner/work/comfy-gpu-ci/comfy-gpu-ci/test_workspaces/DepthAnythingV3-2043/ComfyUI
[00:30] [comfy-env] Found 2 node config(s):
[00:30] - depthanythingv3-nodes <- custom_nodes/ComfyUI-DepthAnythingV3/nodes/comfy-env.toml (python=host)
[00:30] - geometrypack-nodes <- custom_nodes/ComfyUI-GeometryPack/nodes/comfy-env.toml (python=host)
[00:30] [comfy-env] Bootstrap interpreter has python 3.11 + torch 2.11.0 (cpu). Looking for cuda-only wheels matching cpu/torch2.11/cp311.
[00:30] [comfy-env] Root conda deps from ComfyUI-GeometryPack: ['av', 'ffmpeg']
[00:30] [comfy-env] Comfyui feature pin: torch ==2.11.0, torchvision ==0.26.*, torchaudio ==2.11.*
[00:30] [comfy-env] Root conda deps (comfyui env only): ['av', 'ffmpeg']
[00:30] [comfy-env] comfyui env: python 3.11, torch from https://download.pytorch.org/whl/cpu
[00:30] Generated /Users/runner/work/comfy-gpu-ci/comfy-gpu-ci/test_workspaces/DepthAnythingV3-2043/ComfyUI/.ce/pixi.toml
[00:30] [comfy-env] Installing 2 environment(s):
[00:30] - depthanythingv3-nodes (python=host, 10 pypi deps, 2 cuda wheels)
[00:30] - geometrypack-nodes (python=host, 13 pypi deps, 1 cuda wheels)
[00:30] [comfy-env] Running `pixi install --all`...
[00:38] WARN Skipped running the post-link scripts because `run-post-link-scripts` = `false`
[00:38] - bin/.librsvg-pre-unlink.sh
[00:38] To enable them, run:
[00:38] pixi config set --local run-post-link-scripts insecure
[00:38] More info:
[00:38] https://pixi.sh/latest/reference/pixi_configuration/#run-post-link-scripts
[00:42] WARN Skipped running the post-link scripts because `run-post-link-scripts` = `false`
[00:42] - bin/.librsvg-pre-unlink.sh
[00:42] To enable them, run:
[00:42] pixi config set --local run-post-link-scripts insecure
[00:42] More info:
[00:42] https://pixi.sh/latest/reference/pixi_configuration/#run-post-link-scripts
[01:10] WARN Skipped running the post-link scripts because `run-post-link-scripts` = `false`
[01:10] - bin/.librsvg-pre-unlink.sh
[01:10] To enable them, run:
[01:10] pixi config set --local run-post-link-scripts insecure
[01:10] More info:
[01:10] https://pixi.sh/latest/reference/pixi_configuration/#run-post-link-scripts
[01:14] ✔ The following environments have been installed: default, comfyui, depthanythingv3-nodes, geometrypack-nodes.
[01:14] [comfy-env] Note: env `default` is on disk but no node declares it in this run. Leaving as-is. Remove via `pixi clean --environment default` if intended.
[01:14] [comfy-env] depthanythingv3-nodes: deduped libomp
[01:14] [comfy-env] geometrypack-nodes: deduped libomp
[01:14] [comfy-env] Install log: /Users/runner/work/comfy-gpu-ci/comfy-gpu-ci/test_workspaces/DepthAnythingV3-2043/ComfyUI/.ce/install.log
[01:14]
[01:14] Installation complete!
[01:14]
[01:14] [requirements] Re-installing main package requirements...
[01:14] Installing requirements for ComfyUI-DepthAnythingV3...
[01:14] [comfy-env] _discover: scanning /Users/runner/work/comfy-gpu-ci/comfy-gpu-ci/test_workspaces/DepthAnythingV3-2043/ComfyUI/custom_nodes
[01:14] [comfy-env] _discover: ComfyUI-DepthAnythingV3 -> depthanythingv3-nodes (custom_nodes/ComfyUI-DepthAnythingV3/nodes/comfy-env.toml)
[01:14] [comfy-env] _discover: ComfyUI-GeometryPack -> geometrypack-nodes (custom_nodes/ComfyUI-GeometryPack/nodes/comfy-env.toml)
[01:14] [comfy-env] _discover: ComfyUI-KJNodes: no comfy-env.toml found
[01:14] [comfy-env] _discover: ComfyUI-VideoHelperSuite: no comfy-env.toml found
[01:14] [comfy-env] Workspace: /Users/runner/work/comfy-gpu-ci/comfy-gpu-ci/test_workspaces/DepthAnythingV3-2043/ComfyUI/.ce
[01:14] [comfy-env] ComfyUI: /Users/runner/work/comfy-gpu-ci/comfy-gpu-ci/test_workspaces/DepthAnythingV3-2043/ComfyUI
[01:14] [comfy-env] Found 2 node config(s):
[01:14] - depthanythingv3-nodes <- custom_nodes/ComfyUI-DepthAnythingV3/nodes/comfy-env.toml (python=host)
[01:14] - geometrypack-nodes <- custom_nodes/ComfyUI-GeometryPack/nodes/comfy-env.toml (python=host)
[01:14] [comfy-env] Bootstrap interpreter has python 3.11 + torch 2.11.0 (cpu). Looking for cuda-only wheels matching cpu/torch2.11/cp311.
[01:14] [comfy-env] Root conda deps from ComfyUI-GeometryPack: ['av', 'ffmpeg']
[01:14] [comfy-env] Comfyui feature pin: torch ==2.11.0, torchvision ==0.26.*, torchaudio ==2.11.*
[01:14] [comfy-env] Root conda deps (comfyui env only): ['av', 'ffmpeg']
[01:14] [comfy-env] comfyui env: python 3.11, torch from https://download.pytorch.org/whl/cpu
[01:14] Generated /Users/runner/work/comfy-gpu-ci/comfy-gpu-ci/test_workspaces/DepthAnythingV3-2043/ComfyUI/.ce/pixi.toml
[01:14] [comfy-env] Installing 2 environment(s):
[01:14] - depthanythingv3-nodes (python=host, 10 pypi deps, 2 cuda wheels)
[01:14] - geometrypack-nodes (python=host, 13 pypi deps, 1 cuda wheels)
[01:14] [comfy-env] Running `pixi install --all`...
[01:14] ✔ The following environments have been installed: default, comfyui, depthanythingv3-nodes, geometrypack-nodes.
[01:14] [comfy-env] Note: env `default` is on disk but no node declares it in this run. Leaving as-is. Remove via `pixi clean --environment default` if intended.
[01:14] [comfy-env] depthanythingv3-nodes: deduped libomp
[01:14] [comfy-env] geometrypack-nodes: deduped libomp
[01:14] [comfy-env] Install log: /Users/runner/work/comfy-gpu-ci/comfy-gpu-ci/test_workspaces/DepthAnythingV3-2043/ComfyUI/.ce/install.log
[01:14]
[01:14] Installation complete!
[01:14] Installing 3 node dependency(ies)...
[01:14] ComfyUI-VideoHelperSuite from Kosinkadink/ComfyUI-VideoHelperSuite
[01:14] ComfyUI-VideoHelperSuite already exists, skipping...
[01:14] ComfyUI-KJNodes from kijai/ComfyUI-KJNodes
[01:14] ComfyUI-KJNodes already exists, skipping...
[01:14] ComfyUI-GeometryPack from PozzettiAndrea/ComfyUI-GeometryPack
[01:14] ComfyUI-GeometryPack already exists, skipping...
[01:14] Installing validation endpoint...
[01:14] Cloning PozzettiAndrea/ComfyUI-validate-endpoint...
[01:14] Running: git clone --depth 1 https://github.com/PozzettiAndrea/ComfyUI-validate-endpoint.git /Users/runner/work/comfy-gpu-ci/comfy-gpu-ci/test_workspaces/DepthAnythingV3-2043/ComfyUI/custom_nodes/ComfyUI-validate-endpoint
[01:15] CUDA packages absent (will mock): flash_attn, sageattention
[01:15] [INSTALL] PASSED
[01:15]
[01:15] [3/5] REGISTRATION
[01:15] ----------------------------------------
[01:15]
[DEBUG] server=None, server_url=None, api=None
[01:15]
Starting ComfyUI server...
[01:15] Starting ComfyUI server on port 41884...
[01:15] CUDA mock packages: flash_attn, sageattention
[01:15] Starting ComfyUI server on port 41884...
[01:15] Waiting for server to be ready (timeout: 600s)...
[01:16] [ComfyUI] setup plugin alembic.autogenerate.schemas
[01:16] [ComfyUI] setup plugin alembic.autogenerate.tables
[01:16] [ComfyUI] setup plugin alembic.autogenerate.types
[01:16] [ComfyUI] setup plugin alembic.autogenerate.constraints
[01:16] [ComfyUI] setup plugin alembic.autogenerate.defaults
[01:16] [ComfyUI] setup plugin alembic.autogenerate.comments
[01:16] [ComfyUI] Could not autodetect AIMDO implementation, assuming Nvidia
[01:16] [ComfyUI] comfy-aimdo unsupported operating system: Darwin
[01:16] [ComfyUI] NOTE: comfy-aimdo currently only supports Windows and Linux
[01:17] [ComfyUI] [comfy-env] ComfyUI-DepthAnythingV3: 1 isolation env(s):
[01:17] [ComfyUI] [comfy-env] nodes -> /Users/runner/work/comfy-gpu-ci/comfy-gpu-ci/test_workspaces/DepthAnythingV3-2043/ComfyUI/custom_nodes/ComfyUI-DepthAnythingV3/nodes
[01:19] [ComfyUI] [comfy-env] prestartup complete
[01:19] [ComfyUI] [comfy-env] ComfyUI-GeometryPack: 1 isolation env(s):
[01:19] [ComfyUI] [comfy-env] nodes -> /Users/runner/work/comfy-gpu-ci/comfy-gpu-ci/test_workspaces/DepthAnythingV3-2043/ComfyUI/custom_nodes/ComfyUI-GeometryPack/nodes
[01:19] [ComfyUI] [comfy-env] prestartup complete
[01:19] [ComfyUI]
[01:19] [ComfyUI] Prestartup times for custom nodes:
[01:19] [ComfyUI] 0.1 seconds: /Users/runner/work/comfy-gpu-ci/comfy-gpu-ci/test_workspaces/DepthAnythingV3-2043/ComfyUI/custom_nodes/ComfyUI-GeometryPack
[01:19] [ComfyUI] 2.4 seconds: /Users/runner/work/comfy-gpu-ci/comfy-gpu-ci/test_workspaces/DepthAnythingV3-2043/ComfyUI/custom_nodes/ComfyUI-DepthAnythingV3
[01:19] [ComfyUI]
[01:19] [ComfyUI] WARNING: Potential Error in code: Torch already imported, torch should never be imported before this point.
[01:22] [ComfyUI] Found comfy_kitchen backend triton: {'available': False, 'disabled': True, 'unavailable_reason': "ImportError: No module named 'triton'", 'capabilities': []}
[01:22] [ComfyUI] Found comfy_kitchen backend cuda: {'available': False, 'disabled': True, 'unavailable_reason': 'Extension file not found: /Users/runner/work/comfy-gpu-ci/comfy-gpu-ci/test_workspaces/DepthAnythingV3-2043/venv/lib/python3.11/site-packages/comfy_kitchen/backends/cuda/_C.abi3.so', 'capabilities': []}
[01:22] [ComfyUI] Found comfy_kitchen backend eager: {'available': True, 'disabled': False, 'unavailable_reason': None, 'capabilities': ['apply_rope', 'apply_rope1', 'dequantize_mxfp8', 'dequantize_nvfp4', 'dequantize_per_tensor_fp8', 'quantize_mxfp8', 'quantize_nvfp4', 'quantize_per_tensor_fp8', 'scaled_mm_mxfp8', 'scaled_mm_nvfp4']}
[01:22] [ComfyUI] Checkpoint files will always be loaded safely.
[01:22] [ComfyUI] Total VRAM 7168 MB, total RAM 7168 MB
[01:22] [ComfyUI] pytorch version: 2.11.0
[01:22] [ComfyUI] Mac Version (15, 7, 4)
[01:22] [ComfyUI] Set vram state to: SHARED
[01:22] [ComfyUI] Device: mps
[01:22] [ComfyUI] Using sub quadratic optimization for attention, if you have memory or speed issues try using: --use-split-cross-attention
[01:27] [ComfyUI] objc[2982]: Class AVFFrameReceiver is implemented in both /Users/runner/work/comfy-gpu-ci/comfy-gpu-ci/test_workspaces/DepthAnythingV3-2043/venv/lib/python3.11/site-packages/cv2/.dylibs/libavdevice.61.3.100.dylib (0x112e403a8) and /Users/runner/work/comfy-gpu-ci/comfy-gpu-ci/test_workspaces/DepthAnythingV3-2043/venv/lib/python3.11/site-packages/av/.dylibs/libavdevice.62.1.100.dylib (0x13849c3a8). This may cause spurious casting failures and mysterious crashes. One of the duplicates must be removed or renamed.
[01:27] [ComfyUI] objc[2982]: Class AVFAudioReceiver is implemented in both /Users/runner/work/comfy-gpu-ci/comfy-gpu-ci/test_workspaces/DepthAnythingV3-2043/venv/lib/python3.11/site-packages/cv2/.dylibs/libavdevice.61.3.100.dylib (0x112e403f8) and /Users/runner/work/comfy-gpu-ci/comfy-gpu-ci/test_workspaces/DepthAnythingV3-2043/venv/lib/python3.11/site-packages/av/.dylibs/libavdevice.62.1.100.dylib (0x13849c3f8). This may cause spurious casting failures and mysterious crashes. One of the duplicates must be removed or renamed.
[01:28] [ComfyUI] Python version: 3.11.9 (v3.11.9:de54cf5be3, Apr 2 2024, 07:12:50) [Clang 13.0.0 (clang-1300.0.29.30)]
[01:28] [ComfyUI] ComfyUI version: 0.20.1
[01:28] [ComfyUI] comfy-aimdo version: 0.3.0
[01:28] [ComfyUI] comfy-kitchen version: 0.2.8
[01:28] [ComfyUI] ****** User settings have been changed to be stored on the server instead of browser storage. ******
[01:28] [ComfyUI] ****** For multi-user setups add the --multi-user CLI argument to enable multiple user profiles. ******
[01:28] [ComfyUI] ComfyUI frontend version: 1.43.18
[01:28] [ComfyUI] [Prompt Server] web root: /Users/runner/work/comfy-gpu-ci/comfy-gpu-ci/test_workspaces/DepthAnythingV3-2043/venv/lib/python3.11/site-packages/comfyui_frontend_package/static
[01:28] [ComfyUI] Asset seeder disabled
[01:30] [ComfyUI] [comfy-env] Version: 0.3.80
[01:30] [ComfyUI] [comfy-env] register_nodes: ComfyUI-DepthAnythingV3
[01:30] [ComfyUI] [comfy-env] ComfyUI source dir: /Users/runner/work/comfy-gpu-ci/comfy-gpu-ci/test_workspaces/DepthAnythingV3-2043/ComfyUI
[01:30] [ComfyUI] [comfy-env] Found 1 isolation env(s)
[01:30] [ComfyUI] [comfy-env] Scanning nodes metadata (isolation root)...
[01:30] [ComfyUI] [comfy-env] Metadata scan: /Users/runner/.pixi/bin/pixi run --as-is --manifest-path /Users/runner/work/comfy-gpu-ci/comfy-gpu-ci/test_workspaces/DepthAnythingV3-2043/ComfyUI/.ce/pixi.toml -e depthanythingv3-nodes python /var/folders/tb/y368xp_x10s3ty1b_mtl5mxr0000gn/T/comfy_meta_gi9f5r35.py /Users/runner/work/comfy-gpu-ci/comfy-gpu-ci/test_workspaces/DepthAnythingV3-2043/ComfyUI/custom_nodes/ComfyUI-DepthAnythingV3 nodes
[01:30] [ComfyUI] [comfy-env] Scan env PATH for nodes:
[01:30] [ComfyUI] [comfy-env] [0] /Users/runner/hostedtoolcache/Python/3.11.9/arm64/bin
[01:30] [ComfyUI] [comfy-env] [1] /Users/runner/hostedtoolcache/Python/3.11.9/arm64
[01:30] [ComfyUI] [comfy-env] [2] /opt/homebrew/lib/ruby/gems/3.3.0/bin
[01:30] [ComfyUI] [comfy-env] [3] /opt/homebrew/opt/ruby@3.3/bin
[01:30] [ComfyUI] [comfy-env] [4] /Users/runner/.local/bin
[01:30] [ComfyUI] [comfy-env] [5] /opt/homebrew/bin
[01:30] [ComfyUI] [comfy-env] [6] /opt/homebrew/sbin
[01:30] [ComfyUI] [comfy-env] [7] /Users/runner/.cargo/bin
[01:30] [ComfyUI] [comfy-env] [8] /usr/local/opt/curl/bin
[01:30] [ComfyUI] [comfy-env] [9] /usr/local/bin
[01:30] [ComfyUI] [comfy-env] [10] /usr/local/sbin
[01:30] [ComfyUI] [comfy-env] [11] /Users/runner/bin
[01:30] [ComfyUI] [comfy-env] [12] /Users/runner/.yarn/bin
[01:30] [ComfyUI] [comfy-env] [13] /Users/runner/Library/Android/sdk/tools
[01:30] [ComfyUI] [comfy-env] [14] /Users/runner/Library/Android/sdk/platform-tools
[01:30] [ComfyUI] [comfy-env] [15] /Library/Frameworks/Python.framework/Versions/Current/bin
[01:30] [ComfyUI] [comfy-env] [16] /Library/Frameworks/Mono.framework/Versions/Current/Commands
[01:30] [ComfyUI] [comfy-env] [17] /usr/bin
[01:30] [ComfyUI] [comfy-env] [18] /bin
[01:30] [ComfyUI] [comfy-env] [19] /usr/sbin
[01:30] [ComfyUI] [comfy-env] [20] /sbin
[01:30] [ComfyUI] [comfy-env] [21] /Users/runner/.dotnet/tools
[01:34] [ComfyUI] [comfy-env] Metadata scan stderr for nodes:
[01:34] [ComfyUI] [comfy-env] [meta-scan] importing nodes from /Users/runner/work/comfy-gpu-ci/comfy-gpu-ci/test_workspaces/DepthAnythingV3-2043/ComfyUI/custom_nodes/ComfyUI-DepthAnythingV3
[01:34] [ComfyUI] [comfy-env] ERROR:root:Failed to import comfy_kitchen, Error: No module named 'comfy_kitchen', fp8 and fp4 support will not be available.
[01:34] [ComfyUI] [comfy-env] [meta-scan] import OK
[01:34] [ComfyUI] [comfy-env] Scanned nodes: 15 nodes (4.0s)
[01:34] [ComfyUI] [comfy-env] Scanned nodes root: 15 nodes (4.0s)
[01:34] [ComfyUI] [comfy-env] Imported nodes root: 15 nodes (isolation)
[01:34] [ComfyUI] [comfy-env] Registered 15 total nodes
[01:34] [ComfyUI] loading...
[01:34] [ComfyUI] calling register_nodes
[01:34] [ComfyUI] [comfy-env] Version: 0.3.80
[01:34] [ComfyUI] [comfy-env] register_nodes: ComfyUI-GeometryPack
[01:34] [ComfyUI] [comfy-env] ComfyUI source dir: /Users/runner/work/comfy-gpu-ci/comfy-gpu-ci/test_workspaces/DepthAnythingV3-2043/ComfyUI
[01:34] [ComfyUI] [comfy-env] Found 1 isolation env(s)
[01:34] [ComfyUI] [comfy-env] Scanning nodes metadata (isolation root)...
[01:35] [ComfyUI] [comfy-env] Metadata scan: /Users/runner/.pixi/bin/pixi run --as-is --manifest-path /Users/runner/work/comfy-gpu-ci/comfy-gpu-ci/test_workspaces/DepthAnythingV3-2043/ComfyUI/.ce/pixi.toml -e geometrypack-nodes python /var/folders/tb/y368xp_x10s3ty1b_mtl5mxr0000gn/T/comfy_meta_isvcgi_l.py /Users/runner/work/comfy-gpu-ci/comfy-gpu-ci/test_workspaces/DepthAnythingV3-2043/ComfyUI/custom_nodes/ComfyUI-GeometryPack nodes
[01:35] [ComfyUI] [comfy-env] Scan env PATH for nodes:
[01:35] [ComfyUI] [comfy-env] [0] /Users/runner/hostedtoolcache/Python/3.11.9/arm64/bin
[01:35] [ComfyUI] [comfy-env] [1] /Users/runner/hostedtoolcache/Python/3.11.9/arm64
[01:35] [ComfyUI] [comfy-env] [2] /opt/homebrew/lib/ruby/gems/3.3.0/bin
[01:35] [ComfyUI] [comfy-env] [3] /opt/homebrew/opt/ruby@3.3/bin
[01:35] [ComfyUI] [comfy-env] [4] /Users/runner/.local/bin
[01:35] [ComfyUI] [comfy-env] [5] /opt/homebrew/bin
[01:35] [ComfyUI] [comfy-env] [6] /opt/homebrew/sbin
[01:35] [ComfyUI] [comfy-env] [7] /Users/runner/.cargo/bin
[01:35] [ComfyUI] [comfy-env] [8] /usr/local/opt/curl/bin
[01:35] [ComfyUI] [comfy-env] [9] /usr/local/bin
[01:35] [ComfyUI] [comfy-env] [10] /usr/local/sbin
[01:35] [ComfyUI] [comfy-env] [11] /Users/runner/bin
[01:35] [ComfyUI] [comfy-env] [12] /Users/runner/.yarn/bin
[01:35] [ComfyUI] [comfy-env] [13] /Users/runner/Library/Android/sdk/tools
[01:35] [ComfyUI] [comfy-env] [14] /Users/runner/Library/Android/sdk/platform-tools
[01:35] [ComfyUI] [comfy-env] [15] /Library/Frameworks/Python.framework/Versions/Current/bin
[01:35] [ComfyUI] [comfy-env] [16] /Library/Frameworks/Mono.framework/Versions/Current/Commands
[01:35] [ComfyUI] [comfy-env] [17] /usr/bin
[01:35] [ComfyUI] [comfy-env] [18] /bin
[01:35] [ComfyUI] [comfy-env] [19] /usr/sbin
[01:35] [ComfyUI] [comfy-env] [20] /sbin
[01:35] [ComfyUI] [comfy-env] [21] /Users/runner/.dotnet/tools
[01:42] [ComfyUI] [comfy-env] Metadata scan stderr for nodes:
[01:42] [ComfyUI] [comfy-env] [meta-scan] importing nodes from /Users/runner/work/comfy-gpu-ci/comfy-gpu-ci/test_workspaces/DepthAnythingV3-2043/ComfyUI/custom_nodes/ComfyUI-GeometryPack
[01:42] [ComfyUI] [comfy-env] ERROR:root:Failed to import comfy_kitchen, Error: No module named 'comfy_kitchen', fp8 and fp4 support will not be available.
[01:42] [ComfyUI] [comfy-env] [meta-scan] import OK
[01:42] [ComfyUI] [comfy-env] Scanned nodes: 125 nodes (7.9s)
[01:42] [ComfyUI] [comfy-env] Scanned nodes root: 125 nodes (7.9s)
[01:42] [ComfyUI] [comfy-env] Imported nodes root: 125 nodes (isolation)
[01:42] [ComfyUI] [comfy-env] Registered 125 total nodes
[01:42] [ComfyUI]
[01:42] [ComfyUI] Import times for custom nodes:
[01:42] [ComfyUI] 0.0 seconds: /Users/runner/work/comfy-gpu-ci/comfy-gpu-ci/test_workspaces/DepthAnythingV3-2043/ComfyUI/custom_nodes/websocket_image_save.py
[01:42] [ComfyUI] 0.0 seconds: /Users/runner/work/comfy-gpu-ci/comfy-gpu-ci/test_workspaces/DepthAnythingV3-2043/ComfyUI/custom_nodes/ComfyUI-validate-endpoint
[01:42] [ComfyUI] 0.1 seconds: /Users/runner/work/comfy-gpu-ci/comfy-gpu-ci/test_workspaces/DepthAnythingV3-2043/ComfyUI/custom_nodes/ComfyUI-VideoHelperSuite
[01:42] [ComfyUI] 0.1 seconds: /Users/runner/work/comfy-gpu-ci/comfy-gpu-ci/test_workspaces/DepthAnythingV3-2043/ComfyUI/custom_nodes/ComfyUI-KJNodes
[01:42] [ComfyUI] 4.1 seconds: /Users/runner/work/comfy-gpu-ci/comfy-gpu-ci/test_workspaces/DepthAnythingV3-2043/ComfyUI/custom_nodes/ComfyUI-DepthAnythingV3
[01:42] [ComfyUI] 7.9 seconds: /Users/runner/work/comfy-gpu-ci/comfy-gpu-ci/test_workspaces/DepthAnythingV3-2043/ComfyUI/custom_nodes/ComfyUI-GeometryPack
[01:42] [ComfyUI]
[01:42] [ComfyUI] Context impl SQLiteImpl.
[01:42] [ComfyUI] Will assume non-transactional DDL.
[01:42] [ComfyUI] Context impl SQLiteImpl.
[01:42] [ComfyUI] Will assume non-transactional DDL.
[01:42] [ComfyUI] Running upgrade -> 0001_assets, Initial assets schema
[01:42] [ComfyUI] Revision ID: 0001_assets
[01:42] [ComfyUI] Revises: None
[01:42] [ComfyUI] Create Date: 2025-12-10 00:00:00
[01:42] [ComfyUI] Running upgrade 0001_assets -> 0002_merge_to_asset_references, Merge AssetInfo and AssetCacheState into unified asset_references table.
[01:42] [ComfyUI] Running upgrade 0002_merge_to_asset_references -> 0003_add_metadata_job_id, Add system_metadata and job_id columns to asset_references.
[01:42] [ComfyUI] Change preview_id FK from assets.id to asset_references.id.
[01:42] [ComfyUI] Database upgraded from None to 0003_add_metadata_job_id
[01:43] [ComfyUI] Starting server
[01:43] [ComfyUI]
[01:43] [ComfyUI] To see the GUI go to: http://127.0.0.1:41884
[01:43] Server responding, waiting for nodes to load...
[02:03] Server is ready!
[02:03] Checking for import errors in server logs...
[02:03] No import errors detected
[02:03] Found 1120 registered nodes
[02:03] [REGISTRATION] PASSED
[02:03]
[02:03] [4/5] INSTANTIATION
[02:03] ----------------------------------------
[02:03]
[DEBUG] server=<comfy_test.comfyui.server.ComfyUIServer object at 0x1046aaa90>, server_url=None, api=<comfy_test.comfyui.api.ComfyUIAPI object at 0x1046f5050>
[02:03] Testing node constructors...
[02:05] All 15 node(s) instantiated successfully!
[02:05] [INSTANTIATION] PASSED
[02:05]
[02:05] [5/5] EXECUTION
[02:05] ----------------------------------------
[02:05]
[DEBUG] server=<comfy_test.comfyui.server.ComfyUIServer object at 0x1046aaa90>, server_url=None, api=<comfy_test.comfyui.api.ComfyUIAPI object at 0x1046f5050>
[02:05] CPU runner - will execute 4 workflow(s)
[02:05] Running 7 workflow(s) (all with videos)...
[02:05] Installing screenshot dependencies (playwright, pillow)...
[02:05] Packages installed, downloading chromium browser...
[02:15] Screenshot dependencies installed successfully
[02:16] Starting headless browser...
[02:16] macOS -- using Apple Metal GPU via ANGLE
[02:16] Capturing execution frames: advanced.json
[02:18] [ComfyUI] [DEPRECATION WARNING] Detected import of deprecated legacy API: /extensions/core/widgetInputs.js. This is likely caused by a custom node extension using outdated APIs. Please update your extensions or contact the extension author for an updated version.
[02:23] Frame 1 saved (frame_000.jpg, t=0.0s)
[02:23] Validating workflow...
[02:23] [ComfyUI] === /validate endpoint called ===
[02:23] [ComfyUI] Received JSON with keys: ['prompt']
[02:23] [ComfyUI] Prompt has 11 nodes
[02:23] [ComfyUI] Node 2: LoadImage
[02:23] [ComfyUI] Inputs: {"image": "bridge.jpg"}
[02:23] [ComfyUI] Node 3: DownloadAndLoadDepthAnythingV3Model
[02:23] [ComfyUI] Inputs: {"model": "da3_large.safetensors", "precision": "auto", "attention": "auto"}
[02:23] [ComfyUI] Node 4: PreviewImage
[02:23] [ComfyUI] Inputs: {"images": ["12", 0]}
[02:23] [ComfyUI] Node 6: PreviewImage
[02:23] [ComfyUI] Inputs: {"images": ["12", 1]}
[02:23] [ComfyUI] Node 7: PreviewImage
[02:23] [ComfyUI] Inputs: {"images": ["12", 2]}
[02:23] [ComfyUI] Node 8: PreviewImage
[02:23] [ComfyUI] Inputs: {"images": ["12", 3]}
[02:23] [ComfyUI] Node 9: PreviewAny
[02:23] [ComfyUI] Inputs: {"source": ["12", 6]}
[02:23] [ComfyUI] Node 10: PreviewAny
[02:23] [ComfyUI] Inputs: {"source": ["12", 5]}
[02:23] [ComfyUI] Node 11: MaskPreview
[02:23] [ComfyUI] Inputs: {"mask": ["12", 7]}
[02:23] Queuing workflow for execution...
[02:23] [ComfyUI] Node 12: DepthAnything_V3
[02:23] [ComfyUI] Inputs: {"normalization_mode": "V2-Style", "resize_method": "resize", "invert_depth": false, "keep_model_size": false, "da3_model": ["3", 0], "images": ["2", 0]}
[02:23] [ComfyUI] Node 13: PreviewImage
[02:23] [ComfyUI] Inputs: {"images": ["12", 4]}
[02:23] [ComfyUI] Generated prompt_id: 0dec546b-58d8-4092-9400-51cd4d438a11
[02:23] [ComfyUI] Calling execution.validate_prompt()...
[02:23] [ComfyUI] Validation result: valid=True
[02:23] [ComfyUI] === Validation PASSED ===
[02:23] [ComfyUI] got prompt
[02:23] [ComfyUI] [comfy-env] Running DownloadAndLoadDepthAnythingV3Model: model: 'da3_large.safetensors', precision: 'auto', attention: 'auto'
[02:23] [ComfyUI] [comfy-env] SubprocessWorker: /Users/runner/work/comfy-gpu-ci/comfy-gpu-ci/test_workspaces/DepthAnythingV3-2043/ComfyUI/.ce/.pixi/envs/depthanythingv3-nodes/bin/python
[02:23] [ComfyUI] [comfy-env] env_vars: {'COMFYUI_BASE': '/Users/runner/work/comfy-gpu-ci/comfy-gpu-ci/test_workspaces/DepthAnythingV3-2043/ComfyUI'}
[02:23] [ComfyUI] [SubprocessWorker] call_method: nodes.load_model.DownloadAndLoadDepthAnythingV3Model.EXECUTE_NORMALIZED
[02:23] [ComfyUI] [SubprocessWorker] acquired lock, ensuring started...
[02:23] [ComfyUI] [ComfyUI-DepthAnythingV3] python: /Users/runner/work/comfy-gpu-ci/comfy-gpu-ci/test_workspaces/DepthAnythingV3-2043/ComfyUI/.ce/.pixi/envs/depthanythingv3-nodes/bin/python
[02:23] [ComfyUI] [ComfyUI-DepthAnythingV3] sys_path sent to worker: ['/Users/runner/work/comfy-gpu-ci/comfy-gpu-ci/test_workspaces/DepthAnythingV3-2043/ComfyUI', '/Users/runner/work/comfy-gpu-ci/comfy-gpu-ci/test_workspaces/DepthAnythingV3-2043/ComfyUI/custom_nodes/ComfyUI-DepthAnythingV3', '/Users/runner/work/comfy-gpu-ci/comfy-gpu-ci/test_workspaces/DepthAnythingV3-2043/ComfyUI/.ce/.pixi/envs/depthanythingv3-nodes/lib/python3.11/site-packages', '/Users/runner/work/comfy-gpu-ci/comfy-gpu-ci/test_workspaces/DepthAnythingV3-2043/ComfyUI/custom_nodes/ComfyUI-DepthAnythingV3']
[02:23] [ComfyUI] [SubprocessWorker] is_pixi=True, python=/Users/runner/work/comfy-gpu-ci/comfy-gpu-ci/test_workspaces/DepthAnythingV3-2043/ComfyUI/.ce/.pixi/envs/depthanythingv3-nodes/bin/python
[02:23] [ComfyUI] [SubprocessWorker] launching cmd=['/Users/runner/.pixi/bin/pixi', 'run', '--as-is', '--manifest-path', '/Users/runner/work/comfy-gpu-ci/comfy-gpu-ci/test_workspaces/DepthAnythingV3-2043/ComfyUI/.ce/pixi.toml', '-e', 'depthanythingv3-nodes', 'python', '/var/folders/tb/y368xp_x10s3ty1b_mtl5mxr0000gn/T/comfyui_pvenv_0w3iq8cd/persistent_worker.py', 'unix:///var/folders/tb/y368xp_x10s3ty1b_mtl5mxr0000gn/T/comfy_worker_c710a35bfce1.sock']...
[02:23] [ComfyUI] [SubprocessWorker] socket_addr=unix:///var/folders/tb/y368xp_x10s3ty1b_mtl5mxr0000gn/T/comfy_worker_c710a35bfce1.sock exists=True
[02:25] [ComfyUI] [worker:ComfyUI-DepthAnythingV3] ERROR: Failed to import comfy_kitchen, Error: No module named 'comfy_kitchen', fp8 and fp4 support will not be available.
[02:25] [ComfyUI] [SubprocessWorker] worker started/confirmed
[02:25] [ComfyUI] [SubprocessWorker] serializing kwargs to shm...
[02:25] [ComfyUI] [SubprocessWorker] created 0 shm blocks
[02:25] [ComfyUI] [SubprocessWorker] sending request via socket...
[02:25] [ComfyUI] [SubprocessWorker] call_id=1 sending call_method
[02:26] Frame 2 saved (frame_001.jpg, t=2.2s)
[02:26] [capture-periodic] freeze=2ms shot=94ms unfreeze=2ms saved=True
[02:26] [ComfyUI]
[02:28] [ComfyUI] model.safetensors: 0%| | 0.00/1.64G [00:00<?, ?B/s]
[02:28] [ComfyUI] model.safetensors: 4%|▍ | 67.1M/1.64G [00:01<00:35, 44.1MB/s][SubprocessWorker] callback 'report_progress' from call_id=1
[02:28] [ComfyUI]
[02:28] [ComfyUI] model.safetensors: 16%|█▌ | 256M/1.64G [00:01<00:07, 180MB/s] [SubprocessWorker] callback 'report_progress' from call_id=1
[02:28] Frame 3 saved (frame_002.jpg, t=4.5s)
[02:28] [capture-periodic] freeze=20ms shot=252ms unfreeze=16ms saved=True
[02:29] [ComfyUI] [SubprocessWorker] callback 'report_progress' from call_id=1
[02:29] [capture-loop] iter=50 t=6.1s state={'complete': False, 'error': None, 'executedCount': 0, 'wsState': 1} eval_ms=8 ram=3.8/7.0GB (60%) swap=0.0/0.0GB (0%) cpu=54% browser_rss=0.57GB
[02:30] [ComfyUI]
[02:30] [ComfyUI] model.safetensors: 20%|██ | 335M/1.64G [00:04<00:17, 76.8MB/s][SubprocessWorker] callback 'report_progress' from call_id=1
[02:31] Frame 4 saved (frame_003.jpg, t=6.9s)
[02:31] [capture-periodic] freeze=13ms shot=212ms unfreeze=17ms saved=True
[02:32] [ComfyUI]
[02:32] [ComfyUI] model.safetensors: 65%|██████▌ | 1.07G/1.64G [00:06<00:02, 204MB/s][SubprocessWorker] callback 'report_progress' from call_id=1
[02:33] Frame 5 saved (frame_004.jpg, t=9.4s)
[02:33] [capture-periodic] freeze=18ms shot=202ms unfreeze=13ms saved=True
[02:33] [ComfyUI]
[02:33] [ComfyUI] model.safetensors: 73%|███████▎ | 1.21G/1.64G [00:07<00:02, 199MB/s][SubprocessWorker] callback 'report_progress' from call_id=1
[02:35] Frame 6 saved (frame_005.jpg, t=11.7s)
[02:35] [capture-periodic] freeze=5ms shot=105ms unfreeze=4ms saved=True
[02:35] [ComfyUI]
[02:35] [ComfyUI] model.safetensors: 100%|██████████| 1.64G/1.64G [00:08<00:00, 209MB/s][SubprocessWorker] callback 'report_progress' from call_id=1
[02:35] [ComfyUI]
[02:35] [ComfyUI] model.safetensors: 100%|██████████| 1.64G/1.64G [00:08<00:00, 183MB/s]
[02:35] [ComfyUI] [SubprocessWorker] got response: ok
[02:35] [ComfyUI] [comfy-env] DownloadAndLoadDepthAnythingV3Model done (11.72s): result: NodeOutput
[02:35] [ComfyUI] [comfy-env] Running DepthAnything_V3: normalization_mode: 'V2-Style', resize_method: 'resize', invert_depth: False, keep_model_size: False, da3_model: dict, images: torch.float32 [1,683,1024,3] cpu
[02:35] [ComfyUI] [SubprocessWorker] call_method: nodes.nodes_inference.DepthAnything_V3.EXECUTE_NORMALIZED
[02:35] [ComfyUI] [SubprocessWorker] acquired lock, ensuring started...
[02:35] [ComfyUI] [ComfyUI-DepthAnythingV3] Health check: ping (timeout=5.0s)...
[02:35] [ComfyUI] [ComfyUI-DepthAnythingV3] Health check: ok
[02:35] [ComfyUI] [SubprocessWorker] worker started/confirmed
[02:35] [ComfyUI] [comfy-env] PRE-SERIALIZE 'images' shape: torch.Size([1, 683, 1024, 3])
[02:35] [ComfyUI] [SubprocessWorker] serializing kwargs to shm...
[02:35] [ComfyUI] [SubprocessWorker] created 0 shm blocks
[02:35] [ComfyUI] [SubprocessWorker] sending request via socket...
[02:35] [ComfyUI] [SubprocessWorker] call_id=2 sending call_method
[02:35] [ComfyUI] [worker:ComfyUI-DepthAnythingV3] [comfy-env] _from_shm got dict with keys: ['__type__', 'strategy', 'manager_path', 'storage_key', 'storage_size']
[02:35] [ComfyUI] [worker:ComfyUI-DepthAnythingV3] [comfy-env] DESERIALIZE TensorRef: tensor_size=[1, 683, 1024, 3]
[02:35] [ComfyUI] [worker:ComfyUI-DepthAnythingV3] [comfy-env] DESERIALIZED tensor shape: torch.Size([1, 683, 1024, 3])
[02:36] [ComfyUI] [worker:ComfyUI-DepthAnythingV3] WARNING: No comfy kitchen, using old apply_rope functions.
[02:36] [capture-loop] iter=100 t=13.0s state={'complete': False, 'error': None, 'executedCount': 0, 'wsState': 1} eval_ms=2 ram=3.6/7.0GB (59%) swap=0.0/0.0GB (0%) cpu=74% browser_rss=0.57GB
[02:37] Frame 7 saved (frame_006.jpg, t=13.9s)
[02:37] [capture-periodic] freeze=2ms shot=63ms unfreeze=2ms saved=True
[02:42] [capture-loop] iter=150 t=18.6s state={'complete': False, 'error': None, 'executedCount': 0, 'wsState': 1} eval_ms=2 ram=3.7/7.0GB (62%) swap=0.0/0.0GB (0%) cpu=30% browser_rss=0.57GB
[02:48] [capture-loop] iter=200 t=24.2s state={'complete': False, 'error': None, 'executedCount': 0, 'wsState': 1} eval_ms=4 ram=3.1/7.0GB (70%) swap=0.0/0.0GB (0%) cpu=45% browser_rss=0.36GB
[02:48] [ComfyUI] [SubprocessWorker] callback 'request_vram_budget' from call_id=2
[02:48] [ComfyUI] [comfy-env] VRAM request: 0.82GB, free before eviction: 2.28GB
[02:48] [ComfyUI] [comfy-env] VRAM after eviction: 2.28GB
[02:50] [ComfyUI] [worker:ComfyUI-DepthAnythingV3] WARNING: WARNING: This model does not support sky segmentation. V2-Style normalization will work but without sky masking. Use Mono/Metric/Nested models for best V2-Style results.
[02:53] [capture-loop] iter=250 t=30.2s state={'complete': False, 'error': None, 'executedCount': 0, 'wsState': 1} eval_ms=2 ram=4.4/7.0GB (80%) swap=0.0/0.0GB (0%) cpu=47% browser_rss=0.36GB
[03:09] [capture-loop] iter=300 t=45.3s state={'complete': False, 'error': None, 'executedCount': 0, 'wsState': 1} eval_ms=3 ram=4.4/7.0GB (81%) swap=0.0/0.0GB (0%) cpu=54% browser_rss=0.20GB
[03:24] [ComfyUI] [worker:ComfyUI-DepthAnythingV3]
[03:24] [ComfyUI] === WATCHDOG TICK 1 ===
[03:24] [ComfyUI] [worker:ComfyUI-DepthAnythingV3] Thread 0x000000016d7b3000 (most recent call first):
[03:24] [ComfyUI] File "/Users/runner/work/comfy-gpu-ci/comfy-gpu-ci/test_workspaces/DepthAnythingV3-2043/ComfyUI/.ce/.pixi/envs/depthanythingv3-nodes/lib/python3.11/threading.py", line 331 in wait
[03:24] [ComfyUI] File "/Users/runner/work/comfy-gpu-ci/comfy-gpu-ci/test_workspaces/DepthAnythingV3-2043/ComfyUI/.ce/.pixi/envs/depthanythingv3-nodes/lib/python3.11/threading.py", line 629 in wait
[03:24] [ComfyUI] File "/Users/runner/work/comfy-gpu-ci/comfy-gpu-ci/test_workspaces/DepthAnythingV3-2043/ComfyUI/.ce/.pixi/envs/depthanythingv3-nodes/lib/python3.11/site-packages/tqdm/_monitor.py", line 60 in run
[03:24] [ComfyUI] File "/Users/runner/work/comfy-gpu-ci/comfy-gpu-ci/test_workspaces/DepthAnythingV3-2043/ComfyUI/.ce/.pixi/envs/depthanythingv3-nodes/lib/python3.11/threading.py", line 1045 in _bootstrap_inner
[03:24] [ComfyUI] File "/Users/runner/work/comfy-gpu-ci/comfy-gpu-ci/test_workspaces/DepthAnythingV3-2043/ComfyUI/.ce/.pixi/envs/depthanythingv3-nodes/lib/python3.11/threading.py", line 1002 in _bootstrap
[03:24] [ComfyUI]
[03:24] [ComfyUI] Current thread 0x000000016c483000 (most recent call first):
[03:24] [ComfyUI] File "/var/folders/tb/y368xp_x10s3ty1b_mtl5mxr0000gn/T/comfyui_pvenv_0w3iq8cd/persistent_worker.py", line 52 in _watchdog
[03:24] [ComfyUI] File "/Users/runner/work/comfy-gpu-ci/comfy-gpu-ci/test_workspaces/DepthAnythingV3-2043/ComfyUI/.ce/.pixi/envs/depthanythingv3-nodes/lib/python3.11/threading.py", line 982 in run
[03:24] [ComfyUI] File "/Users/runner/work/comfy-gpu-ci/comfy-gpu-ci/test_workspaces/DepthAnythingV3-2043/ComfyUI/.ce/.pixi/envs/depthanythingv3-nodes/lib/python3.11/threading.py", line 1045 in _bootstrap_inner
[03:24] [ComfyUI] File "/Users/runner/work/comfy-gpu-ci/comfy-gpu-ci/test_workspaces/DepthAnythingV3-2043/ComfyUI/.ce/.pixi/envs/depthanythingv3-nodes/lib/python3.11/threading.py", line 1002 in _bootstrap
[03:24] [ComfyUI]
[03:24] [ComfyUI] Thread 0x000000020ddc2240 (most recent call first):
[03:24] [ComfyUI] File "/Users/runner/work/comfy-gpu-ci/comfy-gpu-ci/test_workspaces/DepthAnythingV3-2043/ComfyUI/custom_nodes/ComfyUI-DepthAnythingV3/nodes/depth_anything_v3/model.py", line 338 in forward
[03:24] [ComfyUI] File "/Users/runner/work/comfy-gpu-ci/comfy-gpu-ci/test_workspaces/DepthAnythingV3-2043/ComfyUI/.ce/.pixi/envs/depthanythingv3-nodes/lib/python3.11/site-packages/torch/nn/modules/module.py", line 1790 in _call_impl
[03:24] [ComfyUI] File "/Users/runner/work/comfy-gpu-ci/comfy-gpu-ci/test_workspaces/DepthAnythingV3-2043/ComfyUI/.ce/.pixi/envs/depthanythingv3-nodes/lib/python3.11/site-packages/torch/nn/modules/module.py", line 1779 in _wrapped_call_impl
[03:24] [ComfyUI] File "/Users/runner/work/comfy-gpu-ci/comfy-gpu-ci/test_workspaces/DepthAnythingV3-2043/ComfyUI/custom_nodes/ComfyUI-DepthAnythingV3/nodes/depth_anything_v3/model.py", line 445 in forward
[03:24] [ComfyUI] File "/Users/runner/work/comfy-gpu-ci/comfy-gpu-ci/test_workspaces/DepthAnythingV3-2043/ComfyUI/.ce/.pixi/envs/depthanythingv3-nodes/lib/python3.11/site-packages/torch/nn/modules/module.py", line 1790 in _call_impl
[03:24] [ComfyUI] File "/Users/runner/work/comfy-gpu-ci/comfy-gpu-ci/test_workspaces/DepthAnythingV3-2043/ComfyUI/.ce/.pixi/envs/depthanythingv3-nodes/lib/python3.11/site-packages/torch/nn/modules/module.py", line 1779 in _wrapped_call_impl
[03:24] [ComfyUI] File "/Users/runner/work/comfy-gpu-ci/comfy-gpu-ci/test_workspaces/DepthAnythingV3-2043/ComfyUI/custom_nodes/ComfyUI-DepthAnythingV3/nodes/depth_anything_v3/model.py", line 516 in attn_residual_func
[03:24] [ComfyUI] File "/Users/runner/work/comfy-gpu-ci/comfy-gpu-ci/test_workspaces/DepthAnythingV3-2043/ComfyUI/custom_nodes/ComfyUI-DepthAnythingV3/nodes/depth_anything_v3/model.py", line 521 in forward
[03:24] [ComfyUI] File "/Users/runner/work/comfy-gpu-ci/comfy-gpu-ci/test_workspaces/DepthAnythingV3-2043/ComfyUI/.ce/.pixi/envs/depthanythingv3-nodes/lib/python3.11/site-packages/torch/nn/modules/module.py", line 1790 in _call_impl
[03:24] [ComfyUI] File "/Users/runner/work/comfy-gpu-ci/comfy-gpu-ci/test_workspaces/DepthAnythingV3-2043/ComfyUI/.ce/.pixi/envs/depthanythingv3-nodes/lib/python3.11/site-packages/torch/nn/modules/module.py", line 1779 in _wrapped_call_impl
[03:24] [ComfyUI] File "/Users/runner/work/comfy-gpu-ci/comfy-gpu-ci/test_workspaces/DepthAnythingV3-2043/ComfyUI/custom_nodes/ComfyUI-DepthAnythingV3/nodes/depth_anything_v3/model.py", line 791 in process_attention
[03:24] [ComfyUI] File "/Users/runner/work/comfy-gpu-ci/comfy-gpu-ci/test_workspaces/DepthAnythingV3-2043/ComfyUI/custom_nodes/ComfyUI-DepthAnythingV3/nodes/depth_anything_v3/model.py", line 741 in _get_intermediate_layers_not_chunked
[03:24] [ComfyUI] File "/Users/runner/work/comfy-gpu-ci/comfy-gpu-ci/test_workspaces/DepthAnythingV3-2043/ComfyUI/custom_nodes/ComfyUI-DepthAnythingV3/nodes/depth_anything_v3/model.py", line 800 in get_intermediate_layers
[03:24] [ComfyUI] File "/Users/runner/work/comfy-gpu-ci/comfy-gpu-ci/test_workspaces/DepthAnythingV3-2043/ComfyUI/custom_nodes/ComfyUI-DepthAnythingV3/nodes/depth_anything_v3/model.py", line 891 in forward
[03:24] [ComfyUI] File "/Users/runner/work/comfy-gpu-ci/comfy-gpu-ci/test_workspaces/DepthAnythingV3-2043/ComfyUI/.ce/.pixi/envs/depthanythingv3-nodes/lib/python3.11/site-packages/torch/nn/modules/module.py", line 1790 in _call_impl
[03:24] [ComfyUI] File "/Users/runner/work/comfy-gpu-ci/comfy-gpu-ci/test_workspaces/DepthAnythingV3-2043/ComfyUI/.ce/.pixi/envs/depthanythingv3-nodes/lib/python3.11/site-packages/torch/nn/modules/module.py", line 1779 in _wrapped_call_impl
[03:24] [ComfyUI] File "/Users/runner/work/comfy-gpu-ci/comfy-gpu-ci/test_workspaces/DepthAnythingV3-2043/ComfyUI/custom_nodes/ComfyUI-DepthAnythingV3/nodes/depth_anything_v3/model.py", line 1560 in forward
[03:24] [ComfyUI] File "/Users/runner/work/comfy-gpu-ci/comfy-gpu-ci/test_workspaces/DepthAnythingV3-2043/ComfyUI/.ce/.pixi/envs/depthanythingv3-nodes/lib/python3.11/site-packages/torch/nn/modules/module.py", line 1790 in _call_impl
[03:24] [ComfyUI] File "/Users/runner/work/comfy-gpu-ci/comfy-gpu-ci/test_workspaces/DepthAnythingV3-2043/ComfyUI/.ce/.pixi/envs/depthanythingv3-nodes/lib/python3.11/site-packages/torch/nn/modules/module.py", line 1779 in _wrapped_call_impl
[03:24] [ComfyUI] File "/Users/runner/work/comfy-gpu-ci/comfy-gpu-ci/test_workspaces/DepthAnythingV3-2043/ComfyUI/custom_nodes/ComfyUI-DepthAnythingV3/nodes/nodes_inference.py", line 156 in execute
[03:24] [ComfyUI] File "/Users/runner/work/comfy-gpu-ci/comfy-gpu-ci/test_workspaces/DepthAnythingV3-2043/ComfyUI/comfy_api/latest/_io.py", line 1833 in EXECUTE_NORMALIZED
[03:24] [ComfyUI] File "/var/folders/tb/y368xp_x10s3ty1b_mtl5mxr0000gn/T/comfyui_pvenv_0w3iq8cd/persistent_worker.py", line 1762 in main
[03:24] [ComfyUI] File "/var/folders/tb/y368xp_x10s3ty1b_mtl5mxr0000gn/T/comfyui_pvenv_0w3iq8cd/persistent_worker.py", line 1807 in <module>
[03:24] [ComfyUI]
[03:24] [ComfyUI] [worker:ComfyUI-DepthAnythingV3] === END ===
[03:24] [ComfyUI]
[04:03] Frame 8 saved (frame_007.jpg, t=49.9s)
[04:03] [capture-periodic] freeze=2ms shot=49365ms unfreeze=12ms saved=True
[04:04] [capture-loop] iter=350 t=100.9s state={'complete': False, 'error': None, 'executedCount': 0, 'wsState': 1} eval_ms=4 ram=4.0/7.0GB (85%) swap=0.0/0.0GB (0%) cpu=60% browser_rss=0.19GB
[04:10] [capture-loop] iter=400 t=106.6s state={'complete': False, 'error': None, 'executedCount': 0, 'wsState': 1} eval_ms=3 ram=4.0/7.0GB (85%) swap=0.0/0.0GB (0%) cpu=55% browser_rss=0.21GB
[04:16] [capture-loop] iter=450 t=112.3s state={'complete': False, 'error': None, 'executedCount': 0, 'wsState': 1} eval_ms=2 ram=4.9/7.0GB (87%) swap=0.0/0.0GB (0%) cpu=74% browser_rss=0.19GB
[04:21] [capture-loop] iter=500 t=117.7s state={'complete': False, 'error': None, 'executedCount': 0, 'wsState': 1} eval_ms=2 ram=4.9/7.0GB (88%) swap=0.0/0.0GB (0%) cpu=80% browser_rss=0.18GB
[04:24] [ComfyUI] [worker:ComfyUI-DepthAnythingV3]
[04:24] [ComfyUI] === WATCHDOG TICK 2 ===
[04:24] [ComfyUI] [worker:ComfyUI-DepthAnythingV3] Thread 0x000000016d7b3000 (most recent call first):
[04:24] [ComfyUI] File "/Users/runner/work/comfy-gpu-ci/comfy-gpu-ci/test_workspaces/DepthAnythingV3-2043/ComfyUI/.ce/.pixi/envs/depthanythingv3-nodes/lib/python3.11/threading.py", line 331 in wait
[04:24] [ComfyUI] File "/Users/runner/work/comfy-gpu-ci/comfy-gpu-ci/test_workspaces/DepthAnythingV3-2043/ComfyUI/.ce/.pixi/envs/depthanythingv3-nodes/lib/python3.11/threading.py", line 629 in wait
[04:24] [ComfyUI] File "/Users/runner/work/comfy-gpu-ci/comfy-gpu-ci/test_workspaces/DepthAnythingV3-2043/ComfyUI/.ce/.pixi/envs/depthanythingv3-nodes/lib/python3.11/site-packages/tqdm/_monitor.py", line 60 in run
[04:24] [ComfyUI] File "/Users/runner/work/comfy-gpu-ci/comfy-gpu-ci/test_workspaces/DepthAnythingV3-2043/ComfyUI/.ce/.pixi/envs/depthanythingv3-nodes/lib/python3.11/threading.py", line 1045 in _bootstrap_inner
[04:24] [ComfyUI] File "/Users/runner/work/comfy-gpu-ci/comfy-gpu-ci/test_workspaces/DepthAnythingV3-2043/ComfyUI/.ce/.pixi/envs/depthanythingv3-nodes/lib/python3.11/threading.py", line 1002 in _bootstrap
[04:24] [ComfyUI]
[04:24] [ComfyUI] Current thread 0x000000016c483000 (most recent call first):
[04:24] [ComfyUI] File "/var/folders/tb/y368xp_x10s3ty1b_mtl5mxr0000gn/T/comfyui_pvenv_0w3iq8cd/persistent_worker.py", line 52 in _watchdog
[04:24] [ComfyUI] File "/Users/runner/work/comfy-gpu-ci/comfy-gpu-ci/test_workspaces/DepthAnythingV3-2043/ComfyUI/.ce/.pixi/envs/depthanythingv3-nodes/lib/python3.11/threading.py", line 982 in run
[04:24] [ComfyUI] File "/Users/runner/work/comfy-gpu-ci/comfy-gpu-ci/test_workspaces/DepthAnythingV3-2043/ComfyUI/.ce/.pixi/envs/depthanythingv3-nodes/lib/python3.11/threading.py", line 1045 in _bootstrap_inner
[04:24] [ComfyUI] File "/Users/runner/work/comfy-gpu-ci/comfy-gpu-ci/test_workspaces/DepthAnythingV3-2043/ComfyUI/.ce/.pixi/envs/depthanythingv3-nodes/lib/python3.11/threading.py", line 1002 in _bootstrap
[04:24] [ComfyUI]
[04:24] [ComfyUI] Thread 0x000000020ddc2240 (most recent call first):
[04:24] [ComfyUI] File "/Users/runner/work/comfy-gpu-ci/comfy-gpu-ci/test_workspaces/DepthAnythingV3-2043/ComfyUI/.ce/.pixi/envs/depthanythingv3-nodes/lib/python3.11/site-packages/torch/nn/modules/conv.py", line 548 in _conv_forward
[04:24] [ComfyUI] File "/Users/runner/work/comfy-gpu-ci/comfy-gpu-ci/test_workspaces/DepthAnythingV3-2043/ComfyUI/comfy/ops.py", line 509 in forward_comfy_cast_weights
[04:24] [ComfyUI] File "/Users/runner/work/comfy-gpu-ci/comfy-gpu-ci/test_workspaces/DepthAnythingV3-2043/ComfyUI/comfy/ops.py", line 516 in forward
[04:24] [ComfyUI] File "/Users/runner/work/comfy-gpu-ci/comfy-gpu-ci/test_workspaces/DepthAnythingV3-2043/ComfyUI/.ce/.pixi/envs/depthanythingv3-nodes/lib/python3.11/site-packages/torch/nn/modules/module.py", line 1790 in _call_impl
[04:24] [ComfyUI] File "/Users/runner/work/comfy-gpu-ci/comfy-gpu-ci/test_workspaces/DepthAnythingV3-2043/ComfyUI/.ce/.pixi/envs/depthanythingv3-nodes/lib/python3.11/site-packages/torch/nn/modules/module.py", line 1779 in _wrapped_call_impl
[04:24] [ComfyUI] File "/Users/runner/work/comfy-gpu-ci/comfy-gpu-ci/test_workspaces/DepthAnythingV3-2043/ComfyUI/custom_nodes/ComfyUI-DepthAnythingV3/nodes/depth_anything_v3/model.py", line 1399 in _forward_impl
[04:24] [ComfyUI] File "/Users/runner/work/comfy-gpu-ci/comfy-gpu-ci/test_workspaces/DepthAnythingV3-2043/ComfyUI/custom_nodes/ComfyUI-DepthAnythingV3/nodes/depth_anything_v3/model.py", line 1366 in forward
[04:24] [ComfyUI] File "/Users/runner/work/comfy-gpu-ci/comfy-gpu-ci/test_workspaces/DepthAnythingV3-2043/ComfyUI/.ce/.pixi/envs/depthanythingv3-nodes/lib/python3.11/site-packages/torch/nn/modules/module.py", line 1790 in _call_impl
[04:24] [ComfyUI] File "/Users/runner/work/comfy-gpu-ci/comfy-gpu-ci/test_workspaces/DepthAnythingV3-2043/ComfyUI/.ce/.pixi/envs/depthanythingv3-nodes/lib/python3.11/site-packages/torch/nn/modules/module.py", line 1779 in _wrapped_call_impl
[04:24] [ComfyUI] File "/Users/runner/work/comfy-gpu-ci/comfy-gpu-ci/test_workspaces/DepthAnythingV3-2043/ComfyUI/custom_nodes/ComfyUI-DepthAnythingV3/nodes/depth_anything_v3/model.py", line 1591 in _process_depth_head
[04:24] [ComfyUI] File "/Users/runner/work/comfy-gpu-ci/comfy-gpu-ci/test_workspaces/DepthAnythingV3-2043/ComfyUI/custom_nodes/ComfyUI-DepthAnythingV3/nodes/depth_anything_v3/model.py", line 1577 in forward
[04:24] [ComfyUI] File "/Users/runner/work/comfy-gpu-ci/comfy-gpu-ci/test_workspaces/DepthAnythingV3-2043/ComfyUI/.ce/.pixi/envs/depthanythingv3-nodes/lib/python3.11/site-packages/torch/nn/modules/module.py", line 1790 in _call_impl
[04:24] [ComfyUI] File "/Users/runner/work/comfy-gpu-ci/comfy-gpu-ci/test_workspaces/DepthAnythingV3-2043/ComfyUI/.ce/.pixi/envs/depthanythingv3-nodes/lib/python3.11/site-packages/torch/nn/modules/module.py", line 1779 in _wrapped_call_impl
[04:24] [ComfyUI] File "/Users/runner/work/comfy-gpu-ci/comfy-gpu-ci/test_workspaces/DepthAnythingV3-2043/ComfyUI/custom_nodes/ComfyUI-DepthAnythingV3/nodes/nodes_inference.py", line 156 in execute
[04:24] [ComfyUI] File "/Users/runner/work/comfy-gpu-ci/comfy-gpu-ci/test_workspaces/DepthAnythingV3-2043/ComfyUI/comfy_api/latest/_io.py", line 1833 in EXECUTE_NORMALIZED
[04:24] [ComfyUI] File "/var/folders/tb/y368xp_x10s3ty1b_mtl5mxr0000gn/T/comfyui_pvenv_0w3iq8cd/persistent_worker.py", line 1762 in main
[04:24] [ComfyUI] File "/var/folders/tb/y368xp_x10s3ty1b_mtl5mxr0000gn/T/comfyui_pvenv_0w3iq8cd/persistent_worker.py", line 1807 in <module>
[04:24] [ComfyUI]
[04:24] [ComfyUI] [worker:ComfyUI-DepthAnythingV3] === END ===
[04:24] [ComfyUI]
[04:27] [capture-loop] iter=550 t=123.3s state={'complete': False, 'error': None, 'executedCount': 0, 'wsState': 1} eval_ms=3 ram=4.9/7.0GB (88%) swap=0.0/0.0GB (0%) cpu=57% browser_rss=0.20GB
[04:34] [capture-loop] iter=600 t=131.2s state={'complete': False, 'error': None, 'executedCount': 0, 'wsState': 1} eval_ms=2 ram=4.6/7.0GB (90%) swap=0.6/1.0GB (58%) cpu=64% browser_rss=0.16GB
[04:40] [capture-loop] iter=650 t=136.7s state={'complete': False, 'error': None, 'executedCount': 0, 'wsState': 1} eval_ms=2 ram=4.6/7.0GB (91%) swap=0.6/1.0GB (57%) cpu=56% browser_rss=0.16GB
[04:48] [capture-loop] iter=700 t=145.0s state={'complete': False, 'error': None, 'executedCount': 0, 'wsState': 1} eval_ms=2 ram=4.6/7.0GB (91%) swap=0.6/1.0GB (59%) cpu=54% browser_rss=0.16GB
[04:55] [capture-loop] iter=750 t=152.1s state={'complete': False, 'error': None, 'executedCount': 0, 'wsState': 1} eval_ms=2 ram=4.6/7.0GB (90%) swap=0.6/1.0GB (58%) cpu=57% browser_rss=0.17GB
[05:01] [capture-loop] iter=800 t=157.9s state={'complete': False, 'error': None, 'executedCount': 0, 'wsState': 1} eval_ms=4 ram=4.6/7.0GB (91%) swap=0.6/1.0GB (57%) cpu=52% browser_rss=0.16GB
[05:07] [capture-loop] iter=850 t=163.4s state={'complete': False, 'error': None, 'executedCount': 0, 'wsState': 1} eval_ms=2 ram=4.6/7.0GB (91%) swap=0.6/1.0GB (56%) cpu=45% browser_rss=0.16GB
[05:12] [capture-loop] iter=900 t=169.1s state={'complete': False, 'error': None, 'executedCount': 0, 'wsState': 1} eval_ms=2 ram=4.6/7.0GB (91%) swap=0.6/1.0GB (56%) cpu=39% browser_rss=0.16GB
[05:20] [capture-loop] iter=950 t=177.0s state={'complete': False, 'error': None, 'executedCount': 0, 'wsState': 1} eval_ms=2 ram=4.6/7.0GB (91%) swap=0.6/1.0GB (58%) cpu=51% browser_rss=0.16GB
[05:24] [ComfyUI] [worker:ComfyUI-DepthAnythingV3]
[05:24] [ComfyUI] === WATCHDOG TICK 3 ===
[05:24] [ComfyUI] [worker:ComfyUI-DepthAnythingV3] Thread 0x000000016d7b3000 (most recent call first):
[05:24] [ComfyUI] File "/Users/runner/work/comfy-gpu-ci/comfy-gpu-ci/test_workspaces/DepthAnythingV3-2043/ComfyUI/.ce/.pixi/envs/depthanythingv3-nodes/lib/python3.11/threading.py", line 331 in wait
[05:24] [ComfyUI] File "/Users/runner/work/comfy-gpu-ci/comfy-gpu-ci/test_workspaces/DepthAnythingV3-2043/ComfyUI/.ce/.pixi/envs/depthanythingv3-nodes/lib/python3.11/threading.py", line 629 in wait
[05:24] [ComfyUI] File "/Users/runner/work/comfy-gpu-ci/comfy-gpu-ci/test_workspaces/DepthAnythingV3-2043/ComfyUI/.ce/.pixi/envs/depthanythingv3-nodes/lib/python3.11/site-packages/tqdm/_monitor.py", line 60 in run
[05:24] [ComfyUI] File "/Users/runner/work/comfy-gpu-ci/comfy-gpu-ci/test_workspaces/DepthAnythingV3-2043/ComfyUI/.ce/.pixi/envs/depthanythingv3-nodes/lib/python3.11/threading.py", line 1045 in _bootstrap_inner
[05:24] [ComfyUI] File "/Users/runner/work/comfy-gpu-ci/comfy-gpu-ci/test_workspaces/DepthAnythingV3-2043/ComfyUI/.ce/.pixi/envs/depthanythingv3-nodes/lib/python3.11/threading.py", line 1002 in _bootstrap
[05:24] [ComfyUI]
[05:24] [ComfyUI] Current thread 0x000000016c483000 (most recent call first):
[05:24] [ComfyUI] File "/var/folders/tb/y368xp_x10s3ty1b_mtl5mxr0000gn/T/comfyui_pvenv_0w3iq8cd/persistent_worker.py", line 52 in _watchdog
[05:24] [ComfyUI] File "/Users/runner/work/comfy-gpu-ci/comfy-gpu-ci/test_workspaces/DepthAnythingV3-2043/ComfyUI/.ce/.pixi/envs/depthanythingv3-nodes/lib/python3.11/threading.py", line 982 in run
[05:24] [ComfyUI] File "/Users/runner/work/comfy-gpu-ci/comfy-gpu-ci/test_workspaces/DepthAnythingV3-2043/ComfyUI/.ce/.pixi/envs/depthanythingv3-nodes/lib/python3.11/threading.py", line 1045 in _bootstrap_inner
[05:24] [ComfyUI] File "/Users/runner/work/comfy-gpu-ci/comfy-gpu-ci/test_workspaces/DepthAnythingV3-2043/ComfyUI/.ce/.pixi/envs/depthanythingv3-nodes/lib/python3.11/threading.py", line 1002 in _bootstrap
[05:24] [ComfyUI]
[05:24] [ComfyUI] Thread 0x000000020ddc2240 (most recent call first):
[05:24] [ComfyUI] File "/Users/runner/work/comfy-gpu-ci/comfy-gpu-ci/test_workspaces/DepthAnythingV3-2043/ComfyUI/comfy/ops.py", line 357 in cast_bias_weight
[05:24] [ComfyUI] File "/Users/runner/work/comfy-gpu-ci/comfy-gpu-ci/test_workspaces/DepthAnythingV3-2043/ComfyUI/comfy/ops.py", line 508 in forward_comfy_cast_weights
[05:24] [ComfyUI] File "/Users/runner/work/comfy-gpu-ci/comfy-gpu-ci/test_workspaces/DepthAnythingV3-2043/ComfyUI/comfy/ops.py", line 516 in forward
[05:24] [ComfyUI] File "/Users/runner/work/comfy-gpu-ci/comfy-gpu-ci/test_workspaces/DepthAnythingV3-2043/ComfyUI/.ce/.pixi/envs/depthanythingv3-nodes/lib/python3.11/site-packages/torch/nn/modules/module.py", line 1790 in _call_impl
[05:24] [ComfyUI] File "/Users/runner/work/comfy-gpu-ci/comfy-gpu-ci/test_workspaces/DepthAnythingV3-2043/ComfyUI/.ce/.pixi/envs/depthanythingv3-nodes/lib/python3.11/site-packages/torch/nn/modules/module.py", line 1779 in _wrapped_call_impl
[05:24] [ComfyUI] File "/Users/runner/work/comfy-gpu-ci/comfy-gpu-ci/test_workspaces/DepthAnythingV3-2043/ComfyUI/.ce/.pixi/envs/depthanythingv3-nodes/lib/python3.11/site-packages/torch/nn/modules/container.py", line 253 in forward
[05:24] [ComfyUI] File "/Users/runner/work/comfy-gpu-ci/comfy-gpu-ci/test_workspaces/DepthAnythingV3-2043/ComfyUI/.ce/.pixi/envs/depthanythingv3-nodes/lib/python3.11/site-packages/torch/nn/modules/module.py", line 1790 in _call_impl
[05:24] [ComfyUI] File "/Users/runner/work/comfy-gpu-ci/comfy-gpu-ci/test_workspaces/DepthAnythingV3-2043/ComfyUI/.ce/.pixi/envs/depthanythingv3-nodes/lib/python3.11/site-packages/torch/nn/modules/module.py", line 1779 in _wrapped_call_impl
[05:24] [ComfyUI] File "/Users/runner/work/comfy-gpu-ci/comfy-gpu-ci/test_workspaces/DepthAnythingV3-2043/ComfyUI/custom_nodes/ComfyUI-DepthAnythingV3/nodes/depth_anything_v3/model.py", line 1421 in _forward_impl
[05:24] [ComfyUI] File "/Users/runner/work/comfy-gpu-ci/comfy-gpu-ci/test_workspaces/DepthAnythingV3-2043/ComfyUI/custom_nodes/ComfyUI-DepthAnythingV3/nodes/depth_anything_v3/model.py", line 1366 in forward
[05:24] [ComfyUI] File "/Users/runner/work/comfy-gpu-ci/comfy-gpu-ci/test_workspaces/DepthAnythingV3-2043/ComfyUI/.ce/.pixi/envs/depthanythingv3-nodes/lib/python3.11/site-packages/torch/nn/modules/module.py", line 1790 in _call_impl
[05:24] [ComfyUI] File "/Users/runner/work/comfy-gpu-ci/comfy-gpu-ci/test_workspaces/DepthAnythingV3-2043/ComfyUI/.ce/.pixi/envs/depthanythingv3-nodes/lib/python3.11/site-packages/torch/nn/modules/module.py", line 1779 in _wrapped_call_impl
[05:24] [ComfyUI] File "/Users/runner/work/comfy-gpu-ci/comfy-gpu-ci/test_workspaces/DepthAnythingV3-2043/ComfyUI/custom_nodes/ComfyUI-DepthAnythingV3/nodes/depth_anything_v3/model.py", line 1591 in _process_depth_head
[05:24] [ComfyUI] File "/Users/runner/work/comfy-gpu-ci/comfy-gpu-ci/test_workspaces/DepthAnythingV3-2043/ComfyUI/custom_nodes/ComfyUI-DepthAnythingV3/nodes/depth_anything_v3/model.py", line 1577 in forward
[05:24] [ComfyUI] File "/Users/runner/work/comfy-gpu-ci/comfy-gpu-ci/test_workspaces/DepthAnythingV3-2043/ComfyUI/.ce/.pixi/envs/depthanythingv3-nodes/lib/python3.11/site-packages/torch/nn/modules/module.py", line 1790 in _call_impl
[05:24] [ComfyUI] File "/Users/runner/work/comfy-gpu-ci/comfy-gpu-ci/test_workspaces/DepthAnythingV3-2043/ComfyUI/.ce/.pixi/envs/depthanythingv3-nodes/lib/python3.11/site-packages/torch/nn/modules/module.py", line 1779 in _wrapped_call_impl
[05:24] [ComfyUI] File "/Users/runner/work/comfy-gpu-ci/comfy-gpu-ci/test_workspaces/DepthAnythingV3-2043/ComfyUI/custom_nodes/ComfyUI-DepthAnythingV3/nodes/nodes_inference.py", line 156 in execute
[05:24] [ComfyUI] File "/Users/runner/work/comfy-gpu-ci/comfy-gpu-ci/test_workspaces/DepthAnythingV3-2043/ComfyUI/comfy_api/latest/_io.py", line 1833 in EXECUTE_NORMALIZED
[05:24] [ComfyUI] File "/var/folders/tb/y368xp_x10s3ty1b_mtl5mxr0000gn/T/comfyui_pvenv_0w3iq8cd/persistent_worker.py", line 1762 in main
[05:24] [ComfyUI] File "/var/folders/tb/y368xp_x10s3ty1b_mtl5mxr0000gn/T/comfyui_pvenv_0w3iq8cd/persistent_worker.py", line 1807 in <module>
[05:24] [ComfyUI]
[05:24] [ComfyUI] [worker:ComfyUI-DepthAnythingV3] === END ===
[05:24] [ComfyUI]
[05:27] [capture-loop] iter=1000 t=183.3s state={'complete': False, 'error': None, 'executedCount': 0, 'wsState': 1} eval_ms=2 ram=4.6/7.0GB (91%) swap=0.6/1.0GB (58%) cpu=50% browser_rss=0.17GB
[05:35] [capture-loop] iter=1050 t=191.3s state={'complete': False, 'error': None, 'executedCount': 0, 'wsState': 1} eval_ms=2 ram=4.6/7.0GB (91%) swap=0.6/1.0GB (57%) cpu=47% browser_rss=0.17GB
[05:44] [capture-loop] iter=1100 t=200.9s state={'complete': False, 'error': None, 'executedCount': 0, 'wsState': 1} eval_ms=2 ram=4.6/7.0GB (91%) swap=0.6/1.0GB (59%) cpu=47% browser_rss=0.17GB
[05:53] [capture-loop] iter=1150 t=209.8s state={'complete': False, 'error': None, 'executedCount': 0, 'wsState': 1} eval_ms=2 ram=4.6/7.0GB (91%) swap=0.6/1.0GB (58%) cpu=50% browser_rss=0.17GB
[06:00] [capture-loop] iter=1200 t=217.0s state={'complete': False, 'error': None, 'executedCount': 0, 'wsState': 1} eval_ms=2 ram=4.6/7.0GB (90%) swap=0.6/1.0GB (58%) cpu=48% browser_rss=0.17GB
[06:07] [capture-loop] iter=1250 t=223.4s state={'complete': False, 'error': None, 'executedCount': 0, 'wsState': 1} eval_ms=2 ram=3.1/7.0GB (70%) swap=0.6/1.0GB (57%) cpu=52% browser_rss=0.16GB
[06:08] [ComfyUI] /AppleInternal/Library/BuildRoots/4~B5vFugBcKzdCtMw80UR1WFCTSITbUVQOwkJg1SQ/Library/Caches/com.apple.xbs/Sources/MetalPerformanceShaders/MPSCore/Utility/MPSLibrary.mm:579: failed assertion `MPSKernel MTLComputePipelineStateCache unable to load function ndArrayIdentity.
[06:08] [ComfyUI] Compilation failed: (null)
[06:08] [ComfyUI] '
[06:08] [ComfyUI] /Users/runner/work/comfy-gpu-ci/comfy-gpu-ci/test_workspaces/DepthAnythingV3-2043/ComfyUI/.ce/.pixi/envs/depthanythingv3-nodes/lib/python3.11/multiprocessing/resource_tracker.py:254: UserWarning: resource_tracker: There appear to be 1 leaked semaphore objects to clean up at shutdown
[06:08] [ComfyUI] warnings.warn('resource_tracker: There appear to be %d '
[06:09] [ComfyUI] !!! Exception during processing !!! ComfyUI-DepthAnythingV3: Socket closed but worker process still running.
[06:09] [ComfyUI] exit code: None
[06:09] [ComfyUI] worker log (/var/folders/tb/y368xp_x10s3ty1b_mtl5mxr0000gn/T/comfy_worker_debug.log, last 20 lines):
[06:09] [ComfyUI] File "/Users/runner/work/comfy-gpu-ci/comfy-gpu-ci/test_workspaces/DepthAnythingV3-2043/ComfyUI/comfy/ops.py", line 516 in forward
[06:09] [ComfyUI] File "/Users/runner/work/comfy-gpu-ci/comfy-gpu-ci/test_workspaces/DepthAnythingV3-2043/ComfyUI/.ce/.pixi/envs/depthanythingv3-nodes/lib/python3.11/site-packages/torch/nn/modules/module.py", line 1790 in _call_impl
[06:09] [ComfyUI] File "/Users/runner/work/comfy-gpu-ci/comfy-gpu-ci/test_workspaces/DepthAnythingV3-2043/ComfyUI/.ce/.pixi/envs/depthanythingv3-nodes/lib/python3.11/site-packages/torch/nn/modules/module.py", line 1779 in _wrapped_call_impl
[06:09] [ComfyUI] File "/Users/runner/work/comfy-gpu-ci/comfy-gpu-ci/test_workspaces/DepthAnythingV3-2043/ComfyUI/.ce/.pixi/envs/depthanythingv3-nodes/lib/python3.11/site-packages/torch/nn/modules/container.py", line 253 in forward
[06:09] [ComfyUI] File "/Users/runner/work/comfy-gpu-ci/comfy-gpu-ci/test_workspaces/DepthAnythingV3-2043/ComfyUI/.ce/.pixi/envs/depthanythingv3-nodes/lib/python3.11/site-packages/torch/nn/modules/module.py", line 1790 in _call_impl
[06:09] [ComfyUI] File "/Users/runner/work/comfy-gpu-ci/comfy-gpu-ci/test_workspaces/DepthAnythingV3-2043/ComfyUI/.ce/.pixi/envs/depthanythingv3-nodes/lib/python3.11/site-packages/torch/nn/modules/module.py", line 1779 in _wrapped_call_impl
[06:09] [ComfyUI] File "/Users/runner/work/comfy-gpu-ci/comfy-gpu-ci/test_workspaces/DepthAnythingV3-2043/ComfyUI/custom_nodes/ComfyUI-DepthAnythingV3/nodes/depth_anything_v3/model.py", line 1421 in _forward_impl
[06:09] [ComfyUI] File "/Users/runner/work/comfy-gpu-ci/comfy-gpu-ci/test_workspaces/DepthAnythingV3-2043/ComfyUI/custom_nodes/ComfyUI-DepthAnythingV3/nodes/depth_anything_v3/model.py", line 1366 in forward
[06:09] [ComfyUI] File "/Users/runner/work/comfy-gpu-ci/comfy-gpu-ci/test_workspaces/DepthAnythingV3-2043/ComfyUI/.ce/.pixi/envs/depthanythingv3-nodes/lib/python3.11/site-packages/torch/nn/modules/module.py", line 1790 in _call_impl
[06:09] [ComfyUI] File "/Users/runner/work/comfy-gpu-ci/comfy-gpu-ci/test_workspaces/DepthAnythingV3-2043/ComfyUI/.ce/.pixi/envs/depthanythingv3-nodes/lib/python3.11/site-packages/torch/nn/modules/module.py", line 1779 in _wrapped_call_impl
[06:09] [ComfyUI] File "/Users/runner/work/comfy-gpu-ci/comfy-gpu-ci/test_workspaces/DepthAnythingV3-2043/ComfyUI/custom_nodes/ComfyUI-DepthAnythingV3/nodes/depth_anything_v3/model.py", line 1591 in _process_depth_head
[06:09] [ComfyUI] File "/Users/runner/work/comfy-gpu-ci/comfy-gpu-ci/test_workspaces/DepthAnythingV3-2043/ComfyUI/custom_nodes/ComfyUI-DepthAnythingV3/nodes/depth_anything_v3/model.py", line 1577 in forward
[06:09] [ComfyUI] File "/Users/runner/work/comfy-gpu-ci/comfy-gpu-ci/test_workspaces/DepthAnythingV3-2043/ComfyUI/.ce/.pixi/envs/depthanythingv3-nodes/lib/python3.11/site-packages/torch/nn/modules/module.py", line 1790 in _call_impl
[06:09] [ComfyUI] File "/Users/runner/work/comfy-gpu-ci/comfy-gpu-ci/test_workspaces/DepthAnythingV3-2043/ComfyUI/.ce/.pixi/envs/depthanythingv3-nodes/lib/python3.11/site-packages/torch/nn/modules/module.py", line 1779 in _wrapped_call_impl
[06:09] [ComfyUI] File "/Users/runner/work/comfy-gpu-ci/comfy-gpu-ci/test_workspaces/DepthAnythingV3-2043/ComfyUI/custom_nodes/ComfyUI-DepthAnythingV3/nodes/nodes_inference.py", line 156 in execute
[06:09] [ComfyUI] File "/Users/runner/work/comfy-gpu-ci/comfy-gpu-ci/test_workspaces/DepthAnythingV3-2043/ComfyUI/comfy_api/latest/_io.py", line 1833 in EXECUTE_NORMALIZED
[06:09] [ComfyUI] File "/var/folders/tb/y368xp_x10s3ty1b_mtl5mxr0000gn/T/comfyui_pvenv_0w3iq8cd/persistent_worker.py", line 1762 in main
[06:09] [ComfyUI] File "/var/folders/tb/y368xp_x10s3ty1b_mtl5mxr0000gn/T/comfyui_pvenv_0w3iq8cd/persistent_worker.py", line 1807 in <module>
[06:09] [ComfyUI]
[06:09] [ComfyUI] 20:49:22 [print] === END ===
[06:09] [ComfyUI] Traceback (most recent call last):
[06:09] [ComfyUI] File "/Users/runner/work/comfy-gpu-ci/comfy-gpu-ci/test_workspaces/DepthAnythingV3-2043/venv/lib/python3.11/site-packages/comfy_env/isolation/workers/subprocess.py", line 558, in _send_request
[06:09] [ComfyUI] response = self._transport.recv(timeout=timeout)
[06:09] [ComfyUI] ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
[06:09] [ComfyUI] File "/Users/runner/work/comfy-gpu-ci/comfy-gpu-ci/test_workspaces/DepthAnythingV3-2043/venv/lib/python3.11/site-packages/comfy_env/isolation/workers/_ipc_parent.py", line 166, in recv
[06:09] [ComfyUI] raise ConnectionError("Socket closed")
[06:09] [ComfyUI] ConnectionError: Socket closed
[06:09] [ComfyUI]
[06:09] [ComfyUI] The above exception was the direct cause of the following exception:
[06:09] [ComfyUI]
[06:09] [ComfyUI] Traceback (most recent call last):
[06:09] [ComfyUI] File "/Users/runner/work/comfy-gpu-ci/comfy-gpu-ci/test_workspaces/DepthAnythingV3-2043/ComfyUI/execution.py", line 535, in execute
[06:09] [ComfyUI] output_data, output_ui, has_subgraph, has_pending_tasks = await get_output_data(prompt_id, unique_id, obj, input_data_all, execution_block_cb=execution_block_cb, pre_execute_cb=pre_execute_cb, v3_data=v3_data)
[06:09] [ComfyUI] ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
[06:09] [ComfyUI] File "/Users/runner/work/comfy-gpu-ci/comfy-gpu-ci/test_workspaces/DepthAnythingV3-2043/ComfyUI/execution.py", line 335, in get_output_data
[06:09] [ComfyUI] return_values = await _async_map_node_over_list(prompt_id, unique_id, obj, input_data_all, obj.FUNCTION, allow_interrupt=True, execution_block_cb=execution_block_cb, pre_execute_cb=pre_execute_cb, v3_data=v3_data)
[06:09] [ComfyUI] ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
[06:10] [ComfyUI] File "/Users/runner/work/comfy-gpu-ci/comfy-gpu-ci/test_workspaces/DepthAnythingV3-2043/ComfyUI/execution.py", line 309, in _async_map_node_over_list
[06:10] [ComfyUI] await process_inputs(input_dict, i)
[06:10] [ComfyUI] File "/Users/runner/work/comfy-gpu-ci/comfy-gpu-ci/test_workspaces/DepthAnythingV3-2043/ComfyUI/execution.py", line 297, in process_inputs
[06:10] [ComfyUI] result = f(**inputs)
[06:10] [ComfyUI] ^^^^^^^^^^^
[06:10] [ComfyUI] File "/Users/runner/work/comfy-gpu-ci/comfy-gpu-ci/test_workspaces/DepthAnythingV3-2043/venv/lib/python3.11/site-packages/comfy_env/isolation/metadata.py", line 536, in proxy
[06:10] [ComfyUI] result = worker.call_method(
[06:10] [ComfyUI] ^^^^^^^^^^^^^^^^^^^
[06:10] [ComfyUI] File "/Users/runner/work/comfy-gpu-ci/comfy-gpu-ci/test_workspaces/DepthAnythingV3-2043/venv/lib/python3.11/site-packages/comfy_env/isolation/workers/subprocess.py", line 669, in call_method
[06:10] [ComfyUI] response = self._send_request(request, timeout)
[06:10] [ComfyUI] ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
[06:10] [ComfyUI] File "/Users/runner/work/comfy-gpu-ci/comfy-gpu-ci/test_workspaces/DepthAnythingV3-2043/venv/lib/python3.11/site-packages/comfy_env/isolation/workers/subprocess.py", line 589, in _send_request
[06:10] [ComfyUI] raise RuntimeError(
[06:10] [ComfyUI] RuntimeError: ComfyUI-DepthAnythingV3: Socket closed but worker process still running.
[06:10] [ComfyUI] exit code: None
[06:10] [ComfyUI] worker log (/var/folders/tb/y368xp_x10s3ty1b_mtl5mxr0000gn/T/comfy_worker_debug.log, last 20 lines):
[06:10] [ComfyUI] File "/Users/runner/work/comfy-gpu-ci/comfy-gpu-ci/test_workspaces/DepthAnythingV3-2043/ComfyUI/comfy/ops.py", line 516 in forward
[06:10] [ComfyUI] File "/Users/runner/work/comfy-gpu-ci/comfy-gpu-ci/test_workspaces/DepthAnythingV3-2043/ComfyUI/.ce/.pixi/envs/depthanythingv3-nodes/lib/python3.11/site-packages/torch/nn/modules/module.py", line 1790 in _call_impl
[06:10] [ComfyUI] File "/Users/runner/work/comfy-gpu-ci/comfy-gpu-ci/test_workspaces/DepthAnythingV3-2043/ComfyUI/.ce/.pixi/envs/depthanythingv3-nodes/lib/python3.11/site-packages/torch/nn/modules/module.py", line 1779 in _wrapped_call_impl
[06:10] [ComfyUI] File "/Users/runner/work/comfy-gpu-ci/comfy-gpu-ci/test_workspaces/DepthAnythingV3-2043/ComfyUI/.ce/.pixi/envs/depthanythingv3-nodes/lib/python3.11/site-packages/torch/nn/modules/container.py", line 253 in forward
[06:10] [ComfyUI] File "/Users/runner/work/comfy-gpu-ci/comfy-gpu-ci/test_workspaces/DepthAnythingV3-2043/ComfyUI/.ce/.pixi/envs/depthanythingv3-nodes/lib/python3.11/site-packages/torch/nn/modules/module.py", line 1790 in _call_impl
[06:10] [ComfyUI] File "/Users/runner/work/comfy-gpu-ci/comfy-gpu-ci/test_workspaces/DepthAnythingV3-2043/ComfyUI/.ce/.pixi/envs/depthanythingv3-nodes/lib/python3.11/site-packages/torch/nn/modules/module.py", line 1779 in _wrapped_call_impl
[06:10] [ComfyUI] File "/Users/runner/work/comfy-gpu-ci/comfy-gpu-ci/test_workspaces/DepthAnythingV3-2043/ComfyUI/custom_nodes/ComfyUI-DepthAnythingV3/nodes/depth_anything_v3/model.py", line 1421 in _forward_impl
[06:10] [ComfyUI] File "/Users/runner/work/comfy-gpu-ci/comfy-gpu-ci/test_workspaces/DepthAnythingV3-2043/ComfyUI/custom_nodes/ComfyUI-DepthAnythingV3/nodes/depth_anything_v3/model.py", line 1366 in forward
[06:10] [ComfyUI] File "/Users/runner/work/comfy-gpu-ci/comfy-gpu-ci/test_workspaces/DepthAnythingV3-2043/ComfyUI/.ce/.pixi/envs/depthanythingv3-nodes/lib/python3.11/site-packages/torch/nn/modules/module.py", line 1790 in _call_impl
[06:10] [ComfyUI] File "/Users/runner/work/comfy-gpu-ci/comfy-gpu-ci/test_workspaces/DepthAnythingV3-2043/ComfyUI/.ce/.pixi/envs/depthanythingv3-nodes/lib/python3.11/site-packages/torch/nn/modules/module.py", line 1779 in _wrapped_call_impl
[06:10] [ComfyUI] File "/Users/runner/work/comfy-gpu-ci/comfy-gpu-ci/test_workspaces/DepthAnythingV3-2043/ComfyUI/custom_nodes/ComfyUI-DepthAnythingV3/nodes/depth_anything_v3/model.py", line 1591 in _process_depth_head
[06:10] [ComfyUI] File "/Users/runner/work/comfy-gpu-ci/comfy-gpu-ci/test_workspaces/DepthAnythingV3-2043/ComfyUI/custom_nodes/ComfyUI-DepthAnythingV3/nodes/depth_anything_v3/model.py", line 1577 in forward
[06:10] [ComfyUI] File "/Users/runner/work/comfy-gpu-ci/comfy-gpu-ci/test_workspaces/DepthAnythingV3-2043/ComfyUI/.ce/.pixi/envs/depthanythingv3-nodes/lib/python3.11/site-packages/torch/nn/modules/module.py", line 1790 in _call_impl
[06:10] [ComfyUI] File "/Users/runner/work/comfy-gpu-ci/comfy-gpu-ci/test_workspaces/DepthAnythingV3-2043/ComfyUI/.ce/.pixi/envs/depthanythingv3-nodes/lib/python3.11/site-packages/torch/nn/modules/module.py", line 1779 in _wrapped_call_impl
[06:10] [ComfyUI] File "/Users/runner/work/comfy-gpu-ci/comfy-gpu-ci/test_workspaces/DepthAnythingV3-2043/ComfyUI/custom_nodes/ComfyUI-DepthAnythingV3/nodes/nodes_inference.py", line 156 in execute
[06:10] [ComfyUI] File "/Users/runner/work/comfy-gpu-ci/comfy-gpu-ci/test_workspaces/DepthAnythingV3-2043/ComfyUI/comfy_api/latest/_io.py", line 1833 in EXECUTE_NORMALIZED
[06:10] [ComfyUI] File "/var/folders/tb/y368xp_x10s3ty1b_mtl5mxr0000gn/T/comfyui_pvenv_0w3iq8cd/persistent_worker.py", line 1762 in main
[06:10] [ComfyUI] File "/var/folders/tb/y368xp_x10s3ty1b_mtl5mxr0000gn/T/comfyui_pvenv_0w3iq8cd/persistent_worker.py", line 1807 in <module>
[06:10] [ComfyUI]
[06:10] [ComfyUI] 20:49:22 [print] === END ===
[06:10] [ComfyUI]
[06:10] [ComfyUI] Prompt executed in 226.01 seconds
[06:12] [capture-loop] iter=1300 t=229.1s state={'complete': False, 'error': None, 'executedCount': 0, 'wsState': 1} eval_ms=2 ram=1.9/7.0GB (37%) swap=0.5/1.0GB (45%) cpu=51% browser_rss=0.17GB
[06:15] Execution complete (t=231.4s)
[06:15] Execution error: {'prompt_id': '7f0b777f-89c4-49f1-a152-41e921b50984', 'node_id': '12', 'node_type': 'DepthAnything_V3', 'executed': ['2', '3'], 'exception_message': 'ComfyUI-DepthAnythingV3: Socket closed but worker process still running.\n exit code: None\n worker log (/var/folders/tb/y368xp_x10s3ty1b_mtl5mxr0000gn/T/comfy_worker_debug.log, last 20 lines):\n File "/Users/runner/work/comfy-gpu-ci/comfy-gpu-ci/test_workspaces/DepthAnythingV3-2043/ComfyUI/comfy/ops.py", line 516 in forward\n File "/Users/runner/work/comfy-gpu-ci/comfy-gpu-ci/test_workspaces/DepthAnythingV3-2043/ComfyUI/.ce/.pixi/envs/depthanythingv3-nodes/lib/python3.11/site-packages/torch/nn/modules/module.py", line 1790 in _call_impl\n File "/Users/runner/work/comfy-gpu-ci/comfy-gpu-ci/test_workspaces/DepthAnythingV3-2043/ComfyUI/.ce/.pixi/envs/depthanythingv3-nodes/lib/python3.11/site-packages/torch/nn/modules/module.py", line 1779 in _wrapped_call_impl\n File "/Users/runner/work/comfy-gpu-ci/comfy-gpu-ci/test_workspaces/DepthAnythingV3-2043/ComfyUI/.ce/.pixi/envs/depthanythingv3-nodes/lib/python3.11/site-packages/torch/nn/modules/container.py", line 253 in forward\n File "/Users/runner/work/comfy-gpu-ci/comfy-gpu-ci/test_workspaces/DepthAnythingV3-2043/ComfyUI/.ce/.pixi/envs/depthanythingv3-nodes/lib/python3.11/site-packages/torch/nn/modules/module.py", line 1790 in _call_impl\n File "/Users/runner/work/comfy-gpu-ci/comfy-gpu-ci/test_workspaces/DepthAnythingV3-2043/ComfyUI/.ce/.pixi/envs/depthanythingv3-nodes/lib/python3.11/site-packages/torch/nn/modules/module.py", line 1779 in _wrapped_call_impl\n File "/Users/runner/work/comfy-gpu-ci/comfy-gpu-ci/test_workspaces/DepthAnythingV3-2043/ComfyUI/custom_nodes/ComfyUI-DepthAnythingV3/nodes/depth_anything_v3/model.py", line 1421 in _forward_impl\n File "/Users/runner/work/comfy-gpu-ci/comfy-gpu-ci/test_workspaces/DepthAnythingV3-2043/ComfyUI/custom_nodes/ComfyUI-DepthAnythingV3/nodes/depth_anything_v3/model.py", line 1366 in forward\n File "/Users/runner/work/comfy-gpu-ci/comfy-gpu-ci/test_workspaces/DepthAnythingV3-2043/ComfyUI/.ce/.pixi/envs/depthanythingv3-nodes/lib/python3.11/site-packages/torch/nn/modules/module.py", line 1790 in _call_impl\n File "/Users/runner/work/comfy-gpu-ci/comfy-gpu-ci/test_workspaces/DepthAnythingV3-2043/ComfyUI/.ce/.pixi/envs/depthanythingv3-nodes/lib/python3.11/site-packages/torch/nn/modules/module.py", line 1779 in _wrapped_call_impl\n File "/Users/runner/work/comfy-gpu-ci/comfy-gpu-ci/test_workspaces/DepthAnythingV3-2043/ComfyUI/custom_nodes/ComfyUI-DepthAnythingV3/nodes/depth_anything_v3/model.py", line 1591 in _process_depth_head\n File "/Users/runner/work/comfy-gpu-ci/comfy-gpu-ci/test_workspaces/DepthAnythingV3-2043/ComfyUI/custom_nodes/ComfyUI-DepthAnythingV3/nodes/depth_anything_v3/model.py", line 1577 in forward\n File "/Users/runner/work/comfy-gpu-ci/comfy-gpu-ci/test_workspaces/DepthAnythingV3-2043/ComfyUI/.ce/.pixi/envs/depthanythingv3-nodes/lib/python3.11/site-packages/torch/nn/modules/module.py", line 1790 in _call_impl\n File "/Users/runner/work/comfy-gpu-ci/comfy-gpu-ci/test_workspaces/DepthAnythingV3-2043/ComfyUI/.ce/.pixi/envs/depthanythingv3-nodes/lib/python3.11/site-packages/torch/nn/modules/module.py", line 1779 in _wrapped_call_impl\n File "/Users/runner/work/comfy-gpu-ci/comfy-gpu-ci/test_workspaces/DepthAnythingV3-2043/ComfyUI/custom_nodes/ComfyUI-DepthAnythingV3/nodes/nodes_inference.py", line 156 in execute\n File "/Users/runner/work/comfy-gpu-ci/comfy-gpu-ci/test_workspaces/DepthAnythingV3-2043/ComfyUI/comfy_api/latest/_io.py", line 1833 in EXECUTE_NORMALIZED\n File "/var/folders/tb/y368xp_x10s3ty1b_mtl5mxr0000gn/T/comfyui_pvenv_0w3iq8cd/persistent_worker.py", line 1762 in main\n File "/var/folders/tb/y368xp_x10s3ty1b_mtl5mxr0000gn/T/comfyui_pvenv_0w3iq8cd/persistent_worker.py", line 1807 in <module>\n \n 20:49:22 [print] === END ===\n', 'exception_type': 'RuntimeError', 'traceback': [' File "/Users/runner/work/comfy-gpu-ci/comfy-gpu-ci/test_workspaces/DepthAnythingV3-2043/ComfyUI/execution.py", line 535, in execute\n output_data, output_ui, has_subgraph, has_pending_tasks = await get_output_data(prompt_id, unique_id, obj, input_data_all, execution_block_cb=execution_block_cb, pre_execute_cb=pre_execute_cb, v3_data=v3_data)\n ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^\n', ' File "/Users/runner/work/comfy-gpu-ci/comfy-gpu-ci/test_workspaces/DepthAnythingV3-2043/ComfyUI/execution.py", line 335, in get_output_data\n return_values = await _async_map_node_over_list(prompt_id, unique_id, obj, input_data_all, obj.FUNCTION, allow_interrupt=True, execution_block_cb=execution_block_cb, pre_execute_cb=pre_execute_cb, v3_data=v3_data)\n ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^\n', ' File "/Users/runner/work/comfy-gpu-ci/comfy-gpu-ci/test_workspaces/DepthAnythingV3-2043/ComfyUI/execution.py", line 309, in _async_map_node_over_list\n await process_inputs(input_dict, i)\n', ' File "/Users/runner/work/comfy-gpu-ci/comfy-gpu-ci/test_workspaces/DepthAnythingV3-2043/ComfyUI/execution.py", line 297, in process_inputs\n result = f(**inputs)\n ^^^^^^^^^^^\n', ' File "/Users/runner/work/comfy-gpu-ci/comfy-gpu-ci/test_workspaces/DepthAnythingV3-2043/venv/lib/python3.11/site-packages/comfy_env/isolation/metadata.py", line 536, in proxy\n result = worker.call_method(\n ^^^^^^^^^^^^^^^^^^^\n', ' File "/Users/runner/work/comfy-gpu-ci/comfy-gpu-ci/test_workspaces/DepthAnythingV3-2043/venv/lib/python3.11/site-packages/comfy_env/isolation/workers/subprocess.py", line 669, in call_method\n response = self._send_request(request, timeout)\n ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^\n', ' File "/Users/runner/work/comfy-gpu-ci/comfy-gpu-ci/test_workspaces/DepthAnythingV3-2043/venv/lib/python3.11/site-packages/comfy_env/isolation/workers/subprocess.py", line 589, in _send_request\n raise RuntimeError(\n'], 'current_inputs': {'normalization_mode': ['V2-Style'], 'resize_method': ['resize'], 'invert_depth': [False], 'keep_model_size': [False], 'da3_model': ["{'model_path': '/Users/runner/work/comfy-gpu-ci/comfy-gpu-ci/test_workspaces/DepthAnythingV3-2043/ComfyUI/models/depthanything3/da3_large.safetensors', 'model_key': 'da3-large', 'dtype': 'bf16', 'attention': 'auto'}"], 'images': ['tensor([[[[0.0000, 0.0000, 0.0000],\n [0.0000, 0.0000, 0.0000],\n [0.0000, 0.0000, 0.0000],\n ...,\n [0.0000, 0.0000, 0.0000],\n [0.0000, 0.0000, 0.0000],\n [0.0000, 0.0000, 0.0000]],\n\n [[0.0000, 0.0000, 0.0000],\n [0.0000, 0.0000, 0.0000],\n [0.0000, 0.0000, 0.0000],\n ...,\n [0.0000, 0.0000, 0.0000],\n [0.0000, 0.0000, 0.0000],\n [0.0000, 0.0000, 0.0000]],\n\n [[0.0000, 0.0000, 0.0000],\n [0.0000, 0.0000, 0.0000],\n [0.0000, 0.0000, 0.0000],\n ...,\n [0.0000, 0.0000, 0.0000],\n [0.0000, 0.0000, 0.0000],\n [0.0000, 0.0000, 0.0000]],\n\n ...,\n\n [[0.1367, 0.1367, 0.1367],\n [0.2500, 0.2500, 0.2500],\n [0.0352, 0.0352, 0.0352],\n ...,\n [0.0000, 0.0000, 0.0000],\n [0.0000, 0.0000, 0.0000],\n [0.0000, 0.0000, 0.0000]],\n\n [[0.1250, 0.1250, 0.1250],\n [0.1602, 0.1602, 0.1602],\n [0.5234, 0.5234, 0.5234],\n ...,\n [0.0000, 0.0000, 0.0000],\n [0.0000, 0.0000, 0.0000],\n [0.0000, 0.0000, 0.0000]],\n\n [[0.0000, 0.0000, 0.0000],\n [0.0195, 0.0195, 0.0195],\n [0.2266, 0.2266, 0.2266],\n ...,\n [0.0000, 0.0000, 0.0000],\n [0.0000, 0.0000, 0.0000],\n [0.0000, 0.0000, 0.0000]]]])']}, 'current_outputs': ['12', '11', '6', '8', '9', '4', '13', '3', '10', '7', '2'], 'timestamp': 1778446207633}
[06:15] Capturing execution frames: advanced_3d.json
[06:24] Frame 1 saved (frame_000.jpg, t=0.0s)
[06:24] Validating workflow...
[06:24] [ComfyUI] === /validate endpoint called ===
[06:24] [ComfyUI] Received JSON with keys: ['prompt']
[06:24] [ComfyUI] Prompt has 6 nodes
[06:24] [ComfyUI] Node 2: LoadImage
[06:24] [ComfyUI] Inputs: {"image": "kaffi.jpg"}
[06:24] [ComfyUI] Node 3: DownloadAndLoadDepthAnythingV3Model
[06:24] [ComfyUI] Inputs: {"model": "da3_large.safetensors", "precision": "auto", "attention": "auto"}
[06:24] [ComfyUI] Node 21: DepthAnything_V3
[06:24] [ComfyUI] Inputs: {"normalization_mode": "Raw", "resize_method": "resize", "invert_depth": false, "keep_model_size": false, "da3_model": ["3", 0], "images": ["2", 0]}
[06:24] [ComfyUI] Node 22: DA3_ToPointCloud
[06:24] [ComfyUI] Inputs: {"confidence_threshold": 0.2, "downsample": 1, "allow_around_1": 1, "filter_outliers": false, "outlier_percentage": 5, "depth_raw": ["21", 0], "confidence": ["21", 1], "intrinsics": ["21", 6], "sky_ma
[06:24] [ComfyUI] Node 23: DA3_SavePointCloud
[06:24] [ComfyUI] Inputs: {"filename_prefix": "pointcloud", "pointcloud": ["22", 0]}
[06:24] [ComfyUI] Node 25: DA3_PreviewPointCloud
[06:24] [ComfyUI] Inputs: {"file_path": ["23", 0], "color_mode": "RGB", "preview_vtk": ""}
[06:24] [ComfyUI] Generated prompt_id: ab803fb3-19ae-4352-95c1-ad0bd69e1bfb
[06:24] [ComfyUI] Calling execution.validate_prompt()...
[06:24] [ComfyUI] Validation result: valid=True
[06:24] [ComfyUI] === Validation PASSED ===
[06:24] Queuing workflow for execution...
[06:24] [ComfyUI] got prompt
[06:24] [ComfyUI] [comfy-env] Running DownloadAndLoadDepthAnythingV3Model: model: 'da3_large.safetensors', precision: 'auto', attention: 'auto'
[06:24] [ComfyUI] [comfy-env] SubprocessWorker: /Users/runner/work/comfy-gpu-ci/comfy-gpu-ci/test_workspaces/DepthAnythingV3-2043/ComfyUI/.ce/.pixi/envs/depthanythingv3-nodes/bin/python
[06:24] [ComfyUI] [comfy-env] env_vars: {'COMFYUI_BASE': '/Users/runner/work/comfy-gpu-ci/comfy-gpu-ci/test_workspaces/DepthAnythingV3-2043/ComfyUI'}
[06:24] [ComfyUI] [SubprocessWorker] call_method: nodes.load_model.DownloadAndLoadDepthAnythingV3Model.EXECUTE_NORMALIZED
[06:24] [ComfyUI] [SubprocessWorker] acquired lock, ensuring started...
[06:24] [ComfyUI] [ComfyUI-DepthAnythingV3] python: /Users/runner/work/comfy-gpu-ci/comfy-gpu-ci/test_workspaces/DepthAnythingV3-2043/ComfyUI/.ce/.pixi/envs/depthanythingv3-nodes/bin/python
[06:24] [ComfyUI] [ComfyUI-DepthAnythingV3] sys_path sent to worker: ['/Users/runner/work/comfy-gpu-ci/comfy-gpu-ci/test_workspaces/DepthAnythingV3-2043/ComfyUI', '/Users/runner/work/comfy-gpu-ci/comfy-gpu-ci/test_workspaces/DepthAnythingV3-2043/ComfyUI/custom_nodes/ComfyUI-DepthAnythingV3', '/Users/runner/work/comfy-gpu-ci/comfy-gpu-ci/test_workspaces/DepthAnythingV3-2043/ComfyUI/.ce/.pixi/envs/depthanythingv3-nodes/lib/python3.11/site-packages', '/Users/runner/work/comfy-gpu-ci/comfy-gpu-ci/test_workspaces/DepthAnythingV3-2043/ComfyUI/custom_nodes/ComfyUI-DepthAnythingV3']
[06:24] [ComfyUI] [SubprocessWorker] is_pixi=True, python=/Users/runner/work/comfy-gpu-ci/comfy-gpu-ci/test_workspaces/DepthAnythingV3-2043/ComfyUI/.ce/.pixi/envs/depthanythingv3-nodes/bin/python
[06:24] [ComfyUI] [SubprocessWorker] launching cmd=['/Users/runner/.pixi/bin/pixi', 'run', '--as-is', '--manifest-path', '/Users/runner/work/comfy-gpu-ci/comfy-gpu-ci/test_workspaces/DepthAnythingV3-2043/ComfyUI/.ce/pixi.toml', '-e', 'depthanythingv3-nodes', 'python', '/var/folders/tb/y368xp_x10s3ty1b_mtl5mxr0000gn/T/comfyui_pvenv_jm1u1toj/persistent_worker.py', 'unix:///var/folders/tb/y368xp_x10s3ty1b_mtl5mxr0000gn/T/comfy_worker_4d60d20c0f50.sock']...
[06:24] [ComfyUI] [SubprocessWorker] socket_addr=unix:///var/folders/tb/y368xp_x10s3ty1b_mtl5mxr0000gn/T/comfy_worker_4d60d20c0f50.sock exists=True
[06:27] [ComfyUI] [worker:ComfyUI-DepthAnythingV3] ERROR: Failed to import comfy_kitchen, Error: No module named 'comfy_kitchen', fp8 and fp4 support will not be available.
[06:27] [ComfyUI] [SubprocessWorker] worker started/confirmed
[06:27] [ComfyUI] [SubprocessWorker] serializing kwargs to shm...
[06:27] [ComfyUI] [SubprocessWorker] created 0 shm blocks
[06:27] [ComfyUI] [SubprocessWorker] sending request via socket...
[06:27] [ComfyUI] [SubprocessWorker] call_id=1 sending call_method
[06:28] [ComfyUI] [SubprocessWorker] got response: ok
[06:28] [ComfyUI] [comfy-env] DownloadAndLoadDepthAnythingV3Model done (3.56s): result: NodeOutput
[06:28] [ComfyUI] [comfy-env] Running DepthAnything_V3: normalization_mode: 'Raw', resize_method: 'resize', invert_depth: False, keep_model_size: False, da3_model: dict, images: torch.float32 [1,533,800,3] cpu
[06:28] [ComfyUI] [SubprocessWorker] call_method: nodes.nodes_inference.DepthAnything_V3.EXECUTE_NORMALIZED
[06:28] [ComfyUI] [SubprocessWorker] acquired lock, ensuring started...
[06:28] [ComfyUI] [ComfyUI-DepthAnythingV3] Health check: ping (timeout=5.0s)...
[06:28] [ComfyUI] [ComfyUI-DepthAnythingV3] Health check: ok
[06:28] [ComfyUI] [SubprocessWorker] worker started/confirmed
[06:28] [ComfyUI] [comfy-env] PRE-SERIALIZE 'images' shape: torch.Size([1, 533, 800, 3])
[06:28] [ComfyUI] [SubprocessWorker] serializing kwargs to shm...
[06:28] [ComfyUI] [SubprocessWorker] created 0 shm blocks
[06:28] [ComfyUI] [SubprocessWorker] sending request via socket...
[06:28] [ComfyUI] [SubprocessWorker] call_id=2 sending call_method
[06:28] [ComfyUI] [worker:ComfyUI-DepthAnythingV3] [comfy-env] _from_shm got dict with keys: ['__type__', 'strategy', 'manager_path', 'storage_key', 'storage_size']
[06:28] [ComfyUI] [worker:ComfyUI-DepthAnythingV3] [comfy-env] DESERIALIZE TensorRef: tensor_size=[1, 533, 800, 3]
[06:28] [ComfyUI] [worker:ComfyUI-DepthAnythingV3] [comfy-env] DESERIALIZED tensor shape: torch.Size([1, 533, 800, 3])
[06:29] [ComfyUI] [worker:ComfyUI-DepthAnythingV3] WARNING: No comfy kitchen, using old apply_rope functions.
[06:30] [capture-loop] iter=50 t=5.7s state={'complete': False, 'error': None, 'executedCount': 0, 'wsState': 1} eval_ms=2 ram=3.0/7.0GB (50%) swap=0.4/1.0GB (42%) cpu=58% browser_rss=0.57GB
[06:35] [capture-loop] iter=100 t=11.2s state={'complete': False, 'error': None, 'executedCount': 0, 'wsState': 1} eval_ms=2 ram=3.7/7.0GB (59%) swap=0.4/1.0GB (42%) cpu=41% browser_rss=0.53GB
[06:36] [ComfyUI] [SubprocessWorker] callback 'request_vram_budget' from call_id=2
[06:36] [ComfyUI] [comfy-env] VRAM request: 0.82GB, free before eviction: 2.76GB
[06:36] [ComfyUI] [comfy-env] VRAM after eviction: 2.76GB
[06:41] [capture-loop] iter=150 t=16.9s state={'complete': False, 'error': None, 'executedCount': 0, 'wsState': 1} eval_ms=2 ram=3.6/7.0GB (75%) swap=0.4/1.0GB (41%) cpu=51% browser_rss=0.28GB
[06:47] [capture-loop] iter=200 t=22.4s state={'complete': False, 'error': None, 'executedCount': 0, 'wsState': 1} eval_ms=2 ram=3.6/7.0GB (74%) swap=0.4/1.0GB (41%) cpu=48% browser_rss=0.36GB
[06:49] [ComfyUI] /AppleInternal/Library/BuildRoots/4~B5vFugBcKzdCtMw80UR1WFCTSITbUVQOwkJg1SQ/Library/Caches/com.apple.xbs/Sources/MetalPerformanceShaders/MPSCore/Utility/MPSLibrary.mm:579: failed assertion `MPSKernel MTLComputePipelineStateCache unable to load function ndArrayConvolution2D.
[06:49] [ComfyUI] Compilation failed: (null)
[06:49] [ComfyUI] '
[06:49] [ComfyUI] !!! Exception during processing !!! ComfyUI-DepthAnythingV3: Socket closed but worker process still running.
[06:49] [ComfyUI] exit code: None
[06:49] [ComfyUI] worker log (/var/folders/tb/y368xp_x10s3ty1b_mtl5mxr0000gn/T/comfy_worker_debug.log, last 20 lines):
[06:49] [ComfyUI] 20:50:26 [worker] Request: call_method nodes.nodes_inference call_id=2
[06:49] [ComfyUI] 20:50:26 [worker] Reconstructing inputs from shm...
[06:49] [ComfyUI] 20:50:26 [_from_shm] top-level keys: ['normalization_mode', 'resize_method', 'invert_depth', 'keep_model_size', 'da3_model', 'images']
[06:49] [ComfyUI] 20:50:26 [print] [comfy-env] _from_shm got dict with keys: ['__type__', 'strategy', 'manager_path', 'storage_key', 'storage_size']
[06:49] [ComfyUI] 20:50:26 [_from_shm] images: TensorRef tensor_size=[1, 533, 800, 3]
[06:49] [ComfyUI] 20:50:26 [print] [comfy-env] DESERIALIZE TensorRef: tensor_size=[1, 533, 800, 3]
[06:49] [ComfyUI] 20:50:26 [_from_shm] images: TensorRef deserialized shape=torch.Size([1, 533, 800, 3])
[06:49] [ComfyUI] 20:50:26 [print] [comfy-env] DESERIALIZED tensor shape: torch.Size([1, 533, 800, 3])
[06:49] [ComfyUI] 20:50:26 [worker] Inputs ready: ['normalization_mode', 'resize_method', 'invert_depth', 'keep_model_size', 'da3_model', 'images']
[06:49] [ComfyUI] 20:50:26 [worker] Input 'images' shape: torch.Size([1, 533, 800, 3])
[06:49] [ComfyUI] 20:50:26 [worker] Importing module nodes.nodes_inference...
[06:49] [ComfyUI] 20:50:26 [worker] Module imported
[06:49] [ComfyUI] 20:50:26 [worker] Getting class DepthAnything_V3...
[06:49] [ComfyUI] 20:50:26 [worker] Creating instance...
[06:49] [ComfyUI] 20:50:26 [worker] Calling EXECUTE_NORMALIZED...
[06:49] [ComfyUI] 20:50:26 [log] WARNING: No comfy kitchen, using old apply_rope functions.
[06:49] [ComfyUI] 20:50:34 [worker] load_models_gpu shim: 1 models, 0.82 GB total
[06:49] [ComfyUI] 20:50:34 [worker] Set EXTRA_RESERVED_VRAM = 0.42 GB
[06:49] [ComfyUI] 20:50:34 [worker] Set vram_state = SHARED
[06:49] [ComfyUI] 20:50:46 [worker] Models loaded via real load_models_gpu
[06:49] [ComfyUI] Traceback (most recent call last):
[06:49] [ComfyUI] File "/Users/runner/work/comfy-gpu-ci/comfy-gpu-ci/test_workspaces/DepthAnythingV3-2043/venv/lib/python3.11/site-packages/comfy_env/isolation/workers/subprocess.py", line 558, in _send_request
[06:49] [ComfyUI] response = self._transport.recv(timeout=timeout)
[06:49] [ComfyUI] ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
[06:49] [ComfyUI] File "/Users/runner/work/comfy-gpu-ci/comfy-gpu-ci/test_workspaces/DepthAnythingV3-2043/venv/lib/python3.11/site-packages/comfy_env/isolation/workers/_ipc_parent.py", line 166, in recv
[06:49] [ComfyUI] raise ConnectionError("Socket closed")
[06:49] [ComfyUI] ConnectionError: Socket closed
[06:49] [ComfyUI]
[06:49] [ComfyUI] The above exception was the direct cause of the following exception:
[06:49] [ComfyUI]
[06:49] [ComfyUI] Traceback (most recent call last):
[06:49] [ComfyUI] File "/Users/runner/work/comfy-gpu-ci/comfy-gpu-ci/test_workspaces/DepthAnythingV3-2043/ComfyUI/execution.py", line 535, in execute
[06:49] [ComfyUI] output_data, output_ui, has_subgraph, has_pending_tasks = await get_output_data(prompt_id, unique_id, obj, input_data_all, execution_block_cb=execution_block_cb, pre_execute_cb=pre_execute_cb, v3_data=v3_data)
[06:49] [ComfyUI] ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
[06:49] [ComfyUI] File "/Users/runner/work/comfy-gpu-ci/comfy-gpu-ci/test_workspaces/DepthAnythingV3-2043/ComfyUI/execution.py", line 335, in get_output_data
[06:49] [ComfyUI] return_values = await _async_map_node_over_list(prompt_id, unique_id, obj, input_data_all, obj.FUNCTION, allow_interrupt=True, execution_block_cb=execution_block_cb, pre_execute_cb=pre_execute_cb, v3_data=v3_data)
[06:49] [ComfyUI] ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
[06:49] [ComfyUI] File "/Users/runner/work/comfy-gpu-ci/comfy-gpu-ci/test_workspaces/DepthAnythingV3-2043/ComfyUI/execution.py", line 309, in _async_map_node_over_list
[06:49] [ComfyUI] await process_inputs(input_dict, i)
[06:49] [ComfyUI] File "/Users/runner/work/comfy-gpu-ci/comfy-gpu-ci/test_workspaces/DepthAnythingV3-2043/ComfyUI/execution.py", line 297, in process_inputs
[06:49] [ComfyUI] result = f(**inputs)
[06:49] [ComfyUI] ^^^^^^^^^^^
[06:49] [ComfyUI] File "/Users/runner/work/comfy-gpu-ci/comfy-gpu-ci/test_workspaces/DepthAnythingV3-2043/venv/lib/python3.11/site-packages/comfy_env/isolation/metadata.py", line 536, in proxy
[06:49] [ComfyUI] result = worker.call_method(
[06:49] [ComfyUI] ^^^^^^^^^^^^^^^^^^^
[06:49] [ComfyUI] File "/Users/runner/work/comfy-gpu-ci/comfy-gpu-ci/test_workspaces/DepthAnythingV3-2043/venv/lib/python3.11/site-packages/comfy_env/isolation/workers/subprocess.py", line 669, in call_method
[06:49] [ComfyUI] response = self._send_request(request, timeout)
[06:49] [ComfyUI] ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
[06:49] [ComfyUI] File "/Users/runner/work/comfy-gpu-ci/comfy-gpu-ci/test_workspaces/DepthAnythingV3-2043/venv/lib/python3.11/site-packages/comfy_env/isolation/workers/subprocess.py", line 589, in _send_request
[06:49] [ComfyUI] raise RuntimeError(
[06:49] [ComfyUI] RuntimeError: ComfyUI-DepthAnythingV3: Socket closed but worker process still running.
[06:49] [ComfyUI] exit code: None
[06:49] [ComfyUI] worker log (/var/folders/tb/y368xp_x10s3ty1b_mtl5mxr0000gn/T/comfy_worker_debug.log, last 20 lines):
[06:49] [ComfyUI] 20:50:26 [worker] Request: call_method nodes.nodes_inference call_id=2
[06:49] [ComfyUI] 20:50:26 [worker] Reconstructing inputs from shm...
[06:49] [ComfyUI] 20:50:26 [_from_shm] top-level keys: ['normalization_mode', 'resize_method', 'invert_depth', 'keep_model_size', 'da3_model', 'images']
[06:49] [ComfyUI] 20:50:26 [print] [comfy-env] _from_shm got dict with keys: ['__type__', 'strategy', 'manager_path', 'storage_key', 'storage_size']
[06:49] [ComfyUI] 20:50:26 [_from_shm] images: TensorRef tensor_size=[1, 533, 800, 3]
[06:49] [ComfyUI] 20:50:26 [print] [comfy-env] DESERIALIZE TensorRef: tensor_size=[1, 533, 800, 3]
[06:49] [ComfyUI] 20:50:26 [_from_shm] images: TensorRef deserialized shape=torch.Size([1, 533, 800, 3])
[06:49] [ComfyUI] 20:50:26 [print] [comfy-env] DESERIALIZED tensor shape: torch.Size([1, 533, 800, 3])
[06:49] [ComfyUI] 20:50:26 [worker] Inputs ready: ['normalization_mode', 'resize_method', 'invert_depth', 'keep_model_size', 'da3_model', 'images']
[06:49] [ComfyUI] 20:50:26 [worker] Input 'images' shape: torch.Size([1, 533, 800, 3])
[06:49] [ComfyUI] 20:50:26 [worker] Importing module nodes.nodes_inference...
[06:49] [ComfyUI] 20:50:26 [worker] Module imported
[06:49] [ComfyUI] 20:50:26 [worker] Getting class DepthAnything_V3...
[06:49] [ComfyUI] 20:50:26 [worker] Creating instance...
[06:49] [ComfyUI] 20:50:26 [worker] Calling EXECUTE_NORMALIZED...
[06:49] [ComfyUI] 20:50:26 [log] WARNING: No comfy kitchen, using old apply_rope functions.
[06:49] [ComfyUI] 20:50:34 [worker] load_models_gpu shim: 1 models, 0.82 GB total
[06:49] [ComfyUI] 20:50:34 [worker] Set EXTRA_RESERVED_VRAM = 0.42 GB
[06:49] [ComfyUI] 20:50:34 [worker] Set vram_state = SHARED
[06:49] [ComfyUI] 20:50:46 [worker] Models loaded via real load_models_gpu
[06:49] [ComfyUI]
[06:49] [ComfyUI] Prompt executed in 24.56 seconds
[06:49] Execution complete (t=24.8s)
[06:49] Execution error: {'prompt_id': '2f5e82c1-7c11-4032-a384-5bb06572e02c', 'node_id': '21', 'node_type': 'DepthAnything_V3', 'executed': ['2', '3'], 'exception_message': "ComfyUI-DepthAnythingV3: Socket closed but worker process still running.\n exit code: None\n worker log (/var/folders/tb/y368xp_x10s3ty1b_mtl5mxr0000gn/T/comfy_worker_debug.log, last 20 lines):\n 20:50:26 [worker] Request: call_method nodes.nodes_inference call_id=2\n 20:50:26 [worker] Reconstructing inputs from shm...\n 20:50:26 [_from_shm] top-level keys: ['normalization_mode', 'resize_method', 'invert_depth', 'keep_model_size', 'da3_model', 'images']\n 20:50:26 [print] [comfy-env] _from_shm got dict with keys: ['__type__', 'strategy', 'manager_path', 'storage_key', 'storage_size']\n 20:50:26 [_from_shm] images: TensorRef tensor_size=[1, 533, 800, 3]\n 20:50:26 [print] [comfy-env] DESERIALIZE TensorRef: tensor_size=[1, 533, 800, 3]\n 20:50:26 [_from_shm] images: TensorRef deserialized shape=torch.Size([1, 533, 800, 3])\n 20:50:26 [print] [comfy-env] DESERIALIZED tensor shape: torch.Size([1, 533, 800, 3])\n 20:50:26 [worker] Inputs ready: ['normalization_mode', 'resize_method', 'invert_depth', 'keep_model_size', 'da3_model', 'images']\n 20:50:26 [worker] Input 'images' shape: torch.Size([1, 533, 800, 3])\n 20:50:26 [worker] Importing module nodes.nodes_inference...\n 20:50:26 [worker] Module imported\n 20:50:26 [worker] Getting class DepthAnything_V3...\n 20:50:26 [worker] Creating instance...\n 20:50:26 [worker] Calling EXECUTE_NORMALIZED...\n 20:50:26 [log] WARNING: No comfy kitchen, using old apply_rope functions.\n 20:50:34 [worker] load_models_gpu shim: 1 models, 0.82 GB total\n 20:50:34 [worker] Set EXTRA_RESERVED_VRAM = 0.42 GB\n 20:50:34 [worker] Set vram_state = SHARED\n 20:50:46 [worker] Models loaded via real load_models_gpu\n", 'exception_type': 'RuntimeError', 'traceback': [' File "/Users/runner/work/comfy-gpu-ci/comfy-gpu-ci/test_workspaces/DepthAnythingV3-2043/ComfyUI/execution.py", line 535, in execute\n output_data, output_ui, has_subgraph, has_pending_tasks = await get_output_data(prompt_id, unique_id, obj, input_data_all, execution_block_cb=execution_block_cb, pre_execute_cb=pre_execute_cb, v3_data=v3_data)\n ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^\n', ' File "/Users/runner/work/comfy-gpu-ci/comfy-gpu-ci/test_workspaces/DepthAnythingV3-2043/ComfyUI/execution.py", line 335, in get_output_data\n return_values = await _async_map_node_over_list(prompt_id, unique_id, obj, input_data_all, obj.FUNCTION, allow_interrupt=True, execution_block_cb=execution_block_cb, pre_execute_cb=pre_execute_cb, v3_data=v3_data)\n ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^\n', ' File "/Users/runner/work/comfy-gpu-ci/comfy-gpu-ci/test_workspaces/DepthAnythingV3-2043/ComfyUI/execution.py", line 309, in _async_map_node_over_list\n await process_inputs(input_dict, i)\n', ' File "/Users/runner/work/comfy-gpu-ci/comfy-gpu-ci/test_workspaces/DepthAnythingV3-2043/ComfyUI/execution.py", line 297, in process_inputs\n result = f(**inputs)\n ^^^^^^^^^^^\n', ' File "/Users/runner/work/comfy-gpu-ci/comfy-gpu-ci/test_workspaces/DepthAnythingV3-2043/venv/lib/python3.11/site-packages/comfy_env/isolation/metadata.py", line 536, in proxy\n result = worker.call_method(\n ^^^^^^^^^^^^^^^^^^^\n', ' File "/Users/runner/work/comfy-gpu-ci/comfy-gpu-ci/test_workspaces/DepthAnythingV3-2043/venv/lib/python3.11/site-packages/comfy_env/isolation/workers/subprocess.py", line 669, in call_method\n response = self._send_request(request, timeout)\n ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^\n', ' File "/Users/runner/work/comfy-gpu-ci/comfy-gpu-ci/test_workspaces/DepthAnythingV3-2043/venv/lib/python3.11/site-packages/comfy_env/isolation/workers/subprocess.py", line 589, in _send_request\n raise RuntimeError(\n'], 'current_inputs': {'normalization_mode': ['Raw'], 'resize_method': ['resize'], 'invert_depth': [False], 'keep_model_size': [False], 'da3_model': ["{'model_path': '/Users/runner/work/comfy-gpu-ci/comfy-gpu-ci/test_workspaces/DepthAnythingV3-2043/ComfyUI/models/depthanything3/da3_large.safetensors', 'model_key': 'da3-large', 'dtype': 'bf16', 'attention': 'auto'}"], 'images': ['tensor([[[[0.8549, 0.4863, 0.3216],\n [0.9098, 0.5412, 0.3765],\n [0.9333, 0.5529, 0.3922],\n ...,\n [0.4784, 0.3529, 0.3098],\n [0.4784, 0.3569, 0.3020],\n [0.4667, 0.3451, 0.2902]],\n\n [[0.9529, 0.5843, 0.4196],\n [0.9529, 0.5843, 0.4196],\n [0.9490, 0.5686, 0.4078],\n ...,\n [0.4980, 0.3725, 0.3294],\n [0.4824, 0.3608, 0.3059],\n [0.4706, 0.3490, 0.2941]],\n\n [[0.8392, 0.4627, 0.2902],\n [0.8118, 0.4353, 0.2627],\n [0.7451, 0.3608, 0.1922],\n ...,\n [0.4902, 0.3569, 0.3176],\n [0.5216, 0.3882, 0.3490],\n [0.4824, 0.3490, 0.3098]],\n\n ...,\n\n [[0.9490, 0.6078, 0.4157],\n [0.9294, 0.5882, 0.3961],\n [0.9490, 0.6353, 0.4588],\n ...,\n [0.5569, 0.3216, 0.2039],\n [0.5882, 0.3686, 0.2392],\n [0.5882, 0.3686, 0.2392]],\n\n [[0.9490, 0.5961, 0.4000],\n [0.9686, 0.6157, 0.4196],\n [0.9843, 0.6745, 0.5059],\n ...,\n [0.5412, 0.3059, 0.1961],\n [0.5725, 0.3529, 0.2314],\n [0.5725, 0.3529, 0.2314]],\n\n [[0.9608, 0.6000, 0.4078],\n [0.9961, 0.6353, 0.4431],\n [0.9922, 0.6902, 0.5255],\n ...,\n [0.5373, 0.3020, 0.1922],\n [0.5529, 0.3333, 0.2118],\n [0.5451, 0.3255, 0.2039]]]])']}, 'current_outputs': ['25', '21', '2', '23', '3', '22'], 'timestamp': 1778446246935}
[06:50] Capturing execution frames: advanced_3d_multiview.json
[06:55] Frame 1 saved (frame_000.jpg, t=0.0s)
[06:55] Validating workflow...
[06:55] [ComfyUI] === /validate endpoint called ===
[06:55] [ComfyUI] Received JSON with keys: ['prompt']
[06:55] [ComfyUI] Prompt has 8 nodes
[06:55] [ComfyUI] Node 3: DownloadAndLoadDepthAnythingV3Model
[06:55] [ComfyUI] Inputs: {"model": "da3_large.safetensors", "precision": "auto", "attention": "auto"}
[06:55] [ComfyUI] Node 21: LoadImageDataSetFromFolder
[06:55] [ComfyUI] Inputs: {"folder": "SOH"}
[06:55] [ComfyUI] Node 27: PreviewImage
[06:55] [ComfyUI] Inputs: {"images": ["21", 0]}
[06:55] [ComfyUI] Node 38: DA3_MultiViewPointCloud
[06:55] [ComfyUI] Inputs: {"extrinsics": ["39", 4], "intrinsics": ["39", 5], "confidence_threshold": 0.3, "downsample": 4, "use_icp": false, "allow_around_1": false, "filter_outliers": true, "outlier_percentage": 5, "depths":
[06:55] [ComfyUI] Node 39: DepthAnythingV3_MultiView
[06:55] [ComfyUI] Inputs: {"normalization_mode": "Raw", "resize_method": "resize", "invert_depth": false, "keep_model_size": false, "da3_model": ["3", 0], "images": ["21", 0]}
[06:55] [ComfyUI] Node 44: DA3_SavePointCloud
[06:55] [ComfyUI] Inputs: {"filename_prefix": "pointcloud", "pointcloud": ["38", 0]}
[06:55] [ComfyUI] Node 45: PreviewAny
[06:55] [ComfyUI] Inputs: {"source": ["44", 0]}
[06:55] [ComfyUI] Node 48: DA3_PreviewPointCloud
[06:55] [ComfyUI] Inputs: {"file_path": ["44", 0], "color_mode": "RGB", "preview_vtk": ""}
[06:55] [ComfyUI] Generated prompt_id: fca07f11-8377-46f3-8d82-961a908a2e6c
[06:55] [ComfyUI] Calling execution.validate_prompt()...
[06:55] [ComfyUI] Validation result: valid=True
[06:55] [ComfyUI] === Validation PASSED ===
[06:55] Queuing workflow for execution...
[06:55] [ComfyUI] got prompt
[06:56] [ComfyUI] [comfy-env] Running DownloadAndLoadDepthAnythingV3Model: model: 'da3_large.safetensors', precision: 'auto', attention: 'auto'
[06:56] [ComfyUI] [comfy-env] SubprocessWorker: /Users/runner/work/comfy-gpu-ci/comfy-gpu-ci/test_workspaces/DepthAnythingV3-2043/ComfyUI/.ce/.pixi/envs/depthanythingv3-nodes/bin/python
[06:56] [ComfyUI] [comfy-env] env_vars: {'COMFYUI_BASE': '/Users/runner/work/comfy-gpu-ci/comfy-gpu-ci/test_workspaces/DepthAnythingV3-2043/ComfyUI'}
[06:56] [ComfyUI] [SubprocessWorker] call_method: nodes.load_model.DownloadAndLoadDepthAnythingV3Model.EXECUTE_NORMALIZED
[06:56] [ComfyUI] [SubprocessWorker] acquired lock, ensuring started...
[06:56] [ComfyUI] [ComfyUI-DepthAnythingV3] python: /Users/runner/work/comfy-gpu-ci/comfy-gpu-ci/test_workspaces/DepthAnythingV3-2043/ComfyUI/.ce/.pixi/envs/depthanythingv3-nodes/bin/python
[06:56] [ComfyUI] [ComfyUI-DepthAnythingV3] sys_path sent to worker: ['/Users/runner/work/comfy-gpu-ci/comfy-gpu-ci/test_workspaces/DepthAnythingV3-2043/ComfyUI', '/Users/runner/work/comfy-gpu-ci/comfy-gpu-ci/test_workspaces/DepthAnythingV3-2043/ComfyUI/custom_nodes/ComfyUI-DepthAnythingV3', '/Users/runner/work/comfy-gpu-ci/comfy-gpu-ci/test_workspaces/DepthAnythingV3-2043/ComfyUI/.ce/.pixi/envs/depthanythingv3-nodes/lib/python3.11/site-packages', '/Users/runner/work/comfy-gpu-ci/comfy-gpu-ci/test_workspaces/DepthAnythingV3-2043/ComfyUI/custom_nodes/ComfyUI-DepthAnythingV3']
[06:56] [ComfyUI] [SubprocessWorker] is_pixi=True, python=/Users/runner/work/comfy-gpu-ci/comfy-gpu-ci/test_workspaces/DepthAnythingV3-2043/ComfyUI/.ce/.pixi/envs/depthanythingv3-nodes/bin/python
[06:56] [ComfyUI] [SubprocessWorker] launching cmd=['/Users/runner/.pixi/bin/pixi', 'run', '--as-is', '--manifest-path', '/Users/runner/work/comfy-gpu-ci/comfy-gpu-ci/test_workspaces/DepthAnythingV3-2043/ComfyUI/.ce/pixi.toml', '-e', 'depthanythingv3-nodes', 'python', '/var/folders/tb/y368xp_x10s3ty1b_mtl5mxr0000gn/T/comfyui_pvenv_11abiltf/persistent_worker.py', 'unix:///var/folders/tb/y368xp_x10s3ty1b_mtl5mxr0000gn/T/comfy_worker_56480701b601.sock']...
[06:56] [ComfyUI] [SubprocessWorker] socket_addr=unix:///var/folders/tb/y368xp_x10s3ty1b_mtl5mxr0000gn/T/comfy_worker_56480701b601.sock exists=True
[06:56] Node executed (1 total), capturing...
[06:56] [capture-node] freeze=12ms shot=135ms unfreeze=2ms saved=False
[06:57] [ComfyUI] [worker:ComfyUI-DepthAnythingV3] ERROR: Failed to import comfy_kitchen, Error: No module named 'comfy_kitchen', fp8 and fp4 support will not be available.
[06:57] [ComfyUI] [SubprocessWorker] worker started/confirmed
[06:57] [ComfyUI] [SubprocessWorker] serializing kwargs to shm...
[06:57] [ComfyUI] [SubprocessWorker] created 0 shm blocks
[06:57] [ComfyUI] [SubprocessWorker] sending request via socket...
[06:57] [ComfyUI] [SubprocessWorker] call_id=1 sending call_method
[06:57] [ComfyUI] [SubprocessWorker] got response: ok
[06:57] [ComfyUI] [comfy-env] DownloadAndLoadDepthAnythingV3Model done (1.92s): result: NodeOutput
[06:57] [ComfyUI] [comfy-env] Running DepthAnythingV3_MultiView: normalization_mode: 'Raw', resize_method: 'resize', invert_depth: False, keep_model_size: False, da3_model: dict, images: torch.float32 [1,680,1208,3] cpu
[06:57] [ComfyUI] [SubprocessWorker] call_method: nodes.nodes_multiview.DepthAnythingV3_MultiView.EXECUTE_NORMALIZED
[06:57] [ComfyUI] [SubprocessWorker] acquired lock, ensuring started...
[06:57] [ComfyUI] [ComfyUI-DepthAnythingV3] Health check: ping (timeout=5.0s)...
[06:57] [ComfyUI] [ComfyUI-DepthAnythingV3] Health check: ok
[06:57] [ComfyUI] [SubprocessWorker] worker started/confirmed
[06:57] [ComfyUI] [comfy-env] PRE-SERIALIZE 'images' shape: torch.Size([1, 680, 1208, 3])
[06:57] [ComfyUI] [SubprocessWorker] serializing kwargs to shm...
[06:57] [ComfyUI] [SubprocessWorker] created 0 shm blocks
[06:57] [ComfyUI] [SubprocessWorker] sending request via socket...
[06:57] [ComfyUI] [SubprocessWorker] call_id=2 sending call_method
[06:57] [ComfyUI] [worker:ComfyUI-DepthAnythingV3] [comfy-env] _from_shm got dict with keys: ['__type__', 'strategy', 'manager_path', 'storage_key', 'storage_size']
[06:57] [ComfyUI] [worker:ComfyUI-DepthAnythingV3] [comfy-env] DESERIALIZE TensorRef: tensor_size=[1, 680, 1208, 3]
[06:57] [ComfyUI] [worker:ComfyUI-DepthAnythingV3] [comfy-env] DESERIALIZED tensor shape: torch.Size([1, 680, 1208, 3])
[06:58] [ComfyUI] [worker:ComfyUI-DepthAnythingV3] WARNING: No comfy kitchen, using old apply_rope functions.
[07:01] [capture-loop] iter=50 t=5.8s state={'complete': False, 'error': None, 'executedCount': 1, 'wsState': 1} eval_ms=4 ram=3.7/7.0GB (59%) swap=0.4/1.0GB (41%) cpu=65% browser_rss=0.69GB
[07:05] [ComfyUI] [SubprocessWorker] callback 'request_vram_budget' from call_id=2
[07:05] [ComfyUI] [comfy-env] VRAM request: 0.82GB, free before eviction: 2.83GB
[07:05] [ComfyUI] [comfy-env] VRAM after eviction: 2.82GB
[07:07] [capture-loop] iter=100 t=12.1s state={'complete': False, 'error': None, 'executedCount': 1, 'wsState': 1} eval_ms=2 ram=3.6/7.0GB (75%) swap=0.4/1.0GB (41%) cpu=65% browser_rss=0.35GB
[07:13] [capture-loop] iter=150 t=17.6s state={'complete': False, 'error': None, 'executedCount': 1, 'wsState': 1} eval_ms=2 ram=3.6/7.0GB (74%) swap=0.4/1.0GB (41%) cpu=63% browser_rss=0.32GB
[07:17] [ComfyUI] /AppleInternal/Library/BuildRoots/4~B5vFugBcKzdCtMw80UR1WFCTSITbUVQOwkJg1SQ/Library/Caches/com.apple.xbs/Sources/MetalPerformanceShaders/MPSCore/Utility/MPSLibrary.mm:579: failed assertion `MPSKernel MTLComputePipelineStateCache unable to load function ndArrayConvolution2D.
[07:17] [ComfyUI] Compilation failed: (null)
[07:17] [ComfyUI] '
[07:18] [ComfyUI] !!! Exception during processing !!! ComfyUI-DepthAnythingV3: Socket closed but worker process still running.
[07:18] [ComfyUI] exit code: None
[07:18] [ComfyUI] worker log (/var/folders/tb/y368xp_x10s3ty1b_mtl5mxr0000gn/T/comfy_worker_debug.log, last 20 lines):
[07:18] [ComfyUI] 20:50:55 [worker] Request: call_method nodes.nodes_multiview call_id=2
[07:18] [ComfyUI] 20:50:55 [worker] Reconstructing inputs from shm...
[07:18] [ComfyUI] 20:50:55 [_from_shm] top-level keys: ['normalization_mode', 'resize_method', 'invert_depth', 'keep_model_size', 'da3_model', 'images']
[07:18] [ComfyUI] 20:50:55 [print] [comfy-env] _from_shm got dict with keys: ['__type__', 'strategy', 'manager_path', 'storage_key', 'storage_size']
[07:18] [ComfyUI] 20:50:55 [_from_shm] images: TensorRef tensor_size=[1, 680, 1208, 3]
[07:18] [ComfyUI] 20:50:55 [print] [comfy-env] DESERIALIZE TensorRef: tensor_size=[1, 680, 1208, 3]
[07:18] [ComfyUI] 20:50:55 [_from_shm] images: TensorRef deserialized shape=torch.Size([1, 680, 1208, 3])
[07:18] [ComfyUI] 20:50:55 [print] [comfy-env] DESERIALIZED tensor shape: torch.Size([1, 680, 1208, 3])
[07:18] [ComfyUI] 20:50:55 [worker] Inputs ready: ['normalization_mode', 'resize_method', 'invert_depth', 'keep_model_size', 'da3_model', 'images']
[07:18] [ComfyUI] 20:50:55 [worker] Input 'images' shape: torch.Size([1, 680, 1208, 3])
[07:18] [ComfyUI] 20:50:55 [worker] Importing module nodes.nodes_multiview...
[07:18] [ComfyUI] 20:50:55 [worker] Module imported
[07:18] [ComfyUI] 20:50:55 [worker] Getting class DepthAnythingV3_MultiView...
[07:18] [ComfyUI] 20:50:55 [worker] Creating instance...
[07:18] [ComfyUI] 20:50:55 [worker] Calling EXECUTE_NORMALIZED...
[07:18] [ComfyUI] 20:50:55 [log] WARNING: No comfy kitchen, using old apply_rope functions.
[07:18] [ComfyUI] 20:51:02 [worker] load_models_gpu shim: 1 models, 0.82 GB total
[07:18] [ComfyUI] 20:51:02 [worker] Set EXTRA_RESERVED_VRAM = 0.42 GB
[07:18] [ComfyUI] 20:51:02 [worker] Set vram_state = SHARED
[07:18] [ComfyUI] 20:51:15 [worker] Models loaded via real load_models_gpu
[07:18] [ComfyUI] Traceback (most recent call last):
[07:18] [ComfyUI] File "/Users/runner/work/comfy-gpu-ci/comfy-gpu-ci/test_workspaces/DepthAnythingV3-2043/venv/lib/python3.11/site-packages/comfy_env/isolation/workers/subprocess.py", line 558, in _send_request
[07:18] [ComfyUI] response = self._transport.recv(timeout=timeout)
[07:18] [ComfyUI] ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
[07:18] [ComfyUI] File "/Users/runner/work/comfy-gpu-ci/comfy-gpu-ci/test_workspaces/DepthAnythingV3-2043/venv/lib/python3.11/site-packages/comfy_env/isolation/workers/_ipc_parent.py", line 166, in recv
[07:18] [ComfyUI] raise ConnectionError("Socket closed")
[07:18] [ComfyUI] ConnectionError: Socket closed
[07:18] [ComfyUI]
[07:18] [ComfyUI] The above exception was the direct cause of the following exception:
[07:18] [ComfyUI]
[07:18] [ComfyUI] Traceback (most recent call last):
[07:18] [ComfyUI] File "/Users/runner/work/comfy-gpu-ci/comfy-gpu-ci/test_workspaces/DepthAnythingV3-2043/ComfyUI/execution.py", line 535, in execute
[07:18] [ComfyUI] output_data, output_ui, has_subgraph, has_pending_tasks = await get_output_data(prompt_id, unique_id, obj, input_data_all, execution_block_cb=execution_block_cb, pre_execute_cb=pre_execute_cb, v3_data=v3_data)
[07:18] [ComfyUI] ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
[07:18] [ComfyUI] File "/Users/runner/work/comfy-gpu-ci/comfy-gpu-ci/test_workspaces/DepthAnythingV3-2043/ComfyUI/execution.py", line 335, in get_output_data
[07:18] [ComfyUI] return_values = await _async_map_node_over_list(prompt_id, unique_id, obj, input_data_all, obj.FUNCTION, allow_interrupt=True, execution_block_cb=execution_block_cb, pre_execute_cb=pre_execute_cb, v3_data=v3_data)
[07:18] [ComfyUI] ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
[07:18] [ComfyUI] File "/Users/runner/work/comfy-gpu-ci/comfy-gpu-ci/test_workspaces/DepthAnythingV3-2043/ComfyUI/execution.py", line 309, in _async_map_node_over_list
[07:18] [ComfyUI] await process_inputs(input_dict, i)
[07:18] [ComfyUI] File "/Users/runner/work/comfy-gpu-ci/comfy-gpu-ci/test_workspaces/DepthAnythingV3-2043/ComfyUI/execution.py", line 297, in process_inputs
[07:18] [ComfyUI] result = f(**inputs)
[07:18] [ComfyUI] ^^^^^^^^^^^
[07:18] [ComfyUI] File "/Users/runner/work/comfy-gpu-ci/comfy-gpu-ci/test_workspaces/DepthAnythingV3-2043/venv/lib/python3.11/site-packages/comfy_env/isolation/metadata.py", line 536, in proxy
[07:18] [ComfyUI] result = worker.call_method(
[07:18] [ComfyUI] ^^^^^^^^^^^^^^^^^^^
[07:18] [ComfyUI] File "/Users/runner/work/comfy-gpu-ci/comfy-gpu-ci/test_workspaces/DepthAnythingV3-2043/venv/lib/python3.11/site-packages/comfy_env/isolation/workers/subprocess.py", line 669, in call_method
[07:18] [ComfyUI] response = self._send_request(request, timeout)
[07:18] [ComfyUI] ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
[07:18] [ComfyUI] File "/Users/runner/work/comfy-gpu-ci/comfy-gpu-ci/test_workspaces/DepthAnythingV3-2043/venv/lib/python3.11/site-packages/comfy_env/isolation/workers/subprocess.py", line 589, in _send_request
[07:18] [ComfyUI] raise RuntimeError(
[07:18] [ComfyUI] RuntimeError: ComfyUI-DepthAnythingV3: Socket closed but worker process still running.
[07:18] [ComfyUI] exit code: None
[07:18] [ComfyUI] worker log (/var/folders/tb/y368xp_x10s3ty1b_mtl5mxr0000gn/T/comfy_worker_debug.log, last 20 lines):
[07:18] [ComfyUI] 20:50:55 [worker] Request: call_method nodes.nodes_multiview call_id=2
[07:18] [ComfyUI] 20:50:55 [worker] Reconstructing inputs from shm...
[07:18] [ComfyUI] 20:50:55 [_from_shm] top-level keys: ['normalization_mode', 'resize_method', 'invert_depth', 'keep_model_size', 'da3_model', 'images']
[07:18] [ComfyUI] 20:50:55 [print] [comfy-env] _from_shm got dict with keys: ['__type__', 'strategy', 'manager_path', 'storage_key', 'storage_size']
[07:18] [ComfyUI] 20:50:55 [_from_shm] images: TensorRef tensor_size=[1, 680, 1208, 3]
[07:18] [ComfyUI] 20:50:55 [print] [comfy-env] DESERIALIZE TensorRef: tensor_size=[1, 680, 1208, 3]
[07:18] [ComfyUI] 20:50:55 [_from_shm] images: TensorRef deserialized shape=torch.Size([1, 680, 1208, 3])
[07:18] [ComfyUI] 20:50:55 [print] [comfy-env] DESERIALIZED tensor shape: torch.Size([1, 680, 1208, 3])
[07:18] [ComfyUI] 20:50:55 [worker] Inputs ready: ['normalization_mode', 'resize_method', 'invert_depth', 'keep_model_size', 'da3_model', 'images']
[07:18] [ComfyUI] 20:50:55 [worker] Input 'images' shape: torch.Size([1, 680, 1208, 3])
[07:18] [ComfyUI] 20:50:55 [worker] Importing module nodes.nodes_multiview...
[07:18] [ComfyUI] 20:50:55 [worker] Module imported
[07:18] [ComfyUI] 20:50:55 [worker] Getting class DepthAnythingV3_MultiView...
[07:18] [ComfyUI] 20:50:55 [worker] Creating instance...
[07:18] [ComfyUI] 20:50:55 [worker] Calling EXECUTE_NORMALIZED...
[07:18] [ComfyUI] 20:50:55 [log] WARNING: No comfy kitchen, using old apply_rope functions.
[07:18] [ComfyUI] 20:51:02 [worker] load_models_gpu shim: 1 models, 0.82 GB total
[07:18] [ComfyUI] 20:51:02 [worker] Set EXTRA_RESERVED_VRAM = 0.42 GB
[07:18] [ComfyUI] 20:51:02 [worker] Set vram_state = SHARED
[07:18] [ComfyUI] 20:51:15 [worker] Models loaded via real load_models_gpu
[07:18] [ComfyUI]
[07:18] [ComfyUI] Prompt executed in 22.17 seconds
[07:18] Execution complete (t=22.4s)
[07:18] Execution error: {'prompt_id': '37cf1384-3766-4e0a-8c44-8e16015f0997', 'node_id': '39', 'node_type': 'DepthAnythingV3_MultiView', 'executed': ['21', '27', '3'], 'exception_message': "ComfyUI-DepthAnythingV3: Socket closed but worker process still running.\n exit code: None\n worker log (/var/folders/tb/y368xp_x10s3ty1b_mtl5mxr0000gn/T/comfy_worker_debug.log, last 20 lines):\n 20:50:55 [worker] Request: call_method nodes.nodes_multiview call_id=2\n 20:50:55 [worker] Reconstructing inputs from shm...\n 20:50:55 [_from_shm] top-level keys: ['normalization_mode', 'resize_method', 'invert_depth', 'keep_model_size', 'da3_model', 'images']\n 20:50:55 [print] [comfy-env] _from_shm got dict with keys: ['__type__', 'strategy', 'manager_path', 'storage_key', 'storage_size']\n 20:50:55 [_from_shm] images: TensorRef tensor_size=[1, 680, 1208, 3]\n 20:50:55 [print] [comfy-env] DESERIALIZE TensorRef: tensor_size=[1, 680, 1208, 3]\n 20:50:55 [_from_shm] images: TensorRef deserialized shape=torch.Size([1, 680, 1208, 3])\n 20:50:55 [print] [comfy-env] DESERIALIZED tensor shape: torch.Size([1, 680, 1208, 3])\n 20:50:55 [worker] Inputs ready: ['normalization_mode', 'resize_method', 'invert_depth', 'keep_model_size', 'da3_model', 'images']\n 20:50:55 [worker] Input 'images' shape: torch.Size([1, 680, 1208, 3])\n 20:50:55 [worker] Importing module nodes.nodes_multiview...\n 20:50:55 [worker] Module imported\n 20:50:55 [worker] Getting class DepthAnythingV3_MultiView...\n 20:50:55 [worker] Creating instance...\n 20:50:55 [worker] Calling EXECUTE_NORMALIZED...\n 20:50:55 [log] WARNING: No comfy kitchen, using old apply_rope functions.\n 20:51:02 [worker] load_models_gpu shim: 1 models, 0.82 GB total\n 20:51:02 [worker] Set EXTRA_RESERVED_VRAM = 0.42 GB\n 20:51:02 [worker] Set vram_state = SHARED\n 20:51:15 [worker] Models loaded via real load_models_gpu\n", 'exception_type': 'RuntimeError', 'traceback': [' File "/Users/runner/work/comfy-gpu-ci/comfy-gpu-ci/test_workspaces/DepthAnythingV3-2043/ComfyUI/execution.py", line 535, in execute\n output_data, output_ui, has_subgraph, has_pending_tasks = await get_output_data(prompt_id, unique_id, obj, input_data_all, execution_block_cb=execution_block_cb, pre_execute_cb=pre_execute_cb, v3_data=v3_data)\n ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^\n', ' File "/Users/runner/work/comfy-gpu-ci/comfy-gpu-ci/test_workspaces/DepthAnythingV3-2043/ComfyUI/execution.py", line 335, in get_output_data\n return_values = await _async_map_node_over_list(prompt_id, unique_id, obj, input_data_all, obj.FUNCTION, allow_interrupt=True, execution_block_cb=execution_block_cb, pre_execute_cb=pre_execute_cb, v3_data=v3_data)\n ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^\n', ' File "/Users/runner/work/comfy-gpu-ci/comfy-gpu-ci/test_workspaces/DepthAnythingV3-2043/ComfyUI/execution.py", line 309, in _async_map_node_over_list\n await process_inputs(input_dict, i)\n', ' File "/Users/runner/work/comfy-gpu-ci/comfy-gpu-ci/test_workspaces/DepthAnythingV3-2043/ComfyUI/execution.py", line 297, in process_inputs\n result = f(**inputs)\n ^^^^^^^^^^^\n', ' File "/Users/runner/work/comfy-gpu-ci/comfy-gpu-ci/test_workspaces/DepthAnythingV3-2043/venv/lib/python3.11/site-packages/comfy_env/isolation/metadata.py", line 536, in proxy\n result = worker.call_method(\n ^^^^^^^^^^^^^^^^^^^\n', ' File "/Users/runner/work/comfy-gpu-ci/comfy-gpu-ci/test_workspaces/DepthAnythingV3-2043/venv/lib/python3.11/site-packages/comfy_env/isolation/workers/subprocess.py", line 669, in call_method\n response = self._send_request(request, timeout)\n ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^\n', ' File "/Users/runner/work/comfy-gpu-ci/comfy-gpu-ci/test_workspaces/DepthAnythingV3-2043/venv/lib/python3.11/site-packages/comfy_env/isolation/workers/subprocess.py", line 589, in _send_request\n raise RuntimeError(\n'], 'current_inputs': {'normalization_mode': ['Raw'], 'resize_method': ['resize'], 'invert_depth': [False], 'keep_model_size': [False], 'da3_model': ["{'model_path': '/Users/runner/work/comfy-gpu-ci/comfy-gpu-ci/test_workspaces/DepthAnythingV3-2043/ComfyUI/models/depthanything3/da3_large.safetensors', 'model_key': 'da3-large', 'dtype': 'bf16', 'attention': 'auto'}"], 'images': ['tensor([[[[0.6157, 0.8706, 1.0000],\n [0.6157, 0.8706, 1.0000],\n [0.6118, 0.8706, 1.0000],\n ...,\n [0.5961, 0.8667, 1.0000],\n [0.5961, 0.8667, 1.0000],\n [0.5961, 0.8667, 1.0000]],\n\n [[0.6157, 0.8706, 1.0000],\n [0.6157, 0.8706, 1.0000],\n [0.6118, 0.8706, 1.0000],\n ...,\n [0.5961, 0.8667, 1.0000],\n [0.5961, 0.8667, 1.0000],\n [0.5961, 0.8667, 1.0000]],\n\n [[0.6118, 0.8706, 1.0000],\n [0.6118, 0.8706, 1.0000],\n [0.6118, 0.8706, 1.0000],\n ...,\n [0.5961, 0.8667, 1.0000],\n [0.5961, 0.8667, 1.0000],\n [0.5961, 0.8667, 1.0000]],\n\n ...,\n\n [[0.3216, 0.4157, 0.4941],\n [0.3216, 0.4157, 0.4941],\n [0.3294, 0.4118, 0.4863],\n ...,\n [0.2863, 0.4039, 0.4980],\n [0.3098, 0.4275, 0.5216],\n [0.3333, 0.4510, 0.5451]],\n\n [[0.3255, 0.4196, 0.4980],\n [0.3216, 0.4157, 0.4941],\n [0.3294, 0.4118, 0.4863],\n ...,\n [0.2275, 0.3451, 0.4392],\n [0.2039, 0.3216, 0.4157],\n [0.2157, 0.3333, 0.4275]],\n\n [[0.3176, 0.4118, 0.4902],\n [0.3216, 0.4157, 0.4941],\n [0.3255, 0.4078, 0.4824],\n ...,\n [0.3137, 0.4314, 0.5255],\n [0.3059, 0.4235, 0.5176],\n [0.2863, 0.4039, 0.4980]]]])', 'tensor([[[[0.6196, 0.8784, 1.0000],\n [0.6196, 0.8784, 1.0000],\n [0.6196, 0.8784, 1.0000],\n ...,\n [0.6000, 0.8784, 1.0000],\n [0.6000, 0.8784, 1.0000],\n [0.6000, 0.8784, 1.0000]],\n\n [[0.6196, 0.8784, 1.0000],\n [0.6196, 0.8784, 1.0000],\n [0.6196, 0.8784, 1.0000],\n ...,\n [0.6000, 0.8784, 1.0000],\n [0.6000, 0.8784, 1.0000],\n [0.6000, 0.8784, 1.0000]],\n\n [[0.6196, 0.8784, 1.0000],\n [0.6196, 0.8784, 1.0000],\n [0.6196, 0.8784, 1.0000],\n ...,\n [0.6000, 0.8784, 1.0000],\n [0.6000, 0.8784, 1.0000],\n [0.6000, 0.8784, 1.0000]],\n\n ...,\n\n [[0.3686, 0.4078, 0.4784],\n [0.3725, 0.4118, 0.4824],\n [0.3686, 0.4078, 0.4784],\n ...,\n [0.2745, 0.4039, 0.4941],\n [0.2941, 0.4235, 0.5137],\n [0.2980, 0.4275, 0.5176]],\n\n [[0.3647, 0.4039, 0.4745],\n [0.3608, 0.4000, 0.4706],\n [0.3647, 0.4039, 0.4745],\n ...,\n [0.3020, 0.4314, 0.5216],\n [0.3255, 0.4549, 0.5451],\n [0.3333, 0.4627, 0.5529]],\n\n [[0.3569, 0.3961, 0.4667],\n [0.3569, 0.3961, 0.4667],\n [0.3569, 0.3961, 0.4667],\n ...,\n [0.3176, 0.4471, 0.5373],\n [0.2941, 0.4235, 0.5137],\n [0.2902, 0.4196, 0.5098]]]])']}, 'current_outputs': ['21', '48', '38', '44', '39', '27', '3', '45'], 'timestamp': 1778446275737}
[07:18] [4/7] SKIPPED (not in cpu list) bas_relief.json
[07:18] [5/7] SKIPPED (not in cpu list) da3_streaming.json
[07:19] Capturing execution frames: simple.json
[07:24] Frame 1 saved (frame_000.jpg, t=0.0s)
[07:24] Validating workflow...
[07:24] [ComfyUI] === /validate endpoint called ===
[07:24] [ComfyUI] Received JSON with keys: ['prompt']
[07:24] [ComfyUI] Prompt has 4 nodes
[07:24] [ComfyUI] Node 2: LoadImage
[07:24] [ComfyUI] Inputs: {"image": "bridge.jpg"}
[07:24] [ComfyUI] Node 3: DownloadAndLoadDepthAnythingV3Model
[07:24] [ComfyUI] Inputs: {"model": "da3_large.safetensors", "precision": "auto", "attention": "auto"}
[07:24] [ComfyUI] Node 4: PreviewImage
[07:24] [ComfyUI] Inputs: {"images": ["14", 0]}
[07:24] [ComfyUI] Node 14: DepthAnything_V3
[07:24] [ComfyUI] Inputs: {"normalization_mode": "V2-Style", "resize_method": "resize", "invert_depth": true, "keep_model_size": false, "da3_model": ["3", 0], "images": ["2", 0]}
[07:24] [ComfyUI] Generated prompt_id: d3d3ef95-bd9e-4bcd-9acd-67a7e41475e7
[07:24] [ComfyUI] Calling execution.validate_prompt()...
[07:24] [ComfyUI] Validation result: valid=True
[07:24] [ComfyUI] === Validation PASSED ===
[07:24] Queuing workflow for execution...
[07:24] [ComfyUI] got prompt
[07:24] [ComfyUI] [comfy-env] Running DownloadAndLoadDepthAnythingV3Model: model: 'da3_large.safetensors', precision: 'auto', attention: 'auto'
[07:24] [ComfyUI] [comfy-env] SubprocessWorker: /Users/runner/work/comfy-gpu-ci/comfy-gpu-ci/test_workspaces/DepthAnythingV3-2043/ComfyUI/.ce/.pixi/envs/depthanythingv3-nodes/bin/python
[07:24] [ComfyUI] [comfy-env] env_vars: {'COMFYUI_BASE': '/Users/runner/work/comfy-gpu-ci/comfy-gpu-ci/test_workspaces/DepthAnythingV3-2043/ComfyUI'}
[07:24] [ComfyUI] [SubprocessWorker] call_method: nodes.load_model.DownloadAndLoadDepthAnythingV3Model.EXECUTE_NORMALIZED
[07:24] [ComfyUI] [SubprocessWorker] acquired lock, ensuring started...
[07:24] [ComfyUI] [ComfyUI-DepthAnythingV3] python: /Users/runner/work/comfy-gpu-ci/comfy-gpu-ci/test_workspaces/DepthAnythingV3-2043/ComfyUI/.ce/.pixi/envs/depthanythingv3-nodes/bin/python
[07:24] [ComfyUI] [ComfyUI-DepthAnythingV3] sys_path sent to worker: ['/Users/runner/work/comfy-gpu-ci/comfy-gpu-ci/test_workspaces/DepthAnythingV3-2043/ComfyUI', '/Users/runner/work/comfy-gpu-ci/comfy-gpu-ci/test_workspaces/DepthAnythingV3-2043/ComfyUI/custom_nodes/ComfyUI-DepthAnythingV3', '/Users/runner/work/comfy-gpu-ci/comfy-gpu-ci/test_workspaces/DepthAnythingV3-2043/ComfyUI/.ce/.pixi/envs/depthanythingv3-nodes/lib/python3.11/site-packages', '/Users/runner/work/comfy-gpu-ci/comfy-gpu-ci/test_workspaces/DepthAnythingV3-2043/ComfyUI/custom_nodes/ComfyUI-DepthAnythingV3']
[07:24] [ComfyUI] [SubprocessWorker] is_pixi=True, python=/Users/runner/work/comfy-gpu-ci/comfy-gpu-ci/test_workspaces/DepthAnythingV3-2043/ComfyUI/.ce/.pixi/envs/depthanythingv3-nodes/bin/python
[07:24] [ComfyUI] [SubprocessWorker] launching cmd=['/Users/runner/.pixi/bin/pixi', 'run', '--as-is', '--manifest-path', '/Users/runner/work/comfy-gpu-ci/comfy-gpu-ci/test_workspaces/DepthAnythingV3-2043/ComfyUI/.ce/pixi.toml', '-e', 'depthanythingv3-nodes', 'python', '/var/folders/tb/y368xp_x10s3ty1b_mtl5mxr0000gn/T/comfyui_pvenv_5cmp9j0v/persistent_worker.py', 'unix:///var/folders/tb/y368xp_x10s3ty1b_mtl5mxr0000gn/T/comfy_worker_c3ec749ddb39.sock']...
[07:24] [ComfyUI] [SubprocessWorker] socket_addr=unix:///var/folders/tb/y368xp_x10s3ty1b_mtl5mxr0000gn/T/comfy_worker_c3ec749ddb39.sock exists=True
[07:26] [ComfyUI] [worker:ComfyUI-DepthAnythingV3] ERROR: Failed to import comfy_kitchen, Error: No module named 'comfy_kitchen', fp8 and fp4 support will not be available.
[07:26] [ComfyUI] [SubprocessWorker] worker started/confirmed
[07:26] [ComfyUI] [SubprocessWorker] serializing kwargs to shm...
[07:26] [ComfyUI] [SubprocessWorker] created 0 shm blocks
[07:26] [ComfyUI] [SubprocessWorker] sending request via socket...
[07:26] [ComfyUI] [SubprocessWorker] call_id=1 sending call_method
[07:26] [ComfyUI] [SubprocessWorker] got response: ok
[07:26] [ComfyUI] [comfy-env] DownloadAndLoadDepthAnythingV3Model done (2.19s): result: NodeOutput
[07:26] [ComfyUI] [comfy-env] Running DepthAnything_V3: normalization_mode: 'V2-Style', resize_method: 'resize', invert_depth: True, keep_model_size: False, da3_model: dict, images: torch.float32 [1,683,1024,3] cpu
[07:26] [ComfyUI] [SubprocessWorker] call_method: nodes.nodes_inference.DepthAnything_V3.EXECUTE_NORMALIZED
[07:26] [ComfyUI] [SubprocessWorker] acquired lock, ensuring started...
[07:26] [ComfyUI] [ComfyUI-DepthAnythingV3] Health check: ping (timeout=5.0s)...
[07:26] [ComfyUI] [ComfyUI-DepthAnythingV3] Health check: ok
[07:26] [ComfyUI] [SubprocessWorker] worker started/confirmed
[07:26] [ComfyUI] [comfy-env] PRE-SERIALIZE 'images' shape: torch.Size([1, 683, 1024, 3])
[07:26] [ComfyUI] [SubprocessWorker] serializing kwargs to shm...
[07:26] [ComfyUI] [SubprocessWorker] created 0 shm blocks
[07:26] [ComfyUI] [SubprocessWorker] sending request via socket...
[07:26] [ComfyUI] [SubprocessWorker] call_id=2 sending call_method
[07:26] [ComfyUI] [worker:ComfyUI-DepthAnythingV3] [comfy-env] _from_shm got dict with keys: ['__type__', 'strategy', 'manager_path', 'storage_key', 'storage_size']
[07:26] [ComfyUI] [worker:ComfyUI-DepthAnythingV3] [comfy-env] DESERIALIZE TensorRef: tensor_size=[1, 683, 1024, 3]
[07:26] [ComfyUI] [worker:ComfyUI-DepthAnythingV3] [comfy-env] DESERIALIZED tensor shape: torch.Size([1, 683, 1024, 3])
[07:27] [ComfyUI] [worker:ComfyUI-DepthAnythingV3] WARNING: No comfy kitchen, using old apply_rope functions.
[07:29] [ComfyUI] [SubprocessWorker] callback 'request_vram_budget' from call_id=2
[07:29] [ComfyUI] [comfy-env] VRAM request: 0.82GB, free before eviction: 3.03GB
[07:29] [ComfyUI] [comfy-env] VRAM after eviction: 3.03GB
[07:29] [capture-loop] iter=50 t=5.6s state={'complete': False, 'error': None, 'executedCount': 0, 'wsState': 1} eval_ms=2 ram=3.7/7.0GB (60%) swap=0.4/1.0GB (41%) cpu=68% browser_rss=0.50GB
[07:35] [capture-loop] iter=100 t=11.3s state={'complete': False, 'error': None, 'executedCount': 0, 'wsState': 1} eval_ms=3 ram=3.8/7.0GB (73%) swap=0.4/1.0GB (41%) cpu=54% browser_rss=0.43GB
[07:41] [capture-loop] iter=150 t=16.7s state={'complete': False, 'error': None, 'executedCount': 0, 'wsState': 1} eval_ms=5 ram=3.8/7.0GB (66%) swap=0.4/1.0GB (41%) cpu=57% browser_rss=0.45GB
[07:41] [ComfyUI] [worker:ComfyUI-DepthAnythingV3] WARNING: WARNING: This model does not support sky segmentation. V2-Style normalization will work but without sky masking. Use Mono/Metric/Nested models for best V2-Style results.
[07:41] [ComfyUI] /AppleInternal/Library/BuildRoots/4~B5vFugBcKzdCtMw80UR1WFCTSITbUVQOwkJg1SQ/Library/Caches/com.apple.xbs/Sources/MetalPerformanceShaders/MPSCore/Utility/MPSLibrary.mm:579: failed assertion `MPSKernel MTLComputePipelineStateCache unable to load function ndArrayConvolution2D.
[07:41] [ComfyUI] Compilation failed: (null)
[07:41] [ComfyUI] '
[07:41] [ComfyUI] !!! Exception during processing !!! ComfyUI-DepthAnythingV3: Socket closed but worker process still running.
[07:41] [ComfyUI] exit code: None
[07:41] [ComfyUI] worker log (/var/folders/tb/y368xp_x10s3ty1b_mtl5mxr0000gn/T/comfy_worker_debug.log, last 20 lines):
[07:41] [ComfyUI] 20:51:24 [worker] Reconstructing inputs from shm...
[07:41] [ComfyUI] 20:51:24 [_from_shm] top-level keys: ['normalization_mode', 'resize_method', 'invert_depth', 'keep_model_size', 'da3_model', 'images']
[07:41] [ComfyUI] 20:51:24 [print] [comfy-env] _from_shm got dict with keys: ['__type__', 'strategy', 'manager_path', 'storage_key', 'storage_size']
[07:41] [ComfyUI] 20:51:24 [_from_shm] images: TensorRef tensor_size=[1, 683, 1024, 3]
[07:41] [ComfyUI] 20:51:24 [print] [comfy-env] DESERIALIZE TensorRef: tensor_size=[1, 683, 1024, 3]
[07:41] [ComfyUI] 20:51:24 [_from_shm] images: TensorRef deserialized shape=torch.Size([1, 683, 1024, 3])
[07:41] [ComfyUI] 20:51:24 [print] [comfy-env] DESERIALIZED tensor shape: torch.Size([1, 683, 1024, 3])
[07:41] [ComfyUI] 20:51:24 [worker] Inputs ready: ['normalization_mode', 'resize_method', 'invert_depth', 'keep_model_size', 'da3_model', 'images']
[07:41] [ComfyUI] 20:51:24 [worker] Input 'images' shape: torch.Size([1, 683, 1024, 3])
[07:41] [ComfyUI] 20:51:24 [worker] Importing module nodes.nodes_inference...
[07:41] [ComfyUI] 20:51:24 [worker] Module imported
[07:41] [ComfyUI] 20:51:24 [worker] Getting class DepthAnything_V3...
[07:41] [ComfyUI] 20:51:24 [worker] Creating instance...
[07:41] [ComfyUI] 20:51:24 [worker] Calling EXECUTE_NORMALIZED...
[07:41] [ComfyUI] 20:51:24 [log] WARNING: No comfy kitchen, using old apply_rope functions.
[07:41] [ComfyUI] 20:51:27 [worker] load_models_gpu shim: 1 models, 0.82 GB total
[07:41] [ComfyUI] 20:51:27 [worker] Set EXTRA_RESERVED_VRAM = 0.42 GB
[07:41] [ComfyUI] 20:51:27 [worker] Set vram_state = SHARED
[07:41] [ComfyUI] 20:51:38 [worker] Models loaded via real load_models_gpu
[07:41] [ComfyUI] 20:51:38 [log] WARNING: WARNING: This model does not support sky segmentation. V2-Style normalization will work but without sky masking. Use Mono/Metric/Nested models for best V2-Style results.
[07:41] [ComfyUI] Traceback (most recent call last):
[07:41] [ComfyUI] File "/Users/runner/work/comfy-gpu-ci/comfy-gpu-ci/test_workspaces/DepthAnythingV3-2043/venv/lib/python3.11/site-packages/comfy_env/isolation/workers/subprocess.py", line 558, in _send_request
[07:41] [ComfyUI] response = self._transport.recv(timeout=timeout)
[07:41] [ComfyUI] ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
[07:41] [ComfyUI] File "/Users/runner/work/comfy-gpu-ci/comfy-gpu-ci/test_workspaces/DepthAnythingV3-2043/venv/lib/python3.11/site-packages/comfy_env/isolation/workers/_ipc_parent.py", line 166, in recv
[07:41] [ComfyUI] raise ConnectionError("Socket closed")
[07:41] [ComfyUI] ConnectionError: Socket closed
[07:41] [ComfyUI]
[07:41] [ComfyUI] The above exception was the direct cause of the following exception:
[07:41] [ComfyUI]
[07:41] [ComfyUI] Traceback (most recent call last):
[07:41] [ComfyUI] File "/Users/runner/work/comfy-gpu-ci/comfy-gpu-ci/test_workspaces/DepthAnythingV3-2043/ComfyUI/execution.py", line 535, in execute
[07:41] [ComfyUI] output_data, output_ui, has_subgraph, has_pending_tasks = await get_output_data(prompt_id, unique_id, obj, input_data_all, execution_block_cb=execution_block_cb, pre_execute_cb=pre_execute_cb, v3_data=v3_data)
[07:41] [ComfyUI] ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
[07:41] [ComfyUI] File "/Users/runner/work/comfy-gpu-ci/comfy-gpu-ci/test_workspaces/DepthAnythingV3-2043/ComfyUI/execution.py", line 335, in get_output_data
[07:41] [ComfyUI] return_values = await _async_map_node_over_list(prompt_id, unique_id, obj, input_data_all, obj.FUNCTION, allow_interrupt=True, execution_block_cb=execution_block_cb, pre_execute_cb=pre_execute_cb, v3_data=v3_data)
[07:41] [ComfyUI] ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
[07:41] [ComfyUI] File "/Users/runner/work/comfy-gpu-ci/comfy-gpu-ci/test_workspaces/DepthAnythingV3-2043/ComfyUI/execution.py", line 309, in _async_map_node_over_list
[07:41] [ComfyUI] await process_inputs(input_dict, i)
[07:41] [ComfyUI] File "/Users/runner/work/comfy-gpu-ci/comfy-gpu-ci/test_workspaces/DepthAnythingV3-2043/ComfyUI/execution.py", line 297, in process_inputs
[07:41] [ComfyUI] result = f(**inputs)
[07:41] [ComfyUI] ^^^^^^^^^^^
[07:41] [ComfyUI] File "/Users/runner/work/comfy-gpu-ci/comfy-gpu-ci/test_workspaces/DepthAnythingV3-2043/venv/lib/python3.11/site-packages/comfy_env/isolation/metadata.py", line 536, in proxy
[07:41] [ComfyUI] result = worker.call_method(
[07:41] [ComfyUI] ^^^^^^^^^^^^^^^^^^^
[07:41] [ComfyUI] File "/Users/runner/work/comfy-gpu-ci/comfy-gpu-ci/test_workspaces/DepthAnythingV3-2043/venv/lib/python3.11/site-packages/comfy_env/isolation/workers/subprocess.py", line 669, in call_method
[07:41] [ComfyUI] response = self._send_request(request, timeout)
[07:41] [ComfyUI] ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
[07:41] [ComfyUI] File "/Users/runner/work/comfy-gpu-ci/comfy-gpu-ci/test_workspaces/DepthAnythingV3-2043/venv/lib/python3.11/site-packages/comfy_env/isolation/workers/subprocess.py", line 589, in _send_request
[07:41] [ComfyUI] raise RuntimeError(
[07:41] [ComfyUI] RuntimeError: ComfyUI-DepthAnythingV3: Socket closed but worker process still running.
[07:41] [ComfyUI] exit code: None
[07:41] [ComfyUI] worker log (/var/folders/tb/y368xp_x10s3ty1b_mtl5mxr0000gn/T/comfy_worker_debug.log, last 20 lines):
[07:41] [ComfyUI] 20:51:24 [worker] Reconstructing inputs from shm...
[07:41] [ComfyUI] 20:51:24 [_from_shm] top-level keys: ['normalization_mode', 'resize_method', 'invert_depth', 'keep_model_size', 'da3_model', 'images']
[07:41] [ComfyUI] 20:51:24 [print] [comfy-env] _from_shm got dict with keys: ['__type__', 'strategy', 'manager_path', 'storage_key', 'storage_size']
[07:41] [ComfyUI] 20:51:24 [_from_shm] images: TensorRef tensor_size=[1, 683, 1024, 3]
[07:41] [ComfyUI] 20:51:24 [print] [comfy-env] DESERIALIZE TensorRef: tensor_size=[1, 683, 1024, 3]
[07:41] [ComfyUI] 20:51:24 [_from_shm] images: TensorRef deserialized shape=torch.Size([1, 683, 1024, 3])
[07:41] [ComfyUI] 20:51:24 [print] [comfy-env] DESERIALIZED tensor shape: torch.Size([1, 683, 1024, 3])
[07:41] [ComfyUI] 20:51:24 [worker] Inputs ready: ['normalization_mode', 'resize_method', 'invert_depth', 'keep_model_size', 'da3_model', 'images']
[07:41] [ComfyUI] 20:51:24 [worker] Input 'images' shape: torch.Size([1, 683, 1024, 3])
[07:41] [ComfyUI] 20:51:24 [worker] Importing module nodes.nodes_inference...
[07:41] [ComfyUI] 20:51:24 [worker] Module imported
[07:41] [ComfyUI] 20:51:24 [worker] Getting class DepthAnything_V3...
[07:41] [ComfyUI] 20:51:24 [worker] Creating instance...
[07:41] [ComfyUI] 20:51:24 [worker] Calling EXECUTE_NORMALIZED...
[07:41] [ComfyUI] 20:51:24 [log] WARNING: No comfy kitchen, using old apply_rope functions.
[07:41] [ComfyUI] 20:51:27 [worker] load_models_gpu shim: 1 models, 0.82 GB total
[07:41] [ComfyUI] 20:51:27 [worker] Set EXTRA_RESERVED_VRAM = 0.42 GB
[07:41] [ComfyUI] 20:51:27 [worker] Set vram_state = SHARED
[07:41] [ComfyUI] 20:51:38 [worker] Models loaded via real load_models_gpu
[07:41] [ComfyUI] 20:51:38 [log] WARNING: WARNING: This model does not support sky segmentation. V2-Style normalization will work but without sky masking. Use Mono/Metric/Nested models for best V2-Style results.
[07:41] [ComfyUI]
[07:41] [ComfyUI] Prompt executed in 16.85 seconds
[07:41] Execution complete (t=17.2s)
[07:41] Execution error: {'prompt_id': 'b4778ef9-dd44-4184-bb40-0b5de780b14a', 'node_id': '14', 'node_type': 'DepthAnything_V3', 'executed': ['2', '3'], 'exception_message': "ComfyUI-DepthAnythingV3: Socket closed but worker process still running.\n exit code: None\n worker log (/var/folders/tb/y368xp_x10s3ty1b_mtl5mxr0000gn/T/comfy_worker_debug.log, last 20 lines):\n 20:51:24 [worker] Reconstructing inputs from shm...\n 20:51:24 [_from_shm] top-level keys: ['normalization_mode', 'resize_method', 'invert_depth', 'keep_model_size', 'da3_model', 'images']\n 20:51:24 [print] [comfy-env] _from_shm got dict with keys: ['__type__', 'strategy', 'manager_path', 'storage_key', 'storage_size']\n 20:51:24 [_from_shm] images: TensorRef tensor_size=[1, 683, 1024, 3]\n 20:51:24 [print] [comfy-env] DESERIALIZE TensorRef: tensor_size=[1, 683, 1024, 3]\n 20:51:24 [_from_shm] images: TensorRef deserialized shape=torch.Size([1, 683, 1024, 3])\n 20:51:24 [print] [comfy-env] DESERIALIZED tensor shape: torch.Size([1, 683, 1024, 3])\n 20:51:24 [worker] Inputs ready: ['normalization_mode', 'resize_method', 'invert_depth', 'keep_model_size', 'da3_model', 'images']\n 20:51:24 [worker] Input 'images' shape: torch.Size([1, 683, 1024, 3])\n 20:51:24 [worker] Importing module nodes.nodes_inference...\n 20:51:24 [worker] Module imported\n 20:51:24 [worker] Getting class DepthAnything_V3...\n 20:51:24 [worker] Creating instance...\n 20:51:24 [worker] Calling EXECUTE_NORMALIZED...\n 20:51:24 [log] WARNING: No comfy kitchen, using old apply_rope functions.\n 20:51:27 [worker] load_models_gpu shim: 1 models, 0.82 GB total\n 20:51:27 [worker] Set EXTRA_RESERVED_VRAM = 0.42 GB\n 20:51:27 [worker] Set vram_state = SHARED\n 20:51:38 [worker] Models loaded via real load_models_gpu\n 20:51:38 [log] WARNING: WARNING: This model does not support sky segmentation. V2-Style normalization will work but without sky masking. Use Mono/Metric/Nested models for best V2-Style results.\n", 'exception_type': 'RuntimeError', 'traceback': [' File "/Users/runner/work/comfy-gpu-ci/comfy-gpu-ci/test_workspaces/DepthAnythingV3-2043/ComfyUI/execution.py", line 535, in execute\n output_data, output_ui, has_subgraph, has_pending_tasks = await get_output_data(prompt_id, unique_id, obj, input_data_all, execution_block_cb=execution_block_cb, pre_execute_cb=pre_execute_cb, v3_data=v3_data)\n ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^\n', ' File "/Users/runner/work/comfy-gpu-ci/comfy-gpu-ci/test_workspaces/DepthAnythingV3-2043/ComfyUI/execution.py", line 335, in get_output_data\n return_values = await _async_map_node_over_list(prompt_id, unique_id, obj, input_data_all, obj.FUNCTION, allow_interrupt=True, execution_block_cb=execution_block_cb, pre_execute_cb=pre_execute_cb, v3_data=v3_data)\n ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^\n', ' File "/Users/runner/work/comfy-gpu-ci/comfy-gpu-ci/test_workspaces/DepthAnythingV3-2043/ComfyUI/execution.py", line 309, in _async_map_node_over_list\n await process_inputs(input_dict, i)\n', ' File "/Users/runner/work/comfy-gpu-ci/comfy-gpu-ci/test_workspaces/DepthAnythingV3-2043/ComfyUI/execution.py", line 297, in process_inputs\n result = f(**inputs)\n ^^^^^^^^^^^\n', ' File "/Users/runner/work/comfy-gpu-ci/comfy-gpu-ci/test_workspaces/DepthAnythingV3-2043/venv/lib/python3.11/site-packages/comfy_env/isolation/metadata.py", line 536, in proxy\n result = worker.call_method(\n ^^^^^^^^^^^^^^^^^^^\n', ' File "/Users/runner/work/comfy-gpu-ci/comfy-gpu-ci/test_workspaces/DepthAnythingV3-2043/venv/lib/python3.11/site-packages/comfy_env/isolation/workers/subprocess.py", line 669, in call_method\n response = self._send_request(request, timeout)\n ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^\n', ' File "/Users/runner/work/comfy-gpu-ci/comfy-gpu-ci/test_workspaces/DepthAnythingV3-2043/venv/lib/python3.11/site-packages/comfy_env/isolation/workers/subprocess.py", line 589, in _send_request\n raise RuntimeError(\n'], 'current_inputs': {'normalization_mode': ['V2-Style'], 'resize_method': ['resize'], 'invert_depth': [True], 'keep_model_size': [False], 'da3_model': ["{'model_path': '/Users/runner/work/comfy-gpu-ci/comfy-gpu-ci/test_workspaces/DepthAnythingV3-2043/ComfyUI/models/depthanything3/da3_large.safetensors', 'model_key': 'da3-large', 'dtype': 'bf16', 'attention': 'auto'}"], 'images': ['tensor([[[[0.0000, 0.0000, 0.0000],\n [0.0000, 0.0000, 0.0000],\n [0.0000, 0.0000, 0.0000],\n ...,\n [0.0000, 0.0000, 0.0000],\n [0.0000, 0.0000, 0.0000],\n [0.0000, 0.0000, 0.0000]],\n\n [[0.0000, 0.0000, 0.0000],\n [0.0000, 0.0000, 0.0000],\n [0.0000, 0.0000, 0.0000],\n ...,\n [0.0000, 0.0000, 0.0000],\n [0.0000, 0.0000, 0.0000],\n [0.0000, 0.0000, 0.0000]],\n\n [[0.0000, 0.0000, 0.0000],\n [0.0000, 0.0000, 0.0000],\n [0.0000, 0.0000, 0.0000],\n ...,\n [0.0000, 0.0000, 0.0000],\n [0.0000, 0.0000, 0.0000],\n [0.0000, 0.0000, 0.0000]],\n\n ...,\n\n [[0.1367, 0.1367, 0.1367],\n [0.2500, 0.2500, 0.2500],\n [0.0352, 0.0352, 0.0352],\n ...,\n [0.0000, 0.0000, 0.0000],\n [0.0000, 0.0000, 0.0000],\n [0.0000, 0.0000, 0.0000]],\n\n [[0.1250, 0.1250, 0.1250],\n [0.1602, 0.1602, 0.1602],\n [0.5234, 0.5234, 0.5234],\n ...,\n [0.0000, 0.0000, 0.0000],\n [0.0000, 0.0000, 0.0000],\n [0.0000, 0.0000, 0.0000]],\n\n [[0.0000, 0.0000, 0.0000],\n [0.0195, 0.0195, 0.0195],\n [0.2266, 0.2266, 0.2266],\n ...,\n [0.0000, 0.0000, 0.0000],\n [0.0000, 0.0000, 0.0000],\n [0.0000, 0.0000, 0.0000]]]])']}, 'current_outputs': ['4', '14', '2', '3'], 'timestamp': 1778446298923}
[07:41] [7/7] SKIPPED (not in cpu list) video_multiview_depth.json
[07:42] Results saved to /Users/runner/work/comfy-gpu-ci/comfy-gpu-ci/comfy-test-logs/DepthAnythingV3-2043/dev/macos-cpu/results.json
[07:42] Model report: 4 files, 1.5 GB -> /Users/runner/work/comfy-gpu-ci/comfy-gpu-ci/comfy-test-logs/DepthAnythingV3-2043/dev/macos-cpu/models.json
[07:42] Saved: /Users/runner/work/comfy-gpu-ci/comfy-gpu-ci/comfy-test-logs/DepthAnythingV3-2043/dev/macos-cpu/index.html
[07:42]
macos: FAILED
[07:42] Error: Workflow execution failed (4 error(s))
[07:42] Details: advanced.json: Workflow execution failed: {'prompt_id': '7f0b777f-89c4-49f1-a152-41e921b50984', 'node_id': '12', 'node_type': 'DepthAnything_V3', 'executed': ['2', '3'], 'exception_message': 'ComfyUI-DepthAnythingV3: Socket closed but worker process still running.\n exit code: None\n worker log (/var/folders/tb/y368xp_x10s3ty1b_mtl5mxr0000gn/T/comfy_worker_debug.log, last 20 lines):\n File "/Users/runner/work/comfy-gpu-ci/comfy-gpu-ci/test_workspaces/DepthAnythingV3-2043/ComfyUI/comfy/ops.py", line 516 in forward\n File "/Users/runner/work/comfy-gpu-ci/comfy-gpu-ci/test_workspaces/DepthAnythingV3-2043/ComfyUI/.ce/.pixi/envs/depthanythingv3-nodes/lib/python3.11/site-packages/torch/nn/modules/module.py", line 1790 in _call_impl\n File "/Users/runner/work/comfy-gpu-ci/comfy-gpu-ci/test_workspaces/DepthAnythingV3-2043/ComfyUI/.ce/.pixi/envs/depthanythingv3-nodes/lib/python3.11/site-packages/torch/nn/modules/module.py", line 1779 in _wrapped_call_impl\n File "/Users/runner/work/comfy-gpu-ci/comfy-gpu-ci/test_workspaces/DepthAnythingV3-2043/ComfyUI/.ce/.pixi/envs/depthanythingv3-nodes/lib/python3.11/site-packages/torch/nn/modules/container.py", line 253 in forward\n File "/Users/runner/work/comfy-gpu-ci/comfy-gpu-ci/test_workspaces/DepthAnythingV3-2043/ComfyUI/.ce/.pixi/envs/depthanythingv3-nodes/lib/python3.11/site-packages/torch/nn/modules/module.py", line 1790 in _call_impl\n File "/Users/runner/work/comfy-gpu-ci/comfy-gpu-ci/test_workspaces/DepthAnythingV3-2043/ComfyUI/.ce/.pixi/envs/depthanythingv3-nodes/lib/python3.11/site-packages/torch/nn/modules/module.py", line 1779 in _wrapped_call_impl\n File "/Users/runner/work/comfy-gpu-ci/comfy-gpu-ci/test_workspaces/DepthAnythingV3-2043/ComfyUI/custom_nodes/ComfyUI-DepthAnythingV3/nodes/depth_anything_v3/model.py", line 1421 in _forward_impl\n File "/Users/runner/work/comfy-gpu-ci/comfy-gpu-ci/test_workspaces/DepthAnythingV3-2043/ComfyUI/custom_nodes/ComfyUI-DepthAnythingV3/nodes/depth_anything_v3/model.py", line 1366 in forward\n File "/Users/runner/work/comfy-gpu-ci/comfy-gpu-ci/test_workspaces/DepthAnythingV3-2043/ComfyUI/.ce/.pixi/envs/depthanythingv3-nodes/lib/python3.11/site-packages/torch/nn/modules/module.py", line 1790 in _call_impl\n File "/Users/runner/work/comfy-gpu-ci/comfy-gpu-ci/test_workspaces/DepthAnythingV3-2043/ComfyUI/.ce/.pixi/envs/depthanythingv3-nodes/lib/python3.11/site-packages/torch/nn/modules/module.py", line 1779 in _wrapped_call_impl\n File "/Users/runner/work/comfy-gpu-ci/comfy-gpu-ci/test_workspaces/DepthAnythingV3-2043/ComfyUI/custom_nodes/ComfyUI-DepthAnythingV3/nodes/depth_anything_v3/model.py", line 1591 in _process_depth_head\n File "/Users/runner/work/comfy-gpu-ci/comfy-gpu-ci/test_workspaces/DepthAnythingV3-2043/ComfyUI/custom_nodes/ComfyUI-DepthAnythingV3/nodes/depth_anything_v3/model.py", line 1577 in forward\n File "/Users/runner/work/comfy-gpu-ci/comfy-gpu-ci/test_workspaces/DepthAnythingV3-2043/ComfyUI/.ce/.pixi/envs/depthanythingv3-nodes/lib/python3.11/site-packages/torch/nn/modules/module.py", line 1790 in _call_impl\n File "/Users/runner/work/comfy-gpu-ci/comfy-gpu-ci/test_workspaces/DepthAnythingV3-2043/ComfyUI/.ce/.pixi/envs/depthanythingv3-nodes/lib/python3.11/site-packages/torch/nn/modules/module.py", line 1779 in _wrapped_call_impl\n File "/Users/runner/work/comfy-gpu-ci/comfy-gpu-ci/test_workspaces/DepthAnythingV3-2043/ComfyUI/custom_nodes/ComfyUI-DepthAnythingV3/nodes/nodes_inference.py", line 156 in execute\n File "/Users/runner/work/comfy-gpu-ci/comfy-gpu-ci/test_workspaces/DepthAnythingV3-2043/ComfyUI/comfy_api/latest/_io.py", line 1833 in EXECUTE_NORMALIZED\n File "/var/folders/tb/y368xp_x10s3ty1b_mtl5mxr0000gn/T/comfyui_pvenv_0w3iq8cd/persistent_worker.py", line 1762 in main\n File "/var/folders/tb/y368xp_x10s3ty1b_mtl5mxr0000gn/T/comfyui_pvenv_0w3iq8cd/persistent_worker.py", line 1807 in <module>\n \n 20:49:22 [print] === END ===\n', 'exception_type': 'RuntimeError', 'traceback': [' File "/Users/runner/work/comfy-gpu-ci/comfy-gpu-ci/test_workspaces/DepthAnythingV3-2043/ComfyUI/execution.py", line 535, in execute\n output_data, output_ui, has_subgraph, has_pending_tasks = await get_output_data(prompt_id, unique_id, obj, input_data_all, execution_block_cb=execution_block_cb, pre_execute_cb=pre_execute_cb, v3_data=v3_data)\n ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^\n', ' File "/Users/runner/work/comfy-gpu-ci/comfy-gpu-ci/test_workspaces/DepthAnythingV3-2043/ComfyUI/execution.py", line 335, in get_output_data\n return_values = await _async_map_node_over_list(prompt_id, unique_id, obj, input_data_all, obj.FUNCTION, allow_interrupt=True, execution_block_cb=execution_block_cb, pre_execute_cb=pre_execute_cb, v3_data=v3_data)\n ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^\n', ' File "/Users/runner/work/comfy-gpu-ci/comfy-gpu-ci/test_workspaces/DepthAnythingV3-2043/ComfyUI/execution.py", line 309, in _async_map_node_over_list\n await process_inputs(input_dict, i)\n', ' File "/Users/runner/work/comfy-gpu-ci/comfy-gpu-ci/test_workspaces/DepthAnythingV3-2043/ComfyUI/execution.py", line 297, in process_inputs\n result = f(**inputs)\n ^^^^^^^^^^^\n', ' File "/Users/runner/work/comfy-gpu-ci/comfy-gpu-ci/test_workspaces/DepthAnythingV3-2043/venv/lib/python3.11/site-packages/comfy_env/isolation/metadata.py", line 536, in proxy\n result = worker.call_method(\n ^^^^^^^^^^^^^^^^^^^\n', ' File "/Users/runner/work/comfy-gpu-ci/comfy-gpu-ci/test_workspaces/DepthAnythingV3-2043/venv/lib/python3.11/site-packages/comfy_env/isolation/workers/subprocess.py", line 669, in call_method\n response = self._send_request(request, timeout)\n ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^\n', ' File "/Users/runner/work/comfy-gpu-ci/comfy-gpu-ci/test_workspaces/DepthAnythingV3-2043/venv/lib/python3.11/site-packages/comfy_env/isolation/workers/subprocess.py", line 589, in _send_request\n raise RuntimeError(\n'], 'current_inputs': {'normalization_mode': ['V2-Style'], 'resize_method': ['resize'], 'invert_depth': [False], 'keep_model_size': [False], 'da3_model': ["{'model_path': '/Users/runner/work/comfy-gpu-ci/comfy-gpu-ci/test_workspaces/DepthAnythingV3-2043/ComfyUI/models/depthanything3/da3_large.safetensors', 'model_key': 'da3-large', 'dtype': 'bf16', 'attention': 'auto'}"], 'images': ['tensor([[[[0.0000, 0.0000, 0.0000],\n [0.0000, 0.0000, 0.0000],\n [0.0000, 0.0000, 0.0000],\n ...,\n [0.0000, 0.0000, 0.0000],\n [0.0000, 0.0000, 0.0000],\n [0.0000, 0.0000, 0.0000]],\n\n [[0.0000, 0.0000, 0.0000],\n [0.0000, 0.0000, 0.0000],\n [0.0000, 0.0000, 0.0000],\n ...,\n [0.0000, 0.0000, 0.0000],\n [0.0000, 0.0000, 0.0000],\n [0.0000, 0.0000, 0.0000]],\n\n [[0.0000, 0.0000, 0.0000],\n [0.0000, 0.0000, 0.0000],\n [0.0000, 0.0000, 0.0000],\n ...,\n [0.0000, 0.0000, 0.0000],\n [0.0000, 0.0000, 0.0000],\n [0.0000, 0.0000, 0.0000]],\n\n ...,\n\n [[0.1367, 0.1367, 0.1367],\n [0.2500, 0.2500, 0.2500],\n [0.0352, 0.0352, 0.0352],\n ...,\n [0.0000, 0.0000, 0.0000],\n [0.0000, 0.0000, 0.0000],\n [0.0000, 0.0000, 0.0000]],\n\n [[0.1250, 0.1250, 0.1250],\n [0.1602, 0.1602, 0.1602],\n [0.5234, 0.5234, 0.5234],\n ...,\n [0.0000, 0.0000, 0.0000],\n [0.0000, 0.0000, 0.0000],\n [0.0000, 0.0000, 0.0000]],\n\n [[0.0000, 0.0000, 0.0000],\n [0.0195, 0.0195, 0.0195],\n [0.2266, 0.2266, 0.2266],\n ...,\n [0.0000, 0.0000, 0.0000],\n [0.0000, 0.0000, 0.0000],\n [0.0000, 0.0000, 0.0000]]]])']}, 'current_outputs': ['12', '11', '6', '8', '9', '4', '13', '3', '10', '7', '2'], 'timestamp': 1778446207633}
Details:
Workflow: /private/var/folders/tb/y368xp_x10s3ty1b_mtl5mxr0000gn/T/comfy-test-run-sz0za7xy/ComfyUI-DepthAnythingV3/workflows/advanced.json
Node error: DepthAnything_V3
advanced_3d.json: Workflow execution failed: {'prompt_id': '2f5e82c1-7c11-4032-a384-5bb06572e02c', 'node_id': '21', 'node_type': 'DepthAnything_V3', 'executed': ['2', '3'], 'exception_message': "ComfyUI-DepthAnythingV3: Socket closed but worker process still running.\n exit code: None\n worker log (/var/folders/tb/y368xp_x10s3ty1b_mtl5mxr0000gn/T/comfy_worker_debug.log, last 20 lines):\n 20:50:26 [worker] Request: call_method nodes.nodes_inference call_id=2\n 20:50:26 [worker] Reconstructing inputs from shm...\n 20:50:26 [_from_shm] top-level keys: ['normalization_mode', 'resize_method', 'invert_depth', 'keep_model_size', 'da3_model', 'images']\n 20:50:26 [print] [comfy-env] _from_shm got dict with keys: ['__type__', 'strategy', 'manager_path', 'storage_key', 'storage_size']\n 20:50:26 [_from_shm] images: TensorRef tensor_size=[1, 533, 800, 3]\n 20:50:26 [print] [comfy-env] DESERIALIZE TensorRef: tensor_size=[1, 533, 800, 3]\n 20:50:26 [_from_shm] images: TensorRef deserialized shape=torch.Size([1, 533, 800, 3])\n 20:50:26 [print] [comfy-env] DESERIALIZED tensor shape: torch.Size([1, 533, 800, 3])\n 20:50:26 [worker] Inputs ready: ['normalization_mode', 'resize_method', 'invert_depth', 'keep_model_size', 'da3_model', 'images']\n 20:50:26 [worker] Input 'images' shape: torch.Size([1, 533, 800, 3])\n 20:50:26 [worker] Importing module nodes.nodes_inference...\n 20:50:26 [worker] Module imported\n 20:50:26 [worker] Getting class DepthAnything_V3...\n 20:50:26 [worker] Creating instance...\n 20:50:26 [worker] Calling EXECUTE_NORMALIZED...\n 20:50:26 [log] WARNING: No comfy kitchen, using old apply_rope functions.\n 20:50:34 [worker] load_models_gpu shim: 1 models, 0.82 GB total\n 20:50:34 [worker] Set EXTRA_RESERVED_VRAM = 0.42 GB\n 20:50:34 [worker] Set vram_state = SHARED\n 20:50:46 [worker] Models loaded via real load_models_gpu\n", 'exception_type': 'RuntimeError', 'traceback': [' File "/Users/runner/work/comfy-gpu-ci/comfy-gpu-ci/test_workspaces/DepthAnythingV3-2043/ComfyUI/execution.py", line 535, in execute\n output_data, output_ui, has_subgraph, has_pending_tasks = await get_output_data(prompt_id, unique_id, obj, input_data_all, execution_block_cb=execution_block_cb, pre_execute_cb=pre_execute_cb, v3_data=v3_data)\n ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^\n', ' File "/Users/runner/work/comfy-gpu-ci/comfy-gpu-ci/test_workspaces/DepthAnythingV3-2043/ComfyUI/execution.py", line 335, in get_output_data\n return_values = await _async_map_node_over_list(prompt_id, unique_id, obj, input_data_all, obj.FUNCTION, allow_interrupt=True, execution_block_cb=execution_block_cb, pre_execute_cb=pre_execute_cb, v3_data=v3_data)\n ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^\n', ' File "/Users/runner/work/comfy-gpu-ci/comfy-gpu-ci/test_workspaces/DepthAnythingV3-2043/ComfyUI/execution.py", line 309, in _async_map_node_over_list\n await process_inputs(input_dict, i)\n', ' File "/Users/runner/work/comfy-gpu-ci/comfy-gpu-ci/test_workspaces/DepthAnythingV3-2043/ComfyUI/execution.py", line 297, in process_inputs\n result = f(**inputs)\n ^^^^^^^^^^^\n', ' File "/Users/runner/work/comfy-gpu-ci/comfy-gpu-ci/test_workspaces/DepthAnythingV3-2043/venv/lib/python3.11/site-packages/comfy_env/isolation/metadata.py", line 536, in proxy\n result = worker.call_method(\n ^^^^^^^^^^^^^^^^^^^\n', ' File "/Users/runner/work/comfy-gpu-ci/comfy-gpu-ci/test_workspaces/DepthAnythingV3-2043/venv/lib/python3.11/site-packages/comfy_env/isolation/workers/subprocess.py", line 669, in call_method\n response = self._send_request(request, timeout)\n ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^\n', ' File "/Users/runner/work/comfy-gpu-ci/comfy-gpu-ci/test_workspaces/DepthAnythingV3-2043/venv/lib/python3.11/site-packages/comfy_env/isolation/workers/subprocess.py", line 589, in _send_request\n raise RuntimeError(\n'], 'current_inputs': {'normalization_mode': ['Raw'], 'resize_method': ['resize'], 'invert_depth': [False], 'keep_model_size': [False], 'da3_model': ["{'model_path': '/Users/runner/work/comfy-gpu-ci/comfy-gpu-ci/test_workspaces/DepthAnythingV3-2043/ComfyUI/models/depthanything3/da3_large.safetensors', 'model_key': 'da3-large', 'dtype': 'bf16', 'attention': 'auto'}"], 'images': ['tensor([[[[0.8549, 0.4863, 0.3216],\n [0.9098, 0.5412, 0.3765],\n [0.9333, 0.5529, 0.3922],\n ...,\n [0.4784, 0.3529, 0.3098],\n [0.4784, 0.3569, 0.3020],\n [0.4667, 0.3451, 0.2902]],\n\n [[0.9529, 0.5843, 0.4196],\n [0.9529, 0.5843, 0.4196],\n [0.9490, 0.5686, 0.4078],\n ...,\n [0.4980, 0.3725, 0.3294],\n [0.4824, 0.3608, 0.3059],\n [0.4706, 0.3490, 0.2941]],\n\n [[0.8392, 0.4627, 0.2902],\n [0.8118, 0.4353, 0.2627],\n [0.7451, 0.3608, 0.1922],\n ...,\n [0.4902, 0.3569, 0.3176],\n [0.5216, 0.3882, 0.3490],\n [0.4824, 0.3490, 0.3098]],\n\n ...,\n\n [[0.9490, 0.6078, 0.4157],\n [0.9294, 0.5882, 0.3961],\n [0.9490, 0.6353, 0.4588],\n ...,\n [0.5569, 0.3216, 0.2039],\n [0.5882, 0.3686, 0.2392],\n [0.5882, 0.3686, 0.2392]],\n\n [[0.9490, 0.5961, 0.4000],\n [0.9686, 0.6157, 0.4196],\n [0.9843, 0.6745, 0.5059],\n ...,\n [0.5412, 0.3059, 0.1961],\n [0.5725, 0.3529, 0.2314],\n [0.5725, 0.3529, 0.2314]],\n\n [[0.9608, 0.6000, 0.4078],\n [0.9961, 0.6353, 0.4431],\n [0.9922, 0.6902, 0.5255],\n ...,\n [0.5373, 0.3020, 0.1922],\n [0.5529, 0.3333, 0.2118],\n [0.5451, 0.3255, 0.2039]]]])']}, 'current_outputs': ['25', '21', '2', '23', '3', '22'], 'timestamp': 1778446246935}
Details:
Workflow: /private/var/folders/tb/y368xp_x10s3ty1b_mtl5mxr0000gn/T/comfy-test-run-sz0za7xy/ComfyUI-DepthAnythingV3/workflows/advanced_3d.json
Node error: DepthAnything_V3
advanced_3d_multiview.json: Workflow execution failed: {'prompt_id': '37cf1384-3766-4e0a-8c44-8e16015f0997', 'node_id': '39', 'node_type': 'DepthAnythingV3_MultiView', 'executed': ['21', '27', '3'], 'exception_message': "ComfyUI-DepthAnythingV3: Socket closed but worker process still running.\n exit code: None\n worker log (/var/folders/tb/y368xp_x10s3ty1b_mtl5mxr0000gn/T/comfy_worker_debug.log, last 20 lines):\n 20:50:55 [worker] Request: call_method nodes.nodes_multiview call_id=2\n 20:50:55 [worker] Reconstructing inputs from shm...\n 20:50:55 [_from_shm] top-level keys: ['normalization_mode', 'resize_method', 'invert_depth', 'keep_model_size', 'da3_model', 'images']\n 20:50:55 [print] [comfy-env] _from_shm got dict with keys: ['__type__', 'strategy', 'manager_path', 'storage_key', 'storage_size']\n 20:50:55 [_from_shm] images: TensorRef tensor_size=[1, 680, 1208, 3]\n 20:50:55 [print] [comfy-env] DESERIALIZE TensorRef: tensor_size=[1, 680, 1208, 3]\n 20:50:55 [_from_shm] images: TensorRef deserialized shape=torch.Size([1, 680, 1208, 3])\n 20:50:55 [print] [comfy-env] DESERIALIZED tensor shape: torch.Size([1, 680, 1208, 3])\n 20:50:55 [worker] Inputs ready: ['normalization_mode', 'resize_method', 'invert_depth', 'keep_model_size', 'da3_model', 'images']\n 20:50:55 [worker] Input 'images' shape: torch.Size([1, 680, 1208, 3])\n 20:50:55 [worker] Importing module nodes.nodes_multiview...\n 20:50:55 [worker] Module imported\n 20:50:55 [worker] Getting class DepthAnythingV3_MultiView...\n 20:50:55 [worker] Creating instance...\n 20:50:55 [worker] Calling EXECUTE_NORMALIZED...\n 20:50:55 [log] WARNING: No comfy kitchen, using old apply_rope functions.\n 20:51:02 [worker] load_models_gpu shim: 1 models, 0.82 GB total\n 20:51:02 [worker] Set EXTRA_RESERVED_VRAM = 0.42 GB\n 20:51:02 [worker] Set vram_state = SHARED\n 20:51:15 [worker] Models loaded via real load_models_gpu\n", 'exception_type': 'RuntimeError', 'traceback': [' File "/Users/runner/work/comfy-gpu-ci/comfy-gpu-ci/test_workspaces/DepthAnythingV3-2043/ComfyUI/execution.py", line 535, in execute\n output_data, output_ui, has_subgraph, has_pending_tasks = await get_output_data(prompt_id, unique_id, obj, input_data_all, execution_block_cb=execution_block_cb, pre_execute_cb=pre_execute_cb, v3_data=v3_data)\n ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^\n', ' File "/Users/runner/work/comfy-gpu-ci/comfy-gpu-ci/test_workspaces/DepthAnythingV3-2043/ComfyUI/execution.py", line 335, in get_output_data\n return_values = await _async_map_node_over_list(prompt_id, unique_id, obj, input_data_all, obj.FUNCTION, allow_interrupt=True, execution_block_cb=execution_block_cb, pre_execute_cb=pre_execute_cb, v3_data=v3_data)\n ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^\n', ' File "/Users/runner/work/comfy-gpu-ci/comfy-gpu-ci/test_workspaces/DepthAnythingV3-2043/ComfyUI/execution.py", line 309, in _async_map_node_over_list\n await process_inputs(input_dict, i)\n', ' File "/Users/runner/work/comfy-gpu-ci/comfy-gpu-ci/test_workspaces/DepthAnythingV3-2043/ComfyUI/execution.py", line 297, in process_inputs\n result = f(**inputs)\n ^^^^^^^^^^^\n', ' File "/Users/runner/work/comfy-gpu-ci/comfy-gpu-ci/test_workspaces/DepthAnythingV3-2043/venv/lib/python3.11/site-packages/comfy_env/isolation/metadata.py", line 536, in proxy\n result = worker.call_method(\n ^^^^^^^^^^^^^^^^^^^\n', ' File "/Users/runner/work/comfy-gpu-ci/comfy-gpu-ci/test_workspaces/DepthAnythingV3-2043/venv/lib/python3.11/site-packages/comfy_env/isolation/workers/subprocess.py", line 669, in call_method\n response = self._send_request(request, timeout)\n ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^\n', ' File "/Users/runner/work/comfy-gpu-ci/comfy-gpu-ci/test_workspaces/DepthAnythingV3-2043/venv/lib/python3.11/site-packages/comfy_env/isolation/workers/subprocess.py", line 589, in _send_request\n raise RuntimeError(\n'], 'current_inputs': {'normalization_mode': ['Raw'], 'resize_method': ['resize'], 'invert_depth': [False], 'keep_model_size': [False], 'da3_model': ["{'model_path': '/Users/runner/work/comfy-gpu-ci/comfy-gpu-ci/test_workspaces/DepthAnythingV3-2043/ComfyUI/models/depthanything3/da3_large.safetensors', 'model_key': 'da3-large', 'dtype': 'bf16', 'attention': 'auto'}"], 'images': ['tensor([[[[0.6157, 0.8706, 1.0000],\n [0.6157, 0.8706, 1.0000],\n [0.6118, 0.8706, 1.0000],\n ...,\n [0.5961, 0.8667, 1.0000],\n [0.5961, 0.8667, 1.0000],\n [0.5961, 0.8667, 1.0000]],\n\n [[0.6157, 0.8706, 1.0000],\n [0.6157, 0.8706, 1.0000],\n [0.6118, 0.8706, 1.0000],\n ...,\n [0.5961, 0.8667, 1.0000],\n [0.5961, 0.8667, 1.0000],\n [0.5961, 0.8667, 1.0000]],\n\n [[0.6118, 0.8706, 1.0000],\n [0.6118, 0.8706, 1.0000],\n [0.6118, 0.8706, 1.0000],\n ...,\n [0.5961, 0.8667, 1.0000],\n [0.5961, 0.8667, 1.0000],\n [0.5961, 0.8667, 1.0000]],\n\n ...,\n\n [[0.3216, 0.4157, 0.4941],\n [0.3216, 0.4157, 0.4941],\n [0.3294, 0.4118, 0.4863],\n ...,\n [0.2863, 0.4039, 0.4980],\n [0.3098, 0.4275, 0.5216],\n [0.3333, 0.4510, 0.5451]],\n\n [[0.3255, 0.4196, 0.4980],\n [0.3216, 0.4157, 0.4941],\n [0.3294, 0.4118, 0.4863],\n ...,\n [0.2275, 0.3451, 0.4392],\n [0.2039, 0.3216, 0.4157],\n [0.2157, 0.3333, 0.4275]],\n\n [[0.3176, 0.4118, 0.4902],\n [0.3216, 0.4157, 0.4941],\n [0.3255, 0.4078, 0.4824],\n ...,\n [0.3137, 0.4314, 0.5255],\n [0.3059, 0.4235, 0.5176],\n [0.2863, 0.4039, 0.4980]]]])', 'tensor([[[[0.6196, 0.8784, 1.0000],\n [0.6196, 0.8784, 1.0000],\n [0.6196, 0.8784, 1.0000],\n ...,\n [0.6000, 0.8784, 1.0000],\n [0.6000, 0.8784, 1.0000],\n [0.6000, 0.8784, 1.0000]],\n\n [[0.6196, 0.8784, 1.0000],\n [0.6196, 0.8784, 1.0000],\n [0.6196, 0.8784, 1.0000],\n ...,\n [0.6000, 0.8784, 1.0000],\n [0.6000, 0.8784, 1.0000],\n [0.6000, 0.8784, 1.0000]],\n\n [[0.6196, 0.8784, 1.0000],\n [0.6196, 0.8784, 1.0000],\n [0.6196, 0.8784, 1.0000],\n ...,\n [0.6000, 0.8784, 1.0000],\n [0.6000, 0.8784, 1.0000],\n [0.6000, 0.8784, 1.0000]],\n\n ...,\n\n [[0.3686, 0.4078, 0.4784],\n [0.3725, 0.4118, 0.4824],\n [0.3686, 0.4078, 0.4784],\n ...,\n [0.2745, 0.4039, 0.4941],\n [0.2941, 0.4235, 0.5137],\n [0.2980, 0.4275, 0.5176]],\n\n [[0.3647, 0.4039, 0.4745],\n [0.3608, 0.4000, 0.4706],\n [0.3647, 0.4039, 0.4745],\n ...,\n [0.3020, 0.4314, 0.5216],\n [0.3255, 0.4549, 0.5451],\n [0.3333, 0.4627, 0.5529]],\n\n [[0.3569, 0.3961, 0.4667],\n [0.3569, 0.3961, 0.4667],\n [0.3569, 0.3961, 0.4667],\n ...,\n [0.3176, 0.4471, 0.5373],\n [0.2941, 0.4235, 0.5137],\n [0.2902, 0.4196, 0.5098]]]])']}, 'current_outputs': ['21', '48', '38', '44', '39', '27', '3', '45'], 'timestamp': 1778446275737}
Details:
Workflow: /private/var/folders/tb/y368xp_x10s3ty1b_mtl5mxr0000gn/T/comfy-test-run-sz0za7xy/ComfyUI-DepthAnythingV3/workflows/advanced_3d_multiview.json
Node error: DepthAnythingV3_MultiView
simple.json: Workflow execution failed: {'prompt_id': 'b4778ef9-dd44-4184-bb40-0b5de780b14a', 'node_id': '14', 'node_type': 'DepthAnything_V3', 'executed': ['2', '3'], 'exception_message': "ComfyUI-DepthAnythingV3: Socket closed but worker process still running.\n exit code: None\n worker log (/var/folders/tb/y368xp_x10s3ty1b_mtl5mxr0000gn/T/comfy_worker_debug.log, last 20 lines):\n 20:51:24 [worker] Reconstructing inputs from shm...\n 20:51:24 [_from_shm] top-level keys: ['normalization_mode', 'resize_method', 'invert_depth', 'keep_model_size', 'da3_model', 'images']\n 20:51:24 [print] [comfy-env] _from_shm got dict with keys: ['__type__', 'strategy', 'manager_path', 'storage_key', 'storage_size']\n 20:51:24 [_from_shm] images: TensorRef tensor_size=[1, 683, 1024, 3]\n 20:51:24 [print] [comfy-env] DESERIALIZE TensorRef: tensor_size=[1, 683, 1024, 3]\n 20:51:24 [_from_shm] images: TensorRef deserialized shape=torch.Size([1, 683, 1024, 3])\n 20:51:24 [print] [comfy-env] DESERIALIZED tensor shape: torch.Size([1, 683, 1024, 3])\n 20:51:24 [worker] Inputs ready: ['normalization_mode', 'resize_method', 'invert_depth', 'keep_model_size', 'da3_model', 'images']\n 20:51:24 [worker] Input 'images' shape: torch.Size([1, 683, 1024, 3])\n 20:51:24 [worker] Importing module nodes.nodes_inference...\n 20:51:24 [worker] Module imported\n 20:51:24 [worker] Getting class DepthAnything_V3...\n 20:51:24 [worker] Creating instance...\n 20:51:24 [worker] Calling EXECUTE_NORMALIZED...\n 20:51:24 [log] WARNING: No comfy kitchen, using old apply_rope functions.\n 20:51:27 [worker] load_models_gpu shim: 1 models, 0.82 GB total\n 20:51:27 [worker] Set EXTRA_RESERVED_VRAM = 0.42 GB\n 20:51:27 [worker] Set vram_state = SHARED\n 20:51:38 [worker] Models loaded via real load_models_gpu\n 20:51:38 [log] WARNING: WARNING: This model does not support sky segmentation. V2-Style normalization will work but without sky masking. Use Mono/Metric/Nested models for best V2-Style results.\n", 'exception_type': 'RuntimeError', 'traceback': [' File "/Users/runner/work/comfy-gpu-ci/comfy-gpu-ci/test_workspaces/DepthAnythingV3-2043/ComfyUI/execution.py", line 535, in execute\n output_data, output_ui, has_subgraph, has_pending_tasks = await get_output_data(prompt_id, unique_id, obj, input_data_all, execution_block_cb=execution_block_cb, pre_execute_cb=pre_execute_cb, v3_data=v3_data)\n ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^\n', ' File "/Users/runner/work/comfy-gpu-ci/comfy-gpu-ci/test_workspaces/DepthAnythingV3-2043/ComfyUI/execution.py", line 335, in get_output_data\n return_values = await _async_map_node_over_list(prompt_id, unique_id, obj, input_data_all, obj.FUNCTION, allow_interrupt=True, execution_block_cb=execution_block_cb, pre_execute_cb=pre_execute_cb, v3_data=v3_data)\n ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^\n', ' File "/Users/runner/work/comfy-gpu-ci/comfy-gpu-ci/test_workspaces/DepthAnythingV3-2043/ComfyUI/execution.py", line 309, in _async_map_node_over_list\n await process_inputs(input_dict, i)\n', ' File "/Users/runner/work/comfy-gpu-ci/comfy-gpu-ci/test_workspaces/DepthAnythingV3-2043/ComfyUI/execution.py", line 297, in process_inputs\n result = f(**inputs)\n ^^^^^^^^^^^\n', ' File "/Users/runner/work/comfy-gpu-ci/comfy-gpu-ci/test_workspaces/DepthAnythingV3-2043/venv/lib/python3.11/site-packages/comfy_env/isolation/metadata.py", line 536, in proxy\n result = worker.call_method(\n ^^^^^^^^^^^^^^^^^^^\n', ' File "/Users/runner/work/comfy-gpu-ci/comfy-gpu-ci/test_workspaces/DepthAnythingV3-2043/venv/lib/python3.11/site-packages/comfy_env/isolation/workers/subprocess.py", line 669, in call_method\n response = self._send_request(request, timeout)\n ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^\n', ' File "/Users/runner/work/comfy-gpu-ci/comfy-gpu-ci/test_workspaces/DepthAnythingV3-2043/venv/lib/python3.11/site-packages/comfy_env/isolation/workers/subprocess.py", line 589, in _send_request\n raise RuntimeError(\n'], 'current_inputs': {'normalization_mode': ['V2-Style'], 'resize_method': ['resize'], 'invert_depth': [True], 'keep_model_size': [False], 'da3_model': ["{'model_path': '/Users/runner/work/comfy-gpu-ci/comfy-gpu-ci/test_workspaces/DepthAnythingV3-2043/ComfyUI/models/depthanything3/da3_large.safetensors', 'model_key': 'da3-large', 'dtype': 'bf16', 'attention': 'auto'}"], 'images': ['tensor([[[[0.0000, 0.0000, 0.0000],\n [0.0000, 0.0000, 0.0000],\n [0.0000, 0.0000, 0.0000],\n ...,\n [0.0000, 0.0000, 0.0000],\n [0.0000, 0.0000, 0.0000],\n [0.0000, 0.0000, 0.0000]],\n\n [[0.0000, 0.0000, 0.0000],\n [0.0000, 0.0000, 0.0000],\n [0.0000, 0.0000, 0.0000],\n ...,\n [0.0000, 0.0000, 0.0000],\n [0.0000, 0.0000, 0.0000],\n [0.0000, 0.0000, 0.0000]],\n\n [[0.0000, 0.0000, 0.0000],\n [0.0000, 0.0000, 0.0000],\n [0.0000, 0.0000, 0.0000],\n ...,\n [0.0000, 0.0000, 0.0000],\n [0.0000, 0.0000, 0.0000],\n [0.0000, 0.0000, 0.0000]],\n\n ...,\n\n [[0.1367, 0.1367, 0.1367],\n [0.2500, 0.2500, 0.2500],\n [0.0352, 0.0352, 0.0352],\n ...,\n [0.0000, 0.0000, 0.0000],\n [0.0000, 0.0000, 0.0000],\n [0.0000, 0.0000, 0.0000]],\n\n [[0.1250, 0.1250, 0.1250],\n [0.1602, 0.1602, 0.1602],\n [0.5234, 0.5234, 0.5234],\n ...,\n [0.0000, 0.0000, 0.0000],\n [0.0000, 0.0000, 0.0000],\n [0.0000, 0.0000, 0.0000]],\n\n [[0.0000, 0.0000, 0.0000],\n [0.0195, 0.0195, 0.0195],\n [0.2266, 0.2266, 0.2266],\n ...,\n [0.0000, 0.0000, 0.0000],\n [0.0000, 0.0000, 0.0000],\n [0.0000, 0.0000, 0.0000]]]])']}, 'current_outputs': ['4', '14', '2', '3'], 'timestamp': 1778446298923}
Details:
Workflow: /private/var/folders/tb/y368xp_x10s3ty1b_mtl5mxr0000gn/T/comfy-test-run-sz0za7xy/ComfyUI-DepthAnythingV3/workflows/simple.json
Node error: DepthAnything_V3
[07:42] Stopping ComfyUI server...