[00:00] Crash dump logging enabled: /home/runner/work/comfy-gpu-ci/comfy-gpu-ci/comfy-test-logs/DepthAnythingV3-2120/dev/linux-cpu/crash_dump.log [00:00] [00:00] [1/5] SYNTAX [00:00] ---------------------------------------- [00:00] [DEBUG] server=None, server_url=None, api=None [00:00] Found pyproject.toml (modern format) [00:00] Found requirements.txt (legacy format) [00:00] Unicode check: OK (all characters cp1252-safe) [00:00] Forbidden patterns check: OK [00:00] [SYNTAX] PASSED [00:00] [00:00] [2/5] INSTALL [00:00] ---------------------------------------- [00:00] [DEBUG] server=None, server_url=None, api=None [00:00] Setting up ComfyUI... [00:00] Creating virtual environment... [00:00] Running: uv venv /home/runner/work/comfy-gpu-ci/comfy-gpu-ci/test_workspaces/DepthAnythingV3-2120/.venv --python 3.11 [00:01] Cloning ComfyUI (latest)... [00:01] Running: git clone --depth 1 https://github.com/comfyanonymous/ComfyUI.git /home/runner/work/comfy-gpu-ci/comfy-gpu-ci/test_workspaces/DepthAnythingV3-2120/ComfyUI [00:02] Installing ComfyUI requirements... [00:02] Running: uv pip install --python /home/runner/work/comfy-gpu-ci/comfy-gpu-ci/test_workspaces/DepthAnythingV3-2120/.venv/bin/python -r /home/runner/work/comfy-gpu-ci/comfy-gpu-ci/test_workspaces/DepthAnythingV3-2120/ComfyUI/requirements.txt [00:22] Installing custom node... [00:22] Copying ComfyUI-DepthAnythingV3 to custom_nodes/... [00:22] Installing node requirements... [00:22] Running: uv pip install --python /home/runner/work/comfy-gpu-ci/comfy-gpu-ci/test_workspaces/DepthAnythingV3-2120/.venv/bin/python -r /home/runner/work/comfy-gpu-ci/comfy-gpu-ci/test_workspaces/DepthAnythingV3-2120/ComfyUI/custom_nodes/ComfyUI-DepthAnythingV3/requirements.txt [00:23] Running install.py... [00:23] Running: /home/runner/work/comfy-gpu-ci/comfy-gpu-ci/test_workspaces/DepthAnythingV3-2120/.venv/bin/python /home/runner/work/comfy-gpu-ci/comfy-gpu-ci/test_workspaces/DepthAnythingV3-2120/ComfyUI/custom_nodes/ComfyUI-DepthAnythingV3/install.py [00:23] [00:23] Installing 3 node dependencies... [00:23] Cloning ComfyUI-VideoHelperSuite... [00:23] Installing requirements for ComfyUI-VideoHelperSuite... [00:25] Cloning ComfyUI-KJNodes... [00:25] Installing requirements for ComfyUI-KJNodes... [00:27] Cloning ComfyUI-GeometryPack... [00:28] Installing requirements for ComfyUI-GeometryPack... [00:29] Running install.py for ComfyUI-GeometryPack... [00:29] [comfy-env] _discover: scanning /home/runner/work/comfy-gpu-ci/comfy-gpu-ci/test_workspaces/DepthAnythingV3-2120/ComfyUI/custom_nodes [00:29] [comfy-env] _discover: ComfyUI-DepthAnythingV3 -> depthanythingv3-nodes (custom_nodes/ComfyUI-DepthAnythingV3/nodes/comfy-env.toml) [00:29] [comfy-env] _discover: ComfyUI-GeometryPack -> geometrypack-nodes (custom_nodes/ComfyUI-GeometryPack/nodes/comfy-env.toml) [00:29] [comfy-env] _discover: ComfyUI-KJNodes: no comfy-env.toml found [00:29] [comfy-env] _discover: ComfyUI-VideoHelperSuite: no comfy-env.toml found [00:29] [comfy-env] Workspace: /home/runner/work/comfy-gpu-ci/comfy-gpu-ci/test_workspaces/DepthAnythingV3-2120/ComfyUI/.ce [00:29] [comfy-env] ComfyUI: /home/runner/work/comfy-gpu-ci/comfy-gpu-ci/test_workspaces/DepthAnythingV3-2120/ComfyUI [00:29] [comfy-env] Found 2 node config(s): [00:29] - depthanythingv3-nodes <- custom_nodes/ComfyUI-DepthAnythingV3/nodes/comfy-env.toml (python=host) [00:29] - geometrypack-nodes <- custom_nodes/ComfyUI-GeometryPack/nodes/comfy-env.toml (python=host) [00:29] [comfy-env] Bootstrap interpreter has python 3.11 + torch 2.11.0 (cpu). Looking for cuda-only wheels matching cpu/torch2.11/cp311. [00:32] [comfy-env] GPU: No GPU detected [00:32] [comfy-env] No CUDA detected -- pinning comfyui torch to CPU index [00:32] [comfy-env] Root conda deps from ComfyUI-GeometryPack: ['av', 'ffmpeg'] [00:32] [comfy-env] Host glibc 2.39 -> system-requirements [00:32] Generated /home/runner/work/comfy-gpu-ci/comfy-gpu-ci/test_workspaces/DepthAnythingV3-2120/ComfyUI/.ce/pixi.toml [00:32] [comfy-env] Installing 2 environment(s): [00:32] - depthanythingv3-nodes (python=host, 10 pypi deps, 2 cuda wheels) [00:32] - geometrypack-nodes (python=host, 13 pypi deps, 1 cuda wheels) [00:32] [comfy-env] Running `pixi install --all`... [00:40] WARN Skipped running the post-link scripts because `run-post-link-scripts` = `false` [00:40] - bin/.librsvg-pre-unlink.sh [00:40] To enable them, run: [00:40] pixi config set --local run-post-link-scripts insecure [00:40] More info: [00:40] https://pixi.sh/latest/reference/pixi_configuration/#run-post-link-scripts [00:58] WARN Skipped running the post-link scripts because `run-post-link-scripts` = `false` [00:58] - bin/.librsvg-pre-unlink.sh [00:58] To enable them, run: [00:58] pixi config set --local run-post-link-scripts insecure [00:58] More info: [00:58] https://pixi.sh/latest/reference/pixi_configuration/#run-post-link-scripts [01:01] ✔ The following environments have been installed: default, depthanythingv3-nodes, geometrypack-nodes. [01:01] [comfy-env] Note: env `default` is on disk but no node declares it in this run. Leaving as-is. Remove via `pixi clean --environment default` if intended. [01:01] [comfy-env] Install log: /home/runner/work/comfy-gpu-ci/comfy-gpu-ci/test_workspaces/DepthAnythingV3-2120/ComfyUI/.ce/install.log [01:01] [01:01] Installation complete! [01:01] [01:01] [requirements] Re-installing main package requirements... [01:01] Installing requirements for ComfyUI-DepthAnythingV3... [01:01] [comfy-env] _discover: scanning /home/runner/work/comfy-gpu-ci/comfy-gpu-ci/test_workspaces/DepthAnythingV3-2120/ComfyUI/custom_nodes [01:01] [comfy-env] _discover: ComfyUI-DepthAnythingV3 -> depthanythingv3-nodes (custom_nodes/ComfyUI-DepthAnythingV3/nodes/comfy-env.toml) [01:01] [comfy-env] _discover: ComfyUI-GeometryPack -> geometrypack-nodes (custom_nodes/ComfyUI-GeometryPack/nodes/comfy-env.toml) [01:01] [comfy-env] _discover: ComfyUI-KJNodes: no comfy-env.toml found [01:01] [comfy-env] _discover: ComfyUI-VideoHelperSuite: no comfy-env.toml found [01:01] [comfy-env] Workspace: /home/runner/work/comfy-gpu-ci/comfy-gpu-ci/test_workspaces/DepthAnythingV3-2120/ComfyUI/.ce [01:01] [comfy-env] ComfyUI: /home/runner/work/comfy-gpu-ci/comfy-gpu-ci/test_workspaces/DepthAnythingV3-2120/ComfyUI [01:01] [comfy-env] Found 2 node config(s): [01:01] - depthanythingv3-nodes <- custom_nodes/ComfyUI-DepthAnythingV3/nodes/comfy-env.toml (python=host) [01:01] - geometrypack-nodes <- custom_nodes/ComfyUI-GeometryPack/nodes/comfy-env.toml (python=host) [01:01] [comfy-env] Bootstrap interpreter has python 3.11 + torch 2.11.0 (cpu). Looking for cuda-only wheels matching cpu/torch2.11/cp311. [01:02] [comfy-env] GPU: No GPU detected [01:02] [comfy-env] No CUDA detected -- pinning comfyui torch to CPU index [01:02] [comfy-env] Root conda deps from ComfyUI-GeometryPack: ['av', 'ffmpeg'] [01:02] [comfy-env] Host glibc 2.39 -> system-requirements [01:02] Generated /home/runner/work/comfy-gpu-ci/comfy-gpu-ci/test_workspaces/DepthAnythingV3-2120/ComfyUI/.ce/pixi.toml [01:02] [comfy-env] Installing 2 environment(s): [01:02] - depthanythingv3-nodes (python=host, 10 pypi deps, 2 cuda wheels) [01:02] - geometrypack-nodes (python=host, 13 pypi deps, 1 cuda wheels) [01:02] [comfy-env] Running `pixi install --all`... [01:03] ✔ The following environments have been installed: default, depthanythingv3-nodes, geometrypack-nodes. [01:03] [comfy-env] Note: env `default` is on disk but no node declares it in this run. Leaving as-is. Remove via `pixi clean --environment default` if intended. [01:03] [comfy-env] Install log: /home/runner/work/comfy-gpu-ci/comfy-gpu-ci/test_workspaces/DepthAnythingV3-2120/ComfyUI/.ce/install.log [01:03] [01:03] Installation complete! [01:03] Installing 3 node dependency(ies)... [01:03] ComfyUI-VideoHelperSuite from Kosinkadink/ComfyUI-VideoHelperSuite [01:03] ComfyUI-VideoHelperSuite already exists, skipping... [01:03] ComfyUI-KJNodes from kijai/ComfyUI-KJNodes [01:03] ComfyUI-KJNodes already exists, skipping... [01:03] ComfyUI-GeometryPack from PozzettiAndrea/ComfyUI-GeometryPack [01:03] ComfyUI-GeometryPack already exists, skipping... [01:03] Installing validation endpoint... [01:03] Cloning PozzettiAndrea/ComfyUI-validate-endpoint... [01:03] Running: git clone --depth 1 https://github.com/PozzettiAndrea/ComfyUI-validate-endpoint.git /home/runner/work/comfy-gpu-ci/comfy-gpu-ci/test_workspaces/DepthAnythingV3-2120/ComfyUI/custom_nodes/ComfyUI-validate-endpoint [01:03] CUDA packages absent (will mock): flash_attn, sageattention [01:03] [INSTALL] PASSED [01:03] [01:03] [3/5] REGISTRATION [01:03] ---------------------------------------- [01:03] [DEBUG] server=None, server_url=None, api=None [01:03] Starting ComfyUI server... [01:03] Starting ComfyUI server on port 41881... [01:03] CUDA mock packages: flash_attn, sageattention [01:03] Starting ComfyUI server on port 41881... [01:03] Waiting for server to be ready (timeout: 600s)... [01:04] [ComfyUI] setup plugin alembic.autogenerate.schemas [01:04] [ComfyUI] setup plugin alembic.autogenerate.tables [01:04] [ComfyUI] setup plugin alembic.autogenerate.types [01:04] [ComfyUI] setup plugin alembic.autogenerate.constraints [01:04] [ComfyUI] setup plugin alembic.autogenerate.defaults [01:04] [ComfyUI] setup plugin alembic.autogenerate.comments [01:04] [ComfyUI] [comfy-env] ComfyUI-GeometryPack: 1 isolation env(s): [01:04] [ComfyUI] [comfy-env] nodes -> /home/runner/work/comfy-gpu-ci/comfy-gpu-ci/test_workspaces/DepthAnythingV3-2120/ComfyUI/custom_nodes/ComfyUI-GeometryPack/nodes [01:04] [ComfyUI] [comfy-env] prestartup complete [01:05] [ComfyUI] [comfy-env] ComfyUI-DepthAnythingV3: 1 isolation env(s): [01:05] [ComfyUI] [comfy-env] nodes -> /home/runner/work/comfy-gpu-ci/comfy-gpu-ci/test_workspaces/DepthAnythingV3-2120/ComfyUI/custom_nodes/ComfyUI-DepthAnythingV3/nodes [01:05] [ComfyUI] [comfy-env] prestartup complete [01:05] [ComfyUI] [01:05] [ComfyUI] Prestartup times for custom nodes: [01:05] [ComfyUI] 0.0 seconds: /home/runner/work/comfy-gpu-ci/comfy-gpu-ci/test_workspaces/DepthAnythingV3-2120/ComfyUI/custom_nodes/ComfyUI-DepthAnythingV3 [01:05] [ComfyUI] 0.2 seconds: /home/runner/work/comfy-gpu-ci/comfy-gpu-ci/test_workspaces/DepthAnythingV3-2120/ComfyUI/custom_nodes/ComfyUI-GeometryPack [01:05] [ComfyUI] [01:09] [ComfyUI] Found comfy_kitchen backend eager: {'available': True, 'disabled': False, 'unavailable_reason': None, 'capabilities': ['apply_rope', 'apply_rope1', 'dequantize_mxfp8', 'dequantize_nvfp4', 'dequantize_per_tensor_fp8', 'quantize_mxfp8', 'quantize_nvfp4', 'quantize_per_tensor_fp8', 'scaled_mm_mxfp8', 'scaled_mm_nvfp4']} [01:09] [ComfyUI] Found comfy_kitchen backend triton: {'available': False, 'disabled': True, 'unavailable_reason': 'Neither CUDA nor XPU available on this system', 'capabilities': []} [01:09] [ComfyUI] Found comfy_kitchen backend cuda: {'available': False, 'disabled': False, 'unavailable_reason': 'CUDA not available on this system', 'capabilities': []} [01:09] [ComfyUI] Checkpoint files will always be loaded safely. [01:09] [ComfyUI] Total VRAM 15990 MB, total RAM 15990 MB [01:09] [ComfyUI] pytorch version: 2.11.0+cu130 [01:09] [ComfyUI] Set vram state to: DISABLED [01:09] [ComfyUI] Device: cpu [01:09] [ComfyUI] Using sub quadratic optimization for attention, if you have memory or speed issues try using: --use-split-cross-attention [01:15] [ComfyUI] Python version: 3.11.15 (main, May 8 2026, 18:33:10) [Clang 22.1.3 ] [01:15] [ComfyUI] ComfyUI version: 0.20.1 [01:15] [ComfyUI] comfy-aimdo version: 0.3.0 [01:15] [ComfyUI] comfy-kitchen version: 0.2.8 [01:15] [ComfyUI] ****** User settings have been changed to be stored on the server instead of browser storage. ****** [01:15] [ComfyUI] ****** For multi-user setups add the --multi-user CLI argument to enable multiple user profiles. ****** [01:15] [ComfyUI] ComfyUI frontend version: 1.43.18 [01:15] [ComfyUI] [Prompt Server] web root: /home/runner/work/comfy-gpu-ci/comfy-gpu-ci/test_workspaces/DepthAnythingV3-2120/.venv/lib/python3.11/site-packages/comfyui_frontend_package/static [01:15] [ComfyUI] Asset seeder disabled [01:17] [ComfyUI] loading... [01:17] [ComfyUI] calling register_nodes [01:17] [ComfyUI] [comfy-env] Version: 0.3.81 [01:17] [ComfyUI] [comfy-env] register_nodes: ComfyUI-GeometryPack [01:17] [ComfyUI] [comfy-env] ComfyUI source dir: /home/runner/work/comfy-gpu-ci/comfy-gpu-ci/test_workspaces/DepthAnythingV3-2120/ComfyUI [01:17] [ComfyUI] [comfy-env] Found 1 isolation env(s) [01:17] [ComfyUI] [comfy-env] Scanning nodes metadata (isolation root)... [01:17] [ComfyUI] [comfy-env] Metadata scan: /home/runner/.pixi/bin/pixi run --as-is --manifest-path /home/runner/work/comfy-gpu-ci/comfy-gpu-ci/test_workspaces/DepthAnythingV3-2120/ComfyUI/.ce/pixi.toml -e geometrypack-nodes python /tmp/comfy_meta_ji6yibe0.py /home/runner/work/comfy-gpu-ci/comfy-gpu-ci/test_workspaces/DepthAnythingV3-2120/ComfyUI/custom_nodes/ComfyUI-GeometryPack nodes [01:17] [ComfyUI] [comfy-env] Scan env PATH for nodes: [01:17] [ComfyUI] [comfy-env] [0] /opt/hostedtoolcache/Python/3.12.13/x64/bin [01:17] [ComfyUI] [comfy-env] [1] /opt/hostedtoolcache/Python/3.12.13/x64 [01:17] [ComfyUI] [comfy-env] [2] /snap/bin [01:17] [ComfyUI] [comfy-env] [3] /home/runner/.local/bin [01:17] [ComfyUI] [comfy-env] [4] /opt/pipx_bin [01:17] [ComfyUI] [comfy-env] [5] /home/runner/.cargo/bin [01:17] [ComfyUI] [comfy-env] [6] /home/runner/.config/composer/vendor/bin [01:17] [ComfyUI] [comfy-env] [7] /usr/local/.ghcup/bin [01:17] [ComfyUI] [comfy-env] [8] /home/runner/.dotnet/tools [01:17] [ComfyUI] [comfy-env] [9] /usr/local/sbin [01:17] [ComfyUI] [comfy-env] [10] /usr/local/bin [01:17] [ComfyUI] [comfy-env] [11] /usr/sbin [01:17] [ComfyUI] [comfy-env] [12] /usr/bin [01:17] [ComfyUI] [comfy-env] [13] /sbin [01:17] [ComfyUI] [comfy-env] [14] /bin [01:17] [ComfyUI] [comfy-env] [15] /usr/games [01:17] [ComfyUI] [comfy-env] [16] /usr/local/games [01:17] [ComfyUI] [comfy-env] [17] /snap/bin [01:23] [ComfyUI] [comfy-env] Metadata scan stderr for nodes: [01:23] [ComfyUI] [comfy-env] [meta-scan] importing nodes from /home/runner/work/comfy-gpu-ci/comfy-gpu-ci/test_workspaces/DepthAnythingV3-2120/ComfyUI/custom_nodes/ComfyUI-GeometryPack [01:23] [ComfyUI] [comfy-env] ERROR:root:Failed to import comfy_kitchen, Error: No module named 'comfy_kitchen', fp8 and fp4 support will not be available. [01:23] [ComfyUI] [comfy-env] [meta-scan] import OK [01:23] [ComfyUI] [comfy-env] Scanned nodes: 125 nodes (5.5s) [01:23] [ComfyUI] [comfy-env] Scanned nodes root: 125 nodes (5.7s) [01:23] [ComfyUI] [comfy-env] Imported nodes root: 125 nodes (isolation) [01:23] [ComfyUI] [comfy-env] Registered 125 total nodes [01:23] [ComfyUI] [comfy-env] Version: 0.3.81 [01:23] [ComfyUI] [comfy-env] register_nodes: ComfyUI-DepthAnythingV3 [01:23] [ComfyUI] [comfy-env] ComfyUI source dir: /home/runner/work/comfy-gpu-ci/comfy-gpu-ci/test_workspaces/DepthAnythingV3-2120/ComfyUI [01:23] [ComfyUI] [comfy-env] Found 1 isolation env(s) [01:23] [ComfyUI] [comfy-env] Scanning nodes metadata (isolation root)... [01:23] [ComfyUI] [comfy-env] Metadata scan: /home/runner/.pixi/bin/pixi run --as-is --manifest-path /home/runner/work/comfy-gpu-ci/comfy-gpu-ci/test_workspaces/DepthAnythingV3-2120/ComfyUI/.ce/pixi.toml -e depthanythingv3-nodes python /tmp/comfy_meta_lyszsnn1.py /home/runner/work/comfy-gpu-ci/comfy-gpu-ci/test_workspaces/DepthAnythingV3-2120/ComfyUI/custom_nodes/ComfyUI-DepthAnythingV3 nodes [01:23] [ComfyUI] [comfy-env] Scan env PATH for nodes: [01:23] [ComfyUI] [comfy-env] [0] /opt/hostedtoolcache/Python/3.12.13/x64/bin [01:23] [ComfyUI] [comfy-env] [1] /opt/hostedtoolcache/Python/3.12.13/x64 [01:23] [ComfyUI] [comfy-env] [2] /snap/bin [01:23] [ComfyUI] [comfy-env] [3] /home/runner/.local/bin [01:23] [ComfyUI] [comfy-env] [4] /opt/pipx_bin [01:23] [ComfyUI] [comfy-env] [5] /home/runner/.cargo/bin [01:23] [ComfyUI] [comfy-env] [6] /home/runner/.config/composer/vendor/bin [01:23] [ComfyUI] [comfy-env] [7] /usr/local/.ghcup/bin [01:23] [ComfyUI] [comfy-env] [8] /home/runner/.dotnet/tools [01:23] [ComfyUI] [comfy-env] [9] /usr/local/sbin [01:23] [ComfyUI] [comfy-env] [10] /usr/local/bin [01:23] [ComfyUI] [comfy-env] [11] /usr/sbin [01:23] [ComfyUI] [comfy-env] [12] /usr/bin [01:23] [ComfyUI] [comfy-env] [13] /sbin [01:23] [ComfyUI] [comfy-env] [14] /bin [01:23] [ComfyUI] [comfy-env] [15] /usr/games [01:23] [ComfyUI] [comfy-env] [16] /usr/local/games [01:23] [ComfyUI] [comfy-env] [17] /snap/bin [01:26] [ComfyUI] [comfy-env] Metadata scan stderr for nodes: [01:26] [ComfyUI] [comfy-env] [meta-scan] importing nodes from /home/runner/work/comfy-gpu-ci/comfy-gpu-ci/test_workspaces/DepthAnythingV3-2120/ComfyUI/custom_nodes/ComfyUI-DepthAnythingV3 [01:26] [ComfyUI] [comfy-env] ERROR:root:Failed to import comfy_kitchen, Error: No module named 'comfy_kitchen', fp8 and fp4 support will not be available. [01:26] [ComfyUI] [comfy-env] [meta-scan] import OK [01:26] [ComfyUI] [comfy-env] Scanned nodes: 15 nodes (2.9s) [01:26] [ComfyUI] [comfy-env] Scanned nodes root: 15 nodes (2.9s) [01:26] [ComfyUI] [comfy-env] Imported nodes root: 15 nodes (isolation) [01:26] [ComfyUI] [comfy-env] Registered 15 total nodes [01:26] [ComfyUI] [01:26] [ComfyUI] Import times for custom nodes: [01:26] [ComfyUI] 0.0 seconds: /home/runner/work/comfy-gpu-ci/comfy-gpu-ci/test_workspaces/DepthAnythingV3-2120/ComfyUI/custom_nodes/websocket_image_save.py [01:26] [ComfyUI] 0.0 seconds: /home/runner/work/comfy-gpu-ci/comfy-gpu-ci/test_workspaces/DepthAnythingV3-2120/ComfyUI/custom_nodes/ComfyUI-validate-endpoint [01:26] [ComfyUI] 0.0 seconds: /home/runner/work/comfy-gpu-ci/comfy-gpu-ci/test_workspaces/DepthAnythingV3-2120/ComfyUI/custom_nodes/ComfyUI-VideoHelperSuite [01:26] [ComfyUI] 0.1 seconds: /home/runner/work/comfy-gpu-ci/comfy-gpu-ci/test_workspaces/DepthAnythingV3-2120/ComfyUI/custom_nodes/ComfyUI-KJNodes [01:26] [ComfyUI] 2.9 seconds: /home/runner/work/comfy-gpu-ci/comfy-gpu-ci/test_workspaces/DepthAnythingV3-2120/ComfyUI/custom_nodes/ComfyUI-DepthAnythingV3 [01:26] [ComfyUI] 5.9 seconds: /home/runner/work/comfy-gpu-ci/comfy-gpu-ci/test_workspaces/DepthAnythingV3-2120/ComfyUI/custom_nodes/ComfyUI-GeometryPack [01:26] [ComfyUI] [01:26] [ComfyUI] Context impl SQLiteImpl. [01:26] [ComfyUI] Will assume non-transactional DDL. [01:26] [ComfyUI] Context impl SQLiteImpl. [01:26] [ComfyUI] Will assume non-transactional DDL. [01:26] [ComfyUI] Running upgrade -> 0001_assets, Initial assets schema [01:26] [ComfyUI] Revision ID: 0001_assets [01:26] [ComfyUI] Revises: None [01:26] [ComfyUI] Create Date: 2025-12-10 00:00:00 [01:26] [ComfyUI] Running upgrade 0001_assets -> 0002_merge_to_asset_references, Merge AssetInfo and AssetCacheState into unified asset_references table. [01:26] [ComfyUI] Running upgrade 0002_merge_to_asset_references -> 0003_add_metadata_job_id, Add system_metadata and job_id columns to asset_references. [01:26] [ComfyUI] Change preview_id FK from assets.id to asset_references.id. [01:26] [ComfyUI] Database upgraded from None to 0003_add_metadata_job_id [01:26] [ComfyUI] Starting server [01:26] [ComfyUI] [01:26] [ComfyUI] To see the GUI go to: http://127.0.0.1:41881 [01:26] Server responding, waiting for nodes to load... [01:46] Server is ready! [01:46] Checking for import errors in server logs... [01:46] No import errors detected [01:46] Found 1120 registered nodes [01:46] [REGISTRATION] PASSED [01:46] [01:46] [4/5] INSTANTIATION [01:46] ---------------------------------------- [01:46] [DEBUG] server=, server_url=None, api= [01:46] Testing node constructors... [01:48] All 15 node(s) instantiated successfully! [01:48] [INSTANTIATION] PASSED [01:48] [01:48] [5/5] EXECUTION [01:48] ---------------------------------------- [01:48] [DEBUG] server=, server_url=None, api= [01:48] CPU runner - will execute 4 workflow(s) [01:48] Running 7 workflow(s) (all with videos)... [01:48] Installing screenshot dependencies (playwright, pillow)... [01:49] Packages installed, downloading chromium browser... [01:57] Screenshot dependencies installed successfully [01:58] Starting headless browser... [01:58] Installing Mesa llvmpipe (apt)... [02:08] Mesa install failed: E: Unable to locate package libegl1-mesa [02:08] No GPU, no Mesa -- using SwiftShader software rendering [02:09] Capturing execution frames: advanced.json [02:11] [ComfyUI] [DEPRECATION WARNING] Detected import of deprecated legacy API: /extensions/core/widgetInputs.js. This is likely caused by a custom node extension using outdated APIs. Please update your extensions or contact the extension author for an updated version. [02:16] Frame 1 saved (frame_000.jpg, t=0.0s) [02:16] Validating workflow... [02:16] [ComfyUI] === /validate endpoint called === [02:16] [ComfyUI] Received JSON with keys: ['prompt'] [02:16] [ComfyUI] Prompt has 11 nodes [02:16] [ComfyUI] Node 2: LoadImage [02:16] [ComfyUI] Inputs: {"image": "bridge.jpg"} [02:16] [ComfyUI] Node 3: DownloadAndLoadDepthAnythingV3Model [02:16] [ComfyUI] Inputs: {"model": "da3_large.safetensors", "precision": "auto", "attention": "auto"} [02:16] [ComfyUI] Node 4: PreviewImage [02:16] Queuing workflow for execution... [02:16] [ComfyUI] Inputs: {"images": ["12", 0]} [02:16] [ComfyUI] Node 6: PreviewImage [02:16] [ComfyUI] Inputs: {"images": ["12", 1]} [02:16] [ComfyUI] Node 7: PreviewImage [02:16] [ComfyUI] Inputs: {"images": ["12", 2]} [02:16] [ComfyUI] Node 8: PreviewImage [02:16] [ComfyUI] Inputs: {"images": ["12", 3]} [02:16] [ComfyUI] Node 9: PreviewAny [02:16] [ComfyUI] Inputs: {"source": ["12", 6]} [02:16] [ComfyUI] Node 10: PreviewAny [02:16] [ComfyUI] Inputs: {"source": ["12", 5]} [02:16] [ComfyUI] Node 11: MaskPreview [02:16] [ComfyUI] Inputs: {"mask": ["12", 7]} [02:16] [ComfyUI] Node 12: DepthAnything_V3 [02:16] [ComfyUI] Inputs: {"normalization_mode": "V2-Style", "resize_method": "resize", "invert_depth": false, "keep_model_size": false, "da3_model": ["3", 0], "images": ["2", 0]} [02:16] [ComfyUI] Node 13: PreviewImage [02:16] [ComfyUI] Inputs: {"images": ["12", 4]} [02:16] [ComfyUI] Generated prompt_id: 7db7f901-73e8-4206-8703-a99038e19de4 [02:16] [ComfyUI] Calling execution.validate_prompt()... [02:16] [ComfyUI] Validation result: valid=True [02:16] [ComfyUI] === Validation PASSED === [02:16] [ComfyUI] got prompt [02:16] [ComfyUI] [comfy-env] Running DownloadAndLoadDepthAnythingV3Model: model: 'da3_large.safetensors', precision: 'auto', attention: 'auto' [02:16] [ComfyUI] [SubprocessWorker] call_method: nodes.load_model.DownloadAndLoadDepthAnythingV3Model.EXECUTE_NORMALIZED [02:16] [ComfyUI] [comfy-env] SubprocessWorker: /home/runner/work/comfy-gpu-ci/comfy-gpu-ci/test_workspaces/DepthAnythingV3-2120/ComfyUI/.ce/.pixi/envs/depthanythingv3-nodes/bin/python [02:16] [ComfyUI] [SubprocessWorker] acquired lock, ensuring started... [02:16] [ComfyUI] [comfy-env] env_vars: {'COMFYUI_BASE': '/home/runner/work/comfy-gpu-ci/comfy-gpu-ci/test_workspaces/DepthAnythingV3-2120/ComfyUI'} [02:16] [ComfyUI] [ComfyUI-DepthAnythingV3] python: /home/runner/work/comfy-gpu-ci/comfy-gpu-ci/test_workspaces/DepthAnythingV3-2120/ComfyUI/.ce/.pixi/envs/depthanythingv3-nodes/bin/python [02:16] [ComfyUI] [ComfyUI-DepthAnythingV3] sys_path sent to worker: ['/home/runner/work/comfy-gpu-ci/comfy-gpu-ci/test_workspaces/DepthAnythingV3-2120/ComfyUI', '/home/runner/work/comfy-gpu-ci/comfy-gpu-ci/test_workspaces/DepthAnythingV3-2120/ComfyUI/custom_nodes/ComfyUI-DepthAnythingV3', '/home/runner/work/comfy-gpu-ci/comfy-gpu-ci/test_workspaces/DepthAnythingV3-2120/ComfyUI/.ce/.pixi/envs/depthanythingv3-nodes/lib/python3.11/site-packages', '/home/runner/work/comfy-gpu-ci/comfy-gpu-ci/test_workspaces/DepthAnythingV3-2120/ComfyUI/custom_nodes/ComfyUI-DepthAnythingV3'] [02:16] [ComfyUI] [SubprocessWorker] is_pixi=True, python=/home/runner/work/comfy-gpu-ci/comfy-gpu-ci/test_workspaces/DepthAnythingV3-2120/ComfyUI/.ce/.pixi/envs/depthanythingv3-nodes/bin/python [02:16] [ComfyUI] [SubprocessWorker] launching cmd=['/home/runner/.pixi/bin/pixi', 'run', '--as-is', '--manifest-path', '/home/runner/work/comfy-gpu-ci/comfy-gpu-ci/test_workspaces/DepthAnythingV3-2120/ComfyUI/.ce/pixi.toml', '-e', 'depthanythingv3-nodes', 'python', '/tmp/comfyui_pvenv_iyejiq02/persistent_worker.py', 'abstract://comfy_worker_5e8572b061da']... [02:16] [ComfyUI] [SubprocessWorker] socket_addr=abstract://comfy_worker_5e8572b061da (abstract, no filesystem path) [02:18] [ComfyUI] [worker:ComfyUI-DepthAnythingV3] ERROR: Failed to import comfy_kitchen, Error: No module named 'comfy_kitchen', fp8 and fp4 support will not be available. [02:18] [ComfyUI] [SubprocessWorker] worker started/confirmed [02:18] [ComfyUI] [SubprocessWorker] serializing kwargs to shm... [02:18] [ComfyUI] [SubprocessWorker] created 0 shm blocks [02:18] [ComfyUI] [SubprocessWorker] sending request via socket... [02:18] [ComfyUI] [SubprocessWorker] call_id=1 sending call_method [02:18] [ComfyUI] [02:19] Frame 2 saved (frame_001.jpg, t=2.3s) [02:19] [capture-periodic] freeze=2ms shot=93ms unfreeze=3ms saved=True [02:19] [ComfyUI] model.safetensors: 0%| | 0.00/1.64G [00:00 [03:16] [ComfyUI] [03:16] [ComfyUI] [worker:ComfyUI-DepthAnythingV3] === END === [03:16] [ComfyUI] [03:19] [capture-loop] iter=550 t=62.4s state={'complete': False, 'error': None, 'executedCount': 0, 'wsState': 1} eval_ms=2 ram=3.4/15.6GB (22%) swap=0.0/3.0GB (0%) cpu=32% browser_rss=0.79GB [03:24] [capture-loop] iter=600 t=68.0s state={'complete': False, 'error': None, 'executedCount': 0, 'wsState': 1} eval_ms=3 ram=3.3/15.6GB (21%) swap=0.0/3.0GB (0%) cpu=32% browser_rss=0.78GB [03:30] [capture-loop] iter=650 t=73.5s state={'complete': False, 'error': None, 'executedCount': 0, 'wsState': 1} eval_ms=3 ram=3.3/15.6GB (21%) swap=0.0/3.0GB (0%) cpu=32% browser_rss=0.78GB [03:35] [capture-loop] iter=700 t=79.0s state={'complete': False, 'error': None, 'executedCount': 0, 'wsState': 1} eval_ms=2 ram=3.2/15.6GB (21%) swap=0.0/3.0GB (0%) cpu=32% browser_rss=0.79GB [03:41] [capture-loop] iter=750 t=84.5s state={'complete': False, 'error': None, 'executedCount': 0, 'wsState': 1} eval_ms=2 ram=2.8/15.6GB (18%) swap=0.0/3.0GB (0%) cpu=31% browser_rss=0.78GB [03:46] [capture-loop] iter=800 t=90.0s state={'complete': False, 'error': None, 'executedCount': 0, 'wsState': 1} eval_ms=2 ram=3.3/15.6GB (21%) swap=0.0/3.0GB (0%) cpu=32% browser_rss=0.79GB [03:52] [capture-loop] iter=850 t=95.4s state={'complete': False, 'error': None, 'executedCount': 0, 'wsState': 1} eval_ms=2 ram=3.3/15.6GB (21%) swap=0.0/3.0GB (0%) cpu=32% browser_rss=0.79GB [03:57] [capture-loop] iter=900 t=101.0s state={'complete': False, 'error': None, 'executedCount': 0, 'wsState': 1} eval_ms=2 ram=3.6/15.6GB (23%) swap=0.0/3.0GB (0%) cpu=32% browser_rss=0.79GB [04:03] [capture-loop] iter=950 t=106.4s state={'complete': False, 'error': None, 'executedCount': 0, 'wsState': 1} eval_ms=2 ram=3.4/15.6GB (22%) swap=0.0/3.0GB (0%) cpu=32% browser_rss=0.79GB [04:05] [ComfyUI] [SubprocessWorker] callback 'report_progress' from call_id=2 [04:05] [ComfyUI] [SubprocessWorker] got response: ok [04:05] [ComfyUI] [comfy-env] DepthAnything_V3 done (99.41s): result: NodeOutput [04:05] Node executed (2 total), capturing... [04:05] [ComfyUI] Prompt executed in 108.88 seconds [04:05] Frame 6 saved (frame_005.jpg, t=109.1s) [04:05] [capture-node] freeze=4ms shot=175ms unfreeze=5ms saved=True [04:06] Node executed (8 total), capturing... [04:06] Frame 7 saved (frame_006.jpg, t=109.6s) [04:06] [capture-node] freeze=2ms shot=107ms unfreeze=0ms saved=True [04:06] Execution complete (t=109.6s) [04:06] Captured 7 unique frames over 109.75s [04:06] [debug] iframes: 0 [04:06] [timing] trigger_3d_previews: 0.0s [04:08] Saved high-quality screenshot: advanced_executed.png [04:08] [timing] final_screenshot: 0.3s [04:09] Capturing execution frames: advanced_3d.json [04:15] Frame 1 saved (frame_000.jpg, t=0.0s) [04:15] Validating workflow... [04:15] [ComfyUI] === /validate endpoint called === [04:15] [ComfyUI] Received JSON with keys: ['prompt'] [04:15] [ComfyUI] Prompt has 6 nodes [04:15] [ComfyUI] Node 2: LoadImage [04:15] [ComfyUI] Inputs: {"image": "kaffi.jpg"} [04:15] [ComfyUI] Node 3: DownloadAndLoadDepthAnythingV3Model [04:15] [ComfyUI] Inputs: {"model": "da3_large.safetensors", "precision": "auto", "attention": "auto"} [04:15] [ComfyUI] Node 21: DepthAnything_V3 [04:15] [ComfyUI] Inputs: {"normalization_mode": "Raw", "resize_method": "resize", "invert_depth": false, "keep_model_size": false, "da3_model": ["3", 0], "images": ["2", 0]} [04:15] [ComfyUI] Node 22: DA3_ToPointCloud [04:15] [ComfyUI] Inputs: {"confidence_threshold": 0.2, "downsample": 1, "allow_around_1": 1, "filter_outliers": false, "outlier_percentage": 5, "depth_raw": ["21", 0], "confidence": ["21", 1], "intrinsics": ["21", 6], "sky_ma [04:15] Queuing workflow for execution... [04:15] [ComfyUI] Node 23: DA3_SavePointCloud [04:15] [ComfyUI] Inputs: {"filename_prefix": "pointcloud", "pointcloud": ["22", 0]} [04:15] [ComfyUI] Node 25: DA3_PreviewPointCloud [04:15] [ComfyUI] Inputs: {"file_path": ["23", 0], "color_mode": "RGB", "preview_vtk": ""} [04:15] [ComfyUI] Generated prompt_id: fbc5715a-2eca-4c66-bfd3-e5da0f8d7ec5 [04:15] [ComfyUI] Calling execution.validate_prompt()... [04:15] [ComfyUI] Validation result: valid=True [04:15] [ComfyUI] === Validation PASSED === [04:15] [ComfyUI] got prompt [04:15] [ComfyUI] [comfy-env] Running DownloadAndLoadDepthAnythingV3Model: model: 'da3_large.safetensors', precision: 'auto', attention: 'auto' [04:15] [ComfyUI] [SubprocessWorker] call_method: nodes.load_model.DownloadAndLoadDepthAnythingV3Model.EXECUTE_NORMALIZED [04:15] [ComfyUI] [SubprocessWorker] acquired lock, ensuring started... [04:15] [ComfyUI] [ComfyUI-DepthAnythingV3] Health check: ping (timeout=5.0s)... [04:15] [ComfyUI] [ComfyUI-DepthAnythingV3] Health check: ok [04:15] [ComfyUI] [SubprocessWorker] worker started/confirmed [04:15] [ComfyUI] [SubprocessWorker] serializing kwargs to shm... [04:15] [ComfyUI] [SubprocessWorker] created 0 shm blocks [04:15] [ComfyUI] [SubprocessWorker] sending request via socket... [04:15] [ComfyUI] [SubprocessWorker] call_id=3 sending call_method [04:15] [ComfyUI] [SubprocessWorker] got response: ok [04:15] [ComfyUI] [comfy-env] DownloadAndLoadDepthAnythingV3Model done (0.02s): result: NodeOutput [04:15] [ComfyUI] [comfy-env] Running DepthAnything_V3: normalization_mode: 'Raw', resize_method: 'resize', invert_depth: False, keep_model_size: False, da3_model: dict, images: torch.float32 [1,533,800,3] cpu [04:15] [ComfyUI] [SubprocessWorker] call_method: nodes.nodes_inference.DepthAnything_V3.EXECUTE_NORMALIZED [04:15] [ComfyUI] [SubprocessWorker] acquired lock, ensuring started... [04:15] [ComfyUI] [ComfyUI-DepthAnythingV3] Health check: ping (timeout=5.0s)... [04:15] [ComfyUI] [ComfyUI-DepthAnythingV3] Health check: ok [04:15] [ComfyUI] [SubprocessWorker] worker started/confirmed [04:15] [ComfyUI] [comfy-env] PRE-SERIALIZE 'images' shape: torch.Size([1, 533, 800, 3]) [04:15] [ComfyUI] [SubprocessWorker] serializing kwargs to shm... [04:15] [ComfyUI] [SubprocessWorker] created 0 shm blocks [04:15] [ComfyUI] [SubprocessWorker] sending request via socket... [04:15] [ComfyUI] [SubprocessWorker] call_id=4 sending call_method [04:15] [ComfyUI] [worker:ComfyUI-DepthAnythingV3] [comfy-env] _from_shm got dict with keys: ['__type__', 'strategy', 'parent_pid', 'fd', 'storage_size'] [04:15] [ComfyUI] [worker:ComfyUI-DepthAnythingV3] [comfy-env] DESERIALIZE TensorRef: tensor_size=[1, 533, 800, 3] [04:15] [ComfyUI] [worker:ComfyUI-DepthAnythingV3] [comfy-env] DESERIALIZED tensor shape: torch.Size([1, 533, 800, 3]) [04:15] [ComfyUI] [SubprocessWorker] callback 'request_vram_budget' from call_id=4 [04:15] [ComfyUI] [comfy-env] VRAM request: 1.64GB, free before eviction: 13.72GB [04:15] [ComfyUI] [comfy-env] VRAM after eviction: 13.72GB [04:16] [ComfyUI] [worker:ComfyUI-DepthAnythingV3] [04:16] [ComfyUI] === WATCHDOG TICK 2 === [04:16] [ComfyUI] [worker:ComfyUI-DepthAnythingV3] Thread 0x00007fef8423e6c0 (most recent call first): [04:16] [ComfyUI] File "/home/runner/work/comfy-gpu-ci/comfy-gpu-ci/test_workspaces/DepthAnythingV3-2120/ComfyUI/.ce/.pixi/envs/depthanythingv3-nodes/lib/python3.11/socket.py", line 294 in accept [04:16] [ComfyUI] File "/home/runner/work/comfy-gpu-ci/comfy-gpu-ci/test_workspaces/DepthAnythingV3-2120/ComfyUI/.ce/.pixi/envs/depthanythingv3-nodes/lib/python3.11/multiprocessing/connection.py", line 626 in accept [04:16] [ComfyUI] File "/home/runner/work/comfy-gpu-ci/comfy-gpu-ci/test_workspaces/DepthAnythingV3-2120/ComfyUI/.ce/.pixi/envs/depthanythingv3-nodes/lib/python3.11/multiprocessing/connection.py", line 480 in accept [04:16] [ComfyUI] File "/home/runner/work/comfy-gpu-ci/comfy-gpu-ci/test_workspaces/DepthAnythingV3-2120/ComfyUI/.ce/.pixi/envs/depthanythingv3-nodes/lib/python3.11/multiprocessing/resource_sharer.py", line 138 in _serve [04:16] [ComfyUI] File "/home/runner/work/comfy-gpu-ci/comfy-gpu-ci/test_workspaces/DepthAnythingV3-2120/ComfyUI/.ce/.pixi/envs/depthanythingv3-nodes/lib/python3.11/threading.py", line 982 in run [04:16] [ComfyUI] File "/home/runner/work/comfy-gpu-ci/comfy-gpu-ci/test_workspaces/DepthAnythingV3-2120/ComfyUI/.ce/.pixi/envs/depthanythingv3-nodes/lib/python3.11/threading.py", line 1045 in _bootstrap_inner [04:16] [ComfyUI] File "/home/runner/work/comfy-gpu-ci/comfy-gpu-ci/test_workspaces/DepthAnythingV3-2120/ComfyUI/.ce/.pixi/envs/depthanythingv3-nodes/lib/python3.11/threading.py", line 1002 in _bootstrap [04:16] [ComfyUI] [04:16] [ComfyUI] Thread 0x00007ff0117556c0 (most recent call first): [04:16] [ComfyUI] File "/home/runner/work/comfy-gpu-ci/comfy-gpu-ci/test_workspaces/DepthAnythingV3-2120/ComfyUI/.ce/.pixi/envs/depthanythingv3-nodes/lib/python3.11/threading.py", line 331 in wait [04:16] [ComfyUI] File "/home/runner/work/comfy-gpu-ci/comfy-gpu-ci/test_workspaces/DepthAnythingV3-2120/ComfyUI/.ce/.pixi/envs/depthanythingv3-nodes/lib/python3.11/threading.py", line 629 in wait [04:16] [ComfyUI] File "/home/runner/work/comfy-gpu-ci/comfy-gpu-ci/test_workspaces/DepthAnythingV3-2120/ComfyUI/.ce/.pixi/envs/depthanythingv3-nodes/lib/python3.11/site-packages/tqdm/_monitor.py", line 60 in run [04:16] [ComfyUI] File "/home/runner/work/comfy-gpu-ci/comfy-gpu-ci/test_workspaces/DepthAnythingV3-2120/ComfyUI/.ce/.pixi/envs/depthanythingv3-nodes/lib/python3.11/threading.py", line 1045 in _bootstrap_inner [04:16] [ComfyUI] File "/home/runner/work/comfy-gpu-ci/comfy-gpu-ci/test_workspaces/DepthAnythingV3-2120/ComfyUI/.ce/.pixi/envs/depthanythingv3-nodes/lib/python3.11/threading.py", line 1002 in _bootstrap [04:16] [ComfyUI] [04:16] [ComfyUI] Current thread 0x00007ff0127566c0 (most recent call first): [04:16] [ComfyUI] File "/tmp/comfyui_pvenv_iyejiq02/persistent_worker.py", line 52 in _watchdog [04:16] [ComfyUI] File "/home/runner/work/comfy-gpu-ci/comfy-gpu-ci/test_workspaces/DepthAnythingV3-2120/ComfyUI/.ce/.pixi/envs/depthanythingv3-nodes/lib/python3.11/threading.py", line 982 in run [04:16] [ComfyUI] File "/home/runner/work/comfy-gpu-ci/comfy-gpu-ci/test_workspaces/DepthAnythingV3-2120/ComfyUI/.ce/.pixi/envs/depthanythingv3-nodes/lib/python3.11/threading.py", line 1045 in _bootstrap_inner [04:16] [ComfyUI] File "/home/runner/work/comfy-gpu-ci/comfy-gpu-ci/test_workspaces/DepthAnythingV3-2120/ComfyUI/.ce/.pixi/envs/depthanythingv3-nodes/lib/python3.11/threading.py", line 1002 in _bootstrap [04:16] [ComfyUI] [04:16] [ComfyUI] Thread 0x00007ff01327e740 (most recent call first): [04:16] [ComfyUI] File "/home/runner/work/comfy-gpu-ci/comfy-gpu-ci/test_workspaces/DepthAnythingV3-2120/ComfyUI/comfy/ldm/modules/sub_quadratic_attention.py", line 181 in _get_attention_scores_no_kv_chunking [04:16] [ComfyUI] File "/home/runner/work/comfy-gpu-ci/comfy-gpu-ci/test_workspaces/DepthAnythingV3-2120/ComfyUI/comfy/ldm/modules/sub_quadratic_attention.py", line 259 in efficient_dot_product_attention [04:16] [ComfyUI] File "/home/runner/work/comfy-gpu-ci/comfy-gpu-ci/test_workspaces/DepthAnythingV3-2120/ComfyUI/comfy/ldm/modules/attention.py", line 275 in attention_sub_quad [04:16] [ComfyUI] File "/home/runner/work/comfy-gpu-ci/comfy-gpu-ci/test_workspaces/DepthAnythingV3-2120/ComfyUI/comfy/ldm/modules/attention.py", line 139 in wrapper [04:16] [ComfyUI] File "/home/runner/work/comfy-gpu-ci/comfy-gpu-ci/test_workspaces/DepthAnythingV3-2120/ComfyUI/custom_nodes/ComfyUI-DepthAnythingV3/nodes/depth_anything_v3/model.py", line 453 in forward [04:16] [ComfyUI] File "/home/runner/work/comfy-gpu-ci/comfy-gpu-ci/test_workspaces/DepthAnythingV3-2120/ComfyUI/.ce/.pixi/envs/depthanythingv3-nodes/lib/python3.11/site-packages/torch/nn/modules/module.py", line 1790 in _call_impl [04:16] [ComfyUI] File "/home/runner/work/comfy-gpu-ci/comfy-gpu-ci/test_workspaces/DepthAnythingV3-2120/ComfyUI/.ce/.pixi/envs/depthanythingv3-nodes/lib/python3.11/site-packages/torch/nn/modules/module.py", line 1779 in _wrapped_call_impl [04:16] [ComfyUI] File "/home/runner/work/comfy-gpu-ci/comfy-gpu-ci/test_workspaces/DepthAnythingV3-2120/ComfyUI/custom_nodes/ComfyUI-DepthAnythingV3/nodes/depth_anything_v3/model.py", line 516 in attn_residual_func [04:16] [ComfyUI] File "/home/runner/work/comfy-gpu-ci/comfy-gpu-ci/test_workspaces/DepthAnythingV3-2120/ComfyUI/custom_nodes/ComfyUI-DepthAnythingV3/nodes/depth_anything_v3/model.py", line 521 in forward [04:16] [ComfyUI] File "/home/runner/work/comfy-gpu-ci/comfy-gpu-ci/test_workspaces/DepthAnythingV3-2120/ComfyUI/.ce/.pixi/envs/depthanythingv3-nodes/lib/python3.11/site-packages/torch/nn/modules/module.py", line 1790 in _call_impl [04:16] [ComfyUI] File "/home/runner/work/comfy-gpu-ci/comfy-gpu-ci/test_workspaces/DepthAnythingV3-2120/ComfyUI/.ce/.pixi/envs/depthanythingv3-nodes/lib/python3.11/site-packages/torch/nn/modules/module.py", line 1779 in _wrapped_call_impl [04:16] [ComfyUI] File "/home/runner/work/comfy-gpu-ci/comfy-gpu-ci/test_workspaces/DepthAnythingV3-2120/ComfyUI/custom_nodes/ComfyUI-DepthAnythingV3/nodes/depth_anything_v3/model.py", line 791 in process_attention [04:16] [ComfyUI] File "/home/runner/work/comfy-gpu-ci/comfy-gpu-ci/test_workspaces/DepthAnythingV3-2120/ComfyUI/custom_nodes/ComfyUI-DepthAnythingV3/nodes/depth_anything_v3/model.py", line 750 in _get_intermediate_layers_not_chunked [04:16] [ComfyUI] File "/home/runner/work/comfy-gpu-ci/comfy-gpu-ci/test_workspaces/DepthAnythingV3-2120/ComfyUI/custom_nodes/ComfyUI-DepthAnythingV3/nodes/depth_anything_v3/model.py", line 800 in get_intermediate_layers [04:16] [ComfyUI] File "/home/runner/work/comfy-gpu-ci/comfy-gpu-ci/test_workspaces/DepthAnythingV3-2120/ComfyUI/custom_nodes/ComfyUI-DepthAnythingV3/nodes/depth_anything_v3/model.py", line 891 in forward [04:16] [ComfyUI] File "/home/runner/work/comfy-gpu-ci/comfy-gpu-ci/test_workspaces/DepthAnythingV3-2120/ComfyUI/.ce/.pixi/envs/depthanythingv3-nodes/lib/python3.11/site-packages/torch/nn/modules/module.py", line 1790 in _call_impl [04:16] [ComfyUI] File "/home/runner/work/comfy-gpu-ci/comfy-gpu-ci/test_workspaces/DepthAnythingV3-2120/ComfyUI/.ce/.pixi/envs/depthanythingv3-nodes/lib/python3.11/site-packages/torch/nn/modules/module.py", line 1779 in _wrapped_call_impl [04:16] [ComfyUI] File "/home/runner/work/comfy-gpu-ci/comfy-gpu-ci/test_workspaces/DepthAnythingV3-2120/ComfyUI/custom_nodes/ComfyUI-DepthAnythingV3/nodes/depth_anything_v3/model.py", line 1560 in forward [04:16] [ComfyUI] File "/home/runner/work/comfy-gpu-ci/comfy-gpu-ci/test_workspaces/DepthAnythingV3-2120/ComfyUI/.ce/.pixi/envs/depthanythingv3-nodes/lib/python3.11/site-packages/torch/nn/modules/module.py", line 1790 in _call_impl [04:16] [ComfyUI] File "/home/runner/work/comfy-gpu-ci/comfy-gpu-ci/test_workspaces/DepthAnythingV3-2120/ComfyUI/.ce/.pixi/envs/depthanythingv3-nodes/lib/python3.11/site-packages/torch/nn/modules/module.py", line 1779 in _wrapped_call_impl [04:16] [ComfyUI] File "/home/runner/work/comfy-gpu-ci/comfy-gpu-ci/test_workspaces/DepthAnythingV3-2120/ComfyUI/custom_nodes/ComfyUI-DepthAnythingV3/nodes/nodes_inference.py", line 156 in execute [04:16] [ComfyUI] File "/home/runner/work/comfy-gpu-ci/comfy-gpu-ci/test_workspaces/DepthAnythingV3-2120/ComfyUI/comfy_api/latest/_io.py", line 1833 in EXECUTE_NORMALIZED [04:16] [ComfyUI] File "/tmp/comfyui_pvenv_iyejiq02/persistent_worker.py", line 1762 in main [04:16] [ComfyUI] File "/tmp/comfyui_pvenv_iyejiq02/persistent_worker.py", line 1807 in [04:16] [ComfyUI] [04:16] [ComfyUI] [worker:ComfyUI-DepthAnythingV3] === END === [04:16] [ComfyUI] [04:17] Frame 2 saved (frame_001.jpg, t=2.2s) [04:17] [capture-periodic] freeze=3ms shot=113ms unfreeze=3ms saved=True [04:19] Frame 3 saved (frame_002.jpg, t=4.4s) [04:19] [capture-periodic] freeze=3ms shot=95ms unfreeze=3ms saved=True [04:20] [capture-loop] iter=50 t=5.7s state={'complete': False, 'error': None, 'executedCount': 0, 'wsState': 1} eval_ms=3 ram=3.0/15.6GB (19%) swap=0.0/3.0GB (0%) cpu=28% browser_rss=0.95GB [04:26] [capture-loop] iter=100 t=11.2s state={'complete': False, 'error': None, 'executedCount': 0, 'wsState': 1} eval_ms=2 ram=3.0/15.6GB (19%) swap=0.0/3.0GB (0%) cpu=32% browser_rss=0.95GB [04:31] [capture-loop] iter=150 t=16.7s state={'complete': False, 'error': None, 'executedCount': 0, 'wsState': 1} eval_ms=3 ram=3.2/15.6GB (21%) swap=0.0/3.0GB (0%) cpu=32% browser_rss=0.95GB [04:37] [capture-loop] iter=200 t=22.2s state={'complete': False, 'error': None, 'executedCount': 0, 'wsState': 1} eval_ms=2 ram=3.0/15.6GB (19%) swap=0.0/3.0GB (0%) cpu=32% browser_rss=0.95GB [04:42] [capture-loop] iter=250 t=27.7s state={'complete': False, 'error': None, 'executedCount': 0, 'wsState': 1} eval_ms=3 ram=3.0/15.6GB (19%) swap=0.0/3.0GB (0%) cpu=35% browser_rss=0.86GB [04:48] [capture-loop] iter=300 t=33.3s state={'complete': False, 'error': None, 'executedCount': 0, 'wsState': 1} eval_ms=3 ram=3.2/15.6GB (21%) swap=0.0/3.0GB (0%) cpu=32% browser_rss=0.86GB [04:53] [capture-loop] iter=350 t=38.7s state={'complete': False, 'error': None, 'executedCount': 0, 'wsState': 1} eval_ms=2 ram=3.3/15.6GB (21%) swap=0.0/3.0GB (0%) cpu=32% browser_rss=0.86GB [04:59] [capture-loop] iter=400 t=44.3s state={'complete': False, 'error': None, 'executedCount': 0, 'wsState': 1} eval_ms=2 ram=3.2/15.6GB (20%) swap=0.0/3.0GB (0%) cpu=32% browser_rss=0.86GB [04:59] [ComfyUI] [SubprocessWorker] callback 'report_progress' from call_id=4 [04:59] [ComfyUI] [SubprocessWorker] got response: ok [04:59] [ComfyUI] [comfy-env] DepthAnything_V3 done (44.42s): result: NodeOutput [04:59] [ComfyUI] [comfy-env] Running DA3_ToPointCloud: confidence_threshold: 0.2, downsample: 1, allow_around_1: True, filter_outliers: False, outlier_percentage: 5.0, depth_raw: torch.float32 [1,532,800,3] cpu, confidence: torch.float32 [1,532,800,3] cpu, intrinsics: '{\n "intrinsics": [\n {\n "image_0": [\n ..., sky_mask: torch.float32 [1,532,800] cpu, source_image: torch.float32 [1,532,800,3] cpu [04:59] [ComfyUI] [SubprocessWorker] call_method: nodes.nodes_3d.DA3_ToPointCloud.EXECUTE_NORMALIZED [04:59] [ComfyUI] [SubprocessWorker] acquired lock, ensuring started... [04:59] [ComfyUI] [ComfyUI-DepthAnythingV3] Health check: ping (timeout=5.0s)... [04:59] [ComfyUI] [ComfyUI-DepthAnythingV3] Health check: ok [04:59] [ComfyUI] [SubprocessWorker] worker started/confirmed [04:59] [ComfyUI] [comfy-env] PRE-SERIALIZE 'depth_raw' shape: torch.Size([1, 532, 800, 3]) [04:59] [ComfyUI] [comfy-env] PRE-SERIALIZE 'confidence' shape: torch.Size([1, 532, 800, 3]) [04:59] [ComfyUI] [comfy-env] PRE-SERIALIZE 'sky_mask' shape: torch.Size([1, 532, 800]) [04:59] [ComfyUI] [comfy-env] PRE-SERIALIZE 'source_image' shape: torch.Size([1, 532, 800, 3]) [04:59] [ComfyUI] [SubprocessWorker] serializing kwargs to shm... [04:59] [ComfyUI] [SubprocessWorker] created 0 shm blocks [04:59] [ComfyUI] [SubprocessWorker] sending request via socket... [04:59] [ComfyUI] [SubprocessWorker] call_id=5 sending call_method [04:59] [ComfyUI] [worker:ComfyUI-DepthAnythingV3] [comfy-env] _from_shm got dict with keys: ['__type__', 'strategy', 'parent_pid', 'fd', 'storage_size'] [04:59] [ComfyUI] [worker:ComfyUI-DepthAnythingV3] [comfy-env] DESERIALIZE TensorRef: tensor_size=[1, 532, 800, 3] [04:59] [ComfyUI] [worker:ComfyUI-DepthAnythingV3] [comfy-env] DESERIALIZED tensor shape: torch.Size([1, 532, 800, 3]) [04:59] [ComfyUI] [worker:ComfyUI-DepthAnythingV3] [comfy-env] _from_shm got dict with keys: ['__type__', 'strategy', 'parent_pid', 'fd', 'storage_size'] [04:59] [ComfyUI] [worker:ComfyUI-DepthAnythingV3] [comfy-env] DESERIALIZE TensorRef: tensor_size=[1, 532, 800, 3] [04:59] [ComfyUI] [worker:ComfyUI-DepthAnythingV3] [comfy-env] DESERIALIZED tensor shape: torch.Size([1, 532, 800, 3]) [04:59] [ComfyUI] [worker:ComfyUI-DepthAnythingV3] [comfy-env] _from_shm got dict with keys: ['__type__', 'strategy', 'parent_pid', 'fd', 'storage_size'] [04:59] [ComfyUI] [worker:ComfyUI-DepthAnythingV3] [comfy-env] DESERIALIZE TensorRef: tensor_size=[1, 532, 800] [04:59] [ComfyUI] [worker:ComfyUI-DepthAnythingV3] [comfy-env] DESERIALIZED tensor shape: torch.Size([1, 532, 800]) [04:59] [ComfyUI] [worker:ComfyUI-DepthAnythingV3] [comfy-env] _from_shm got dict with keys: ['__type__', 'strategy', 'parent_pid', 'fd', 'storage_size'] [04:59] [ComfyUI] [worker:ComfyUI-DepthAnythingV3] [comfy-env] DESERIALIZE TensorRef: tensor_size=[1, 532, 800, 3] [04:59] [ComfyUI] [worker:ComfyUI-DepthAnythingV3] [comfy-env] DESERIALIZED tensor shape: torch.Size([1, 532, 800, 3]) [04:59] [ComfyUI] [SubprocessWorker] got response: ok [04:59] [ComfyUI] [comfy-env] DA3_ToPointCloud done (0.07s): result: NodeOutput [04:59] [ComfyUI] [comfy-env] Running DA3_SavePointCloud: filename_prefix: 'pointcloud', pointcloud: list[1] [04:59] [ComfyUI] [SubprocessWorker] call_method: nodes.nodes_3d.DA3_SavePointCloud.EXECUTE_NORMALIZED [04:59] [ComfyUI] [SubprocessWorker] acquired lock, ensuring started... [04:59] [ComfyUI] [ComfyUI-DepthAnythingV3] Health check: ping (timeout=5.0s)... [04:59] [ComfyUI] [ComfyUI-DepthAnythingV3] Health check: ok [04:59] [ComfyUI] [SubprocessWorker] worker started/confirmed [04:59] [ComfyUI] [SubprocessWorker] serializing kwargs to shm... [04:59] [ComfyUI] [SubprocessWorker] created 0 shm blocks [04:59] [ComfyUI] [SubprocessWorker] sending request via socket... [04:59] [ComfyUI] [SubprocessWorker] call_id=6 sending call_method [04:59] [ComfyUI] [worker:ComfyUI-DepthAnythingV3] [comfy-env] _from_shm got dict with keys: ['__type__', 'strategy', 'parent_pid', 'fd', 'storage_size'] [04:59] [ComfyUI] [worker:ComfyUI-DepthAnythingV3] [comfy-env] DESERIALIZE TensorRef: tensor_size=[311011, 3] [04:59] [ComfyUI] [worker:ComfyUI-DepthAnythingV3] [comfy-env] DESERIALIZED tensor shape: torch.Size([311011, 3]) [04:59] [ComfyUI] [worker:ComfyUI-DepthAnythingV3] [comfy-env] _from_shm got dict with keys: ['__type__', 'strategy', 'parent_pid', 'fd', 'storage_size'] [04:59] [ComfyUI] [worker:ComfyUI-DepthAnythingV3] [comfy-env] DESERIALIZE TensorRef: tensor_size=[311011] [04:59] [ComfyUI] [worker:ComfyUI-DepthAnythingV3] [comfy-env] DESERIALIZED tensor shape: torch.Size([311011]) [04:59] [ComfyUI] [worker:ComfyUI-DepthAnythingV3] [comfy-env] _from_shm got dict with keys: ['__type__', 'strategy', 'parent_pid', 'fd', 'storage_size'] [04:59] [ComfyUI] [worker:ComfyUI-DepthAnythingV3] [comfy-env] DESERIALIZE TensorRef: tensor_size=[311011, 3] [04:59] [ComfyUI] [worker:ComfyUI-DepthAnythingV3] [comfy-env] DESERIALIZED tensor shape: torch.Size([311011, 3]) [05:00] Frame 4 saved (frame_003.jpg, t=45.9s) [05:00] [capture-periodic] freeze=2ms shot=91ms unfreeze=4ms saved=True [05:01] [ComfyUI] [SubprocessWorker] got response: ok [05:01] [ComfyUI] [comfy-env] DA3_SavePointCloud done (2.04s): result: NodeOutput [05:01] [ComfyUI] [comfy-env] Running DA3_PreviewPointCloud: file_path: '/home/runner/work/comfy-gpu-ci/comfy-gpu-ci/test_workspa..., color_mode: 'RGB' [05:01] [ComfyUI] [SubprocessWorker] call_method: nodes.preview_nodes.DA3_PreviewPointCloud.EXECUTE_NORMALIZED [05:01] [ComfyUI] [SubprocessWorker] acquired lock, ensuring started... [05:01] [ComfyUI] [ComfyUI-DepthAnythingV3] Health check: ping (timeout=5.0s)... [05:01] [ComfyUI] [ComfyUI-DepthAnythingV3] Health check: ok [05:01] [ComfyUI] [SubprocessWorker] worker started/confirmed [05:01] [ComfyUI] [SubprocessWorker] serializing kwargs to shm... [05:01] [ComfyUI] [SubprocessWorker] created 0 shm blocks [05:01] [ComfyUI] [SubprocessWorker] sending request via socket... [05:01] [ComfyUI] [SubprocessWorker] call_id=7 sending call_method [05:01] [ComfyUI] [SubprocessWorker] got response: ok [05:01] [ComfyUI] [comfy-env] DA3_PreviewPointCloud done (0.01s): result: NodeOutput [05:01] [ComfyUI] Prompt executed in 46.57 seconds [05:01] Node executed (1 total), capturing... [05:01] Frame 5 saved (frame_004.jpg, t=46.9s) [05:01] [capture-node] freeze=3ms shot=99ms unfreeze=3ms saved=True [05:03] Node executed (2 total), capturing... [05:04] Frame 6 saved (frame_005.jpg, t=49.0s) [05:04] [capture-node] freeze=3ms shot=91ms unfreeze=0ms saved=True [05:04] Execution complete (t=49.0s) [05:04] Captured 6 unique frames over 49.12s [05:04] [debug] iframes: 1 [05:04] [debug] iframe[0]: src=http://127.0.0.1:41881/extensions/ComfyUI-GeometryPack/viewer_vtk.html?v=1778448, canvas=486x394, rafFrozen=True [05:04] [timing] trigger_3d_previews: 0.0s [05:06] Saved high-quality screenshot: advanced_3d_executed.png [05:06] [timing] final_screenshot: 0.2s [05:06] Capturing execution frames: advanced_3d_multiview.json [05:12] Frame 1 saved (frame_000.jpg, t=0.0s) [05:12] Validating workflow... [05:12] [ComfyUI] === /validate endpoint called === [05:12] [ComfyUI] Received JSON with keys: ['prompt'] [05:12] [ComfyUI] Prompt has 8 nodes [05:12] [ComfyUI] Node 3: DownloadAndLoadDepthAnythingV3Model [05:12] [ComfyUI] Inputs: {"model": "da3_large.safetensors", "precision": "auto", "attention": "auto"} [05:12] [ComfyUI] Node 21: LoadImageDataSetFromFolder [05:12] [ComfyUI] Inputs: {"folder": "SOH"} [05:12] [ComfyUI] Node 27: PreviewImage [05:12] [ComfyUI] Inputs: {"images": ["21", 0]} [05:12] [ComfyUI] Node 38: DA3_MultiViewPointCloud [05:12] [ComfyUI] Inputs: {"extrinsics": ["39", 4], "intrinsics": ["39", 5], "confidence_threshold": 0.3, "downsample": 4, "use_icp": false, "allow_around_1": false, "filter_outliers": true, "outlier_percentage": 5, "depths": [05:12] [ComfyUI] Node 39: DepthAnythingV3_MultiView [05:12] [ComfyUI] Inputs: {"normalization_mode": "Raw", "resize_method": "resize", "invert_depth": false, "keep_model_size": false, "da3_model": ["3", 0], "images": ["21", 0]} [05:12] Queuing workflow for execution... [05:12] [ComfyUI] Node 44: DA3_SavePointCloud [05:12] [ComfyUI] Inputs: {"filename_prefix": "pointcloud", "pointcloud": ["38", 0]} [05:12] [ComfyUI] Node 45: PreviewAny [05:12] [ComfyUI] Inputs: {"source": ["44", 0]} [05:12] [ComfyUI] Node 48: DA3_PreviewPointCloud [05:12] [ComfyUI] Inputs: {"file_path": ["44", 0], "color_mode": "RGB", "preview_vtk": ""} [05:12] [ComfyUI] Generated prompt_id: 3a163ba4-f75e-46bb-b469-fda4d48cadc1 [05:12] [ComfyUI] Calling execution.validate_prompt()... [05:12] [ComfyUI] Validation result: valid=True [05:12] [ComfyUI] === Validation PASSED === [05:12] [ComfyUI] got prompt [05:13] [ComfyUI] [comfy-env] Running DownloadAndLoadDepthAnythingV3Model: model: 'da3_large.safetensors', precision: 'auto', attention: 'auto' [05:13] [ComfyUI] [SubprocessWorker] call_method: nodes.load_model.DownloadAndLoadDepthAnythingV3Model.EXECUTE_NORMALIZED [05:13] [ComfyUI] [SubprocessWorker] acquired lock, ensuring started... [05:13] [ComfyUI] [ComfyUI-DepthAnythingV3] Health check: ping (timeout=5.0s)... [05:13] [ComfyUI] [ComfyUI-DepthAnythingV3] Health check: ok [05:13] [ComfyUI] [SubprocessWorker] worker started/confirmed [05:13] [ComfyUI] [SubprocessWorker] serializing kwargs to shm... [05:13] [ComfyUI] [SubprocessWorker] created 0 shm blocks [05:13] [ComfyUI] [SubprocessWorker] sending request via socket... [05:13] [ComfyUI] [SubprocessWorker] call_id=8 sending call_method [05:13] Node executed (1 total), capturing... [05:13] [ComfyUI] [SubprocessWorker] got response: ok [05:13] [ComfyUI] [comfy-env] DownloadAndLoadDepthAnythingV3Model done (0.02s): result: NodeOutput [05:13] [ComfyUI] [comfy-env] Running DepthAnythingV3_MultiView: normalization_mode: 'Raw', resize_method: 'resize', invert_depth: False, keep_model_size: False, da3_model: dict, images: torch.float32 [1,680,1208,3] cpu [05:13] [ComfyUI] [SubprocessWorker] call_method: nodes.nodes_multiview.DepthAnythingV3_MultiView.EXECUTE_NORMALIZED [05:13] [ComfyUI] [SubprocessWorker] acquired lock, ensuring started... [05:13] [ComfyUI] [ComfyUI-DepthAnythingV3] Health check: ping (timeout=5.0s)... [05:13] [ComfyUI] [ComfyUI-DepthAnythingV3] Health check: ok [05:13] [ComfyUI] [SubprocessWorker] worker started/confirmed [05:13] [ComfyUI] [comfy-env] PRE-SERIALIZE 'images' shape: torch.Size([1, 680, 1208, 3]) [05:13] [ComfyUI] [SubprocessWorker] serializing kwargs to shm... [05:13] [ComfyUI] [SubprocessWorker] created 0 shm blocks [05:13] [ComfyUI] [SubprocessWorker] sending request via socket... [05:13] [ComfyUI] [SubprocessWorker] call_id=9 sending call_method [05:13] [ComfyUI] [worker:ComfyUI-DepthAnythingV3] [comfy-env] _from_shm got dict with keys: ['__type__', 'strategy', 'parent_pid', 'fd', 'storage_size'] [05:13] [ComfyUI] [worker:ComfyUI-DepthAnythingV3] [comfy-env] DESERIALIZE TensorRef: tensor_size=[1, 680, 1208, 3] [05:13] [ComfyUI] [worker:ComfyUI-DepthAnythingV3] [comfy-env] DESERIALIZED tensor shape: torch.Size([1, 680, 1208, 3]) [05:13] [ComfyUI] [SubprocessWorker] callback 'request_vram_budget' from call_id=9 [05:13] [ComfyUI] [comfy-env] VRAM request: 1.64GB, free before eviction: 13.50GB [05:13] [ComfyUI] [comfy-env] VRAM after eviction: 13.50GB [05:13] Frame 2 saved (frame_001.jpg, t=0.5s) [05:13] [capture-node] freeze=2ms shot=93ms unfreeze=5ms saved=True [05:16] [ComfyUI] [worker:ComfyUI-DepthAnythingV3] [05:16] [ComfyUI] === WATCHDOG TICK 3 === [05:16] [ComfyUI] [worker:ComfyUI-DepthAnythingV3] Thread 0x00007fef8423e6c0 (most recent call first): [05:16] [ComfyUI] File "/home/runner/work/comfy-gpu-ci/comfy-gpu-ci/test_workspaces/DepthAnythingV3-2120/ComfyUI/.ce/.pixi/envs/depthanythingv3-nodes/lib/python3.11/socket.py", line 294 in accept [05:16] [ComfyUI] File "/home/runner/work/comfy-gpu-ci/comfy-gpu-ci/test_workspaces/DepthAnythingV3-2120/ComfyUI/.ce/.pixi/envs/depthanythingv3-nodes/lib/python3.11/multiprocessing/connection.py", line 626 in accept [05:16] [ComfyUI] File "/home/runner/work/comfy-gpu-ci/comfy-gpu-ci/test_workspaces/DepthAnythingV3-2120/ComfyUI/.ce/.pixi/envs/depthanythingv3-nodes/lib/python3.11/multiprocessing/connection.py", line 480 in accept [05:16] [ComfyUI] File "/home/runner/work/comfy-gpu-ci/comfy-gpu-ci/test_workspaces/DepthAnythingV3-2120/ComfyUI/.ce/.pixi/envs/depthanythingv3-nodes/lib/python3.11/multiprocessing/resource_sharer.py", line 138 in _serve [05:16] [ComfyUI] File "/home/runner/work/comfy-gpu-ci/comfy-gpu-ci/test_workspaces/DepthAnythingV3-2120/ComfyUI/.ce/.pixi/envs/depthanythingv3-nodes/lib/python3.11/threading.py", line 982 in run [05:16] [ComfyUI] File "/home/runner/work/comfy-gpu-ci/comfy-gpu-ci/test_workspaces/DepthAnythingV3-2120/ComfyUI/.ce/.pixi/envs/depthanythingv3-nodes/lib/python3.11/threading.py", line 1045 in _bootstrap_inner [05:16] [ComfyUI] File "/home/runner/work/comfy-gpu-ci/comfy-gpu-ci/test_workspaces/DepthAnythingV3-2120/ComfyUI/.ce/.pixi/envs/depthanythingv3-nodes/lib/python3.11/threading.py", line 1002 in _bootstrap [05:16] [ComfyUI] [05:16] [ComfyUI] Thread 0x00007ff0117556c0 (most recent call first): [05:16] [ComfyUI] File "/home/runner/work/comfy-gpu-ci/comfy-gpu-ci/test_workspaces/DepthAnythingV3-2120/ComfyUI/.ce/.pixi/envs/depthanythingv3-nodes/lib/python3.11/threading.py", line 331 in wait [05:16] [ComfyUI] File "/home/runner/work/comfy-gpu-ci/comfy-gpu-ci/test_workspaces/DepthAnythingV3-2120/ComfyUI/.ce/.pixi/envs/depthanythingv3-nodes/lib/python3.11/threading.py", line 629 in wait [05:16] [ComfyUI] File "/home/runner/work/comfy-gpu-ci/comfy-gpu-ci/test_workspaces/DepthAnythingV3-2120/ComfyUI/.ce/.pixi/envs/depthanythingv3-nodes/lib/python3.11/site-packages/tqdm/_monitor.py", line 60 in run [05:16] [ComfyUI] File "/home/runner/work/comfy-gpu-ci/comfy-gpu-ci/test_workspaces/DepthAnythingV3-2120/ComfyUI/.ce/.pixi/envs/depthanythingv3-nodes/lib/python3.11/threading.py", line 1045 in _bootstrap_inner [05:16] [ComfyUI] File "/home/runner/work/comfy-gpu-ci/comfy-gpu-ci/test_workspaces/DepthAnythingV3-2120/ComfyUI/.ce/.pixi/envs/depthanythingv3-nodes/lib/python3.11/threading.py", line 1002 in _bootstrap [05:16] [ComfyUI] [05:16] [ComfyUI] Current thread 0x00007ff0127566c0 (most recent call first): [05:16] [ComfyUI] File "/tmp/comfyui_pvenv_iyejiq02/persistent_worker.py", line 52 in _watchdog [05:16] [ComfyUI] File "/home/runner/work/comfy-gpu-ci/comfy-gpu-ci/test_workspaces/DepthAnythingV3-2120/ComfyUI/.ce/.pixi/envs/depthanythingv3-nodes/lib/python3.11/threading.py", line 982 in run [05:16] [ComfyUI] File "/home/runner/work/comfy-gpu-ci/comfy-gpu-ci/test_workspaces/DepthAnythingV3-2120/ComfyUI/.ce/.pixi/envs/depthanythingv3-nodes/lib/python3.11/threading.py", line 1045 in _bootstrap_inner [05:16] [ComfyUI] File "/home/runner/work/comfy-gpu-ci/comfy-gpu-ci/test_workspaces/DepthAnythingV3-2120/ComfyUI/.ce/.pixi/envs/depthanythingv3-nodes/lib/python3.11/threading.py", line 1002 in _bootstrap [05:16] [ComfyUI] [05:16] [ComfyUI] Thread 0x00007ff01327e740 (most recent call first): [05:16] [ComfyUI] File "/home/runner/work/comfy-gpu-ci/comfy-gpu-ci/test_workspaces/DepthAnythingV3-2120/ComfyUI/comfy/ops.py", line 475 in forward_comfy_cast_weights [05:16] [ComfyUI] File "/home/runner/work/comfy-gpu-ci/comfy-gpu-ci/test_workspaces/DepthAnythingV3-2120/ComfyUI/comfy/ops.py", line 482 in forward [05:16] [ComfyUI] File "/home/runner/work/comfy-gpu-ci/comfy-gpu-ci/test_workspaces/DepthAnythingV3-2120/ComfyUI/.ce/.pixi/envs/depthanythingv3-nodes/lib/python3.11/site-packages/torch/nn/modules/module.py", line 1790 in _call_impl [05:16] [ComfyUI] File "/home/runner/work/comfy-gpu-ci/comfy-gpu-ci/test_workspaces/DepthAnythingV3-2120/ComfyUI/.ce/.pixi/envs/depthanythingv3-nodes/lib/python3.11/site-packages/torch/nn/modules/module.py", line 1779 in _wrapped_call_impl [05:16] [ComfyUI] File "/home/runner/work/comfy-gpu-ci/comfy-gpu-ci/test_workspaces/DepthAnythingV3-2120/ComfyUI/custom_nodes/ComfyUI-DepthAnythingV3/nodes/depth_anything_v3/model.py", line 244 in forward [05:16] [ComfyUI] File "/home/runner/work/comfy-gpu-ci/comfy-gpu-ci/test_workspaces/DepthAnythingV3-2120/ComfyUI/.ce/.pixi/envs/depthanythingv3-nodes/lib/python3.11/site-packages/torch/nn/modules/module.py", line 1790 in _call_impl [05:16] [ComfyUI] File "/home/runner/work/comfy-gpu-ci/comfy-gpu-ci/test_workspaces/DepthAnythingV3-2120/ComfyUI/.ce/.pixi/envs/depthanythingv3-nodes/lib/python3.11/site-packages/torch/nn/modules/module.py", line 1779 in _wrapped_call_impl [05:16] [ComfyUI] File "/home/runner/work/comfy-gpu-ci/comfy-gpu-ci/test_workspaces/DepthAnythingV3-2120/ComfyUI/custom_nodes/ComfyUI-DepthAnythingV3/nodes/depth_anything_v3/model.py", line 519 in ffn_residual_func [05:16] [ComfyUI] File "/home/runner/work/comfy-gpu-ci/comfy-gpu-ci/test_workspaces/DepthAnythingV3-2120/ComfyUI/custom_nodes/ComfyUI-DepthAnythingV3/nodes/depth_anything_v3/model.py", line 522 in forward [05:16] [ComfyUI] File "/home/runner/work/comfy-gpu-ci/comfy-gpu-ci/test_workspaces/DepthAnythingV3-2120/ComfyUI/.ce/.pixi/envs/depthanythingv3-nodes/lib/python3.11/site-packages/torch/nn/modules/module.py", line 1790 in _call_impl [05:16] [ComfyUI] File "/home/runner/work/comfy-gpu-ci/comfy-gpu-ci/test_workspaces/DepthAnythingV3-2120/ComfyUI/.ce/.pixi/envs/depthanythingv3-nodes/lib/python3.11/site-packages/torch/nn/modules/module.py", line 1779 in _wrapped_call_impl [05:16] [ComfyUI] File "/home/runner/work/comfy-gpu-ci/comfy-gpu-ci/test_workspaces/DepthAnythingV3-2120/ComfyUI/custom_nodes/ComfyUI-DepthAnythingV3/nodes/depth_anything_v3/model.py", line 791 in process_attention [05:16] [ComfyUI] File "/home/runner/work/comfy-gpu-ci/comfy-gpu-ci/test_workspaces/DepthAnythingV3-2120/ComfyUI/custom_nodes/ComfyUI-DepthAnythingV3/nodes/depth_anything_v3/model.py", line 750 in _get_intermediate_layers_not_chunked [05:16] [ComfyUI] File "/home/runner/work/comfy-gpu-ci/comfy-gpu-ci/test_workspaces/DepthAnythingV3-2120/ComfyUI/custom_nodes/ComfyUI-DepthAnythingV3/nodes/depth_anything_v3/model.py", line 800 in get_intermediate_layers [05:16] [ComfyUI] File "/home/runner/work/comfy-gpu-ci/comfy-gpu-ci/test_workspaces/DepthAnythingV3-2120/ComfyUI/custom_nodes/ComfyUI-DepthAnythingV3/nodes/depth_anything_v3/model.py", line 891 in forward [05:16] [ComfyUI] File "/home/runner/work/comfy-gpu-ci/comfy-gpu-ci/test_workspaces/DepthAnythingV3-2120/ComfyUI/.ce/.pixi/envs/depthanythingv3-nodes/lib/python3.11/site-packages/torch/nn/modules/module.py", line 1790 in _call_impl [05:16] [ComfyUI] File "/home/runner/work/comfy-gpu-ci/comfy-gpu-ci/test_workspaces/DepthAnythingV3-2120/ComfyUI/.ce/.pixi/envs/depthanythingv3-nodes/lib/python3.11/site-packages/torch/nn/modules/module.py", line 1779 in _wrapped_call_impl [05:16] [ComfyUI] File "/home/runner/work/comfy-gpu-ci/comfy-gpu-ci/test_workspaces/DepthAnythingV3-2120/ComfyUI/custom_nodes/ComfyUI-DepthAnythingV3/nodes/depth_anything_v3/model.py", line 1560 in forward [05:16] [ComfyUI] File "/home/runner/work/comfy-gpu-ci/comfy-gpu-ci/test_workspaces/DepthAnythingV3-2120/ComfyUI/.ce/.pixi/envs/depthanythingv3-nodes/lib/python3.11/site-packages/torch/nn/modules/module.py", line 1790 in _call_impl [05:16] [ComfyUI] File "/home/runner/work/comfy-gpu-ci/comfy-gpu-ci/test_workspaces/DepthAnythingV3-2120/ComfyUI/.ce/.pixi/envs/depthanythingv3-nodes/lib/python3.11/site-packages/torch/nn/modules/module.py", line 1779 in _wrapped_call_impl [05:16] [ComfyUI] File "/home/runner/work/comfy-gpu-ci/comfy-gpu-ci/test_workspaces/DepthAnythingV3-2120/ComfyUI/custom_nodes/ComfyUI-DepthAnythingV3/nodes/nodes_multiview.py", line 128 in execute [05:16] [ComfyUI] File "/home/runner/work/comfy-gpu-ci/comfy-gpu-ci/test_workspaces/DepthAnythingV3-2120/ComfyUI/comfy_api/latest/_io.py", line 1833 in EXECUTE_NORMALIZED [05:16] [ComfyUI] File "/tmp/comfyui_pvenv_iyejiq02/persistent_worker.py", line 1762 in main [05:16] [ComfyUI] File "/tmp/comfyui_pvenv_iyejiq02/persistent_worker.py", line 1807 in [05:16] [ComfyUI] [05:16] [ComfyUI] [worker:ComfyUI-DepthAnythingV3] === END === [05:16] [ComfyUI] [05:17] Frame 3 saved (frame_002.jpg, t=4.9s) [05:17] [capture-periodic] freeze=3ms shot=91ms unfreeze=3ms saved=True [05:18] [capture-loop] iter=50 t=5.9s state={'complete': False, 'error': None, 'executedCount': 1, 'wsState': 1} eval_ms=3 ram=4.1/15.6GB (26%) swap=0.0/3.0GB (0%) cpu=32% browser_rss=0.95GB [05:24] [capture-loop] iter=100 t=11.4s state={'complete': False, 'error': None, 'executedCount': 1, 'wsState': 1} eval_ms=3 ram=2.9/15.6GB (19%) swap=0.0/3.0GB (0%) cpu=34% browser_rss=0.95GB [05:29] [capture-loop] iter=150 t=17.0s state={'complete': False, 'error': None, 'executedCount': 1, 'wsState': 1} eval_ms=2 ram=4.2/15.6GB (27%) swap=0.0/3.0GB (0%) cpu=32% browser_rss=0.95GB [05:35] [capture-loop] iter=200 t=22.6s state={'complete': False, 'error': None, 'executedCount': 1, 'wsState': 1} eval_ms=2 ram=2.9/15.6GB (19%) swap=0.0/3.0GB (0%) cpu=32% browser_rss=0.95GB [05:40] [capture-loop] iter=250 t=28.0s state={'complete': False, 'error': None, 'executedCount': 1, 'wsState': 1} eval_ms=2 ram=4.5/15.6GB (29%) swap=0.0/3.0GB (0%) cpu=31% browser_rss=0.95GB [05:46] [capture-loop] iter=300 t=33.6s state={'complete': False, 'error': None, 'executedCount': 1, 'wsState': 1} eval_ms=2 ram=2.9/15.6GB (19%) swap=0.0/3.0GB (0%) cpu=32% browser_rss=0.95GB [05:51] [capture-loop] iter=350 t=39.0s state={'complete': False, 'error': None, 'executedCount': 1, 'wsState': 1} eval_ms=3 ram=4.6/15.6GB (30%) swap=0.0/3.0GB (0%) cpu=32% browser_rss=0.95GB [05:57] [capture-loop] iter=400 t=44.6s state={'complete': False, 'error': None, 'executedCount': 1, 'wsState': 1} eval_ms=2 ram=2.9/15.6GB (19%) swap=0.0/3.0GB (0%) cpu=32% browser_rss=0.95GB [06:02] [capture-loop] iter=450 t=50.0s state={'complete': False, 'error': None, 'executedCount': 1, 'wsState': 1} eval_ms=2 ram=4.7/15.6GB (30%) swap=0.0/3.0GB (0%) cpu=32% browser_rss=0.95GB [06:08] [capture-loop] iter=500 t=55.6s state={'complete': False, 'error': None, 'executedCount': 1, 'wsState': 1} eval_ms=2 ram=2.9/15.6GB (18%) swap=0.0/3.0GB (0%) cpu=32% browser_rss=0.95GB [06:13] [capture-loop] iter=550 t=61.0s state={'complete': False, 'error': None, 'executedCount': 1, 'wsState': 1} eval_ms=2 ram=4.8/15.6GB (31%) swap=0.0/3.0GB (0%) cpu=32% browser_rss=0.95GB [06:16] [ComfyUI] [worker:ComfyUI-DepthAnythingV3] [06:16] [ComfyUI] === WATCHDOG TICK 4 === [06:16] [ComfyUI] [worker:ComfyUI-DepthAnythingV3] Thread 0x00007fef8423e6c0 (most recent call first): [06:16] [ComfyUI] File "/home/runner/work/comfy-gpu-ci/comfy-gpu-ci/test_workspaces/DepthAnythingV3-2120/ComfyUI/.ce/.pixi/envs/depthanythingv3-nodes/lib/python3.11/socket.py", line 294 in accept [06:16] [ComfyUI] File "/home/runner/work/comfy-gpu-ci/comfy-gpu-ci/test_workspaces/DepthAnythingV3-2120/ComfyUI/.ce/.pixi/envs/depthanythingv3-nodes/lib/python3.11/multiprocessing/connection.py", line 626 in accept [06:16] [ComfyUI] File "/home/runner/work/comfy-gpu-ci/comfy-gpu-ci/test_workspaces/DepthAnythingV3-2120/ComfyUI/.ce/.pixi/envs/depthanythingv3-nodes/lib/python3.11/multiprocessing/connection.py", line 480 in accept [06:16] [ComfyUI] File "/home/runner/work/comfy-gpu-ci/comfy-gpu-ci/test_workspaces/DepthAnythingV3-2120/ComfyUI/.ce/.pixi/envs/depthanythingv3-nodes/lib/python3.11/multiprocessing/resource_sharer.py", line 138 in _serve [06:16] [ComfyUI] File "/home/runner/work/comfy-gpu-ci/comfy-gpu-ci/test_workspaces/DepthAnythingV3-2120/ComfyUI/.ce/.pixi/envs/depthanythingv3-nodes/lib/python3.11/threading.py", line 982 in run [06:16] [ComfyUI] File "/home/runner/work/comfy-gpu-ci/comfy-gpu-ci/test_workspaces/DepthAnythingV3-2120/ComfyUI/.ce/.pixi/envs/depthanythingv3-nodes/lib/python3.11/threading.py", line 1045 in _bootstrap_inner [06:16] [ComfyUI] File "/home/runner/work/comfy-gpu-ci/comfy-gpu-ci/test_workspaces/DepthAnythingV3-2120/ComfyUI/.ce/.pixi/envs/depthanythingv3-nodes/lib/python3.11/threading.py", line 1002 in _bootstrap [06:16] [ComfyUI] [06:16] [ComfyUI] Thread 0x00007ff0117556c0 (most recent call first): [06:16] [ComfyUI] File "/home/runner/work/comfy-gpu-ci/comfy-gpu-ci/test_workspaces/DepthAnythingV3-2120/ComfyUI/.ce/.pixi/envs/depthanythingv3-nodes/lib/python3.11/threading.py", line 331 in wait [06:16] [ComfyUI] File "/home/runner/work/comfy-gpu-ci/comfy-gpu-ci/test_workspaces/DepthAnythingV3-2120/ComfyUI/.ce/.pixi/envs/depthanythingv3-nodes/lib/python3.11/threading.py", line 629 in wait [06:16] [ComfyUI] File "/home/runner/work/comfy-gpu-ci/comfy-gpu-ci/test_workspaces/DepthAnythingV3-2120/ComfyUI/.ce/.pixi/envs/depthanythingv3-nodes/lib/python3.11/site-packages/tqdm/_monitor.py", line 60 in run [06:16] [ComfyUI] File "/home/runner/work/comfy-gpu-ci/comfy-gpu-ci/test_workspaces/DepthAnythingV3-2120/ComfyUI/.ce/.pixi/envs/depthanythingv3-nodes/lib/python3.11/threading.py", line 1045 in _bootstrap_inner [06:16] [ComfyUI] File "/home/runner/work/comfy-gpu-ci/comfy-gpu-ci/test_workspaces/DepthAnythingV3-2120/ComfyUI/.ce/.pixi/envs/depthanythingv3-nodes/lib/python3.11/threading.py", line 1002 in _bootstrap [06:16] [ComfyUI] [06:16] [ComfyUI] Current thread 0x00007ff0127566c0 (most recent call first): [06:16] [ComfyUI] File "/tmp/comfyui_pvenv_iyejiq02/persistent_worker.py", line 52 in _watchdog [06:16] [ComfyUI] File "/home/runner/work/comfy-gpu-ci/comfy-gpu-ci/test_workspaces/DepthAnythingV3-2120/ComfyUI/.ce/.pixi/envs/depthanythingv3-nodes/lib/python3.11/threading.py", line 982 in run [06:16] [ComfyUI] File "/home/runner/work/comfy-gpu-ci/comfy-gpu-ci/test_workspaces/DepthAnythingV3-2120/ComfyUI/.ce/.pixi/envs/depthanythingv3-nodes/lib/python3.11/threading.py", line 1045 in _bootstrap_inner [06:16] [ComfyUI] File "/home/runner/work/comfy-gpu-ci/comfy-gpu-ci/test_workspaces/DepthAnythingV3-2120/ComfyUI/.ce/.pixi/envs/depthanythingv3-nodes/lib/python3.11/threading.py", line 1002 in _bootstrap [06:16] [ComfyUI] [06:16] [ComfyUI] Thread 0x00007ff01327e740 (most recent call first): [06:16] [ComfyUI] File "/home/runner/work/comfy-gpu-ci/comfy-gpu-ci/test_workspaces/DepthAnythingV3-2120/ComfyUI/comfy/ldm/modules/sub_quadratic_attention.py", line 159 in _get_attention_scores_no_kv_chunking [06:16] [ComfyUI] File "/home/runner/work/comfy-gpu-ci/comfy-gpu-ci/test_workspaces/DepthAnythingV3-2120/ComfyUI/comfy/ldm/modules/sub_quadratic_attention.py", line 269 in [06:16] [ComfyUI] File "/home/runner/work/comfy-gpu-ci/comfy-gpu-ci/test_workspaces/DepthAnythingV3-2120/ComfyUI/comfy/ldm/modules/sub_quadratic_attention.py", line 268 in efficient_dot_product_attention [06:16] [ComfyUI] File "/home/runner/work/comfy-gpu-ci/comfy-gpu-ci/test_workspaces/DepthAnythingV3-2120/ComfyUI/comfy/ldm/modules/attention.py", line 275 in attention_sub_quad [06:16] [ComfyUI] File "/home/runner/work/comfy-gpu-ci/comfy-gpu-ci/test_workspaces/DepthAnythingV3-2120/ComfyUI/comfy/ldm/modules/attention.py", line 139 in wrapper [06:16] [ComfyUI] File "/home/runner/work/comfy-gpu-ci/comfy-gpu-ci/test_workspaces/DepthAnythingV3-2120/ComfyUI/custom_nodes/ComfyUI-DepthAnythingV3/nodes/depth_anything_v3/model.py", line 453 in forward [06:16] [ComfyUI] File "/home/runner/work/comfy-gpu-ci/comfy-gpu-ci/test_workspaces/DepthAnythingV3-2120/ComfyUI/.ce/.pixi/envs/depthanythingv3-nodes/lib/python3.11/site-packages/torch/nn/modules/module.py", line 1790 in _call_impl [06:16] [ComfyUI] File "/home/runner/work/comfy-gpu-ci/comfy-gpu-ci/test_workspaces/DepthAnythingV3-2120/ComfyUI/.ce/.pixi/envs/depthanythingv3-nodes/lib/python3.11/site-packages/torch/nn/modules/module.py", line 1779 in _wrapped_call_impl [06:16] [ComfyUI] File "/home/runner/work/comfy-gpu-ci/comfy-gpu-ci/test_workspaces/DepthAnythingV3-2120/ComfyUI/custom_nodes/ComfyUI-DepthAnythingV3/nodes/depth_anything_v3/model.py", line 516 in attn_residual_func [06:16] [ComfyUI] File "/home/runner/work/comfy-gpu-ci/comfy-gpu-ci/test_workspaces/DepthAnythingV3-2120/ComfyUI/custom_nodes/ComfyUI-DepthAnythingV3/nodes/depth_anything_v3/model.py", line 521 in forward [06:16] [ComfyUI] File "/home/runner/work/comfy-gpu-ci/comfy-gpu-ci/test_workspaces/DepthAnythingV3-2120/ComfyUI/.ce/.pixi/envs/depthanythingv3-nodes/lib/python3.11/site-packages/torch/nn/modules/module.py", line 1790 in _call_impl [06:16] [ComfyUI] File "/home/runner/work/comfy-gpu-ci/comfy-gpu-ci/test_workspaces/DepthAnythingV3-2120/ComfyUI/.ce/.pixi/envs/depthanythingv3-nodes/lib/python3.11/site-packages/torch/nn/modules/module.py", line 1779 in _wrapped_call_impl [06:16] [ComfyUI] File "/home/runner/work/comfy-gpu-ci/comfy-gpu-ci/test_workspaces/DepthAnythingV3-2120/ComfyUI/custom_nodes/ComfyUI-DepthAnythingV3/nodes/depth_anything_v3/model.py", line 791 in process_attention [06:16] [ComfyUI] File "/home/runner/work/comfy-gpu-ci/comfy-gpu-ci/test_workspaces/DepthAnythingV3-2120/ComfyUI/custom_nodes/ComfyUI-DepthAnythingV3/nodes/depth_anything_v3/model.py", line 741 in _get_intermediate_layers_not_chunked [06:16] [ComfyUI] File "/home/runner/work/comfy-gpu-ci/comfy-gpu-ci/test_workspaces/DepthAnythingV3-2120/ComfyUI/custom_nodes/ComfyUI-DepthAnythingV3/nodes/depth_anything_v3/model.py", line 800 in get_intermediate_layers [06:16] [ComfyUI] File "/home/runner/work/comfy-gpu-ci/comfy-gpu-ci/test_workspaces/DepthAnythingV3-2120/ComfyUI/custom_nodes/ComfyUI-DepthAnythingV3/nodes/depth_anything_v3/model.py", line 891 in forward [06:16] [ComfyUI] File "/home/runner/work/comfy-gpu-ci/comfy-gpu-ci/test_workspaces/DepthAnythingV3-2120/ComfyUI/.ce/.pixi/envs/depthanythingv3-nodes/lib/python3.11/site-packages/torch/nn/modules/module.py", line 1790 in _call_impl [06:16] [ComfyUI] File "/home/runner/work/comfy-gpu-ci/comfy-gpu-ci/test_workspaces/DepthAnythingV3-2120/ComfyUI/.ce/.pixi/envs/depthanythingv3-nodes/lib/python3.11/site-packages/torch/nn/modules/module.py", line 1779 in _wrapped_call_impl [06:16] [ComfyUI] File "/home/runner/work/comfy-gpu-ci/comfy-gpu-ci/test_workspaces/DepthAnythingV3-2120/ComfyUI/custom_nodes/ComfyUI-DepthAnythingV3/nodes/depth_anything_v3/model.py", line 1560 in forward [06:16] [ComfyUI] File "/home/runner/work/comfy-gpu-ci/comfy-gpu-ci/test_workspaces/DepthAnythingV3-2120/ComfyUI/.ce/.pixi/envs/depthanythingv3-nodes/lib/python3.11/site-packages/torch/nn/modules/module.py", line 1790 in _call_impl [06:16] [ComfyUI] File "/home/runner/work/comfy-gpu-ci/comfy-gpu-ci/test_workspaces/DepthAnythingV3-2120/ComfyUI/.ce/.pixi/envs/depthanythingv3-nodes/lib/python3.11/site-packages/torch/nn/modules/module.py", line 1779 in _wrapped_call_impl [06:16] [ComfyUI] File "/home/runner/work/comfy-gpu-ci/comfy-gpu-ci/test_workspaces/DepthAnythingV3-2120/ComfyUI/custom_nodes/ComfyUI-DepthAnythingV3/nodes/nodes_multiview.py", line 128 in execute [06:16] [ComfyUI] File "/home/runner/work/comfy-gpu-ci/comfy-gpu-ci/test_workspaces/DepthAnythingV3-2120/ComfyUI/comfy_api/latest/_io.py", line 1833 in EXECUTE_NORMALIZED [06:16] [ComfyUI] File "/tmp/comfyui_pvenv_iyejiq02/persistent_worker.py", line 1762 in main [06:16] [ComfyUI] File "/tmp/comfyui_pvenv_iyejiq02/persistent_worker.py", line 1807 in [06:16] [ComfyUI] [06:16] [ComfyUI] [worker:ComfyUI-DepthAnythingV3] === END === [06:16] [ComfyUI] [06:19] [capture-loop] iter=600 t=66.6s state={'complete': False, 'error': None, 'executedCount': 1, 'wsState': 1} eval_ms=3 ram=2.9/15.6GB (18%) swap=0.0/3.0GB (0%) cpu=33% browser_rss=0.95GB [06:24] [capture-loop] iter=650 t=72.0s state={'complete': False, 'error': None, 'executedCount': 1, 'wsState': 1} eval_ms=2 ram=4.9/15.6GB (32%) swap=0.0/3.0GB (0%) cpu=32% browser_rss=0.95GB [06:30] [capture-loop] iter=700 t=77.5s state={'complete': False, 'error': None, 'executedCount': 1, 'wsState': 1} eval_ms=3 ram=2.9/15.6GB (19%) swap=0.0/3.0GB (0%) cpu=32% browser_rss=0.95GB [06:35] [capture-loop] iter=750 t=83.0s state={'complete': False, 'error': None, 'executedCount': 1, 'wsState': 1} eval_ms=3 ram=4.9/15.6GB (31%) swap=0.0/3.0GB (0%) cpu=32% browser_rss=0.95GB [06:41] [capture-loop] iter=800 t=88.5s state={'complete': False, 'error': None, 'executedCount': 1, 'wsState': 1} eval_ms=2 ram=3.1/15.6GB (20%) swap=0.0/3.0GB (0%) cpu=32% browser_rss=0.95GB [06:46] [capture-loop] iter=850 t=94.0s state={'complete': False, 'error': None, 'executedCount': 1, 'wsState': 1} eval_ms=2 ram=3.3/15.6GB (21%) swap=0.0/3.0GB (0%) cpu=31% browser_rss=0.95GB [06:52] [capture-loop] iter=900 t=99.5s state={'complete': False, 'error': None, 'executedCount': 1, 'wsState': 1} eval_ms=2 ram=3.7/15.6GB (24%) swap=0.0/3.0GB (0%) cpu=32% browser_rss=0.95GB [06:57] [capture-loop] iter=950 t=105.0s state={'complete': False, 'error': None, 'executedCount': 1, 'wsState': 1} eval_ms=2 ram=4.2/15.6GB (27%) swap=0.0/3.0GB (0%) cpu=31% browser_rss=0.95GB [07:03] [capture-loop] iter=1000 t=110.5s state={'complete': False, 'error': None, 'executedCount': 1, 'wsState': 1} eval_ms=2 ram=4.0/15.6GB (25%) swap=0.0/3.0GB (0%) cpu=32% browser_rss=0.95GB [07:08] [capture-loop] iter=1050 t=116.0s state={'complete': False, 'error': None, 'executedCount': 1, 'wsState': 1} eval_ms=2 ram=4.2/15.6GB (27%) swap=0.0/3.0GB (0%) cpu=32% browser_rss=0.96GB [07:13] [ComfyUI] [SubprocessWorker] got response: ok [07:13] [ComfyUI] [comfy-env] DepthAnythingV3_MultiView done (120.47s): result: NodeOutput [07:13] [ComfyUI] [comfy-env] Running DepthAnythingV3_MultiView: normalization_mode: 'Raw', resize_method: 'resize', invert_depth: False, keep_model_size: False, da3_model: dict, images: torch.float32 [1,680,1208,3] cpu [07:13] [ComfyUI] [SubprocessWorker] call_method: nodes.nodes_multiview.DepthAnythingV3_MultiView.EXECUTE_NORMALIZED [07:13] [ComfyUI] [SubprocessWorker] acquired lock, ensuring started... [07:13] [ComfyUI] [ComfyUI-DepthAnythingV3] Health check: ping (timeout=5.0s)... [07:13] [ComfyUI] [ComfyUI-DepthAnythingV3] Health check: ok [07:13] [ComfyUI] [SubprocessWorker] worker started/confirmed [07:13] [ComfyUI] [comfy-env] PRE-SERIALIZE 'images' shape: torch.Size([1, 680, 1208, 3]) [07:13] [ComfyUI] [SubprocessWorker] serializing kwargs to shm... [07:13] [ComfyUI] [SubprocessWorker] created 0 shm blocks [07:13] [ComfyUI] [SubprocessWorker] sending request via socket... [07:13] [ComfyUI] [SubprocessWorker] call_id=10 sending call_method [07:13] [ComfyUI] [worker:ComfyUI-DepthAnythingV3] [comfy-env] _from_shm got dict with keys: ['__type__', 'strategy', 'parent_pid', 'fd', 'storage_size'] [07:13] [ComfyUI] [worker:ComfyUI-DepthAnythingV3] [comfy-env] DESERIALIZE TensorRef: tensor_size=[1, 680, 1208, 3] [07:13] [ComfyUI] [worker:ComfyUI-DepthAnythingV3] [comfy-env] DESERIALIZED tensor shape: torch.Size([1, 680, 1208, 3]) [07:13] [ComfyUI] [SubprocessWorker] callback 'request_vram_budget' from call_id=10 [07:13] [ComfyUI] [comfy-env] VRAM request: 1.64GB, free before eviction: 13.68GB [07:13] [ComfyUI] [comfy-env] VRAM after eviction: 13.68GB [07:14] [capture-loop] iter=1100 t=121.5s state={'complete': False, 'error': None, 'executedCount': 1, 'wsState': 1} eval_ms=3 ram=3.0/15.6GB (19%) swap=0.0/3.0GB (0%) cpu=32% browser_rss=0.96GB [07:16] [ComfyUI] [worker:ComfyUI-DepthAnythingV3] [07:16] [ComfyUI] === WATCHDOG TICK 5 === [07:16] [ComfyUI] [worker:ComfyUI-DepthAnythingV3] Thread 0x00007fef8423e6c0 (most recent call first): [07:16] [ComfyUI] File "/home/runner/work/comfy-gpu-ci/comfy-gpu-ci/test_workspaces/DepthAnythingV3-2120/ComfyUI/.ce/.pixi/envs/depthanythingv3-nodes/lib/python3.11/socket.py", line 294 in accept [07:16] [ComfyUI] File "/home/runner/work/comfy-gpu-ci/comfy-gpu-ci/test_workspaces/DepthAnythingV3-2120/ComfyUI/.ce/.pixi/envs/depthanythingv3-nodes/lib/python3.11/multiprocessing/connection.py", line 626 in accept [07:16] [ComfyUI] File "/home/runner/work/comfy-gpu-ci/comfy-gpu-ci/test_workspaces/DepthAnythingV3-2120/ComfyUI/.ce/.pixi/envs/depthanythingv3-nodes/lib/python3.11/multiprocessing/connection.py", line 480 in accept [07:16] [ComfyUI] File "/home/runner/work/comfy-gpu-ci/comfy-gpu-ci/test_workspaces/DepthAnythingV3-2120/ComfyUI/.ce/.pixi/envs/depthanythingv3-nodes/lib/python3.11/multiprocessing/resource_sharer.py", line 138 in _serve [07:16] [ComfyUI] File "/home/runner/work/comfy-gpu-ci/comfy-gpu-ci/test_workspaces/DepthAnythingV3-2120/ComfyUI/.ce/.pixi/envs/depthanythingv3-nodes/lib/python3.11/threading.py", line 982 in run [07:16] [ComfyUI] File "/home/runner/work/comfy-gpu-ci/comfy-gpu-ci/test_workspaces/DepthAnythingV3-2120/ComfyUI/.ce/.pixi/envs/depthanythingv3-nodes/lib/python3.11/threading.py", line 1045 in _bootstrap_inner [07:16] [ComfyUI] File "/home/runner/work/comfy-gpu-ci/comfy-gpu-ci/test_workspaces/DepthAnythingV3-2120/ComfyUI/.ce/.pixi/envs/depthanythingv3-nodes/lib/python3.11/threading.py", line 1002 in _bootstrap [07:16] [ComfyUI] [07:16] [ComfyUI] Thread 0x00007ff0117556c0 (most recent call first): [07:16] [ComfyUI] File "/home/runner/work/comfy-gpu-ci/comfy-gpu-ci/test_workspaces/DepthAnythingV3-2120/ComfyUI/.ce/.pixi/envs/depthanythingv3-nodes/lib/python3.11/threading.py", line 331 in wait [07:16] [ComfyUI] File "/home/runner/work/comfy-gpu-ci/comfy-gpu-ci/test_workspaces/DepthAnythingV3-2120/ComfyUI/.ce/.pixi/envs/depthanythingv3-nodes/lib/python3.11/threading.py", line 629 in wait [07:16] [ComfyUI] File "/home/runner/work/comfy-gpu-ci/comfy-gpu-ci/test_workspaces/DepthAnythingV3-2120/ComfyUI/.ce/.pixi/envs/depthanythingv3-nodes/lib/python3.11/site-packages/tqdm/_monitor.py", line 60 in run [07:16] [ComfyUI] File "/home/runner/work/comfy-gpu-ci/comfy-gpu-ci/test_workspaces/DepthAnythingV3-2120/ComfyUI/.ce/.pixi/envs/depthanythingv3-nodes/lib/python3.11/threading.py", line 1045 in _bootstrap_inner [07:16] [ComfyUI] File "/home/runner/work/comfy-gpu-ci/comfy-gpu-ci/test_workspaces/DepthAnythingV3-2120/ComfyUI/.ce/.pixi/envs/depthanythingv3-nodes/lib/python3.11/threading.py", line 1002 in _bootstrap [07:16] [ComfyUI] [07:16] [ComfyUI] Current thread 0x00007ff0127566c0 (most recent call first): [07:16] [ComfyUI] File "/tmp/comfyui_pvenv_iyejiq02/persistent_worker.py", line 52 in _watchdog [07:16] [ComfyUI] File "/home/runner/work/comfy-gpu-ci/comfy-gpu-ci/test_workspaces/DepthAnythingV3-2120/ComfyUI/.ce/.pixi/envs/depthanythingv3-nodes/lib/python3.11/threading.py", line 982 in run [07:16] [ComfyUI] File "/home/runner/work/comfy-gpu-ci/comfy-gpu-ci/test_workspaces/DepthAnythingV3-2120/ComfyUI/.ce/.pixi/envs/depthanythingv3-nodes/lib/python3.11/threading.py", line 1045 in _bootstrap_inner [07:16] [ComfyUI] File "/home/runner/work/comfy-gpu-ci/comfy-gpu-ci/test_workspaces/DepthAnythingV3-2120/ComfyUI/.ce/.pixi/envs/depthanythingv3-nodes/lib/python3.11/threading.py", line 1002 in _bootstrap [07:16] [ComfyUI] [07:16] [ComfyUI] Thread 0x00007ff01327e740 (most recent call first): [07:16] [ComfyUI] File "/home/runner/work/comfy-gpu-ci/comfy-gpu-ci/test_workspaces/DepthAnythingV3-2120/ComfyUI/comfy/ops.py", line 475 in forward_comfy_cast_weights [07:16] [ComfyUI] File "/home/runner/work/comfy-gpu-ci/comfy-gpu-ci/test_workspaces/DepthAnythingV3-2120/ComfyUI/comfy/ops.py", line 482 in forward [07:16] [ComfyUI] File "/home/runner/work/comfy-gpu-ci/comfy-gpu-ci/test_workspaces/DepthAnythingV3-2120/ComfyUI/.ce/.pixi/envs/depthanythingv3-nodes/lib/python3.11/site-packages/torch/nn/modules/module.py", line 1790 in _call_impl [07:16] [ComfyUI] File "/home/runner/work/comfy-gpu-ci/comfy-gpu-ci/test_workspaces/DepthAnythingV3-2120/ComfyUI/.ce/.pixi/envs/depthanythingv3-nodes/lib/python3.11/site-packages/torch/nn/modules/module.py", line 1779 in _wrapped_call_impl [07:16] [ComfyUI] File "/home/runner/work/comfy-gpu-ci/comfy-gpu-ci/test_workspaces/DepthAnythingV3-2120/ComfyUI/custom_nodes/ComfyUI-DepthAnythingV3/nodes/depth_anything_v3/model.py", line 241 in forward [07:16] [ComfyUI] File "/home/runner/work/comfy-gpu-ci/comfy-gpu-ci/test_workspaces/DepthAnythingV3-2120/ComfyUI/.ce/.pixi/envs/depthanythingv3-nodes/lib/python3.11/site-packages/torch/nn/modules/module.py", line 1790 in _call_impl [07:16] [ComfyUI] File "/home/runner/work/comfy-gpu-ci/comfy-gpu-ci/test_workspaces/DepthAnythingV3-2120/ComfyUI/.ce/.pixi/envs/depthanythingv3-nodes/lib/python3.11/site-packages/torch/nn/modules/module.py", line 1779 in _wrapped_call_impl [07:16] [ComfyUI] File "/home/runner/work/comfy-gpu-ci/comfy-gpu-ci/test_workspaces/DepthAnythingV3-2120/ComfyUI/custom_nodes/ComfyUI-DepthAnythingV3/nodes/depth_anything_v3/model.py", line 519 in ffn_residual_func [07:16] [ComfyUI] File "/home/runner/work/comfy-gpu-ci/comfy-gpu-ci/test_workspaces/DepthAnythingV3-2120/ComfyUI/custom_nodes/ComfyUI-DepthAnythingV3/nodes/depth_anything_v3/model.py", line 522 in forward [07:16] [ComfyUI] File "/home/runner/work/comfy-gpu-ci/comfy-gpu-ci/test_workspaces/DepthAnythingV3-2120/ComfyUI/.ce/.pixi/envs/depthanythingv3-nodes/lib/python3.11/site-packages/torch/nn/modules/module.py", line 1790 in _call_impl [07:16] [ComfyUI] File "/home/runner/work/comfy-gpu-ci/comfy-gpu-ci/test_workspaces/DepthAnythingV3-2120/ComfyUI/.ce/.pixi/envs/depthanythingv3-nodes/lib/python3.11/site-packages/torch/nn/modules/module.py", line 1779 in _wrapped_call_impl [07:16] [ComfyUI] File "/home/runner/work/comfy-gpu-ci/comfy-gpu-ci/test_workspaces/DepthAnythingV3-2120/ComfyUI/custom_nodes/ComfyUI-DepthAnythingV3/nodes/depth_anything_v3/model.py", line 791 in process_attention [07:16] [ComfyUI] File "/home/runner/work/comfy-gpu-ci/comfy-gpu-ci/test_workspaces/DepthAnythingV3-2120/ComfyUI/custom_nodes/ComfyUI-DepthAnythingV3/nodes/depth_anything_v3/model.py", line 750 in _get_intermediate_layers_not_chunked [07:16] [ComfyUI] File "/home/runner/work/comfy-gpu-ci/comfy-gpu-ci/test_workspaces/DepthAnythingV3-2120/ComfyUI/custom_nodes/ComfyUI-DepthAnythingV3/nodes/depth_anything_v3/model.py", line 800 in get_intermediate_layers [07:16] [ComfyUI] File "/home/runner/work/comfy-gpu-ci/comfy-gpu-ci/test_workspaces/DepthAnythingV3-2120/ComfyUI/custom_nodes/ComfyUI-DepthAnythingV3/nodes/depth_anything_v3/model.py", line 891 in forward [07:16] [ComfyUI] File "/home/runner/work/comfy-gpu-ci/comfy-gpu-ci/test_workspaces/DepthAnythingV3-2120/ComfyUI/.ce/.pixi/envs/depthanythingv3-nodes/lib/python3.11/site-packages/torch/nn/modules/module.py", line 1790 in _call_impl [07:16] [ComfyUI] File "/home/runner/work/comfy-gpu-ci/comfy-gpu-ci/test_workspaces/DepthAnythingV3-2120/ComfyUI/.ce/.pixi/envs/depthanythingv3-nodes/lib/python3.11/site-packages/torch/nn/modules/module.py", line 1779 in _wrapped_call_impl [07:16] [ComfyUI] File "/home/runner/work/comfy-gpu-ci/comfy-gpu-ci/test_workspaces/DepthAnythingV3-2120/ComfyUI/custom_nodes/ComfyUI-DepthAnythingV3/nodes/depth_anything_v3/model.py", line 1560 in forward [07:16] [ComfyUI] File "/home/runner/work/comfy-gpu-ci/comfy-gpu-ci/test_workspaces/DepthAnythingV3-2120/ComfyUI/.ce/.pixi/envs/depthanythingv3-nodes/lib/python3.11/site-packages/torch/nn/modules/module.py", line 1790 in _call_impl [07:16] [ComfyUI] File "/home/runner/work/comfy-gpu-ci/comfy-gpu-ci/test_workspaces/DepthAnythingV3-2120/ComfyUI/.ce/.pixi/envs/depthanythingv3-nodes/lib/python3.11/site-packages/torch/nn/modules/module.py", line 1779 in _wrapped_call_impl [07:16] [ComfyUI] File "/home/runner/work/comfy-gpu-ci/comfy-gpu-ci/test_workspaces/DepthAnythingV3-2120/ComfyUI/custom_nodes/ComfyUI-DepthAnythingV3/nodes/nodes_multiview.py", line 128 in execute [07:16] [ComfyUI] File "/home/runner/work/comfy-gpu-ci/comfy-gpu-ci/test_workspaces/DepthAnythingV3-2120/ComfyUI/comfy_api/latest/_io.py", line 1833 in EXECUTE_NORMALIZED [07:16] [ComfyUI] File "/tmp/comfyui_pvenv_iyejiq02/persistent_worker.py", line 1762 in main [07:16] [ComfyUI] File "/tmp/comfyui_pvenv_iyejiq02/persistent_worker.py", line 1807 in [07:16] [ComfyUI] [07:16] [ComfyUI] [worker:ComfyUI-DepthAnythingV3] === END === [07:16] [ComfyUI] [07:19] [capture-loop] iter=1150 t=127.0s state={'complete': False, 'error': None, 'executedCount': 1, 'wsState': 1} eval_ms=2 ram=3.8/15.6GB (25%) swap=0.0/3.0GB (0%) cpu=32% browser_rss=0.96GB [07:25] [capture-loop] iter=1200 t=132.5s state={'complete': False, 'error': None, 'executedCount': 1, 'wsState': 1} eval_ms=2 ram=3.2/15.6GB (20%) swap=0.0/3.0GB (0%) cpu=33% browser_rss=0.95GB [07:30] [capture-loop] iter=1250 t=138.0s state={'complete': False, 'error': None, 'executedCount': 1, 'wsState': 1} eval_ms=2 ram=3.9/15.6GB (25%) swap=0.0/3.0GB (0%) cpu=32% browser_rss=0.95GB [07:36] [capture-loop] iter=1300 t=143.5s state={'complete': False, 'error': None, 'executedCount': 1, 'wsState': 1} eval_ms=2 ram=3.2/15.6GB (21%) swap=0.0/3.0GB (0%) cpu=32% browser_rss=0.95GB [07:41] [capture-loop] iter=1350 t=149.0s state={'complete': False, 'error': None, 'executedCount': 1, 'wsState': 1} eval_ms=2 ram=2.9/15.6GB (18%) swap=0.0/3.0GB (0%) cpu=32% browser_rss=0.95GB [07:47] [capture-loop] iter=1400 t=154.5s state={'complete': False, 'error': None, 'executedCount': 1, 'wsState': 1} eval_ms=2 ram=3.2/15.6GB (21%) swap=0.0/3.0GB (0%) cpu=32% browser_rss=0.95GB [07:52] [capture-loop] iter=1450 t=160.1s state={'complete': False, 'error': None, 'executedCount': 1, 'wsState': 1} eval_ms=2 ram=2.9/15.6GB (18%) swap=0.0/3.0GB (0%) cpu=32% browser_rss=0.95GB [07:58] [capture-loop] iter=1500 t=165.6s state={'complete': False, 'error': None, 'executedCount': 1, 'wsState': 1} eval_ms=3 ram=3.3/15.6GB (21%) swap=0.0/3.0GB (0%) cpu=32% browser_rss=0.95GB [08:03] [capture-loop] iter=1550 t=171.1s state={'complete': False, 'error': None, 'executedCount': 1, 'wsState': 1} eval_ms=2 ram=2.9/15.6GB (18%) swap=0.0/3.0GB (0%) cpu=32% browser_rss=0.95GB [08:09] [capture-loop] iter=1600 t=176.6s state={'complete': False, 'error': None, 'executedCount': 1, 'wsState': 1} eval_ms=2 ram=3.3/15.6GB (21%) swap=0.0/3.0GB (0%) cpu=31% browser_rss=0.95GB [08:14] [capture-loop] iter=1650 t=182.1s state={'complete': False, 'error': None, 'executedCount': 1, 'wsState': 1} eval_ms=2 ram=2.9/15.6GB (19%) swap=0.0/3.0GB (0%) cpu=32% browser_rss=0.95GB [08:16] [ComfyUI] [worker:ComfyUI-DepthAnythingV3] [08:16] [ComfyUI] === WATCHDOG TICK 6 === [08:16] [ComfyUI] [worker:ComfyUI-DepthAnythingV3] Thread 0x00007fef8423e6c0 (most recent call first): [08:16] [ComfyUI] File "/home/runner/work/comfy-gpu-ci/comfy-gpu-ci/test_workspaces/DepthAnythingV3-2120/ComfyUI/.ce/.pixi/envs/depthanythingv3-nodes/lib/python3.11/socket.py", line 294 in accept [08:16] [ComfyUI] File "/home/runner/work/comfy-gpu-ci/comfy-gpu-ci/test_workspaces/DepthAnythingV3-2120/ComfyUI/.ce/.pixi/envs/depthanythingv3-nodes/lib/python3.11/multiprocessing/connection.py", line 626 in accept [08:16] [ComfyUI] File "/home/runner/work/comfy-gpu-ci/comfy-gpu-ci/test_workspaces/DepthAnythingV3-2120/ComfyUI/.ce/.pixi/envs/depthanythingv3-nodes/lib/python3.11/multiprocessing/connection.py", line 480 in accept [08:16] [ComfyUI] File "/home/runner/work/comfy-gpu-ci/comfy-gpu-ci/test_workspaces/DepthAnythingV3-2120/ComfyUI/.ce/.pixi/envs/depthanythingv3-nodes/lib/python3.11/multiprocessing/resource_sharer.py", line 138 in _serve [08:16] [ComfyUI] File "/home/runner/work/comfy-gpu-ci/comfy-gpu-ci/test_workspaces/DepthAnythingV3-2120/ComfyUI/.ce/.pixi/envs/depthanythingv3-nodes/lib/python3.11/threading.py", line 982 in run [08:16] [ComfyUI] File "/home/runner/work/comfy-gpu-ci/comfy-gpu-ci/test_workspaces/DepthAnythingV3-2120/ComfyUI/.ce/.pixi/envs/depthanythingv3-nodes/lib/python3.11/threading.py", line 1045 in _bootstrap_inner [08:16] [ComfyUI] File "/home/runner/work/comfy-gpu-ci/comfy-gpu-ci/test_workspaces/DepthAnythingV3-2120/ComfyUI/.ce/.pixi/envs/depthanythingv3-nodes/lib/python3.11/threading.py", line 1002 in _bootstrap [08:16] [ComfyUI] [08:16] [ComfyUI] Thread 0x00007ff0117556c0 (most recent call first): [08:16] [ComfyUI] File "/home/runner/work/comfy-gpu-ci/comfy-gpu-ci/test_workspaces/DepthAnythingV3-2120/ComfyUI/.ce/.pixi/envs/depthanythingv3-nodes/lib/python3.11/threading.py", line 331 in wait [08:16] [ComfyUI] File "/home/runner/work/comfy-gpu-ci/comfy-gpu-ci/test_workspaces/DepthAnythingV3-2120/ComfyUI/.ce/.pixi/envs/depthanythingv3-nodes/lib/python3.11/threading.py", line 629 in wait [08:16] [ComfyUI] File "/home/runner/work/comfy-gpu-ci/comfy-gpu-ci/test_workspaces/DepthAnythingV3-2120/ComfyUI/.ce/.pixi/envs/depthanythingv3-nodes/lib/python3.11/site-packages/tqdm/_monitor.py", line 60 in run [08:16] [ComfyUI] File "/home/runner/work/comfy-gpu-ci/comfy-gpu-ci/test_workspaces/DepthAnythingV3-2120/ComfyUI/.ce/.pixi/envs/depthanythingv3-nodes/lib/python3.11/threading.py", line 1045 in _bootstrap_inner [08:16] [ComfyUI] File "/home/runner/work/comfy-gpu-ci/comfy-gpu-ci/test_workspaces/DepthAnythingV3-2120/ComfyUI/.ce/.pixi/envs/depthanythingv3-nodes/lib/python3.11/threading.py", line 1002 in _bootstrap [08:16] [ComfyUI] [08:16] [ComfyUI] Current thread 0x00007ff0127566c0 (most recent call first): [08:16] [ComfyUI] File "/tmp/comfyui_pvenv_iyejiq02/persistent_worker.py", line 52 in _watchdog [08:16] [ComfyUI] File "/home/runner/work/comfy-gpu-ci/comfy-gpu-ci/test_workspaces/DepthAnythingV3-2120/ComfyUI/.ce/.pixi/envs/depthanythingv3-nodes/lib/python3.11/threading.py", line 982 in run [08:16] [ComfyUI] File "/home/runner/work/comfy-gpu-ci/comfy-gpu-ci/test_workspaces/DepthAnythingV3-2120/ComfyUI/.ce/.pixi/envs/depthanythingv3-nodes/lib/python3.11/threading.py", line 1045 in _bootstrap_inner [08:16] [ComfyUI] File "/home/runner/work/comfy-gpu-ci/comfy-gpu-ci/test_workspaces/DepthAnythingV3-2120/ComfyUI/.ce/.pixi/envs/depthanythingv3-nodes/lib/python3.11/threading.py", line 1002 in _bootstrap [08:16] [ComfyUI] [08:16] [ComfyUI] Thread 0x00007ff01327e740 (most recent call first): [08:16] [ComfyUI] File "/home/runner/work/comfy-gpu-ci/comfy-gpu-ci/test_workspaces/DepthAnythingV3-2120/ComfyUI/comfy/ldm/modules/sub_quadratic_attention.py", line 159 in _get_attention_scores_no_kv_chunking [08:16] [ComfyUI] File "/home/runner/work/comfy-gpu-ci/comfy-gpu-ci/test_workspaces/DepthAnythingV3-2120/ComfyUI/comfy/ldm/modules/sub_quadratic_attention.py", line 269 in [08:16] [ComfyUI] File "/home/runner/work/comfy-gpu-ci/comfy-gpu-ci/test_workspaces/DepthAnythingV3-2120/ComfyUI/comfy/ldm/modules/sub_quadratic_attention.py", line 268 in efficient_dot_product_attention [08:16] [ComfyUI] File "/home/runner/work/comfy-gpu-ci/comfy-gpu-ci/test_workspaces/DepthAnythingV3-2120/ComfyUI/comfy/ldm/modules/attention.py", line 275 in attention_sub_quad [08:16] [ComfyUI] File "/home/runner/work/comfy-gpu-ci/comfy-gpu-ci/test_workspaces/DepthAnythingV3-2120/ComfyUI/comfy/ldm/modules/attention.py", line 139 in wrapper [08:16] [ComfyUI] File "/home/runner/work/comfy-gpu-ci/comfy-gpu-ci/test_workspaces/DepthAnythingV3-2120/ComfyUI/custom_nodes/ComfyUI-DepthAnythingV3/nodes/depth_anything_v3/model.py", line 453 in forward [08:16] [ComfyUI] File "/home/runner/work/comfy-gpu-ci/comfy-gpu-ci/test_workspaces/DepthAnythingV3-2120/ComfyUI/.ce/.pixi/envs/depthanythingv3-nodes/lib/python3.11/site-packages/torch/nn/modules/module.py", line 1790 in _call_impl [08:16] [ComfyUI] File "/home/runner/work/comfy-gpu-ci/comfy-gpu-ci/test_workspaces/DepthAnythingV3-2120/ComfyUI/.ce/.pixi/envs/depthanythingv3-nodes/lib/python3.11/site-packages/torch/nn/modules/module.py", line 1779 in _wrapped_call_impl [08:16] [ComfyUI] File "/home/runner/work/comfy-gpu-ci/comfy-gpu-ci/test_workspaces/DepthAnythingV3-2120/ComfyUI/custom_nodes/ComfyUI-DepthAnythingV3/nodes/depth_anything_v3/model.py", line 516 in attn_residual_func [08:16] [ComfyUI] File "/home/runner/work/comfy-gpu-ci/comfy-gpu-ci/test_workspaces/DepthAnythingV3-2120/ComfyUI/custom_nodes/ComfyUI-DepthAnythingV3/nodes/depth_anything_v3/model.py", line 521 in forward [08:16] [ComfyUI] File "/home/runner/work/comfy-gpu-ci/comfy-gpu-ci/test_workspaces/DepthAnythingV3-2120/ComfyUI/.ce/.pixi/envs/depthanythingv3-nodes/lib/python3.11/site-packages/torch/nn/modules/module.py", line 1790 in _call_impl [08:16] [ComfyUI] File "/home/runner/work/comfy-gpu-ci/comfy-gpu-ci/test_workspaces/DepthAnythingV3-2120/ComfyUI/.ce/.pixi/envs/depthanythingv3-nodes/lib/python3.11/site-packages/torch/nn/modules/module.py", line 1779 in _wrapped_call_impl [08:16] [ComfyUI] File "/home/runner/work/comfy-gpu-ci/comfy-gpu-ci/test_workspaces/DepthAnythingV3-2120/ComfyUI/custom_nodes/ComfyUI-DepthAnythingV3/nodes/depth_anything_v3/model.py", line 791 in process_attention [08:16] [ComfyUI] File "/home/runner/work/comfy-gpu-ci/comfy-gpu-ci/test_workspaces/DepthAnythingV3-2120/ComfyUI/custom_nodes/ComfyUI-DepthAnythingV3/nodes/depth_anything_v3/model.py", line 741 in _get_intermediate_layers_not_chunked [08:16] [ComfyUI] File "/home/runner/work/comfy-gpu-ci/comfy-gpu-ci/test_workspaces/DepthAnythingV3-2120/ComfyUI/custom_nodes/ComfyUI-DepthAnythingV3/nodes/depth_anything_v3/model.py", line 800 in get_intermediate_layers [08:16] [ComfyUI] File "/home/runner/work/comfy-gpu-ci/comfy-gpu-ci/test_workspaces/DepthAnythingV3-2120/ComfyUI/custom_nodes/ComfyUI-DepthAnythingV3/nodes/depth_anything_v3/model.py", line 891 in forward [08:16] [ComfyUI] File "/home/runner/work/comfy-gpu-ci/comfy-gpu-ci/test_workspaces/DepthAnythingV3-2120/ComfyUI/.ce/.pixi/envs/depthanythingv3-nodes/lib/python3.11/site-packages/torch/nn/modules/module.py", line 1790 in _call_impl [08:16] [ComfyUI] File "/home/runner/work/comfy-gpu-ci/comfy-gpu-ci/test_workspaces/DepthAnythingV3-2120/ComfyUI/.ce/.pixi/envs/depthanythingv3-nodes/lib/python3.11/site-packages/torch/nn/modules/module.py", line 1779 in _wrapped_call_impl [08:16] [ComfyUI] File "/home/runner/work/comfy-gpu-ci/comfy-gpu-ci/test_workspaces/DepthAnythingV3-2120/ComfyUI/custom_nodes/ComfyUI-DepthAnythingV3/nodes/depth_anything_v3/model.py", line 1560 in forward [08:16] [ComfyUI] File "/home/runner/work/comfy-gpu-ci/comfy-gpu-ci/test_workspaces/DepthAnythingV3-2120/ComfyUI/.ce/.pixi/envs/depthanythingv3-nodes/lib/python3.11/site-packages/torch/nn/modules/module.py", line 1790 in _call_impl [08:16] [ComfyUI] File "/home/runner/work/comfy-gpu-ci/comfy-gpu-ci/test_workspaces/DepthAnythingV3-2120/ComfyUI/.ce/.pixi/envs/depthanythingv3-nodes/lib/python3.11/site-packages/torch/nn/modules/module.py", line 1779 in _wrapped_call_impl [08:16] [ComfyUI] File "/home/runner/work/comfy-gpu-ci/comfy-gpu-ci/test_workspaces/DepthAnythingV3-2120/ComfyUI/custom_nodes/ComfyUI-DepthAnythingV3/nodes/nodes_multiview.py", line 128 in execute [08:16] [ComfyUI] File "/home/runner/work/comfy-gpu-ci/comfy-gpu-ci/test_workspaces/DepthAnythingV3-2120/ComfyUI/comfy_api/latest/_io.py", line 1833 in EXECUTE_NORMALIZED [08:16] [ComfyUI] File "/tmp/comfyui_pvenv_iyejiq02/persistent_worker.py", line 1762 in main [08:16] [ComfyUI] File "/tmp/comfyui_pvenv_iyejiq02/persistent_worker.py", line 1807 in [08:16] [ComfyUI] [08:16] [ComfyUI] [worker:ComfyUI-DepthAnythingV3] === END === [08:16] [ComfyUI] [08:20] [capture-loop] iter=1700 t=187.5s state={'complete': False, 'error': None, 'executedCount': 1, 'wsState': 1} eval_ms=2 ram=3.4/15.6GB (22%) swap=0.0/3.0GB (0%) cpu=31% browser_rss=0.96GB [08:25] [capture-loop] iter=1750 t=193.1s state={'complete': False, 'error': None, 'executedCount': 1, 'wsState': 1} eval_ms=2 ram=2.9/15.6GB (19%) swap=0.0/3.0GB (0%) cpu=33% browser_rss=0.96GB [08:31] [capture-loop] iter=1800 t=198.5s state={'complete': False, 'error': None, 'executedCount': 1, 'wsState': 1} eval_ms=2 ram=3.6/15.6GB (23%) swap=0.0/3.0GB (0%) cpu=32% browser_rss=0.95GB [08:36] [capture-loop] iter=1850 t=204.1s state={'complete': False, 'error': None, 'executedCount': 1, 'wsState': 1} eval_ms=3 ram=3.2/15.6GB (21%) swap=0.0/3.0GB (0%) cpu=33% browser_rss=0.96GB [08:42] [capture-loop] iter=1900 t=209.6s state={'complete': False, 'error': None, 'executedCount': 1, 'wsState': 1} eval_ms=3 ram=3.4/15.6GB (22%) swap=0.0/3.0GB (0%) cpu=32% browser_rss=0.95GB [08:47] [capture-loop] iter=1950 t=215.1s state={'complete': False, 'error': None, 'executedCount': 1, 'wsState': 1} eval_ms=2 ram=3.7/15.6GB (23%) swap=0.0/3.0GB (0%) cpu=32% browser_rss=0.96GB [08:53] [capture-loop] iter=2000 t=220.6s state={'complete': False, 'error': None, 'executedCount': 1, 'wsState': 1} eval_ms=2 ram=3.9/15.6GB (25%) swap=0.0/3.0GB (0%) cpu=32% browser_rss=0.95GB [08:58] [capture-loop] iter=2050 t=226.1s state={'complete': False, 'error': None, 'executedCount': 1, 'wsState': 1} eval_ms=2 ram=4.0/15.6GB (26%) swap=0.0/3.0GB (0%) cpu=32% browser_rss=0.96GB [09:04] [capture-loop] iter=2100 t=231.6s state={'complete': False, 'error': None, 'executedCount': 1, 'wsState': 1} eval_ms=2 ram=4.3/15.6GB (28%) swap=0.0/3.0GB (0%) cpu=33% browser_rss=0.96GB [09:09] [capture-loop] iter=2150 t=237.1s state={'complete': False, 'error': None, 'executedCount': 1, 'wsState': 1} eval_ms=2 ram=4.6/15.6GB (29%) swap=0.0/3.0GB (0%) cpu=32% browser_rss=0.95GB [09:14] [ComfyUI] [SubprocessWorker] got response: ok [09:14] [ComfyUI] [comfy-env] DepthAnythingV3_MultiView done (120.52s): result: NodeOutput [09:14] [ComfyUI] [comfy-env] Running DA3_MultiViewPointCloud: extrinsics: '{\n "extrinsics": [\n {\n "image_0": [\n ..., intrinsics: '{\n "intrinsics": [\n {\n "image_0": [\n ..., confidence_threshold: 0.3, downsample: 4, use_icp: False, allow_around_1: False, filter_outliers: True, outlier_percentage: 5.0, depths: torch.float32 [1,680,1208,3] cpu, images: torch.float32 [1,680,1208,3] cpu, confidence: torch.float32 [1,680,1208,3] cpu, sky_mask: torch.float32 [1,680,1208] cpu [09:14] [ComfyUI] [SubprocessWorker] call_method: nodes.nodes_multiview.DA3_MultiViewPointCloud.EXECUTE_NORMALIZED [09:14] [ComfyUI] [SubprocessWorker] acquired lock, ensuring started... [09:14] [ComfyUI] [ComfyUI-DepthAnythingV3] Health check: ping (timeout=5.0s)... [09:14] [ComfyUI] [ComfyUI-DepthAnythingV3] Health check: ok [09:14] [ComfyUI] [SubprocessWorker] worker started/confirmed [09:14] [ComfyUI] [comfy-env] PRE-SERIALIZE 'depths' shape: torch.Size([1, 680, 1208, 3]) [09:14] [ComfyUI] [comfy-env] PRE-SERIALIZE 'images' shape: torch.Size([1, 680, 1208, 3]) [09:14] [ComfyUI] [comfy-env] PRE-SERIALIZE 'confidence' shape: torch.Size([1, 680, 1208, 3]) [09:14] [ComfyUI] [comfy-env] PRE-SERIALIZE 'sky_mask' shape: torch.Size([1, 680, 1208]) [09:14] [ComfyUI] [SubprocessWorker] serializing kwargs to shm... [09:14] [ComfyUI] [SubprocessWorker] created 0 shm blocks [09:14] [ComfyUI] [SubprocessWorker] sending request via socket... [09:14] [ComfyUI] [SubprocessWorker] call_id=11 sending call_method [09:14] [ComfyUI] [worker:ComfyUI-DepthAnythingV3] [comfy-env] _from_shm got dict with keys: ['__type__', 'strategy', 'parent_pid', 'fd', 'storage_size'] [09:14] [ComfyUI] [worker:ComfyUI-DepthAnythingV3] [comfy-env] DESERIALIZE TensorRef: tensor_size=[1, 680, 1208, 3] [09:14] [ComfyUI] [worker:ComfyUI-DepthAnythingV3] [comfy-env] DESERIALIZED tensor shape: torch.Size([1, 680, 1208, 3]) [09:14] [ComfyUI] [worker:ComfyUI-DepthAnythingV3] [comfy-env] _from_shm got dict with keys: ['__type__', 'strategy', 'parent_pid', 'fd', 'storage_size'] [09:14] [ComfyUI] [worker:ComfyUI-DepthAnythingV3] [comfy-env] DESERIALIZE TensorRef: tensor_size=[1, 680, 1208, 3] [09:14] [ComfyUI] [worker:ComfyUI-DepthAnythingV3] [comfy-env] DESERIALIZED tensor shape: torch.Size([1, 680, 1208, 3]) [09:14] [ComfyUI] [worker:ComfyUI-DepthAnythingV3] [comfy-env] _from_shm got dict with keys: ['__type__', 'strategy', 'parent_pid', 'fd', 'storage_size'] [09:14] [ComfyUI] [worker:ComfyUI-DepthAnythingV3] [comfy-env] DESERIALIZE TensorRef: tensor_size=[1, 680, 1208, 3] [09:14] [ComfyUI] [worker:ComfyUI-DepthAnythingV3] [comfy-env] DESERIALIZED tensor shape: torch.Size([1, 680, 1208, 3]) [09:14] [ComfyUI] [worker:ComfyUI-DepthAnythingV3] [comfy-env] _from_shm got dict with keys: ['__type__', 'strategy', 'parent_pid', 'fd', 'storage_size'] [09:14] [ComfyUI] [worker:ComfyUI-DepthAnythingV3] [comfy-env] DESERIALIZE TensorRef: tensor_size=[1, 680, 1208] [09:14] [ComfyUI] [worker:ComfyUI-DepthAnythingV3] [comfy-env] DESERIALIZED tensor shape: torch.Size([1, 680, 1208]) [09:14] [ComfyUI] [SubprocessWorker] callback 'report_progress' from call_id=11 [09:14] [ComfyUI] [SubprocessWorker] got response: ok [09:14] [ComfyUI] [comfy-env] DA3_MultiViewPointCloud done (0.06s): result: NodeOutput [09:14] [ComfyUI] [comfy-env] Running DA3_MultiViewPointCloud: extrinsics: '{\n "extrinsics": [\n {\n "image_0": [\n ..., intrinsics: '{\n "intrinsics": [\n {\n "image_0": [\n ..., confidence_threshold: 0.3, downsample: 4, use_icp: False, allow_around_1: False, filter_outliers: True, outlier_percentage: 5.0, depths: torch.float32 [1,680,1208,3] cpu, images: torch.float32 [1,680,1208,3] cpu, confidence: torch.float32 [1,680,1208,3] cpu, sky_mask: torch.float32 [1,680,1208] cpu [09:14] [ComfyUI] [SubprocessWorker] call_method: nodes.nodes_multiview.DA3_MultiViewPointCloud.EXECUTE_NORMALIZED [09:14] [ComfyUI] [SubprocessWorker] acquired lock, ensuring started... [09:14] [ComfyUI] [ComfyUI-DepthAnythingV3] Health check: ping (timeout=5.0s)... [09:14] [ComfyUI] [ComfyUI-DepthAnythingV3] Health check: ok [09:14] [ComfyUI] [SubprocessWorker] worker started/confirmed [09:14] [ComfyUI] [comfy-env] PRE-SERIALIZE 'depths' shape: torch.Size([1, 680, 1208, 3]) [09:14] [ComfyUI] [comfy-env] PRE-SERIALIZE 'images' shape: torch.Size([1, 680, 1208, 3]) [09:14] [ComfyUI] [comfy-env] PRE-SERIALIZE 'confidence' shape: torch.Size([1, 680, 1208, 3]) [09:14] [ComfyUI] [comfy-env] PRE-SERIALIZE 'sky_mask' shape: torch.Size([1, 680, 1208]) [09:14] [ComfyUI] [SubprocessWorker] serializing kwargs to shm... [09:14] [ComfyUI] [SubprocessWorker] created 0 shm blocks [09:14] [ComfyUI] [SubprocessWorker] sending request via socket... [09:14] [ComfyUI] [SubprocessWorker] call_id=12 sending call_method [09:14] [ComfyUI] [worker:ComfyUI-DepthAnythingV3] [comfy-env] _from_shm got dict with keys: ['__type__', 'strategy', 'parent_pid', 'fd', 'storage_size'] [09:14] [ComfyUI] [worker:ComfyUI-DepthAnythingV3] [comfy-env] DESERIALIZE TensorRef: tensor_size=[1, 680, 1208, 3] [09:14] [ComfyUI] [worker:ComfyUI-DepthAnythingV3] [comfy-env] DESERIALIZED tensor shape: torch.Size([1, 680, 1208, 3]) [09:14] [ComfyUI] [worker:ComfyUI-DepthAnythingV3] [comfy-env] _from_shm got dict with keys: ['__type__', 'strategy', 'parent_pid', 'fd', 'storage_size'] [09:14] [ComfyUI] [worker:ComfyUI-DepthAnythingV3] [comfy-env] DESERIALIZE TensorRef: tensor_size=[1, 680, 1208, 3] [09:14] [ComfyUI] [worker:ComfyUI-DepthAnythingV3] [comfy-env] DESERIALIZED tensor shape: torch.Size([1, 680, 1208, 3]) [09:14] [ComfyUI] [worker:ComfyUI-DepthAnythingV3] [comfy-env] _from_shm got dict with keys: ['__type__', 'strategy', 'parent_pid', 'fd', 'storage_size'] [09:14] [ComfyUI] [worker:ComfyUI-DepthAnythingV3] [comfy-env] DESERIALIZE TensorRef: tensor_size=[1, 680, 1208, 3] [09:14] [ComfyUI] [worker:ComfyUI-DepthAnythingV3] [comfy-env] DESERIALIZED tensor shape: torch.Size([1, 680, 1208, 3]) [09:14] [ComfyUI] [worker:ComfyUI-DepthAnythingV3] [comfy-env] _from_shm got dict with keys: ['__type__', 'strategy', 'parent_pid', 'fd', 'storage_size'] [09:14] [ComfyUI] [worker:ComfyUI-DepthAnythingV3] [comfy-env] DESERIALIZE TensorRef: tensor_size=[1, 680, 1208] [09:14] [ComfyUI] [worker:ComfyUI-DepthAnythingV3] [comfy-env] DESERIALIZED tensor shape: torch.Size([1, 680, 1208]) [09:14] [ComfyUI] [SubprocessWorker] callback 'report_progress' from call_id=12 [09:14] [ComfyUI] [SubprocessWorker] got response: ok [09:14] [ComfyUI] [comfy-env] DA3_MultiViewPointCloud done (0.06s): result: NodeOutput [09:14] [ComfyUI] [comfy-env] Running DA3_SavePointCloud: filename_prefix: 'pointcloud', pointcloud: list[1] [09:14] [ComfyUI] [SubprocessWorker] call_method: nodes.nodes_3d.DA3_SavePointCloud.EXECUTE_NORMALIZED [09:14] [ComfyUI] [SubprocessWorker] acquired lock, ensuring started... [09:14] [ComfyUI] [ComfyUI-DepthAnythingV3] Health check: ping (timeout=5.0s)... [09:14] [ComfyUI] [ComfyUI-DepthAnythingV3] Health check: ok [09:14] [ComfyUI] [SubprocessWorker] worker started/confirmed [09:14] [ComfyUI] [SubprocessWorker] serializing kwargs to shm... [09:14] [ComfyUI] [SubprocessWorker] created 0 shm blocks [09:14] [ComfyUI] [SubprocessWorker] sending request via socket... [09:14] [ComfyUI] [SubprocessWorker] call_id=13 sending call_method [09:14] [ComfyUI] [worker:ComfyUI-DepthAnythingV3] [comfy-env] _from_shm got dict with keys: ['__type__', 'strategy', 'parent_pid', 'fd', 'storage_size'] [09:14] [ComfyUI] [worker:ComfyUI-DepthAnythingV3] [comfy-env] DESERIALIZE TensorRef: tensor_size=[20434, 3] [09:14] [ComfyUI] [worker:ComfyUI-DepthAnythingV3] [comfy-env] DESERIALIZED tensor shape: torch.Size([20434, 3]) [09:14] [ComfyUI] [worker:ComfyUI-DepthAnythingV3] [comfy-env] _from_shm got dict with keys: ['__type__', 'strategy', 'parent_pid', 'fd', 'storage_size'] [09:14] [ComfyUI] [worker:ComfyUI-DepthAnythingV3] [comfy-env] DESERIALIZE TensorRef: tensor_size=[20434, 3] [09:14] [ComfyUI] [worker:ComfyUI-DepthAnythingV3] [comfy-env] DESERIALIZED tensor shape: torch.Size([20434, 3]) [09:14] [ComfyUI] [worker:ComfyUI-DepthAnythingV3] [comfy-env] _from_shm got dict with keys: ['__type__', 'strategy', 'parent_pid', 'fd', 'storage_size'] [09:14] [ComfyUI] [worker:ComfyUI-DepthAnythingV3] [comfy-env] DESERIALIZE TensorRef: tensor_size=[20434] [09:14] [ComfyUI] [worker:ComfyUI-DepthAnythingV3] [comfy-env] DESERIALIZED tensor shape: torch.Size([20434]) [09:14] [ComfyUI] [worker:ComfyUI-DepthAnythingV3] [comfy-env] _from_shm got dict with keys: ['__type__', 'strategy', 'parent_pid', 'fd', 'storage_size'] [09:14] [ComfyUI] [worker:ComfyUI-DepthAnythingV3] [comfy-env] DESERIALIZE TensorRef: tensor_size=[20434] [09:14] [ComfyUI] [worker:ComfyUI-DepthAnythingV3] [comfy-env] DESERIALIZED tensor shape: torch.Size([20434]) [09:14] [ComfyUI] [SubprocessWorker] got response: ok [09:14] [ComfyUI] [comfy-env] DA3_SavePointCloud done (0.17s): result: NodeOutput [09:14] [ComfyUI] [comfy-env] Running DA3_SavePointCloud: filename_prefix: 'pointcloud', pointcloud: list[1] [09:14] [ComfyUI] [SubprocessWorker] call_method: nodes.nodes_3d.DA3_SavePointCloud.EXECUTE_NORMALIZED [09:14] [ComfyUI] [SubprocessWorker] acquired lock, ensuring started... [09:14] [ComfyUI] [ComfyUI-DepthAnythingV3] Health check: ping (timeout=5.0s)... [09:14] [ComfyUI] [ComfyUI-DepthAnythingV3] Health check: ok [09:14] [ComfyUI] [SubprocessWorker] worker started/confirmed [09:14] [ComfyUI] [SubprocessWorker] serializing kwargs to shm... [09:14] [ComfyUI] [SubprocessWorker] created 0 shm blocks [09:14] [ComfyUI] [SubprocessWorker] sending request via socket... [09:14] [ComfyUI] [SubprocessWorker] call_id=14 sending call_method [09:14] [ComfyUI] [worker:ComfyUI-DepthAnythingV3] [comfy-env] _from_shm got dict with keys: ['__type__', 'strategy', 'parent_pid', 'fd', 'storage_size'] [09:14] [ComfyUI] [worker:ComfyUI-DepthAnythingV3] [comfy-env] DESERIALIZE TensorRef: tensor_size=[18844, 3] [09:14] [ComfyUI] [worker:ComfyUI-DepthAnythingV3] [comfy-env] DESERIALIZED tensor shape: torch.Size([18844, 3]) [09:14] [ComfyUI] [worker:ComfyUI-DepthAnythingV3] [comfy-env] _from_shm got dict with keys: ['__type__', 'strategy', 'parent_pid', 'fd', 'storage_size'] [09:14] [ComfyUI] [worker:ComfyUI-DepthAnythingV3] [comfy-env] DESERIALIZE TensorRef: tensor_size=[18844, 3] [09:14] [ComfyUI] [worker:ComfyUI-DepthAnythingV3] [comfy-env] DESERIALIZED tensor shape: torch.Size([18844, 3]) [09:14] [ComfyUI] [worker:ComfyUI-DepthAnythingV3] [comfy-env] _from_shm got dict with keys: ['__type__', 'strategy', 'parent_pid', 'fd', 'storage_size'] [09:14] [ComfyUI] [worker:ComfyUI-DepthAnythingV3] [comfy-env] DESERIALIZE TensorRef: tensor_size=[18844] [09:14] [ComfyUI] [worker:ComfyUI-DepthAnythingV3] [comfy-env] DESERIALIZED tensor shape: torch.Size([18844]) [09:14] [ComfyUI] [worker:ComfyUI-DepthAnythingV3] [comfy-env] _from_shm got dict with keys: ['__type__', 'strategy', 'parent_pid', 'fd', 'storage_size'] [09:14] [ComfyUI] [worker:ComfyUI-DepthAnythingV3] [comfy-env] DESERIALIZE TensorRef: tensor_size=[18844] [09:14] [ComfyUI] [worker:ComfyUI-DepthAnythingV3] [comfy-env] DESERIALIZED tensor shape: torch.Size([18844]) [09:14] [ComfyUI] [SubprocessWorker] got response: ok [09:14] [ComfyUI] [comfy-env] DA3_SavePointCloud done (0.14s): result: NodeOutput [09:14] [ComfyUI] [comfy-env] Running DA3_PreviewPointCloud: file_path: '/home/runner/work/comfy-gpu-ci/comfy-gpu-ci/test_workspa..., color_mode: 'RGB' [09:14] [ComfyUI] [SubprocessWorker] call_method: nodes.preview_nodes.DA3_PreviewPointCloud.EXECUTE_NORMALIZED [09:14] [ComfyUI] [SubprocessWorker] acquired lock, ensuring started... [09:14] [ComfyUI] [ComfyUI-DepthAnythingV3] Health check: ping (timeout=5.0s)... [09:14] [ComfyUI] [ComfyUI-DepthAnythingV3] Health check: ok [09:14] [ComfyUI] [SubprocessWorker] worker started/confirmed [09:14] [ComfyUI] [SubprocessWorker] serializing kwargs to shm... [09:14] [ComfyUI] [SubprocessWorker] created 0 shm blocks [09:14] [ComfyUI] [SubprocessWorker] sending request via socket... [09:14] [ComfyUI] [SubprocessWorker] call_id=15 sending call_method [09:14] [ComfyUI] [SubprocessWorker] got response: ok [09:14] [ComfyUI] [comfy-env] DA3_PreviewPointCloud done (0.01s): result: NodeOutput [09:14] [ComfyUI] [comfy-env] Running DA3_PreviewPointCloud: file_path: '/home/runner/work/comfy-gpu-ci/comfy-gpu-ci/test_workspa..., color_mode: 'RGB' [09:14] [ComfyUI] [SubprocessWorker] call_method: nodes.preview_nodes.DA3_PreviewPointCloud.EXECUTE_NORMALIZED [09:14] [ComfyUI] [SubprocessWorker] acquired lock, ensuring started... [09:14] [ComfyUI] [ComfyUI-DepthAnythingV3] Health check: ping (timeout=5.0s)... [09:14] [ComfyUI] [ComfyUI-DepthAnythingV3] Health check: ok [09:14] [ComfyUI] [SubprocessWorker] worker started/confirmed [09:14] [ComfyUI] [SubprocessWorker] serializing kwargs to shm... [09:14] [ComfyUI] [SubprocessWorker] created 0 shm blocks [09:14] [ComfyUI] [SubprocessWorker] sending request via socket... [09:14] [ComfyUI] [SubprocessWorker] call_id=16 sending call_method [09:14] [ComfyUI] [SubprocessWorker] got response: ok [09:14] [ComfyUI] [comfy-env] DA3_PreviewPointCloud done (0.00s): result: NodeOutput [09:14] [ComfyUI] Prompt executed in 241.65 seconds [09:14] Node executed (2 total), capturing... [09:14] Frame 4 saved (frame_003.jpg, t=242.0s) [09:14] [capture-node] freeze=2ms shot=84ms unfreeze=6ms saved=True [09:15] Node executed (4 total), capturing... [09:15] Frame 5 saved (frame_004.jpg, t=242.5s) [09:15] [capture-node] freeze=2ms shot=104ms unfreeze=0ms saved=True [09:15] Execution complete (t=242.5s) [09:15] Captured 5 unique frames over 242.68s [09:15] [debug] iframes: 1 [09:15] [debug] iframe[0]: src=http://127.0.0.1:41881/extensions/ComfyUI-GeometryPack/viewer_vtk.html?v=1778448, canvas=486x394, rafFrozen=True [09:15] [timing] trigger_3d_previews: 0.0s [09:17] Saved high-quality screenshot: advanced_3d_multiview_executed.png [09:17] [timing] final_screenshot: 0.2s [09:18] [4/7] SKIPPED (not in cpu list) bas_relief.json [09:18] [5/7] SKIPPED (not in cpu list) da3_streaming.json [09:18] Capturing execution frames: simple.json [09:24] Frame 1 saved (frame_000.jpg, t=0.0s) [09:24] Validating workflow... [09:24] [ComfyUI] === /validate endpoint called === [09:24] [ComfyUI] Received JSON with keys: ['prompt'] [09:24] [ComfyUI] Prompt has 4 nodes [09:24] [ComfyUI] Node 2: LoadImage [09:24] [ComfyUI] Inputs: {"image": "bridge.jpg"} [09:24] [ComfyUI] Node 3: DownloadAndLoadDepthAnythingV3Model [09:24] [ComfyUI] Inputs: {"model": "da3_large.safetensors", "precision": "auto", "attention": "auto"} [09:24] [ComfyUI] Node 4: PreviewImage [09:24] [ComfyUI] Inputs: {"images": ["14", 0]} [09:24] [ComfyUI] Node 14: DepthAnything_V3 [09:24] Queuing workflow for execution... [09:24] [ComfyUI] Inputs: {"normalization_mode": "V2-Style", "resize_method": "resize", "invert_depth": true, "keep_model_size": false, "da3_model": ["3", 0], "images": ["2", 0]} [09:24] [ComfyUI] Generated prompt_id: 6ac2c232-0fd4-4158-a1b3-0a0d3ce8fe68 [09:24] [ComfyUI] Calling execution.validate_prompt()... [09:24] [ComfyUI] Validation result: valid=True [09:24] [ComfyUI] === Validation PASSED === [09:24] [ComfyUI] got prompt [09:24] [ComfyUI] [comfy-env] Running DownloadAndLoadDepthAnythingV3Model: model: 'da3_large.safetensors', precision: 'auto', attention: 'auto' [09:24] [ComfyUI] [SubprocessWorker] call_method: nodes.load_model.DownloadAndLoadDepthAnythingV3Model.EXECUTE_NORMALIZED [09:24] [ComfyUI] [SubprocessWorker] acquired lock, ensuring started... [09:24] [ComfyUI] [ComfyUI-DepthAnythingV3] Health check: ping (timeout=5.0s)... [09:24] [ComfyUI] [ComfyUI-DepthAnythingV3] Health check: failed [09:24] [ComfyUI] [ComfyUI-DepthAnythingV3] Socket unhealthy, restarting worker... [09:24] [ComfyUI] [ComfyUI-DepthAnythingV3] python: /home/runner/work/comfy-gpu-ci/comfy-gpu-ci/test_workspaces/DepthAnythingV3-2120/ComfyUI/.ce/.pixi/envs/depthanythingv3-nodes/bin/python [09:24] [ComfyUI] [ComfyUI-DepthAnythingV3] sys_path sent to worker: ['/home/runner/work/comfy-gpu-ci/comfy-gpu-ci/test_workspaces/DepthAnythingV3-2120/ComfyUI', '/home/runner/work/comfy-gpu-ci/comfy-gpu-ci/test_workspaces/DepthAnythingV3-2120/ComfyUI/custom_nodes/ComfyUI-DepthAnythingV3', '/home/runner/work/comfy-gpu-ci/comfy-gpu-ci/test_workspaces/DepthAnythingV3-2120/ComfyUI/.ce/.pixi/envs/depthanythingv3-nodes/lib/python3.11/site-packages', '/home/runner/work/comfy-gpu-ci/comfy-gpu-ci/test_workspaces/DepthAnythingV3-2120/ComfyUI/custom_nodes/ComfyUI-DepthAnythingV3'] [09:24] [ComfyUI] [SubprocessWorker] is_pixi=True, python=/home/runner/work/comfy-gpu-ci/comfy-gpu-ci/test_workspaces/DepthAnythingV3-2120/ComfyUI/.ce/.pixi/envs/depthanythingv3-nodes/bin/python [09:24] [ComfyUI] [SubprocessWorker] launching cmd=['/home/runner/.pixi/bin/pixi', 'run', '--as-is', '--manifest-path', '/home/runner/work/comfy-gpu-ci/comfy-gpu-ci/test_workspaces/DepthAnythingV3-2120/ComfyUI/.ce/pixi.toml', '-e', 'depthanythingv3-nodes', 'python', '/tmp/comfyui_pvenv_iyejiq02/persistent_worker.py', 'abstract://comfy_worker_530a6a689a1d']... [09:24] [ComfyUI] [SubprocessWorker] socket_addr=abstract://comfy_worker_530a6a689a1d (abstract, no filesystem path) [09:25] [ComfyUI] [worker:ComfyUI-DepthAnythingV3] ERROR: Failed to import comfy_kitchen, Error: No module named 'comfy_kitchen', fp8 and fp4 support will not be available. [09:25] [ComfyUI] [SubprocessWorker] worker started/confirmed [09:25] [ComfyUI] [SubprocessWorker] serializing kwargs to shm... [09:25] [ComfyUI] [SubprocessWorker] created 0 shm blocks [09:25] [ComfyUI] [SubprocessWorker] sending request via socket... [09:25] [ComfyUI] [SubprocessWorker] call_id=17 sending call_method [09:26] [ComfyUI] [SubprocessWorker] got response: ok [09:26] [ComfyUI] [comfy-env] DownloadAndLoadDepthAnythingV3Model done (1.47s): result: NodeOutput [09:26] [ComfyUI] [comfy-env] Running DepthAnything_V3: normalization_mode: 'V2-Style', resize_method: 'resize', invert_depth: True, keep_model_size: False, da3_model: dict, images: torch.float32 [1,683,1024,3] cpu [09:26] [ComfyUI] [SubprocessWorker] call_method: nodes.nodes_inference.DepthAnything_V3.EXECUTE_NORMALIZED [09:26] [ComfyUI] [SubprocessWorker] acquired lock, ensuring started... [09:26] [ComfyUI] [ComfyUI-DepthAnythingV3] Health check: ping (timeout=5.0s)... [09:26] [ComfyUI] [ComfyUI-DepthAnythingV3] Health check: ok [09:26] [ComfyUI] [SubprocessWorker] worker started/confirmed [09:26] [ComfyUI] [comfy-env] PRE-SERIALIZE 'images' shape: torch.Size([1, 683, 1024, 3]) [09:26] [ComfyUI] [SubprocessWorker] serializing kwargs to shm... [09:26] [ComfyUI] [SubprocessWorker] created 0 shm blocks [09:26] [ComfyUI] [SubprocessWorker] sending request via socket... [09:26] [ComfyUI] [SubprocessWorker] call_id=18 sending call_method [09:26] [ComfyUI] [worker:ComfyUI-DepthAnythingV3] [comfy-env] _from_shm got dict with keys: ['__type__', 'strategy', 'parent_pid', 'fd', 'storage_size'] [09:26] [ComfyUI] [worker:ComfyUI-DepthAnythingV3] [comfy-env] DESERIALIZE TensorRef: tensor_size=[1, 683, 1024, 3] [09:26] [ComfyUI] [worker:ComfyUI-DepthAnythingV3] [comfy-env] DESERIALIZED tensor shape: torch.Size([1, 683, 1024, 3]) [09:26] [ComfyUI] [worker:ComfyUI-DepthAnythingV3] WARNING: No comfy kitchen, using old apply_rope functions. [09:26] Frame 2 saved (frame_001.jpg, t=2.2s) [09:26] [capture-periodic] freeze=3ms shot=118ms unfreeze=3ms saved=True [09:27] [ComfyUI] [SubprocessWorker] callback 'request_vram_budget' from call_id=18 [09:27] [ComfyUI] [comfy-env] VRAM request: 1.64GB, free before eviction: 13.54GB [09:27] [ComfyUI] [comfy-env] VRAM after eviction: 13.54GB [09:27] [ComfyUI] [worker:ComfyUI-DepthAnythingV3] WARNING: WARNING: This model does not support sky segmentation. V2-Style normalization will work but without sky masking. Use Mono/Metric/Nested models for best V2-Style results. [09:29] Frame 3 saved (frame_002.jpg, t=4.5s) [09:29] [capture-periodic] freeze=2ms shot=118ms unfreeze=3ms saved=True [09:30] [capture-loop] iter=50 t=5.7s state={'complete': False, 'error': None, 'executedCount': 0, 'wsState': 1} eval_ms=2 ram=3.2/15.6GB (20%) swap=0.0/3.0GB (0%) cpu=29% browser_rss=1.01GB [09:35] [capture-loop] iter=100 t=11.2s state={'complete': False, 'error': None, 'executedCount': 0, 'wsState': 1} eval_ms=3 ram=3.5/15.6GB (22%) swap=0.0/3.0GB (0%) cpu=32% browser_rss=1.00GB [09:41] [capture-loop] iter=150 t=16.8s state={'complete': False, 'error': None, 'executedCount': 0, 'wsState': 1} eval_ms=3 ram=4.6/15.6GB (29%) swap=0.0/3.0GB (0%) cpu=32% browser_rss=1.00GB [09:46] [capture-loop] iter=200 t=22.4s state={'complete': False, 'error': None, 'executedCount': 0, 'wsState': 1} eval_ms=2 ram=3.1/15.6GB (20%) swap=0.0/3.0GB (0%) cpu=32% browser_rss=1.00GB [09:52] [capture-loop] iter=250 t=27.9s state={'complete': False, 'error': None, 'executedCount': 0, 'wsState': 1} eval_ms=3 ram=3.2/15.6GB (21%) swap=0.0/3.0GB (0%) cpu=34% browser_rss=0.90GB [09:57] [capture-loop] iter=300 t=33.6s state={'complete': False, 'error': None, 'executedCount': 0, 'wsState': 1} eval_ms=3 ram=3.2/15.6GB (21%) swap=0.0/3.0GB (0%) cpu=34% browser_rss=0.90GB [10:03] [capture-loop] iter=350 t=39.1s state={'complete': False, 'error': None, 'executedCount': 0, 'wsState': 1} eval_ms=3 ram=3.7/15.6GB (24%) swap=0.0/3.0GB (0%) cpu=32% browser_rss=0.90GB [10:09] [capture-loop] iter=400 t=44.6s state={'complete': False, 'error': None, 'executedCount': 0, 'wsState': 1} eval_ms=2 ram=4.1/15.6GB (26%) swap=0.0/3.0GB (0%) cpu=32% browser_rss=0.90GB [10:14] [capture-loop] iter=450 t=50.1s state={'complete': False, 'error': None, 'executedCount': 0, 'wsState': 1} eval_ms=2 ram=3.3/15.6GB (21%) swap=0.0/3.0GB (0%) cpu=32% browser_rss=0.89GB [10:20] [capture-loop] iter=500 t=55.7s state={'complete': False, 'error': None, 'executedCount': 0, 'wsState': 1} eval_ms=2 ram=3.1/15.6GB (20%) swap=0.0/3.0GB (0%) cpu=32% browser_rss=0.90GB [10:24] [ComfyUI] [worker:ComfyUI-DepthAnythingV3] [10:24] [ComfyUI] === WATCHDOG TICK 1 === [10:24] [ComfyUI] [worker:ComfyUI-DepthAnythingV3] Current thread 0x00007f982786a6c0 (most recent call first): [10:24] [ComfyUI] File "/tmp/comfyui_pvenv_iyejiq02/persistent_worker.py", line 52 in _watchdog [10:24] [ComfyUI] File "/home/runner/work/comfy-gpu-ci/comfy-gpu-ci/test_workspaces/DepthAnythingV3-2120/ComfyUI/.ce/.pixi/envs/depthanythingv3-nodes/lib/python3.11/threading.py", line 982 in run [10:24] [ComfyUI] File "/home/runner/work/comfy-gpu-ci/comfy-gpu-ci/test_workspaces/DepthAnythingV3-2120/ComfyUI/.ce/.pixi/envs/depthanythingv3-nodes/lib/python3.11/threading.py", line 1045 in _bootstrap_inner [10:24] [ComfyUI] File "/home/runner/work/comfy-gpu-ci/comfy-gpu-ci/test_workspaces/DepthAnythingV3-2120/ComfyUI/.ce/.pixi/envs/depthanythingv3-nodes/lib/python3.11/threading.py", line 1002 in _bootstrap [10:24] [ComfyUI] [10:24] [ComfyUI] Thread 0x00007f982838f740 (most recent call first): [10:24] [ComfyUI] File "/home/runner/work/comfy-gpu-ci/comfy-gpu-ci/test_workspaces/DepthAnythingV3-2120/ComfyUI/comfy/ops.py", line 475 in forward_comfy_cast_weights [10:24] [ComfyUI] File "/home/runner/work/comfy-gpu-ci/comfy-gpu-ci/test_workspaces/DepthAnythingV3-2120/ComfyUI/comfy/ops.py", line 482 in forward [10:24] [ComfyUI] File "/home/runner/work/comfy-gpu-ci/comfy-gpu-ci/test_workspaces/DepthAnythingV3-2120/ComfyUI/.ce/.pixi/envs/depthanythingv3-nodes/lib/python3.11/site-packages/torch/nn/modules/module.py", line 1790 in _call_impl [10:24] [ComfyUI] File "/home/runner/work/comfy-gpu-ci/comfy-gpu-ci/test_workspaces/DepthAnythingV3-2120/ComfyUI/.ce/.pixi/envs/depthanythingv3-nodes/lib/python3.11/site-packages/torch/nn/modules/module.py", line 1779 in _wrapped_call_impl [10:24] [ComfyUI] File "/home/runner/work/comfy-gpu-ci/comfy-gpu-ci/test_workspaces/DepthAnythingV3-2120/ComfyUI/custom_nodes/ComfyUI-DepthAnythingV3/nodes/depth_anything_v3/model.py", line 241 in forward [10:24] [ComfyUI] File "/home/runner/work/comfy-gpu-ci/comfy-gpu-ci/test_workspaces/DepthAnythingV3-2120/ComfyUI/.ce/.pixi/envs/depthanythingv3-nodes/lib/python3.11/site-packages/torch/nn/modules/module.py", line 1790 in _call_impl [10:24] [ComfyUI] File "/home/runner/work/comfy-gpu-ci/comfy-gpu-ci/test_workspaces/DepthAnythingV3-2120/ComfyUI/.ce/.pixi/envs/depthanythingv3-nodes/lib/python3.11/site-packages/torch/nn/modules/module.py", line 1779 in _wrapped_call_impl [10:24] [ComfyUI] File "/home/runner/work/comfy-gpu-ci/comfy-gpu-ci/test_workspaces/DepthAnythingV3-2120/ComfyUI/custom_nodes/ComfyUI-DepthAnythingV3/nodes/depth_anything_v3/model.py", line 519 in ffn_residual_func [10:24] [ComfyUI] File "/home/runner/work/comfy-gpu-ci/comfy-gpu-ci/test_workspaces/DepthAnythingV3-2120/ComfyUI/custom_nodes/ComfyUI-DepthAnythingV3/nodes/depth_anything_v3/model.py", line 522 in forward [10:24] [ComfyUI] File "/home/runner/work/comfy-gpu-ci/comfy-gpu-ci/test_workspaces/DepthAnythingV3-2120/ComfyUI/.ce/.pixi/envs/depthanythingv3-nodes/lib/python3.11/site-packages/torch/nn/modules/module.py", line 1790 in _call_impl [10:24] [ComfyUI] File "/home/runner/work/comfy-gpu-ci/comfy-gpu-ci/test_workspaces/DepthAnythingV3-2120/ComfyUI/.ce/.pixi/envs/depthanythingv3-nodes/lib/python3.11/site-packages/torch/nn/modules/module.py", line 1779 in _wrapped_call_impl [10:24] [ComfyUI] File "/home/runner/work/comfy-gpu-ci/comfy-gpu-ci/test_workspaces/DepthAnythingV3-2120/ComfyUI/custom_nodes/ComfyUI-DepthAnythingV3/nodes/depth_anything_v3/model.py", line 791 in process_attention [10:24] [ComfyUI] File "/home/runner/work/comfy-gpu-ci/comfy-gpu-ci/test_workspaces/DepthAnythingV3-2120/ComfyUI/custom_nodes/ComfyUI-DepthAnythingV3/nodes/depth_anything_v3/model.py", line 750 in _get_intermediate_layers_not_chunked [10:24] [ComfyUI] File "/home/runner/work/comfy-gpu-ci/comfy-gpu-ci/test_workspaces/DepthAnythingV3-2120/ComfyUI/custom_nodes/ComfyUI-DepthAnythingV3/nodes/depth_anything_v3/model.py", line 800 in get_intermediate_layers [10:24] [ComfyUI] File "/home/runner/work/comfy-gpu-ci/comfy-gpu-ci/test_workspaces/DepthAnythingV3-2120/ComfyUI/custom_nodes/ComfyUI-DepthAnythingV3/nodes/depth_anything_v3/model.py", line 891 in forward [10:24] [ComfyUI] File "/home/runner/work/comfy-gpu-ci/comfy-gpu-ci/test_workspaces/DepthAnythingV3-2120/ComfyUI/.ce/.pixi/envs/depthanythingv3-nodes/lib/python3.11/site-packages/torch/nn/modules/module.py", line 1790 in _call_impl [10:24] [ComfyUI] File "/home/runner/work/comfy-gpu-ci/comfy-gpu-ci/test_workspaces/DepthAnythingV3-2120/ComfyUI/.ce/.pixi/envs/depthanythingv3-nodes/lib/python3.11/site-packages/torch/nn/modules/module.py", line 1779 in _wrapped_call_impl [10:24] [ComfyUI] File "/home/runner/work/comfy-gpu-ci/comfy-gpu-ci/test_workspaces/DepthAnythingV3-2120/ComfyUI/custom_nodes/ComfyUI-DepthAnythingV3/nodes/depth_anything_v3/model.py", line 1560 in forward [10:24] [ComfyUI] File "/home/runner/work/comfy-gpu-ci/comfy-gpu-ci/test_workspaces/DepthAnythingV3-2120/ComfyUI/.ce/.pixi/envs/depthanythingv3-nodes/lib/python3.11/site-packages/torch/nn/modules/module.py", line 1790 in _call_impl [10:24] [ComfyUI] File "/home/runner/work/comfy-gpu-ci/comfy-gpu-ci/test_workspaces/DepthAnythingV3-2120/ComfyUI/.ce/.pixi/envs/depthanythingv3-nodes/lib/python3.11/site-packages/torch/nn/modules/module.py", line 1779 in _wrapped_call_impl [10:24] [ComfyUI] File "/home/runner/work/comfy-gpu-ci/comfy-gpu-ci/test_workspaces/DepthAnythingV3-2120/ComfyUI/custom_nodes/ComfyUI-DepthAnythingV3/nodes/nodes_inference.py", line 156 in execute [10:24] [ComfyUI] File "/home/runner/work/comfy-gpu-ci/comfy-gpu-ci/test_workspaces/DepthAnythingV3-2120/ComfyUI/comfy_api/latest/_io.py", line 1833 in EXECUTE_NORMALIZED [10:24] [ComfyUI] File "/tmp/comfyui_pvenv_iyejiq02/persistent_worker.py", line 1762 in main [10:24] [ComfyUI] File "/tmp/comfyui_pvenv_iyejiq02/persistent_worker.py", line 1807 in [10:24] [ComfyUI] [10:24] [ComfyUI] [worker:ComfyUI-DepthAnythingV3] === END === [10:24] [ComfyUI] [10:25] [capture-loop] iter=550 t=61.2s state={'complete': False, 'error': None, 'executedCount': 0, 'wsState': 1} eval_ms=2 ram=3.0/15.6GB (19%) swap=0.0/3.0GB (0%) cpu=32% browser_rss=0.90GB [10:31] [capture-loop] iter=600 t=66.8s state={'complete': False, 'error': None, 'executedCount': 0, 'wsState': 1} eval_ms=3 ram=3.3/15.6GB (21%) swap=0.0/3.0GB (0%) cpu=32% browser_rss=0.90GB [10:36] [capture-loop] iter=650 t=72.3s state={'complete': False, 'error': None, 'executedCount': 0, 'wsState': 1} eval_ms=3 ram=3.8/15.6GB (24%) swap=0.0/3.0GB (0%) cpu=31% browser_rss=0.90GB [10:42] [capture-loop] iter=700 t=77.9s state={'complete': False, 'error': None, 'executedCount': 0, 'wsState': 1} eval_ms=3 ram=4.1/15.6GB (26%) swap=0.0/3.0GB (0%) cpu=32% browser_rss=0.90GB [10:47] [capture-loop] iter=750 t=83.3s state={'complete': False, 'error': None, 'executedCount': 0, 'wsState': 1} eval_ms=2 ram=4.1/15.6GB (26%) swap=0.0/3.0GB (0%) cpu=31% browser_rss=0.90GB [10:53] [capture-loop] iter=800 t=88.9s state={'complete': False, 'error': None, 'executedCount': 0, 'wsState': 1} eval_ms=2 ram=3.9/15.6GB (25%) swap=0.0/3.0GB (0%) cpu=32% browser_rss=0.90GB [10:55] [ComfyUI] [SubprocessWorker] callback 'report_progress' from call_id=18 [10:55] [ComfyUI] [SubprocessWorker] got response: ok [10:55] [ComfyUI] [comfy-env] DepthAnything_V3 done (89.47s): result: NodeOutput [10:55] [ComfyUI] Prompt executed in 90.98 seconds [10:55] Node executed (1 total), capturing... [10:56] Frame 4 saved (frame_003.jpg, t=91.6s) [10:56] [capture-node] freeze=2ms shot=116ms unfreeze=0ms saved=True [10:56] Execution complete (t=91.6s) [10:56] Captured 4 unique frames over 91.77s [10:56] [debug] iframes: 0 [10:56] [timing] trigger_3d_previews: 0.0s [10:58] Saved high-quality screenshot: simple_executed.png [10:58] [timing] final_screenshot: 0.3s [10:58] [7/7] SKIPPED (not in cpu list) video_multiview_depth.json [10:58] Results saved to /home/runner/work/comfy-gpu-ci/comfy-gpu-ci/comfy-test-logs/DepthAnythingV3-2120/dev/linux-cpu/results.json [10:58] Model report: 4 files, 1.5 GB -> /home/runner/work/comfy-gpu-ci/comfy-gpu-ci/comfy-test-logs/DepthAnythingV3-2120/dev/linux-cpu/models.json [10:58] Saved: /home/runner/work/comfy-gpu-ci/comfy-gpu-ci/comfy-test-logs/DepthAnythingV3-2120/dev/linux-cpu/index.html [10:58] [EXECUTION] PASSED [10:58] linux: PASSED [10:58] Stopping ComfyUI server...