[00:00] Crash dump logging enabled: /logs/DepthAnythingV3-2204/dev/linux-gpu/crash_dump.log [00:00] [00:00] [1/5] SYNTAX [00:00] ---------------------------------------- [00:00] [DEBUG] server=None, server_url=None, api=None [00:00] Found pyproject.toml (modern format) [00:00] Found requirements.txt (legacy format) [00:00] Unicode check: OK (all characters cp1252-safe) [00:00] Forbidden patterns check: OK [00:00] [SYNTAX] PASSED [00:00] [00:00] [2/5] INSTALL [00:00] ---------------------------------------- [00:00] [DEBUG] server=None, server_url=None, api=None [00:00] Setting up ComfyUI... [00:00] Creating virtual environment... [00:00] Running: uv venv /workspaces/DepthAnythingV3-2204/.venv --python 3.12 [00:00] Cloning ComfyUI (latest)... [00:00] Running: git clone --depth 1 https://github.com/comfyanonymous/ComfyUI.git /workspaces/DepthAnythingV3-2204/ComfyUI [00:01] Installing ComfyUI requirements... [00:01] Running: uv pip install --python /workspaces/DepthAnythingV3-2204/.venv/bin/python --index-url https://download.pytorch.org/whl/cu128 --extra-index-url https://pypi.org/simple --index-strategy unsafe-best-match -r /workspaces/DepthAnythingV3-2204/ComfyUI/requirements.txt [01:18] Installing custom node... [01:18] Copying ComfyUI-DepthAnythingV3 to custom_nodes/... [01:18] Installing node requirements... [01:18] Running: uv pip install --python /workspaces/DepthAnythingV3-2204/.venv/bin/python --index-url https://download.pytorch.org/whl/cu128 --extra-index-url https://pypi.org/simple --index-strategy unsafe-best-match -r /workspaces/DepthAnythingV3-2204/ComfyUI/custom_nodes/ComfyUI-DepthAnythingV3/requirements.txt [01:21] Running install.py... [01:21] Running: /workspaces/DepthAnythingV3-2204/.venv/bin/python /workspaces/DepthAnythingV3-2204/ComfyUI/custom_nodes/ComfyUI-DepthAnythingV3/install.py [01:22] [01:22] Installing 3 node dependencies... [01:22] Cloning ComfyUI-VideoHelperSuite... [01:22] Installing requirements for ComfyUI-VideoHelperSuite... [01:24] Cloning ComfyUI-KJNodes... [01:26] Installing requirements for ComfyUI-KJNodes... [01:28] Cloning ComfyUI-GeometryPack... [01:32] Installing requirements for ComfyUI-GeometryPack... [01:33] Running install.py for ComfyUI-GeometryPack... [01:35] [comfy-env] _discover: scanning /workspaces/DepthAnythingV3-2204/ComfyUI/custom_nodes [01:35] [comfy-env] _discover: ComfyUI-DepthAnythingV3 -> depthanythingv3-nodes (custom_nodes/ComfyUI-DepthAnythingV3/nodes/comfy-env.toml) [01:35] [comfy-env] _discover: ComfyUI-GeometryPack -> geometrypack-nodes (custom_nodes/ComfyUI-GeometryPack/nodes/comfy-env.toml) [01:35] [comfy-env] _discover: ComfyUI-KJNodes: no comfy-env.toml found [01:35] [comfy-env] _discover: ComfyUI-VideoHelperSuite: no comfy-env.toml found [01:35] [comfy-env] Workspace: /root/.ce [01:35] [comfy-env] ComfyUI: /workspaces/DepthAnythingV3-2204/ComfyUI [01:35] [comfy-env] Found 2 node config(s): [01:35] - depthanythingv3-nodes <- custom_nodes/ComfyUI-DepthAnythingV3/nodes/comfy-env.toml (python=host) [01:35] - geometrypack-nodes <- custom_nodes/ComfyUI-GeometryPack/nodes/comfy-env.toml (python=host) [01:35] [comfy-env] Bootstrap interpreter has python 3.12 + torch 2.11.0 (cu128). Looking for cuda-only wheels matching cu128/torch2.11/cp312. [01:36] [comfy-env] GPU: Detection: smi [01:36] Driver: 580.126.20 [01:36] CUDA: 13.0 [01:36] Recommended: CUDA 13.0 [01:36] [01:36] GPU 0: NVIDIA GeForce RTX 5060 (sm_120) [Blackwell] 8151MB [01:36] [comfy-env] Comfyui feature -> torch 2.11.0 from https://download.pytorch.org/whl/cu128 (CUDA 12.8 via bootstrap torch) [01:36] [comfy-env] cuda-wheels: 3 package(s) need a matched (cuda, torch, python) combo: ['flash_attn', 'sageattention', 'cumesh'] [01:36] [comfy-env] cuda-wheels tier 1 (bootstrap): probing cu12.8/torch2.11/cp312 [01:36] [cuda-wheels] Looking up flash_attn: cu128 torch2.11 cp312 manylinux linux [01:36] [cuda-wheels] https://pozzettiandrea.github.io/cuda-wheels/v2/flash_attn/: HTTPError: HTTP Error 404: Not Found [01:36] [cuda-wheels] Found: flash_attn-2.8.3+cu128torch2.11-cp312-cp312-manylinux_2_34_x86_64.manylinux_2_35_x86_64.whl [01:36] [cuda-wheels] Looking up sageattention: cu128 torch2.11 cp312 manylinux linux [01:36] [cuda-wheels] Found: sageattention-2.2.0+cu128torch2.11-cp312-cp312-manylinux_2_34_x86_64.manylinux_2_35_x86_64.whl [01:36] [cuda-wheels] Looking up cumesh: cu128 torch2.11 cp312 manylinux linux [01:36] [cuda-wheels] Found: cumesh-0.0.1+cu128torch2.11-cp312-cp312-manylinux_2_35_x86_64.whl [01:36] [comfy-env] cuda-wheels combo: cu12.8/torch2.11 (bootstrap matches; per-node envs will pin to this) [01:36] [comfy-env] Host glibc 2.35 -> system-requirements [01:36] [cuda-wheels] Looking up flash_attn: cu128 torch2.11 cp312 manylinux linux [01:36] [cuda-wheels] https://pozzettiandrea.github.io/cuda-wheels/v2/flash_attn/: HTTPError: HTTP Error 404: Not Found [01:36] [cuda-wheels] Found: flash_attn-2.8.3+cu128torch2.11-cp312-cp312-manylinux_2_34_x86_64.manylinux_2_35_x86_64.whl [01:36] [cuda-wheels] Looking up sageattention: cu128 torch2.11 cp312 manylinux linux [01:36] [cuda-wheels] Found: sageattention-2.2.0+cu128torch2.11-cp312-cp312-manylinux_2_34_x86_64.manylinux_2_35_x86_64.whl [01:36] [comfy-env] depthanythingv3-nodes: cuda-wheels deferred for post-pixi install (flash_attn, sageattention) [01:36] [cuda-wheels] Looking up cumesh: cu128 torch2.11 cp312 manylinux linux [01:36] [cuda-wheels] Found: cumesh-0.0.1+cu128torch2.11-cp312-cp312-manylinux_2_35_x86_64.whl [01:36] [comfy-env] geometrypack-nodes: cuda-wheels deferred for post-pixi install (cumesh) [01:36] Generated /root/.ce/pixi.toml [01:36] [comfy-env] Installing 2 environment(s): [01:36] - depthanythingv3-nodes (python=host, 10 pypi deps, 2 cuda wheels) [01:36] - geometrypack-nodes (python=host, 14 pypi deps, 1 cuda wheels) [01:36] [comfy-env] Running `pixi install -e depthanythingv3-nodes -e geometrypack-nodes`... [01:42] WARN Skipped running the post-link scripts because `run-post-link-scripts` = `false` [01:42] - bin/.librsvg-pre-unlink.sh [01:42] To enable them, run: [01:42] pixi config set --local run-post-link-scripts insecure [01:42] More info: [01:42] https://pixi.sh/latest/reference/pixi_configuration/#run-post-link-scripts [01:56] WARN Skipped running the post-link scripts because `run-post-link-scripts` = `false` [01:56] - bin/.librsvg-pre-unlink.sh [01:56] To enable them, run: [01:56] pixi config set --local run-post-link-scripts insecure [01:56] More info: [01:56] https://pixi.sh/latest/reference/pixi_configuration/#run-post-link-scripts [02:56] The following environments have been installed: depthanythingv3-nodes, geometrypack-nodes. [02:56] [comfy-env] depthanythingv3-nodes: installing cuda-wheels with --no-deps (flash_attn, sageattention) [02:56] Using Python 3.12.13 environment at: .pixi/envs/depthanythingv3-nodes [02:58] Resolved 2 packages in 1.85s [02:58] Downloading sageattention (53.2MiB) [02:58] Downloading flash-attn (242.3MiB) [02:59] Downloaded sageattention [03:04] Downloaded flash-attn [03:04] Prepared 2 packages in 6.60s [03:04] Installed 2 packages in 7ms [03:04] + flash-attn==2.8.3+cu128torch2.11 (from https://github.com/PozzettiAndrea/cuda-wheels/releases/download/flash_attn-latest/flash_attn-2.8.3%2Bcu128torch2.11-cp312-cp312-manylinux_2_34_x86_64.manylinux_2_35_x86_64.whl) [03:04] + sageattention==2.2.0+cu128torch2.11 (from https://github.com/PozzettiAndrea/cuda-wheels/releases/download/sageattention-latest/sageattention-2.2.0%2Bcu128torch2.11-cp312-cp312-manylinux_2_34_x86_64.manylinux_2_35_x86_64.whl) [03:04] [comfy-env] geometrypack-nodes: installing cuda-wheels with --no-deps (cumesh) [03:04] Using Python 3.12.13 environment at: .pixi/envs/geometrypack-nodes [03:05] Resolved 1 package in 967ms [03:05] Downloading cumesh (19.5MiB) [03:06] Downloaded cumesh [03:06] Prepared 1 package in 342ms [03:06] Installed 1 package in 2ms [03:06] + cumesh==0.0.1+cu128torch2.11 (from https://github.com/PozzettiAndrea/cuda-wheels/releases/download/cumesh-latest/cumesh-0.0.1%2Bcu128torch2.11-cp312-cp312-manylinux_2_35_x86_64.whl) [03:06] [comfy-env] Install log: /root/.ce/install.log [03:06] [03:06] Installation complete! [03:06] [03:06] [requirements] Re-installing main package requirements... [03:06] Installing requirements for ComfyUI-DepthAnythingV3... [03:06] [comfy-env] _discover: scanning /workspaces/DepthAnythingV3-2204/ComfyUI/custom_nodes [03:06] [comfy-env] _discover: ComfyUI-DepthAnythingV3 -> depthanythingv3-nodes (custom_nodes/ComfyUI-DepthAnythingV3/nodes/comfy-env.toml) [03:06] [comfy-env] _discover: ComfyUI-GeometryPack -> geometrypack-nodes (custom_nodes/ComfyUI-GeometryPack/nodes/comfy-env.toml) [03:06] [comfy-env] _discover: ComfyUI-KJNodes: no comfy-env.toml found [03:06] [comfy-env] _discover: ComfyUI-VideoHelperSuite: no comfy-env.toml found [03:06] [comfy-env] Workspace: /root/.ce [03:06] [comfy-env] ComfyUI: /workspaces/DepthAnythingV3-2204/ComfyUI [03:06] [comfy-env] Found 2 node config(s): [03:06] - depthanythingv3-nodes <- custom_nodes/ComfyUI-DepthAnythingV3/nodes/comfy-env.toml (python=host) [03:06] - geometrypack-nodes <- custom_nodes/ComfyUI-GeometryPack/nodes/comfy-env.toml (python=host) [03:06] [comfy-env] Bootstrap interpreter has python 3.12 + torch 2.11.0 (cu128). Looking for cuda-only wheels matching cu128/torch2.11/cp312. [03:06] [comfy-env] GPU: Detection: smi [03:06] Driver: 580.126.20 [03:06] CUDA: 13.0 [03:06] Recommended: CUDA 13.0 [03:06] [03:06] GPU 0: NVIDIA GeForce RTX 5060 (sm_120) [Blackwell] 8151MB [03:06] [comfy-env] Comfyui feature -> torch 2.11.0 from https://download.pytorch.org/whl/cu128 (CUDA 12.8 via bootstrap torch) [03:06] [comfy-env] cuda-wheels: 3 package(s) need a matched (cuda, torch, python) combo: ['flash_attn', 'sageattention', 'cumesh'] [03:06] [comfy-env] cuda-wheels tier 1 (bootstrap): probing cu12.8/torch2.11/cp312 [03:06] [cuda-wheels] Looking up flash_attn: cu128 torch2.11 cp312 manylinux linux [03:06] [cuda-wheels] https://pozzettiandrea.github.io/cuda-wheels/v2/flash_attn/: HTTPError: HTTP Error 404: Not Found [03:06] [cuda-wheels] Found: flash_attn-2.8.3+cu128torch2.11-cp312-cp312-manylinux_2_34_x86_64.manylinux_2_35_x86_64.whl [03:06] [cuda-wheels] Looking up sageattention: cu128 torch2.11 cp312 manylinux linux [03:06] [cuda-wheels] Found: sageattention-2.2.0+cu128torch2.11-cp312-cp312-manylinux_2_34_x86_64.manylinux_2_35_x86_64.whl [03:06] [cuda-wheels] Looking up cumesh: cu128 torch2.11 cp312 manylinux linux [03:07] [cuda-wheels] Found: cumesh-0.0.1+cu128torch2.11-cp312-cp312-manylinux_2_35_x86_64.whl [03:07] [comfy-env] cuda-wheels combo: cu12.8/torch2.11 (bootstrap matches; per-node envs will pin to this) [03:07] [comfy-env] Host glibc 2.35 -> system-requirements [03:07] [cuda-wheels] Looking up flash_attn: cu128 torch2.11 cp312 manylinux linux [03:07] [cuda-wheels] https://pozzettiandrea.github.io/cuda-wheels/v2/flash_attn/: HTTPError: HTTP Error 404: Not Found [03:07] [cuda-wheels] Found: flash_attn-2.8.3+cu128torch2.11-cp312-cp312-manylinux_2_34_x86_64.manylinux_2_35_x86_64.whl [03:07] [cuda-wheels] Looking up sageattention: cu128 torch2.11 cp312 manylinux linux [03:07] [cuda-wheels] Found: sageattention-2.2.0+cu128torch2.11-cp312-cp312-manylinux_2_34_x86_64.manylinux_2_35_x86_64.whl [03:07] [comfy-env] depthanythingv3-nodes: cuda-wheels deferred for post-pixi install (flash_attn, sageattention) [03:07] [cuda-wheels] Looking up cumesh: cu128 torch2.11 cp312 manylinux linux [03:07] [cuda-wheels] Found: cumesh-0.0.1+cu128torch2.11-cp312-cp312-manylinux_2_35_x86_64.whl [03:07] [comfy-env] geometrypack-nodes: cuda-wheels deferred for post-pixi install (cumesh) [03:07] Generated /root/.ce/pixi.toml [03:07] [comfy-env] Installing 2 environment(s): [03:07] - depthanythingv3-nodes (python=host, 10 pypi deps, 2 cuda wheels) [03:07] - geometrypack-nodes (python=host, 14 pypi deps, 1 cuda wheels) [03:07] [comfy-env] Running `pixi install -e depthanythingv3-nodes -e geometrypack-nodes`... [03:07] The following environments have been installed: depthanythingv3-nodes, geometrypack-nodes. [03:07] [comfy-env] depthanythingv3-nodes: installing cuda-wheels with --no-deps (flash_attn, sageattention) [03:07] Using Python 3.12.13 environment at: .pixi/envs/depthanythingv3-nodes [03:07] Checked 2 packages in 40ms [03:07] [comfy-env] geometrypack-nodes: installing cuda-wheels with --no-deps (cumesh) [03:07] Using Python 3.12.13 environment at: .pixi/envs/geometrypack-nodes [03:07] Checked 1 package in 63ms [03:07] [comfy-env] Install log: /root/.ce/install.log [03:07] [03:07] Installation complete! [03:07] Installing 3 node dependency(ies)... [03:07] ComfyUI-VideoHelperSuite from Kosinkadink/ComfyUI-VideoHelperSuite [03:07] ComfyUI-VideoHelperSuite already exists, skipping... [03:07] ComfyUI-KJNodes from kijai/ComfyUI-KJNodes [03:07] ComfyUI-KJNodes already exists, skipping... [03:07] ComfyUI-GeometryPack from PozzettiAndrea/ComfyUI-GeometryPack [03:07] ComfyUI-GeometryPack already exists, skipping... [03:07] Installing validation endpoint... [03:07] Cloning PozzettiAndrea/ComfyUI-validate-endpoint... [03:07] Running: git clone --depth 1 https://github.com/PozzettiAndrea/ComfyUI-validate-endpoint.git /workspaces/DepthAnythingV3-2204/ComfyUI/custom_nodes/ComfyUI-validate-endpoint [03:08] CUDA packages absent (will mock): flash_attn, sageattention [03:08] [INSTALL] PASSED [03:08] [03:08] [3/5] REGISTRATION [03:08] ---------------------------------------- [03:08] [DEBUG] server=None, server_url=None, api=None [03:08] Starting ComfyUI server... [03:08] Starting ComfyUI server on port 41890... [03:08] CUDA mock packages: flash_attn, sageattention [03:08] Starting ComfyUI server on port 41890... [03:08] Waiting for server to be ready (timeout: 600s)... [03:09] [ComfyUI] setup plugin alembic.autogenerate.schemas [03:09] [ComfyUI] setup plugin alembic.autogenerate.tables [03:09] [ComfyUI] setup plugin alembic.autogenerate.types [03:09] [ComfyUI] setup plugin alembic.autogenerate.constraints [03:09] [ComfyUI] setup plugin alembic.autogenerate.defaults [03:09] [ComfyUI] setup plugin alembic.autogenerate.comments [03:09] [ComfyUI] [comfy-env] ComfyUI-GeometryPack: 1 isolation env(s): [03:09] [ComfyUI] [comfy-env] nodes -> /workspaces/DepthAnythingV3-2204/ComfyUI/custom_nodes/ComfyUI-GeometryPack/nodes [03:09] [ComfyUI] [comfy-env] prestartup complete [03:09] [ComfyUI] [comfy-env] ComfyUI-DepthAnythingV3: 1 isolation env(s): [03:09] [ComfyUI] [comfy-env] nodes -> /workspaces/DepthAnythingV3-2204/ComfyUI/custom_nodes/ComfyUI-DepthAnythingV3/nodes [03:09] [ComfyUI] [comfy-env] prestartup complete [03:09] [ComfyUI] [03:09] [ComfyUI] Prestartup times for custom nodes: [03:09] [ComfyUI] 0.0 seconds: /workspaces/DepthAnythingV3-2204/ComfyUI/custom_nodes/ComfyUI-DepthAnythingV3 [03:09] [ComfyUI] 0.2 seconds: /workspaces/DepthAnythingV3-2204/ComfyUI/custom_nodes/ComfyUI-GeometryPack [03:09] [ComfyUI] [03:14] [ComfyUI] WARNING: You need pytorch with cu130 or higher to use optimized CUDA operations. [03:14] [ComfyUI] Found comfy_kitchen backend eager: {'available': True, 'disabled': False, 'unavailable_reason': None, 'capabilities': ['apply_rope', 'apply_rope1', 'dequantize_mxfp8', 'dequantize_nvfp4', 'dequantize_per_tensor_fp8', 'quantize_mxfp8', 'quantize_nvfp4', 'quantize_per_tensor_fp8', 'scaled_mm_mxfp8', 'scaled_mm_nvfp4']} [03:14] [ComfyUI] Found comfy_kitchen backend triton: {'available': True, 'disabled': True, 'unavailable_reason': None, 'capabilities': ['apply_rope', 'apply_rope1', 'dequantize_nvfp4', 'dequantize_per_tensor_fp8', 'quantize_mxfp8', 'quantize_nvfp4', 'quantize_per_tensor_fp8']} [03:14] [ComfyUI] Found comfy_kitchen backend cuda: {'available': True, 'disabled': True, 'unavailable_reason': None, 'capabilities': ['apply_rope', 'apply_rope1', 'dequantize_nvfp4', 'dequantize_per_tensor_fp8', 'quantize_mxfp8', 'quantize_nvfp4', 'quantize_per_tensor_fp8']} [03:14] [ComfyUI] Checkpoint files will always be loaded safely. [03:14] [ComfyUI] Total VRAM 7704 MB, total RAM 32011 MB [03:14] [ComfyUI] pytorch version: 2.11.0+cu128 [03:14] [ComfyUI] Set vram state to: NORMAL_VRAM [03:14] [ComfyUI] Device: cuda:0 NVIDIA GeForce RTX 5060 : cudaMallocAsync [03:14] [ComfyUI] Using async weight offloading with 2 streams [03:14] [ComfyUI] Enabled pinned memory 28810.0 [03:15] [ComfyUI] Using pytorch attention [03:19] [ComfyUI] aimdo: /project/src-posix/cuda-funchooks.c:52:DEBUG:aimdo_setup_hooks: hooks successfully installed [03:19] [ComfyUI] aimdo: /project/src/control.c:151:INFO:comfy-aimdo inited for GPU: NVIDIA GeForce RTX 5060 (VRAM: 7703 MB) [03:19] [ComfyUI] DynamicVRAM support detected and enabled [03:19] [ComfyUI] Python version: 3.12.13 (main, May 8 2026, 18:32:55) [Clang 22.1.3 ] [03:19] [ComfyUI] ComfyUI version: 0.20.1 [03:19] [ComfyUI] comfy-aimdo version: 0.3.0 [03:19] [ComfyUI] comfy-kitchen version: 0.2.8 [03:19] [ComfyUI] ****** User settings have been changed to be stored on the server instead of browser storage. ****** [03:19] [ComfyUI] ****** For multi-user setups add the --multi-user CLI argument to enable multiple user profiles. ****** [03:19] [ComfyUI] ComfyUI frontend version: 1.43.18 [03:19] [ComfyUI] [Prompt Server] web root: /workspaces/DepthAnythingV3-2204/.venv/lib/python3.12/site-packages/comfyui_frontend_package/static [03:19] [ComfyUI] Asset seeder disabled [03:21] [ComfyUI] loading... [03:21] [ComfyUI] calling register_nodes [03:21] [ComfyUI] [comfy-env] Version: 0.3.82 [03:21] [ComfyUI] [comfy-env] register_nodes: ComfyUI-GeometryPack [03:21] [ComfyUI] [comfy-env] ComfyUI source dir: /workspaces/DepthAnythingV3-2204/ComfyUI [03:21] [ComfyUI] [comfy-env] Found 1 isolation env(s) [03:21] [ComfyUI] [comfy-env] Scanning nodes metadata (isolation root)... [03:21] [ComfyUI] [comfy-env] Metadata scan: /root/.pixi/bin/pixi run --as-is --manifest-path /root/.ce/pixi.toml -e geometrypack-nodes python /tmp/comfy_meta_ltaeid05.py /workspaces/DepthAnythingV3-2204/ComfyUI/custom_nodes/ComfyUI-GeometryPack nodes [03:21] [ComfyUI] [comfy-env] Scan env PATH for nodes: [03:21] [ComfyUI] [comfy-env] [0] /root/.local/bin [03:21] [ComfyUI] [comfy-env] [1] /usr/local/nvidia/bin [03:21] [ComfyUI] [comfy-env] [2] /usr/local/cuda/bin [03:21] [ComfyUI] [comfy-env] [3] /usr/local/sbin [03:21] [ComfyUI] [comfy-env] [4] /usr/local/bin [03:21] [ComfyUI] [comfy-env] [5] /usr/sbin [03:21] [ComfyUI] [comfy-env] [6] /usr/bin [03:21] [ComfyUI] [comfy-env] [7] /sbin [03:21] [ComfyUI] [comfy-env] [8] /bin [03:26] [ComfyUI] [comfy-env] Metadata scan stderr for nodes: [03:26] [ComfyUI] [comfy-env] [meta-scan] importing nodes from /workspaces/DepthAnythingV3-2204/ComfyUI/custom_nodes/ComfyUI-GeometryPack [03:26] [ComfyUI] [comfy-env] ERROR:root:Failed to import comfy_kitchen, Error: No module named 'comfy_kitchen', fp8 and fp4 support will not be available. [03:26] [ComfyUI] [comfy-env] [meta-scan] import OK [03:26] [ComfyUI] [comfy-env] Scanned nodes: 125 nodes (5.3s) [03:26] [ComfyUI] [comfy-env] Scanned nodes root: 125 nodes (5.3s) [03:26] [ComfyUI] [comfy-env] Imported nodes root: 125 nodes (isolation) [03:26] [ComfyUI] [comfy-env] Registered 125 total nodes [03:26] [ComfyUI] [comfy-env] Version: 0.3.82 [03:26] [ComfyUI] [comfy-env] register_nodes: ComfyUI-DepthAnythingV3 [03:26] [ComfyUI] [comfy-env] ComfyUI source dir: /workspaces/DepthAnythingV3-2204/ComfyUI [03:26] [ComfyUI] [comfy-env] Found 1 isolation env(s) [03:26] [ComfyUI] [comfy-env] Scanning nodes metadata (isolation root)... [03:26] [ComfyUI] [comfy-env] Metadata scan: /root/.pixi/bin/pixi run --as-is --manifest-path /root/.ce/pixi.toml -e depthanythingv3-nodes python /tmp/comfy_meta_p9xgk9i1.py /workspaces/DepthAnythingV3-2204/ComfyUI/custom_nodes/ComfyUI-DepthAnythingV3 nodes [03:26] [ComfyUI] [comfy-env] Scan env PATH for nodes: [03:26] [ComfyUI] [comfy-env] [0] /root/.local/bin [03:26] [ComfyUI] [comfy-env] [1] /usr/local/nvidia/bin [03:26] [ComfyUI] [comfy-env] [2] /usr/local/cuda/bin [03:26] [ComfyUI] [comfy-env] [3] /usr/local/sbin [03:26] [ComfyUI] [comfy-env] [4] /usr/local/bin [03:26] [ComfyUI] [comfy-env] [5] /usr/sbin [03:26] [ComfyUI] [comfy-env] [6] /usr/bin [03:26] [ComfyUI] [comfy-env] [7] /sbin [03:26] [ComfyUI] [comfy-env] [8] /bin [03:29] [ComfyUI] [comfy-env] Metadata scan stderr for nodes: [03:29] [ComfyUI] [comfy-env] [meta-scan] importing nodes from /workspaces/DepthAnythingV3-2204/ComfyUI/custom_nodes/ComfyUI-DepthAnythingV3 [03:29] [ComfyUI] [comfy-env] ERROR:root:Failed to import comfy_kitchen, Error: No module named 'comfy_kitchen', fp8 and fp4 support will not be available. [03:29] [ComfyUI] [comfy-env] [meta-scan] import OK [03:29] [ComfyUI] [comfy-env] Scanned nodes: 15 nodes (2.8s) [03:29] [ComfyUI] [comfy-env] Scanned nodes root: 15 nodes (2.8s) [03:29] [ComfyUI] [comfy-env] Imported nodes root: 15 nodes (isolation) [03:29] [ComfyUI] [comfy-env] Registered 15 total nodes [03:29] [ComfyUI] [03:29] [ComfyUI] Import times for custom nodes: [03:29] [ComfyUI] 0.0 seconds: /workspaces/DepthAnythingV3-2204/ComfyUI/custom_nodes/websocket_image_save.py [03:29] [ComfyUI] 0.0 seconds: /workspaces/DepthAnythingV3-2204/ComfyUI/custom_nodes/ComfyUI-validate-endpoint [03:29] [ComfyUI] 0.1 seconds: /workspaces/DepthAnythingV3-2204/ComfyUI/custom_nodes/ComfyUI-VideoHelperSuite [03:29] [ComfyUI] 0.1 seconds: /workspaces/DepthAnythingV3-2204/ComfyUI/custom_nodes/ComfyUI-KJNodes [03:29] [ComfyUI] 2.8 seconds: /workspaces/DepthAnythingV3-2204/ComfyUI/custom_nodes/ComfyUI-DepthAnythingV3 [03:29] [ComfyUI] 5.5 seconds: /workspaces/DepthAnythingV3-2204/ComfyUI/custom_nodes/ComfyUI-GeometryPack [03:29] [ComfyUI] [03:29] [ComfyUI] Context impl SQLiteImpl. [03:29] [ComfyUI] Will assume non-transactional DDL. [03:29] [ComfyUI] Context impl SQLiteImpl. [03:29] [ComfyUI] Will assume non-transactional DDL. [03:29] [ComfyUI] Running upgrade -> 0001_assets, Initial assets schema [03:29] [ComfyUI] Revision ID: 0001_assets [03:29] [ComfyUI] Revises: None [03:29] [ComfyUI] Create Date: 2025-12-10 00:00:00 [03:29] [ComfyUI] Running upgrade 0001_assets -> 0002_merge_to_asset_references, Merge AssetInfo and AssetCacheState into unified asset_references table. [03:29] [ComfyUI] Running upgrade 0002_merge_to_asset_references -> 0003_add_metadata_job_id, Add system_metadata and job_id columns to asset_references. [03:29] [ComfyUI] Change preview_id FK from assets.id to asset_references.id. [03:29] [ComfyUI] Database upgraded from None to 0003_add_metadata_job_id [03:29] [ComfyUI] Starting server [03:29] [ComfyUI] [03:29] [ComfyUI] To see the GUI go to: http://127.0.0.1:41890 [03:30] Server responding, waiting for nodes to load... [03:50] Server is ready! [03:50] Checking for import errors in server logs... [03:50] No import errors detected [03:50] Found 1120 registered nodes [03:50] [REGISTRATION] PASSED [03:50] [03:50] [4/5] INSTANTIATION [03:50] ---------------------------------------- [03:50] [DEBUG] server=, server_url=None, api= [03:50] Testing node constructors... [03:50] All 15 node(s) instantiated successfully! [03:50] [INSTANTIATION] PASSED [03:50] [03:50] [5/5] EXECUTION [03:50] ---------------------------------------- [03:50] [DEBUG] server=, server_url=None, api= [03:50] GPU runner - will execute 7 workflow(s) [03:50] Running 7 workflow(s) (all with videos)... [03:50] Installing screenshot dependencies (playwright, pillow)... [03:52] Packages installed, downloading chromium browser... [04:09] Screenshot dependencies installed successfully [04:09] Starting headless browser... [04:09] Installing Vulkan stack (apt)... [04:09] Vulkan install error: [Errno 2] No such file or directory: 'sudo' [04:09] GPU detected (no Vulkan) -- using ANGLE/OpenGL rendering [04:09] Capturing execution frames: advanced.json [04:10] [ComfyUI] [DEPRECATION WARNING] Detected import of deprecated legacy API: /extensions/core/widgetInputs.js. This is likely caused by a custom node extension using outdated APIs. Please update your extensions or contact the extension author for an updated version. [04:15] Frame 1 saved (frame_000.jpg, t=0.0s) [04:15] Validating workflow... [04:15] [ComfyUI] === /validate endpoint called === [04:15] [ComfyUI] Received JSON with keys: ['prompt'] [04:15] [ComfyUI] Prompt has 11 nodes [04:15] [ComfyUI] Node 2: LoadImage [04:15] [ComfyUI] Inputs: {"image": "bridge.jpg"} [04:15] Queuing workflow for execution... [04:15] [ComfyUI] Node 3: DownloadAndLoadDepthAnythingV3Model [04:15] [ComfyUI] Inputs: {"model": "da3_large.safetensors", "precision": "auto", "attention": "auto"} [04:15] [ComfyUI] Node 4: PreviewImage [04:15] [ComfyUI] Inputs: {"images": ["12", 0]} [04:15] [ComfyUI] Node 6: PreviewImage [04:15] [ComfyUI] Inputs: {"images": ["12", 1]} [04:15] [ComfyUI] Node 7: PreviewImage [04:15] [ComfyUI] Inputs: {"images": ["12", 2]} [04:15] [ComfyUI] Node 8: PreviewImage [04:15] [ComfyUI] Inputs: {"images": ["12", 3]} [04:15] [ComfyUI] Node 9: PreviewAny [04:15] [ComfyUI] Inputs: {"source": ["12", 6]} [04:15] [ComfyUI] Node 10: PreviewAny [04:15] [ComfyUI] Inputs: {"source": ["12", 5]} [04:15] [ComfyUI] Node 11: MaskPreview [04:15] [ComfyUI] Inputs: {"mask": ["12", 7]} [04:15] [ComfyUI] Node 12: DepthAnything_V3 [04:15] [ComfyUI] Inputs: {"normalization_mode": "V2-Style", "resize_method": "resize", "invert_depth": false, "keep_model_size": false, "da3_model": ["3", 0], "images": ["2", 0]} [04:15] [ComfyUI] Node 13: PreviewImage [04:15] [ComfyUI] Inputs: {"images": ["12", 4]} [04:15] [ComfyUI] Generated prompt_id: 880d18e5-1d57-4433-a26d-87a20e77e285 [04:15] [ComfyUI] Calling execution.validate_prompt()... [04:15] [ComfyUI] Validation result: valid=True [04:15] [ComfyUI] === Validation PASSED === [04:15] [ComfyUI] got prompt [04:15] [ComfyUI] [comfy-env] Running DownloadAndLoadDepthAnythingV3Model: model: 'da3_large.safetensors', precision: 'auto', attention: 'auto' [04:15] [ComfyUI] [comfy-env] SubprocessWorker: /root/.ce/.pixi/envs/depthanythingv3-nodes/bin/python [04:15] [ComfyUI] [VRAM] Before DownloadAndLoadDepthAnythingV3Model: 152 / 7703 MB [04:15] [ComfyUI] [SubprocessWorker] call_method: nodes.load_model.DownloadAndLoadDepthAnythingV3Model.EXECUTE_NORMALIZED [04:15] [ComfyUI] [SubprocessWorker] acquired lock, ensuring started... [04:15] [ComfyUI] [comfy-env] env_vars: {'COMFYUI_BASE': '/workspaces/DepthAnythingV3-2204/ComfyUI'} [04:15] [ComfyUI] [ComfyUI-DepthAnythingV3] python: /root/.ce/.pixi/envs/depthanythingv3-nodes/bin/python [04:15] [ComfyUI] [ComfyUI-DepthAnythingV3] sys_path sent to worker: ['/workspaces/DepthAnythingV3-2204/ComfyUI', '/workspaces/DepthAnythingV3-2204/ComfyUI/custom_nodes/ComfyUI-DepthAnythingV3', '/root/.ce/.pixi/envs/depthanythingv3-nodes/lib/python3.12/site-packages', '/workspaces/DepthAnythingV3-2204/ComfyUI/custom_nodes/ComfyUI-DepthAnythingV3'] [04:15] [ComfyUI] [SubprocessWorker] is_pixi=True, python=/root/.ce/.pixi/envs/depthanythingv3-nodes/bin/python [04:15] [ComfyUI] [SubprocessWorker] launching cmd=['/root/.pixi/bin/pixi', 'run', '--as-is', '--manifest-path', '/root/.ce/pixi.toml', '-e', 'depthanythingv3-nodes', 'python', '/tmp/comfyui_pvenv_910zmk0o/persistent_worker.py', 'abstract://comfy_worker_2bdc7eaae1d5']... [04:15] [ComfyUI] [SubprocessWorker] socket_addr=abstract://comfy_worker_2bdc7eaae1d5 (abstract, no filesystem path) [04:17] [ComfyUI] [worker:ComfyUI-DepthAnythingV3] ERROR: Failed to import comfy_kitchen, Error: No module named 'comfy_kitchen', fp8 and fp4 support will not be available. [04:17] [ComfyUI] [SubprocessWorker] worker started/confirmed [04:17] [ComfyUI] [SubprocessWorker] serializing kwargs to shm... [04:17] [ComfyUI] [SubprocessWorker] created 0 shm blocks [04:17] [ComfyUI] [SubprocessWorker] sending request via socket... [04:17] [ComfyUI] [SubprocessWorker] call_id=1 sending call_method [04:18] [ComfyUI] Warning: You are sending unauthenticated requests to the HF Hub. Please set a HF_TOKEN to enable higher rate limits and faster downloads. [04:18] [ComfyUI] [worker:ComfyUI-DepthAnythingV3] WARNING: Warning: You are sending unauthenticated requests to the HF Hub. Please set a HF_TOKEN to enable higher rate limits and faster downloads. [04:18] Frame 2 saved (frame_001.jpg, t=2.4s) [04:18] [capture-periodic] freeze=2ms shot=145ms unfreeze=4ms saved=True [04:18] [ComfyUI] [04:20] Frame 3 saved (frame_002.jpg, t=4.7s) [04:20] [capture-periodic] freeze=2ms shot=143ms unfreeze=5ms saved=True [04:21] [capture-loop] iter=50 t=5.8s state={'complete': False, 'error': None, 'executedCount': 0, 'wsState': 1} eval_ms=2 ram=3.7/31.3GB (12%) swap=0.5/32.0GB (2%) cpu=8% browser_rss=0.85GB [04:22] [ComfyUI] model.safetensors: 0%| | 0.00/1.64G [00:00 cpu: 2937 / 7703 MB [04:41] Capturing execution frames: advanced_3d.json [04:41] [ComfyUI] [ComfyUI-DepthAnythingV3] Health check: ping (timeout=5.0s)... [04:41] [ComfyUI] [ComfyUI-DepthAnythingV3] Health check: failed [04:41] [ComfyUI] [ComfyUI-DepthAnythingV3] Socket unhealthy, restarting worker... [04:41] [ComfyUI] [comfy-env] Invalidated 1 stale model patchers (will be cleaned up during next unload) [04:41] [ComfyUI] [ComfyUI-DepthAnythingV3] python: /root/.ce/.pixi/envs/depthanythingv3-nodes/bin/python [04:41] [ComfyUI] [ComfyUI-DepthAnythingV3] sys_path sent to worker: ['/workspaces/DepthAnythingV3-2204/ComfyUI', '/workspaces/DepthAnythingV3-2204/ComfyUI/custom_nodes/ComfyUI-DepthAnythingV3', '/root/.ce/.pixi/envs/depthanythingv3-nodes/lib/python3.12/site-packages', '/workspaces/DepthAnythingV3-2204/ComfyUI/custom_nodes/ComfyUI-DepthAnythingV3'] [04:41] [ComfyUI] [SubprocessWorker] is_pixi=True, python=/root/.ce/.pixi/envs/depthanythingv3-nodes/bin/python [04:41] [ComfyUI] [SubprocessWorker] launching cmd=['/root/.pixi/bin/pixi', 'run', '--as-is', '--manifest-path', '/root/.ce/pixi.toml', '-e', 'depthanythingv3-nodes', 'python', '/tmp/comfyui_pvenv_910zmk0o/persistent_worker.py', 'abstract://comfy_worker_878065959946']... [04:41] [ComfyUI] [SubprocessWorker] socket_addr=abstract://comfy_worker_878065959946 (abstract, no filesystem path) [04:43] [ComfyUI] [worker:ComfyUI-DepthAnythingV3] ERROR: Failed to import comfy_kitchen, Error: No module named 'comfy_kitchen', fp8 and fp4 support will not be available. [04:43] [ComfyUI] [SubprocessWorker] call_id=3 sending model_to_device [04:43] [ComfyUI] Model 'DepthAnything3Net_1' gone from worker (restarted?), treating as offloaded [04:43] [ComfyUI] [comfy-env] [VRAM] After offload 'DepthAnything3Net_1' (783 MB): 269 / 7703 MB [04:46] Frame 1 saved (frame_000.jpg, t=0.0s) [04:46] Validating workflow... [04:46] [ComfyUI] === /validate endpoint called === [04:46] [ComfyUI] Received JSON with keys: ['prompt'] [04:46] [ComfyUI] Prompt has 6 nodes [04:46] [ComfyUI] Node 2: LoadImage [04:46] [ComfyUI] Inputs: {"image": "kaffi.jpg"} [04:46] [ComfyUI] Node 3: DownloadAndLoadDepthAnythingV3Model [04:46] Queuing workflow for execution... [04:46] [ComfyUI] Inputs: {"model": "da3_large.safetensors", "precision": "auto", "attention": "auto"} [04:46] [ComfyUI] Node 21: DepthAnything_V3 [04:46] [ComfyUI] Inputs: {"normalization_mode": "Raw", "resize_method": "resize", "invert_depth": false, "keep_model_size": false, "da3_model": ["3", 0], "images": ["2", 0]} [04:46] [ComfyUI] Node 22: DA3_ToPointCloud [04:46] [ComfyUI] Inputs: {"confidence_threshold": 0.2, "downsample": 1, "allow_around_1": 1, "filter_outliers": false, "outlier_percentage": 5, "depth_raw": ["21", 0], "confidence": ["21", 1], "intrinsics": ["21", 6], "sky_ma [04:46] [ComfyUI] Node 23: DA3_SavePointCloud [04:46] [ComfyUI] Inputs: {"filename_prefix": "pointcloud", "pointcloud": ["22", 0]} [04:46] [ComfyUI] Node 25: DA3_PreviewPointCloud [04:46] [ComfyUI] Inputs: {"file_path": ["23", 0], "color_mode": "RGB", "preview_vtk": ""} [04:46] [ComfyUI] Generated prompt_id: 781c4c28-56db-4ee7-b556-fe80e92cdf54 [04:46] [ComfyUI] Calling execution.validate_prompt()... [04:46] [ComfyUI] Validation result: valid=True [04:46] [ComfyUI] === Validation PASSED === [04:46] [ComfyUI] got prompt [04:47] [ComfyUI] [comfy-env] Running DownloadAndLoadDepthAnythingV3Model: model: 'da3_large.safetensors', precision: 'auto', attention: 'auto' [04:47] [ComfyUI] [VRAM] Before DownloadAndLoadDepthAnythingV3Model: 269 / 7703 MB [04:47] [ComfyUI] [SubprocessWorker] call_method: nodes.load_model.DownloadAndLoadDepthAnythingV3Model.EXECUTE_NORMALIZED [04:47] [ComfyUI] [SubprocessWorker] acquired lock, ensuring started... [04:47] [ComfyUI] [ComfyUI-DepthAnythingV3] Health check: ping (timeout=5.0s)... [04:47] [ComfyUI] [ComfyUI-DepthAnythingV3] Health check: ok [04:47] [ComfyUI] [SubprocessWorker] worker started/confirmed [04:47] [ComfyUI] [SubprocessWorker] serializing kwargs to shm... [04:47] [ComfyUI] [SubprocessWorker] created 0 shm blocks [04:47] [ComfyUI] [SubprocessWorker] sending request via socket... [04:47] [ComfyUI] [SubprocessWorker] call_id=4 sending call_method [04:47] [ComfyUI] [SubprocessWorker] got response: ok [04:47] [ComfyUI] [comfy-env] [VRAM] Before offload 'DepthAnything3Net_1' (783 MB) -> cpu: 269 / 7703 MB [04:47] [ComfyUI] [ComfyUI-DepthAnythingV3] Health check: ping (timeout=5.0s)... [04:47] [ComfyUI] [ComfyUI-DepthAnythingV3] Health check: ok [04:47] [ComfyUI] [SubprocessWorker] call_id=5 sending model_to_device [04:47] [ComfyUI] Model 'DepthAnything3Net_1' gone from worker (restarted?), treating as offloaded [04:47] [ComfyUI] [comfy-env] [VRAM] After offload 'DepthAnything3Net_1' (783 MB): 269 / 7703 MB [04:47] [ComfyUI] [comfy-env] DownloadAndLoadDepthAnythingV3Model done (0.14s): result: NodeOutput [04:47] [ComfyUI] [VRAM] After DownloadAndLoadDepthAnythingV3Model: 269 / 7703 MB [04:47] [ComfyUI] [comfy-env] Running DepthAnything_V3: normalization_mode: 'Raw', resize_method: 'resize', invert_depth: False, keep_model_size: False, da3_model: dict, images: torch.float32 [1,533,800,3] cpu [04:47] [ComfyUI] [VRAM] Before DepthAnything_V3: 269 / 7703 MB [04:47] [ComfyUI] [SubprocessWorker] call_method: nodes.nodes_inference.DepthAnything_V3.EXECUTE_NORMALIZED [04:47] [ComfyUI] [SubprocessWorker] acquired lock, ensuring started... [04:47] [ComfyUI] [ComfyUI-DepthAnythingV3] Health check: ping (timeout=5.0s)... [04:47] [ComfyUI] [ComfyUI-DepthAnythingV3] Health check: ok [04:47] [ComfyUI] [SubprocessWorker] worker started/confirmed [04:47] [ComfyUI] [comfy-env] PRE-SERIALIZE 'images' shape: torch.Size([1, 533, 800, 3]) [04:47] [ComfyUI] [SubprocessWorker] serializing kwargs to shm... [04:47] [ComfyUI] [SubprocessWorker] created 0 shm blocks [04:47] [ComfyUI] [SubprocessWorker] sending request via socket... [04:47] [ComfyUI] [SubprocessWorker] call_id=6 sending call_method [04:47] [ComfyUI] [worker:ComfyUI-DepthAnythingV3] [comfy-env] _from_shm got dict with keys: ['__type__', 'strategy', 'parent_pid', 'fd', 'storage_size'] [04:47] [ComfyUI] [worker:ComfyUI-DepthAnythingV3] [comfy-env] DESERIALIZE TensorRef: tensor_size=[1, 533, 800, 3] [04:47] [ComfyUI] [worker:ComfyUI-DepthAnythingV3] [comfy-env] DESERIALIZED tensor shape: torch.Size([1, 533, 800, 3]) [04:47] [ComfyUI] [worker:ComfyUI-DepthAnythingV3] WARNING: No comfy kitchen, using old apply_rope functions. [04:48] [ComfyUI] [SubprocessWorker] callback 'request_vram_budget' from call_id=6 [04:48] [ComfyUI] [comfy-env] VRAM request: 0.82GB, free before eviction: 7.80GB [04:48] [ComfyUI] [comfy-env] VRAM after eviction: 7.80GB [04:48] [ComfyUI] [worker:ComfyUI-DepthAnythingV3] [VRAM] +210MB (now 210MB) reserved=224MB peak=210MB [04:49] Frame 2 saved (frame_001.jpg, t=2.3s) [04:49] [capture-periodic] freeze=2ms shot=140ms unfreeze=4ms saved=True [04:49] [ComfyUI] [SubprocessWorker] callback 'report_progress' from call_id=6 [04:49] [ComfyUI] [SubprocessWorker] got response: ok [04:49] [ComfyUI] [comfy-env] Created 1 model patchers: ['DepthAnything3Net_1'] [04:49] [ComfyUI] [comfy-env] DepthAnything_V3 done (2.85s): result: NodeOutput [04:49] [ComfyUI] [VRAM] After DepthAnything_V3: 2263 / 7703 MB [04:49] [ComfyUI] [VRAM] Loaded: SubprocessModel (783 MB) [04:49] [ComfyUI] [comfy-env] Running DA3_ToPointCloud: confidence_threshold: 0.2, downsample: 1, allow_around_1: True, filter_outliers: False, outlier_percentage: 5.0, depth_raw: torch.float32 [1,532,800,3] cpu, confidence: torch.float32 [1,532,800,3] cpu, intrinsics: '{\n "intrinsics": [\n {\n "image_0": [\n ..., sky_mask: torch.float32 [1,532,800] cpu, source_image: torch.float32 [1,532,800,3] cpu [04:49] [ComfyUI] [VRAM] Before DA3_ToPointCloud: 2263 / 7703 MB [04:49] [ComfyUI] [VRAM] Loaded: SubprocessModel (783 MB) [04:49] [ComfyUI] [SubprocessWorker] call_method: nodes.nodes_3d.DA3_ToPointCloud.EXECUTE_NORMALIZED [04:49] [ComfyUI] [SubprocessWorker] acquired lock, ensuring started... [04:49] [ComfyUI] [ComfyUI-DepthAnythingV3] Health check: ping (timeout=5.0s)... [04:49] [ComfyUI] [ComfyUI-DepthAnythingV3] Health check: failed [04:49] [ComfyUI] [ComfyUI-DepthAnythingV3] python: /root/.ce/.pixi/envs/depthanythingv3-nodes/bin/python [04:49] [ComfyUI] [ComfyUI-DepthAnythingV3] Socket unhealthy, restarting worker... [04:49] [ComfyUI] [ComfyUI-DepthAnythingV3] sys_path sent to worker: ['/workspaces/DepthAnythingV3-2204/ComfyUI', '/workspaces/DepthAnythingV3-2204/ComfyUI/custom_nodes/ComfyUI-DepthAnythingV3', '/root/.ce/.pixi/envs/depthanythingv3-nodes/lib/python3.12/site-packages', '/workspaces/DepthAnythingV3-2204/ComfyUI/custom_nodes/ComfyUI-DepthAnythingV3'] [04:49] [ComfyUI] [comfy-env] Invalidated 1 stale model patchers (will be cleaned up during next unload) [04:49] [ComfyUI] [SubprocessWorker] is_pixi=True, python=/root/.ce/.pixi/envs/depthanythingv3-nodes/bin/python [04:49] [ComfyUI] [SubprocessWorker] launching cmd=['/root/.pixi/bin/pixi', 'run', '--as-is', '--manifest-path', '/root/.ce/pixi.toml', '-e', 'depthanythingv3-nodes', 'python', '/tmp/comfyui_pvenv_910zmk0o/persistent_worker.py', 'abstract://comfy_worker_51535a44fd9a']... [04:49] [ComfyUI] [SubprocessWorker] socket_addr=abstract://comfy_worker_51535a44fd9a (abstract, no filesystem path) [04:51] [ComfyUI] [worker:ComfyUI-DepthAnythingV3] ERROR: Failed to import comfy_kitchen, Error: No module named 'comfy_kitchen', fp8 and fp4 support will not be available. [04:51] Frame 3 saved (frame_002.jpg, t=4.6s) [04:51] [capture-periodic] freeze=1ms shot=130ms unfreeze=5ms saved=True [04:51] [ComfyUI] [SubprocessWorker] worker started/confirmed [04:51] [ComfyUI] [comfy-env] PRE-SERIALIZE 'depth_raw' shape: torch.Size([1, 532, 800, 3]) [04:51] [ComfyUI] [comfy-env] PRE-SERIALIZE 'confidence' shape: torch.Size([1, 532, 800, 3]) [04:51] [ComfyUI] [comfy-env] PRE-SERIALIZE 'sky_mask' shape: torch.Size([1, 532, 800]) [04:51] [ComfyUI] [comfy-env] PRE-SERIALIZE 'source_image' shape: torch.Size([1, 532, 800, 3]) [04:51] [ComfyUI] [SubprocessWorker] serializing kwargs to shm... [04:51] [ComfyUI] [SubprocessWorker] created 0 shm blocks [04:51] [ComfyUI] [SubprocessWorker] sending request via socket... [04:51] [ComfyUI] [SubprocessWorker] call_id=7 sending call_method [04:51] [ComfyUI] [worker:ComfyUI-DepthAnythingV3] [comfy-env] _from_shm got dict with keys: ['__type__', 'strategy', 'parent_pid', 'fd', 'storage_size'] [04:51] [ComfyUI] [worker:ComfyUI-DepthAnythingV3] [comfy-env] DESERIALIZE TensorRef: tensor_size=[1, 532, 800, 3] [04:51] [ComfyUI] [worker:ComfyUI-DepthAnythingV3] [comfy-env] DESERIALIZED tensor shape: torch.Size([1, 532, 800, 3]) [04:51] [ComfyUI] [worker:ComfyUI-DepthAnythingV3] [comfy-env] _from_shm got dict with keys: ['__type__', 'strategy', 'parent_pid', 'fd', 'storage_size'] [04:51] [ComfyUI] [worker:ComfyUI-DepthAnythingV3] [comfy-env] DESERIALIZE TensorRef: tensor_size=[1, 532, 800, 3] [04:51] [ComfyUI] [worker:ComfyUI-DepthAnythingV3] [comfy-env] DESERIALIZED tensor shape: torch.Size([1, 532, 800, 3]) [04:51] [ComfyUI] [worker:ComfyUI-DepthAnythingV3] [comfy-env] _from_shm got dict with keys: ['__type__', 'strategy', 'parent_pid', 'fd', 'storage_size'] [04:51] [ComfyUI] [worker:ComfyUI-DepthAnythingV3] [comfy-env] DESERIALIZE TensorRef: tensor_size=[1, 532, 800] [04:51] [ComfyUI] [worker:ComfyUI-DepthAnythingV3] [comfy-env] DESERIALIZED tensor shape: torch.Size([1, 532, 800]) [04:51] [ComfyUI] [worker:ComfyUI-DepthAnythingV3] [comfy-env] _from_shm got dict with keys: ['__type__', 'strategy', 'parent_pid', 'fd', 'storage_size'] [04:51] [ComfyUI] [worker:ComfyUI-DepthAnythingV3] [comfy-env] DESERIALIZE TensorRef: tensor_size=[1, 532, 800, 3] [04:51] [ComfyUI] [worker:ComfyUI-DepthAnythingV3] [comfy-env] DESERIALIZED tensor shape: torch.Size([1, 532, 800, 3]) [04:51] [ComfyUI] [SubprocessWorker] got response: ok [04:51] [ComfyUI] [comfy-env] [VRAM] Before offload 'DepthAnything3Net_1' (783 MB) -> cpu: 269 / 7703 MB [04:51] [ComfyUI] [ComfyUI-DepthAnythingV3] Health check: ping (timeout=5.0s)... [04:51] [ComfyUI] [ComfyUI-DepthAnythingV3] Health check: ok [04:51] [ComfyUI] [SubprocessWorker] call_id=8 sending model_to_device [04:51] [ComfyUI] Model 'DepthAnything3Net_1' gone from worker (restarted?), treating as offloaded [04:51] [ComfyUI] [comfy-env] [VRAM] After offload 'DepthAnything3Net_1' (783 MB): 269 / 7703 MB [04:51] [ComfyUI] [comfy-env] DA3_ToPointCloud done (1.77s): result: NodeOutput [04:51] [ComfyUI] [VRAM] After DA3_ToPointCloud: 269 / 7703 MB [04:51] [ComfyUI] [comfy-env] Running DA3_SavePointCloud: filename_prefix: 'pointcloud', pointcloud: list[1] [04:51] [ComfyUI] [VRAM] Before DA3_SavePointCloud: 269 / 7703 MB [04:51] [ComfyUI] [SubprocessWorker] call_method: nodes.nodes_3d.DA3_SavePointCloud.EXECUTE_NORMALIZED [04:51] [ComfyUI] [SubprocessWorker] acquired lock, ensuring started... [04:51] [ComfyUI] [ComfyUI-DepthAnythingV3] Health check: ping (timeout=5.0s)... [04:51] [ComfyUI] [ComfyUI-DepthAnythingV3] Health check: ok [04:51] [ComfyUI] [SubprocessWorker] worker started/confirmed [04:51] [ComfyUI] [SubprocessWorker] serializing kwargs to shm... [04:51] [ComfyUI] [SubprocessWorker] created 0 shm blocks [04:51] [ComfyUI] [SubprocessWorker] sending request via socket... [04:51] [ComfyUI] [SubprocessWorker] call_id=9 sending call_method [04:51] [ComfyUI] [worker:ComfyUI-DepthAnythingV3] [comfy-env] _from_shm got dict with keys: ['__type__', 'strategy', 'parent_pid', 'fd', 'storage_size'] [04:51] [ComfyUI] [worker:ComfyUI-DepthAnythingV3] [comfy-env] DESERIALIZE TensorRef: tensor_size=[311395, 3] [04:51] [ComfyUI] [worker:ComfyUI-DepthAnythingV3] [comfy-env] DESERIALIZED tensor shape: torch.Size([311395, 3]) [04:51] [ComfyUI] [worker:ComfyUI-DepthAnythingV3] [comfy-env] _from_shm got dict with keys: ['__type__', 'strategy', 'parent_pid', 'fd', 'storage_size'] [04:51] [ComfyUI] [worker:ComfyUI-DepthAnythingV3] [comfy-env] DESERIALIZE TensorRef: tensor_size=[311395] [04:51] [ComfyUI] [worker:ComfyUI-DepthAnythingV3] [comfy-env] DESERIALIZED tensor shape: torch.Size([311395]) [04:51] [ComfyUI] [worker:ComfyUI-DepthAnythingV3] [comfy-env] _from_shm got dict with keys: ['__type__', 'strategy', 'parent_pid', 'fd', 'storage_size'] [04:51] [ComfyUI] [worker:ComfyUI-DepthAnythingV3] [comfy-env] DESERIALIZE TensorRef: tensor_size=[311395, 3] [04:51] [ComfyUI] [worker:ComfyUI-DepthAnythingV3] [comfy-env] DESERIALIZED tensor shape: torch.Size([311395, 3]) [04:52] [capture-loop] iter=50 t=5.7s state={'complete': False, 'error': None, 'executedCount': 0, 'wsState': 1} eval_ms=2 ram=3.5/31.3GB (11%) swap=0.5/32.0GB (2%) cpu=13% browser_rss=0.92GB [04:53] Frame 4 saved (frame_003.jpg, t=6.8s) [04:53] [capture-periodic] freeze=2ms shot=141ms unfreeze=5ms saved=True [04:54] [ComfyUI] [SubprocessWorker] got response: ok [04:54] [ComfyUI] [comfy-env] DA3_SavePointCloud done (2.25s): result: NodeOutput [04:54] [ComfyUI] [VRAM] After DA3_SavePointCloud: 269 / 7703 MB [04:54] [ComfyUI] [comfy-env] Running DA3_PreviewPointCloud: file_path: '/workspaces/DepthAnythingV3-2204/ComfyUI/output/pointclo..., color_mode: 'RGB' [04:54] [ComfyUI] [VRAM] Before DA3_PreviewPointCloud: 269 / 7703 MB [04:54] [ComfyUI] [SubprocessWorker] call_method: nodes.preview_nodes.DA3_PreviewPointCloud.EXECUTE_NORMALIZED [04:54] [ComfyUI] [SubprocessWorker] acquired lock, ensuring started... [04:54] [ComfyUI] [ComfyUI-DepthAnythingV3] Health check: ping (timeout=5.0s)... [04:54] [ComfyUI] [ComfyUI-DepthAnythingV3] Health check: ok [04:54] [ComfyUI] [SubprocessWorker] worker started/confirmed [04:54] [ComfyUI] [SubprocessWorker] serializing kwargs to shm... [04:54] [ComfyUI] [SubprocessWorker] created 0 shm blocks [04:54] [ComfyUI] [SubprocessWorker] sending request via socket... [04:54] [ComfyUI] [SubprocessWorker] call_id=10 sending call_method [04:54] [ComfyUI] [SubprocessWorker] got response: ok [04:54] [ComfyUI] [comfy-env] DA3_PreviewPointCloud done (0.01s): result: NodeOutput [04:54] [ComfyUI] [VRAM] After DA3_PreviewPointCloud: 269 / 7703 MB [04:54] [ComfyUI] Prompt executed in 7.04 seconds [04:54] Node executed (2 total), capturing... [04:54] Frame 5 saved (frame_004.jpg, t=7.4s) [04:54] [capture-node] freeze=2ms shot=160ms unfreeze=0ms saved=True [04:54] Execution complete (t=7.4s) [04:55] Captured 5 unique frames over 8.74s [04:55] [debug] iframes: 1 [04:55] [debug] iframe[0]: src=http://127.0.0.1:41890/extensions/ComfyUI-DepthAnythingV3/viewer_vtk.html?v=1778, canvas=486x394, rafFrozen=True [04:55] [timing] trigger_3d_previews: 0.0s [04:57] Saved high-quality screenshot: advanced_3d_executed.png [04:57] [timing] final_screenshot: 0.3s [04:58] Capturing execution frames: advanced_3d_multiview.json [05:03] Frame 1 saved (frame_000.jpg, t=0.0s) [05:03] Validating workflow... [05:03] [ComfyUI] === /validate endpoint called === [05:03] [ComfyUI] Received JSON with keys: ['prompt'] [05:03] [ComfyUI] Prompt has 8 nodes [05:03] [ComfyUI] Node 3: DownloadAndLoadDepthAnythingV3Model [05:03] [ComfyUI] Inputs: {"model": "da3_large.safetensors", "precision": "auto", "attention": "auto"} [05:03] [ComfyUI] Node 21: LoadImageDataSetFromFolder [05:03] [ComfyUI] Inputs: {"folder": "SOH"} [05:03] Queuing workflow for execution... [05:03] [ComfyUI] Node 27: PreviewImage [05:03] [ComfyUI] Inputs: {"images": ["21", 0]} [05:03] [ComfyUI] Node 38: DA3_MultiViewPointCloud [05:03] [ComfyUI] Inputs: {"extrinsics": ["39", 4], "intrinsics": ["39", 5], "confidence_threshold": 0.3, "downsample": 4, "use_icp": false, "allow_around_1": false, "filter_outliers": true, "outlier_percentage": 5, "depths": [05:03] [ComfyUI] Node 39: DepthAnythingV3_MultiView [05:03] [ComfyUI] Inputs: {"normalization_mode": "Raw", "resize_method": "resize", "invert_depth": false, "keep_model_size": false, "da3_model": ["3", 0], "images": ["21", 0]} [05:03] [ComfyUI] Node 44: DA3_SavePointCloud [05:03] [ComfyUI] Inputs: {"filename_prefix": "pointcloud", "pointcloud": ["38", 0]} [05:03] [ComfyUI] Node 45: PreviewAny [05:03] [ComfyUI] Inputs: {"source": ["44", 0]} [05:03] [ComfyUI] Node 48: DA3_PreviewPointCloud [05:03] [ComfyUI] Inputs: {"file_path": ["44", 0], "color_mode": "RGB", "preview_vtk": ""} [05:03] [ComfyUI] Generated prompt_id: 76502cf5-8133-4ac8-9aee-35eef848cf57 [05:03] [ComfyUI] Calling execution.validate_prompt()... [05:03] [ComfyUI] Validation result: valid=True [05:03] [ComfyUI] === Validation PASSED === [05:03] [ComfyUI] got prompt [05:03] [ComfyUI] [comfy-env] Running DownloadAndLoadDepthAnythingV3Model: model: 'da3_large.safetensors', precision: 'auto', attention: 'auto' [05:03] [ComfyUI] [VRAM] Before DownloadAndLoadDepthAnythingV3Model: 269 / 7703 MB [05:03] [ComfyUI] [SubprocessWorker] call_method: nodes.load_model.DownloadAndLoadDepthAnythingV3Model.EXECUTE_NORMALIZED [05:03] [ComfyUI] [SubprocessWorker] acquired lock, ensuring started... [05:03] [ComfyUI] [ComfyUI-DepthAnythingV3] Health check: ping (timeout=5.0s)... [05:03] Node executed (1 total), capturing... [05:03] [ComfyUI] [ComfyUI-DepthAnythingV3] Health check: ok [05:03] [ComfyUI] [SubprocessWorker] worker started/confirmed [05:03] [ComfyUI] [SubprocessWorker] serializing kwargs to shm... [05:03] [ComfyUI] [SubprocessWorker] created 0 shm blocks [05:03] [ComfyUI] [SubprocessWorker] sending request via socket... [05:03] [ComfyUI] [SubprocessWorker] call_id=11 sending call_method [05:03] [ComfyUI] [SubprocessWorker] got response: ok [05:03] [ComfyUI] [comfy-env] DownloadAndLoadDepthAnythingV3Model done (0.03s): result: NodeOutput [05:03] [ComfyUI] [VRAM] After DownloadAndLoadDepthAnythingV3Model: 269 / 7703 MB [05:03] [ComfyUI] [comfy-env] Running DepthAnythingV3_MultiView: normalization_mode: 'Raw', resize_method: 'resize', invert_depth: False, keep_model_size: False, da3_model: dict, images: torch.float32 [1,680,1208,3] cpu [05:03] [ComfyUI] [VRAM] Before DepthAnythingV3_MultiView: 269 / 7703 MB [05:03] [ComfyUI] [SubprocessWorker] call_method: nodes.nodes_multiview.DepthAnythingV3_MultiView.EXECUTE_NORMALIZED [05:03] [ComfyUI] [SubprocessWorker] acquired lock, ensuring started... [05:03] [ComfyUI] [ComfyUI-DepthAnythingV3] Health check: ping (timeout=5.0s)... [05:03] [ComfyUI] [ComfyUI-DepthAnythingV3] Health check: ok [05:03] [ComfyUI] [SubprocessWorker] worker started/confirmed [05:03] [ComfyUI] [comfy-env] PRE-SERIALIZE 'images' shape: torch.Size([1, 680, 1208, 3]) [05:03] [ComfyUI] [SubprocessWorker] serializing kwargs to shm... [05:03] [ComfyUI] [SubprocessWorker] created 0 shm blocks [05:03] [ComfyUI] [SubprocessWorker] sending request via socket... [05:03] [ComfyUI] [SubprocessWorker] call_id=12 sending call_method [05:03] [ComfyUI] [worker:ComfyUI-DepthAnythingV3] [comfy-env] _from_shm got dict with keys: ['__type__', 'strategy', 'parent_pid', 'fd', 'storage_size'] [05:03] [ComfyUI] [worker:ComfyUI-DepthAnythingV3] [comfy-env] DESERIALIZE TensorRef: tensor_size=[1, 680, 1208, 3] [05:03] [ComfyUI] [worker:ComfyUI-DepthAnythingV3] [comfy-env] DESERIALIZED tensor shape: torch.Size([1, 680, 1208, 3]) [05:03] [ComfyUI] [worker:ComfyUI-DepthAnythingV3] WARNING: No comfy kitchen, using old apply_rope functions. [05:03] Frame 2 saved (frame_001.jpg, t=0.5s) [05:03] [capture-node] freeze=2ms shot=124ms unfreeze=1ms saved=True [05:05] [ComfyUI] [SubprocessWorker] callback 'request_vram_budget' from call_id=12 [05:05] [ComfyUI] [comfy-env] VRAM request: 0.82GB, free before eviction: 7.80GB [05:05] [ComfyUI] [comfy-env] VRAM after eviction: 7.80GB [05:05] [ComfyUI] [worker:ComfyUI-DepthAnythingV3] [VRAM] +210MB (now 210MB) reserved=224MB peak=210MB [05:06] [ComfyUI] [worker:ComfyUI-DepthAnythingV3] [VRAM] +733MB (now 943MB) reserved=2848MB peak=1240MB [05:06] [ComfyUI] [SubprocessWorker] got response: ok [05:06] [ComfyUI] [comfy-env] Created 1 model patchers: ['DepthAnything3Net_1'] [05:06] [ComfyUI] [comfy-env] DepthAnythingV3_MultiView done (3.11s): result: NodeOutput [05:06] [ComfyUI] [VRAM] After DepthAnythingV3_MultiView: 3223 / 7703 MB [05:06] [ComfyUI] [VRAM] Loaded: SubprocessModel (783 MB) [05:06] [ComfyUI] [comfy-env] Running DepthAnythingV3_MultiView: normalization_mode: 'Raw', resize_method: 'resize', invert_depth: False, keep_model_size: False, da3_model: dict, images: torch.float32 [1,680,1208,3] cpu [05:06] [ComfyUI] [VRAM] Before DepthAnythingV3_MultiView: 3223 / 7703 MB [05:06] [ComfyUI] [VRAM] Loaded: SubprocessModel (783 MB) [05:06] [ComfyUI] [SubprocessWorker] call_method: nodes.nodes_multiview.DepthAnythingV3_MultiView.EXECUTE_NORMALIZED [05:06] [ComfyUI] [SubprocessWorker] acquired lock, ensuring started... [05:06] [ComfyUI] [ComfyUI-DepthAnythingV3] Health check: ping (timeout=5.0s)... [05:06] [ComfyUI] [ComfyUI-DepthAnythingV3] Health check: ok [05:06] [ComfyUI] [SubprocessWorker] worker started/confirmed [05:06] [ComfyUI] [comfy-env] PRE-SERIALIZE 'images' shape: torch.Size([1, 680, 1208, 3]) [05:06] [ComfyUI] [SubprocessWorker] serializing kwargs to shm... [05:06] [ComfyUI] [SubprocessWorker] created 0 shm blocks [05:06] [ComfyUI] [SubprocessWorker] sending request via socket... [05:06] [ComfyUI] [SubprocessWorker] call_id=13 sending call_method [05:06] [ComfyUI] [worker:ComfyUI-DepthAnythingV3] [comfy-env] _from_shm got dict with keys: ['__type__', 'strategy', 'parent_pid', 'fd', 'storage_size'] [05:06] [ComfyUI] [worker:ComfyUI-DepthAnythingV3] [comfy-env] DESERIALIZE TensorRef: tensor_size=[1, 680, 1208, 3] [05:06] [ComfyUI] [worker:ComfyUI-DepthAnythingV3] [comfy-env] DESERIALIZED tensor shape: torch.Size([1, 680, 1208, 3]) [05:06] [ComfyUI] [SubprocessWorker] callback 'request_vram_budget' from call_id=13 [05:06] [ComfyUI] [comfy-env] VRAM request: 0.82GB, free before eviction: 4.70GB [05:06] [ComfyUI] [comfy-env] VRAM after eviction: 4.70GB [05:07] [ComfyUI] [SubprocessWorker] got response: ok [05:07] [ComfyUI] [comfy-env] DepthAnythingV3_MultiView done (0.51s): result: NodeOutput [05:07] [ComfyUI] [VRAM] After DepthAnythingV3_MultiView: 3191 / 7703 MB [05:07] [ComfyUI] [VRAM] Loaded: SubprocessModel (783 MB) [05:07] [ComfyUI] [comfy-env] Running DA3_MultiViewPointCloud: extrinsics: '{\n "extrinsics": [\n {\n "image_0": [\n ..., intrinsics: '{\n "intrinsics": [\n {\n "image_0": [\n ..., confidence_threshold: 0.3, downsample: 4, use_icp: False, allow_around_1: False, filter_outliers: True, outlier_percentage: 5.0, depths: torch.float32 [1,680,1208,3] cpu, images: torch.float32 [1,680,1208,3] cpu, confidence: torch.float32 [1,680,1208,3] cpu, sky_mask: torch.float32 [1,680,1208] cpu [05:07] [ComfyUI] [VRAM] Before DA3_MultiViewPointCloud: 3191 / 7703 MB [05:07] [ComfyUI] [VRAM] Loaded: SubprocessModel (783 MB) [05:07] [ComfyUI] [SubprocessWorker] call_method: nodes.nodes_multiview.DA3_MultiViewPointCloud.EXECUTE_NORMALIZED [05:07] [ComfyUI] [SubprocessWorker] acquired lock, ensuring started... [05:07] [ComfyUI] [ComfyUI-DepthAnythingV3] Health check: ping (timeout=5.0s)... [05:07] [ComfyUI] [ComfyUI-DepthAnythingV3] Health check: ok [05:07] [ComfyUI] [SubprocessWorker] worker started/confirmed [05:07] [ComfyUI] [comfy-env] PRE-SERIALIZE 'depths' shape: torch.Size([1, 680, 1208, 3]) [05:07] [ComfyUI] [comfy-env] PRE-SERIALIZE 'images' shape: torch.Size([1, 680, 1208, 3]) [05:07] [ComfyUI] [comfy-env] PRE-SERIALIZE 'confidence' shape: torch.Size([1, 680, 1208, 3]) [05:07] [ComfyUI] [comfy-env] PRE-SERIALIZE 'sky_mask' shape: torch.Size([1, 680, 1208]) [05:07] [ComfyUI] [SubprocessWorker] serializing kwargs to shm... [05:07] [ComfyUI] [SubprocessWorker] created 0 shm blocks [05:07] [ComfyUI] [SubprocessWorker] sending request via socket... [05:07] [ComfyUI] [SubprocessWorker] call_id=14 sending call_method [05:07] [ComfyUI] [worker:ComfyUI-DepthAnythingV3] [comfy-env] _from_shm got dict with keys: ['__type__', 'strategy', 'parent_pid', 'fd', 'storage_size'] [05:07] [ComfyUI] [worker:ComfyUI-DepthAnythingV3] [comfy-env] DESERIALIZE TensorRef: tensor_size=[1, 680, 1208, 3] [05:07] [ComfyUI] [worker:ComfyUI-DepthAnythingV3] [comfy-env] DESERIALIZED tensor shape: torch.Size([1, 680, 1208, 3]) [05:07] [ComfyUI] [worker:ComfyUI-DepthAnythingV3] [comfy-env] _from_shm got dict with keys: ['__type__', 'strategy', 'parent_pid', 'fd', 'storage_size'] [05:07] [ComfyUI] [worker:ComfyUI-DepthAnythingV3] [comfy-env] DESERIALIZE TensorRef: tensor_size=[1, 680, 1208, 3] [05:07] [ComfyUI] [worker:ComfyUI-DepthAnythingV3] [comfy-env] DESERIALIZED tensor shape: torch.Size([1, 680, 1208, 3]) [05:07] [ComfyUI] [worker:ComfyUI-DepthAnythingV3] [comfy-env] _from_shm got dict with keys: ['__type__', 'strategy', 'parent_pid', 'fd', 'storage_size'] [05:07] [ComfyUI] [worker:ComfyUI-DepthAnythingV3] [comfy-env] DESERIALIZE TensorRef: tensor_size=[1, 680, 1208, 3] [05:07] [ComfyUI] [worker:ComfyUI-DepthAnythingV3] [comfy-env] DESERIALIZED tensor shape: torch.Size([1, 680, 1208, 3]) [05:07] [ComfyUI] [worker:ComfyUI-DepthAnythingV3] [comfy-env] _from_shm got dict with keys: ['__type__', 'strategy', 'parent_pid', 'fd', 'storage_size'] [05:07] [ComfyUI] [worker:ComfyUI-DepthAnythingV3] [comfy-env] DESERIALIZE TensorRef: tensor_size=[1, 680, 1208] [05:07] [ComfyUI] [worker:ComfyUI-DepthAnythingV3] [comfy-env] DESERIALIZED tensor shape: torch.Size([1, 680, 1208]) [05:07] [ComfyUI] [SubprocessWorker] callback 'report_progress' from call_id=14 [05:07] [ComfyUI] [SubprocessWorker] got response: ok [05:07] [ComfyUI] [comfy-env] DA3_MultiViewPointCloud done (0.08s): result: NodeOutput [05:07] [ComfyUI] [VRAM] After DA3_MultiViewPointCloud: 3191 / 7703 MB [05:07] [ComfyUI] [VRAM] Loaded: SubprocessModel (783 MB) [05:07] [ComfyUI] [comfy-env] Running DA3_MultiViewPointCloud: extrinsics: '{\n "extrinsics": [\n {\n "image_0": [\n ..., intrinsics: '{\n "intrinsics": [\n {\n "image_0": [\n ..., confidence_threshold: 0.3, downsample: 4, use_icp: False, allow_around_1: False, filter_outliers: True, outlier_percentage: 5.0, depths: torch.float32 [1,680,1208,3] cpu, images: torch.float32 [1,680,1208,3] cpu, confidence: torch.float32 [1,680,1208,3] cpu, sky_mask: torch.float32 [1,680,1208] cpu [05:07] [ComfyUI] [VRAM] Before DA3_MultiViewPointCloud: 3191 / 7703 MB [05:07] [ComfyUI] [VRAM] Loaded: SubprocessModel (783 MB) [05:07] [ComfyUI] [SubprocessWorker] call_method: nodes.nodes_multiview.DA3_MultiViewPointCloud.EXECUTE_NORMALIZED [05:07] [ComfyUI] [SubprocessWorker] acquired lock, ensuring started... [05:07] [ComfyUI] [ComfyUI-DepthAnythingV3] Health check: ping (timeout=5.0s)... [05:07] [ComfyUI] [ComfyUI-DepthAnythingV3] Health check: ok [05:07] [ComfyUI] [SubprocessWorker] worker started/confirmed [05:07] [ComfyUI] [comfy-env] PRE-SERIALIZE 'depths' shape: torch.Size([1, 680, 1208, 3]) [05:07] [ComfyUI] [comfy-env] PRE-SERIALIZE 'images' shape: torch.Size([1, 680, 1208, 3]) [05:07] [ComfyUI] [comfy-env] PRE-SERIALIZE 'confidence' shape: torch.Size([1, 680, 1208, 3]) [05:07] [ComfyUI] [comfy-env] PRE-SERIALIZE 'sky_mask' shape: torch.Size([1, 680, 1208]) [05:07] [ComfyUI] [SubprocessWorker] serializing kwargs to shm... [05:07] [ComfyUI] [SubprocessWorker] created 0 shm blocks [05:07] [ComfyUI] [SubprocessWorker] sending request via socket... [05:07] [ComfyUI] [SubprocessWorker] call_id=15 sending call_method [05:07] [ComfyUI] [worker:ComfyUI-DepthAnythingV3] [comfy-env] _from_shm got dict with keys: ['__type__', 'strategy', 'parent_pid', 'fd', 'storage_size'] [05:07] [ComfyUI] [worker:ComfyUI-DepthAnythingV3] [comfy-env] DESERIALIZE TensorRef: tensor_size=[1, 680, 1208, 3] [05:07] [ComfyUI] [worker:ComfyUI-DepthAnythingV3] [comfy-env] DESERIALIZED tensor shape: torch.Size([1, 680, 1208, 3]) [05:07] [ComfyUI] [worker:ComfyUI-DepthAnythingV3] [comfy-env] _from_shm got dict with keys: ['__type__', 'strategy', 'parent_pid', 'fd', 'storage_size'] [05:07] [ComfyUI] [worker:ComfyUI-DepthAnythingV3] [comfy-env] DESERIALIZE TensorRef: tensor_size=[1, 680, 1208, 3] [05:07] [ComfyUI] [worker:ComfyUI-DepthAnythingV3] [comfy-env] DESERIALIZED tensor shape: torch.Size([1, 680, 1208, 3]) [05:07] [ComfyUI] [worker:ComfyUI-DepthAnythingV3] [comfy-env] _from_shm got dict with keys: ['__type__', 'strategy', 'parent_pid', 'fd', 'storage_size'] [05:07] [ComfyUI] [worker:ComfyUI-DepthAnythingV3] [comfy-env] DESERIALIZE TensorRef: tensor_size=[1, 680, 1208, 3] [05:07] [ComfyUI] [worker:ComfyUI-DepthAnythingV3] [comfy-env] DESERIALIZED tensor shape: torch.Size([1, 680, 1208, 3]) [05:07] [ComfyUI] [worker:ComfyUI-DepthAnythingV3] [comfy-env] _from_shm got dict with keys: ['__type__', 'strategy', 'parent_pid', 'fd', 'storage_size'] [05:07] [ComfyUI] [worker:ComfyUI-DepthAnythingV3] [comfy-env] DESERIALIZE TensorRef: tensor_size=[1, 680, 1208] [05:07] [ComfyUI] [worker:ComfyUI-DepthAnythingV3] [comfy-env] DESERIALIZED tensor shape: torch.Size([1, 680, 1208]) [05:07] [ComfyUI] [SubprocessWorker] callback 'report_progress' from call_id=15 [05:07] [ComfyUI] [SubprocessWorker] got response: ok [05:07] [ComfyUI] [comfy-env] DA3_MultiViewPointCloud done (0.07s): result: NodeOutput [05:07] [ComfyUI] [VRAM] After DA3_MultiViewPointCloud: 3191 / 7703 MB [05:07] [ComfyUI] [VRAM] Loaded: SubprocessModel (783 MB) [05:07] [ComfyUI] [comfy-env] Running DA3_SavePointCloud: filename_prefix: 'pointcloud', pointcloud: list[1] [05:07] [ComfyUI] [VRAM] Before DA3_SavePointCloud: 3191 / 7703 MB [05:07] [ComfyUI] [VRAM] Loaded: SubprocessModel (783 MB) [05:07] [ComfyUI] [SubprocessWorker] call_method: nodes.nodes_3d.DA3_SavePointCloud.EXECUTE_NORMALIZED [05:07] [ComfyUI] [SubprocessWorker] acquired lock, ensuring started... [05:07] [ComfyUI] [ComfyUI-DepthAnythingV3] Health check: ping (timeout=5.0s)... [05:07] [ComfyUI] [ComfyUI-DepthAnythingV3] Health check: ok [05:07] [ComfyUI] [SubprocessWorker] worker started/confirmed [05:07] [ComfyUI] [SubprocessWorker] serializing kwargs to shm... [05:07] [ComfyUI] [SubprocessWorker] created 0 shm blocks [05:07] [ComfyUI] [SubprocessWorker] sending request via socket... [05:07] [ComfyUI] [SubprocessWorker] call_id=16 sending call_method [05:07] [ComfyUI] [worker:ComfyUI-DepthAnythingV3] [comfy-env] _from_shm got dict with keys: ['__type__', 'strategy', 'parent_pid', 'fd', 'storage_size'] [05:07] [ComfyUI] [worker:ComfyUI-DepthAnythingV3] [comfy-env] DESERIALIZE TensorRef: tensor_size=[18819, 3] [05:07] [ComfyUI] [worker:ComfyUI-DepthAnythingV3] [comfy-env] DESERIALIZED tensor shape: torch.Size([18819, 3]) [05:07] [ComfyUI] [worker:ComfyUI-DepthAnythingV3] [comfy-env] _from_shm got dict with keys: ['__type__', 'strategy', 'parent_pid', 'fd', 'storage_size'] [05:07] [ComfyUI] [worker:ComfyUI-DepthAnythingV3] [comfy-env] DESERIALIZE TensorRef: tensor_size=[18819, 3] [05:07] [ComfyUI] [worker:ComfyUI-DepthAnythingV3] [comfy-env] DESERIALIZED tensor shape: torch.Size([18819, 3]) [05:07] [ComfyUI] [worker:ComfyUI-DepthAnythingV3] [comfy-env] _from_shm got dict with keys: ['__type__', 'strategy', 'parent_pid', 'fd', 'storage_size'] [05:07] [ComfyUI] [worker:ComfyUI-DepthAnythingV3] [comfy-env] DESERIALIZE TensorRef: tensor_size=[18819] [05:07] [ComfyUI] [worker:ComfyUI-DepthAnythingV3] [comfy-env] DESERIALIZED tensor shape: torch.Size([18819]) [05:07] [ComfyUI] [worker:ComfyUI-DepthAnythingV3] [comfy-env] _from_shm got dict with keys: ['__type__', 'strategy', 'parent_pid', 'fd', 'storage_size'] [05:07] [ComfyUI] [worker:ComfyUI-DepthAnythingV3] [comfy-env] DESERIALIZE TensorRef: tensor_size=[18819] [05:07] [ComfyUI] [worker:ComfyUI-DepthAnythingV3] [comfy-env] DESERIALIZED tensor shape: torch.Size([18819]) [05:07] [ComfyUI] [SubprocessWorker] got response: ok [05:07] [ComfyUI] [comfy-env] DA3_SavePointCloud done (0.18s): result: NodeOutput [05:07] [ComfyUI] [VRAM] After DA3_SavePointCloud: 3191 / 7703 MB [05:07] [ComfyUI] [VRAM] Loaded: SubprocessModel (783 MB) [05:07] [ComfyUI] [comfy-env] Running DA3_SavePointCloud: filename_prefix: 'pointcloud', pointcloud: list[1] [05:07] [ComfyUI] [VRAM] Before DA3_SavePointCloud: 3191 / 7703 MB [05:07] [ComfyUI] [VRAM] Loaded: SubprocessModel (783 MB) [05:07] [ComfyUI] [SubprocessWorker] call_method: nodes.nodes_3d.DA3_SavePointCloud.EXECUTE_NORMALIZED [05:07] [ComfyUI] [SubprocessWorker] acquired lock, ensuring started... [05:07] [ComfyUI] [ComfyUI-DepthAnythingV3] Health check: ping (timeout=5.0s)... [05:07] [ComfyUI] [ComfyUI-DepthAnythingV3] Health check: ok [05:07] [ComfyUI] [SubprocessWorker] worker started/confirmed [05:07] [ComfyUI] [SubprocessWorker] serializing kwargs to shm... [05:07] [ComfyUI] [SubprocessWorker] created 0 shm blocks [05:07] [ComfyUI] [SubprocessWorker] sending request via socket... [05:07] [ComfyUI] [SubprocessWorker] call_id=17 sending call_method [05:07] [ComfyUI] [worker:ComfyUI-DepthAnythingV3] [comfy-env] _from_shm got dict with keys: ['__type__', 'strategy', 'parent_pid', 'fd', 'storage_size'] [05:07] [ComfyUI] [worker:ComfyUI-DepthAnythingV3] [comfy-env] DESERIALIZE TensorRef: tensor_size=[20447, 3] [05:07] [ComfyUI] [worker:ComfyUI-DepthAnythingV3] [comfy-env] DESERIALIZED tensor shape: torch.Size([20447, 3]) [05:07] [ComfyUI] [worker:ComfyUI-DepthAnythingV3] [comfy-env] _from_shm got dict with keys: ['__type__', 'strategy', 'parent_pid', 'fd', 'storage_size'] [05:07] [ComfyUI] [worker:ComfyUI-DepthAnythingV3] [comfy-env] DESERIALIZE TensorRef: tensor_size=[20447, 3] [05:07] [ComfyUI] [worker:ComfyUI-DepthAnythingV3] [comfy-env] DESERIALIZED tensor shape: torch.Size([20447, 3]) [05:07] [ComfyUI] [worker:ComfyUI-DepthAnythingV3] [comfy-env] _from_shm got dict with keys: ['__type__', 'strategy', 'parent_pid', 'fd', 'storage_size'] [05:07] [ComfyUI] [worker:ComfyUI-DepthAnythingV3] [comfy-env] DESERIALIZE TensorRef: tensor_size=[20447] [05:07] [ComfyUI] [worker:ComfyUI-DepthAnythingV3] [comfy-env] DESERIALIZED tensor shape: torch.Size([20447]) [05:07] [ComfyUI] [worker:ComfyUI-DepthAnythingV3] [comfy-env] _from_shm got dict with keys: ['__type__', 'strategy', 'parent_pid', 'fd', 'storage_size'] [05:07] [ComfyUI] [worker:ComfyUI-DepthAnythingV3] [comfy-env] DESERIALIZE TensorRef: tensor_size=[20447] [05:07] [ComfyUI] [worker:ComfyUI-DepthAnythingV3] [comfy-env] DESERIALIZED tensor shape: torch.Size([20447]) [05:07] [ComfyUI] [SubprocessWorker] got response: ok [05:07] [ComfyUI] [comfy-env] DA3_SavePointCloud done (0.18s): result: NodeOutput [05:07] [ComfyUI] [VRAM] After DA3_SavePointCloud: 3191 / 7703 MB [05:07] [ComfyUI] [VRAM] Loaded: SubprocessModel (783 MB) [05:07] [ComfyUI] [comfy-env] Running DA3_PreviewPointCloud: file_path: '/workspaces/DepthAnythingV3-2204/ComfyUI/output/pointclo..., color_mode: 'RGB' [05:07] [ComfyUI] [VRAM] Before DA3_PreviewPointCloud: 3191 / 7703 MB [05:07] [ComfyUI] [VRAM] Loaded: SubprocessModel (783 MB) [05:07] [ComfyUI] [SubprocessWorker] call_method: nodes.preview_nodes.DA3_PreviewPointCloud.EXECUTE_NORMALIZED [05:07] [ComfyUI] [SubprocessWorker] acquired lock, ensuring started... [05:07] [ComfyUI] [ComfyUI-DepthAnythingV3] Health check: ping (timeout=5.0s)... [05:07] [ComfyUI] [ComfyUI-DepthAnythingV3] Health check: ok [05:07] [ComfyUI] [SubprocessWorker] worker started/confirmed [05:07] [ComfyUI] [SubprocessWorker] serializing kwargs to shm... [05:07] [ComfyUI] [SubprocessWorker] created 0 shm blocks [05:07] [ComfyUI] [SubprocessWorker] sending request via socket... [05:07] [ComfyUI] [SubprocessWorker] call_id=18 sending call_method [05:07] [ComfyUI] [SubprocessWorker] got response: ok [05:07] [ComfyUI] [comfy-env] DA3_PreviewPointCloud done (0.01s): result: NodeOutput [05:07] [ComfyUI] [VRAM] After DA3_PreviewPointCloud: 3191 / 7703 MB [05:07] [ComfyUI] [VRAM] Loaded: SubprocessModel (783 MB) [05:07] [ComfyUI] [comfy-env] Running DA3_PreviewPointCloud: file_path: '/workspaces/DepthAnythingV3-2204/ComfyUI/output/pointclo..., color_mode: 'RGB' [05:07] [ComfyUI] [VRAM] Before DA3_PreviewPointCloud: 3191 / 7703 MB [05:07] [ComfyUI] [VRAM] Loaded: SubprocessModel (783 MB) [05:07] [ComfyUI] [SubprocessWorker] call_method: nodes.preview_nodes.DA3_PreviewPointCloud.EXECUTE_NORMALIZED [05:07] [ComfyUI] [SubprocessWorker] acquired lock, ensuring started... [05:07] [ComfyUI] [ComfyUI-DepthAnythingV3] Health check: ping (timeout=5.0s)... [05:07] [ComfyUI] [ComfyUI-DepthAnythingV3] Health check: ok [05:07] [ComfyUI] [SubprocessWorker] worker started/confirmed [05:07] [ComfyUI] [SubprocessWorker] serializing kwargs to shm... [05:07] [ComfyUI] [SubprocessWorker] created 0 shm blocks [05:07] [ComfyUI] [SubprocessWorker] sending request via socket... [05:07] [ComfyUI] [SubprocessWorker] call_id=19 sending call_method [05:07] [ComfyUI] [SubprocessWorker] got response: ok [05:07] [ComfyUI] [comfy-env] DA3_PreviewPointCloud done (0.01s): result: NodeOutput [05:07] [ComfyUI] [VRAM] After DA3_PreviewPointCloud: 3191 / 7703 MB [05:07] [ComfyUI] [VRAM] Loaded: SubprocessModel (783 MB) [05:07] [ComfyUI] Prompt executed in 4.35 seconds [05:07] Node executed (4 total), capturing... [05:08] Frame 3 saved (frame_002.jpg, t=4.8s) [05:08] [capture-node] freeze=9ms shot=150ms unfreeze=0ms saved=True [05:08] Execution complete (t=4.8s) [05:08] Captured 3 unique frames over 4.96s [05:08] [debug] iframes: 1 [05:08] [debug] iframe[0]: src=http://127.0.0.1:41890/extensions/ComfyUI-DepthAnythingV3/viewer_vtk.html?v=1778, canvas=486x394, rafFrozen=True [05:08] [timing] trigger_3d_previews: 0.0s [05:10] Saved high-quality screenshot: advanced_3d_multiview_executed.png [05:10] [timing] final_screenshot: 0.3s [05:10] [ComfyUI] [comfy-env] [VRAM] Before offload 'DepthAnything3Net_1' (783 MB) -> cpu: 3191 / 7703 MB [05:10] Capturing execution frames: bas_relief.json [05:10] [ComfyUI] [ComfyUI-DepthAnythingV3] Health check: ping (timeout=5.0s)... [05:10] [ComfyUI] [ComfyUI-DepthAnythingV3] Health check: ok [05:10] [ComfyUI] [SubprocessWorker] call_id=20 sending model_to_device [05:10] [ComfyUI] [worker:ComfyUI-DepthAnythingV3] [VRAM] -289MB (now 655MB) reserved=2816MB peak=1240MB [05:11] [ComfyUI] [comfy-env] [VRAM] After offload 'DepthAnything3Net_1' (783 MB): 439 / 7703 MB [05:16] Frame 1 saved (frame_000.jpg, t=0.0s) [05:16] Validating workflow... [05:16] [ComfyUI] === /validate endpoint called === [05:16] [ComfyUI] Received JSON with keys: ['prompt'] [05:16] [ComfyUI] Prompt has 6 nodes [05:16] [ComfyUI] Node 2: LoadImage [05:16] [ComfyUI] Inputs: {"image": "bas_relief.png"} [05:16] Queuing workflow for execution... [05:16] [ComfyUI] Node 3: DownloadAndLoadDepthAnythingV3Model [05:16] [ComfyUI] Inputs: {"model": "da3_large.safetensors", "precision": "auto", "attention": "auto"} [05:16] [ComfyUI] Node 21: DepthAnything_V3 [05:16] [ComfyUI] Inputs: {"normalization_mode": "Raw", "resize_method": "resize", "invert_depth": false, "keep_model_size": true, "da3_model": ["3", 0], "images": ["2", 0]} [05:16] [ComfyUI] Node 27: PreviewImage [05:16] [ComfyUI] Inputs: {"images": ["21", 2]} [05:16] [ComfyUI] Node 30: Preview3D [05:16] [ComfyUI] Inputs: {"model_file": ["32", 0], "image": ""} [05:16] [ComfyUI] Node 32: DA3_ToMesh [05:16] [ComfyUI] Inputs: {"confidence_threshold": 0.1, "depth_edge_threshold": 0.1, "downsample": 1, "target_faces": 100000, "filename_prefix": "mesh", "allow_around_1": true, "use_draco_compression": false, "depth_raw": ["21 [05:16] [ComfyUI] Generated prompt_id: 54919c08-3efd-4f2a-b02e-7829c39d6b34 [05:16] [ComfyUI] Calling execution.validate_prompt()... [05:16] [ComfyUI] Validation result: valid=True [05:16] [ComfyUI] === Validation PASSED === [05:16] [ComfyUI] got prompt [05:16] [ComfyUI] [comfy-env] Running DownloadAndLoadDepthAnythingV3Model: model: 'da3_large.safetensors', precision: 'auto', attention: 'auto' [05:16] [ComfyUI] [VRAM] Before DownloadAndLoadDepthAnythingV3Model: 439 / 7703 MB [05:16] [ComfyUI] [SubprocessWorker] call_method: nodes.load_model.DownloadAndLoadDepthAnythingV3Model.EXECUTE_NORMALIZED [05:16] [ComfyUI] [SubprocessWorker] acquired lock, ensuring started... [05:16] [ComfyUI] [ComfyUI-DepthAnythingV3] Health check: ping (timeout=5.0s)... [05:16] [ComfyUI] [ComfyUI-DepthAnythingV3] Health check: failed [05:16] [ComfyUI] [ComfyUI-DepthAnythingV3] Socket unhealthy, restarting worker... [05:16] [ComfyUI] [comfy-env] Invalidated 1 stale model patchers (will be cleaned up during next unload) [05:16] [ComfyUI] [ComfyUI-DepthAnythingV3] python: /root/.ce/.pixi/envs/depthanythingv3-nodes/bin/python [05:16] [ComfyUI] [ComfyUI-DepthAnythingV3] sys_path sent to worker: ['/workspaces/DepthAnythingV3-2204/ComfyUI', '/workspaces/DepthAnythingV3-2204/ComfyUI/custom_nodes/ComfyUI-DepthAnythingV3', '/root/.ce/.pixi/envs/depthanythingv3-nodes/lib/python3.12/site-packages', '/workspaces/DepthAnythingV3-2204/ComfyUI/custom_nodes/ComfyUI-DepthAnythingV3'] [05:16] [ComfyUI] [SubprocessWorker] is_pixi=True, python=/root/.ce/.pixi/envs/depthanythingv3-nodes/bin/python [05:16] [ComfyUI] [SubprocessWorker] launching cmd=['/root/.pixi/bin/pixi', 'run', '--as-is', '--manifest-path', '/root/.ce/pixi.toml', '-e', 'depthanythingv3-nodes', 'python', '/tmp/comfyui_pvenv_910zmk0o/persistent_worker.py', 'abstract://comfy_worker_6400a111dc5e']... [05:16] [ComfyUI] [SubprocessWorker] socket_addr=abstract://comfy_worker_6400a111dc5e (abstract, no filesystem path) [05:17] [ComfyUI] [worker:ComfyUI-DepthAnythingV3] ERROR: Failed to import comfy_kitchen, Error: No module named 'comfy_kitchen', fp8 and fp4 support will not be available. [05:17] [ComfyUI] [SubprocessWorker] worker started/confirmed [05:17] [ComfyUI] [SubprocessWorker] serializing kwargs to shm... [05:17] [ComfyUI] [SubprocessWorker] created 0 shm blocks [05:17] [ComfyUI] [SubprocessWorker] sending request via socket... [05:17] [ComfyUI] [SubprocessWorker] call_id=21 sending call_method [05:18] [ComfyUI] [SubprocessWorker] got response: ok [05:18] [ComfyUI] [comfy-env] [VRAM] Before offload 'DepthAnything3Net_1' (783 MB) -> cpu: 269 / 7703 MB [05:18] [ComfyUI] [ComfyUI-DepthAnythingV3] Health check: ping (timeout=5.0s)... [05:18] [ComfyUI] [ComfyUI-DepthAnythingV3] Health check: ok [05:18] [ComfyUI] [SubprocessWorker] call_id=22 sending model_to_device [05:18] [ComfyUI] Model 'DepthAnything3Net_1' gone from worker (restarted?), treating as offloaded [05:18] [ComfyUI] [comfy-env] [VRAM] After offload 'DepthAnything3Net_1' (783 MB): 269 / 7703 MB [05:18] [ComfyUI] [comfy-env] DownloadAndLoadDepthAnythingV3Model done (1.59s): result: NodeOutput [05:18] [ComfyUI] [VRAM] After DownloadAndLoadDepthAnythingV3Model: 269 / 7703 MB [05:18] [ComfyUI] [comfy-env] Running DepthAnything_V3: normalization_mode: 'Raw', resize_method: 'resize', invert_depth: False, keep_model_size: True, da3_model: dict, images: torch.float32 [1,2000,1336,3] cpu [05:18] [ComfyUI] [VRAM] Before DepthAnything_V3: 269 / 7703 MB [05:18] [ComfyUI] [SubprocessWorker] call_method: nodes.nodes_inference.DepthAnything_V3.EXECUTE_NORMALIZED [05:18] [ComfyUI] [SubprocessWorker] acquired lock, ensuring started... [05:18] [ComfyUI] [ComfyUI-DepthAnythingV3] Health check: ping (timeout=5.0s)... [05:18] [ComfyUI] [ComfyUI-DepthAnythingV3] Health check: ok [05:18] [ComfyUI] [SubprocessWorker] worker started/confirmed [05:18] [ComfyUI] [comfy-env] PRE-SERIALIZE 'images' shape: torch.Size([1, 2000, 1336, 3]) [05:18] [ComfyUI] [SubprocessWorker] serializing kwargs to shm... [05:18] [ComfyUI] [SubprocessWorker] created 0 shm blocks [05:18] [ComfyUI] [SubprocessWorker] sending request via socket... [05:18] [ComfyUI] [SubprocessWorker] call_id=23 sending call_method [05:18] [ComfyUI] [worker:ComfyUI-DepthAnythingV3] [comfy-env] _from_shm got dict with keys: ['__type__', 'strategy', 'parent_pid', 'fd', 'storage_size'] [05:18] [ComfyUI] [worker:ComfyUI-DepthAnythingV3] [comfy-env] DESERIALIZE TensorRef: tensor_size=[1, 2000, 1336, 3] [05:18] [ComfyUI] [worker:ComfyUI-DepthAnythingV3] [comfy-env] DESERIALIZED tensor shape: torch.Size([1, 2000, 1336, 3]) [05:18] [ComfyUI] [worker:ComfyUI-DepthAnythingV3] WARNING: No comfy kitchen, using old apply_rope functions. [05:18] Frame 2 saved (frame_001.jpg, t=2.3s) [05:18] [capture-periodic] freeze=2ms shot=164ms unfreeze=3ms saved=True [05:19] [ComfyUI] [SubprocessWorker] callback 'request_vram_budget' from call_id=23 [05:19] [ComfyUI] [comfy-env] VRAM request: 0.82GB, free before eviction: 7.80GB [05:19] [ComfyUI] [comfy-env] VRAM after eviction: 7.80GB [05:19] [ComfyUI] [worker:ComfyUI-DepthAnythingV3] [VRAM] +218MB (now 218MB) reserved=224MB peak=218MB [05:20] [ComfyUI] [worker:ComfyUI-DepthAnythingV3] [VRAM] +935MB (now 1153MB) reserved=1440MB peak=1153MB [05:20] Frame 3 saved (frame_002.jpg, t=4.6s) [05:20] [capture-periodic] freeze=1ms shot=154ms unfreeze=3ms saved=True [05:21] [ComfyUI] [SubprocessWorker] callback 'report_progress' from call_id=23 [05:21] [capture-loop] iter=50 t=5.8s state={'complete': False, 'error': None, 'executedCount': 0, 'wsState': 1} eval_ms=2 ram=4.7/31.3GB (15%) swap=0.5/32.0GB (2%) cpu=13% browser_rss=0.91GB [05:21] [ComfyUI] [worker:ComfyUI-DepthAnythingV3] [VRAM] -279MB (now 875MB) reserved=7008MB peak=3480MB [05:22] [ComfyUI] [SubprocessWorker] got response: ok [05:22] [ComfyUI] [comfy-env] Created 1 model patchers: ['DepthAnything3Net_1'] [05:22] [ComfyUI] [comfy-env] DepthAnything_V3 done (4.03s): result: NodeOutput [05:22] [ComfyUI] [VRAM] After DepthAnything_V3: 7383 / 7703 MB [05:22] [ComfyUI] [VRAM] Loaded: SubprocessModel (783 MB) [05:22] [ComfyUI] [comfy-env] Running DA3_ToMesh: confidence_threshold: 0.1, depth_edge_threshold: 0.1, downsample: 1, target_faces: 100000, filename_prefix: 'mesh', allow_around_1: True, use_draco_compression: False, depth_raw: torch.float32 [1,2002,1330,3] cpu, confidence: torch.float32 [1,2002,1330,3] cpu, intrinsics: '{\n "intrinsics": [\n {\n "image_0": [\n ..., sky_mask: torch.float32 [1,2002,1330] cpu, source_image: torch.float32 [1,2002,1330,3] cpu [05:22] [ComfyUI] [VRAM] Before DA3_ToMesh: 7383 / 7703 MB [05:22] [ComfyUI] [VRAM] Loaded: SubprocessModel (783 MB) [05:22] [ComfyUI] [SubprocessWorker] call_method: nodes.nodes_3d.DA3_ToMesh.EXECUTE_NORMALIZED [05:22] [ComfyUI] [SubprocessWorker] acquired lock, ensuring started... [05:22] [ComfyUI] [ComfyUI-DepthAnythingV3] Health check: ping (timeout=5.0s)... [05:22] [ComfyUI] [ComfyUI-DepthAnythingV3] Health check: ok [05:22] [ComfyUI] [SubprocessWorker] worker started/confirmed [05:22] [ComfyUI] [comfy-env] PRE-SERIALIZE 'depth_raw' shape: torch.Size([1, 2002, 1330, 3]) [05:22] [ComfyUI] [comfy-env] PRE-SERIALIZE 'confidence' shape: torch.Size([1, 2002, 1330, 3]) [05:22] [ComfyUI] [comfy-env] PRE-SERIALIZE 'sky_mask' shape: torch.Size([1, 2002, 1330]) [05:22] [ComfyUI] [comfy-env] PRE-SERIALIZE 'source_image' shape: torch.Size([1, 2002, 1330, 3]) [05:22] [ComfyUI] [SubprocessWorker] serializing kwargs to shm... [05:22] [ComfyUI] [SubprocessWorker] created 0 shm blocks [05:22] [ComfyUI] [SubprocessWorker] sending request via socket... [05:22] [ComfyUI] [SubprocessWorker] call_id=24 sending call_method [05:22] [ComfyUI] [worker:ComfyUI-DepthAnythingV3] [comfy-env] _from_shm got dict with keys: ['__type__', 'strategy', 'parent_pid', 'fd', 'storage_size'] [05:22] [ComfyUI] [worker:ComfyUI-DepthAnythingV3] [comfy-env] DESERIALIZE TensorRef: tensor_size=[1, 2002, 1330, 3] [05:22] [ComfyUI] [worker:ComfyUI-DepthAnythingV3] [comfy-env] DESERIALIZED tensor shape: torch.Size([1, 2002, 1330, 3]) [05:22] [ComfyUI] [worker:ComfyUI-DepthAnythingV3] [comfy-env] _from_shm got dict with keys: ['__type__', 'strategy', 'parent_pid', 'fd', 'storage_size'] [05:22] [ComfyUI] [worker:ComfyUI-DepthAnythingV3] [comfy-env] DESERIALIZE TensorRef: tensor_size=[1, 2002, 1330, 3] [05:22] [ComfyUI] [worker:ComfyUI-DepthAnythingV3] [comfy-env] DESERIALIZED tensor shape: torch.Size([1, 2002, 1330, 3]) [05:22] [ComfyUI] [worker:ComfyUI-DepthAnythingV3] [comfy-env] _from_shm got dict with keys: ['__type__', 'strategy', 'parent_pid', 'fd', 'storage_size'] [05:22] [ComfyUI] [worker:ComfyUI-DepthAnythingV3] [comfy-env] DESERIALIZE TensorRef: tensor_size=[1, 2002, 1330] [05:22] [ComfyUI] [worker:ComfyUI-DepthAnythingV3] [comfy-env] DESERIALIZED tensor shape: torch.Size([1, 2002, 1330]) [05:22] [ComfyUI] [worker:ComfyUI-DepthAnythingV3] [comfy-env] _from_shm got dict with keys: ['__type__', 'strategy', 'parent_pid', 'fd', 'storage_size'] [05:22] [ComfyUI] [worker:ComfyUI-DepthAnythingV3] [comfy-env] DESERIALIZE TensorRef: tensor_size=[1, 2002, 1330, 3] [05:22] [ComfyUI] [worker:ComfyUI-DepthAnythingV3] [comfy-env] DESERIALIZED tensor shape: torch.Size([1, 2002, 1330, 3]) [05:22] Node executed (1 total), capturing... [05:22] [ComfyUI] [worker:ComfyUI-DepthAnythingV3] WARNING: pyfqmr not installed, skipping decimation. Install with: pip install pyfqmr [05:22] Frame 4 saved (frame_003.jpg, t=6.5s) [05:22] [capture-node] freeze=2ms shot=176ms unfreeze=2ms saved=True [05:25] [ComfyUI] [worker:ComfyUI-DepthAnythingV3] WARNING: pygltflib is required for material post-processing. Install with: pip install pygltflib. Mesh may appear dark or single-sided. [05:25] [ComfyUI] [SubprocessWorker] got response: ok [05:25] [ComfyUI] [comfy-env] DA3_ToMesh done (3.64s): result: NodeOutput [05:25] [ComfyUI] [VRAM] After DA3_ToMesh: 7451 / 7703 MB [05:25] [ComfyUI] [VRAM] Loaded: SubprocessModel (783 MB) [05:25] [ComfyUI] Prompt executed in 9.65 seconds [05:25] [ComfyUI] [comfy-env] [VRAM] Before offload 'DepthAnything3Net_1' (783 MB) -> cpu: 7451 / 7703 MB [05:25] [ComfyUI] [ComfyUI-DepthAnythingV3] Health check: ping (timeout=5.0s)... [05:25] [ComfyUI] [ComfyUI-DepthAnythingV3] Health check: ok [05:25] [ComfyUI] [SubprocessWorker] call_id=25 sending model_to_device [05:26] [ComfyUI] [worker:ComfyUI-DepthAnythingV3] [VRAM] -284MB (now 591MB) reserved=7008MB peak=3480MB [05:26] Node executed (3 total), capturing... [05:26] [ComfyUI] [comfy-env] [VRAM] After offload 'DepthAnything3Net_1' (783 MB): 507 / 7703 MB [05:26] Frame 5 saved (frame_004.jpg, t=10.2s) [05:26] [capture-node] freeze=139ms shot=197ms unfreeze=0ms saved=True [05:26] Execution complete (t=10.2s) [05:26] [3d-wait] Phase 1: Waiting for 'Loading 3D Model' text to disappear... [06:26] [3d-wait] Phase 1 exception after 60.0s: Page.wait_for_function: Timeout 60000ms exceeded. [06:26] [3d-wait] Phase 2: iframes=0 [06:26] [3d-wait] Total 3D wait: 60.0s [06:26] Captured 5 unique frames over 70.62s [06:26] [debug] iframes: 0 [06:26] [timing] trigger_3d_previews: 0.0s [06:29] Saved high-quality screenshot: bas_relief_executed.png [06:29] [timing] final_screenshot: 0.5s [06:29] Capturing execution frames: da3_streaming.json [06:35] Frame 1 saved (frame_000.jpg, t=0.0s) [06:35] Validating workflow... [06:35] [ComfyUI] === /validate endpoint called === [06:35] [ComfyUI] Received JSON with keys: ['prompt'] [06:35] [ComfyUI] Prompt has 5 nodes [06:35] [ComfyUI] Node 2: DownloadAndLoadDepthAnythingV3Model [06:35] [ComfyUI] Inputs: {"model": "da3_large.safetensors", "precision": "auto", "attention": "auto"} [06:35] [ComfyUI] Node 3: LoadVideo [06:35] Queuing workflow for execution... [06:35] [ComfyUI] Inputs: {"file": "robot_unitree.mp4", "video-preview": ""} [06:35] [ComfyUI] Node 4: SaveVideo [06:35] [ComfyUI] Inputs: {"filename_prefix": "video/preview_da3", "format": "auto", "codec": "auto", "video": ["6", 0]} [06:35] [ComfyUI] Node 5: LoadSALADModel [06:35] [ComfyUI] Inputs: {} [06:35] [ComfyUI] Node 6: DepthAnythingV3_Streaming [06:35] [ComfyUI] Inputs: {"normalization_mode": "Standard", "chunk_size": 30, "overlap": 8, "align_lib": "auto", "align_method": "sim3", "resize_method": "resize", "invert_depth": true, "save_pointcloud": false, "sample_ratio [06:35] [ComfyUI] Generated prompt_id: d8bb8056-3374-4893-8b60-c93ce968d848 [06:35] [ComfyUI] Calling execution.validate_prompt()... [06:35] [ComfyUI] Validation result: valid=True [06:35] [ComfyUI] === Validation PASSED === [06:35] [ComfyUI] got prompt [06:35] [ComfyUI] [comfy-env] Running LoadSALADModel: [06:35] [ComfyUI] [VRAM] Before LoadSALADModel: 507 / 7703 MB [06:35] [ComfyUI] [SubprocessWorker] call_method: nodes.load_model.LoadSALADModel.EXECUTE_NORMALIZED [06:35] [ComfyUI] [SubprocessWorker] acquired lock, ensuring started... [06:35] [ComfyUI] [ComfyUI-DepthAnythingV3] Health check: ping (timeout=5.0s)... [06:35] [ComfyUI] [ComfyUI-DepthAnythingV3] Health check: failed [06:35] [ComfyUI] [ComfyUI-DepthAnythingV3] Socket unhealthy, restarting worker... [06:35] [ComfyUI] [comfy-env] Invalidated 1 stale model patchers (will be cleaned up during next unload) [06:35] [ComfyUI] [ComfyUI-DepthAnythingV3] python: /root/.ce/.pixi/envs/depthanythingv3-nodes/bin/python [06:35] [ComfyUI] [ComfyUI-DepthAnythingV3] sys_path sent to worker: ['/workspaces/DepthAnythingV3-2204/ComfyUI', '/workspaces/DepthAnythingV3-2204/ComfyUI/custom_nodes/ComfyUI-DepthAnythingV3', '/root/.ce/.pixi/envs/depthanythingv3-nodes/lib/python3.12/site-packages', '/workspaces/DepthAnythingV3-2204/ComfyUI/custom_nodes/ComfyUI-DepthAnythingV3'] [06:35] [ComfyUI] [SubprocessWorker] is_pixi=True, python=/root/.ce/.pixi/envs/depthanythingv3-nodes/bin/python [06:35] [ComfyUI] [SubprocessWorker] launching cmd=['/root/.pixi/bin/pixi', 'run', '--as-is', '--manifest-path', '/root/.ce/pixi.toml', '-e', 'depthanythingv3-nodes', 'python', '/tmp/comfyui_pvenv_910zmk0o/persistent_worker.py', 'abstract://comfy_worker_39e58ac26113']... [06:35] [ComfyUI] [SubprocessWorker] socket_addr=abstract://comfy_worker_39e58ac26113 (abstract, no filesystem path) [06:37] [ComfyUI] [worker:ComfyUI-DepthAnythingV3] ERROR: Failed to import comfy_kitchen, Error: No module named 'comfy_kitchen', fp8 and fp4 support will not be available. [06:37] [ComfyUI] [SubprocessWorker] worker started/confirmed [06:37] [ComfyUI] [SubprocessWorker] sending request via socket... [06:37] [ComfyUI] [SubprocessWorker] call_id=26 sending call_method [06:37] [ComfyUI] Warning: You are sending unauthenticated requests to the HF Hub. Please set a HF_TOKEN to enable higher rate limits and faster downloads. [06:37] [ComfyUI] [worker:ComfyUI-DepthAnythingV3] WARNING: Warning: You are sending unauthenticated requests to the HF Hub. Please set a HF_TOKEN to enable higher rate limits and faster downloads. [06:37] [ComfyUI] [06:38] Frame 2 saved (frame_001.jpg, t=2.3s) [06:38] [capture-periodic] freeze=2ms shot=124ms unfreeze=5ms saved=True [06:40] Frame 3 saved (frame_002.jpg, t=4.6s) [06:40] [capture-periodic] freeze=1ms shot=143ms unfreeze=6ms saved=True [06:41] [capture-loop] iter=50 t=5.7s state={'complete': False, 'error': None, 'executedCount': 0, 'wsState': 1} eval_ms=2 ram=4.4/31.3GB (14%) swap=0.5/32.0GB (2%) cpu=18% browser_rss=1.09GB [06:42] [ComfyUI] dino_salad.safetensors: 0%| | 0.00/352M [00:00 cpu: 269 / 7703 MB [06:42] [ComfyUI] [ComfyUI-DepthAnythingV3] Health check: ping (timeout=5.0s)... [06:42] [ComfyUI] [ComfyUI-DepthAnythingV3] Health check: ok [06:42] [ComfyUI] [SubprocessWorker] call_id=27 sending model_to_device [06:42] [ComfyUI] Model 'DepthAnything3Net_1' gone from worker (restarted?), treating as offloaded [06:42] [ComfyUI] [comfy-env] [VRAM] After offload 'DepthAnything3Net_1' (783 MB): 269 / 7703 MB [06:42] [ComfyUI] [comfy-env] LoadSALADModel done (6.43s): result: NodeOutput [06:42] [ComfyUI] [VRAM] After LoadSALADModel: 269 / 7703 MB [06:42] [ComfyUI] [comfy-env] Running DownloadAndLoadDepthAnythingV3Model: model: 'da3_large.safetensors', precision: 'auto', attention: 'auto' [06:42] [ComfyUI] [VRAM] Before DownloadAndLoadDepthAnythingV3Model: 269 / 7703 MB [06:42] [ComfyUI] [SubprocessWorker] call_method: nodes.load_model.DownloadAndLoadDepthAnythingV3Model.EXECUTE_NORMALIZED [06:42] [ComfyUI] [SubprocessWorker] acquired lock, ensuring started... [06:42] [ComfyUI] [ComfyUI-DepthAnythingV3] Health check: ping (timeout=5.0s)... [06:42] [ComfyUI] [ComfyUI-DepthAnythingV3] Health check: ok [06:42] [ComfyUI] [SubprocessWorker] worker started/confirmed [06:42] [ComfyUI] [SubprocessWorker] serializing kwargs to shm... [06:42] [ComfyUI] [SubprocessWorker] created 0 shm blocks [06:42] [ComfyUI] [SubprocessWorker] sending request via socket... [06:42] [ComfyUI] [SubprocessWorker] call_id=28 sending call_method [06:42] [ComfyUI] [SubprocessWorker] got response: ok [06:42] [ComfyUI] [comfy-env] DownloadAndLoadDepthAnythingV3Model done (0.02s): result: NodeOutput [06:42] [ComfyUI] [VRAM] After DownloadAndLoadDepthAnythingV3Model: 269 / 7703 MB [06:42] [ComfyUI] [comfy-env] Running DepthAnythingV3_Streaming: normalization_mode: 'Standard', chunk_size: 30, overlap: 8, align_lib: 'auto', align_method: 'sim3', resize_method: 'resize', invert_depth: True, save_pointcloud: False, sample_ratio: 0.015, conf_threshold_coef: 0.75, da3_model: dict, video: VideoFromFile, salad_model: dict [06:42] [ComfyUI] [VRAM] Before DepthAnythingV3_Streaming: 269 / 7703 MB [06:42] [ComfyUI] [SubprocessWorker] call_method: nodes.streaming.node.DepthAnythingV3_Streaming.EXECUTE_NORMALIZED [06:42] [ComfyUI] [SubprocessWorker] acquired lock, ensuring started... [06:42] [ComfyUI] [ComfyUI-DepthAnythingV3] Health check: ping (timeout=5.0s)... [06:42] [ComfyUI] [ComfyUI-DepthAnythingV3] Health check: ok [06:42] [ComfyUI] [SubprocessWorker] worker started/confirmed [06:42] [ComfyUI] [SubprocessWorker] serializing kwargs to shm... [06:42] [ComfyUI] [SubprocessWorker] created 1 shm blocks [06:42] [ComfyUI] [SubprocessWorker] sending request via socket... [06:42] [ComfyUI] [SubprocessWorker] call_id=29 sending call_method [06:42] Frame 4 saved (frame_003.jpg, t=6.8s) [06:42] [capture-periodic] freeze=1ms shot=85ms unfreeze=2ms saved=True [06:44] [ComfyUI] [worker:ComfyUI-DepthAnythingV3] WARNING: No comfy kitchen, using old apply_rope functions. [06:45] [ComfyUI] [SubprocessWorker] callback 'request_vram_budget' from call_id=29 [06:45] [ComfyUI] [comfy-env] VRAM request: 1.17GB, free before eviction: 7.80GB [06:45] [ComfyUI] [comfy-env] VRAM after eviction: 7.80GB [06:45] [ComfyUI] [worker:ComfyUI-DepthAnythingV3] [VRAM] +335MB (now 335MB) reserved=352MB peak=335MB [06:46] [ComfyUI] [worker:ComfyUI-DepthAnythingV3] [VRAM] +783MB (now 1119MB) reserved=1120MB peak=1119MB [06:46] [capture-loop] iter=100 t=11.1s state={'complete': False, 'error': None, 'executedCount': 0, 'wsState': 1} eval_ms=2 ram=7.5/31.3GB (24%) swap=0.5/32.0GB (2%) cpu=14% browser_rss=1.08GB [06:49] [ComfyUI] [SubprocessWorker] callback 'report_progress' from call_id=29 [06:49] [ComfyUI] [worker:ComfyUI-DepthAnythingV3] [VRAM] +276MB (now 1395MB) reserved=1408MB peak=1395MB [06:50] [ComfyUI] [worker:ComfyUI-DepthAnythingV3] [VRAM] +1240MB (now 2635MB) reserved=4032MB peak=2635MB [06:51] [ComfyUI] [worker:ComfyUI-DepthAnythingV3] [VRAM] +350MB (now 2986MB) reserved=4480MB peak=2986MB [06:52] [capture-loop] iter=150 t=16.7s state={'complete': False, 'error': None, 'executedCount': 0, 'wsState': 1} eval_ms=2 ram=7.5/31.3GB (24%) swap=0.5/32.0GB (2%) cpu=14% browser_rss=1.08GB [06:52] [ComfyUI] [worker:ComfyUI-DepthAnythingV3] [VRAM] +350MB (now 3337MB) reserved=4928MB peak=3337MB [06:53] [ComfyUI] [worker:ComfyUI-DepthAnythingV3] [VRAM] +350MB (now 3688MB) reserved=5280MB peak=3688MB [06:54] [ComfyUI] [worker:ComfyUI-DepthAnythingV3] [VRAM] +568MB (now 4257MB) reserved=4544MB peak=4257MB [06:57] [ComfyUI] [worker:ComfyUI-DepthAnythingV3] [VRAM] +206MB (now 4463MB) reserved=5440MB peak=4463MB [06:57] [capture-loop] iter=200 t=22.2s state={'complete': False, 'error': None, 'executedCount': 0, 'wsState': 1} eval_ms=2 ram=7.5/31.3GB (24%) swap=0.5/32.0GB (2%) cpu=11% browser_rss=1.08GB [06:59] [ComfyUI] [worker:ComfyUI-DepthAnythingV3] [VRAM] -2947MB (now 1517MB) reserved=7136MB peak=4556MB [06:59] [ComfyUI] [SubprocessWorker] callback 'report_progress' from call_id=29 [07:00] [ComfyUI] [worker:ComfyUI-DepthAnythingV3] [VRAM] +1118MB (now 2635MB) reserved=4064MB peak=4556MB [07:00] Frame 5 saved (frame_004.jpg, t=24.5s) [07:00] [capture-periodic] freeze=2ms shot=143ms unfreeze=3ms saved=True [07:01] [ComfyUI] [worker:ComfyUI-DepthAnythingV3] [VRAM] +350MB (now 2986MB) reserved=4416MB peak=4556MB [07:02] [ComfyUI] [worker:ComfyUI-DepthAnythingV3] [VRAM] +350MB (now 3337MB) reserved=4832MB peak=4556MB [07:03] [ComfyUI] [worker:ComfyUI-DepthAnythingV3] [VRAM] +350MB (now 3688MB) reserved=5120MB peak=4556MB [07:03] [capture-loop] iter=250 t=27.8s state={'complete': False, 'error': None, 'executedCount': 0, 'wsState': 1} eval_ms=2 ram=7.6/31.3GB (24%) swap=0.5/32.0GB (2%) cpu=12% browser_rss=0.99GB [07:04] [ComfyUI] [worker:ComfyUI-DepthAnythingV3] [VRAM] +579MB (now 4267MB) reserved=4608MB peak=4556MB [07:07] [ComfyUI] [worker:ComfyUI-DepthAnythingV3] [VRAM] +206MB (now 4473MB) reserved=5536MB peak=4556MB [07:08] [ComfyUI] [worker:ComfyUI-DepthAnythingV3] [VRAM] -2957MB (now 1517MB) reserved=7264MB peak=4556MB [07:08] [ComfyUI] [SubprocessWorker] callback 'report_progress' from call_id=29 [07:08] [capture-loop] iter=300 t=33.3s state={'complete': False, 'error': None, 'executedCount': 0, 'wsState': 1} eval_ms=3 ram=7.7/31.3GB (24%) swap=0.5/32.0GB (2%) cpu=11% browser_rss=0.99GB [07:09] Frame 6 saved (frame_005.jpg, t=33.4s) [07:09] [capture-periodic] freeze=6ms shot=126ms unfreeze=5ms saved=True [07:09] [ComfyUI] [worker:ComfyUI-DepthAnythingV3] [VRAM] +1118MB (now 2635MB) reserved=4064MB peak=4556MB [07:10] [ComfyUI] [worker:ComfyUI-DepthAnythingV3] [VRAM] +350MB (now 2986MB) reserved=4416MB peak=4556MB [07:11] [ComfyUI] [worker:ComfyUI-DepthAnythingV3] [VRAM] +350MB (now 3337MB) reserved=4832MB peak=4556MB [07:12] [ComfyUI] [worker:ComfyUI-DepthAnythingV3] [VRAM] +350MB (now 3688MB) reserved=5120MB peak=4556MB [07:13] [ComfyUI] [worker:ComfyUI-DepthAnythingV3] [VRAM] +568MB (now 4257MB) reserved=4544MB peak=4556MB [07:14] [capture-loop] iter=350 t=38.9s state={'complete': False, 'error': None, 'executedCount': 0, 'wsState': 1} eval_ms=2 ram=7.6/31.3GB (24%) swap=0.5/32.0GB (2%) cpu=12% browser_rss=0.97GB [07:17] [ComfyUI] [worker:ComfyUI-DepthAnythingV3] [VRAM] +206MB (now 4463MB) reserved=5440MB peak=4556MB [07:18] [ComfyUI] [worker:ComfyUI-DepthAnythingV3] [VRAM] -2947MB (now 1517MB) reserved=7264MB peak=4556MB [07:18] [ComfyUI] [SubprocessWorker] callback 'report_progress' from call_id=29 [07:19] [ComfyUI] [worker:ComfyUI-DepthAnythingV3] [VRAM] +1118MB (now 2635MB) reserved=4064MB peak=4556MB [07:19] [capture-loop] iter=400 t=44.4s state={'complete': False, 'error': None, 'executedCount': 0, 'wsState': 1} eval_ms=2 ram=7.8/31.3GB (25%) swap=0.5/32.0GB (2%) cpu=12% browser_rss=0.97GB [07:20] Frame 7 saved (frame_006.jpg, t=44.5s) [07:20] [capture-periodic] freeze=1ms shot=131ms unfreeze=4ms saved=True [07:20] [ComfyUI] [worker:ComfyUI-DepthAnythingV3] [VRAM] +350MB (now 2986MB) reserved=4416MB peak=4556MB [07:21] [ComfyUI] [worker:ComfyUI-DepthAnythingV3] [VRAM] +350MB (now 3337MB) reserved=4832MB peak=4556MB [07:22] [ComfyUI] [worker:ComfyUI-DepthAnythingV3] [VRAM] +350MB (now 3688MB) reserved=5120MB peak=4556MB [07:23] [ComfyUI] [worker:ComfyUI-DepthAnythingV3] [VRAM] +568MB (now 4257MB) reserved=4544MB peak=4556MB [07:25] [capture-loop] iter=450 t=50.0s state={'complete': False, 'error': None, 'executedCount': 0, 'wsState': 1} eval_ms=2 ram=7.8/31.3GB (25%) swap=0.5/32.0GB (2%) cpu=11% browser_rss=0.97GB [07:26] [ComfyUI] [worker:ComfyUI-DepthAnythingV3] [VRAM] +206MB (now 4463MB) reserved=5440MB peak=4556MB [07:28] [ComfyUI] [worker:ComfyUI-DepthAnythingV3] [VRAM] -2947MB (now 1517MB) reserved=7264MB peak=4556MB [07:28] [ComfyUI] [SubprocessWorker] callback 'report_progress' from call_id=29 [07:29] Frame 8 saved (frame_007.jpg, t=53.3s) [07:29] [capture-periodic] freeze=1ms shot=129ms unfreeze=4ms saved=True [07:29] [ComfyUI] [worker:ComfyUI-DepthAnythingV3] [VRAM] +1118MB (now 2635MB) reserved=4064MB peak=4556MB [07:30] [ComfyUI] [worker:ComfyUI-DepthAnythingV3] [VRAM] +350MB (now 2986MB) reserved=4416MB peak=4556MB [07:31] [capture-loop] iter=500 t=55.4s state={'complete': False, 'error': None, 'executedCount': 0, 'wsState': 1} eval_ms=2 ram=7.9/31.3GB (25%) swap=0.5/32.0GB (2%) cpu=12% browser_rss=0.97GB [07:31] [ComfyUI] [worker:ComfyUI-DepthAnythingV3] [VRAM] +350MB (now 3337MB) reserved=4832MB peak=4556MB [07:32] [ComfyUI] [worker:ComfyUI-DepthAnythingV3] [VRAM] +350MB (now 3688MB) reserved=5120MB peak=4556MB [07:33] [ComfyUI] [worker:ComfyUI-DepthAnythingV3] [VRAM] +579MB (now 4267MB) reserved=4608MB peak=4556MB [07:35] [ComfyUI] [worker:ComfyUI-DepthAnythingV3] [07:35] [ComfyUI] === WATCHDOG TICK 1 === [07:35] [ComfyUI] [worker:ComfyUI-DepthAnythingV3] Thread 0x00007548ca140640 (most recent call first): [07:35] [ComfyUI] File "/root/.ce/.pixi/envs/depthanythingv3-nodes/lib/python3.12/threading.py", line 359 in wait [07:35] [ComfyUI] File "/root/.ce/.pixi/envs/depthanythingv3-nodes/lib/python3.12/threading.py", line 655 in wait [07:35] [ComfyUI] File "/root/.ce/.pixi/envs/depthanythingv3-nodes/lib/python3.12/site-packages/tqdm/_monitor.py", line 60 in run [07:35] [ComfyUI] File "/root/.ce/.pixi/envs/depthanythingv3-nodes/lib/python3.12/threading.py", line 1075 in _bootstrap_inner [07:35] [ComfyUI] File "/root/.ce/.pixi/envs/depthanythingv3-nodes/lib/python3.12/threading.py", line 1032 in _bootstrap [07:35] [ComfyUI] [07:35] [ComfyUI] Thread 0x0000754c73bd1640 (most recent call first): [07:35] [ComfyUI] File "/tmp/comfyui_pvenv_910zmk0o/persistent_worker.py", line 106 in _vram_poller [07:35] [ComfyUI] File "/root/.ce/.pixi/envs/depthanythingv3-nodes/lib/python3.12/threading.py", line 1012 in run [07:35] [ComfyUI] File "/root/.ce/.pixi/envs/depthanythingv3-nodes/lib/python3.12/threading.py", line 1075 in _bootstrap_inner [07:35] [ComfyUI] File "/root/.ce/.pixi/envs/depthanythingv3-nodes/lib/python3.12/threading.py", line 1032 in _bootstrap [07:35] [ComfyUI] [07:35] [ComfyUI] Current thread 0x0000754c743d6640 (most recent call first): [07:35] [ComfyUI] File "/tmp/comfyui_pvenv_910zmk0o/persistent_worker.py", line 52 in _watchdog [07:35] [ComfyUI] File "/root/.ce/.pixi/envs/depthanythingv3-nodes/lib/python3.12/threading.py", line 1012 in run [07:35] [ComfyUI] File "/root/.ce/.pixi/envs/depthanythingv3-nodes/lib/python3.12/threading.py", line 1075 in _bootstrap_inner [07:35] [ComfyUI] File "/root/.ce/.pixi/envs/depthanythingv3-nodes/lib/python3.12/threading.py", line 1032 in _bootstrap [07:35] [ComfyUI] [07:35] [ComfyUI] Thread 0x0000754c749d1740 (most recent call first): [07:35] [ComfyUI] File "/root/.ce/.pixi/envs/depthanythingv3-nodes/lib/python3.12/site-packages/torch/nn/functional.py", line 4877 in interpolate [07:35] [ComfyUI] File "/workspaces/DepthAnythingV3-2204/ComfyUI/custom_nodes/ComfyUI-DepthAnythingV3/nodes/depth_anything_v3/model.py", line 179 in custom_interpolate [07:35] [ComfyUI] File "/workspaces/DepthAnythingV3-2204/ComfyUI/custom_nodes/ComfyUI-DepthAnythingV3/nodes/depth_anything_v3/model.py", line 1417 in _forward_impl [07:35] [ComfyUI] File "/workspaces/DepthAnythingV3-2204/ComfyUI/custom_nodes/ComfyUI-DepthAnythingV3/nodes/depth_anything_v3/model.py", line 1379 in forward [07:35] [ComfyUI] File "/root/.ce/.pixi/envs/depthanythingv3-nodes/lib/python3.12/site-packages/torch/nn/modules/module.py", line 1790 in _call_impl [07:35] [ComfyUI] File "/root/.ce/.pixi/envs/depthanythingv3-nodes/lib/python3.12/site-packages/torch/nn/modules/module.py", line 1779 in _wrapped_call_impl [07:35] [ComfyUI] File "/workspaces/DepthAnythingV3-2204/ComfyUI/custom_nodes/ComfyUI-DepthAnythingV3/nodes/depth_anything_v3/model.py", line 1591 in _process_depth_head [07:35] [ComfyUI] File "/workspaces/DepthAnythingV3-2204/ComfyUI/custom_nodes/ComfyUI-DepthAnythingV3/nodes/depth_anything_v3/model.py", line 1577 in forward [07:35] [ComfyUI] File "/root/.ce/.pixi/envs/depthanythingv3-nodes/lib/python3.12/site-packages/torch/nn/modules/module.py", line 1790 in _call_impl [07:35] [ComfyUI] File "/root/.ce/.pixi/envs/depthanythingv3-nodes/lib/python3.12/site-packages/torch/nn/modules/module.py", line 1779 in _wrapped_call_impl [07:35] [ComfyUI] File "/workspaces/DepthAnythingV3-2204/ComfyUI/custom_nodes/ComfyUI-DepthAnythingV3/nodes/streaming/pipeline.py", line 330 in _process_chunk [07:35] [ComfyUI] File "/workspaces/DepthAnythingV3-2204/ComfyUI/custom_nodes/ComfyUI-DepthAnythingV3/nodes/streaming/pipeline.py", line 277 in run [07:35] [ComfyUI] File "/workspaces/DepthAnythingV3-2204/ComfyUI/custom_nodes/ComfyUI-DepthAnythingV3/nodes/streaming/node.py", line 249 in execute [07:35] [ComfyUI] File "/workspaces/DepthAnythingV3-2204/ComfyUI/comfy_api/latest/_io.py", line 1833 in EXECUTE_NORMALIZED [07:35] [ComfyUI] File "/tmp/comfyui_pvenv_910zmk0o/persistent_worker.py", line 1762 in main [07:35] [ComfyUI] File "/tmp/comfyui_pvenv_910zmk0o/persistent_worker.py", line 1807 in [07:35] [ComfyUI] [07:35] [ComfyUI] [worker:ComfyUI-DepthAnythingV3] === END === [07:35] [ComfyUI] [07:36] [capture-loop] iter=550 t=61.0s state={'complete': False, 'error': None, 'executedCount': 0, 'wsState': 1} eval_ms=2 ram=7.9/31.3GB (25%) swap=0.5/32.0GB (2%) cpu=11% browser_rss=0.97GB [07:36] [ComfyUI] [worker:ComfyUI-DepthAnythingV3] [VRAM] +206MB (now 4473MB) reserved=5568MB peak=4556MB [07:38] [ComfyUI] [worker:ComfyUI-DepthAnythingV3] [VRAM] -2957MB (now 1517MB) reserved=6912MB peak=4556MB [07:38] [ComfyUI] [SubprocessWorker] callback 'report_progress' from call_id=29 [07:39] [ComfyUI] [worker:ComfyUI-DepthAnythingV3] [VRAM] +1118MB (now 2635MB) reserved=4064MB peak=4556MB [07:40] [ComfyUI] [worker:ComfyUI-DepthAnythingV3] [VRAM] +350MB (now 2986MB) reserved=4416MB peak=4556MB [07:40] Frame 9 saved (frame_008.jpg, t=64.4s) [07:40] [capture-periodic] freeze=1ms shot=135ms unfreeze=3ms saved=True [07:41] [ComfyUI] [worker:ComfyUI-DepthAnythingV3] [VRAM] +350MB (now 3337MB) reserved=4832MB peak=4556MB [07:42] [capture-loop] iter=600 t=66.5s state={'complete': False, 'error': None, 'executedCount': 0, 'wsState': 1} eval_ms=2 ram=8.2/31.3GB (26%) swap=0.5/32.0GB (2%) cpu=11% browser_rss=0.97GB [07:42] [ComfyUI] [worker:ComfyUI-DepthAnythingV3] [VRAM] +350MB (now 3688MB) reserved=5120MB peak=4556MB [07:43] [ComfyUI] [worker:ComfyUI-DepthAnythingV3] [VRAM] +579MB (now 4267MB) reserved=4608MB peak=4556MB [07:46] [ComfyUI] [worker:ComfyUI-DepthAnythingV3] [VRAM] +206MB (now 4473MB) reserved=5472MB peak=4556MB [07:47] [capture-loop] iter=650 t=72.1s state={'complete': False, 'error': None, 'executedCount': 0, 'wsState': 1} eval_ms=2 ram=8.2/31.3GB (26%) swap=0.5/32.0GB (2%) cpu=11% browser_rss=0.97GB [07:47] [ComfyUI] [worker:ComfyUI-DepthAnythingV3] [VRAM] -2957MB (now 1517MB) reserved=7264MB peak=4556MB [07:48] [ComfyUI] [SubprocessWorker] callback 'report_progress' from call_id=29 [07:48] [ComfyUI] [worker:ComfyUI-DepthAnythingV3] [VRAM] +943MB (now 2460MB) reserved=3968MB peak=4556MB [07:49] Frame 10 saved (frame_009.jpg, t=73.3s) [07:49] [capture-periodic] freeze=2ms shot=122ms unfreeze=4ms saved=True [07:49] [ComfyUI] [worker:ComfyUI-DepthAnythingV3] [VRAM] +350MB (now 2811MB) reserved=4160MB peak=4556MB [07:50] [ComfyUI] [worker:ComfyUI-DepthAnythingV3] [VRAM] +350MB (now 3161MB) reserved=4832MB peak=4556MB [07:51] [ComfyUI] [worker:ComfyUI-DepthAnythingV3] [VRAM] +350MB (now 3512MB) reserved=4928MB peak=4556MB [07:53] [ComfyUI] [worker:ComfyUI-DepthAnythingV3] [VRAM] +744MB (now 4257MB) reserved=4544MB peak=4556MB [07:53] [capture-loop] iter=700 t=77.6s state={'complete': False, 'error': None, 'executedCount': 0, 'wsState': 1} eval_ms=2 ram=8.3/31.3GB (27%) swap=0.5/32.0GB (2%) cpu=11% browser_rss=0.97GB [07:56] [ComfyUI] [worker:ComfyUI-DepthAnythingV3] [VRAM] +206MB (now 4463MB) reserved=5440MB peak=4556MB [07:57] [ComfyUI] [worker:ComfyUI-DepthAnythingV3] [VRAM] -2947MB (now 1517MB) reserved=7264MB peak=4556MB [07:58] [ComfyUI] [SubprocessWorker] callback 'report_progress' from call_id=29 [07:58] [capture-loop] iter=750 t=83.2s state={'complete': False, 'error': None, 'executedCount': 0, 'wsState': 1} eval_ms=2 ram=8.4/31.3GB (27%) swap=0.5/32.0GB (2%) cpu=12% browser_rss=0.97GB [07:58] [ComfyUI] [worker:ComfyUI-DepthAnythingV3] [VRAM] +499MB (now 2016MB) reserved=3200MB peak=4556MB [07:59] [ComfyUI] [worker:ComfyUI-DepthAnythingV3] [VRAM] +584MB (now 2601MB) reserved=4000MB peak=4556MB [08:00] Frame 11 saved (frame_010.jpg, t=84.3s) [08:00] [capture-periodic] freeze=1ms shot=104ms unfreeze=1ms saved=True [08:00] [ComfyUI] [worker:ComfyUI-DepthAnythingV3] [VRAM] +686MB (now 3287MB) reserved=3552MB peak=4556MB [08:03] [ComfyUI] [worker:ComfyUI-DepthAnythingV3] [VRAM] -1901MB (now 1387MB) reserved=5504MB peak=4556MB [08:04] [ComfyUI] [SubprocessWorker] callback 'report_progress' from call_id=29 [08:04] [capture-loop] iter=800 t=88.7s state={'complete': False, 'error': None, 'executedCount': 0, 'wsState': 1} eval_ms=6 ram=8.6/31.3GB (28%) swap=0.5/32.0GB (2%) cpu=12% browser_rss=0.97GB [08:04] Frame 12 saved (frame_011.jpg, t=88.8s) [08:04] [capture-periodic] freeze=1ms shot=142ms unfreeze=5ms saved=True [08:04] [ComfyUI] [worker:ComfyUI-DepthAnythingV3] [VRAM] -259MB (now 1128MB) reserved=1216MB peak=4556MB [08:06] [ComfyUI] [worker:ComfyUI-DepthAnythingV3] [VRAM] +214MB (now 1343MB) reserved=1408MB peak=4556MB [08:07] [ComfyUI] [worker:ComfyUI-DepthAnythingV3] [VRAM] -215MB (now 1128MB) reserved=1632MB peak=4556MB [08:08] [ComfyUI] [SubprocessWorker] callback 'report_progress' from call_id=29 [08:09] Frame 13 saved (frame_012.jpg, t=93.3s) [08:09] [capture-periodic] freeze=1ms shot=128ms unfreeze=4ms saved=True [08:09] [ComfyUI] [worker:ComfyUI-DepthAnythingV3] [VRAM] +408MB (now 1536MB) reserved=1632MB peak=4556MB [08:09] [ComfyUI] [SubprocessWorker] callback 'report_progress' from call_id=29 [08:09] [capture-loop] iter=850 t=94.4s state={'complete': False, 'error': None, 'executedCount': 0, 'wsState': 1} eval_ms=2 ram=8.7/31.3GB (28%) swap=0.5/32.0GB (2%) cpu=12% browser_rss=0.97GB [08:10] [ComfyUI] [worker:ComfyUI-DepthAnythingV3] [VRAM] -409MB (now 1128MB) reserved=1728MB peak=4556MB [08:11] [ComfyUI] [SubprocessWorker] callback 'report_progress' from call_id=29 [08:11] Frame 14 saved (frame_013.jpg, t=95.5s) [08:11] [capture-periodic] freeze=3ms shot=141ms unfreeze=6ms saved=True [08:12] [ComfyUI] [worker:ComfyUI-DepthAnythingV3] [VRAM] +215MB (now 1344MB) reserved=1728MB peak=4556MB [08:12] [ComfyUI] [SubprocessWorker] callback 'report_progress' from call_id=29 [08:13] [ComfyUI] [worker:ComfyUI-DepthAnythingV3] [VRAM] -216MB (now 1128MB) reserved=1728MB peak=4556MB [08:13] Frame 15 saved (frame_014.jpg, t=97.8s) [08:13] [capture-periodic] freeze=1ms shot=133ms unfreeze=9ms saved=True [08:14] [ComfyUI] [SubprocessWorker] callback 'report_progress' from call_id=29 [08:15] [ComfyUI] [worker:ComfyUI-DepthAnythingV3] [VRAM] +257MB (now 1385MB) reserved=1728MB peak=4556MB [08:15] [capture-loop] iter=900 t=100.0s state={'complete': False, 'error': None, 'executedCount': 0, 'wsState': 1} eval_ms=2 ram=9.3/31.3GB (30%) swap=0.5/32.0GB (2%) cpu=12% browser_rss=0.98GB [08:15] Frame 16 saved (frame_015.jpg, t=100.1s) [08:15] [capture-periodic] freeze=2ms shot=138ms unfreeze=5ms saved=True [08:15] [ComfyUI] [SubprocessWorker] callback 'report_progress' from call_id=29 [08:16] [ComfyUI] [worker:ComfyUI-DepthAnythingV3] [VRAM] -258MB (now 1128MB) reserved=1728MB peak=4556MB [08:17] [ComfyUI] [SubprocessWorker] callback 'report_progress' from call_id=29 [08:17] [ComfyUI] [worker:ComfyUI-DepthAnythingV3] WARNING: faiss not installed, skipping loop closure. pip install faiss-cpu [08:18] Frame 17 saved (frame_016.jpg, t=102.3s) [08:18] [capture-periodic] freeze=2ms shot=140ms unfreeze=3ms saved=True [08:21] [capture-loop] iter=950 t=105.6s state={'complete': False, 'error': None, 'executedCount': 0, 'wsState': 1} eval_ms=2 ram=10.9/31.3GB (35%) swap=0.5/32.0GB (2%) cpu=12% browser_rss=0.98GB [08:21] [ComfyUI] [SubprocessWorker] callback 'report_progress' from call_id=29 [08:22] Frame 18 saved (frame_017.jpg, t=106.8s) [08:22] [capture-periodic] freeze=1ms shot=137ms unfreeze=3ms saved=True [08:26] [capture-loop] iter=1000 t=111.1s state={'complete': False, 'error': None, 'executedCount': 0, 'wsState': 1} eval_ms=2 ram=8.4/31.3GB (27%) swap=0.5/32.0GB (2%) cpu=11% browser_rss=0.98GB [08:32] [capture-loop] iter=1050 t=116.7s state={'complete': False, 'error': None, 'executedCount': 0, 'wsState': 1} eval_ms=2 ram=8.4/31.3GB (27%) swap=0.5/32.0GB (2%) cpu=12% browser_rss=0.98GB [08:35] [ComfyUI] [worker:ComfyUI-DepthAnythingV3] [08:35] [ComfyUI] === WATCHDOG TICK 2 === [08:35] [ComfyUI] [worker:ComfyUI-DepthAnythingV3] Thread 0x00007548ca140640 (most recent call first): [08:35] [ComfyUI] File "/root/.ce/.pixi/envs/depthanythingv3-nodes/lib/python3.12/threading.py", line 359 in wait [08:35] [ComfyUI] File "/root/.ce/.pixi/envs/depthanythingv3-nodes/lib/python3.12/threading.py", line 655 in wait [08:35] [ComfyUI] File "/root/.ce/.pixi/envs/depthanythingv3-nodes/lib/python3.12/site-packages/tqdm/_monitor.py", line 60 in run [08:35] [ComfyUI] File "/root/.ce/.pixi/envs/depthanythingv3-nodes/lib/python3.12/threading.py", line 1075 in _bootstrap_inner [08:35] [ComfyUI] File "/root/.ce/.pixi/envs/depthanythingv3-nodes/lib/python3.12/threading.py", line 1032 in _bootstrap [08:35] [ComfyUI] [08:35] [ComfyUI] Thread 0x0000754c73bd1640 (most recent call first): [08:35] [ComfyUI] File "/tmp/comfyui_pvenv_910zmk0o/persistent_worker.py", line 106 in _vram_poller [08:35] [ComfyUI] File "/root/.ce/.pixi/envs/depthanythingv3-nodes/lib/python3.12/threading.py", line 1012 in run [08:35] [ComfyUI] File "/root/.ce/.pixi/envs/depthanythingv3-nodes/lib/python3.12/threading.py", line 1075 in _bootstrap_inner [08:35] [ComfyUI] File "/root/.ce/.pixi/envs/depthanythingv3-nodes/lib/python3.12/threading.py", line 1032 in _bootstrap [08:35] [ComfyUI] [08:35] [ComfyUI] Current thread 0x0000754c743d6640 (most recent call first): [08:35] [ComfyUI] File "/tmp/comfyui_pvenv_910zmk0o/persistent_worker.py", line 52 in _watchdog [08:35] [ComfyUI] File "/root/.ce/.pixi/envs/depthanythingv3-nodes/lib/python3.12/threading.py", line 1012 in run [08:35] [ComfyUI] File "/root/.ce/.pixi/envs/depthanythingv3-nodes/lib/python3.12/threading.py", line 1075 in _bootstrap_inner [08:35] [ComfyUI] File "/root/.ce/.pixi/envs/depthanythingv3-nodes/lib/python3.12/threading.py", line 1032 in _bootstrap [08:35] [ComfyUI] [08:35] [ComfyUI] Thread 0x0000754c749d1740 (most recent call first): [08:35] [ComfyUI] File "/root/.ce/.pixi/envs/depthanythingv3-nodes/lib/python3.12/zipfile/__init__.py", line 1235 in write [08:35] [ComfyUI] File "/root/.ce/.pixi/envs/depthanythingv3-nodes/lib/python3.12/site-packages/numpy/lib/_format_impl.py", line 777 in write_array [08:35] [ComfyUI] File "/root/.ce/.pixi/envs/depthanythingv3-nodes/lib/python3.12/site-packages/numpy/lib/_npyio_impl.py", line 786 in _savez [08:35] [ComfyUI] File "/root/.ce/.pixi/envs/depthanythingv3-nodes/lib/python3.12/site-packages/numpy/lib/_npyio_impl.py", line 753 in savez_compressed [08:35] [ComfyUI] File "/workspaces/DepthAnythingV3-2204/ComfyUI/custom_nodes/ComfyUI-DepthAnythingV3/nodes/streaming/node.py", line 271 in execute [08:35] [ComfyUI] File "/workspaces/DepthAnythingV3-2204/ComfyUI/comfy_api/latest/_io.py", line 1833 in EXECUTE_NORMALIZED [08:35] [ComfyUI] File "/tmp/comfyui_pvenv_910zmk0o/persistent_worker.py", line 1762 in main [08:35] [ComfyUI] File "/tmp/comfyui_pvenv_910zmk0o/persistent_worker.py", line 1807 in [08:35] [ComfyUI] [08:35] [ComfyUI] [worker:ComfyUI-DepthAnythingV3] === END === [08:35] [ComfyUI] [08:37] [capture-loop] iter=1100 t=122.2s state={'complete': False, 'error': None, 'executedCount': 0, 'wsState': 1} eval_ms=2 ram=8.4/31.3GB (27%) swap=0.5/32.0GB (2%) cpu=11% browser_rss=0.98GB [08:43] [capture-loop] iter=1150 t=127.7s state={'complete': False, 'error': None, 'executedCount': 0, 'wsState': 1} eval_ms=2 ram=8.3/31.3GB (27%) swap=0.5/32.0GB (2%) cpu=11% browser_rss=0.98GB [08:48] [capture-loop] iter=1200 t=133.2s state={'complete': False, 'error': None, 'executedCount': 0, 'wsState': 1} eval_ms=2 ram=8.3/31.3GB (27%) swap=0.5/32.0GB (2%) cpu=11% browser_rss=0.98GB [08:54] [capture-loop] iter=1250 t=138.7s state={'complete': False, 'error': None, 'executedCount': 0, 'wsState': 1} eval_ms=2 ram=9.0/31.3GB (29%) swap=0.5/32.0GB (2%) cpu=11% browser_rss=0.98GB [08:59] [capture-loop] iter=1300 t=144.2s state={'complete': False, 'error': None, 'executedCount': 0, 'wsState': 1} eval_ms=2 ram=8.8/31.3GB (28%) swap=0.5/32.0GB (2%) cpu=11% browser_rss=0.98GB [09:00] [ComfyUI] [SubprocessWorker] got response: ok [09:02] [ComfyUI] [comfy-env] Created 2 model patchers: ['DepthAnything3Net_1', 'VPRModel_2'] [09:02] [ComfyUI] [comfy-env] DepthAnythingV3_Streaming done (140.05s): result: NodeOutput [09:02] [ComfyUI] [VRAM] After DepthAnythingV3_Streaming: 2171 / 7703 MB [09:02] [ComfyUI] [VRAM] Loaded: SubprocessModel (335 MB), SubprocessModel (783 MB) [09:04] [ComfyUI] Prompt executed in 148.39 seconds [09:04] Node executed (1 total), capturing... [09:04] Frame 19 saved (frame_018.jpg, t=148.8s) [09:04] [capture-node] freeze=2ms shot=128ms unfreeze=10ms saved=True [09:04] Execution complete (t=149.0s) [09:04] Captured 19 unique frames over 149.05s [09:04] [debug] iframes: 0 [09:04] [timing] trigger_3d_previews: 0.0s [09:06] Saved high-quality screenshot: da3_streaming_executed.png [09:06] [timing] final_screenshot: 0.3s [09:07] [ComfyUI] [comfy-env] [VRAM] Before offload 'VPRModel_2' (335 MB) -> cpu: 2171 / 7703 MB [09:07] Capturing execution frames: simple.json [09:07] [ComfyUI] [ComfyUI-DepthAnythingV3] Health check: ping (timeout=5.0s)... [09:07] [ComfyUI] [ComfyUI-DepthAnythingV3] Health check: ok [09:07] [ComfyUI] [SubprocessWorker] call_id=30 sending model_to_device [09:07] [ComfyUI] [comfy-env] [VRAM] After offload 'VPRModel_2' (335 MB): 1339 / 7703 MB [09:07] [ComfyUI] [comfy-env] [VRAM] Before offload 'DepthAnything3Net_1' (783 MB) -> cpu: 1339 / 7703 MB [09:07] [ComfyUI] [ComfyUI-DepthAnythingV3] Health check: ping (timeout=5.0s)... [09:07] [ComfyUI] [ComfyUI-DepthAnythingV3] Health check: ok [09:07] [ComfyUI] [SubprocessWorker] call_id=31 sending model_to_device [09:07] [ComfyUI] [worker:ComfyUI-DepthAnythingV3] [VRAM] -336MB (now 792MB) reserved=896MB peak=4556MB [09:07] [ComfyUI] [comfy-env] [VRAM] After offload 'DepthAnything3Net_1' (783 MB): 539 / 7703 MB [09:12] Frame 1 saved (frame_000.jpg, t=0.0s) [09:12] Validating workflow... [09:12] [ComfyUI] === /validate endpoint called === [09:12] [ComfyUI] Received JSON with keys: ['prompt'] [09:12] [ComfyUI] Prompt has 4 nodes [09:12] [ComfyUI] Node 2: LoadImage [09:12] Queuing workflow for execution... [09:12] [ComfyUI] Inputs: {"image": "bridge.jpg"} [09:12] [ComfyUI] Node 3: DownloadAndLoadDepthAnythingV3Model [09:12] [ComfyUI] Inputs: {"model": "da3_large.safetensors", "precision": "auto", "attention": "auto"} [09:12] [ComfyUI] Node 4: PreviewImage [09:12] [ComfyUI] Inputs: {"images": ["14", 0]} [09:12] [ComfyUI] Node 14: DepthAnything_V3 [09:12] [ComfyUI] Inputs: {"normalization_mode": "V2-Style", "resize_method": "resize", "invert_depth": true, "keep_model_size": false, "da3_model": ["3", 0], "images": ["2", 0]} [09:12] [ComfyUI] Generated prompt_id: bbd7c9a2-53ac-48e0-beb9-ef67524f8473 [09:12] [ComfyUI] Calling execution.validate_prompt()... [09:12] [ComfyUI] Validation result: valid=True [09:12] [ComfyUI] === Validation PASSED === [09:12] [ComfyUI] got prompt [09:12] [ComfyUI] [comfy-env] Running DownloadAndLoadDepthAnythingV3Model: model: 'da3_large.safetensors', precision: 'auto', attention: 'auto' [09:12] [ComfyUI] [VRAM] Before DownloadAndLoadDepthAnythingV3Model: 539 / 7703 MB [09:12] [ComfyUI] [SubprocessWorker] call_method: nodes.load_model.DownloadAndLoadDepthAnythingV3Model.EXECUTE_NORMALIZED [09:12] [ComfyUI] [SubprocessWorker] acquired lock, ensuring started... [09:12] [ComfyUI] [ComfyUI-DepthAnythingV3] Health check: ping (timeout=5.0s)... [09:12] [ComfyUI] [ComfyUI-DepthAnythingV3] Health check: failed [09:12] [ComfyUI] [ComfyUI-DepthAnythingV3] Socket unhealthy, restarting worker... [09:12] [ComfyUI] [ComfyUI-DepthAnythingV3] python: /root/.ce/.pixi/envs/depthanythingv3-nodes/bin/python [09:12] [ComfyUI] [comfy-env] Invalidated 2 stale model patchers (will be cleaned up during next unload) [09:12] [ComfyUI] [ComfyUI-DepthAnythingV3] sys_path sent to worker: ['/workspaces/DepthAnythingV3-2204/ComfyUI', '/workspaces/DepthAnythingV3-2204/ComfyUI/custom_nodes/ComfyUI-DepthAnythingV3', '/root/.ce/.pixi/envs/depthanythingv3-nodes/lib/python3.12/site-packages', '/workspaces/DepthAnythingV3-2204/ComfyUI/custom_nodes/ComfyUI-DepthAnythingV3'] [09:12] [ComfyUI] [SubprocessWorker] is_pixi=True, python=/root/.ce/.pixi/envs/depthanythingv3-nodes/bin/python [09:12] [ComfyUI] [SubprocessWorker] launching cmd=['/root/.pixi/bin/pixi', 'run', '--as-is', '--manifest-path', '/root/.ce/pixi.toml', '-e', 'depthanythingv3-nodes', 'python', '/tmp/comfyui_pvenv_910zmk0o/persistent_worker.py', 'abstract://comfy_worker_222e57755442']... [09:12] [ComfyUI] [SubprocessWorker] socket_addr=abstract://comfy_worker_222e57755442 (abstract, no filesystem path) [09:14] [ComfyUI] [worker:ComfyUI-DepthAnythingV3] ERROR: Failed to import comfy_kitchen, Error: No module named 'comfy_kitchen', fp8 and fp4 support will not be available. [09:14] [ComfyUI] [SubprocessWorker] worker started/confirmed [09:14] [ComfyUI] [SubprocessWorker] serializing kwargs to shm... [09:14] [ComfyUI] [SubprocessWorker] created 0 shm blocks [09:14] [ComfyUI] [SubprocessWorker] sending request via socket... [09:14] [ComfyUI] [SubprocessWorker] call_id=32 sending call_method [09:14] [ComfyUI] [SubprocessWorker] got response: ok [09:14] [ComfyUI] [comfy-env] [VRAM] Before offload 'VPRModel_2' (335 MB) -> cpu: 269 / 7703 MB [09:14] [ComfyUI] [ComfyUI-DepthAnythingV3] Health check: ping (timeout=5.0s)... [09:14] [ComfyUI] [ComfyUI-DepthAnythingV3] Health check: ok [09:14] [ComfyUI] [SubprocessWorker] call_id=33 sending model_to_device [09:14] [ComfyUI] Model 'VPRModel_2' gone from worker (restarted?), treating as offloaded [09:14] [ComfyUI] [comfy-env] [VRAM] After offload 'VPRModel_2' (335 MB): 269 / 7703 MB [09:14] [ComfyUI] [comfy-env] [VRAM] Before offload 'DepthAnything3Net_1' (783 MB) -> cpu: 269 / 7703 MB [09:14] [ComfyUI] [ComfyUI-DepthAnythingV3] Health check: ping (timeout=5.0s)... [09:14] [ComfyUI] [ComfyUI-DepthAnythingV3] Health check: ok [09:14] [ComfyUI] [SubprocessWorker] call_id=34 sending model_to_device [09:14] [ComfyUI] Model 'DepthAnything3Net_1' gone from worker (restarted?), treating as offloaded [09:14] [ComfyUI] [comfy-env] [VRAM] After offload 'DepthAnything3Net_1' (783 MB): 269 / 7703 MB [09:14] [ComfyUI] [comfy-env] DownloadAndLoadDepthAnythingV3Model done (1.81s): result: NodeOutput [09:14] [ComfyUI] [VRAM] After DownloadAndLoadDepthAnythingV3Model: 269 / 7703 MB [09:14] [ComfyUI] [comfy-env] Running DepthAnything_V3: normalization_mode: 'V2-Style', resize_method: 'resize', invert_depth: True, keep_model_size: False, da3_model: dict, images: torch.float32 [1,683,1024,3] cpu [09:14] [ComfyUI] [VRAM] Before DepthAnything_V3: 269 / 7703 MB [09:14] [ComfyUI] [SubprocessWorker] call_method: nodes.nodes_inference.DepthAnything_V3.EXECUTE_NORMALIZED [09:14] [ComfyUI] [SubprocessWorker] acquired lock, ensuring started... [09:14] [ComfyUI] [ComfyUI-DepthAnythingV3] Health check: ping (timeout=5.0s)... [09:14] [ComfyUI] [ComfyUI-DepthAnythingV3] Health check: ok [09:14] [ComfyUI] [SubprocessWorker] worker started/confirmed [09:14] [ComfyUI] [comfy-env] PRE-SERIALIZE 'images' shape: torch.Size([1, 683, 1024, 3]) [09:14] [ComfyUI] [SubprocessWorker] serializing kwargs to shm... [09:14] [ComfyUI] [SubprocessWorker] created 0 shm blocks [09:14] [ComfyUI] [SubprocessWorker] sending request via socket... [09:14] [ComfyUI] [SubprocessWorker] call_id=35 sending call_method [09:14] [ComfyUI] [worker:ComfyUI-DepthAnythingV3] [comfy-env] _from_shm got dict with keys: ['__type__', 'strategy', 'parent_pid', 'fd', 'storage_size'] [09:14] [ComfyUI] [worker:ComfyUI-DepthAnythingV3] [comfy-env] DESERIALIZE TensorRef: tensor_size=[1, 683, 1024, 3] [09:14] [ComfyUI] [worker:ComfyUI-DepthAnythingV3] [comfy-env] DESERIALIZED tensor shape: torch.Size([1, 683, 1024, 3]) [09:14] [ComfyUI] [worker:ComfyUI-DepthAnythingV3] WARNING: No comfy kitchen, using old apply_rope functions. [09:15] Frame 2 saved (frame_001.jpg, t=2.4s) [09:15] [capture-periodic] freeze=1ms shot=117ms unfreeze=3ms saved=True [09:16] [ComfyUI] [SubprocessWorker] callback 'request_vram_budget' from call_id=35 [09:16] [ComfyUI] [comfy-env] VRAM request: 0.82GB, free before eviction: 7.80GB [09:16] [ComfyUI] [comfy-env] VRAM after eviction: 7.80GB [09:16] [ComfyUI] [worker:ComfyUI-DepthAnythingV3] [VRAM] +258MB (now 258MB) reserved=288MB peak=258MB [09:16] [ComfyUI] [worker:ComfyUI-DepthAnythingV3] WARNING: WARNING: This model does not support sky segmentation. V2-Style normalization will work but without sky masking. Use Mono/Metric/Nested models for best V2-Style results. [09:17] Frame 3 saved (frame_002.jpg, t=4.6s) [09:17] [capture-periodic] freeze=1ms shot=149ms unfreeze=2ms saved=True [09:17] [ComfyUI] [worker:ComfyUI-DepthAnythingV3] [VRAM] +553MB (now 812MB) reserved=2560MB peak=1505MB [09:17] [ComfyUI] [SubprocessWorker] callback 'report_progress' from call_id=35 [09:17] [ComfyUI] [SubprocessWorker] got response: ok [09:17] [ComfyUI] [comfy-env] Created 1 model patchers: ['DepthAnything3Net_1'] [09:17] [ComfyUI] [comfy-env] DepthAnything_V3 done (3.22s): result: NodeOutput [09:17] [ComfyUI] [VRAM] After DepthAnything_V3: 2937 / 7703 MB [09:17] [ComfyUI] [VRAM] Loaded: SubprocessModel (783 MB) [09:17] [ComfyUI] Prompt executed in 5.09 seconds [09:17] [ComfyUI] [comfy-env] [VRAM] Before offload 'DepthAnything3Net_1' (783 MB) -> cpu: 2937 / 7703 MB [09:17] [ComfyUI] [ComfyUI-DepthAnythingV3] Health check: ping (timeout=5.0s)... [09:17] [ComfyUI] [ComfyUI-DepthAnythingV3] Health check: ok [09:17] [ComfyUI] [SubprocessWorker] call_id=36 sending model_to_device [09:17] Node executed (1 total), capturing... [09:18] Frame 4 saved (frame_003.jpg, t=5.5s) [09:18] [capture-node] freeze=2ms shot=156ms unfreeze=0ms saved=True [09:18] Execution complete (t=5.5s) [09:18] Captured 4 unique frames over 5.76s [09:18] [debug] iframes: 0 [09:18] [timing] trigger_3d_previews: 0.0s [09:18] [ComfyUI] [comfy-env] [VRAM] After offload 'DepthAnything3Net_1' (783 MB): 441 / 7703 MB [09:20] Saved high-quality screenshot: simple_executed.png [09:20] [timing] final_screenshot: 0.3s [09:20] Capturing execution frames: video_multiview_depth.json [09:26] Frame 1 saved (frame_000.jpg, t=0.0s) [09:26] Validating workflow... [09:26] [ComfyUI] === /validate endpoint called === [09:26] [ComfyUI] Received JSON with keys: ['prompt'] [09:26] [ComfyUI] Prompt has 9 nodes [09:26] [ComfyUI] Node 3: DownloadAndLoadDepthAnythingV3Model [09:26] [ComfyUI] Inputs: {"model": "da3_base.safetensors", "precision": "auto", "attention": "auto"} [09:26] [ComfyUI] Node 52: CreateVideo [09:26] Queuing workflow for execution... [09:26] [ComfyUI] Inputs: {"fps": 10, "images": ["62", 0]} [09:26] [ComfyUI] Node 53: CreateVideo [09:26] [ComfyUI] Inputs: {"fps": 10, "images": ["61", 0]} [09:26] [ComfyUI] Node 54: SaveVideo [09:26] [ComfyUI] Inputs: {"filename_prefix": "video/ComfyUI", "format": "auto", "codec": "auto", "video": ["52", 0]} [09:26] [ComfyUI] Node 55: SaveVideo [09:26] [ComfyUI] Inputs: {"filename_prefix": "video/ComfyUI", "format": "auto", "codec": "auto", "video": ["53", 0]} [09:26] [ComfyUI] Node 61: DepthAnything_V3 [09:26] [ComfyUI] Inputs: {"normalization_mode": "V2-Style", "resize_method": "resize", "invert_depth": false, "keep_model_size": false, "da3_model": ["3", 0], "images": ["71", 0]} [09:26] [ComfyUI] Node 62: DepthAnythingV3_MultiView [09:26] [ComfyUI] Inputs: {"normalization_mode": "V2-Style", "resize_method": "resize", "invert_depth": false, "keep_model_size": false, "da3_model": ["3", 0], "images": ["71", 0]} [09:26] [ComfyUI] Node 66: PreviewImage [09:26] [ComfyUI] Inputs: {"images": ["71", 0]} [09:26] [ComfyUI] Node 71: LoadImagesFromFolderKJ [09:26] [ComfyUI] Inputs: {"folder": "input/robotframes", "width": 1024, "height": 576, "keep_aspect_ratio": "crop", "image_load_cap": 0, "start_index": 0, "include_subfolders": false} [09:26] [ComfyUI] Generated prompt_id: 924a6a5f-68d9-45fa-8ecb-14d1b5f3f643 [09:26] [ComfyUI] Calling execution.validate_prompt()... [09:26] [ComfyUI] Validation result: valid=True [09:26] [ComfyUI] === Validation PASSED === [09:26] [ComfyUI] got prompt [09:27] [ComfyUI] [comfy-env] Running DownloadAndLoadDepthAnythingV3Model: model: 'da3_base.safetensors', precision: 'auto', attention: 'auto' [09:27] [ComfyUI] [VRAM] Before DownloadAndLoadDepthAnythingV3Model: 441 / 7703 MB [09:27] [ComfyUI] [SubprocessWorker] call_method: nodes.load_model.DownloadAndLoadDepthAnythingV3Model.EXECUTE_NORMALIZED [09:27] [ComfyUI] [SubprocessWorker] acquired lock, ensuring started... [09:27] [ComfyUI] [ComfyUI-DepthAnythingV3] Health check: ping (timeout=5.0s)... [09:27] [ComfyUI] [ComfyUI-DepthAnythingV3] Health check: failed [09:27] [ComfyUI] [ComfyUI-DepthAnythingV3] Socket unhealthy, restarting worker... [09:27] [ComfyUI] [comfy-env] Invalidated 1 stale model patchers (will be cleaned up during next unload) [09:27] [ComfyUI] [ComfyUI-DepthAnythingV3] python: /root/.ce/.pixi/envs/depthanythingv3-nodes/bin/python [09:27] [ComfyUI] [ComfyUI-DepthAnythingV3] sys_path sent to worker: ['/workspaces/DepthAnythingV3-2204/ComfyUI', '/workspaces/DepthAnythingV3-2204/ComfyUI/custom_nodes/ComfyUI-DepthAnythingV3', '/root/.ce/.pixi/envs/depthanythingv3-nodes/lib/python3.12/site-packages', '/workspaces/DepthAnythingV3-2204/ComfyUI/custom_nodes/ComfyUI-DepthAnythingV3'] [09:27] [ComfyUI] [SubprocessWorker] is_pixi=True, python=/root/.ce/.pixi/envs/depthanythingv3-nodes/bin/python [09:27] [ComfyUI] [SubprocessWorker] launching cmd=['/root/.pixi/bin/pixi', 'run', '--as-is', '--manifest-path', '/root/.ce/pixi.toml', '-e', 'depthanythingv3-nodes', 'python', '/tmp/comfyui_pvenv_910zmk0o/persistent_worker.py', 'abstract://comfy_worker_f776a1f91e79']... [09:27] [ComfyUI] [SubprocessWorker] socket_addr=abstract://comfy_worker_f776a1f91e79 (abstract, no filesystem path) [09:27] Node executed (1 total), capturing... [09:27] Frame 2 saved (frame_001.jpg, t=1.3s) [09:27] [capture-node] freeze=2ms shot=142ms unfreeze=7ms saved=True [09:28] [ComfyUI] [worker:ComfyUI-DepthAnythingV3] ERROR: Failed to import comfy_kitchen, Error: No module named 'comfy_kitchen', fp8 and fp4 support will not be available. [09:28] [ComfyUI] [SubprocessWorker] worker started/confirmed [09:28] [ComfyUI] [SubprocessWorker] serializing kwargs to shm... [09:28] [ComfyUI] [SubprocessWorker] created 0 shm blocks [09:28] [ComfyUI] [SubprocessWorker] sending request via socket... [09:28] [ComfyUI] [SubprocessWorker] call_id=37 sending call_method [09:29] [ComfyUI] Warning: You are sending unauthenticated requests to the HF Hub. Please set a HF_TOKEN to enable higher rate limits and faster downloads. [09:29] [ComfyUI] [worker:ComfyUI-DepthAnythingV3] WARNING: Warning: You are sending unauthenticated requests to the HF Hub. Please set a HF_TOKEN to enable higher rate limits and faster downloads. [09:29] [ComfyUI] [09:32] Frame 3 saved (frame_002.jpg, t=5.8s) [09:32] [capture-periodic] freeze=1ms shot=134ms unfreeze=5ms saved=True [09:32] [capture-loop] iter=50 t=6.1s state={'complete': False, 'error': None, 'executedCount': 1, 'wsState': 1} eval_ms=2 ram=4.4/31.3GB (14%) swap=0.5/32.0GB (2%) cpu=13% browser_rss=1.19GB [09:33] [ComfyUI] model.safetensors: 0%| | 0.00/542M [00:00 cpu: 269 / 7703 MB [09:35] [ComfyUI] [ComfyUI-DepthAnythingV3] Health check: ping (timeout=5.0s)... [09:35] [ComfyUI] [ComfyUI-DepthAnythingV3] Health check: ok [09:35] [ComfyUI] [SubprocessWorker] call_id=38 sending model_to_device [09:35] [ComfyUI] Model 'DepthAnything3Net_1' gone from worker (restarted?), treating as offloaded [09:35] [ComfyUI] [comfy-env] [VRAM] After offload 'DepthAnything3Net_1' (783 MB): 269 / 7703 MB [09:35] [ComfyUI] [comfy-env] DownloadAndLoadDepthAnythingV3Model done (8.09s): result: NodeOutput [09:35] [ComfyUI] [VRAM] After DownloadAndLoadDepthAnythingV3Model: 269 / 7703 MB [09:35] [ComfyUI] [comfy-env] Running DepthAnythingV3_MultiView: normalization_mode: 'V2-Style', resize_method: 'resize', invert_depth: False, keep_model_size: False, da3_model: dict, images: torch.float32 [13,576,1024,3] cpu [09:35] [ComfyUI] [VRAM] Before DepthAnythingV3_MultiView: 269 / 7703 MB [09:35] [ComfyUI] [SubprocessWorker] call_method: nodes.nodes_multiview.DepthAnythingV3_MultiView.EXECUTE_NORMALIZED [09:35] [ComfyUI] [SubprocessWorker] acquired lock, ensuring started... [09:35] [ComfyUI] [ComfyUI-DepthAnythingV3] Health check: ping (timeout=5.0s)... [09:35] [ComfyUI] [ComfyUI-DepthAnythingV3] Health check: ok [09:35] [ComfyUI] [SubprocessWorker] worker started/confirmed [09:35] [ComfyUI] [comfy-env] PRE-SERIALIZE 'images' shape: torch.Size([13, 576, 1024, 3]) [09:35] [ComfyUI] [SubprocessWorker] serializing kwargs to shm... [09:35] [ComfyUI] [SubprocessWorker] created 0 shm blocks [09:35] [ComfyUI] [SubprocessWorker] sending request via socket... [09:35] [ComfyUI] [SubprocessWorker] call_id=39 sending call_method [09:35] [ComfyUI] [worker:ComfyUI-DepthAnythingV3] [comfy-env] _from_shm got dict with keys: ['__type__', 'strategy', 'parent_pid', 'fd', 'storage_size'] [09:35] [ComfyUI] [worker:ComfyUI-DepthAnythingV3] [comfy-env] DESERIALIZE TensorRef: tensor_size=[13, 576, 1024, 3] [09:35] [ComfyUI] [worker:ComfyUI-DepthAnythingV3] [comfy-env] DESERIALIZED tensor shape: torch.Size([13, 576, 1024, 3]) [09:35] [ComfyUI] [worker:ComfyUI-DepthAnythingV3] WARNING: No comfy kitchen, using old apply_rope functions. [09:36] Frame 5 saved (frame_004.jpg, t=10.3s) [09:36] [capture-periodic] freeze=2ms shot=134ms unfreeze=6ms saved=True [09:36] [ComfyUI] [SubprocessWorker] callback 'request_vram_budget' from call_id=39 [09:36] [ComfyUI] [comfy-env] VRAM request: 0.27GB, free before eviction: 7.80GB [09:36] [ComfyUI] [comfy-env] VRAM after eviction: 7.80GB [09:36] [ComfyUI] [worker:ComfyUI-DepthAnythingV3] WARNING: WARNING: This model does not support sky segmentation. V2-Style normalization will work but without sky masking. Use Mono/Metric/Nested models for best V2-Style results. [09:36] [ComfyUI] [worker:ComfyUI-DepthAnythingV3] [VRAM] +258MB (now 258MB) reserved=288MB peak=258MB [09:37] [capture-loop] iter=100 t=11.6s state={'complete': False, 'error': None, 'executedCount': 1, 'wsState': 1} eval_ms=2 ram=5.1/31.3GB (16%) swap=0.5/32.0GB (2%) cpu=13% browser_rss=1.03GB [09:37] [ComfyUI] [worker:ComfyUI-DepthAnythingV3] [VRAM] +795MB (now 1053MB) reserved=1696MB peak=1053MB [09:38] [ComfyUI] [worker:ComfyUI-DepthAnythingV3] [VRAM] +404MB (now 1458MB) reserved=1888MB peak=1458MB [09:39] [ComfyUI] [worker:ComfyUI-DepthAnythingV3] [VRAM] -805MB (now 653MB) reserved=2688MB peak=1458MB [09:40] [ComfyUI] [SubprocessWorker] got response: ok [09:40] [ComfyUI] [comfy-env] Created 1 model patchers: ['DepthAnything3Net_1'] [09:40] [ComfyUI] [comfy-env] DepthAnythingV3_MultiView done (5.47s): result: NodeOutput [09:40] [ComfyUI] [VRAM] After DepthAnythingV3_MultiView: 3065 / 7703 MB [09:40] [ComfyUI] [VRAM] Loaded: SubprocessModel (258 MB) [09:40] [ComfyUI] [comfy-env] Running DepthAnything_V3: normalization_mode: 'V2-Style', resize_method: 'resize', invert_depth: False, keep_model_size: False, da3_model: dict, images: torch.float32 [13,576,1024,3] cpu [09:40] [ComfyUI] [VRAM] Before DepthAnything_V3: 3065 / 7703 MB [09:40] [ComfyUI] [VRAM] Loaded: SubprocessModel (258 MB) [09:40] [ComfyUI] [SubprocessWorker] call_method: nodes.nodes_inference.DepthAnything_V3.EXECUTE_NORMALIZED [09:40] [ComfyUI] [SubprocessWorker] acquired lock, ensuring started... [09:40] [ComfyUI] [ComfyUI-DepthAnythingV3] Health check: ping (timeout=5.0s)... [09:40] [ComfyUI] [ComfyUI-DepthAnythingV3] Health check: failed [09:40] [ComfyUI] [ComfyUI-DepthAnythingV3] Socket unhealthy, restarting worker... [09:40] [ComfyUI] [comfy-env] Invalidated 1 stale model patchers (will be cleaned up during next unload) [09:40] [ComfyUI] [ComfyUI-DepthAnythingV3] python: /root/.ce/.pixi/envs/depthanythingv3-nodes/bin/python [09:40] [ComfyUI] [ComfyUI-DepthAnythingV3] sys_path sent to worker: ['/workspaces/DepthAnythingV3-2204/ComfyUI', '/workspaces/DepthAnythingV3-2204/ComfyUI/custom_nodes/ComfyUI-DepthAnythingV3', '/root/.ce/.pixi/envs/depthanythingv3-nodes/lib/python3.12/site-packages', '/workspaces/DepthAnythingV3-2204/ComfyUI/custom_nodes/ComfyUI-DepthAnythingV3'] [09:40] [ComfyUI] [SubprocessWorker] is_pixi=True, python=/root/.ce/.pixi/envs/depthanythingv3-nodes/bin/python [09:40] [ComfyUI] [SubprocessWorker] launching cmd=['/root/.pixi/bin/pixi', 'run', '--as-is', '--manifest-path', '/root/.ce/pixi.toml', '-e', 'depthanythingv3-nodes', 'python', '/tmp/comfyui_pvenv_910zmk0o/persistent_worker.py', 'abstract://comfy_worker_6a4c121e7368']... [09:40] [ComfyUI] [SubprocessWorker] socket_addr=abstract://comfy_worker_6a4c121e7368 (abstract, no filesystem path) [09:41] Frame 6 saved (frame_005.jpg, t=14.8s) [09:41] [capture-periodic] freeze=1ms shot=108ms unfreeze=1ms saved=True [09:41] Node executed (2 total), capturing... [09:41] Frame 7 saved (frame_006.jpg, t=15.2s) [09:41] [capture-node] freeze=2ms shot=143ms unfreeze=1ms saved=True [09:42] [ComfyUI] [worker:ComfyUI-DepthAnythingV3] ERROR: Failed to import comfy_kitchen, Error: No module named 'comfy_kitchen', fp8 and fp4 support will not be available. [09:42] [ComfyUI] [SubprocessWorker] worker started/confirmed [09:42] [ComfyUI] [comfy-env] PRE-SERIALIZE 'images' shape: torch.Size([13, 576, 1024, 3]) [09:42] [ComfyUI] [SubprocessWorker] serializing kwargs to shm... [09:42] [ComfyUI] [SubprocessWorker] created 0 shm blocks [09:42] [ComfyUI] [SubprocessWorker] sending request via socket... [09:42] [ComfyUI] [SubprocessWorker] call_id=40 sending call_method [09:42] [ComfyUI] [worker:ComfyUI-DepthAnythingV3] [comfy-env] _from_shm got dict with keys: ['__type__', 'strategy', 'parent_pid', 'fd', 'storage_size'] [09:42] [ComfyUI] [worker:ComfyUI-DepthAnythingV3] [comfy-env] DESERIALIZE TensorRef: tensor_size=[13, 576, 1024, 3] [09:42] [ComfyUI] [worker:ComfyUI-DepthAnythingV3] [comfy-env] DESERIALIZED tensor shape: torch.Size([13, 576, 1024, 3]) [09:42] [ComfyUI] [worker:ComfyUI-DepthAnythingV3] WARNING: No comfy kitchen, using old apply_rope functions. [09:43] [capture-loop] iter=150 t=17.4s state={'complete': False, 'error': None, 'executedCount': 2, 'wsState': 1} eval_ms=2 ram=4.6/31.3GB (15%) swap=0.5/32.0GB (2%) cpu=18% browser_rss=1.04GB [09:43] Frame 8 saved (frame_007.jpg, t=17.4s) [09:43] [capture-periodic] freeze=2ms shot=127ms unfreeze=4ms saved=True [09:43] [ComfyUI] [SubprocessWorker] callback 'request_vram_budget' from call_id=40 [09:43] [ComfyUI] [comfy-env] VRAM request: 0.27GB, free before eviction: 7.80GB [09:43] [ComfyUI] [comfy-env] VRAM after eviction: 7.80GB [09:44] [ComfyUI] [worker:ComfyUI-DepthAnythingV3] WARNING: WARNING: This model does not support sky segmentation. V2-Style normalization will work but without sky masking. Use Mono/Metric/Nested models for best V2-Style results. [09:44] [ComfyUI] [worker:ComfyUI-DepthAnythingV3] [VRAM] +258MB (now 258MB) reserved=288MB peak=258MB [09:45] [ComfyUI] [SubprocessWorker] callback 'report_progress' from call_id=40 [09:45] [ComfyUI] [worker:ComfyUI-DepthAnythingV3] [VRAM] +210MB (now 469MB) reserved=640MB peak=469MB [09:45] [ComfyUI] [SubprocessWorker] callback 'report_progress' from call_id=40 [09:45] [ComfyUI] [SubprocessWorker] callback 'report_progress' from call_id=40 [09:45] [ComfyUI] [SubprocessWorker] callback 'report_progress' from call_id=40 [09:45] [ComfyUI] [SubprocessWorker] callback 'report_progress' from call_id=40 [09:45] [ComfyUI] [SubprocessWorker] callback 'report_progress' from call_id=40 [09:45] [ComfyUI] [SubprocessWorker] callback 'report_progress' from call_id=40 [09:45] [ComfyUI] [SubprocessWorker] callback 'report_progress' from call_id=40 [09:45] [ComfyUI] [SubprocessWorker] callback 'report_progress' from call_id=40 [09:45] Frame 9 saved (frame_008.jpg, t=19.7s) [09:45] [capture-periodic] freeze=1ms shot=110ms unfreeze=1ms saved=True [09:45] [ComfyUI] [SubprocessWorker] callback 'report_progress' from call_id=40 [09:46] [ComfyUI] [SubprocessWorker] callback 'report_progress' from call_id=40 [09:46] [ComfyUI] [SubprocessWorker] callback 'report_progress' from call_id=40 [09:46] [ComfyUI] [SubprocessWorker] callback 'report_progress' from call_id=40 [09:47] [ComfyUI] [worker:ComfyUI-DepthAnythingV3] [VRAM] -202MB (now 267MB) reserved=1312MB peak=469MB [09:47] [ComfyUI] [SubprocessWorker] got response: ok [09:47] [ComfyUI] [comfy-env] [VRAM] Before offload 'DepthAnything3Net_1' (258 MB) -> cpu: 1689 / 7703 MB [09:47] [ComfyUI] [ComfyUI-DepthAnythingV3] Health check: ping (timeout=5.0s)... [09:47] [ComfyUI] [ComfyUI-DepthAnythingV3] Health check: ok [09:47] [ComfyUI] [SubprocessWorker] call_id=41 sending model_to_device [09:48] [ComfyUI] [comfy-env] [VRAM] After offload 'DepthAnything3Net_1' (258 MB): 441 / 7703 MB [09:48] [ComfyUI] [comfy-env] Created 1 model patchers: ['DepthAnything3Net_1'] [09:48] [ComfyUI] [comfy-env] DepthAnything_V3 done (7.10s): result: NodeOutput [09:48] [ComfyUI] [VRAM] After DepthAnything_V3: 441 / 7703 MB [09:48] [ComfyUI] [VRAM] Loaded: SubprocessModel (258 MB) [09:48] Frame 10 saved (frame_009.jpg, t=21.9s) [09:48] [capture-periodic] freeze=11ms shot=111ms unfreeze=5ms saved=True [09:48] [ComfyUI] Prompt executed in 21.89 seconds [09:48] Node executed (3 total), capturing... [09:48] Frame 11 saved (frame_010.jpg, t=22.4s) [09:48] [capture-node] freeze=7ms shot=121ms unfreeze=1ms saved=True [09:48] Execution complete (t=22.6s) [09:48] Captured 11 unique frames over 22.62s [09:48] [debug] iframes: 0 [09:48] [timing] trigger_3d_previews: 0.0s [09:50] Saved high-quality screenshot: video_multiview_depth_executed.png [09:50] [timing] final_screenshot: 0.3s [09:51] [ComfyUI] [comfy-env] [VRAM] Before offload 'DepthAnything3Net_1' (258 MB) -> cpu: 441 / 7703 MB [09:51] [ComfyUI] [ComfyUI-DepthAnythingV3] Health check: ping (timeout=5.0s)... [09:51] [ComfyUI] [ComfyUI-DepthAnythingV3] Health check: failed [09:51] [ComfyUI] [ComfyUI-DepthAnythingV3] Socket unhealthy, restarting worker... [09:51] [ComfyUI] [comfy-env] Invalidated 1 stale model patchers (will be cleaned up during next unload) [09:51] [ComfyUI] [ComfyUI-DepthAnythingV3] python: /root/.ce/.pixi/envs/depthanythingv3-nodes/bin/python [09:51] [ComfyUI] [ComfyUI-DepthAnythingV3] sys_path sent to worker: ['/workspaces/DepthAnythingV3-2204/ComfyUI', '/workspaces/DepthAnythingV3-2204/ComfyUI/custom_nodes/ComfyUI-DepthAnythingV3', '/root/.ce/.pixi/envs/depthanythingv3-nodes/lib/python3.12/site-packages', '/workspaces/DepthAnythingV3-2204/ComfyUI/custom_nodes/ComfyUI-DepthAnythingV3'] [09:51] [ComfyUI] [SubprocessWorker] is_pixi=True, python=/root/.ce/.pixi/envs/depthanythingv3-nodes/bin/python [09:51] [ComfyUI] [SubprocessWorker] launching cmd=['/root/.pixi/bin/pixi', 'run', '--as-is', '--manifest-path', '/root/.ce/pixi.toml', '-e', 'depthanythingv3-nodes', 'python', '/tmp/comfyui_pvenv_910zmk0o/persistent_worker.py', 'abstract://comfy_worker_d9b7ff07f021']... [09:51] [ComfyUI] [SubprocessWorker] socket_addr=abstract://comfy_worker_d9b7ff07f021 (abstract, no filesystem path) [09:51] Results saved to /logs/DepthAnythingV3-2204/dev/linux-gpu/results.json [09:51] Model report: 9 files, 2.4 GB -> /logs/DepthAnythingV3-2204/dev/linux-gpu/models.json [09:51] Saved: /logs/DepthAnythingV3-2204/dev/linux-gpu/index.html [09:51] [EXECUTION] PASSED [09:51] linux: PASSED [09:51] Stopping ComfyUI server...