[00:00] Crash dump logging enabled: /Users/runner/work/comfy-gpu-ci/comfy-gpu-ci/comfy-test-logs/Sharp-1915/dev/macos-cpu/crash_dump.log [00:00] [00:00] [1/5] SYNTAX [00:00] ---------------------------------------- [00:00] [DEBUG] server=None, api=None [00:00] Found pyproject.toml (modern format) [00:00] Found requirements.txt (legacy format) [00:00] Unicode check: OK (all characters cp1252-safe) [00:00] Forbidden patterns check: OK [00:00] [SYNTAX] PASSED [00:00] [00:00] [2/5] INSTALL [00:00] ---------------------------------------- [00:00] [DEBUG] server=None, api=None [00:00] Setting up ComfyUI... [00:00] Cloning ComfyUI (latest)... [00:00] Running: git clone --depth 1 https://github.com/comfyanonymous/ComfyUI.git /Users/runner/work/comfy-gpu-ci/comfy-gpu-ci/test_workspaces/Sharp-1915/ComfyUI [00:01] Creating virtual environment... [00:01] Running: /Library/Frameworks/Python.framework/Versions/3.11/bin/python -m venv /Users/runner/work/comfy-gpu-ci/comfy-gpu-ci/test_workspaces/Sharp-1915/venv [00:04] Installing uv into venv... [00:04] Running: /Users/runner/work/comfy-gpu-ci/comfy-gpu-ci/test_workspaces/Sharp-1915/venv/bin/python -m pip install uv [00:05] Installing PyTorch... [00:05] Pinning torch family: torch==2.10.0 torchvision==0.25.0 torchaudio==2.10.0 [00:05] Running: /Users/runner/work/comfy-gpu-ci/comfy-gpu-ci/test_workspaces/Sharp-1915/venv/bin/python -m uv pip install torch==2.10.0 torchvision==0.25.0 torchaudio==2.10.0 [00:14] Installing ComfyUI requirements... [00:14] Running: /Users/runner/work/comfy-gpu-ci/comfy-gpu-ci/test_workspaces/Sharp-1915/venv/bin/python -m uv pip install -r /Users/runner/work/comfy-gpu-ci/comfy-gpu-ci/test_workspaces/Sharp-1915/ComfyUI/requirements.txt [00:24] Installing custom node... [00:24] Copying ComfyUI-Sharp to custom_nodes/... [00:24] Installing node requirements... [00:24] Running: /Users/runner/work/comfy-gpu-ci/comfy-gpu-ci/test_workspaces/Sharp-1915/venv/bin/python -m uv pip install -r /Users/runner/work/comfy-gpu-ci/comfy-gpu-ci/test_workspaces/Sharp-1915/ComfyUI/custom_nodes/ComfyUI-Sharp/requirements.txt [00:25] Running install.py... [00:25] Running: /Users/runner/work/comfy-gpu-ci/comfy-gpu-ci/test_workspaces/Sharp-1915/venv/bin/python /Users/runner/work/comfy-gpu-ci/comfy-gpu-ci/test_workspaces/Sharp-1915/ComfyUI/custom_nodes/ComfyUI-Sharp/install.py [00:25] [00:25] Installing 2 node dependencies... [00:25] Cloning ComfyUI-GaussianPack... [00:28] Installing requirements for ComfyUI-GaussianPack... [00:31] Running install.py for ComfyUI-GaussianPack... [00:32] [comfy-env] _discover: scanning /Users/runner/work/comfy-gpu-ci/comfy-gpu-ci/test_workspaces/Sharp-1915/ComfyUI/custom_nodes [00:32] [comfy-env] _discover: ComfyUI-GaussianPack -> gaussianpack-nodes (custom_nodes/ComfyUI-GaussianPack/nodes/comfy-env.toml) [00:32] [comfy-env] _discover: ComfyUI-Sharp -> sharp-nodes (custom_nodes/ComfyUI-Sharp/nodes/comfy-env.toml) [00:32] [comfy-env] Workspace: /Users/runner/.ce [00:32] [comfy-env] ComfyUI: /Users/runner/work/comfy-gpu-ci/comfy-gpu-ci/test_workspaces/Sharp-1915/ComfyUI [00:32] [comfy-env] Found 2 node config(s): [00:32] - gaussianpack-nodes <- custom_nodes/ComfyUI-GaussianPack/nodes/comfy-env.toml (python=host) [00:32] - sharp-nodes <- custom_nodes/ComfyUI-Sharp/nodes/comfy-env.toml (python=host) [00:32] [comfy-env] Bootstrap interpreter has python 3.11 + torch 2.10.0 (cpu). Looking for cuda-only wheels matching cpu/torch2.10/cp311. [00:32] Generated /Users/runner/.ce/pixi.toml [00:32] [comfy-env] Installing 2 environment(s): [00:32] - gaussianpack-nodes (python=host, 8 pypi deps, 1 cuda wheels) [00:32] - sharp-nodes (python=host, 15 pypi deps) [00:32] [comfy-env] Running `pixi install -e gaussianpack-nodes -e sharp-nodes`... [00:42] WARN Skipped running the post-link scripts because `run-post-link-scripts` = `false` [00:42] - bin/.librsvg-pre-unlink.sh [00:42] To enable them, run: [00:42] pixi config set --local run-post-link-scripts insecure [00:42] More info: [00:42] https://pixi.sh/latest/reference/pixi_configuration/#run-post-link-scripts [00:58] WARN Skipped running the post-link scripts because `run-post-link-scripts` = `false` [00:58] - bin/.librsvg-pre-unlink.sh [00:58] To enable them, run: [00:58] pixi config set --local run-post-link-scripts insecure [00:58] More info: [00:58] https://pixi.sh/latest/reference/pixi_configuration/#run-post-link-scripts [01:02] ✔ The following environments have been installed: gaussianpack-nodes, sharp-nodes. [01:02] [comfy-env] gaussianpack-nodes: deduped libomp [01:02] [comfy-env] sharp-nodes: deduped libomp [01:02] [comfy-env] Recorded install hash c13fd71e660f -> /Users/runner/.ce/install.hash [01:02] [comfy-env] Install log: /Users/runner/.ce/install.log [01:02] [01:02] Installation complete! [01:03] Cloning ComfyUI-PanoPack... [01:04] Installing requirements for ComfyUI-PanoPack... [01:05] Running install.py for ComfyUI-PanoPack... [01:05] [01:05] Installing 2 node dependencies... [01:05] Cloning ComfyUI-MoGe2... [01:06] Installing requirements for ComfyUI-MoGe2... [01:06] Running install.py for ComfyUI-MoGe2... [01:06] [comfy-env] _discover: scanning /Users/runner/work/comfy-gpu-ci/comfy-gpu-ci/test_workspaces/Sharp-1915/ComfyUI/custom_nodes [01:06] [comfy-env] _discover: ComfyUI-GaussianPack -> gaussianpack-nodes (custom_nodes/ComfyUI-GaussianPack/nodes/comfy-env.toml) [01:06] [comfy-env] _discover: ComfyUI-MoGe2 -> moge2-nodes (custom_nodes/ComfyUI-MoGe2/nodes/comfy-env.toml) [01:06] [comfy-env] _discover: ComfyUI-PanoPack -> panopack-nodes (custom_nodes/ComfyUI-PanoPack/nodes/comfy-env.toml) [01:06] [comfy-env] _discover: ComfyUI-Sharp -> sharp-nodes (custom_nodes/ComfyUI-Sharp/nodes/comfy-env.toml) [01:06] [comfy-env] Workspace: /Users/runner/.ce [01:06] [comfy-env] ComfyUI: /Users/runner/work/comfy-gpu-ci/comfy-gpu-ci/test_workspaces/Sharp-1915/ComfyUI [01:06] [comfy-env] Found 4 node config(s): [01:06] - gaussianpack-nodes <- custom_nodes/ComfyUI-GaussianPack/nodes/comfy-env.toml (python=host) [01:06] - moge2-nodes <- custom_nodes/ComfyUI-MoGe2/nodes/comfy-env.toml (python=host) [01:06] - panopack-nodes <- custom_nodes/ComfyUI-PanoPack/nodes/comfy-env.toml (python=host) [01:06] - sharp-nodes <- custom_nodes/ComfyUI-Sharp/nodes/comfy-env.toml (python=host) [01:06] [comfy-env] Bootstrap interpreter has python 3.11 + torch 2.10.0 (cpu). Looking for cuda-only wheels matching cpu/torch2.10/cp311. [01:06] Generated /Users/runner/.ce/pixi.toml [01:06] [comfy-env] Installing 4 environment(s): [01:06] - gaussianpack-nodes (python=host, 8 pypi deps, 1 cuda wheels) [01:06] - moge2-nodes (python=host, 12 pypi deps, 2 cuda wheels) [01:06] - panopack-nodes (python=host, 21 pypi deps) [01:06] - sharp-nodes (python=host, 15 pypi deps) [01:06] [comfy-env] Running `pixi install -e gaussianpack-nodes -e moge2-nodes -e panopack-nodes -e sharp-nodes`... [01:21] WARN Skipped running the post-link scripts because `run-post-link-scripts` = `false` [01:21] - bin/.librsvg-pre-unlink.sh [01:21] To enable them, run: [01:21] pixi config set --local run-post-link-scripts insecure [01:21] More info: [01:21] https://pixi.sh/latest/reference/pixi_configuration/#run-post-link-scripts [01:25] WARN Skipped running the post-link scripts because `run-post-link-scripts` = `false` [01:25] - bin/.librsvg-pre-unlink.sh [01:25] To enable them, run: [01:25] pixi config set --local run-post-link-scripts insecure [01:25] More info: [01:25] https://pixi.sh/latest/reference/pixi_configuration/#run-post-link-scripts [01:28] ✔ The following environments have been installed: gaussianpack-nodes, moge2-nodes, panopack-nodes, sharp-nodes. [01:28] [comfy-env] gaussianpack-nodes: deduped libomp [01:28] [comfy-env] moge2-nodes: deduped libomp [01:28] [comfy-env] panopack-nodes: deduped libomp [01:28] [comfy-env] sharp-nodes: deduped libomp [01:28] [comfy-env] Recorded install hash ead5c265d7a8 -> /Users/runner/.ce/install.hash [01:28] [comfy-env] Install log: /Users/runner/.ce/install.log [01:28] [01:28] Installation complete! [01:28] Cloning ComfyUI-GeometryPack... [01:31] Installing requirements for ComfyUI-GeometryPack... [01:32] Running install.py for ComfyUI-GeometryPack... [01:32] [comfy-env] _discover: scanning /Users/runner/work/comfy-gpu-ci/comfy-gpu-ci/test_workspaces/Sharp-1915/ComfyUI/custom_nodes [01:32] [comfy-env] _discover: ComfyUI-GaussianPack -> gaussianpack-nodes (custom_nodes/ComfyUI-GaussianPack/nodes/comfy-env.toml) [01:32] [comfy-env] _discover: ComfyUI-GeometryPack -> geometrypack-nodes (custom_nodes/ComfyUI-GeometryPack/nodes/comfy-env.toml) [01:32] [comfy-env] _discover: ComfyUI-MoGe2 -> moge2-nodes (custom_nodes/ComfyUI-MoGe2/nodes/comfy-env.toml) [01:32] [comfy-env] _discover: ComfyUI-PanoPack -> panopack-nodes (custom_nodes/ComfyUI-PanoPack/nodes/comfy-env.toml) [01:32] [comfy-env] _discover: ComfyUI-Sharp -> sharp-nodes (custom_nodes/ComfyUI-Sharp/nodes/comfy-env.toml) [01:32] [comfy-env] Workspace: /Users/runner/.ce [01:32] [comfy-env] ComfyUI: /Users/runner/work/comfy-gpu-ci/comfy-gpu-ci/test_workspaces/Sharp-1915/ComfyUI [01:32] [comfy-env] Found 5 node config(s): [01:32] - gaussianpack-nodes <- custom_nodes/ComfyUI-GaussianPack/nodes/comfy-env.toml (python=host) [01:32] - geometrypack-nodes <- custom_nodes/ComfyUI-GeometryPack/nodes/comfy-env.toml (python=host) [01:32] - moge2-nodes <- custom_nodes/ComfyUI-MoGe2/nodes/comfy-env.toml (python=host) [01:32] - panopack-nodes <- custom_nodes/ComfyUI-PanoPack/nodes/comfy-env.toml (python=host) [01:32] - sharp-nodes <- custom_nodes/ComfyUI-Sharp/nodes/comfy-env.toml (python=host) [01:32] [comfy-env] Bootstrap interpreter has python 3.11 + torch 2.10.0 (cpu). Looking for cuda-only wheels matching cpu/torch2.10/cp311. [01:32] Generated /Users/runner/.ce/pixi.toml [01:32] [comfy-env] Installing 5 environment(s): [01:32] - gaussianpack-nodes (python=host, 8 pypi deps, 1 cuda wheels) [01:32] - geometrypack-nodes (python=host, 14 pypi deps, 1 cuda wheels) [01:32] - moge2-nodes (python=host, 12 pypi deps, 2 cuda wheels) [01:32] - panopack-nodes (python=host, 21 pypi deps) [01:32] - sharp-nodes (python=host, 15 pypi deps) [01:32] [comfy-env] Running `pixi install -e gaussianpack-nodes -e geometrypack-nodes -e moge2-nodes -e panopack-nodes -e sharp-nodes`... [01:50] WARN Skipped running the post-link scripts because `run-post-link-scripts` = `false` [01:50] - bin/.librsvg-pre-unlink.sh [01:50] To enable them, run: [01:50] pixi config set --local run-post-link-scripts insecure [01:50] More info: [01:50] https://pixi.sh/latest/reference/pixi_configuration/#run-post-link-scripts [01:53] ✔ The following environments have been installed: gaussianpack-nodes, geometrypack-nodes, moge2-nodes, panopack-nodes, sharp-nodes. [01:53] [comfy-env] gaussianpack-nodes: deduped libomp [01:53] [comfy-env] geometrypack-nodes: deduped libomp [01:53] [comfy-env] moge2-nodes: deduped libomp [01:53] [comfy-env] panopack-nodes: deduped libomp [01:53] [comfy-env] sharp-nodes: deduped libomp [01:53] [comfy-env] Recorded install hash 6a7bc6f93489 -> /Users/runner/.ce/install.hash [01:53] [comfy-env] Install log: /Users/runner/.ce/install.log [01:53] [01:53] Installation complete! [01:53] [01:53] [requirements] Re-installing main package requirements... [01:53] Installing requirements for ComfyUI-PanoPack... [01:53] [comfy-env] _discover: scanning /Users/runner/work/comfy-gpu-ci/comfy-gpu-ci/test_workspaces/Sharp-1915/ComfyUI/custom_nodes [01:53] [comfy-env] _discover: ComfyUI-GaussianPack -> gaussianpack-nodes (custom_nodes/ComfyUI-GaussianPack/nodes/comfy-env.toml) [01:53] [comfy-env] _discover: ComfyUI-GeometryPack -> geometrypack-nodes (custom_nodes/ComfyUI-GeometryPack/nodes/comfy-env.toml) [01:53] [comfy-env] _discover: ComfyUI-MoGe2 -> moge2-nodes (custom_nodes/ComfyUI-MoGe2/nodes/comfy-env.toml) [01:53] [comfy-env] _discover: ComfyUI-PanoPack -> panopack-nodes (custom_nodes/ComfyUI-PanoPack/nodes/comfy-env.toml) [01:53] [comfy-env] _discover: ComfyUI-Sharp -> sharp-nodes (custom_nodes/ComfyUI-Sharp/nodes/comfy-env.toml) [01:53] [comfy-env] Workspace inputs unchanged (hash 6a7bc6f93489) -- skipping install. Delete /Users/runner/.ce/install.hash to force. [01:53] [01:53] Installation complete! [01:53] ComfyUI-MoGe2: exists [01:53] ComfyUI-GeometryPack: exists [01:53] [01:53] [requirements] Re-installing main package requirements... [01:53] Installing requirements for ComfyUI-Sharp... [01:53] [comfy-env] _discover: scanning /Users/runner/work/comfy-gpu-ci/comfy-gpu-ci/test_workspaces/Sharp-1915/ComfyUI/custom_nodes [01:53] [comfy-env] _discover: ComfyUI-GaussianPack -> gaussianpack-nodes (custom_nodes/ComfyUI-GaussianPack/nodes/comfy-env.toml) [01:53] [comfy-env] _discover: ComfyUI-GeometryPack -> geometrypack-nodes (custom_nodes/ComfyUI-GeometryPack/nodes/comfy-env.toml) [01:53] [comfy-env] _discover: ComfyUI-MoGe2 -> moge2-nodes (custom_nodes/ComfyUI-MoGe2/nodes/comfy-env.toml) [01:53] [comfy-env] _discover: ComfyUI-PanoPack -> panopack-nodes (custom_nodes/ComfyUI-PanoPack/nodes/comfy-env.toml) [01:53] [comfy-env] _discover: ComfyUI-Sharp -> sharp-nodes (custom_nodes/ComfyUI-Sharp/nodes/comfy-env.toml) [01:53] [comfy-env] Workspace inputs unchanged (hash 6a7bc6f93489) -- skipping install. Delete /Users/runner/.ce/install.hash to force. [01:53] [01:53] Installation complete! [01:53] Installing 2 node dependency(ies)... [01:53] ComfyUI-GaussianPack from PozzettiAndrea/ComfyUI-GaussianPack [01:53] ComfyUI-GaussianPack already exists, skipping... [01:53] ComfyUI-PanoPack from PozzettiAndrea/ComfyUI-PanoPack [01:53] ComfyUI-PanoPack already exists, skipping... [01:53] Installing validation endpoint... [01:53] Cloning PozzettiAndrea/ComfyUI-validate-endpoint... [01:53] Running: git clone --depth 1 https://x-access-token:***@github.com/PozzettiAndrea/ComfyUI-validate-endpoint.git /Users/runner/work/comfy-gpu-ci/comfy-gpu-ci/test_workspaces/Sharp-1915/ComfyUI/custom_nodes/ComfyUI-validate-endpoint [01:54] [INSTALL] PASSED [01:54] [01:54] [3/5] REGISTRATION [01:54] ---------------------------------------- [01:54] [DEBUG] server=None, api=None [01:54] Starting ComfyUI server... [01:54] Starting ComfyUI server on port 41893... [01:54] Starting ComfyUI server on port 41893... [01:54] Waiting for server to be ready (timeout: 600s)... [01:55] [ComfyUI] [INFO] setup plugin alembic.autogenerate.schemas [01:55] [ComfyUI] [INFO] setup plugin alembic.autogenerate.tables [01:55] [ComfyUI] [INFO] setup plugin alembic.autogenerate.types [01:55] [ComfyUI] [INFO] setup plugin alembic.autogenerate.constraints [01:55] [ComfyUI] [INFO] setup plugin alembic.autogenerate.defaults [01:55] [ComfyUI] [INFO] setup plugin alembic.autogenerate.comments [01:56] [ComfyUI] [WARNING] Could not autodetect AIMDO implementation, assuming Nvidia [01:56] [ComfyUI] [INFO] comfy-aimdo unsupported operating system: Darwin [01:56] [ComfyUI] [INFO] NOTE: comfy-aimdo currently only supports Windows and Linux [01:56] [ComfyUI] [comfy-env] ComfyUI-MoGe2: 1 isolation env(s): [01:56] [ComfyUI] [comfy-env] nodes -> /Users/runner/work/comfy-gpu-ci/comfy-gpu-ci/test_workspaces/Sharp-1915/ComfyUI/custom_nodes/ComfyUI-MoGe2/nodes [01:56] [ComfyUI] [comfy-env] Workspace: /Users/runner/.ce [01:56] [ComfyUI] [comfy-env] env: /Users/runner/.ce/.pixi/envs/moge2-nodes [OK] [01:58] [ComfyUI] [comfy-env] prestartup complete [01:58] [ComfyUI] [comfy-env] ComfyUI-Sharp: 1 isolation env(s): [01:58] [ComfyUI] [comfy-env] nodes -> /Users/runner/work/comfy-gpu-ci/comfy-gpu-ci/test_workspaces/Sharp-1915/ComfyUI/custom_nodes/ComfyUI-Sharp/nodes [01:58] [ComfyUI] [comfy-env] env: /Users/runner/.ce/.pixi/envs/sharp-nodes [OK] [01:58] [ComfyUI] [comfy-env] prestartup complete [01:58] [ComfyUI] [comfy-env] ComfyUI-PanoPack: 1 isolation env(s): [01:58] [ComfyUI] [comfy-env] nodes -> /Users/runner/work/comfy-gpu-ci/comfy-gpu-ci/test_workspaces/Sharp-1915/ComfyUI/custom_nodes/ComfyUI-PanoPack/nodes [01:58] [ComfyUI] [comfy-env] env: /Users/runner/.ce/.pixi/envs/panopack-nodes [OK] [01:58] [ComfyUI] [comfy-env] prestartup complete [01:58] [ComfyUI] [comfy-env] ComfyUI-GeometryPack: 1 isolation env(s): [01:58] [ComfyUI] [comfy-env] nodes -> /Users/runner/work/comfy-gpu-ci/comfy-gpu-ci/test_workspaces/Sharp-1915/ComfyUI/custom_nodes/ComfyUI-GeometryPack/nodes [01:58] [ComfyUI] [comfy-env] env: /Users/runner/.ce/.pixi/envs/geometrypack-nodes [OK] [01:58] [ComfyUI] [comfy-env] prestartup complete [01:58] [ComfyUI] [INFO] [01:58] [ComfyUI] Prestartup times for custom nodes: [01:58] [ComfyUI] [INFO] 0.1 seconds: /Users/runner/work/comfy-gpu-ci/comfy-gpu-ci/test_workspaces/Sharp-1915/ComfyUI/custom_nodes/ComfyUI-Sharp [01:58] [ComfyUI] [INFO] 0.1 seconds: /Users/runner/work/comfy-gpu-ci/comfy-gpu-ci/test_workspaces/Sharp-1915/ComfyUI/custom_nodes/ComfyUI-GaussianPack [01:58] [ComfyUI] [INFO] 0.1 seconds: /Users/runner/work/comfy-gpu-ci/comfy-gpu-ci/test_workspaces/Sharp-1915/ComfyUI/custom_nodes/ComfyUI-PanoPack [01:58] [ComfyUI] [INFO] 0.3 seconds: /Users/runner/work/comfy-gpu-ci/comfy-gpu-ci/test_workspaces/Sharp-1915/ComfyUI/custom_nodes/ComfyUI-GeometryPack [01:58] [ComfyUI] [INFO] 2.3 seconds: /Users/runner/work/comfy-gpu-ci/comfy-gpu-ci/test_workspaces/Sharp-1915/ComfyUI/custom_nodes/ComfyUI-MoGe2 [01:58] [ComfyUI] [INFO] [01:58] [ComfyUI] [WARNING] WARNING: Potential Error in code: Torch already imported, torch should never be imported before this point. [02:02] [ComfyUI] [INFO] Found comfy_kitchen backend triton: {'available': False, 'disabled': True, 'unavailable_reason': "ImportError: No module named 'triton'", 'capabilities': []} [02:02] [ComfyUI] [INFO] Found comfy_kitchen backend eager: {'available': True, 'disabled': False, 'unavailable_reason': None, 'capabilities': ['apply_rope', 'apply_rope1', 'apply_rope_split_half', 'apply_rope_split_half1', 'dequantize_mxfp8', 'dequantize_nvfp4', 'dequantize_per_tensor_fp8', 'gemv_awq_w4a16', 'quantize_mxfp8', 'quantize_nvfp4', 'quantize_per_tensor_fp8', 'quantize_svdquant_w4a4', 'scaled_mm_mxfp8', 'scaled_mm_nvfp4', 'scaled_mm_svdquant_w4a4', 'stochastic_rounding_fp8']} [02:02] [ComfyUI] [INFO] Found comfy_kitchen backend cuda: {'available': False, 'disabled': True, 'unavailable_reason': 'Extension file not found: /Users/runner/work/comfy-gpu-ci/comfy-gpu-ci/test_workspaces/Sharp-1915/venv/lib/python3.11/site-packages/comfy_kitchen/backends/cuda/_C.abi3.so', 'capabilities': []} [02:02] [ComfyUI] [INFO] Checkpoint files will always be loaded safely. [02:02] [ComfyUI] [INFO] Total VRAM 7168 MB, total RAM 7168 MB [02:02] [ComfyUI] [INFO] pytorch version: 2.10.0 [02:02] [ComfyUI] [INFO] Mac Version (15, 7, 7) [02:02] [ComfyUI] [INFO] Set vram state to: SHARED [02:02] [ComfyUI] [INFO] Device: mps [02:03] [ComfyUI] [INFO] Using sub quadratic optimization for attention, if you have memory or speed issues try using: --use-split-cross-attention [02:10] [ComfyUI] [INFO] Python version: 3.11.9 (v3.11.9:de54cf5be3, Apr 2 2024, 07:12:50) [Clang 13.0.0 (clang-1300.0.29.30)] [02:10] [ComfyUI] [INFO] ComfyUI version: 0.24.0 [02:10] [ComfyUI] [INFO] comfy-aimdo version: 0.4.9 [02:10] [ComfyUI] [INFO] comfy-kitchen version: 0.2.10 [02:10] [ComfyUI] [WARNING] ****** User settings have been changed to be stored on the server instead of browser storage. ****** [02:10] [ComfyUI] [WARNING] ****** For multi-user setups add the --multi-user CLI argument to enable multiple user profiles. ****** [02:10] [ComfyUI] [INFO] comfyui-frontend-package version: 1.45.15 [02:10] [ComfyUI] [INFO] comfyui-workflow-templates version: 0.9.98 [02:10] [ComfyUI] [INFO] comfyui-embedded-docs version: 0.5.2 [02:10] [ComfyUI] [INFO] comfy-kitchen version: 0.2.10 [02:10] [ComfyUI] [INFO] comfy-aimdo version: 0.4.9 [02:10] [ComfyUI] [INFO] [Prompt Server] web root: /Users/runner/work/comfy-gpu-ci/comfy-gpu-ci/test_workspaces/Sharp-1915/venv/lib/python3.11/site-packages/comfyui_frontend_package/static [02:10] [ComfyUI] [INFO] Asset seeder disabled [02:13] [ComfyUI] [comfy-env] Version: 0.3.89 [02:13] [ComfyUI] [comfy-env] register_nodes: ComfyUI-MoGe2 [02:13] [ComfyUI] [comfy-env] ComfyUI source dir: /Users/runner/work/comfy-gpu-ci/comfy-gpu-ci/test_workspaces/Sharp-1915/ComfyUI [02:13] [ComfyUI] [comfy-env] Found 1 isolation env(s) [02:13] [ComfyUI] [comfy-env] Scanning nodes metadata (isolation root)... [02:13] [ComfyUI] [comfy-env] Metadata scan: /Users/runner/.pixi/bin/pixi run --as-is --manifest-path /Users/runner/.ce/pixi.toml -e moge2-nodes python /var/folders/8d/778wjbv96mq1760tv6gk374m0000gn/T/comfy_meta_vydwafhg.py /Users/runner/work/comfy-gpu-ci/comfy-gpu-ci/test_workspaces/Sharp-1915/ComfyUI/custom_nodes/ComfyUI-MoGe2 nodes /var/folders/8d/778wjbv96mq1760tv6gk374m0000gn/T/comfy_meta_out_kifu2og7.pkl [02:13] [ComfyUI] [comfy-env] Scan env PATH for nodes: [02:13] [ComfyUI] [comfy-env] [0] /Users/runner/hostedtoolcache/Python/3.11.9/arm64/bin [02:13] [ComfyUI] [comfy-env] [1] /Users/runner/hostedtoolcache/Python/3.11.9/arm64 [02:13] [ComfyUI] [comfy-env] [2] /opt/homebrew/lib/ruby/gems/3.3.0/bin [02:13] [ComfyUI] [comfy-env] [3] /opt/homebrew/opt/ruby@3.3/bin [02:13] [ComfyUI] [comfy-env] [4] /Users/runner/.local/bin [02:13] [ComfyUI] [comfy-env] [5] /opt/homebrew/bin [02:13] [ComfyUI] [comfy-env] [6] /opt/homebrew/sbin [02:13] [ComfyUI] [comfy-env] [7] /Users/runner/.cargo/bin [02:13] [ComfyUI] [comfy-env] [8] /usr/local/opt/curl/bin [02:13] [ComfyUI] [comfy-env] [9] /usr/local/bin [02:13] [ComfyUI] [comfy-env] [10] /usr/local/sbin [02:13] [ComfyUI] [comfy-env] [11] /Users/runner/bin [02:13] [ComfyUI] [comfy-env] [12] /Users/runner/.yarn/bin [02:13] [ComfyUI] [comfy-env] [13] /Users/runner/Library/Android/sdk/tools [02:13] [ComfyUI] [comfy-env] [14] /Users/runner/Library/Android/sdk/platform-tools [02:13] [ComfyUI] [comfy-env] [15] /Library/Frameworks/Python.framework/Versions/Current/bin [02:13] [ComfyUI] [comfy-env] [16] /Library/Frameworks/Mono.framework/Versions/Current/Commands [02:13] [ComfyUI] [comfy-env] [17] /usr/bin [02:13] [ComfyUI] [comfy-env] [18] /bin [02:13] [ComfyUI] [comfy-env] [19] /usr/sbin [02:13] [ComfyUI] [comfy-env] [20] /sbin [02:13] [ComfyUI] [comfy-env] [21] /Users/runner/.dotnet/tools [02:18] [ComfyUI] [comfy-env] Metadata scan stderr for nodes: [02:18] [ComfyUI] [comfy-env] [meta-scan] importing nodes from /Users/runner/work/comfy-gpu-ci/comfy-gpu-ci/test_workspaces/Sharp-1915/ComfyUI/custom_nodes/ComfyUI-MoGe2 [02:18] [ComfyUI] [comfy-env] ERROR:root:Failed to import comfy_kitchen, Error: No module named 'comfy_kitchen', fp8 and fp4 support will not be available. [02:18] [ComfyUI] [comfy-env] WARNING:root:comfy_kitchen does not support stochastic FP8 rounding, please update comfy_kitchen. [02:18] [ComfyUI] [comfy-env] [meta-scan] import OK [02:18] [ComfyUI] [comfy-env] Scanned nodes: 3 nodes (5.5s) [02:18] [ComfyUI] [comfy-env] Scanned nodes root: 3 nodes (5.5s) [02:18] [ComfyUI] [comfy-env] Imported nodes root: 3 nodes (isolation) [02:18] [ComfyUI] [comfy-env] Registered 3 total nodes [02:18] [ComfyUI] [comfy-env] Version: 0.3.89 [02:18] [ComfyUI] [comfy-env] register_nodes: ComfyUI-Sharp [02:18] [ComfyUI] [comfy-env] ComfyUI source dir: /Users/runner/work/comfy-gpu-ci/comfy-gpu-ci/test_workspaces/Sharp-1915/ComfyUI [02:18] [ComfyUI] [comfy-env] Found 1 isolation env(s) [02:18] [ComfyUI] [comfy-env] Scanning nodes metadata (isolation root)... [02:18] [ComfyUI] [comfy-env] Metadata scan: /Users/runner/.pixi/bin/pixi run --as-is --manifest-path /Users/runner/.ce/pixi.toml -e sharp-nodes python /var/folders/8d/778wjbv96mq1760tv6gk374m0000gn/T/comfy_meta_w9fb9pu3.py /Users/runner/work/comfy-gpu-ci/comfy-gpu-ci/test_workspaces/Sharp-1915/ComfyUI/custom_nodes/ComfyUI-Sharp nodes /var/folders/8d/778wjbv96mq1760tv6gk374m0000gn/T/comfy_meta_out_cynixsov.pkl [02:18] [ComfyUI] [comfy-env] Scan env PATH for nodes: [02:18] [ComfyUI] [comfy-env] [0] /Users/runner/hostedtoolcache/Python/3.11.9/arm64/bin [02:18] [ComfyUI] [comfy-env] [1] /Users/runner/hostedtoolcache/Python/3.11.9/arm64 [02:18] [ComfyUI] [comfy-env] [2] /opt/homebrew/lib/ruby/gems/3.3.0/bin [02:18] [ComfyUI] [comfy-env] [3] /opt/homebrew/opt/ruby@3.3/bin [02:18] [ComfyUI] [comfy-env] [4] /Users/runner/.local/bin [02:18] [ComfyUI] [comfy-env] [5] /opt/homebrew/bin [02:18] [ComfyUI] [comfy-env] [6] /opt/homebrew/sbin [02:18] [ComfyUI] [comfy-env] [7] /Users/runner/.cargo/bin [02:18] [ComfyUI] [comfy-env] [8] /usr/local/opt/curl/bin [02:18] [ComfyUI] [comfy-env] [9] /usr/local/bin [02:18] [ComfyUI] [comfy-env] [10] /usr/local/sbin [02:18] [ComfyUI] [comfy-env] [11] /Users/runner/bin [02:18] [ComfyUI] [comfy-env] [12] /Users/runner/.yarn/bin [02:18] [ComfyUI] [comfy-env] [13] /Users/runner/Library/Android/sdk/tools [02:18] [ComfyUI] [comfy-env] [14] /Users/runner/Library/Android/sdk/platform-tools [02:18] [ComfyUI] [comfy-env] [15] /Library/Frameworks/Python.framework/Versions/Current/bin [02:18] [ComfyUI] [comfy-env] [16] /Library/Frameworks/Mono.framework/Versions/Current/Commands [02:18] [ComfyUI] [comfy-env] [17] /usr/bin [02:18] [ComfyUI] [comfy-env] [18] /bin [02:18] [ComfyUI] [comfy-env] [19] /usr/sbin [02:18] [ComfyUI] [comfy-env] [20] /sbin [02:18] [ComfyUI] [comfy-env] [21] /Users/runner/.dotnet/tools [02:24] [ComfyUI] [comfy-env] Metadata scan stderr for nodes: [02:24] [ComfyUI] [comfy-env] [meta-scan] importing nodes from /Users/runner/work/comfy-gpu-ci/comfy-gpu-ci/test_workspaces/Sharp-1915/ComfyUI/custom_nodes/ComfyUI-Sharp [02:24] [ComfyUI] [comfy-env] [meta-scan] import OK [02:24] [ComfyUI] [comfy-env] Scanned nodes: 17 nodes (5.9s) [02:24] [ComfyUI] [comfy-env] Scanned nodes root: 17 nodes (5.9s) [02:24] [ComfyUI] [comfy-env] Imported nodes root: 17 nodes (isolation) [02:24] [ComfyUI] [comfy-env] Registered 17 total nodes [02:24] [ComfyUI] [comfy-env] Version: 0.3.89 [02:24] [ComfyUI] [comfy-env] register_nodes: ComfyUI-PanoPack [02:24] [ComfyUI] [comfy-env] ComfyUI source dir: /Users/runner/work/comfy-gpu-ci/comfy-gpu-ci/test_workspaces/Sharp-1915/ComfyUI [02:24] [ComfyUI] [comfy-env] Found 1 isolation env(s) [02:24] [ComfyUI] [comfy-env] Scanning nodes metadata (isolation root)... [02:24] [ComfyUI] [comfy-env] Metadata scan: /Users/runner/.pixi/bin/pixi run --as-is --manifest-path /Users/runner/.ce/pixi.toml -e panopack-nodes python /var/folders/8d/778wjbv96mq1760tv6gk374m0000gn/T/comfy_meta_kwx_a_gq.py /Users/runner/work/comfy-gpu-ci/comfy-gpu-ci/test_workspaces/Sharp-1915/ComfyUI/custom_nodes/ComfyUI-PanoPack nodes /var/folders/8d/778wjbv96mq1760tv6gk374m0000gn/T/comfy_meta_out_0396bshv.pkl [02:24] [ComfyUI] [comfy-env] Scan env PATH for nodes: [02:24] [ComfyUI] [comfy-env] [0] /Users/runner/hostedtoolcache/Python/3.11.9/arm64/bin [02:24] [ComfyUI] [comfy-env] [1] /Users/runner/hostedtoolcache/Python/3.11.9/arm64 [02:24] [ComfyUI] [comfy-env] [2] /opt/homebrew/lib/ruby/gems/3.3.0/bin [02:25] [ComfyUI] [comfy-env] [3] /opt/homebrew/opt/ruby@3.3/bin [02:25] [ComfyUI] [comfy-env] [4] /Users/runner/.local/bin [02:25] [ComfyUI] [comfy-env] [5] /opt/homebrew/bin [02:25] [ComfyUI] [comfy-env] [6] /opt/homebrew/sbin [02:25] [ComfyUI] [comfy-env] [7] /Users/runner/.cargo/bin [02:25] [ComfyUI] [comfy-env] [8] /usr/local/opt/curl/bin [02:25] [ComfyUI] [comfy-env] [9] /usr/local/bin [02:25] [ComfyUI] [comfy-env] [10] /usr/local/sbin [02:25] [ComfyUI] [comfy-env] [11] /Users/runner/bin [02:25] [ComfyUI] [comfy-env] [12] /Users/runner/.yarn/bin [02:25] [ComfyUI] [comfy-env] [13] /Users/runner/Library/Android/sdk/tools [02:25] [ComfyUI] [comfy-env] [14] /Users/runner/Library/Android/sdk/platform-tools [02:25] [ComfyUI] [comfy-env] [15] /Library/Frameworks/Python.framework/Versions/Current/bin [02:25] [ComfyUI] [comfy-env] [16] /Library/Frameworks/Mono.framework/Versions/Current/Commands [02:25] [ComfyUI] [comfy-env] [17] /usr/bin [02:25] [ComfyUI] [comfy-env] [18] /bin [02:25] [ComfyUI] [comfy-env] [19] /usr/sbin [02:25] [ComfyUI] [comfy-env] [20] /sbin [02:25] [ComfyUI] [comfy-env] [21] /Users/runner/.dotnet/tools [02:30] [ComfyUI] [comfy-env] Metadata scan stderr for nodes: [02:30] [ComfyUI] [comfy-env] [meta-scan] importing nodes from /Users/runner/work/comfy-gpu-ci/comfy-gpu-ci/test_workspaces/Sharp-1915/ComfyUI/custom_nodes/ComfyUI-PanoPack [02:30] [ComfyUI] [comfy-env] objc[14686]: Class AVFFrameReceiver is implemented in both /Users/runner/.ce/.pixi/envs/panopack-nodes/lib/libavdevice.62.3.100.dylib (0x113fd47a8) and /Users/runner/.ce/.pixi/envs/panopack-nodes/lib/python3.11/site-packages/cv2/.dylibs/libavdevice.61.3.100.dylib (0x129d343a8). This may cause spurious casting failures and mysterious crashes. One of the duplicates must be removed or renamed. [02:30] [ComfyUI] [comfy-env] objc[14686]: Class AVFAudioReceiver is implemented in both /Users/runner/.ce/.pixi/envs/panopack-nodes/lib/libavdevice.62.3.100.dylib (0x113fd47f8) and /Users/runner/.ce/.pixi/envs/panopack-nodes/lib/python3.11/site-packages/cv2/.dylibs/libavdevice.61.3.100.dylib (0x129d343f8). This may cause spurious casting failures and mysterious crashes. One of the duplicates must be removed or renamed. [02:30] [ComfyUI] [comfy-env] [meta-scan] import OK [02:30] [ComfyUI] [comfy-env] Scanned nodes: 15 nodes (5.6s) [02:30] [ComfyUI] [comfy-env] Scanned nodes root: 15 nodes (5.6s) [02:30] [ComfyUI] [comfy-env] Imported nodes root: 15 nodes (isolation) [02:30] [ComfyUI] [comfy-env] Registered 15 total nodes [02:30] [ComfyUI] [comfy-env] Version: 0.3.89 [02:30] [ComfyUI] [comfy-env] register_nodes: ComfyUI-GaussianPack [02:30] [ComfyUI] [comfy-env] ComfyUI source dir: /Users/runner/work/comfy-gpu-ci/comfy-gpu-ci/test_workspaces/Sharp-1915/ComfyUI [02:30] [ComfyUI] [comfy-env] Found 1 isolation env(s) [02:30] [ComfyUI] [comfy-env] Scanning nodes metadata (isolation root)... [02:30] [ComfyUI] [comfy-env] Metadata scan: /Users/runner/.pixi/bin/pixi run --as-is --manifest-path /Users/runner/.ce/pixi.toml -e gaussianpack-nodes python /var/folders/8d/778wjbv96mq1760tv6gk374m0000gn/T/comfy_meta_61ogpse4.py /Users/runner/work/comfy-gpu-ci/comfy-gpu-ci/test_workspaces/Sharp-1915/ComfyUI/custom_nodes/ComfyUI-GaussianPack nodes /var/folders/8d/778wjbv96mq1760tv6gk374m0000gn/T/comfy_meta_out_u_f1xoty.pkl [02:30] [ComfyUI] [comfy-env] Scan env PATH for nodes: [02:30] [ComfyUI] [comfy-env] [0] /Users/runner/hostedtoolcache/Python/3.11.9/arm64/bin [02:30] [ComfyUI] [comfy-env] [1] /Users/runner/hostedtoolcache/Python/3.11.9/arm64 [02:30] [ComfyUI] [comfy-env] [2] /opt/homebrew/lib/ruby/gems/3.3.0/bin [02:30] [ComfyUI] [comfy-env] [3] /opt/homebrew/opt/ruby@3.3/bin [02:30] [ComfyUI] [comfy-env] [4] /Users/runner/.local/bin [02:30] [ComfyUI] [comfy-env] [5] /opt/homebrew/bin [02:30] [ComfyUI] [comfy-env] [6] /opt/homebrew/sbin [02:30] [ComfyUI] [comfy-env] [7] /Users/runner/.cargo/bin [02:30] [ComfyUI] [comfy-env] [8] /usr/local/opt/curl/bin [02:30] [ComfyUI] [comfy-env] [9] /usr/local/bin [02:30] [ComfyUI] [comfy-env] [10] /usr/local/sbin [02:30] [ComfyUI] [comfy-env] [11] /Users/runner/bin [02:30] [ComfyUI] [comfy-env] [12] /Users/runner/.yarn/bin [02:30] [ComfyUI] [comfy-env] [13] /Users/runner/Library/Android/sdk/tools [02:30] [ComfyUI] [comfy-env] [14] /Users/runner/Library/Android/sdk/platform-tools [02:30] [ComfyUI] [comfy-env] [15] /Library/Frameworks/Python.framework/Versions/Current/bin [02:30] [ComfyUI] [comfy-env] [16] /Library/Frameworks/Mono.framework/Versions/Current/Commands [02:30] [ComfyUI] [comfy-env] [17] /usr/bin [02:30] [ComfyUI] [comfy-env] [18] /bin [02:30] [ComfyUI] [comfy-env] [19] /usr/sbin [02:30] [ComfyUI] [comfy-env] [20] /sbin [02:30] [ComfyUI] [comfy-env] [21] /Users/runner/.dotnet/tools [02:36] [ComfyUI] [comfy-env] Metadata scan stderr for nodes: [02:36] [ComfyUI] [comfy-env] [meta-scan] importing nodes from /Users/runner/work/comfy-gpu-ci/comfy-gpu-ci/test_workspaces/Sharp-1915/ComfyUI/custom_nodes/ComfyUI-GaussianPack [02:36] [ComfyUI] [comfy-env] SPZ route not registered (ModuleNotFoundError: No module named 'comfy_aimdo') [02:36] [ComfyUI] [comfy-env] [meta-scan] import OK [02:36] [ComfyUI] [comfy-env] Scanned nodes: 11 nodes (5.4s) [02:36] [ComfyUI] [comfy-env] Scanned nodes root: 11 nodes (5.4s) [02:36] [ComfyUI] [comfy-env] Imported nodes root: 11 nodes (isolation) [02:36] [ComfyUI] [comfy-env] Registered 11 total nodes [02:36] [ComfyUI] [INFO] loading... [02:36] [ComfyUI] [INFO] calling register_nodes [02:36] [ComfyUI] [comfy-env] Version: 0.3.89 [02:36] [ComfyUI] [comfy-env] register_nodes: ComfyUI-GeometryPack [02:36] [ComfyUI] [comfy-env] ComfyUI source dir: /Users/runner/work/comfy-gpu-ci/comfy-gpu-ci/test_workspaces/Sharp-1915/ComfyUI [02:36] [ComfyUI] [comfy-env] Found 1 isolation env(s) [02:36] [ComfyUI] [comfy-env] Scanning nodes metadata (isolation root)... [02:36] [ComfyUI] [comfy-env] Metadata scan: /Users/runner/.pixi/bin/pixi run --as-is --manifest-path /Users/runner/.ce/pixi.toml -e geometrypack-nodes python /var/folders/8d/778wjbv96mq1760tv6gk374m0000gn/T/comfy_meta_bj5pfs7d.py /Users/runner/work/comfy-gpu-ci/comfy-gpu-ci/test_workspaces/Sharp-1915/ComfyUI/custom_nodes/ComfyUI-GeometryPack nodes /var/folders/8d/778wjbv96mq1760tv6gk374m0000gn/T/comfy_meta_out_vqpdf32d.pkl [02:36] [ComfyUI] [comfy-env] Scan env PATH for nodes: [02:36] [ComfyUI] [comfy-env] [0] /Users/runner/hostedtoolcache/Python/3.11.9/arm64/bin [02:36] [ComfyUI] [comfy-env] [1] /Users/runner/hostedtoolcache/Python/3.11.9/arm64 [02:36] [ComfyUI] [comfy-env] [2] /opt/homebrew/lib/ruby/gems/3.3.0/bin [02:36] [ComfyUI] [comfy-env] [3] /opt/homebrew/opt/ruby@3.3/bin [02:36] [ComfyUI] [comfy-env] [4] /Users/runner/.local/bin [02:36] [ComfyUI] [comfy-env] [5] /opt/homebrew/bin [02:36] [ComfyUI] [comfy-env] [6] /opt/homebrew/sbin [02:36] [ComfyUI] [comfy-env] [7] /Users/runner/.cargo/bin [02:36] [ComfyUI] [comfy-env] [8] /usr/local/opt/curl/bin [02:36] [ComfyUI] [comfy-env] [9] /usr/local/bin [02:36] [ComfyUI] [comfy-env] [10] /usr/local/sbin [02:36] [ComfyUI] [comfy-env] [11] /Users/runner/bin [02:36] [ComfyUI] [comfy-env] [12] /Users/runner/.yarn/bin [02:36] [ComfyUI] [comfy-env] [13] /Users/runner/Library/Android/sdk/tools [02:36] [ComfyUI] [comfy-env] [14] /Users/runner/Library/Android/sdk/platform-tools [02:36] [ComfyUI] [comfy-env] [15] /Library/Frameworks/Python.framework/Versions/Current/bin [02:36] [ComfyUI] [comfy-env] [16] /Library/Frameworks/Mono.framework/Versions/Current/Commands [02:36] [ComfyUI] [comfy-env] [17] /usr/bin [02:36] [ComfyUI] [comfy-env] [18] /bin [02:36] [ComfyUI] [comfy-env] [19] /usr/sbin [02:36] [ComfyUI] [comfy-env] [20] /sbin [02:36] [ComfyUI] [comfy-env] [21] /Users/runner/.dotnet/tools [02:44] [ComfyUI] [comfy-env] Metadata scan stderr for nodes: [02:44] [ComfyUI] [comfy-env] [meta-scan] importing nodes from /Users/runner/work/comfy-gpu-ci/comfy-gpu-ci/test_workspaces/Sharp-1915/ComfyUI/custom_nodes/ComfyUI-GeometryPack [02:44] [ComfyUI] [comfy-env] ERROR:root:Failed to import comfy_kitchen, Error: No module named 'comfy_kitchen', fp8 and fp4 support will not be available. [02:44] [ComfyUI] [comfy-env] WARNING:root:comfy_kitchen does not support stochastic FP8 rounding, please update comfy_kitchen. [02:44] [ComfyUI] [comfy-env] [meta-scan] import OK [02:44] [ComfyUI] [comfy-env] Scanned nodes: 125 nodes (8.7s) [02:44] [ComfyUI] [comfy-env] Scanned nodes root: 125 nodes (8.8s) [02:44] [ComfyUI] [comfy-env] Imported nodes root: 125 nodes (isolation) [02:44] [ComfyUI] [comfy-env] Registered 125 total nodes [02:45] [ComfyUI] [INFO] [02:45] [ComfyUI] Import times for custom nodes: [02:45] [ComfyUI] [INFO] 0.0 seconds: /Users/runner/work/comfy-gpu-ci/comfy-gpu-ci/test_workspaces/Sharp-1915/ComfyUI/custom_nodes/websocket_image_save.py [02:45] [ComfyUI] [INFO] 0.0 seconds: /Users/runner/work/comfy-gpu-ci/comfy-gpu-ci/test_workspaces/Sharp-1915/ComfyUI/custom_nodes/ComfyUI-validate-endpoint [02:45] [ComfyUI] [INFO] 5.5 seconds: /Users/runner/work/comfy-gpu-ci/comfy-gpu-ci/test_workspaces/Sharp-1915/ComfyUI/custom_nodes/ComfyUI-GaussianPack [02:45] [ComfyUI] [INFO] 5.7 seconds: /Users/runner/work/comfy-gpu-ci/comfy-gpu-ci/test_workspaces/Sharp-1915/ComfyUI/custom_nodes/ComfyUI-MoGe2 [02:45] [ComfyUI] [INFO] 5.8 seconds: /Users/runner/work/comfy-gpu-ci/comfy-gpu-ci/test_workspaces/Sharp-1915/ComfyUI/custom_nodes/ComfyUI-PanoPack [02:45] [ComfyUI] [INFO] 5.9 seconds: /Users/runner/work/comfy-gpu-ci/comfy-gpu-ci/test_workspaces/Sharp-1915/ComfyUI/custom_nodes/ComfyUI-Sharp [02:45] [ComfyUI] [INFO] 8.9 seconds: /Users/runner/work/comfy-gpu-ci/comfy-gpu-ci/test_workspaces/Sharp-1915/ComfyUI/custom_nodes/ComfyUI-GeometryPack [02:45] [ComfyUI] [INFO] [02:45] [ComfyUI] [INFO] Context impl SQLiteImpl. [02:45] [ComfyUI] [INFO] Will assume non-transactional DDL. [02:45] [ComfyUI] [INFO] Context impl SQLiteImpl. [02:45] [ComfyUI] [INFO] Will assume non-transactional DDL. [02:45] [ComfyUI] [INFO] Running upgrade -> 0001_assets, Initial assets schema [02:45] [ComfyUI] Revision ID: 0001_assets [02:45] [ComfyUI] Revises: None [02:45] [ComfyUI] Create Date: 2025-12-10 00:00:00 [02:45] [ComfyUI] [INFO] Running upgrade 0001_assets -> 0002_merge_to_asset_references, Merge AssetInfo and AssetCacheState into unified asset_references table. [02:45] [ComfyUI] [INFO] Running upgrade 0002_merge_to_asset_references -> 0003_add_metadata_job_id, Add system_metadata and job_id columns to asset_references. [02:45] [ComfyUI] Change preview_id FK from assets.id to asset_references.id. [02:45] [ComfyUI] [INFO] Database upgraded from None to 0003_add_metadata_job_id [02:45] [ComfyUI] [INFO] Using RAM pressure cache. [02:45] [ComfyUI] [INFO] Starting server [02:45] [ComfyUI] [02:45] [ComfyUI] [INFO] To see the GUI go to: http://127.0.0.1:41893 [02:46] Server responding, waiting for nodes to load... [03:06] Server is ready! [03:06] Checking for import errors in server logs... [03:06] No import errors detected [03:06] Found 942 registered nodes [03:06] [REGISTRATION] PASSED [03:06] [03:06] [4/5] INSTANTIATION [03:06] ---------------------------------------- [03:06] [DEBUG] server=, api= [03:06] Testing node constructors... [03:08] All 17 node(s) instantiated successfully! [03:08] [INSTANTIATION] PASSED [03:08] [03:08] [5/5] EXECUTION [03:08] ---------------------------------------- [03:08] [DEBUG] server=, api= [03:08] CPU runner - will execute 3 workflow(s) [03:08] Running 4 workflow(s) (all with videos)... [03:08] Installing screenshot dependencies (playwright, pillow)... [03:10] Packages installed, downloading chromium browser... [03:21] Screenshot dependencies installed successfully [03:21] Starting headless browser... [03:21] macOS -- using Apple Metal GPU via ANGLE [03:22] [1/4] SKIPPED (not in cpu list) pano.json [03:22] [ComfyUI] [INFO] Using RAM pressure cache. [03:22] [ComfyUI] [INFO] Using RAM pressure cache. [03:22] Capturing execution frames: sharp_basic.json [03:22] [ComfyUI] [INFO] Using RAM pressure cache. [03:32] Frame 1 saved (frame_000.jpg, t=0.0s) [03:32] Validating workflow... [03:32] [ComfyUI] [INFO] === /validate endpoint called === [03:32] [ComfyUI] [INFO] Received JSON with keys: ['prompt'] [03:32] [ComfyUI] [INFO] Prompt has 4 nodes [03:32] [ComfyUI] [INFO] Node 1: LoadImage [03:32] [ComfyUI] [INFO] Inputs: {"image": "beach.jpg"} [03:32] [ComfyUI] [INFO] Node 2: LoadSharpModel [03:32] [ComfyUI] [INFO] Inputs: {"precision": "auto"} [03:32] [ComfyUI] [INFO] Node 5: SharpPredict [03:32] [ComfyUI] [INFO] Inputs: {"focal_length_mm": 30, "output_prefix": "sharp", "model": ["2", 0], "image": ["1", 0]} [03:32] [ComfyUI] [INFO] Node 6: PreviewGaussianSharp [03:32] [ComfyUI] [INFO] Inputs: {"preview_gaussian": "", "ply_path": ["5", 0], "extrinsics": ["5", 1], "intrinsics": ["5", 2]} [03:32] [ComfyUI] [INFO] Generated prompt_id: 992b0f9c-ac85-42cb-af49-4d6a9330e992 [03:32] [ComfyUI] [INFO] Calling execution.validate_prompt()... [03:32] [ComfyUI] [INFO] Validation result: valid=True [03:32] [ComfyUI] [INFO] === Validation PASSED === [03:32] Queuing workflow for execution... [03:32] [ComfyUI] [INFO] got prompt [03:32] [ComfyUI] [comfy-env] Running LoadSharpModel: precision: 'auto' [03:32] [ComfyUI] [comfy-env] SubprocessWorker: /Users/runner/.ce/.pixi/envs/sharp-nodes/bin/python [03:32] [ComfyUI] [comfy-env] env_vars: {'COMFYUI_BASE': '/Users/runner/work/comfy-gpu-ci/comfy-gpu-ci/test_workspaces/Sharp-1915/ComfyUI'} [03:32] [ComfyUI] [SubprocessWorker] call_method: nodes.load_model.LoadSharpModel.EXECUTE_NORMALIZED [03:32] [ComfyUI] [SubprocessWorker] acquired lock, ensuring started... [03:32] [ComfyUI] [ComfyUI-Sharp] python: /Users/runner/.ce/.pixi/envs/sharp-nodes/bin/python [03:32] [ComfyUI] [ComfyUI-Sharp] sys_path sent to worker: ['/Users/runner/work/comfy-gpu-ci/comfy-gpu-ci/test_workspaces/Sharp-1915/ComfyUI', '/Users/runner/work/comfy-gpu-ci/comfy-gpu-ci/test_workspaces/Sharp-1915/ComfyUI/custom_nodes/ComfyUI-Sharp', '/Users/runner/.ce/.pixi/envs/sharp-nodes/lib/python3.11/site-packages', '/Users/runner/work/comfy-gpu-ci/comfy-gpu-ci/test_workspaces/Sharp-1915/ComfyUI/custom_nodes/ComfyUI-Sharp'] [03:32] [ComfyUI] [SubprocessWorker] is_pixi=True, python=/Users/runner/.ce/.pixi/envs/sharp-nodes/bin/python [03:32] [ComfyUI] [SubprocessWorker] launching cmd=['/Users/runner/.pixi/bin/pixi', 'run', '--as-is', '--manifest-path', '/Users/runner/.ce/pixi.toml', '-e', 'sharp-nodes', 'python', '/var/folders/8d/778wjbv96mq1760tv6gk374m0000gn/T/comfyui_pvenv_zcu5iw2_/persistent_worker.py', 'unix:///var/folders/8d/778wjbv96mq1760tv6gk374m0000gn/T/comfy_worker_450fe80f0755.sock']... [03:32] [ComfyUI] [SubprocessWorker] socket_addr=unix:///var/folders/8d/778wjbv96mq1760tv6gk374m0000gn/T/comfy_worker_450fe80f0755.sock exists=True [03:34] Frame 2 saved (frame_001.jpg, t=2.3s) [03:34] [capture-periodic] freeze=3ms shot=159ms unfreeze=6ms saved=True [03:35] [ComfyUI] [worker:ComfyUI-Sharp] ERROR: Failed to import comfy_kitchen, Error: No module named 'comfy_kitchen', fp8 and fp4 support will not be available. [03:35] [ComfyUI] [worker:ComfyUI-Sharp] WARNING: comfy_kitchen does not support stochastic FP8 rounding, please update comfy_kitchen. [03:35] [ComfyUI] [SubprocessWorker] worker started/confirmed [03:35] [ComfyUI] [SubprocessWorker] serializing kwargs to shm... [03:35] [ComfyUI] [SubprocessWorker] created 0 shm blocks [03:35] [ComfyUI] [SubprocessWorker] sending request via socket... [03:35] [ComfyUI] [SubprocessWorker] call_id=1 sending call_method [03:36] [ComfyUI] [worker:ComfyUI-Sharp] [LoadSharpModel] precision='auto' -> dtype=bf16 (device=mps) [03:36] [ComfyUI] [worker:ComfyUI-Sharp] [LoadSharpModel] checkpoint not found at /Users/runner/work/comfy-gpu-ci/comfy-gpu-ci/test_workspaces/Sharp-1915/ComfyUI/models/sharp/sharp_2572gikvuh.pt — downloading from HuggingFace repo 'apple/Sharp' file 'sharp_2572gikvuh.pt' -> /Users/runner/work/comfy-gpu-ci/comfy-gpu-ci/test_workspaces/Sharp-1915/ComfyUI/models/sharp [03:36] Frame 3 saved (frame_002.jpg, t=4.6s) [03:36] [capture-periodic] freeze=2ms shot=118ms unfreeze=4ms saved=True [03:37] [ComfyUI] Warning: You are sending unauthenticated requests to the HF Hub. Please set a HF_TOKEN to enable higher rate limits and faster downloads. [03:37] [ComfyUI] [worker:ComfyUI-Sharp] WARNING: Warning: You are sending unauthenticated requests to the HF Hub. Please set a HF_TOKEN to enable higher rate limits and faster downloads. [03:37] [ComfyUI] [03:38] [capture-loop] iter=50 t=6.0s state={'complete': False, 'error': None, 'executedCount': 0, 'wsState': 1} eval_ms=2 ram=3.7/7.0GB (61%) swap=0.0/0.0GB (0%) cpu=76% browser_rss=0.61GB [03:40] [ComfyUI] sharp_2572gikvuh.pt: 0%| | 0.00/2.81G [00:00 dtype=bf16 [04:02] [ComfyUI] [SubprocessWorker] got response: ok [04:02] [ComfyUI] [comfy-env] LoadSharpModel done (30.43s): result: NodeOutput [04:02] [ComfyUI] [comfy-env] Running SharpPredict: focal_length_mm: 30.0, output_prefix: 'sharp', model: dict, image: torch.float32 [1,1024,1536,3] cpu [04:02] [ComfyUI] [SubprocessWorker] call_method: nodes.predict.SharpPredict.EXECUTE_NORMALIZED [04:02] [ComfyUI] [SubprocessWorker] acquired lock, ensuring started... [04:02] [ComfyUI] [ComfyUI-Sharp] Health check: ping (timeout=5.0s)... [04:02] [ComfyUI] [ComfyUI-Sharp] Health check: ok [04:02] [ComfyUI] [SubprocessWorker] worker started/confirmed [04:02] [ComfyUI] [comfy-env] PRE-SERIALIZE 'image' shape: torch.Size([1, 1024, 1536, 3]) [04:02] [ComfyUI] [SubprocessWorker] serializing kwargs to shm... [04:03] [ComfyUI] [SubprocessWorker] created 0 shm blocks [04:03] [ComfyUI] [SubprocessWorker] sending request via socket... [04:03] [ComfyUI] [SubprocessWorker] call_id=2 sending call_method [04:03] [ComfyUI] [worker:ComfyUI-Sharp] [comfy-env] _from_shm got dict with keys: ['__type__', 'strategy', 'manager_path', 'storage_key', 'storage_size'] [04:03] [ComfyUI] [worker:ComfyUI-Sharp] [comfy-env] DESERIALIZE TensorRef: tensor_size=[1, 1024, 1536, 3] [04:03] [ComfyUI] [worker:ComfyUI-Sharp] [comfy-env] DESERIALIZED tensor shape: torch.Size([1, 1024, 1536, 3]) [04:04] Frame 7 saved (frame_006.jpg, t=32.1s) [04:04] [capture-periodic] freeze=36ms shot=117ms unfreeze=3ms saved=True [04:08] [capture-loop] iter=250 t=36.3s state={'complete': False, 'error': None, 'executedCount': 0, 'wsState': 1} eval_ms=5 ram=3.0/7.0GB (57%) swap=0.0/0.0GB (0%) cpu=56% browser_rss=0.52GB [04:10] [ComfyUI] objc[16657]: Class AVFFrameReceiver is implemented in both /Users/runner/.ce/.pixi/envs/sharp-nodes/lib/libavdevice.62.3.101.dylib (0x114b247a8) and /Users/runner/.ce/.pixi/envs/sharp-nodes/lib/python3.11/site-packages/cv2/.dylibs/libavdevice.61.3.100.dylib (0x13dca83a8). This may cause spurious casting failures and mysterious crashes. One of the duplicates must be removed or renamed. [04:10] [ComfyUI] objc[16657]: Class AVFAudioReceiver is implemented in both /Users/runner/.ce/.pixi/envs/sharp-nodes/lib/libavdevice.62.3.101.dylib (0x114b247f8) and /Users/runner/.ce/.pixi/envs/sharp-nodes/lib/python3.11/site-packages/cv2/.dylibs/libavdevice.61.3.100.dylib (0x13dca83f8). This may cause spurious casting failures and mysterious crashes. One of the duplicates must be removed or renamed. [04:12] [ComfyUI] [worker:ComfyUI-Sharp] [LoadSharpModel] loading checkpoint from /Users/runner/work/comfy-gpu-ci/comfy-gpu-ci/test_workspaces/Sharp-1915/ComfyUI/models/sharp/sharp_2572gikvuh.pt (dtype=bf16) [04:14] [capture-loop] iter=300 t=42.8s state={'complete': False, 'error': None, 'executedCount': 0, 'wsState': 1} eval_ms=21 ram=3.4/7.0GB (67%) swap=0.0/0.0GB (0%) cpu=63% browser_rss=0.39GB [04:21] [ComfyUI] [worker:ComfyUI-Sharp] [LoadSharpModel] initializing model on meta device... [04:21] [ComfyUI] [worker:ComfyUI-Sharp] [LoadSharpModel] model ready (torch.bfloat16) [04:22] [ComfyUI] [SubprocessWorker] callback 'request_vram_budget' from call_id=2 [04:22] [ComfyUI] [comfy-env] VRAM request: 2.81GB, free before eviction: 1.29GB [04:22] [ComfyUI] [comfy-env] VRAM after eviction: 1.29GB [04:23] [capture-loop] iter=350 t=51.1s state={'complete': False, 'error': None, 'executedCount': 0, 'wsState': 1} eval_ms=36 ram=2.5/7.0GB (89%) swap=0.1/1.0GB (14%) cpu=78% browser_rss=0.27GB [04:30] [capture-loop] iter=400 t=58.0s state={'complete': False, 'error': None, 'executedCount': 0, 'wsState': 1} eval_ms=5 ram=5.1/7.0GB (85%) swap=0.5/1.0GB (51%) cpu=78% browser_rss=0.21GB [04:33] [ComfyUI] [worker:ComfyUI-Sharp] [04:33] [ComfyUI] === WATCHDOG TICK 1 === [04:33] [ComfyUI] [worker:ComfyUI-Sharp] Thread 0x000000016d57f000 (most recent call first): [04:33] [ComfyUI] File "/Users/runner/.ce/.pixi/envs/sharp-nodes/lib/python3.11/threading.py", line 331 in wait [04:33] [ComfyUI] File "/Users/runner/.ce/.pixi/envs/sharp-nodes/lib/python3.11/threading.py", line 629 in wait [04:33] [ComfyUI] File "/Users/runner/.ce/.pixi/envs/sharp-nodes/lib/python3.11/site-packages/tqdm/_monitor.py", line 69 in run [04:33] [ComfyUI] File "/Users/runner/.ce/.pixi/envs/sharp-nodes/lib/python3.11/threading.py", line 1045 in _bootstrap_inner [04:33] [ComfyUI] File "/Users/runner/.ce/.pixi/envs/sharp-nodes/lib/python3.11/threading.py", line 1002 in _bootstrap [04:33] [ComfyUI] [04:33] [ComfyUI] Current thread 0x000000016c24f000 (most recent call first): [04:33] [ComfyUI] File "/var/folders/8d/778wjbv96mq1760tv6gk374m0000gn/T/comfyui_pvenv_zcu5iw2_/persistent_worker.py", line 52 in _watchdog [04:33] [ComfyUI] File "/Users/runner/.ce/.pixi/envs/sharp-nodes/lib/python3.11/threading.py", line 982 in run [04:33] [ComfyUI] File "/Users/runner/.ce/.pixi/envs/sharp-nodes/lib/python3.11/threading.py", line 1045 in _bootstrap_inner [04:33] [ComfyUI] File "/Users/runner/.ce/.pixi/envs/sharp-nodes/lib/python3.11/threading.py", line 1002 in _bootstrap [04:33] [ComfyUI] [04:33] [ComfyUI] Thread 0x00000001efc5a2c0 (most recent call first): [04:33] [ComfyUI] File "/Users/runner/work/comfy-gpu-ci/comfy-gpu-ci/test_workspaces/Sharp-1915/ComfyUI/comfy/ldm/modules/sub_quadratic_attention.py", line 181 in _get_attention_scores_no_kv_chunking [04:33] [ComfyUI] File "/Users/runner/work/comfy-gpu-ci/comfy-gpu-ci/test_workspaces/Sharp-1915/ComfyUI/comfy/ldm/modules/sub_quadratic_attention.py", line 259 in efficient_dot_product_attention [04:33] [ComfyUI] File "/Users/runner/work/comfy-gpu-ci/comfy-gpu-ci/test_workspaces/Sharp-1915/ComfyUI/comfy/ldm/modules/attention.py", line 275 in attention_sub_quad [04:33] [ComfyUI] File "/Users/runner/work/comfy-gpu-ci/comfy-gpu-ci/test_workspaces/Sharp-1915/ComfyUI/comfy/ldm/modules/attention.py", line 139 in wrapper [04:33] [ComfyUI] File "/Users/runner/work/comfy-gpu-ci/comfy-gpu-ci/test_workspaces/Sharp-1915/ComfyUI/custom_nodes/ComfyUI-Sharp/nodes/sharp/model.py", line 234 in forward [04:33] [ComfyUI] File "/Users/runner/.ce/.pixi/envs/sharp-nodes/lib/python3.11/site-packages/torch/nn/modules/module.py", line 1787 in _call_impl [04:33] [ComfyUI] File "/Users/runner/.ce/.pixi/envs/sharp-nodes/lib/python3.11/site-packages/torch/nn/modules/module.py", line 1776 in _wrapped_call_impl [04:33] [ComfyUI] File "/Users/runner/work/comfy-gpu-ci/comfy-gpu-ci/test_workspaces/Sharp-1915/ComfyUI/custom_nodes/ComfyUI-Sharp/nodes/sharp/model.py", line 309 in forward [04:33] [ComfyUI] File "/Users/runner/.ce/.pixi/envs/sharp-nodes/lib/python3.11/site-packages/torch/nn/modules/module.py", line 1787 in _call_impl [04:33] [ComfyUI] File "/Users/runner/.ce/.pixi/envs/sharp-nodes/lib/python3.11/site-packages/torch/nn/modules/module.py", line 1776 in _wrapped_call_impl [04:33] [ComfyUI] File "/Users/runner/work/comfy-gpu-ci/comfy-gpu-ci/test_workspaces/Sharp-1915/ComfyUI/custom_nodes/ComfyUI-Sharp/nodes/sharp/model.py", line 412 in forward [04:33] [ComfyUI] File "/Users/runner/.ce/.pixi/envs/sharp-nodes/lib/python3.11/site-packages/torch/nn/modules/module.py", line 1787 in _call_impl [04:33] [ComfyUI] File "/Users/runner/.ce/.pixi/envs/sharp-nodes/lib/python3.11/site-packages/torch/nn/modules/module.py", line 1776 in _wrapped_call_impl [04:33] [ComfyUI] File "/Users/runner/work/comfy-gpu-ci/comfy-gpu-ci/test_workspaces/Sharp-1915/ComfyUI/custom_nodes/ComfyUI-Sharp/nodes/sharp/model.py", line 662 in forward [04:33] [ComfyUI] File "/Users/runner/.ce/.pixi/envs/sharp-nodes/lib/python3.11/site-packages/torch/nn/modules/module.py", line 1787 in _call_impl [04:33] [ComfyUI] File "/Users/runner/.ce/.pixi/envs/sharp-nodes/lib/python3.11/site-packages/torch/nn/modules/module.py", line 1776 in _wrapped_call_impl [04:33] [ComfyUI] File "/Users/runner/work/comfy-gpu-ci/comfy-gpu-ci/test_workspaces/Sharp-1915/ComfyUI/custom_nodes/ComfyUI-Sharp/nodes/sharp/model.py", line 1109 in forward [04:33] [ComfyUI] File "/Users/runner/.ce/.pixi/envs/sharp-nodes/lib/python3.11/site-packages/torch/nn/modules/module.py", line 1787 in _call_impl [04:33] [ComfyUI] File "/Users/runner/.ce/.pixi/envs/sharp-nodes/lib/python3.11/site-packages/torch/nn/modules/module.py", line 1776 in _wrapped_call_impl [04:33] [ComfyUI] File "/Users/runner/work/comfy-gpu-ci/comfy-gpu-ci/test_workspaces/Sharp-1915/ComfyUI/custom_nodes/ComfyUI-Sharp/nodes/sharp/model.py", line 2006 in encode [04:33] [ComfyUI] File "/Users/runner/work/comfy-gpu-ci/comfy-gpu-ci/test_workspaces/Sharp-1915/ComfyUI/custom_nodes/ComfyUI-Sharp/nodes/predict.py", line 348 in _predict_image_cached [04:33] [ComfyUI] File "/Users/runner/work/comfy-gpu-ci/comfy-gpu-ci/test_workspaces/Sharp-1915/ComfyUI/custom_nodes/ComfyUI-Sharp/nodes/predict.py", line 239 in execute [04:33] [ComfyUI] File "/Users/runner/.ce/.pixi/envs/sharp-nodes/lib/python3.11/site-packages/torch/utils/_contextlib.py", line 124 in decorate_context [04:33] [ComfyUI] File "/Users/runner/work/comfy-gpu-ci/comfy-gpu-ci/test_workspaces/Sharp-1915/ComfyUI/comfy_api/latest/_io.py", line 1892 in EXECUTE_NORMALIZED [04:33] [ComfyUI] File "/var/folders/8d/778wjbv96mq1760tv6gk374m0000gn/T/comfyui_pvenv_zcu5iw2_/persistent_worker.py", line 1762 in main [04:33] [ComfyUI] File "/var/folders/8d/778wjbv96mq1760tv6gk374m0000gn/T/comfyui_pvenv_zcu5iw2_/persistent_worker.py", line 1807 in [04:33] [ComfyUI] [04:33] [ComfyUI] [worker:ComfyUI-Sharp] === END === [04:33] [ComfyUI] [04:39] [capture-loop] iter=450 t=66.9s state={'complete': False, 'error': None, 'executedCount': 0, 'wsState': 1} eval_ms=6 ram=5.6/7.0GB (93%) swap=0.5/1.0GB (51%) cpu=59% browser_rss=0.21GB [04:49] [capture-loop] iter=500 t=77.1s state={'complete': False, 'error': None, 'executedCount': 0, 'wsState': 1} eval_ms=4 ram=4.9/7.0GB (90%) swap=0.5/1.0GB (50%) cpu=42% browser_rss=0.20GB [05:23] [capture-loop] iter=550 t=111.3s state={'complete': False, 'error': None, 'executedCount': 0, 'wsState': 1} eval_ms=10 ram=3.8/7.0GB (76%) swap=4.0/5.0GB (80%) cpu=54% browser_rss=0.16GB [05:35] [ComfyUI] [worker:ComfyUI-Sharp] [05:35] [ComfyUI] === WATCHDOG TICK 2 === [05:36] [ComfyUI] [worker:ComfyUI-Sharp] Thread 0x000000016d57f000 (most recent call first): [05:36] [ComfyUI] File "/Users/runner/.ce/.pixi/envs/sharp-nodes/lib/python3.11/threading.py", line 331 in wait [05:36] [ComfyUI] File "/Users/runner/.ce/.pixi/envs/sharp-nodes/lib/python3.11/threading.py", line 629 in wait [05:36] [ComfyUI] File "/Users/runner/.ce/.pixi/envs/sharp-nodes/lib/python3.11/site-packages/tqdm/_monitor.py", line 69 in run [05:36] [ComfyUI] File "/Users/runner/.ce/.pixi/envs/sharp-nodes/lib/python3.11/threading.py", line 1045 in _bootstrap_inner [05:36] [ComfyUI] File "/Users/runner/.ce/.pixi/envs/sharp-nodes/lib/python3.11/threading.py", line 1002 in _bootstrap [05:36] [ComfyUI] [05:36] [ComfyUI] Current thread 0x000000016c24f000 (most recent call first): [05:36] [ComfyUI] File "/var/folders/8d/778wjbv96mq1760tv6gk374m0000gn/T/comfyui_pvenv_zcu5iw2_/persistent_worker.py", line 52 in _watchdog [05:36] [ComfyUI] File "/Users/runner/.ce/.pixi/envs/sharp-nodes/lib/python3.11/threading.py", line 982 in run [05:36] [ComfyUI] File "/Users/runner/.ce/.pixi/envs/sharp-nodes/lib/python3.11/threading.py", line 1045 in _bootstrap_inner [05:36] [ComfyUI] File "/Users/runner/.ce/.pixi/envs/sharp-nodes/lib/python3.11/threading.py", line 1002 in _bootstrap [05:36] [ComfyUI] [05:36] [ComfyUI] Thread 0x00000001efc5a2c0 (most recent call first): [05:36] [ComfyUI] File "/Users/runner/work/comfy-gpu-ci/comfy-gpu-ci/test_workspaces/Sharp-1915/ComfyUI/custom_nodes/ComfyUI-Sharp/nodes/predict.py", line 42 in _monodepth_to [05:36] [ComfyUI] File "/Users/runner/work/comfy-gpu-ci/comfy-gpu-ci/test_workspaces/Sharp-1915/ComfyUI/custom_nodes/ComfyUI-Sharp/nodes/predict.py", line 353 in _predict_image_cached [05:36] [ComfyUI] File "/Users/runner/work/comfy-gpu-ci/comfy-gpu-ci/test_workspaces/Sharp-1915/ComfyUI/custom_nodes/ComfyUI-Sharp/nodes/predict.py", line 239 in execute [05:36] [ComfyUI] File "/Users/runner/.ce/.pixi/envs/sharp-nodes/lib/python3.11/site-packages/torch/utils/_contextlib.py", line 124 in decorate_context [05:36] [ComfyUI] File "/Users/runner/work/comfy-gpu-ci/comfy-gpu-ci/test_workspaces/Sharp-1915/ComfyUI/comfy_api/latest/_io.py", line 1892 in EXECUTE_NORMALIZED [05:36] [ComfyUI] File "/var/folders/8d/778wjbv96mq1760tv6gk374m0000gn/T/comfyui_pvenv_zcu5iw2_/persistent_worker.py", line 1762 in main [05:36] [ComfyUI] File "/var/folders/8d/778wjbv96mq1760tv6gk374m0000gn/T/comfyui_pvenv_zcu5iw2_/persistent_worker.py", line 1807 in [05:36] [ComfyUI] [05:36] [ComfyUI] [worker:ComfyUI-Sharp] === END === [05:36] [ComfyUI] [05:42] [capture-loop] iter=600 t=130.4s state={'complete': False, 'error': None, 'executedCount': 0, 'wsState': 1} eval_ms=5 ram=5.0/7.0GB (90%) swap=4.4/5.0GB (88%) cpu=39% browser_rss=0.16GB [06:03] [capture-loop] iter=650 t=151.4s state={'complete': False, 'error': None, 'executedCount': 0, 'wsState': 1} eval_ms=5 ram=4.5/7.0GB (92%) swap=6.4/7.0GB (91%) cpu=61% browser_rss=0.17GB [06:11] [capture-loop] iter=700 t=159.0s state={'complete': False, 'error': None, 'executedCount': 0, 'wsState': 1} eval_ms=2 ram=5.0/7.0GB (83%) swap=6.6/7.0GB (94%) cpu=56% browser_rss=0.18GB [06:16] [ComfyUI] [SubprocessWorker] callback 'report_progress' from call_id=2 [06:16] [ComfyUI] [SubprocessWorker] got response: ok [06:16] [ComfyUI] [comfy-env] SharpPredict done (133.46s): result: NodeOutput [06:16] [ComfyUI] [comfy-env] Running PreviewGaussianSharp: ply_path: '/Users/runner/work/comfy-gpu-ci/comfy-gpu-ci/test_worksp..., extrinsics: list[4], intrinsics: list[3] [06:16] [ComfyUI] [comfy-env] SubprocessWorker: /Users/runner/.ce/.pixi/envs/gaussianpack-nodes/bin/python [06:16] [ComfyUI] [comfy-env] env_vars: {'COMFYUI_BASE': '/Users/runner/work/comfy-gpu-ci/comfy-gpu-ci/test_workspaces/Sharp-1915/ComfyUI'} [06:16] [ComfyUI] [SubprocessWorker] call_method: nodes.preview_gaussian_sharp.PreviewGaussianSharp.EXECUTE_NORMALIZED [06:16] [ComfyUI] [SubprocessWorker] acquired lock, ensuring started... [06:16] [ComfyUI] [ComfyUI-GaussianPack] python: /Users/runner/.ce/.pixi/envs/gaussianpack-nodes/bin/python [06:16] [ComfyUI] [ComfyUI-GaussianPack] sys_path sent to worker: ['/Users/runner/work/comfy-gpu-ci/comfy-gpu-ci/test_workspaces/Sharp-1915/ComfyUI', '/Users/runner/work/comfy-gpu-ci/comfy-gpu-ci/test_workspaces/Sharp-1915/ComfyUI/custom_nodes/ComfyUI-GaussianPack', '/Users/runner/.ce/.pixi/envs/gaussianpack-nodes/lib/python3.11/site-packages', '/Users/runner/work/comfy-gpu-ci/comfy-gpu-ci/test_workspaces/Sharp-1915/ComfyUI/custom_nodes/ComfyUI-GaussianPack'] [06:16] [ComfyUI] [SubprocessWorker] is_pixi=True, python=/Users/runner/.ce/.pixi/envs/gaussianpack-nodes/bin/python [06:16] [ComfyUI] [SubprocessWorker] launching cmd=['/Users/runner/.pixi/bin/pixi', 'run', '--as-is', '--manifest-path', '/Users/runner/.ce/pixi.toml', '-e', 'gaussianpack-nodes', 'python', '/var/folders/8d/778wjbv96mq1760tv6gk374m0000gn/T/comfyui_pvenv_atgs5eit/persistent_worker.py', 'unix:///var/folders/8d/778wjbv96mq1760tv6gk374m0000gn/T/comfy_worker_61a83e924cbb.sock']... [06:16] [ComfyUI] [SubprocessWorker] socket_addr=unix:///var/folders/8d/778wjbv96mq1760tv6gk374m0000gn/T/comfy_worker_61a83e924cbb.sock exists=True [06:16] Frame 8 saved (frame_007.jpg, t=164.2s) [06:16] [capture-periodic] freeze=5ms shot=161ms unfreeze=3ms saved=True [06:17] [capture-loop] iter=750 t=165.7s state={'complete': False, 'error': None, 'executedCount': 0, 'wsState': 1} eval_ms=2 ram=3.2/7.0GB (70%) swap=6.5/7.0GB (92%) cpu=61% browser_rss=0.20GB [06:18] Frame 9 saved (frame_008.jpg, t=166.5s) [06:18] [capture-periodic] freeze=3ms shot=119ms unfreeze=2ms saved=True [06:20] [ComfyUI] [SubprocessWorker] worker started/confirmed [06:20] [ComfyUI] [SubprocessWorker] serializing kwargs to shm... [06:20] [ComfyUI] [SubprocessWorker] created 0 shm blocks [06:20] [ComfyUI] [SubprocessWorker] sending request via socket... [06:20] [ComfyUI] [SubprocessWorker] call_id=1 sending call_method [06:23] [ComfyUI] [worker:ComfyUI-GaussianPack] WARNING: SPZ route not registered (ModuleNotFoundError: No module named 'comfy_aimdo') [06:23] [ComfyUI] [SubprocessWorker] got response: ok [06:23] [ComfyUI] [comfy-env] PreviewGaussianSharp done (6.87s): result: NodeOutput [06:23] [ComfyUI] [INFO] Prompt executed in 171.01 seconds [06:23] Node executed (1 total), capturing... [06:23] Frame 10 saved (frame_009.jpg, t=171.5s) [06:23] [capture-node] freeze=7ms shot=331ms unfreeze=3ms saved=True [06:24] Execution complete (t=172.0s) [06:24] [3d-wait] Phase 1: Waiting for 'Loading 3D Model' text to disappear... [06:24] [3d-wait] Phase 1 done in 0.0s [06:24] [3d-wait] Phase 2: iframes=1 [06:24] [3d-wait] iframe viewer_ready=False (matched 0 console logs) [06:24] [3d-wait] Waiting for 'Loaded successfully' console message (timeout=60s)... [06:29] [3d-wait] Got 'Loaded successfully' after 5.8s [06:30] [3d-wait] Unfrozen in 0.442s, rendering for 5s... [06:35] [3d-wait] JS halted via CDP after 5.5s [06:36] [3d-wait] Re-frozen in 6.7s [06:36] [3d-wait] Total 3D wait: 12.5s [06:36] Captured 10 unique frames over 184.47s [06:36] [debug] iframes: 1 [06:36] [debug] iframe[0]: src=http://127.0.0.1:41893/extensions/ComfyUI-GaussianPack/viewer_gaussian_sharp.htm, canvas=1536x1024, rafFrozen=True [06:36] [timing] trigger_3d_previews: 0.0s [06:39] Saved high-quality screenshot: sharp_basic_executed.png [06:39] [timing] final_screenshot: 0.4s [06:39] [ComfyUI] [INFO] Using RAM pressure cache. [06:39] [ComfyUI] [INFO] Using RAM pressure cache. [06:39] Capturing execution frames: sharp_exif.json [06:39] [ComfyUI] [INFO] Using RAM pressure cache. [06:47] Frame 1 saved (frame_000.jpg, t=0.0s) [06:47] Validating workflow... [06:47] [ComfyUI] [INFO] === /validate endpoint called === [06:47] [ComfyUI] [INFO] Received JSON with keys: ['prompt'] [06:47] [ComfyUI] [INFO] Prompt has 4 nodes [06:47] [ComfyUI] [INFO] Node 2: LoadSharpModel [06:47] [ComfyUI] [INFO] Inputs: {"precision": "auto"} [06:47] [ComfyUI] [INFO] Node 7: SharpPredict [06:47] [ComfyUI] [INFO] Inputs: {"focal_length_mm": ["9", 2], "output_prefix": "sharp", "model": ["2", 0], "image": ["9", 0]} [06:47] [ComfyUI] [INFO] Node 9: LoadImageWithExif [06:47] [ComfyUI] [INFO] Inputs: {"image": "eth3d.png", "default_focal_mm": 30} [06:47] [ComfyUI] [INFO] Node 11: PreviewGaussianSharp [06:47] [ComfyUI] [INFO] Inputs: {"preview_gaussian": "", "ply_path": ["7", 0], "extrinsics": ["7", 1], "intrinsics": ["7", 2]} [06:47] [ComfyUI] [INFO] Generated prompt_id: 6b486fba-b946-4cbc-8766-4743667ede94 [06:47] [ComfyUI] [INFO] Calling execution.validate_prompt()... [06:47] [ComfyUI] [INFO] Validation result: valid=True [06:47] [ComfyUI] [INFO] === Validation PASSED === [06:47] Queuing workflow for execution... [06:47] [ComfyUI] [INFO] got prompt [06:47] [ComfyUI] [comfy-env] Running LoadImageWithExif: image: 'eth3d.png', default_focal_mm: 30.0 [06:47] [ComfyUI] [SubprocessWorker] call_method: nodes.load_image_exif.LoadImageWithExif.EXECUTE_NORMALIZED [06:47] [ComfyUI] [SubprocessWorker] acquired lock, ensuring started... [06:47] [ComfyUI] [ComfyUI-Sharp] Health check: ping (timeout=5.0s)... [06:47] [ComfyUI] [ComfyUI-Sharp] Health check: failed [06:47] [ComfyUI] [ComfyUI-Sharp] Socket unhealthy, restarting worker... [06:47] [ComfyUI] [ComfyUI-Sharp] python: /Users/runner/.ce/.pixi/envs/sharp-nodes/bin/python [06:47] [ComfyUI] [ComfyUI-Sharp] sys_path sent to worker: ['/Users/runner/work/comfy-gpu-ci/comfy-gpu-ci/test_workspaces/Sharp-1915/ComfyUI', '/Users/runner/work/comfy-gpu-ci/comfy-gpu-ci/test_workspaces/Sharp-1915/ComfyUI/custom_nodes/ComfyUI-Sharp', '/Users/runner/.ce/.pixi/envs/sharp-nodes/lib/python3.11/site-packages', '/Users/runner/work/comfy-gpu-ci/comfy-gpu-ci/test_workspaces/Sharp-1915/ComfyUI/custom_nodes/ComfyUI-Sharp'] [06:47] [ComfyUI] [SubprocessWorker] is_pixi=True, python=/Users/runner/.ce/.pixi/envs/sharp-nodes/bin/python [06:47] [ComfyUI] [SubprocessWorker] launching cmd=['/Users/runner/.pixi/bin/pixi', 'run', '--as-is', '--manifest-path', '/Users/runner/.ce/pixi.toml', '-e', 'sharp-nodes', 'python', '/var/folders/8d/778wjbv96mq1760tv6gk374m0000gn/T/comfyui_pvenv_zcu5iw2_/persistent_worker.py', 'unix:///var/folders/8d/778wjbv96mq1760tv6gk374m0000gn/T/comfy_worker_be2eddec1a40.sock']... [06:47] [ComfyUI] [SubprocessWorker] socket_addr=unix:///var/folders/8d/778wjbv96mq1760tv6gk374m0000gn/T/comfy_worker_be2eddec1a40.sock exists=True [06:49] Frame 2 saved (frame_001.jpg, t=2.5s) [06:49] [capture-periodic] freeze=6ms shot=244ms unfreeze=12ms saved=True [06:51] [ComfyUI] [worker:ComfyUI-Sharp] ERROR: Failed to import comfy_kitchen, Error: No module named 'comfy_kitchen', fp8 and fp4 support will not be available. [06:52] [ComfyUI] [worker:ComfyUI-Sharp] WARNING: comfy_kitchen does not support stochastic FP8 rounding, please update comfy_kitchen. [06:52] [ComfyUI] [SubprocessWorker] worker started/confirmed [06:52] [ComfyUI] [SubprocessWorker] serializing kwargs to shm... [06:52] [ComfyUI] [SubprocessWorker] created 0 shm blocks [06:52] [ComfyUI] [SubprocessWorker] sending request via socket... [06:52] [ComfyUI] [SubprocessWorker] call_id=3 sending call_method [06:53] Frame 3 saved (frame_002.jpg, t=4.8s) [06:53] [capture-periodic] freeze=11ms shot=1239ms unfreeze=12ms saved=True [06:54] [capture-loop] iter=50 t=7.8s state={'complete': False, 'error': None, 'executedCount': 0, 'wsState': 1} eval_ms=4 ram=2.1/7.0GB (37%) swap=5.7/8.0GB (71%) cpu=65% browser_rss=0.53GB [06:55] [ComfyUI] [SubprocessWorker] got response: ok [06:55] [ComfyUI] [comfy-env] LoadImageWithExif done (7.97s): result: NodeOutput [06:55] [ComfyUI] [comfy-env] Running LoadSharpModel: precision: 'auto' [06:55] [ComfyUI] [SubprocessWorker] call_method: nodes.load_model.LoadSharpModel.EXECUTE_NORMALIZED [06:55] [ComfyUI] [SubprocessWorker] acquired lock, ensuring started... [06:55] [ComfyUI] [ComfyUI-Sharp] Health check: ping (timeout=5.0s)... [06:55] [ComfyUI] [ComfyUI-Sharp] Health check: ok [06:55] [ComfyUI] [SubprocessWorker] worker started/confirmed [06:55] [ComfyUI] [SubprocessWorker] serializing kwargs to shm... [06:55] [ComfyUI] [SubprocessWorker] created 0 shm blocks [06:55] [ComfyUI] [SubprocessWorker] sending request via socket... [06:55] [ComfyUI] [SubprocessWorker] call_id=4 sending call_method [06:55] [ComfyUI] [worker:ComfyUI-Sharp] [LoadSharpModel] precision='auto' -> dtype=bf16 (device=mps) [06:55] [ComfyUI] [worker:ComfyUI-Sharp] [LoadSharpModel] checkpoint already present, reusing (no download): /Users/runner/work/comfy-gpu-ci/comfy-gpu-ci/test_workspaces/Sharp-1915/ComfyUI/models/sharp/sharp_2572gikvuh.pt (2679.6 MB) [06:55] [ComfyUI] [worker:ComfyUI-Sharp] [LoadSharpModel] checkpoint ready: /Users/runner/work/comfy-gpu-ci/comfy-gpu-ci/test_workspaces/Sharp-1915/ComfyUI/models/sharp/sharp_2572gikvuh.pt (2679.6 MB) [06:55] [ComfyUI] [worker:ComfyUI-Sharp] [LoadSharpModel] config: precision=auto -> dtype=bf16 [06:55] [ComfyUI] [SubprocessWorker] got response: ok [06:55] [ComfyUI] [comfy-env] LoadSharpModel done (0.05s): result: NodeOutput [06:55] [ComfyUI] [comfy-env] Running SharpPredict: focal_length_mm: 20.0, output_prefix: 'sharp', model: dict, image: torch.float32 [1,2022,3040,3] cpu [06:55] [ComfyUI] [SubprocessWorker] call_method: nodes.predict.SharpPredict.EXECUTE_NORMALIZED [06:55] [ComfyUI] [SubprocessWorker] acquired lock, ensuring started... [06:55] [ComfyUI] [ComfyUI-Sharp] Health check: ping (timeout=5.0s)... [06:55] [ComfyUI] [ComfyUI-Sharp] Health check: ok [06:55] [ComfyUI] [SubprocessWorker] worker started/confirmed [06:55] [ComfyUI] [comfy-env] PRE-SERIALIZE 'image' shape: torch.Size([1, 2022, 3040, 3]) [06:55] [ComfyUI] [SubprocessWorker] serializing kwargs to shm... [06:55] [ComfyUI] [SubprocessWorker] created 0 shm blocks [06:55] [ComfyUI] [SubprocessWorker] sending request via socket... [06:55] [ComfyUI] [SubprocessWorker] call_id=5 sending call_method [06:55] [ComfyUI] [worker:ComfyUI-Sharp] [comfy-env] _from_shm got dict with keys: ['__type__', 'strategy', 'manager_path', 'storage_key', 'storage_size'] [06:55] [ComfyUI] [worker:ComfyUI-Sharp] [comfy-env] DESERIALIZE TensorRef: tensor_size=[1, 2022, 3040, 3] [06:55] [ComfyUI] [worker:ComfyUI-Sharp] [comfy-env] DESERIALIZED tensor shape: torch.Size([1, 2022, 3040, 3]) [06:55] Frame 4 saved (frame_003.jpg, t=8.2s) [06:55] [capture-periodic] freeze=5ms shot=246ms unfreeze=6ms saved=True [06:57] Frame 5 saved (frame_004.jpg, t=10.6s) [06:57] [capture-periodic] freeze=4ms shot=122ms unfreeze=4ms saved=True [06:58] [ComfyUI] objc[20942]: Class AVFFrameReceiver is implemented in both /Users/runner/.ce/.pixi/envs/sharp-nodes/lib/libavdevice.62.3.101.dylib (0x1283447a8) and /Users/runner/.ce/.pixi/envs/sharp-nodes/lib/python3.11/site-packages/cv2/.dylibs/libavdevice.61.3.100.dylib (0x15ef303a8). This may cause spurious casting failures and mysterious crashes. One of the duplicates must be removed or renamed. [06:58] [ComfyUI] objc[20942]: Class AVFAudioReceiver is implemented in both /Users/runner/.ce/.pixi/envs/sharp-nodes/lib/libavdevice.62.3.101.dylib (0x1283447f8) and /Users/runner/.ce/.pixi/envs/sharp-nodes/lib/python3.11/site-packages/cv2/.dylibs/libavdevice.61.3.100.dylib (0x15ef303f8). This may cause spurious casting failures and mysterious crashes. One of the duplicates must be removed or renamed. [07:00] [ComfyUI] [worker:ComfyUI-Sharp] [LoadSharpModel] loading checkpoint from /Users/runner/work/comfy-gpu-ci/comfy-gpu-ci/test_workspaces/Sharp-1915/ComfyUI/models/sharp/sharp_2572gikvuh.pt (dtype=bf16) [07:01] [capture-loop] iter=100 t=14.1s state={'complete': False, 'error': None, 'executedCount': 0, 'wsState': 1} eval_ms=72 ram=2.6/7.0GB (44%) swap=3.5/8.0GB (44%) cpu=64% browser_rss=0.54GB [07:04] Frame 6 saved (frame_005.jpg, t=17.3s) [07:04] [capture-periodic] freeze=4ms shot=458ms unfreeze=13ms saved=True [07:08] [capture-loop] iter=150 t=21.4s state={'complete': False, 'error': None, 'executedCount': 0, 'wsState': 1} eval_ms=4 ram=2.7/7.0GB (76%) swap=0.6/2.0GB (30%) cpu=88% browser_rss=0.44GB [07:08] [ComfyUI] [worker:ComfyUI-Sharp] [LoadSharpModel] initializing model on meta device... [07:08] [ComfyUI] [worker:ComfyUI-Sharp] [LoadSharpModel] model ready (torch.bfloat16) [07:08] [ComfyUI] [SubprocessWorker] callback 'request_vram_budget' from call_id=5 [07:08] [ComfyUI] [comfy-env] VRAM request: 2.81GB, free before eviction: 1.80GB [07:08] [ComfyUI] [comfy-env] VRAM after eviction: 1.80GB [07:13] Frame 7 saved (frame_006.jpg, t=26.3s) [07:13] [capture-periodic] freeze=3ms shot=260ms unfreeze=12ms saved=True [07:16] [capture-loop] iter=200 t=29.8s state={'complete': False, 'error': None, 'executedCount': 0, 'wsState': 1} eval_ms=6 ram=4.5/7.0GB (79%) swap=0.6/2.0GB (30%) cpu=73% browser_rss=0.27GB [07:27] Frame 8 saved (frame_007.jpg, t=33.8s) [07:27] [capture-periodic] freeze=2ms shot=7203ms unfreeze=24ms saved=True [07:33] Frame 9 saved (frame_008.jpg, t=43.2s) [07:33] [capture-periodic] freeze=2ms shot=3247ms unfreeze=3ms saved=True [07:33] [capture-loop] iter=250 t=46.6s state={'complete': False, 'error': None, 'executedCount': 0, 'wsState': 1} eval_ms=5 ram=5.8/7.0GB (90%) swap=0.9/2.0GB (45%) cpu=79% browser_rss=0.24GB [07:46] Frame 10 saved (frame_009.jpg, t=53.8s) [07:46] [capture-periodic] freeze=97ms shot=5990ms unfreeze=5ms saved=True [07:47] [ComfyUI] [worker:ComfyUI-Sharp] [07:47] [ComfyUI] === WATCHDOG TICK 1 === [07:47] [ComfyUI] [worker:ComfyUI-Sharp] Current thread 0x000000016c1f7000 (most recent call first): [07:47] [ComfyUI] File "/var/folders/8d/778wjbv96mq1760tv6gk374m0000gn/T/comfyui_pvenv_zcu5iw2_/persistent_worker.py", line 52 in _watchdog [07:47] [ComfyUI] File "/Users/runner/.ce/.pixi/envs/sharp-nodes/lib/python3.11/threading.py", line 982 in run [07:47] [ComfyUI] File "/Users/runner/.ce/.pixi/envs/sharp-nodes/lib/python3.11/threading.py", line 1045 in _bootstrap_inner [07:47] [ComfyUI] File "/Users/runner/.ce/.pixi/envs/sharp-nodes/lib/python3.11/threading.py", line 1002 in _bootstrap [07:47] [ComfyUI] [07:47] [ComfyUI] Thread 0x00000001efc5a2c0 (most recent call first): [07:47] [ComfyUI] File "/Users/runner/.ce/.pixi/envs/sharp-nodes/lib/python3.11/site-packages/torch/nn/modules/conv.py", line 548 in _conv_forward [07:47] [ComfyUI] File "/Users/runner/.ce/.pixi/envs/sharp-nodes/lib/python3.11/site-packages/torch/nn/modules/conv.py", line 553 in forward [07:47] [ComfyUI] File "/Users/runner/work/comfy-gpu-ci/comfy-gpu-ci/test_workspaces/Sharp-1915/ComfyUI/comfy/ops.py", line 537 in forward [07:47] [ComfyUI] File "/Users/runner/.ce/.pixi/envs/sharp-nodes/lib/python3.11/site-packages/torch/nn/modules/module.py", line 1787 in _call_impl [07:47] [ComfyUI] File "/Users/runner/.ce/.pixi/envs/sharp-nodes/lib/python3.11/site-packages/torch/nn/modules/module.py", line 1776 in _wrapped_call_impl [07:47] [ComfyUI] File "/Users/runner/work/comfy-gpu-ci/comfy-gpu-ci/test_workspaces/Sharp-1915/ComfyUI/custom_nodes/ComfyUI-Sharp/nodes/sharp/model.py", line 969 in forward [07:47] [ComfyUI] File "/Users/runner/.ce/.pixi/envs/sharp-nodes/lib/python3.11/site-packages/torch/nn/modules/module.py", line 1787 in _call_impl [07:47] [ComfyUI] File "/Users/runner/.ce/.pixi/envs/sharp-nodes/lib/python3.11/site-packages/torch/nn/modules/module.py", line 1776 in _wrapped_call_impl [07:47] [ComfyUI] File "/Users/runner/work/comfy-gpu-ci/comfy-gpu-ci/test_workspaces/Sharp-1915/ComfyUI/custom_nodes/ComfyUI-Sharp/nodes/sharp/model.py", line 1118 in forward [07:47] [ComfyUI] File "/Users/runner/.ce/.pixi/envs/sharp-nodes/lib/python3.11/site-packages/torch/nn/modules/module.py", line 1787 in _call_impl [07:47] [ComfyUI] File "/Users/runner/.ce/.pixi/envs/sharp-nodes/lib/python3.11/site-packages/torch/nn/modules/module.py", line 1776 in _wrapped_call_impl [07:47] [ComfyUI] File "/Users/runner/work/comfy-gpu-ci/comfy-gpu-ci/test_workspaces/Sharp-1915/ComfyUI/custom_nodes/ComfyUI-Sharp/nodes/sharp/model.py", line 2006 in encode [07:47] [ComfyUI] File "/Users/runner/work/comfy-gpu-ci/comfy-gpu-ci/test_workspaces/Sharp-1915/ComfyUI/custom_nodes/ComfyUI-Sharp/nodes/predict.py", line 348 in _predict_image_cached [07:47] [ComfyUI] File "/Users/runner/work/comfy-gpu-ci/comfy-gpu-ci/test_workspaces/Sharp-1915/ComfyUI/custom_nodes/ComfyUI-Sharp/nodes/predict.py", line 239 in execute [07:47] [ComfyUI] File "/Users/runner/.ce/.pixi/envs/sharp-nodes/lib/python3.11/site-packages/torch/utils/_contextlib.py", line 124 in decorate_context [07:47] [ComfyUI] File "/Users/runner/work/comfy-gpu-ci/comfy-gpu-ci/test_workspaces/Sharp-1915/ComfyUI/comfy_api/latest/_io.py", line 1892 in EXECUTE_NORMALIZED [07:47] [ComfyUI] File "/var/folders/8d/778wjbv96mq1760tv6gk374m0000gn/T/comfyui_pvenv_zcu5iw2_/persistent_worker.py", line 1762 in main [07:47] [ComfyUI] File "/var/folders/8d/778wjbv96mq1760tv6gk374m0000gn/T/comfyui_pvenv_zcu5iw2_/persistent_worker.py", line 1807 in [07:47] [ComfyUI] [07:47] [ComfyUI] [worker:ComfyUI-Sharp] === END === [07:47] [ComfyUI] [07:48] [capture-loop] iter=300 t=61.4s state={'complete': False, 'error': None, 'executedCount': 0, 'wsState': 1} eval_ms=16 ram=5.2/7.0GB (84%) swap=1.2/2.0GB (62%) cpu=77% browser_rss=0.20GB [08:13] [ComfyUI] [SubprocessWorker] got response: error [08:13] [ComfyUI] [ERROR] !!! Exception during processing !!! MPS backend out of memory (MPS allocated: 6.73 GiB, other allocations: 581.22 MiB, max allowed: 7.93 GiB). Tried to allocate 576.00 MiB on private pool. Use PYTORCH_MPS_HIGH_WATERMARK_RATIO=0.0 to disable upper limit for memory allocations (may cause system failure). [08:13] [ComfyUI] [08:13] [ComfyUI] Worker traceback: [08:13] [ComfyUI] Traceback (most recent call last): [08:13] [ComfyUI] File "/var/folders/8d/778wjbv96mq1760tv6gk374m0000gn/T/comfyui_pvenv_zcu5iw2_/persistent_worker.py", line 1762, in main [08:13] [ComfyUI] result = method(**inputs) [08:13] [ComfyUI] ^^^^^^^^^^^^^^^^ [08:13] [ComfyUI] File "/Users/runner/work/comfy-gpu-ci/comfy-gpu-ci/test_workspaces/Sharp-1915/ComfyUI/comfy_api/latest/_io.py", line 1892, in EXECUTE_NORMALIZED [08:13] [ComfyUI] to_return = cls.execute(*args, **kwargs) [08:13] [ComfyUI] ^^^^^^^^^^^^^^^^^^^^^^^^^^^^ [08:13] [ComfyUI] File "/Users/runner/.ce/.pixi/envs/sharp-nodes/lib/python3.11/site-packages/torch/utils/_contextlib.py", line 124, in decorate_context [08:13] [ComfyUI] return func(*args, **kwargs) [08:13] [ComfyUI] ^^^^^^^^^^^^^^^^^^^^^ [08:13] [ComfyUI] File "/Users/runner/work/comfy-gpu-ci/comfy-gpu-ci/test_workspaces/Sharp-1915/ComfyUI/custom_nodes/ComfyUI-Sharp/nodes/predict.py", line 239, in execute [08:13] [ComfyUI] gaussians, refined_depth_l0, refined_depth_l1 = _predict_image_cached( [08:13] [ComfyUI] ^^^^^^^^^^^^^^^^^^^^^^ [08:13] [ComfyUI] File "/Users/runner/work/comfy-gpu-ci/comfy-gpu-ci/test_workspaces/Sharp-1915/ComfyUI/custom_nodes/ComfyUI-Sharp/nodes/predict.py", line 348, in _predict_image_cached [08:13] [ComfyUI] monodepth_output, _ = predictor.encode(image_resized_pt) [08:13] [ComfyUI] ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ [08:13] [ComfyUI] File "/Users/runner/work/comfy-gpu-ci/comfy-gpu-ci/test_workspaces/Sharp-1915/ComfyUI/custom_nodes/ComfyUI-Sharp/nodes/sharp/model.py", line 2006, in encode [08:13] [ComfyUI] monodepth_output = self.monodepth_model(image) [08:13] [ComfyUI] ^^^^^^^^^^^^^^^^^^^^^^^^^^^ [08:13] [ComfyUI] File "/Users/runner/.ce/.pixi/envs/sharp-nodes/lib/python3.11/site-packages/torch/nn/modules/module.py", line 1776, in _wrapped_call_impl [08:13] [ComfyUI] return self._call_impl(*args, **kwargs) [08:13] [ComfyUI] ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ [08:13] [ComfyUI] File "/Users/runner/.ce/.pixi/envs/sharp-nodes/lib/python3.11/site-packages/torch/nn/modules/module.py", line 1787, in _call_impl [08:13] [ComfyUI] return forward_call(*args, **kwargs) [08:13] [ComfyUI] ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ [08:13] [ComfyUI] File "/Users/runner/work/comfy-gpu-ci/comfy-gpu-ci/test_workspaces/Sharp-1915/ComfyUI/custom_nodes/ComfyUI-Sharp/nodes/sharp/model.py", line 1118, in forward [08:13] [ComfyUI] decoder_features = self.monodepth_predictor.decoder(encoder_features) [08:13] [ComfyUI] ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ [08:13] [ComfyUI] File "/Users/runner/.ce/.pixi/envs/sharp-nodes/lib/python3.11/site-packages/torch/nn/modules/module.py", line 1776, in _wrapped_call_impl [08:13] [ComfyUI] return self._call_impl(*args, **kwargs) [08:13] [ComfyUI] ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ [08:13] [ComfyUI] File "/Users/runner/.ce/.pixi/envs/sharp-nodes/lib/python3.11/site-packages/torch/nn/modules/module.py", line 1787, in _call_impl [08:13] [ComfyUI] return forward_call(*args, **kwargs) [08:13] [ComfyUI] ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ [08:13] [ComfyUI] File "/Users/runner/work/comfy-gpu-ci/comfy-gpu-ci/test_workspaces/Sharp-1915/ComfyUI/custom_nodes/ComfyUI-Sharp/nodes/sharp/model.py", line 970, in forward [08:13] [ComfyUI] features = self.fusions[i](features, features_i) [08:13] [ComfyUI] ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ [08:13] [ComfyUI] File "/Users/runner/.ce/.pixi/envs/sharp-nodes/lib/python3.11/site-packages/torch/nn/modules/module.py", line 1776, in _wrapped_call_impl [08:13] [ComfyUI] return self._call_impl(*args, **kwargs) [08:13] [ComfyUI] ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ [08:13] [ComfyUI] File "/Users/runner/.ce/.pixi/envs/sharp-nodes/lib/python3.11/site-packages/torch/nn/modules/module.py", line 1787, in _call_impl [08:13] [ComfyUI] return forward_call(*args, **kwargs) [08:13] [ComfyUI] ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ [08:13] [ComfyUI] File "/Users/runner/work/comfy-gpu-ci/comfy-gpu-ci/test_workspaces/Sharp-1915/ComfyUI/custom_nodes/ComfyUI-Sharp/nodes/sharp/model.py", line 862, in forward [08:13] [ComfyUI] x = self.out_conv(x) [08:13] [ComfyUI] ^^^^^^^^^^^^^^^^ [08:13] [ComfyUI] File "/Users/runner/.ce/.pixi/envs/sharp-nodes/lib/python3.11/site-packages/torch/nn/modules/module.py", line 1776, in _wrapped_call_impl [08:13] [ComfyUI] return self._call_impl(*args, **kwargs) [08:13] [ComfyUI] ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ [08:13] [ComfyUI] File "/Users/runner/.ce/.pixi/envs/sharp-nodes/lib/python3.11/site-packages/torch/nn/modules/module.py", line 1787, in _call_impl [08:13] [ComfyUI] return forward_call(*args, **kwargs) [08:13] [ComfyUI] ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ [08:13] [ComfyUI] File "/Users/runner/work/comfy-gpu-ci/comfy-gpu-ci/test_workspaces/Sharp-1915/ComfyUI/comfy/ops.py", line 537, in forward [08:13] [ComfyUI] return super().forward(*args, **kwargs) [08:13] [ComfyUI] ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ [08:13] [ComfyUI] File "/Users/runner/.ce/.pixi/envs/sharp-nodes/lib/python3.11/site-packages/torch/nn/modules/conv.py", line 553, in forward [08:13] [ComfyUI] return self._conv_forward(input, self.weight, self.bias) [08:13] [ComfyUI] ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ [08:13] [ComfyUI] File "/Users/runner/.ce/.pixi/envs/sharp-nodes/lib/python3.11/site-packages/torch/nn/modules/conv.py", line 548, in _conv_forward [08:13] [ComfyUI] return F.conv2d( [08:13] [ComfyUI] ^^^^^^^^^ [08:13] [ComfyUI] RuntimeError: MPS backend out of memory (MPS allocated: 6.73 GiB, other allocations: 581.22 MiB, max allowed: 7.93 GiB). Tried to allocate 576.00 MiB on private pool. Use PYTORCH_MPS_HIGH_WATERMARK_RATIO=0.0 to disable upper limit for memory allocations (may cause system failure). [08:13] [ComfyUI] [08:13] [ComfyUI] [ERROR] Traceback (most recent call last): [08:13] [ComfyUI] File "/Users/runner/work/comfy-gpu-ci/comfy-gpu-ci/test_workspaces/Sharp-1915/ComfyUI/execution.py", line 536, in execute [08:13] [ComfyUI] output_data, output_ui, has_subgraph, has_pending_tasks = await get_output_data(prompt_id, unique_id, obj, input_data_all, execution_block_cb=execution_block_cb, pre_execute_cb=pre_execute_cb, v3_data=v3_data) [08:13] [ComfyUI] ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ [08:13] [ComfyUI] File "/Users/runner/work/comfy-gpu-ci/comfy-gpu-ci/test_workspaces/Sharp-1915/ComfyUI/execution.py", line 336, in get_output_data [08:13] [ComfyUI] return_values = await _async_map_node_over_list(prompt_id, unique_id, obj, input_data_all, obj.FUNCTION, allow_interrupt=True, execution_block_cb=execution_block_cb, pre_execute_cb=pre_execute_cb, v3_data=v3_data) [08:13] [ComfyUI] ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ [08:13] [ComfyUI] File "/Users/runner/work/comfy-gpu-ci/comfy-gpu-ci/test_workspaces/Sharp-1915/ComfyUI/execution.py", line 310, in _async_map_node_over_list [08:13] [ComfyUI] await process_inputs(input_dict, i) [08:13] [ComfyUI] File "/Users/runner/work/comfy-gpu-ci/comfy-gpu-ci/test_workspaces/Sharp-1915/ComfyUI/execution.py", line 298, in process_inputs [08:13] [ComfyUI] result = f(**inputs) [08:13] [ComfyUI] ^^^^^^^^^^^ [08:13] [ComfyUI] File "/Users/runner/work/comfy-gpu-ci/comfy-gpu-ci/test_workspaces/Sharp-1915/venv/lib/python3.11/site-packages/comfy_env/isolation/metadata.py", line 556, in proxy [08:13] [ComfyUI] result = worker.call_method( [08:13] [ComfyUI] ^^^^^^^^^^^^^^^^^^^ [08:13] [ComfyUI] File "/Users/runner/work/comfy-gpu-ci/comfy-gpu-ci/test_workspaces/Sharp-1915/venv/lib/python3.11/site-packages/comfy_env/isolation/workers/subprocess.py", line 674, in call_method [08:13] [ComfyUI] raise WorkerError( [08:13] [ComfyUI] comfy_env.isolation.workers.base.WorkerError: MPS backend out of memory (MPS allocated: 6.73 GiB, other allocations: 581.22 MiB, max allowed: 7.93 GiB). Tried to allocate 576.00 MiB on private pool. Use PYTORCH_MPS_HIGH_WATERMARK_RATIO=0.0 to disable upper limit for memory allocations (may cause system failure). [08:13] [ComfyUI] [08:14] [ComfyUI] Worker traceback: [08:14] [ComfyUI] Traceback (most recent call last): [08:14] [ComfyUI] File "/var/folders/8d/778wjbv96mq1760tv6gk374m0000gn/T/comfyui_pvenv_zcu5iw2_/persistent_worker.py", line 1762, in main [08:14] [ComfyUI] result = method(**inputs) [08:14] [ComfyUI] ^^^^^^^^^^^^^^^^ [08:14] [ComfyUI] File "/Users/runner/work/comfy-gpu-ci/comfy-gpu-ci/test_workspaces/Sharp-1915/ComfyUI/comfy_api/latest/_io.py", line 1892, in EXECUTE_NORMALIZED [08:14] [ComfyUI] to_return = cls.execute(*args, **kwargs) [08:14] [ComfyUI] ^^^^^^^^^^^^^^^^^^^^^^^^^^^^ [08:14] [ComfyUI] File "/Users/runner/.ce/.pixi/envs/sharp-nodes/lib/python3.11/site-packages/torch/utils/_contextlib.py", line 124, in decorate_context [08:14] [ComfyUI] return func(*args, **kwargs) [08:14] [ComfyUI] ^^^^^^^^^^^^^^^^^^^^^ [08:14] [ComfyUI] File "/Users/runner/work/comfy-gpu-ci/comfy-gpu-ci/test_workspaces/Sharp-1915/ComfyUI/custom_nodes/ComfyUI-Sharp/nodes/predict.py", line 239, in execute [08:14] [ComfyUI] gaussians, refined_depth_l0, refined_depth_l1 = _predict_image_cached( [08:14] [ComfyUI] ^^^^^^^^^^^^^^^^^^^^^^ [08:14] [ComfyUI] File "/Users/runner/work/comfy-gpu-ci/comfy-gpu-ci/test_workspaces/Sharp-1915/ComfyUI/custom_nodes/ComfyUI-Sharp/nodes/predict.py", line 348, in _predict_image_cached [08:14] [ComfyUI] monodepth_output, _ = predictor.encode(image_resized_pt) [08:14] [ComfyUI] ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ [08:14] [ComfyUI] File "/Users/runner/work/comfy-gpu-ci/comfy-gpu-ci/test_workspaces/Sharp-1915/ComfyUI/custom_nodes/ComfyUI-Sharp/nodes/sharp/model.py", line 2006, in encode [08:14] [ComfyUI] monodepth_output = self.monodepth_model(image) [08:14] [ComfyUI] ^^^^^^^^^^^^^^^^^^^^^^^^^^^ [08:14] [ComfyUI] File "/Users/runner/.ce/.pixi/envs/sharp-nodes/lib/python3.11/site-packages/torch/nn/modules/module.py", line 1776, in _wrapped_call_impl [08:14] [ComfyUI] return self._call_impl(*args, **kwargs) [08:14] [ComfyUI] ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ [08:14] [ComfyUI] File "/Users/runner/.ce/.pixi/envs/sharp-nodes/lib/python3.11/site-packages/torch/nn/modules/module.py", line 1787, in _call_impl [08:14] [ComfyUI] return forward_call(*args, **kwargs) [08:14] [ComfyUI] ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ [08:14] [ComfyUI] File "/Users/runner/work/comfy-gpu-ci/comfy-gpu-ci/test_workspaces/Sharp-1915/ComfyUI/custom_nodes/ComfyUI-Sharp/nodes/sharp/model.py", line 1118, in forward [08:14] [ComfyUI] decoder_features = self.monodepth_predictor.decoder(encoder_features) [08:14] [ComfyUI] ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ [08:14] [ComfyUI] File "/Users/runner/.ce/.pixi/envs/sharp-nodes/lib/python3.11/site-packages/torch/nn/modules/module.py", line 1776, in _wrapped_call_impl [08:14] [ComfyUI] return self._call_impl(*args, **kwargs) [08:14] [ComfyUI] ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ [08:14] [ComfyUI] File "/Users/runner/.ce/.pixi/envs/sharp-nodes/lib/python3.11/site-packages/torch/nn/modules/module.py", line 1787, in _call_impl [08:14] [ComfyUI] return forward_call(*args, **kwargs) [08:14] [ComfyUI] ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ [08:14] [ComfyUI] File "/Users/runner/work/comfy-gpu-ci/comfy-gpu-ci/test_workspaces/Sharp-1915/ComfyUI/custom_nodes/ComfyUI-Sharp/nodes/sharp/model.py", line 970, in forward [08:14] [ComfyUI] features = self.fusions[i](features, features_i) [08:14] [ComfyUI] ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ [08:14] [ComfyUI] File "/Users/runner/.ce/.pixi/envs/sharp-nodes/lib/python3.11/site-packages/torch/nn/modules/module.py", line 1776, in _wrapped_call_impl [08:14] [ComfyUI] return self._call_impl(*args, **kwargs) [08:14] [ComfyUI] ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ [08:14] [ComfyUI] File "/Users/runner/.ce/.pixi/envs/sharp-nodes/lib/python3.11/site-packages/torch/nn/modules/module.py", line 1787, in _call_impl [08:14] [ComfyUI] return forward_call(*args, **kwargs) [08:14] [ComfyUI] ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ [08:14] [ComfyUI] File "/Users/runner/work/comfy-gpu-ci/comfy-gpu-ci/test_workspaces/Sharp-1915/ComfyUI/custom_nodes/ComfyUI-Sharp/nodes/sharp/model.py", line 862, in forward [08:14] [ComfyUI] x = self.out_conv(x) [08:14] [ComfyUI] ^^^^^^^^^^^^^^^^ [08:14] [ComfyUI] File "/Users/runner/.ce/.pixi/envs/sharp-nodes/lib/python3.11/site-packages/torch/nn/modules/module.py", line 1776, in _wrapped_call_impl [08:14] [ComfyUI] return self._call_impl(*args, **kwargs) [08:14] [ComfyUI] ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ [08:14] [ComfyUI] File "/Users/runner/.ce/.pixi/envs/sharp-nodes/lib/python3.11/site-packages/torch/nn/modules/module.py", line 1787, in _call_impl [08:14] [ComfyUI] return forward_call(*args, **kwargs) [08:14] [ComfyUI] ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ [08:14] [ComfyUI] File "/Users/runner/work/comfy-gpu-ci/comfy-gpu-ci/test_workspaces/Sharp-1915/ComfyUI/comfy/ops.py", line 537, in forward [08:14] [ComfyUI] return super().forward(*args, **kwargs) [08:14] [ComfyUI] ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ [08:14] [ComfyUI] File "/Users/runner/.ce/.pixi/envs/sharp-nodes/lib/python3.11/site-packages/torch/nn/modules/conv.py", line 553, in forward [08:14] [ComfyUI] return self._conv_forward(input, self.weight, self.bias) [08:14] [ComfyUI] ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ [08:14] [ComfyUI] File "/Users/runner/.ce/.pixi/envs/sharp-nodes/lib/python3.11/site-packages/torch/nn/modules/conv.py", line 548, in _conv_forward [08:14] [ComfyUI] return F.conv2d( [08:14] [ComfyUI] ^^^^^^^^^ [08:14] [ComfyUI] RuntimeError: MPS backend out of memory (MPS allocated: 6.73 GiB, other allocations: 581.22 MiB, max allowed: 7.93 GiB). Tried to allocate 576.00 MiB on private pool. Use PYTORCH_MPS_HIGH_WATERMARK_RATIO=0.0 to disable upper limit for memory allocations (may cause system failure). [08:14] [ComfyUI] [08:14] [ComfyUI] [08:14] [ComfyUI] [INFO] Prompt executed in 86.82 seconds [08:14] Execution complete (t=87.9s) [08:14] Execution error: {'prompt_id': '8a0433fa-7d52-4d8b-b620-62151ba4d2b5', 'node_id': '7', 'node_type': 'SharpPredict', 'executed': ['2', '9'], 'exception_message': 'MPS backend out of memory (MPS allocated: 6.73 GiB, other allocations: 581.22 MiB, max allowed: 7.93 GiB). Tried to allocate 576.00 MiB on private pool. Use PYTORCH_MPS_HIGH_WATERMARK_RATIO=0.0 to disable upper limit for memory allocations (may cause system failure).\n\nWorker traceback:\nTraceback (most recent call last):\n File "/var/folders/8d/778wjbv96mq1760tv6gk374m0000gn/T/comfyui_pvenv_zcu5iw2_/persistent_worker.py", line 1762, in main\n result = method(**inputs)\n ^^^^^^^^^^^^^^^^\n File "/Users/runner/work/comfy-gpu-ci/comfy-gpu-ci/test_workspaces/Sharp-1915/ComfyUI/comfy_api/latest/_io.py", line 1892, in EXECUTE_NORMALIZED\n to_return = cls.execute(*args, **kwargs)\n ^^^^^^^^^^^^^^^^^^^^^^^^^^^^\n File "/Users/runner/.ce/.pixi/envs/sharp-nodes/lib/python3.11/site-packages/torch/utils/_contextlib.py", line 124, in decorate_context\n return func(*args, **kwargs)\n ^^^^^^^^^^^^^^^^^^^^^\n File "/Users/runner/work/comfy-gpu-ci/comfy-gpu-ci/test_workspaces/Sharp-1915/ComfyUI/custom_nodes/ComfyUI-Sharp/nodes/predict.py", line 239, in execute\n gaussians, refined_depth_l0, refined_depth_l1 = _predict_image_cached(\n ^^^^^^^^^^^^^^^^^^^^^^\n File "/Users/runner/work/comfy-gpu-ci/comfy-gpu-ci/test_workspaces/Sharp-1915/ComfyUI/custom_nodes/ComfyUI-Sharp/nodes/predict.py", line 348, in _predict_image_cached\n monodepth_output, _ = predictor.encode(image_resized_pt)\n ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^\n File "/Users/runner/work/comfy-gpu-ci/comfy-gpu-ci/test_workspaces/Sharp-1915/ComfyUI/custom_nodes/ComfyUI-Sharp/nodes/sharp/model.py", line 2006, in encode\n monodepth_output = self.monodepth_model(image)\n ^^^^^^^^^^^^^^^^^^^^^^^^^^^\n File "/Users/runner/.ce/.pixi/envs/sharp-nodes/lib/python3.11/site-packages/torch/nn/modules/module.py", line 1776, in _wrapped_call_impl\n return self._call_impl(*args, **kwargs)\n ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^\n File "/Users/runner/.ce/.pixi/envs/sharp-nodes/lib/python3.11/site-packages/torch/nn/modules/module.py", line 1787, in _call_impl\n return forward_call(*args, **kwargs)\n ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^\n File "/Users/runner/work/comfy-gpu-ci/comfy-gpu-ci/test_workspaces/Sharp-1915/ComfyUI/custom_nodes/ComfyUI-Sharp/nodes/sharp/model.py", line 1118, in forward\n decoder_features = self.monodepth_predictor.decoder(encoder_features)\n ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^\n File "/Users/runner/.ce/.pixi/envs/sharp-nodes/lib/python3.11/site-packages/torch/nn/modules/module.py", line 1776, in _wrapped_call_impl\n return self._call_impl(*args, **kwargs)\n ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^\n File "/Users/runner/.ce/.pixi/envs/sharp-nodes/lib/python3.11/site-packages/torch/nn/modules/module.py", line 1787, in _call_impl\n return forward_call(*args, **kwargs)\n ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^\n File "/Users/runner/work/comfy-gpu-ci/comfy-gpu-ci/test_workspaces/Sharp-1915/ComfyUI/custom_nodes/ComfyUI-Sharp/nodes/sharp/model.py", line 970, in forward\n features = self.fusions[i](features, features_i)\n ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^\n File "/Users/runner/.ce/.pixi/envs/sharp-nodes/lib/python3.11/site-packages/torch/nn/modules/module.py", line 1776, in _wrapped_call_impl\n return self._call_impl(*args, **kwargs)\n ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^\n File "/Users/runner/.ce/.pixi/envs/sharp-nodes/lib/python3.11/site-packages/torch/nn/modules/module.py", line 1787, in _call_impl\n return forward_call(*args, **kwargs)\n ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^\n File "/Users/runner/work/comfy-gpu-ci/comfy-gpu-ci/test_workspaces/Sharp-1915/ComfyUI/custom_nodes/ComfyUI-Sharp/nodes/sharp/model.py", line 862, in forward\n x = self.out_conv(x)\n ^^^^^^^^^^^^^^^^\n File "/Users/runner/.ce/.pixi/envs/sharp-nodes/lib/python3.11/site-packages/torch/nn/modules/module.py", line 1776, in _wrapped_call_impl\n return self._call_impl(*args, **kwargs)\n ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^\n File "/Users/runner/.ce/.pixi/envs/sharp-nodes/lib/python3.11/site-packages/torch/nn/modules/module.py", line 1787, in _call_impl\n return forward_call(*args, **kwargs)\n ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^\n File "/Users/runner/work/comfy-gpu-ci/comfy-gpu-ci/test_workspaces/Sharp-1915/ComfyUI/comfy/ops.py", line 537, in forward\n return super().forward(*args, **kwargs)\n ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^\n File "/Users/runner/.ce/.pixi/envs/sharp-nodes/lib/python3.11/site-packages/torch/nn/modules/conv.py", line 553, in forward\n return self._conv_forward(input, self.weight, self.bias)\n ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^\n File "/Users/runner/.ce/.pixi/envs/sharp-nodes/lib/python3.11/site-packages/torch/nn/modules/conv.py", line 548, in _conv_forward\n return F.conv2d(\n ^^^^^^^^^\nRuntimeError: MPS backend out of memory (MPS allocated: 6.73 GiB, other allocations: 581.22 MiB, max allowed: 7.93 GiB). Tried to allocate 576.00 MiB on private pool. Use PYTORCH_MPS_HIGH_WATERMARK_RATIO=0.0 to disable upper limit for memory allocations (may cause system failure).\n\n', 'exception_type': 'comfy_env.isolation.workers.base.WorkerError', 'traceback': [' File "/Users/runner/work/comfy-gpu-ci/comfy-gpu-ci/test_workspaces/Sharp-1915/ComfyUI/execution.py", line 536, in execute\n output_data, output_ui, has_subgraph, has_pending_tasks = await get_output_data(prompt_id, unique_id, obj, input_data_all, execution_block_cb=execution_block_cb, pre_execute_cb=pre_execute_cb, v3_data=v3_data)\n ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^\n', ' File "/Users/runner/work/comfy-gpu-ci/comfy-gpu-ci/test_workspaces/Sharp-1915/ComfyUI/execution.py", line 336, in get_output_data\n return_values = await _async_map_node_over_list(prompt_id, unique_id, obj, input_data_all, obj.FUNCTION, allow_interrupt=True, execution_block_cb=execution_block_cb, pre_execute_cb=pre_execute_cb, v3_data=v3_data)\n ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^\n', ' File "/Users/runner/work/comfy-gpu-ci/comfy-gpu-ci/test_workspaces/Sharp-1915/ComfyUI/execution.py", line 310, in _async_map_node_over_list\n await process_inputs(input_dict, i)\n', ' File "/Users/runner/work/comfy-gpu-ci/comfy-gpu-ci/test_workspaces/Sharp-1915/ComfyUI/execution.py", line 298, in process_inputs\n result = f(**inputs)\n ^^^^^^^^^^^\n', ' File "/Users/runner/work/comfy-gpu-ci/comfy-gpu-ci/test_workspaces/Sharp-1915/venv/lib/python3.11/site-packages/comfy_env/isolation/metadata.py", line 556, in proxy\n result = worker.call_method(\n ^^^^^^^^^^^^^^^^^^^\n', ' File "/Users/runner/work/comfy-gpu-ci/comfy-gpu-ci/test_workspaces/Sharp-1915/venv/lib/python3.11/site-packages/comfy_env/isolation/workers/subprocess.py", line 674, in call_method\n raise WorkerError(\n'], 'current_inputs': {'focal_length_mm': [20], 'output_prefix': ['sharp'], 'model': ["{'model_path': '/Users/runner/work/comfy-gpu-ci/comfy-gpu-ci/test_workspaces/Sharp-1915/ComfyUI/models/sharp/sharp_2572gikvuh.pt', 'precision': 'auto', 'dtype': 'bf16'}"], 'image': ['tensor([[[[0.2157, 0.1647, 0.1569],\n [0.2275, 0.1608, 0.1608],\n [0.2275, 0.1647, 0.1529],\n ...,\n [0.4471, 0.4745, 0.4863],\n [0.4510, 0.4745, 0.4863],\n [0.4431, 0.4745, 0.4745]],\n\n [[0.2196, 0.1686, 0.1569],\n [0.2314, 0.1647, 0.1608],\n [0.2353, 0.1647, 0.1647],\n ...,\n [0.4549, 0.4784, 0.4706],\n [0.4549, 0.4706, 0.4784],\n [0.4431, 0.4706, 0.4667]],\n\n [[0.2314, 0.1725, 0.1569],\n [0.2510, 0.1725, 0.1608],\n [0.2392, 0.1725, 0.1686],\n ...,\n [0.4588, 0.4745, 0.4627],\n [0.4510, 0.4745, 0.4667],\n [0.4471, 0.4706, 0.4627]],\n\n ...,\n\n [[0.1569, 0.1647, 0.1843],\n [0.1647, 0.1725, 0.1882],\n [0.1490, 0.1686, 0.1922],\n ...,\n [0.1020, 0.1137, 0.1373],\n [0.1137, 0.1176, 0.1412],\n [0.0863, 0.1176, 0.1373]],\n\n [[0.1569, 0.1686, 0.1804],\n [0.1569, 0.1647, 0.1961],\n [0.1490, 0.1647, 0.1961],\n ...,\n [0.1059, 0.1216, 0.1294],\n [0.1176, 0.1216, 0.1333],\n [0.1059, 0.1137, 0.1373]],\n\n [[0.1608, 0.1686, 0.1843],\n [0.1608, 0.1686, 0.1882],\n [0.1569, 0.1686, 0.1882],\n ...,\n [0.1059, 0.1176, 0.1333],\n [0.1137, 0.1176, 0.1333],\n [0.1333, 0.1176, 0.1333]]]])'], 'prompt': ["{'2': {'inputs': {'precision': 'auto'}, 'class_type': 'LoadSharpModel', '_meta': {'title': '(Down)Load SHARP Model'}}, '7': {'inputs': {'focal_length_mm': ['9', 2], 'output_prefix': 'sharp', 'model': ['2', 0], 'image': ['9', 0]}, 'class_type': 'SharpPredict', '_meta': {'title': 'SHARP Predict (Image to PLY)'}}, '9': {'inputs': {'image': 'eth3d.png', 'default_focal_mm': 30.0}, 'class_type': 'LoadImageWithExif', '_meta': {'title': 'Load Image with EXIF (Focal Length)'}}, '11': {'inputs': {'preview_gaussian': '', 'ply_path': ['7', 0], 'extrinsics': ['7', 1], 'intrinsics': ['7', 2]}, 'class_type': 'PreviewGaussianSharp', '_meta': {'title': 'Preview Gaussian Sharp'}}}"], 'extra_pnginfo': ["{'workflow': {'id': 'sharp-basic-workflow', 'revision': 0, 'last_node_id': 11, 'last_link_id': 24, 'nodes': [{'id': 2, 'type': 'LoadSharpModel', 'pos': [-150, -400], 'size': [270, 106], 'flags': {}, 'order': 0, 'mode': 0, 'inputs': [], 'outputs': [{'name': 'model_config', 'type': 'SHARP_MODEL_CONFIG', 'links': [11]}], 'properties': {'Node name for S&R': 'LoadSharpModel', 'aux_id': 'PozzettiAndrea/ComfyUI-Sharp', 'ver': '9f1b9c726e2cfc0118866c3df783e7f6bc895226', 'cnr_id': 'comfyui-sharp'}, 'widgets_values': ['auto']}, {'id': 9, 'type': 'LoadImageWithExif', 'pos': [-208.74978010739324, -99.02778023242435], 'size': [342.28125, 420], 'flags': {}, 'order': 1, 'mode': 0, 'inputs': [], 'outputs': [{'name': 'image', 'type': 'IMAGE', 'links': [19]}, {'name': 'mask', 'type': 'MASK', 'links': None}, {'name': 'focal_length_mm', 'type': 'FLOAT', 'links': [20]}], 'properties': {'Node name for S&R': 'LoadImageWithExif', 'aux_id': 'PozzettiAndrea/ComfyUI-Sharp', 'ver': 'c69751a59b587c3b83d0e37cfe2bab3bc838574a', 'cnr_id': 'comfyui-sharp'}, 'widgets_values': ['eth3d.png', 30, 'image']}, {'id': 7, 'type': 'SharpPredict', 'pos': [226.15696022727278, -245.70490056818184], 'size': [298.890625, 236], 'flags': {}, 'order': 2, 'mode': 0, 'inputs': [{'name': 'model', 'type': 'SHARP_MODEL_CONFIG', 'link': 11}, {'name': 'image', 'type': 'IMAGE', 'link': 19}, {'name': 'extrinsics', 'shape': 7, 'type': 'EXTRINSICS', 'link': None}, {'name': 'intrinsics', 'shape': 7, 'type': 'INTRINSICS', 'link': None}, {'name': 'focal_length_mm', 'shape': 7, 'type': 'FLOAT', 'widget': {'name': 'focal_length_mm'}, 'link': 20}], 'outputs': [{'name': 'ply_path', 'type': 'STRING', 'links': [22]}, {'name': 'extrinsics', 'type': 'EXTRINSICS', 'links': [23]}, {'name': 'intrinsics', 'type': 'INTRINSICS', 'links': [24]}, {'name': 'layer_0_refined_depth', 'type': 'IMAGE', 'links': None}, {'name': 'layer_1_refined_depth', 'type': 'IMAGE', 'links': None}], 'properties': {'Node name for S&R': 'SharpPredict', 'aux_id': 'PozzettiAndrea/ComfyUI-Sharp', 'ver': 'c69751a59b587c3b83d0e37cfe2bab3bc838574a', 'cnr_id': 'comfyui-sharp'}, 'widgets_values': [30, 'sharp']}, {'id': 11, 'type': 'PreviewGaussianSharp', 'pos': [600.5860117362482, -287.72961200652577], 'size': [512, 658], 'flags': {}, 'order': 3, 'mode': 0, 'inputs': [{'name': 'ply_path', 'type': 'STRING', 'link': 22}, {'name': 'extrinsics', 'shape': 7, 'type': 'EXTRINSICS', 'link': 23}, {'name': 'intrinsics', 'shape': 7, 'type': 'INTRINSICS', 'link': 24}], 'outputs': [{'name': 'extrinsics', 'type': 'EXTRINSICS', 'links': None}, {'name': 'intrinsics', 'type': 'INTRINSICS', 'links': None}], 'properties': {'Node name for S&R': 'PreviewGaussianSharp', 'aux_id': 'PozzettiAndrea/ComfyUI-GaussianPack', 'ver': '059313a53ffa7ecc8697eddc02d2cee4727e5085'}, 'widgets_values': ['']}], 'links': [[11, 2, 0, 7, 0, 'SHARP_MODEL'], [19, 9, 0, 7, 1, 'IMAGE'], [20, 9, 2, 7, 4, 'FLOAT'], [22, 7, 0, 11, 0, 'STRING'], [23, 7, 1, 11, 1, 'EXTRINSICS'], [24, 7, 2, 11, 2, 'INTRINSICS']], 'groups': [], 'config': {}, 'extra': {'ds': {'scale': 0.9373016969629105, 'offset': [449.06099628194596, 596.4219590460706]}, 'workflowRendererVersion': 'LG', 'frontendVersion': '1.45.15'}, 'version': 0.4}}"]}, 'current_outputs': ['2', '9', '11', '7'], 'timestamp': 1780860197909} [08:16] [ComfyUI] [INFO] Using RAM pressure cache. [08:16] [ComfyUI] [INFO] Using RAM pressure cache. [08:16] Capturing execution frames: vanilla_vs_image_depth_gaussians.json [08:16] [ComfyUI] [INFO] Using RAM pressure cache. [08:24] Frame 1 saved (frame_000.jpg, t=0.0s) [08:24] Validating workflow... [08:24] [ComfyUI] [INFO] === /validate endpoint called === [08:24] [ComfyUI] [INFO] Received JSON with keys: ['prompt'] [08:24] [ComfyUI] [INFO] Prompt has 8 nodes [08:24] [ComfyUI] [INFO] Node 7: LoadImage [08:24] [ComfyUI] [INFO] Inputs: {"image": "middlebury.jpg"} [08:24] [ComfyUI] [INFO] Node 9: LoadSharpModel [08:24] [ComfyUI] [INFO] Inputs: {"precision": "auto"} [08:24] [ComfyUI] [INFO] Node 47: SharpPredictMetricDepth [08:24] [ComfyUI] [INFO] Inputs: {"focal_length_mm": 30, "model": ["9", 0], "image": ["7", 0]} [08:24] [ComfyUI] [INFO] Node 57: SharpPredict [08:24] [ComfyUI] [INFO] Inputs: {"focal_length_mm": 30, "output_prefix": "sharp", "model": ["9", 0], "image": ["58", 0]} [08:24] [ComfyUI] [INFO] Node 58: ImageFromBatch [08:24] [ComfyUI] [INFO] Inputs: {"batch_index": 0, "length": 1, "image": ["7", 0]} [08:24] Queuing workflow for execution... [08:24] [ComfyUI] [INFO] Node 83: SharpPredictGaussiansFromMetricDepth [08:24] [ComfyUI] [INFO] Inputs: {"snap_to_external_depth": "none", "depth_convention": "planar_z", "focal_length_mm": 30, "output_prefix": "sharp_aligned", "save_background_layer": true, "edge_crop": 0, "model": ["9", 0], "image": [ [08:24] [ComfyUI] [INFO] Node 92: PreviewGaussianSharp [08:24] [ComfyUI] [INFO] Inputs: {"preview_gaussian": "", "ply_path": ["83", 0], "extrinsics": ["83", 2], "intrinsics": ["83", 3]} [08:24] [ComfyUI] [INFO] Node 93: PreviewGaussianSharp [08:24] [ComfyUI] [INFO] Inputs: {"preview_gaussian": "", "ply_path": ["57", 0], "extrinsics": ["57", 1], "intrinsics": ["57", 2]} [08:24] [ComfyUI] [INFO] Generated prompt_id: f984b004-b57b-4f2b-9b32-16dcf3ca63bb [08:24] [ComfyUI] [INFO] Calling execution.validate_prompt()... [08:24] [ComfyUI] [INFO] Validation result: valid=True [08:24] [ComfyUI] [INFO] === Validation PASSED === [08:24] [ComfyUI] [INFO] got prompt [08:24] [ComfyUI] [comfy-env] Running LoadSharpModel: precision: 'auto' [08:24] [ComfyUI] [SubprocessWorker] call_method: nodes.load_model.LoadSharpModel.EXECUTE_NORMALIZED [08:24] [ComfyUI] [SubprocessWorker] acquired lock, ensuring started... [08:24] [ComfyUI] [ComfyUI-Sharp] Health check: ping (timeout=5.0s)... [08:24] [ComfyUI] [ComfyUI-Sharp] Health check: ok [08:24] [ComfyUI] [SubprocessWorker] worker started/confirmed [08:24] [ComfyUI] [SubprocessWorker] serializing kwargs to shm... [08:24] [ComfyUI] [SubprocessWorker] created 0 shm blocks [08:24] [ComfyUI] [SubprocessWorker] sending request via socket... [08:24] [ComfyUI] [SubprocessWorker] call_id=6 sending call_method [08:24] [ComfyUI] [worker:ComfyUI-Sharp] [LoadSharpModel] precision='auto' -> dtype=bf16 (device=mps) [08:24] [ComfyUI] [worker:ComfyUI-Sharp] [LoadSharpModel] checkpoint already present, reusing (no download): /Users/runner/work/comfy-gpu-ci/comfy-gpu-ci/test_workspaces/Sharp-1915/ComfyUI/models/sharp/sharp_2572gikvuh.pt (2679.6 MB) [08:24] [ComfyUI] [worker:ComfyUI-Sharp] [LoadSharpModel] checkpoint ready: /Users/runner/work/comfy-gpu-ci/comfy-gpu-ci/test_workspaces/Sharp-1915/ComfyUI/models/sharp/sharp_2572gikvuh.pt (2679.6 MB) [08:24] [ComfyUI] [worker:ComfyUI-Sharp] [LoadSharpModel] config: precision=auto -> dtype=bf16 [08:24] [ComfyUI] [SubprocessWorker] got response: ok [08:24] [ComfyUI] [comfy-env] LoadSharpModel done (0.07s): result: NodeOutput [08:24] [ComfyUI] [comfy-env] Running SharpPredict: focal_length_mm: 30.0, output_prefix: 'sharp', model: dict, image: torch.float32 [1,960,1416,3] cpu [08:24] [ComfyUI] [SubprocessWorker] call_method: nodes.predict.SharpPredict.EXECUTE_NORMALIZED [08:24] [ComfyUI] [SubprocessWorker] acquired lock, ensuring started... [08:24] [ComfyUI] [ComfyUI-Sharp] Health check: ping (timeout=5.0s)... [08:24] [ComfyUI] [ComfyUI-Sharp] Health check: ok [08:24] [ComfyUI] [SubprocessWorker] worker started/confirmed [08:24] [ComfyUI] [comfy-env] PRE-SERIALIZE 'image' shape: torch.Size([1, 960, 1416, 3]) [08:24] [ComfyUI] [SubprocessWorker] serializing kwargs to shm... [08:24] [ComfyUI] [SubprocessWorker] created 0 shm blocks [08:24] [ComfyUI] [SubprocessWorker] sending request via socket... [08:24] [ComfyUI] [SubprocessWorker] call_id=7 sending call_method [08:24] [ComfyUI] [worker:ComfyUI-Sharp] [comfy-env] _from_shm got dict with keys: ['__type__', 'strategy', 'manager_path', 'storage_key', 'storage_size'] [08:24] [ComfyUI] [worker:ComfyUI-Sharp] [comfy-env] DESERIALIZE TensorRef: tensor_size=[1, 960, 1416, 3] [08:24] [ComfyUI] [worker:ComfyUI-Sharp] [comfy-env] DESERIALIZED tensor shape: torch.Size([1, 960, 1416, 3]) [08:24] [ComfyUI] [SubprocessWorker] callback 'request_vram_budget' from call_id=7 [08:24] [ComfyUI] [comfy-env] VRAM request: 2.81GB, free before eviction: 2.10GB [08:24] [ComfyUI] [comfy-env] VRAM after eviction: 2.10GB [08:38] Frame 2 saved (frame_001.jpg, t=2.2s) [08:38] [capture-periodic] freeze=4ms shot=12270ms unfreeze=20ms saved=True [08:44] Frame 3 saved (frame_002.jpg, t=16.6s) [08:44] [capture-periodic] freeze=3ms shot=4119ms unfreeze=4ms saved=True [08:45] [capture-loop] iter=50 t=22.1s state={'complete': False, 'error': None, 'executedCount': 0, 'wsState': 1} eval_ms=4 ram=5.8/7.0GB (90%) swap=0.9/2.0GB (44%) cpu=59% browser_rss=0.51GB [08:55] [ComfyUI] [worker:ComfyUI-Sharp] [08:55] [ComfyUI] === WATCHDOG TICK 2 === [08:55] [ComfyUI] [worker:ComfyUI-Sharp] Current thread 0x000000016c1f7000 (most recent call first): [08:55] [ComfyUI] File "/var/folders/8d/778wjbv96mq1760tv6gk374m0000gn/T/comfyui_pvenv_zcu5iw2_/persistent_worker.py", line 52 in _watchdog [08:55] [ComfyUI] File "/Users/runner/.ce/.pixi/envs/sharp-nodes/lib/python3.11/threading.py", line 982 in run [08:55] [ComfyUI] File "/Users/runner/.ce/.pixi/envs/sharp-nodes/lib/python3.11/threading.py", line 1045 in _bootstrap_inner [08:55] [ComfyUI] File "/Users/runner/.ce/.pixi/envs/sharp-nodes/lib/python3.11/threading.py", line 1002 in _bootstrap [08:55] [ComfyUI] [08:55] [ComfyUI] Thread 0x00000001efc5a2c0 (most recent call first): [08:55] [ComfyUI] File "/Users/runner/.ce/.pixi/envs/sharp-nodes/lib/python3.11/site-packages/torch/nn/modules/conv.py", line 548 in _conv_forward [08:55] [ComfyUI] File "/Users/runner/.ce/.pixi/envs/sharp-nodes/lib/python3.11/site-packages/torch/nn/modules/conv.py", line 553 in forward [08:55] [ComfyUI] File "/Users/runner/work/comfy-gpu-ci/comfy-gpu-ci/test_workspaces/Sharp-1915/ComfyUI/comfy/ops.py", line 537 in forward [08:55] [ComfyUI] File "/Users/runner/.ce/.pixi/envs/sharp-nodes/lib/python3.11/site-packages/torch/nn/modules/module.py", line 1787 in _call_impl [08:55] [ComfyUI] File "/Users/runner/.ce/.pixi/envs/sharp-nodes/lib/python3.11/site-packages/torch/nn/modules/module.py", line 1776 in _wrapped_call_impl [08:55] [ComfyUI] File "/Users/runner/work/comfy-gpu-ci/comfy-gpu-ci/test_workspaces/Sharp-1915/ComfyUI/custom_nodes/ComfyUI-Sharp/nodes/sharp/model.py", line 966 in forward [08:55] [ComfyUI] File "/Users/runner/.ce/.pixi/envs/sharp-nodes/lib/python3.11/site-packages/torch/nn/modules/module.py", line 1787 in _call_impl [08:55] [ComfyUI] File "/Users/runner/.ce/.pixi/envs/sharp-nodes/lib/python3.11/site-packages/torch/nn/modules/module.py", line 1776 in _wrapped_call_impl [08:55] [ComfyUI] File "/Users/runner/work/comfy-gpu-ci/comfy-gpu-ci/test_workspaces/Sharp-1915/ComfyUI/custom_nodes/ComfyUI-Sharp/nodes/sharp/model.py", line 1118 in forward [08:55] [ComfyUI] File "/Users/runner/.ce/.pixi/envs/sharp-nodes/lib/python3.11/site-packages/torch/nn/modules/module.py", line 1787 in _call_impl [08:55] [ComfyUI] File "/Users/runner/.ce/.pixi/envs/sharp-nodes/lib/python3.11/site-packages/torch/nn/modules/module.py", line 1776 in _wrapped_call_impl [08:55] [ComfyUI] File "/Users/runner/work/comfy-gpu-ci/comfy-gpu-ci/test_workspaces/Sharp-1915/ComfyUI/custom_nodes/ComfyUI-Sharp/nodes/sharp/model.py", line 2006 in encode [08:55] [ComfyUI] File "/Users/runner/work/comfy-gpu-ci/comfy-gpu-ci/test_workspaces/Sharp-1915/ComfyUI/custom_nodes/ComfyUI-Sharp/nodes/predict.py", line 348 in _predict_image_cached [08:55] [ComfyUI] File "/Users/runner/work/comfy-gpu-ci/comfy-gpu-ci/test_workspaces/Sharp-1915/ComfyUI/custom_nodes/ComfyUI-Sharp/nodes/predict.py", line 239 in execute [08:55] [ComfyUI] File "/Users/runner/.ce/.pixi/envs/sharp-nodes/lib/python3.11/site-packages/torch/utils/_contextlib.py", line 124 in decorate_context [08:55] [ComfyUI] File "/Users/runner/work/comfy-gpu-ci/comfy-gpu-ci/test_workspaces/Sharp-1915/ComfyUI/comfy_api/latest/_io.py", line 1892 in EXECUTE_NORMALIZED [08:55] [ComfyUI] File "/var/folders/8d/778wjbv96mq1760tv6gk374m0000gn/T/comfyui_pvenv_zcu5iw2_/persistent_worker.py", line 1762 in main [08:55] [ComfyUI] File "/var/folders/8d/778wjbv96mq1760tv6gk374m0000gn/T/comfyui_pvenv_zcu5iw2_/persistent_worker.py", line 1807 in [08:55] [ComfyUI] [08:55] [ComfyUI] [worker:ComfyUI-Sharp] === END === [08:55] [ComfyUI] [09:31] [capture-loop] iter=100 t=66.9s state={'complete': False, 'error': None, 'executedCount': 0, 'wsState': 1} eval_ms=37 ram=5.1/7.0GB (82%) swap=3.4/5.0GB (68%) cpu=62% browser_rss=0.18GB [09:49] [capture-loop] iter=150 t=85.8s state={'complete': False, 'error': None, 'executedCount': 0, 'wsState': 1} eval_ms=3 ram=5.4/7.0GB (90%) swap=6.0/7.0GB (86%) cpu=52% browser_rss=0.18GB [09:53] [ComfyUI] [SubprocessWorker] callback 'report_progress' from call_id=7 [09:54] [ComfyUI] [SubprocessWorker] got response: ok [09:54] [ComfyUI] [comfy-env] SharpPredict done (90.12s): result: NodeOutput [09:55] [ComfyUI] [comfy-env] Running PreviewGaussianSharp: ply_path: '/Users/runner/work/comfy-gpu-ci/comfy-gpu-ci/test_worksp..., extrinsics: list[4], intrinsics: list[3] [09:55] [ComfyUI] [SubprocessWorker] call_method: nodes.preview_gaussian_sharp.PreviewGaussianSharp.EXECUTE_NORMALIZED [09:55] [ComfyUI] [SubprocessWorker] acquired lock, ensuring started... [09:55] [ComfyUI] [ComfyUI-GaussianPack] Health check: ping (timeout=5.0s)... [09:55] [ComfyUI] [ComfyUI-GaussianPack] Health check: failed [09:55] [ComfyUI] [ComfyUI-GaussianPack] Socket unhealthy, restarting worker... [09:55] [ComfyUI] [ComfyUI-GaussianPack] python: /Users/runner/.ce/.pixi/envs/gaussianpack-nodes/bin/python [09:55] [ComfyUI] [ComfyUI-GaussianPack] sys_path sent to worker: ['/Users/runner/work/comfy-gpu-ci/comfy-gpu-ci/test_workspaces/Sharp-1915/ComfyUI', '/Users/runner/work/comfy-gpu-ci/comfy-gpu-ci/test_workspaces/Sharp-1915/ComfyUI/custom_nodes/ComfyUI-GaussianPack', '/Users/runner/.ce/.pixi/envs/gaussianpack-nodes/lib/python3.11/site-packages', '/Users/runner/work/comfy-gpu-ci/comfy-gpu-ci/test_workspaces/Sharp-1915/ComfyUI/custom_nodes/ComfyUI-GaussianPack'] [09:55] [ComfyUI] [SubprocessWorker] is_pixi=True, python=/Users/runner/.ce/.pixi/envs/gaussianpack-nodes/bin/python [09:55] [ComfyUI] [SubprocessWorker] launching cmd=['/Users/runner/.pixi/bin/pixi', 'run', '--as-is', '--manifest-path', '/Users/runner/.ce/pixi.toml', '-e', 'gaussianpack-nodes', 'python', '/var/folders/8d/778wjbv96mq1760tv6gk374m0000gn/T/comfyui_pvenv_atgs5eit/persistent_worker.py', 'unix:///var/folders/8d/778wjbv96mq1760tv6gk374m0000gn/T/comfy_worker_99de1205e546.sock']... [09:55] [ComfyUI] [SubprocessWorker] socket_addr=unix:///var/folders/8d/778wjbv96mq1760tv6gk374m0000gn/T/comfy_worker_99de1205e546.sock exists=True [09:55] [ComfyUI] Traceback (most recent call last): [09:55] [ComfyUI] File "/var/folders/8d/778wjbv96mq1760tv6gk374m0000gn/T/comfyui_pvenv_atgs5eit/persistent_worker.py", line 1807, in [09:55] [ComfyUI] main() [09:55] [ComfyUI] File "/var/folders/8d/778wjbv96mq1760tv6gk374m0000gn/T/comfyui_pvenv_atgs5eit/persistent_worker.py", line 1667, in main [09:55] [ComfyUI] transport.send({"status": "pong", "call_id": _current_call_id}) [09:55] [ComfyUI] File "/var/folders/8d/778wjbv96mq1760tv6gk374m0000gn/T/comfyui_pvenv_atgs5eit/persistent_worker.py", line 1075, in send [09:55] [ComfyUI] self._sock.sendall(msg) [09:55] [ComfyUI] BrokenPipeError: [Errno 32] Broken pipe [09:55] Frame 4 saved (frame_003.jpg, t=91.3s) [09:55] [capture-periodic] freeze=167ms shot=239ms unfreeze=3ms saved=True [09:57] [capture-loop] iter=200 t=93.3s state={'complete': False, 'error': None, 'executedCount': 0, 'wsState': 1} eval_ms=2 ram=2.9/7.0GB (73%) swap=5.8/7.0GB (82%) cpu=66% browser_rss=0.22GB [09:57] Frame 5 saved (frame_004.jpg, t=93.8s) [09:57] [capture-periodic] freeze=2ms shot=179ms unfreeze=2ms saved=True [09:59] [ComfyUI] [SubprocessWorker] worker started/confirmed [09:59] [ComfyUI] [SubprocessWorker] serializing kwargs to shm... [09:59] [ComfyUI] [SubprocessWorker] created 0 shm blocks [09:59] [ComfyUI] [SubprocessWorker] sending request via socket... [09:59] [ComfyUI] [SubprocessWorker] call_id=2 sending call_method [10:00] [ComfyUI] [worker:ComfyUI-GaussianPack] WARNING: SPZ route not registered (ModuleNotFoundError: No module named 'comfy_aimdo') [10:00] [ComfyUI] [SubprocessWorker] got response: ok [10:00] [ComfyUI] [comfy-env] PreviewGaussianSharp done (5.15s): result: NodeOutput [10:00] [ComfyUI] [comfy-env] Running SharpPredictMetricDepth: focal_length_mm: 30.0, model: dict, image: torch.float32 [1,960,1416,3] cpu [10:00] [ComfyUI] [SubprocessWorker] call_method: nodes.predict_metric_depth.SharpPredictMetricDepth.EXECUTE_NORMALIZED [10:00] [ComfyUI] [SubprocessWorker] acquired lock, ensuring started... [10:00] [ComfyUI] [ComfyUI-Sharp] Health check: ping (timeout=5.0s)... [10:00] [ComfyUI] [ComfyUI-Sharp] Health check: failed [10:00] [ComfyUI] [ComfyUI-Sharp] Socket unhealthy, restarting worker... [10:00] [ComfyUI] [ComfyUI-Sharp] python: /Users/runner/.ce/.pixi/envs/sharp-nodes/bin/python [10:00] [ComfyUI] [ComfyUI-Sharp] sys_path sent to worker: ['/Users/runner/work/comfy-gpu-ci/comfy-gpu-ci/test_workspaces/Sharp-1915/ComfyUI', '/Users/runner/work/comfy-gpu-ci/comfy-gpu-ci/test_workspaces/Sharp-1915/ComfyUI/custom_nodes/ComfyUI-Sharp', '/Users/runner/.ce/.pixi/envs/sharp-nodes/lib/python3.11/site-packages', '/Users/runner/work/comfy-gpu-ci/comfy-gpu-ci/test_workspaces/Sharp-1915/ComfyUI/custom_nodes/ComfyUI-Sharp'] [10:00] [ComfyUI] [SubprocessWorker] is_pixi=True, python=/Users/runner/.ce/.pixi/envs/sharp-nodes/bin/python [10:00] [ComfyUI] [SubprocessWorker] launching cmd=['/Users/runner/.pixi/bin/pixi', 'run', '--as-is', '--manifest-path', '/Users/runner/.ce/pixi.toml', '-e', 'sharp-nodes', 'python', '/var/folders/8d/778wjbv96mq1760tv6gk374m0000gn/T/comfyui_pvenv_zcu5iw2_/persistent_worker.py', 'unix:///var/folders/8d/778wjbv96mq1760tv6gk374m0000gn/T/comfy_worker_8bc9d76646d2.sock']... [10:00] [ComfyUI] [SubprocessWorker] socket_addr=unix:///var/folders/8d/778wjbv96mq1760tv6gk374m0000gn/T/comfy_worker_8bc9d76646d2.sock exists=True [10:00] Node executed (1 total), capturing... [10:02] Frame 6 saved (frame_005.jpg, t=97.2s) [10:02] [capture-node] freeze=21ms shot=1419ms unfreeze=61ms saved=True [10:06] Frame 7 saved (frame_006.jpg, t=101.7s) [10:06] [capture-periodic] freeze=549ms shot=147ms unfreeze=6ms saved=True [10:08] [ComfyUI] [worker:ComfyUI-Sharp] ERROR: Failed to import comfy_kitchen, Error: No module named 'comfy_kitchen', fp8 and fp4 support will not be available. [10:08] [ComfyUI] [worker:ComfyUI-Sharp] WARNING: comfy_kitchen does not support stochastic FP8 rounding, please update comfy_kitchen. [10:09] Frame 8 saved (frame_007.jpg, t=104.9s) [10:09] [capture-periodic] freeze=4ms shot=965ms unfreeze=2ms saved=True [10:09] [ComfyUI] [SubprocessWorker] worker started/confirmed [10:09] [ComfyUI] [comfy-env] PRE-SERIALIZE 'image' shape: torch.Size([1, 960, 1416, 3]) [10:09] [ComfyUI] [SubprocessWorker] serializing kwargs to shm... [10:09] [ComfyUI] [SubprocessWorker] created 0 shm blocks [10:10] [ComfyUI] [SubprocessWorker] sending request via socket... [10:10] [ComfyUI] [SubprocessWorker] call_id=8 sending call_method [10:10] [ComfyUI] [worker:ComfyUI-Sharp] [comfy-env] _from_shm got dict with keys: ['__type__', 'strategy', 'manager_path', 'storage_key', 'storage_size'] [10:10] [ComfyUI] [worker:ComfyUI-Sharp] [comfy-env] DESERIALIZE TensorRef: tensor_size=[1, 960, 1416, 3] [10:10] [ComfyUI] [worker:ComfyUI-Sharp] [comfy-env] DESERIALIZED tensor shape: torch.Size([1, 960, 1416, 3]) [10:10] [capture-loop] iter=250 t=106.5s state={'complete': False, 'error': None, 'executedCount': 1, 'wsState': 1} eval_ms=44 ram=2.2/7.0GB (42%) swap=5.7/7.0GB (82%) cpu=65% browser_rss=0.76GB [10:13] [ComfyUI] objc[24418]: Class AVFFrameReceiver is implemented in both /Users/runner/.ce/.pixi/envs/sharp-nodes/lib/libavdevice.62.3.101.dylib (0x113f3c7a8) and /Users/runner/.ce/.pixi/envs/sharp-nodes/lib/python3.11/site-packages/cv2/.dylibs/libavdevice.61.3.100.dylib (0x12e7a43a8). This may cause spurious casting failures and mysterious crashes. One of the duplicates must be removed or renamed. [10:13] [ComfyUI] objc[24418]: Class AVFAudioReceiver is implemented in both /Users/runner/.ce/.pixi/envs/sharp-nodes/lib/libavdevice.62.3.101.dylib (0x113f3c7f8) and /Users/runner/.ce/.pixi/envs/sharp-nodes/lib/python3.11/site-packages/cv2/.dylibs/libavdevice.61.3.100.dylib (0x12e7a43f8). This may cause spurious casting failures and mysterious crashes. One of the duplicates must be removed or renamed. [10:16] [ComfyUI] [worker:ComfyUI-Sharp] [LoadSharpModel] loading checkpoint from /Users/runner/work/comfy-gpu-ci/comfy-gpu-ci/test_workspaces/Sharp-1915/ComfyUI/models/sharp/sharp_2572gikvuh.pt (dtype=bf16) [10:17] [capture-loop] iter=300 t=113.2s state={'complete': False, 'error': None, 'executedCount': 1, 'wsState': 1} eval_ms=45 ram=2.7/7.0GB (43%) swap=1.7/7.0GB (25%) cpu=67% browser_rss=0.76GB [10:24] [ComfyUI] [worker:ComfyUI-Sharp] [LoadSharpModel] initializing model on meta device... [10:24] [ComfyUI] [worker:ComfyUI-Sharp] [LoadSharpModel] model ready (torch.bfloat16) [10:24] [ComfyUI] [worker:ComfyUI-Sharp] [SharpPredictMetricDepth] intrinsics not wired -> using identity-style K (focal=1186.2px @ image 1416×960, 35mm-equiv 30.0mm). Pass intrinsics from PanoramaSplit for per-face accurate K. [10:24] [ComfyUI] [SubprocessWorker] callback 'request_vram_budget' from call_id=8 [10:24] [ComfyUI] [comfy-env] VRAM request: 2.81GB, free before eviction: 1.89GB [10:24] [ComfyUI] [comfy-env] VRAM after eviction: 1.89GB [10:27] [capture-loop] iter=350 t=123.8s state={'complete': False, 'error': None, 'executedCount': 1, 'wsState': 1} eval_ms=11 ram=3.1/7.0GB (86%) swap=1.0/2.0GB (48%) cpu=77% browser_rss=0.41GB [10:35] [capture-loop] iter=400 t=131.2s state={'complete': False, 'error': None, 'executedCount': 1, 'wsState': 1} eval_ms=4 ram=4.4/7.0GB (78%) swap=1.0/2.0GB (48%) cpu=86% browser_rss=0.37GB [10:41] [capture-loop] iter=450 t=137.5s state={'complete': False, 'error': None, 'executedCount': 1, 'wsState': 1} eval_ms=22 ram=4.1/7.0GB (68%) swap=1.0/2.0GB (48%) cpu=80% browser_rss=0.35GB [10:52] [capture-loop] iter=500 t=148.6s state={'complete': False, 'error': None, 'executedCount': 1, 'wsState': 1} eval_ms=3 ram=5.7/7.0GB (92%) swap=0.9/2.0GB (47%) cpu=78% browser_rss=0.26GB [11:03] [ComfyUI] [worker:ComfyUI-Sharp] [11:03] [ComfyUI] === WATCHDOG TICK 1 === [11:03] [ComfyUI] [worker:ComfyUI-Sharp] Current thread 0x000000016de67000 (most recent call first): [11:03] [ComfyUI] File "/var/folders/8d/778wjbv96mq1760tv6gk374m0000gn/T/comfyui_pvenv_zcu5iw2_/persistent_worker.py", line 52 in _watchdog [11:03] [ComfyUI] File "/Users/runner/.ce/.pixi/envs/sharp-nodes/lib/python3.11/threading.py", line 982 in run [11:03] [ComfyUI] File "/Users/runner/.ce/.pixi/envs/sharp-nodes/lib/python3.11/threading.py", line 1045 in _bootstrap_inner [11:03] [ComfyUI] File "/Users/runner/.ce/.pixi/envs/sharp-nodes/lib/python3.11/threading.py", line 1002 in _bootstrap [11:03] [ComfyUI] [11:03] [ComfyUI] Thread 0x00000001efc5a2c0 (most recent call first): [11:03] [ComfyUI] File "/Users/runner/.ce/.pixi/envs/sharp-nodes/lib/python3.11/site-packages/torch/nn/modules/conv.py", line 548 in _conv_forward [11:03] [ComfyUI] File "/Users/runner/.ce/.pixi/envs/sharp-nodes/lib/python3.11/site-packages/torch/nn/modules/conv.py", line 553 in forward [11:03] [ComfyUI] File "/Users/runner/work/comfy-gpu-ci/comfy-gpu-ci/test_workspaces/Sharp-1915/ComfyUI/comfy/ops.py", line 537 in forward [11:03] [ComfyUI] File "/Users/runner/.ce/.pixi/envs/sharp-nodes/lib/python3.11/site-packages/torch/nn/modules/module.py", line 1787 in _call_impl [11:03] [ComfyUI] File "/Users/runner/.ce/.pixi/envs/sharp-nodes/lib/python3.11/site-packages/torch/nn/modules/module.py", line 1776 in _wrapped_call_impl [11:03] [ComfyUI] File "/Users/runner/.ce/.pixi/envs/sharp-nodes/lib/python3.11/site-packages/torch/nn/modules/container.py", line 253 in forward [11:03] [ComfyUI] File "/Users/runner/.ce/.pixi/envs/sharp-nodes/lib/python3.11/site-packages/torch/nn/modules/module.py", line 1787 in _call_impl [11:03] [ComfyUI] File "/Users/runner/.ce/.pixi/envs/sharp-nodes/lib/python3.11/site-packages/torch/nn/modules/module.py", line 1776 in _wrapped_call_impl [11:03] [ComfyUI] File "/Users/runner/work/comfy-gpu-ci/comfy-gpu-ci/test_workspaces/Sharp-1915/ComfyUI/custom_nodes/ComfyUI-Sharp/nodes/sharp/model.py", line 733 in forward [11:03] [ComfyUI] File "/Users/runner/.ce/.pixi/envs/sharp-nodes/lib/python3.11/site-packages/torch/nn/modules/module.py", line 1787 in _call_impl [11:03] [ComfyUI] File "/Users/runner/.ce/.pixi/envs/sharp-nodes/lib/python3.11/site-packages/torch/nn/modules/module.py", line 1776 in _wrapped_call_impl [11:03] [ComfyUI] File "/Users/runner/work/comfy-gpu-ci/comfy-gpu-ci/test_workspaces/Sharp-1915/ComfyUI/custom_nodes/ComfyUI-Sharp/nodes/sharp/model.py", line 1109 in forward [11:03] [ComfyUI] File "/Users/runner/.ce/.pixi/envs/sharp-nodes/lib/python3.11/site-packages/torch/nn/modules/module.py", line 1787 in _call_impl [11:03] [ComfyUI] File "/Users/runner/.ce/.pixi/envs/sharp-nodes/lib/python3.11/site-packages/torch/nn/modules/module.py", line 1776 in _wrapped_call_impl [11:03] [ComfyUI] File "/Users/runner/work/comfy-gpu-ci/comfy-gpu-ci/test_workspaces/Sharp-1915/ComfyUI/custom_nodes/ComfyUI-Sharp/nodes/sharp/model.py", line 2006 in encode [11:03] [ComfyUI] File "/Users/runner/work/comfy-gpu-ci/comfy-gpu-ci/test_workspaces/Sharp-1915/ComfyUI/custom_nodes/ComfyUI-Sharp/nodes/predict_metric_depth.py", line 231 in execute [11:03] [ComfyUI] File "/Users/runner/.ce/.pixi/envs/sharp-nodes/lib/python3.11/site-packages/torch/utils/_contextlib.py", line 124 in decorate_context [11:03] [ComfyUI] File "/Users/runner/work/comfy-gpu-ci/comfy-gpu-ci/test_workspaces/Sharp-1915/ComfyUI/comfy_api/latest/_io.py", line 1892 in EXECUTE_NORMALIZED [11:03] [ComfyUI] File "/var/folders/8d/778wjbv96mq1760tv6gk374m0000gn/T/comfyui_pvenv_zcu5iw2_/persistent_worker.py", line 1762 in main [11:03] [ComfyUI] File "/var/folders/8d/778wjbv96mq1760tv6gk374m0000gn/T/comfyui_pvenv_zcu5iw2_/persistent_worker.py", line 1807 in [11:03] [ComfyUI] [11:03] [ComfyUI] [worker:ComfyUI-Sharp] === END === [11:03] [ComfyUI] [11:07] Frame 9 saved (frame_008.jpg, t=161.2s) [11:07] [capture-periodic] freeze=15ms shot=2155ms unfreeze=8ms saved=True [11:15] Frame 10 saved (frame_009.jpg, t=165.6s) [11:15] [capture-periodic] freeze=6ms shot=6407ms unfreeze=32ms saved=True [11:29] Frame 11 saved (frame_010.jpg, t=175.0s) [11:29] [capture-periodic] freeze=310ms shot=9703ms unfreeze=132ms saved=True [11:29] [capture-loop] iter=550 t=185.6s state={'complete': False, 'error': None, 'executedCount': 1, 'wsState': 1} eval_ms=9 ram=3.5/7.0GB (70%) swap=4.2/5.0GB (83%) cpu=56% browser_rss=0.26GB [11:37] Frame 12 saved (frame_011.jpg, t=187.3s) [11:37] [capture-periodic] freeze=3ms shot=6747ms unfreeze=6ms saved=True [11:56] Frame 13 saved (frame_012.jpg, t=198.7s) [11:56] [capture-periodic] freeze=14ms shot=13339ms unfreeze=20ms saved=True [11:56] [capture-loop] iter=600 t=212.4s state={'complete': False, 'error': None, 'executedCount': 1, 'wsState': 1} eval_ms=173 ram=3.3/7.0GB (86%) swap=4.9/6.0GB (82%) cpu=45% browser_rss=0.23GB [11:58] [ComfyUI] [worker:ComfyUI-Sharp] [SharpPredictMetricDepth] 1 face(s) @ 1536²; layer0/layer1 depth median=2.46/2.46m, K_1536 fx->1286.7; points_raw ||v||=1.65–3.52m; 93.4s [11:59] Frame 14 saved (frame_013.jpg, t=214.1s) [11:59] [capture-periodic] freeze=18ms shot=894ms unfreeze=15ms saved=True [12:00] [ComfyUI] [SubprocessWorker] got response: ok [12:00] [ComfyUI] [comfy-env] SharpPredictMetricDepth done (120.36s): result: NodeOutput [12:00] [ComfyUI] [comfy-env] Running SharpPredictGaussiansFromMetricDepth: snap_to_external_depth: 'none', depth_convention: 'planar_z', focal_length_mm: 30.0, output_prefix: 'sharp_aligned', save_background_layer: True, edge_crop: 0.0, model: dict, image: torch.float32 [1,960,1416,3] cpu, metric_depth_layer0: torch.float32 [1,1536,1536,3] cpu [12:00] [ComfyUI] [SubprocessWorker] call_method: nodes.predict_gaussians_from_depth.SharpPredictGaussiansFromMetricDepth.EXECUTE_NORMALIZED [12:00] [ComfyUI] [SubprocessWorker] acquired lock, ensuring started... [12:00] [ComfyUI] [ComfyUI-Sharp] Health check: ping (timeout=5.0s)... [12:00] [ComfyUI] [ComfyUI-Sharp] Health check: ok [12:00] [ComfyUI] [SubprocessWorker] worker started/confirmed [12:00] [ComfyUI] [comfy-env] PRE-SERIALIZE 'image' shape: torch.Size([1, 960, 1416, 3]) [12:00] [ComfyUI] [comfy-env] PRE-SERIALIZE 'metric_depth_layer0' shape: torch.Size([1, 1536, 1536, 3]) [12:00] [ComfyUI] [SubprocessWorker] serializing kwargs to shm... [12:00] [ComfyUI] [SubprocessWorker] created 0 shm blocks [12:00] [ComfyUI] [SubprocessWorker] sending request via socket... [12:00] [ComfyUI] [SubprocessWorker] call_id=9 sending call_method [12:00] [ComfyUI] [worker:ComfyUI-Sharp] [comfy-env] _from_shm got dict with keys: ['__type__', 'strategy', 'manager_path', 'storage_key', 'storage_size'] [12:00] [ComfyUI] [worker:ComfyUI-Sharp] [comfy-env] DESERIALIZE TensorRef: tensor_size=[1, 960, 1416, 3] [12:00] [ComfyUI] [worker:ComfyUI-Sharp] [comfy-env] DESERIALIZED tensor shape: torch.Size([1, 960, 1416, 3]) [12:00] [ComfyUI] [worker:ComfyUI-Sharp] [comfy-env] _from_shm got dict with keys: ['__type__', 'strategy', 'manager_path', 'storage_key', 'storage_size'] [12:00] [ComfyUI] [worker:ComfyUI-Sharp] [comfy-env] DESERIALIZE TensorRef: tensor_size=[1, 1536, 1536, 3] [12:00] [ComfyUI] [worker:ComfyUI-Sharp] [comfy-env] DESERIALIZED tensor shape: torch.Size([1, 1536, 1536, 3]) [12:01] [ComfyUI] [worker:ComfyUI-Sharp] [SharpPredictGaussiansFromMetricDepth] metric_depth_layer1 unwired -> layer 1 will duplicate layer 0 (legacy behavior) [12:01] [ComfyUI] [SubprocessWorker] callback 'request_vram_budget' from call_id=9 [12:01] [ComfyUI] [comfy-env] VRAM request: 2.81GB, free before eviction: 0.93GB [12:01] [ComfyUI] [comfy-env] VRAM after eviction: 0.94GB [12:02] [ComfyUI] [worker:ComfyUI-Sharp] [SharpPredictGaussiansFromMetricDepth] face 1/1: 1416×960, extrinsics=none, intrinsics=none, mask=no, snap=none, depth_conv=planar_z [12:02] Frame 15 saved (frame_014.jpg, t=217.3s) [12:02] [capture-periodic] freeze=18ms shot=916ms unfreeze=16ms saved=True [12:03] [ComfyUI] [worker:ComfyUI-Sharp] [12:03] [ComfyUI] === WATCHDOG TICK 2 === [12:03] [ComfyUI] [worker:ComfyUI-Sharp] Current thread 0x000000016de67000 (most recent call first): [12:03] [ComfyUI] File "/var/folders/8d/778wjbv96mq1760tv6gk374m0000gn/T/comfyui_pvenv_zcu5iw2_/persistent_worker.py", line 52 in _watchdog [12:03] [ComfyUI] File "/Users/runner/.ce/.pixi/envs/sharp-nodes/lib/python3.11/threading.py", line 982 in run [12:03] [ComfyUI] File "/Users/runner/.ce/.pixi/envs/sharp-nodes/lib/python3.11/threading.py", line 1045 in _bootstrap_inner [12:03] [ComfyUI] File "/Users/runner/.ce/.pixi/envs/sharp-nodes/lib/python3.11/threading.py", line 1002 in _bootstrap [12:03] [ComfyUI] [12:03] [ComfyUI] Thread 0x00000001efc5a2c0 (most recent call first): [12:03] [ComfyUI] File "/Users/runner/work/comfy-gpu-ci/comfy-gpu-ci/test_workspaces/Sharp-1915/ComfyUI/custom_nodes/ComfyUI-Sharp/nodes/predict_gaussian_attrs.py", line 110 in [12:03] [ComfyUI] File "/Users/runner/work/comfy-gpu-ci/comfy-gpu-ci/test_workspaces/Sharp-1915/ComfyUI/custom_nodes/ComfyUI-Sharp/nodes/predict_gaussian_attrs.py", line 110 in _monodepth_to [12:03] [ComfyUI] File "/Users/runner/work/comfy-gpu-ci/comfy-gpu-ci/test_workspaces/Sharp-1915/ComfyUI/custom_nodes/ComfyUI-Sharp/nodes/predict_gaussians_from_depth.py", line 380 in execute [12:03] [ComfyUI] File "/Users/runner/.ce/.pixi/envs/sharp-nodes/lib/python3.11/site-packages/torch/utils/_contextlib.py", line 124 in decorate_context [12:03] [ComfyUI] File "/Users/runner/work/comfy-gpu-ci/comfy-gpu-ci/test_workspaces/Sharp-1915/ComfyUI/comfy_api/latest/_io.py", line 1892 in EXECUTE_NORMALIZED [12:03] [ComfyUI] File "/var/folders/8d/778wjbv96mq1760tv6gk374m0000gn/T/comfyui_pvenv_zcu5iw2_/persistent_worker.py", line 1762 in main [12:03] [ComfyUI] File "/var/folders/8d/778wjbv96mq1760tv6gk374m0000gn/T/comfyui_pvenv_zcu5iw2_/persistent_worker.py", line 1807 in [12:03] [ComfyUI] [12:03] [ComfyUI] [worker:ComfyUI-Sharp] === END === [12:03] [ComfyUI] [12:06] [capture-loop] iter=650 t=222.8s state={'complete': False, 'error': None, 'executedCount': 1, 'wsState': 1} eval_ms=7 ram=4.5/7.0GB (79%) swap=4.1/6.0GB (69%) cpu=62% browser_rss=0.27GB [12:37] [capture-loop] iter=700 t=253.2s state={'complete': False, 'error': None, 'executedCount': 1, 'wsState': 1} eval_ms=10 ram=4.6/7.0GB (81%) swap=6.7/7.0GB (95%) cpu=55% browser_rss=0.22GB [12:37] Frame 16 saved (frame_015.jpg, t=253.2s) [12:37] [capture-periodic] freeze=6ms shot=184ms unfreeze=2ms saved=True [12:39] [ComfyUI] [SubprocessWorker] callback 'report_progress' from call_id=9 [12:39] [ComfyUI] [worker:ComfyUI-Sharp] [SharpPredictGaussiansFromMetricDepth] 1 face(s) -> 1.18M gaussians total (both layers, snap=none); saved to /Users/runner/work/comfy-gpu-ci/comfy-gpu-ci/test_workspaces/Sharp-1915/ComfyUI/output/sharp_aligned_1780860425846.ply; 37.6s [12:40] [ComfyUI] [SubprocessWorker] got response: ok [12:40] [ComfyUI] [comfy-env] SharpPredictGaussiansFromMetricDepth done (39.26s): result: NodeOutput [12:40] [ComfyUI] [comfy-env] Running PreviewGaussianSharp: ply_path: '/Users/runner/work/comfy-gpu-ci/comfy-gpu-ci/test_worksp..., extrinsics: list[4], intrinsics: list[3] [12:40] [ComfyUI] [SubprocessWorker] call_method: nodes.preview_gaussian_sharp.PreviewGaussianSharp.EXECUTE_NORMALIZED [12:41] [ComfyUI] [SubprocessWorker] acquired lock, ensuring started... [12:41] [ComfyUI] [ComfyUI-GaussianPack] Health check: ping (timeout=5.0s)... [12:41] [ComfyUI] [ComfyUI-GaussianPack] Health check: failed [12:41] [ComfyUI] [ComfyUI-GaussianPack] Socket unhealthy, restarting worker... [12:41] [ComfyUI] [ComfyUI-GaussianPack] python: /Users/runner/.ce/.pixi/envs/gaussianpack-nodes/bin/python [12:41] [ComfyUI] [ComfyUI-GaussianPack] sys_path sent to worker: ['/Users/runner/work/comfy-gpu-ci/comfy-gpu-ci/test_workspaces/Sharp-1915/ComfyUI', '/Users/runner/work/comfy-gpu-ci/comfy-gpu-ci/test_workspaces/Sharp-1915/ComfyUI/custom_nodes/ComfyUI-GaussianPack', '/Users/runner/.ce/.pixi/envs/gaussianpack-nodes/lib/python3.11/site-packages', '/Users/runner/work/comfy-gpu-ci/comfy-gpu-ci/test_workspaces/Sharp-1915/ComfyUI/custom_nodes/ComfyUI-GaussianPack'] [12:41] [ComfyUI] [SubprocessWorker] is_pixi=True, python=/Users/runner/.ce/.pixi/envs/gaussianpack-nodes/bin/python [12:41] [ComfyUI] [SubprocessWorker] launching cmd=['/Users/runner/.pixi/bin/pixi', 'run', '--as-is', '--manifest-path', '/Users/runner/.ce/pixi.toml', '-e', 'gaussianpack-nodes', 'python', '/var/folders/8d/778wjbv96mq1760tv6gk374m0000gn/T/comfyui_pvenv_atgs5eit/persistent_worker.py', 'unix:///var/folders/8d/778wjbv96mq1760tv6gk374m0000gn/T/comfy_worker_0b9b36d0423b.sock']... [12:41] [ComfyUI] [SubprocessWorker] socket_addr=unix:///var/folders/8d/778wjbv96mq1760tv6gk374m0000gn/T/comfy_worker_0b9b36d0423b.sock exists=True [12:41] [ComfyUI] Traceback (most recent call last): [12:41] [ComfyUI] File "/var/folders/8d/778wjbv96mq1760tv6gk374m0000gn/T/comfyui_pvenv_atgs5eit/persistent_worker.py", line 1807, in [12:41] [ComfyUI] main() [12:41] [ComfyUI] File "/var/folders/8d/778wjbv96mq1760tv6gk374m0000gn/T/comfyui_pvenv_atgs5eit/persistent_worker.py", line 1667, in main [12:41] [ComfyUI] transport.send({"status": "pong", "call_id": _current_call_id}) [12:41] [ComfyUI] File "/var/folders/8d/778wjbv96mq1760tv6gk374m0000gn/T/comfyui_pvenv_atgs5eit/persistent_worker.py", line 1075, in send [12:41] [ComfyUI] self._sock.sendall(msg) [12:41] [ComfyUI] BrokenPipeError: [Errno 32] Broken pipe [12:41] Frame 17 saved (frame_016.jpg, t=255.5s) [12:41] [capture-periodic] freeze=14ms shot=835ms unfreeze=1251ms saved=True [12:43] Frame 18 saved (frame_017.jpg, t=259.7s) [12:43] [capture-periodic] freeze=11ms shot=176ms unfreeze=2ms saved=True [12:44] [ComfyUI] [SubprocessWorker] worker started/confirmed [12:44] [ComfyUI] [SubprocessWorker] serializing kwargs to shm... [12:44] [ComfyUI] [SubprocessWorker] created 0 shm blocks [12:44] [ComfyUI] [SubprocessWorker] sending request via socket... [12:44] [ComfyUI] [SubprocessWorker] call_id=3 sending call_method [12:45] [ComfyUI] [worker:ComfyUI-GaussianPack] WARNING: SPZ route not registered (ModuleNotFoundError: No module named 'comfy_aimdo') [12:45] [ComfyUI] [SubprocessWorker] got response: ok [12:45] [ComfyUI] [comfy-env] PreviewGaussianSharp done (4.51s): result: NodeOutput [12:45] [ComfyUI] [INFO] Prompt executed in 261.34 seconds [12:45] Node executed (2 total), capturing... [12:46] Frame 19 saved (frame_018.jpg, t=261.8s) [12:46] [capture-node] freeze=2ms shot=581ms unfreeze=2ms saved=True [12:46] [capture-loop] iter=750 t=262.6s state={'complete': False, 'error': None, 'executedCount': 2, 'wsState': 1} eval_ms=3 ram=3.4/7.0GB (67%) swap=6.4/7.0GB (92%) cpu=45% browser_rss=0.28GB [12:49] Frame 20 saved (frame_019.jpg, t=264.4s) [12:49] [capture-periodic] freeze=23ms shot=690ms unfreeze=33ms saved=True [12:49] Execution complete (t=264.4s) [12:50] [3d-wait] Phase 1: Waiting for 'Loading 3D Model' text to disappear... [12:53] [3d-wait] Phase 1 done in 2.8s [12:53] [3d-wait] Phase 2: iframes=2 [12:53] [3d-wait] iframe viewer_ready=True (matched 2 console logs) [12:53] [3d-wait] Unfrozen in 0.007s, rendering for 5s... [12:58] [3d-wait] JS halted via CDP after 5.4s [12:59] [3d-wait] Re-frozen in 6.6s [12:59] [3d-wait] Total 3D wait: 9.4s [12:59] Captured 20 unique frames over 276.02s [12:59] [debug] iframes: 2 [12:59] [debug] iframe[0]: src=http://127.0.0.1:41893/extensions/ComfyUI-GaussianPack/viewer_gaussian_sharp.htm, canvas=1416x960, rafFrozen=True [12:59] [debug] iframe[1]: src=http://127.0.0.1:41893/extensions/ComfyUI-GaussianPack/viewer_gaussian_sharp.htm, canvas=1416x960, rafFrozen=True [12:59] [timing] trigger_3d_previews: 0.0s [13:02] Saved high-quality screenshot: vanilla_vs_image_depth_gaussians_executed.png [13:02] [timing] final_screenshot: 0.4s [13:02] [ComfyUI] [INFO] Using RAM pressure cache. [13:04] Results saved to /Users/runner/work/comfy-gpu-ci/comfy-gpu-ci/comfy-test-logs/Sharp-1915/dev/macos-cpu/results.json [13:04] Model report: 4 files, 2.6 GB -> /Users/runner/work/comfy-gpu-ci/comfy-gpu-ci/comfy-test-logs/Sharp-1915/dev/macos-cpu/models.json [13:04] Saved: /Users/runner/work/comfy-gpu-ci/comfy-gpu-ci/comfy-test-logs/Sharp-1915/dev/macos-cpu/index.html [13:04] macos: FAILED [13:04] Error: Workflow execution failed (1 error(s)) [13:04] Details: sharp_exif.json: Workflow execution failed: {'prompt_id': '8a0433fa-7d52-4d8b-b620-62151ba4d2b5', 'node_id': '7', 'node_type': 'SharpPredict', 'executed': ['2', '9'], 'exception_message': 'MPS backend out of memory (MPS allocated: 6.73 GiB, other allocations: 581.22 MiB, max allowed: 7.93 GiB). Tried to allocate 576.00 MiB on private pool. Use PYTORCH_MPS_HIGH_WATERMARK_RATIO=0.0 to disable upper limit for memory allocations (may cause system failure).\n\nWorker traceback:\nTraceback (most recent call last):\n File "/var/folders/8d/778wjbv96mq1760tv6gk374m0000gn/T/comfyui_pvenv_zcu5iw2_/persistent_worker.py", line 1762, in main\n result = method(**inputs)\n ^^^^^^^^^^^^^^^^\n File "/Users/runner/work/comfy-gpu-ci/comfy-gpu-ci/test_workspaces/Sharp-1915/ComfyUI/comfy_api/latest/_io.py", line 1892, in EXECUTE_NORMALIZED\n to_return = cls.execute(*args, **kwargs)\n ^^^^^^^^^^^^^^^^^^^^^^^^^^^^\n File "/Users/runner/.ce/.pixi/envs/sharp-nodes/lib/python3.11/site-packages/torch/utils/_contextlib.py", line 124, in decorate_context\n return func(*args, **kwargs)\n ^^^^^^^^^^^^^^^^^^^^^\n File "/Users/runner/work/comfy-gpu-ci/comfy-gpu-ci/test_workspaces/Sharp-1915/ComfyUI/custom_nodes/ComfyUI-Sharp/nodes/predict.py", line 239, in execute\n gaussians, refined_depth_l0, refined_depth_l1 = _predict_image_cached(\n ^^^^^^^^^^^^^^^^^^^^^^\n File "/Users/runner/work/comfy-gpu-ci/comfy-gpu-ci/test_workspaces/Sharp-1915/ComfyUI/custom_nodes/ComfyUI-Sharp/nodes/predict.py", line 348, in _predict_image_cached\n monodepth_output, _ = predictor.encode(image_resized_pt)\n ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^\n File "/Users/runner/work/comfy-gpu-ci/comfy-gpu-ci/test_workspaces/Sharp-1915/ComfyUI/custom_nodes/ComfyUI-Sharp/nodes/sharp/model.py", line 2006, in encode\n monodepth_output = self.monodepth_model(image)\n ^^^^^^^^^^^^^^^^^^^^^^^^^^^\n File "/Users/runner/.ce/.pixi/envs/sharp-nodes/lib/python3.11/site-packages/torch/nn/modules/module.py", line 1776, in _wrapped_call_impl\n return self._call_impl(*args, **kwargs)\n ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^\n File "/Users/runner/.ce/.pixi/envs/sharp-nodes/lib/python3.11/site-packages/torch/nn/modules/module.py", line 1787, in _call_impl\n return forward_call(*args, **kwargs)\n ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^\n File "/Users/runner/work/comfy-gpu-ci/comfy-gpu-ci/test_workspaces/Sharp-1915/ComfyUI/custom_nodes/ComfyUI-Sharp/nodes/sharp/model.py", line 1118, in forward\n decoder_features = self.monodepth_predictor.decoder(encoder_features)\n ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^\n File "/Users/runner/.ce/.pixi/envs/sharp-nodes/lib/python3.11/site-packages/torch/nn/modules/module.py", line 1776, in _wrapped_call_impl\n return self._call_impl(*args, **kwargs)\n ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^\n File "/Users/runner/.ce/.pixi/envs/sharp-nodes/lib/python3.11/site-packages/torch/nn/modules/module.py", line 1787, in _call_impl\n return forward_call(*args, **kwargs)\n ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^\n File "/Users/runner/work/comfy-gpu-ci/comfy-gpu-ci/test_workspaces/Sharp-1915/ComfyUI/custom_nodes/ComfyUI-Sharp/nodes/sharp/model.py", line 970, in forward\n features = self.fusions[i](features, features_i)\n ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^\n File "/Users/runner/.ce/.pixi/envs/sharp-nodes/lib/python3.11/site-packages/torch/nn/modules/module.py", line 1776, in _wrapped_call_impl\n return self._call_impl(*args, **kwargs)\n ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^\n File "/Users/runner/.ce/.pixi/envs/sharp-nodes/lib/python3.11/site-packages/torch/nn/modules/module.py", line 1787, in _call_impl\n return forward_call(*args, **kwargs)\n ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^\n File "/Users/runner/work/comfy-gpu-ci/comfy-gpu-ci/test_workspaces/Sharp-1915/ComfyUI/custom_nodes/ComfyUI-Sharp/nodes/sharp/model.py", line 862, in forward\n x = self.out_conv(x)\n ^^^^^^^^^^^^^^^^\n File "/Users/runner/.ce/.pixi/envs/sharp-nodes/lib/python3.11/site-packages/torch/nn/modules/module.py", line 1776, in _wrapped_call_impl\n return self._call_impl(*args, **kwargs)\n ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^\n File "/Users/runner/.ce/.pixi/envs/sharp-nodes/lib/python3.11/site-packages/torch/nn/modules/module.py", line 1787, in _call_impl\n return forward_call(*args, **kwargs)\n ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^\n File "/Users/runner/work/comfy-gpu-ci/comfy-gpu-ci/test_workspaces/Sharp-1915/ComfyUI/comfy/ops.py", line 537, in forward\n return super().forward(*args, **kwargs)\n ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^\n File "/Users/runner/.ce/.pixi/envs/sharp-nodes/lib/python3.11/site-packages/torch/nn/modules/conv.py", line 553, in forward\n return self._conv_forward(input, self.weight, self.bias)\n ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^\n File "/Users/runner/.ce/.pixi/envs/sharp-nodes/lib/python3.11/site-packages/torch/nn/modules/conv.py", line 548, in _conv_forward\n return F.conv2d(\n ^^^^^^^^^\nRuntimeError: MPS backend out of memory (MPS allocated: 6.73 GiB, other allocations: 581.22 MiB, max allowed: 7.93 GiB). Tried to allocate 576.00 MiB on private pool. Use PYTORCH_MPS_HIGH_WATERMARK_RATIO=0.0 to disable upper limit for memory allocations (may cause system failure).\n\n', 'exception_type': 'comfy_env.isolation.workers.base.WorkerError', 'traceback': [' File "/Users/runner/work/comfy-gpu-ci/comfy-gpu-ci/test_workspaces/Sharp-1915/ComfyUI/execution.py", line 536, in execute\n output_data, output_ui, has_subgraph, has_pending_tasks = await get_output_data(prompt_id, unique_id, obj, input_data_all, execution_block_cb=execution_block_cb, pre_execute_cb=pre_execute_cb, v3_data=v3_data)\n ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^\n', ' File "/Users/runner/work/comfy-gpu-ci/comfy-gpu-ci/test_workspaces/Sharp-1915/ComfyUI/execution.py", line 336, in get_output_data\n return_values = await _async_map_node_over_list(prompt_id, unique_id, obj, input_data_all, obj.FUNCTION, allow_interrupt=True, execution_block_cb=execution_block_cb, pre_execute_cb=pre_execute_cb, v3_data=v3_data)\n ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^\n', ' File "/Users/runner/work/comfy-gpu-ci/comfy-gpu-ci/test_workspaces/Sharp-1915/ComfyUI/execution.py", line 310, in _async_map_node_over_list\n await process_inputs(input_dict, i)\n', ' File "/Users/runner/work/comfy-gpu-ci/comfy-gpu-ci/test_workspaces/Sharp-1915/ComfyUI/execution.py", line 298, in process_inputs\n result = f(**inputs)\n ^^^^^^^^^^^\n', ' File "/Users/runner/work/comfy-gpu-ci/comfy-gpu-ci/test_workspaces/Sharp-1915/venv/lib/python3.11/site-packages/comfy_env/isolation/metadata.py", line 556, in proxy\n result = worker.call_method(\n ^^^^^^^^^^^^^^^^^^^\n', ' File "/Users/runner/work/comfy-gpu-ci/comfy-gpu-ci/test_workspaces/Sharp-1915/venv/lib/python3.11/site-packages/comfy_env/isolation/workers/subprocess.py", line 674, in call_method\n raise WorkerError(\n'], 'current_inputs': {'focal_length_mm': [20], 'output_prefix': ['sharp'], 'model': ["{'model_path': '/Users/runner/work/comfy-gpu-ci/comfy-gpu-ci/test_workspaces/Sharp-1915/ComfyUI/models/sharp/sharp_2572gikvuh.pt', 'precision': 'auto', 'dtype': 'bf16'}"], 'image': ['tensor([[[[0.2157, 0.1647, 0.1569],\n [0.2275, 0.1608, 0.1608],\n [0.2275, 0.1647, 0.1529],\n ...,\n [0.4471, 0.4745, 0.4863],\n [0.4510, 0.4745, 0.4863],\n [0.4431, 0.4745, 0.4745]],\n\n [[0.2196, 0.1686, 0.1569],\n [0.2314, 0.1647, 0.1608],\n [0.2353, 0.1647, 0.1647],\n ...,\n [0.4549, 0.4784, 0.4706],\n [0.4549, 0.4706, 0.4784],\n [0.4431, 0.4706, 0.4667]],\n\n [[0.2314, 0.1725, 0.1569],\n [0.2510, 0.1725, 0.1608],\n [0.2392, 0.1725, 0.1686],\n ...,\n [0.4588, 0.4745, 0.4627],\n [0.4510, 0.4745, 0.4667],\n [0.4471, 0.4706, 0.4627]],\n\n ...,\n\n [[0.1569, 0.1647, 0.1843],\n [0.1647, 0.1725, 0.1882],\n [0.1490, 0.1686, 0.1922],\n ...,\n [0.1020, 0.1137, 0.1373],\n [0.1137, 0.1176, 0.1412],\n [0.0863, 0.1176, 0.1373]],\n\n [[0.1569, 0.1686, 0.1804],\n [0.1569, 0.1647, 0.1961],\n [0.1490, 0.1647, 0.1961],\n ...,\n [0.1059, 0.1216, 0.1294],\n [0.1176, 0.1216, 0.1333],\n [0.1059, 0.1137, 0.1373]],\n\n [[0.1608, 0.1686, 0.1843],\n [0.1608, 0.1686, 0.1882],\n [0.1569, 0.1686, 0.1882],\n ...,\n [0.1059, 0.1176, 0.1333],\n [0.1137, 0.1176, 0.1333],\n [0.1333, 0.1176, 0.1333]]]])'], 'prompt': ["{'2': {'inputs': {'precision': 'auto'}, 'class_type': 'LoadSharpModel', '_meta': {'title': '(Down)Load SHARP Model'}}, '7': {'inputs': {'focal_length_mm': ['9', 2], 'output_prefix': 'sharp', 'model': ['2', 0], 'image': ['9', 0]}, 'class_type': 'SharpPredict', '_meta': {'title': 'SHARP Predict (Image to PLY)'}}, '9': {'inputs': {'image': 'eth3d.png', 'default_focal_mm': 30.0}, 'class_type': 'LoadImageWithExif', '_meta': {'title': 'Load Image with EXIF (Focal Length)'}}, '11': {'inputs': {'preview_gaussian': '', 'ply_path': ['7', 0], 'extrinsics': ['7', 1], 'intrinsics': ['7', 2]}, 'class_type': 'PreviewGaussianSharp', '_meta': {'title': 'Preview Gaussian Sharp'}}}"], 'extra_pnginfo': ["{'workflow': {'id': 'sharp-basic-workflow', 'revision': 0, 'last_node_id': 11, 'last_link_id': 24, 'nodes': [{'id': 2, 'type': 'LoadSharpModel', 'pos': [-150, -400], 'size': [270, 106], 'flags': {}, 'order': 0, 'mode': 0, 'inputs': [], 'outputs': [{'name': 'model_config', 'type': 'SHARP_MODEL_CONFIG', 'links': [11]}], 'properties': {'Node name for S&R': 'LoadSharpModel', 'aux_id': 'PozzettiAndrea/ComfyUI-Sharp', 'ver': '9f1b9c726e2cfc0118866c3df783e7f6bc895226', 'cnr_id': 'comfyui-sharp'}, 'widgets_values': ['auto']}, {'id': 9, 'type': 'LoadImageWithExif', 'pos': [-208.74978010739324, -99.02778023242435], 'size': [342.28125, 420], 'flags': {}, 'order': 1, 'mode': 0, 'inputs': [], 'outputs': [{'name': 'image', 'type': 'IMAGE', 'links': [19]}, {'name': 'mask', 'type': 'MASK', 'links': None}, {'name': 'focal_length_mm', 'type': 'FLOAT', 'links': [20]}], 'properties': {'Node name for S&R': 'LoadImageWithExif', 'aux_id': 'PozzettiAndrea/ComfyUI-Sharp', 'ver': 'c69751a59b587c3b83d0e37cfe2bab3bc838574a', 'cnr_id': 'comfyui-sharp'}, 'widgets_values': ['eth3d.png', 30, 'image']}, {'id': 7, 'type': 'SharpPredict', 'pos': [226.15696022727278, -245.70490056818184], 'size': [298.890625, 236], 'flags': {}, 'order': 2, 'mode': 0, 'inputs': [{'name': 'model', 'type': 'SHARP_MODEL_CONFIG', 'link': 11}, {'name': 'image', 'type': 'IMAGE', 'link': 19}, {'name': 'extrinsics', 'shape': 7, 'type': 'EXTRINSICS', 'link': None}, {'name': 'intrinsics', 'shape': 7, 'type': 'INTRINSICS', 'link': None}, {'name': 'focal_length_mm', 'shape': 7, 'type': 'FLOAT', 'widget': {'name': 'focal_length_mm'}, 'link': 20}], 'outputs': [{'name': 'ply_path', 'type': 'STRING', 'links': [22]}, {'name': 'extrinsics', 'type': 'EXTRINSICS', 'links': [23]}, {'name': 'intrinsics', 'type': 'INTRINSICS', 'links': [24]}, {'name': 'layer_0_refined_depth', 'type': 'IMAGE', 'links': None}, {'name': 'layer_1_refined_depth', 'type': 'IMAGE', 'links': None}], 'properties': {'Node name for S&R': 'SharpPredict', 'aux_id': 'PozzettiAndrea/ComfyUI-Sharp', 'ver': 'c69751a59b587c3b83d0e37cfe2bab3bc838574a', 'cnr_id': 'comfyui-sharp'}, 'widgets_values': [30, 'sharp']}, {'id': 11, 'type': 'PreviewGaussianSharp', 'pos': [600.5860117362482, -287.72961200652577], 'size': [512, 658], 'flags': {}, 'order': 3, 'mode': 0, 'inputs': [{'name': 'ply_path', 'type': 'STRING', 'link': 22}, {'name': 'extrinsics', 'shape': 7, 'type': 'EXTRINSICS', 'link': 23}, {'name': 'intrinsics', 'shape': 7, 'type': 'INTRINSICS', 'link': 24}], 'outputs': [{'name': 'extrinsics', 'type': 'EXTRINSICS', 'links': None}, {'name': 'intrinsics', 'type': 'INTRINSICS', 'links': None}], 'properties': {'Node name for S&R': 'PreviewGaussianSharp', 'aux_id': 'PozzettiAndrea/ComfyUI-GaussianPack', 'ver': '059313a53ffa7ecc8697eddc02d2cee4727e5085'}, 'widgets_values': ['']}], 'links': [[11, 2, 0, 7, 0, 'SHARP_MODEL'], [19, 9, 0, 7, 1, 'IMAGE'], [20, 9, 2, 7, 4, 'FLOAT'], [22, 7, 0, 11, 0, 'STRING'], [23, 7, 1, 11, 1, 'EXTRINSICS'], [24, 7, 2, 11, 2, 'INTRINSICS']], 'groups': [], 'config': {}, 'extra': {'ds': {'scale': 0.9373016969629105, 'offset': [449.06099628194596, 596.4219590460706]}, 'workflowRendererVersion': 'LG', 'frontendVersion': '1.45.15'}, 'version': 0.4}}"]}, 'current_outputs': ['2', '9', '11', '7'], 'timestamp': 1780860197909} Details: Workflow: /private/var/folders/8d/778wjbv96mq1760tv6gk374m0000gn/T/comfy-test-run-n4s1o4ug/ComfyUI-Sharp/workflows/sharp_exif.json Node error: SharpPredict [13:04] Stopping ComfyUI server...