[00:00] Crash dump logging enabled: /home/runner/work/comfy-gpu-ci/comfy-gpu-ci/comfy-test-logs/Sharp-2211/dev/linux-cpu/crash_dump.log [00:00] [00:00] [1/5] SYNTAX [00:00] ---------------------------------------- [00:00] [DEBUG] server=None, api=None [00:00] Found pyproject.toml (modern format) [00:00] Found requirements.txt (legacy format) [00:00] Unicode check: OK (all characters cp1252-safe) [00:00] Forbidden patterns check: OK [00:00] [SYNTAX] PASSED [00:00] [00:00] [2/5] INSTALL [00:00] ---------------------------------------- [00:00] [DEBUG] server=None, api=None [00:00] Setting up ComfyUI... [00:00] Creating virtual environment... [00:00] Running: uv venv /home/runner/work/comfy-gpu-ci/comfy-gpu-ci/test_workspaces/Sharp-2211/.venv --python 3.11 [00:01] torch_version='2.10.0' -> pinning torch==2.10.0 torchvision==0.25.0 torchaudio==2.10.0 [00:01] Cloning ComfyUI (latest)... [00:01] Running: git clone --depth 1 https://github.com/comfyanonymous/ComfyUI.git /home/runner/work/comfy-gpu-ci/comfy-gpu-ci/test_workspaces/Sharp-2211/ComfyUI [00:02] Pinning torch family from https://download.pytorch.org/whl/cpu: torch==2.10.0 torchvision==0.25.0 torchaudio==2.10.0 [00:02] Running: uv pip install --python /home/runner/work/comfy-gpu-ci/comfy-gpu-ci/test_workspaces/Sharp-2211/.venv/bin/python --index-url https://download.pytorch.org/whl/cpu --extra-index-url https://pypi.org/simple --index-strategy unsafe-best-match torch==2.10.0 torchvision==0.25.0 torchaudio==2.10.0 [00:06] Installing ComfyUI requirements... [00:06] Running: uv pip install --python /home/runner/work/comfy-gpu-ci/comfy-gpu-ci/test_workspaces/Sharp-2211/.venv/bin/python --index-url https://download.pytorch.org/whl/cpu --extra-index-url https://pypi.org/simple --index-strategy unsafe-best-match -r /home/runner/work/comfy-gpu-ci/comfy-gpu-ci/test_workspaces/Sharp-2211/ComfyUI/requirements.txt [00:11] Installing custom node... [00:11] Copying ComfyUI-Sharp to custom_nodes/... [00:11] Installing node requirements... [00:11] Running: uv pip install --python /home/runner/work/comfy-gpu-ci/comfy-gpu-ci/test_workspaces/Sharp-2211/.venv/bin/python --index-url https://download.pytorch.org/whl/cpu --extra-index-url https://pypi.org/simple --index-strategy unsafe-best-match -r /home/runner/work/comfy-gpu-ci/comfy-gpu-ci/test_workspaces/Sharp-2211/ComfyUI/custom_nodes/ComfyUI-Sharp/requirements.txt [00:12] Running install.py... [00:12] Running: /home/runner/work/comfy-gpu-ci/comfy-gpu-ci/test_workspaces/Sharp-2211/.venv/bin/python /home/runner/work/comfy-gpu-ci/comfy-gpu-ci/test_workspaces/Sharp-2211/ComfyUI/custom_nodes/ComfyUI-Sharp/install.py [00:12] [00:12] Installing 2 node dependencies... [00:12] Cloning ComfyUI-GaussianPack... [00:15] Installing requirements for ComfyUI-GaussianPack... [00:16] Running install.py for ComfyUI-GaussianPack... [00:17] [comfy-env] _discover: scanning /home/runner/work/comfy-gpu-ci/comfy-gpu-ci/test_workspaces/Sharp-2211/ComfyUI/custom_nodes [00:17] [comfy-env] _discover: ComfyUI-GaussianPack -> gaussianpack-nodes (custom_nodes/ComfyUI-GaussianPack/nodes/comfy-env.toml) [00:17] [comfy-env] _discover: ComfyUI-Sharp -> sharp-nodes (custom_nodes/ComfyUI-Sharp/nodes/comfy-env.toml) [00:17] [comfy-env] Workspace: /home/runner/.ce [00:17] [comfy-env] ComfyUI: /home/runner/work/comfy-gpu-ci/comfy-gpu-ci/test_workspaces/Sharp-2211/ComfyUI [00:17] [comfy-env] Found 2 node config(s): [00:17] - gaussianpack-nodes <- custom_nodes/ComfyUI-GaussianPack/nodes/comfy-env.toml (python=host) [00:17] - sharp-nodes <- custom_nodes/ComfyUI-Sharp/nodes/comfy-env.toml (python=host) [00:17] [comfy-env] Bootstrap interpreter has python 3.11 + torch 2.10.0 (cpu). Looking for cuda-only wheels matching cpu/torch2.10/cp311. [00:19] [comfy-env] GPU: No GPU detected [00:19] [comfy-env] No CUDA detected -- pinning comfyui torch to CPU index [00:19] [comfy-env] Host glibc 2.39 -> system-requirements [00:19] Generated /home/runner/.ce/pixi.toml [00:19] [comfy-env] Installing 2 environment(s): [00:19] - gaussianpack-nodes (python=host, 8 pypi deps, 1 cuda wheels) [00:19] - sharp-nodes (python=host, 15 pypi deps, 1 cuda wheels) [00:19] [comfy-env] Running `pixi install -e gaussianpack-nodes -e sharp-nodes`... [00:25] WARN Skipped running the post-link scripts because `run-post-link-scripts` = `false` [00:25] - bin/.librsvg-pre-unlink.sh [00:25] To enable them, run: [00:25] pixi config set --local run-post-link-scripts insecure [00:25] More info: [00:25] https://pixi.sh/latest/reference/pixi_configuration/#run-post-link-scripts [00:36] WARN Skipped running the post-link scripts because `run-post-link-scripts` = `false` [00:36] - bin/.librsvg-pre-unlink.sh [00:36] To enable them, run: [00:36] pixi config set --local run-post-link-scripts insecure [00:36] More info: [00:36] https://pixi.sh/latest/reference/pixi_configuration/#run-post-link-scripts [00:38] ✔ The following environments have been installed: gaussianpack-nodes, sharp-nodes. [00:39] [comfy-env] Recorded install hash fbd9bcb6ce25 -> /home/runner/.ce/install.hash [00:39] [comfy-env] Install log: /home/runner/.ce/install.log [00:39] [00:39] Installation complete! [00:39] Cloning ComfyUI-PanoPack... [00:40] Installing requirements for ComfyUI-PanoPack... [00:40] Running install.py for ComfyUI-PanoPack... [00:40] [00:40] Installing 2 node dependencies... [00:40] Cloning ComfyUI-MoGe2... [00:41] Installing requirements for ComfyUI-MoGe2... [00:41] Running install.py for ComfyUI-MoGe2... [00:41] [comfy-env] _discover: scanning /home/runner/work/comfy-gpu-ci/comfy-gpu-ci/test_workspaces/Sharp-2211/ComfyUI/custom_nodes [00:41] [comfy-env] _discover: ComfyUI-GaussianPack -> gaussianpack-nodes (custom_nodes/ComfyUI-GaussianPack/nodes/comfy-env.toml) [00:41] [comfy-env] _discover: ComfyUI-MoGe2 -> moge2-nodes (custom_nodes/ComfyUI-MoGe2/nodes/comfy-env.toml) [00:41] [comfy-env] _discover: ComfyUI-PanoPack -> panopack-nodes (custom_nodes/ComfyUI-PanoPack/nodes/comfy-env.toml) [00:41] [comfy-env] _discover: ComfyUI-Sharp -> sharp-nodes (custom_nodes/ComfyUI-Sharp/nodes/comfy-env.toml) [00:41] [comfy-env] Workspace: /home/runner/.ce [00:41] [comfy-env] ComfyUI: /home/runner/work/comfy-gpu-ci/comfy-gpu-ci/test_workspaces/Sharp-2211/ComfyUI [00:41] [comfy-env] Found 4 node config(s): [00:41] - gaussianpack-nodes <- custom_nodes/ComfyUI-GaussianPack/nodes/comfy-env.toml (python=host) [00:41] - moge2-nodes <- custom_nodes/ComfyUI-MoGe2/nodes/comfy-env.toml (python=host) [00:41] - panopack-nodes <- custom_nodes/ComfyUI-PanoPack/nodes/comfy-env.toml (python=host) [00:41] - sharp-nodes <- custom_nodes/ComfyUI-Sharp/nodes/comfy-env.toml (python=host) [00:41] [comfy-env] Bootstrap interpreter has python 3.11 + torch 2.10.0 (cpu). Looking for cuda-only wheels matching cpu/torch2.10/cp311. [00:42] [comfy-env] GPU: No GPU detected [00:42] [comfy-env] No CUDA detected -- pinning comfyui torch to CPU index [00:42] [comfy-env] Host glibc 2.39 -> system-requirements [00:42] Generated /home/runner/.ce/pixi.toml [00:42] [comfy-env] Installing 4 environment(s): [00:42] - gaussianpack-nodes (python=host, 8 pypi deps, 1 cuda wheels) [00:42] - moge2-nodes (python=host, 12 pypi deps, 2 cuda wheels) [00:42] - panopack-nodes (python=host, 21 pypi deps) [00:42] - sharp-nodes (python=host, 15 pypi deps, 1 cuda wheels) [00:42] [comfy-env] Running `pixi install -e gaussianpack-nodes -e moge2-nodes -e panopack-nodes -e sharp-nodes`... [00:44] WARN Skipped running the post-link scripts because `run-post-link-scripts` = `false` [00:44] - bin/.librsvg-pre-unlink.sh [00:44] To enable them, run: [00:44] pixi config set --local run-post-link-scripts insecure [00:44] More info: [00:44] https://pixi.sh/latest/reference/pixi_configuration/#run-post-link-scripts [00:53] WARN Skipped running the post-link scripts because `run-post-link-scripts` = `false` [00:53] - bin/.librsvg-pre-unlink.sh [00:53] To enable them, run: [00:53] pixi config set --local run-post-link-scripts insecure [00:53] More info: [00:53] https://pixi.sh/latest/reference/pixi_configuration/#run-post-link-scripts [00:54] ✔ The following environments have been installed: gaussianpack-nodes, moge2-nodes, panopack-nodes, sharp-nodes. [00:54] [comfy-env] Recorded install hash 84e37ee4e920 -> /home/runner/.ce/install.hash [00:55] [comfy-env] Install log: /home/runner/.ce/install.log [00:55] [00:55] Installation complete! [00:55] Cloning ComfyUI-GeometryPack... [00:56] Installing requirements for ComfyUI-GeometryPack... [00:57] Running install.py for ComfyUI-GeometryPack... [00:57] [comfy-env] _discover: scanning /home/runner/work/comfy-gpu-ci/comfy-gpu-ci/test_workspaces/Sharp-2211/ComfyUI/custom_nodes [00:57] [comfy-env] _discover: ComfyUI-GaussianPack -> gaussianpack-nodes (custom_nodes/ComfyUI-GaussianPack/nodes/comfy-env.toml) [00:57] [comfy-env] _discover: ComfyUI-GeometryPack -> geometrypack-nodes (custom_nodes/ComfyUI-GeometryPack/nodes/comfy-env.toml) [00:57] [comfy-env] _discover: ComfyUI-MoGe2 -> moge2-nodes (custom_nodes/ComfyUI-MoGe2/nodes/comfy-env.toml) [00:57] [comfy-env] _discover: ComfyUI-PanoPack -> panopack-nodes (custom_nodes/ComfyUI-PanoPack/nodes/comfy-env.toml) [00:57] [comfy-env] _discover: ComfyUI-Sharp -> sharp-nodes (custom_nodes/ComfyUI-Sharp/nodes/comfy-env.toml) [00:57] [comfy-env] Workspace: /home/runner/.ce [00:57] [comfy-env] ComfyUI: /home/runner/work/comfy-gpu-ci/comfy-gpu-ci/test_workspaces/Sharp-2211/ComfyUI [00:57] [comfy-env] Found 5 node config(s): [00:57] - gaussianpack-nodes <- custom_nodes/ComfyUI-GaussianPack/nodes/comfy-env.toml (python=host) [00:57] - geometrypack-nodes <- custom_nodes/ComfyUI-GeometryPack/nodes/comfy-env.toml (python=host) [00:57] - moge2-nodes <- custom_nodes/ComfyUI-MoGe2/nodes/comfy-env.toml (python=host) [00:57] - panopack-nodes <- custom_nodes/ComfyUI-PanoPack/nodes/comfy-env.toml (python=host) [00:57] - sharp-nodes <- custom_nodes/ComfyUI-Sharp/nodes/comfy-env.toml (python=host) [00:57] [comfy-env] Bootstrap interpreter has python 3.11 + torch 2.10.0 (cpu). Looking for cuda-only wheels matching cpu/torch2.10/cp311. [00:58] [comfy-env] GPU: No GPU detected [00:58] [comfy-env] No CUDA detected -- pinning comfyui torch to CPU index [00:58] [comfy-env] Host glibc 2.39 -> system-requirements [00:58] Generated /home/runner/.ce/pixi.toml [00:58] [comfy-env] Installing 5 environment(s): [00:58] - gaussianpack-nodes (python=host, 8 pypi deps, 1 cuda wheels) [00:58] - geometrypack-nodes (python=host, 14 pypi deps, 1 cuda wheels) [00:58] - moge2-nodes (python=host, 12 pypi deps, 2 cuda wheels) [00:58] - panopack-nodes (python=host, 21 pypi deps) [00:58] - sharp-nodes (python=host, 15 pypi deps, 1 cuda wheels) [00:58] [comfy-env] Running `pixi install -e gaussianpack-nodes -e geometrypack-nodes -e moge2-nodes -e panopack-nodes -e sharp-nodes`... [01:12] WARN Skipped running the post-link scripts because `run-post-link-scripts` = `false` [01:12] - bin/.librsvg-pre-unlink.sh [01:12] To enable them, run: [01:12] pixi config set --local run-post-link-scripts insecure [01:12] More info: [01:12] https://pixi.sh/latest/reference/pixi_configuration/#run-post-link-scripts [01:14] ✔ The following environments have been installed: gaussianpack-nodes, geometrypack-nodes, moge2-nodes, panopack-nodes, sharp-nodes. [01:14] [comfy-env] Recorded install hash 6fd28b8aa152 -> /home/runner/.ce/install.hash [01:14] [comfy-env] Install log: /home/runner/.ce/install.log [01:14] [01:14] Installation complete! [01:15] [01:15] [requirements] Re-installing main package requirements... [01:15] Installing requirements for ComfyUI-PanoPack... [01:15] [comfy-env] _discover: scanning /home/runner/work/comfy-gpu-ci/comfy-gpu-ci/test_workspaces/Sharp-2211/ComfyUI/custom_nodes [01:15] [comfy-env] _discover: ComfyUI-GaussianPack -> gaussianpack-nodes (custom_nodes/ComfyUI-GaussianPack/nodes/comfy-env.toml) [01:15] [comfy-env] _discover: ComfyUI-GeometryPack -> geometrypack-nodes (custom_nodes/ComfyUI-GeometryPack/nodes/comfy-env.toml) [01:15] [comfy-env] _discover: ComfyUI-MoGe2 -> moge2-nodes (custom_nodes/ComfyUI-MoGe2/nodes/comfy-env.toml) [01:15] [comfy-env] _discover: ComfyUI-PanoPack -> panopack-nodes (custom_nodes/ComfyUI-PanoPack/nodes/comfy-env.toml) [01:15] [comfy-env] _discover: ComfyUI-Sharp -> sharp-nodes (custom_nodes/ComfyUI-Sharp/nodes/comfy-env.toml) [01:15] [comfy-env] Workspace inputs unchanged (hash 6fd28b8aa152) -- skipping install. Delete /home/runner/.ce/install.hash to force. [01:15] [01:15] Installation complete! [01:15] ComfyUI-MoGe2: exists [01:15] ComfyUI-GeometryPack: exists [01:15] [01:15] [requirements] Re-installing main package requirements... [01:15] Installing requirements for ComfyUI-Sharp... [01:15] [comfy-env] _discover: scanning /home/runner/work/comfy-gpu-ci/comfy-gpu-ci/test_workspaces/Sharp-2211/ComfyUI/custom_nodes [01:15] [comfy-env] _discover: ComfyUI-GaussianPack -> gaussianpack-nodes (custom_nodes/ComfyUI-GaussianPack/nodes/comfy-env.toml) [01:15] [comfy-env] _discover: ComfyUI-GeometryPack -> geometrypack-nodes (custom_nodes/ComfyUI-GeometryPack/nodes/comfy-env.toml) [01:15] [comfy-env] _discover: ComfyUI-MoGe2 -> moge2-nodes (custom_nodes/ComfyUI-MoGe2/nodes/comfy-env.toml) [01:15] [comfy-env] _discover: ComfyUI-PanoPack -> panopack-nodes (custom_nodes/ComfyUI-PanoPack/nodes/comfy-env.toml) [01:15] [comfy-env] _discover: ComfyUI-Sharp -> sharp-nodes (custom_nodes/ComfyUI-Sharp/nodes/comfy-env.toml) [01:15] [comfy-env] Workspace inputs unchanged (hash 6fd28b8aa152) -- skipping install. Delete /home/runner/.ce/install.hash to force. [01:15] [01:15] Installation complete! [01:15] Installing 2 node dependency(ies)... [01:15] ComfyUI-GaussianPack from PozzettiAndrea/ComfyUI-GaussianPack [01:15] ComfyUI-GaussianPack already exists, skipping... [01:15] ComfyUI-PanoPack from PozzettiAndrea/ComfyUI-PanoPack [01:15] ComfyUI-PanoPack already exists, skipping... [01:15] Installing validation endpoint... [01:15] Cloning PozzettiAndrea/ComfyUI-validate-endpoint... [01:15] Running: git clone --depth 1 https://x-access-token:***@github.com/PozzettiAndrea/ComfyUI-validate-endpoint.git /home/runner/work/comfy-gpu-ci/comfy-gpu-ci/test_workspaces/Sharp-2211/ComfyUI/custom_nodes/ComfyUI-validate-endpoint [01:15] CUDA packages absent (will mock): gsplat [01:15] [INSTALL] PASSED [01:15] [01:15] [3/5] REGISTRATION [01:15] ---------------------------------------- [01:15] [DEBUG] server=None, api=None [01:15] Starting ComfyUI server... [01:15] Starting ComfyUI server on port 41888... [01:15] CUDA mock packages: gsplat [01:15] Starting ComfyUI server on port 41888... [01:15] Waiting for server to be ready (timeout: 600s)... [01:16] [ComfyUI] [INFO] setup plugin alembic.autogenerate.schemas [01:16] [ComfyUI] [INFO] setup plugin alembic.autogenerate.tables [01:16] [ComfyUI] [INFO] setup plugin alembic.autogenerate.types [01:16] [ComfyUI] [INFO] setup plugin alembic.autogenerate.constraints [01:16] [ComfyUI] [INFO] setup plugin alembic.autogenerate.defaults [01:16] [ComfyUI] [INFO] setup plugin alembic.autogenerate.comments [01:16] [ComfyUI] [comfy-env] ComfyUI-Sharp: 1 isolation env(s): [01:16] [ComfyUI] [comfy-env] nodes -> /home/runner/work/comfy-gpu-ci/comfy-gpu-ci/test_workspaces/Sharp-2211/ComfyUI/custom_nodes/ComfyUI-Sharp/nodes [01:16] [ComfyUI] [comfy-env] Workspace: /home/runner/.ce [01:16] [ComfyUI] [comfy-env] env: /home/runner/.ce/.pixi/envs/sharp-nodes [OK] [01:16] [ComfyUI] [comfy-env] prestartup complete [01:16] [ComfyUI] [comfy-env] ComfyUI-GeometryPack: 1 isolation env(s): [01:16] [ComfyUI] [comfy-env] nodes -> /home/runner/work/comfy-gpu-ci/comfy-gpu-ci/test_workspaces/Sharp-2211/ComfyUI/custom_nodes/ComfyUI-GeometryPack/nodes [01:16] [ComfyUI] [comfy-env] env: /home/runner/.ce/.pixi/envs/geometrypack-nodes [OK] [01:16] [ComfyUI] [comfy-env] prestartup complete [01:16] [ComfyUI] [comfy-env] ComfyUI-PanoPack: 1 isolation env(s): [01:16] [ComfyUI] [comfy-env] nodes -> /home/runner/work/comfy-gpu-ci/comfy-gpu-ci/test_workspaces/Sharp-2211/ComfyUI/custom_nodes/ComfyUI-PanoPack/nodes [01:16] [ComfyUI] [comfy-env] env: /home/runner/.ce/.pixi/envs/panopack-nodes [OK] [01:16] [ComfyUI] [comfy-env] prestartup complete [01:16] [ComfyUI] [comfy-env] ComfyUI-MoGe2: 1 isolation env(s): [01:16] [ComfyUI] [comfy-env] nodes -> /home/runner/work/comfy-gpu-ci/comfy-gpu-ci/test_workspaces/Sharp-2211/ComfyUI/custom_nodes/ComfyUI-MoGe2/nodes [01:16] [ComfyUI] [comfy-env] env: /home/runner/.ce/.pixi/envs/moge2-nodes [OK] [01:16] [ComfyUI] [comfy-env] prestartup complete [01:16] [ComfyUI] [INFO] [01:16] [ComfyUI] Prestartup times for custom nodes: [01:16] [ComfyUI] [INFO] 0.0 seconds: /home/runner/work/comfy-gpu-ci/comfy-gpu-ci/test_workspaces/Sharp-2211/ComfyUI/custom_nodes/ComfyUI-MoGe2 [01:16] [ComfyUI] [INFO] 0.0 seconds: /home/runner/work/comfy-gpu-ci/comfy-gpu-ci/test_workspaces/Sharp-2211/ComfyUI/custom_nodes/ComfyUI-GaussianPack [01:16] [ComfyUI] [INFO] 0.0 seconds: /home/runner/work/comfy-gpu-ci/comfy-gpu-ci/test_workspaces/Sharp-2211/ComfyUI/custom_nodes/ComfyUI-PanoPack [01:16] [ComfyUI] [INFO] 0.0 seconds: /home/runner/work/comfy-gpu-ci/comfy-gpu-ci/test_workspaces/Sharp-2211/ComfyUI/custom_nodes/ComfyUI-GeometryPack [01:16] [ComfyUI] [INFO] 0.2 seconds: /home/runner/work/comfy-gpu-ci/comfy-gpu-ci/test_workspaces/Sharp-2211/ComfyUI/custom_nodes/ComfyUI-Sharp [01:16] [ComfyUI] [INFO] [01:20] [ComfyUI] [INFO] Found comfy_kitchen backend cuda: {'available': False, 'disabled': True, 'unavailable_reason': 'CUDA not available on this system', 'capabilities': []} [01:20] [ComfyUI] [INFO] Found comfy_kitchen backend eager: {'available': True, 'disabled': False, 'unavailable_reason': None, 'capabilities': ['apply_rope', 'apply_rope1', 'apply_rope_split_half', 'apply_rope_split_half1', 'dequantize_mxfp8', 'dequantize_nvfp4', 'dequantize_per_tensor_fp8', 'gemv_awq_w4a16', 'quantize_mxfp8', 'quantize_nvfp4', 'quantize_per_tensor_fp8', 'quantize_svdquant_w4a4', 'scaled_mm_mxfp8', 'scaled_mm_nvfp4', 'scaled_mm_svdquant_w4a4', 'stochastic_rounding_fp8']} [01:20] [ComfyUI] [INFO] Found comfy_kitchen backend triton: {'available': False, 'disabled': True, 'unavailable_reason': "ImportError: No module named 'triton'", 'capabilities': []} [01:20] [ComfyUI] [INFO] Checkpoint files will always be loaded safely. [01:21] [ComfyUI] [INFO] Total VRAM 15990 MB, total RAM 15990 MB [01:21] [ComfyUI] [INFO] pytorch version: 2.10.0+cpu [01:21] [ComfyUI] [INFO] Set vram state to: DISABLED [01:21] [ComfyUI] [INFO] Device: cpu [01:21] [ComfyUI] [INFO] Using sub quadratic optimization for attention, if you have memory or speed issues try using: --use-split-cross-attention [01:26] [ComfyUI] [INFO] Python version: 3.11.15 (main, Jun 2 2026, 22:26:03) [Clang 22.1.3 ] [01:26] [ComfyUI] [INFO] ComfyUI version: 0.24.0 [01:26] [ComfyUI] [INFO] comfy-aimdo version: 0.4.9 [01:26] [ComfyUI] [INFO] comfy-kitchen version: 0.2.10 [01:26] [ComfyUI] [WARNING] ****** User settings have been changed to be stored on the server instead of browser storage. ****** [01:26] [ComfyUI] [WARNING] ****** For multi-user setups add the --multi-user CLI argument to enable multiple user profiles. ****** [01:26] [ComfyUI] [INFO] comfyui-frontend-package version: 1.45.15 [01:26] [ComfyUI] [INFO] comfyui-workflow-templates version: 0.9.98 [01:26] [ComfyUI] [INFO] comfyui-embedded-docs version: 0.5.2 [01:26] [ComfyUI] [INFO] comfy-kitchen version: 0.2.10 [01:26] [ComfyUI] [INFO] comfy-aimdo version: 0.4.9 [01:26] [ComfyUI] [INFO] [Prompt Server] web root: /home/runner/work/comfy-gpu-ci/comfy-gpu-ci/test_workspaces/Sharp-2211/.venv/lib/python3.11/site-packages/comfyui_frontend_package/static [01:26] [ComfyUI] [INFO] Asset seeder disabled [01:28] [ComfyUI] [comfy-env] Version: 0.3.89 [01:29] [ComfyUI] [comfy-env] register_nodes: ComfyUI-Sharp [01:29] [ComfyUI] [comfy-env] ComfyUI source dir: /home/runner/work/comfy-gpu-ci/comfy-gpu-ci/test_workspaces/Sharp-2211/ComfyUI [01:29] [ComfyUI] [comfy-env] Found 1 isolation env(s) [01:29] [ComfyUI] [comfy-env] Scanning nodes metadata (isolation root)... [01:29] [ComfyUI] [comfy-env] Metadata scan: /home/runner/.pixi/bin/pixi run --as-is --manifest-path /home/runner/.ce/pixi.toml -e sharp-nodes python /tmp/comfy_meta_fo8a7ze2.py /home/runner/work/comfy-gpu-ci/comfy-gpu-ci/test_workspaces/Sharp-2211/ComfyUI/custom_nodes/ComfyUI-Sharp nodes /tmp/comfy_meta_out_b_4llngm.pkl [01:29] [ComfyUI] [comfy-env] Scan env PATH for nodes: [01:29] [ComfyUI] [comfy-env] [0] /opt/hostedtoolcache/Python/3.13.13/x64/bin [01:29] [ComfyUI] [comfy-env] [1] /opt/hostedtoolcache/Python/3.13.13/x64 [01:29] [ComfyUI] [comfy-env] [2] /snap/bin [01:29] [ComfyUI] [comfy-env] [3] /home/runner/.local/bin [01:29] [ComfyUI] [comfy-env] [4] /opt/pipx_bin [01:29] [ComfyUI] [comfy-env] [5] /home/runner/.cargo/bin [01:29] [ComfyUI] [comfy-env] [6] /home/runner/.config/composer/vendor/bin [01:29] [ComfyUI] [comfy-env] [7] /usr/local/.ghcup/bin [01:29] [ComfyUI] [comfy-env] [8] /home/runner/.dotnet/tools [01:29] [ComfyUI] [comfy-env] [9] /usr/local/sbin [01:29] [ComfyUI] [comfy-env] [10] /usr/local/bin [01:29] [ComfyUI] [comfy-env] [11] /usr/sbin [01:29] [ComfyUI] [comfy-env] [12] /usr/bin [01:29] [ComfyUI] [comfy-env] [13] /sbin [01:29] [ComfyUI] [comfy-env] [14] /bin [01:29] [ComfyUI] [comfy-env] [15] /usr/games [01:29] [ComfyUI] [comfy-env] [16] /usr/local/games [01:29] [ComfyUI] [comfy-env] [17] /snap/bin [01:32] [ComfyUI] [comfy-env] Metadata scan stderr for nodes: [01:32] [ComfyUI] [comfy-env] [meta-scan] importing nodes from /home/runner/work/comfy-gpu-ci/comfy-gpu-ci/test_workspaces/Sharp-2211/ComfyUI/custom_nodes/ComfyUI-Sharp [01:32] [ComfyUI] [comfy-env] [meta-scan] import OK [01:32] [ComfyUI] [comfy-env] Scanned nodes: 17 nodes (3.4s) [01:32] [ComfyUI] [comfy-env] Scanned nodes root: 17 nodes (3.5s) [01:32] [ComfyUI] [comfy-env] Imported nodes root: 17 nodes (isolation) [01:32] [ComfyUI] [comfy-env] Registered 17 total nodes [01:32] [ComfyUI] [INFO] loading... [01:32] [ComfyUI] [INFO] calling register_nodes [01:32] [ComfyUI] [comfy-env] Version: 0.3.89 [01:32] [ComfyUI] [comfy-env] register_nodes: ComfyUI-GeometryPack [01:32] [ComfyUI] [comfy-env] ComfyUI source dir: /home/runner/work/comfy-gpu-ci/comfy-gpu-ci/test_workspaces/Sharp-2211/ComfyUI [01:32] [ComfyUI] [comfy-env] Found 1 isolation env(s) [01:32] [ComfyUI] [comfy-env] Scanning nodes metadata (isolation root)... [01:32] [ComfyUI] [comfy-env] Metadata scan: /home/runner/.pixi/bin/pixi run --as-is --manifest-path /home/runner/.ce/pixi.toml -e geometrypack-nodes python /tmp/comfy_meta_2u0g7wgi.py /home/runner/work/comfy-gpu-ci/comfy-gpu-ci/test_workspaces/Sharp-2211/ComfyUI/custom_nodes/ComfyUI-GeometryPack nodes /tmp/comfy_meta_out_xoeudmbm.pkl [01:32] [ComfyUI] [comfy-env] Scan env PATH for nodes: [01:32] [ComfyUI] [comfy-env] [0] /opt/hostedtoolcache/Python/3.13.13/x64/bin [01:32] [ComfyUI] [comfy-env] [1] /opt/hostedtoolcache/Python/3.13.13/x64 [01:32] [ComfyUI] [comfy-env] [2] /snap/bin [01:32] [ComfyUI] [comfy-env] [3] /home/runner/.local/bin [01:32] [ComfyUI] [comfy-env] [4] /opt/pipx_bin [01:32] [ComfyUI] [comfy-env] [5] /home/runner/.cargo/bin [01:32] [ComfyUI] [comfy-env] [6] /home/runner/.config/composer/vendor/bin [01:32] [ComfyUI] [comfy-env] [7] /usr/local/.ghcup/bin [01:32] [ComfyUI] [comfy-env] [8] /home/runner/.dotnet/tools [01:32] [ComfyUI] [comfy-env] [9] /usr/local/sbin [01:32] [ComfyUI] [comfy-env] [10] /usr/local/bin [01:32] [ComfyUI] [comfy-env] [11] /usr/sbin [01:32] [ComfyUI] [comfy-env] [12] /usr/bin [01:32] [ComfyUI] [comfy-env] [13] /sbin [01:32] [ComfyUI] [comfy-env] [14] /bin [01:32] [ComfyUI] [comfy-env] [15] /usr/games [01:32] [ComfyUI] [comfy-env] [16] /usr/local/games [01:32] [ComfyUI] [comfy-env] [17] /snap/bin [01:37] [ComfyUI] [comfy-env] Metadata scan stderr for nodes: [01:37] [ComfyUI] [comfy-env] [meta-scan] importing nodes from /home/runner/work/comfy-gpu-ci/comfy-gpu-ci/test_workspaces/Sharp-2211/ComfyUI/custom_nodes/ComfyUI-GeometryPack [01:37] [ComfyUI] [comfy-env] ERROR:root:Failed to import comfy_kitchen, Error: No module named 'comfy_kitchen', fp8 and fp4 support will not be available. [01:37] [ComfyUI] [comfy-env] WARNING:root:comfy_kitchen does not support stochastic FP8 rounding, please update comfy_kitchen. [01:37] [ComfyUI] [comfy-env] [meta-scan] import OK [01:37] [ComfyUI] [comfy-env] Scanned nodes: 125 nodes (4.7s) [01:37] [ComfyUI] [comfy-env] Scanned nodes root: 125 nodes (4.7s) [01:37] [ComfyUI] [comfy-env] Imported nodes root: 125 nodes (isolation) [01:37] [ComfyUI] [comfy-env] Registered 125 total nodes [01:37] [ComfyUI] [comfy-env] Version: 0.3.89 [01:37] [ComfyUI] [comfy-env] register_nodes: ComfyUI-GaussianPack [01:37] [ComfyUI] [comfy-env] ComfyUI source dir: /home/runner/work/comfy-gpu-ci/comfy-gpu-ci/test_workspaces/Sharp-2211/ComfyUI [01:37] [ComfyUI] [comfy-env] Found 1 isolation env(s) [01:37] [ComfyUI] [comfy-env] Scanning nodes metadata (isolation root)... [01:37] [ComfyUI] [comfy-env] Metadata scan: /home/runner/.pixi/bin/pixi run --as-is --manifest-path /home/runner/.ce/pixi.toml -e gaussianpack-nodes python /tmp/comfy_meta_vwskgpgj.py /home/runner/work/comfy-gpu-ci/comfy-gpu-ci/test_workspaces/Sharp-2211/ComfyUI/custom_nodes/ComfyUI-GaussianPack nodes /tmp/comfy_meta_out_e6fzb1ar.pkl [01:37] [ComfyUI] [comfy-env] Scan env PATH for nodes: [01:37] [ComfyUI] [comfy-env] [0] /opt/hostedtoolcache/Python/3.13.13/x64/bin [01:37] [ComfyUI] [comfy-env] [1] /opt/hostedtoolcache/Python/3.13.13/x64 [01:37] [ComfyUI] [comfy-env] [2] /snap/bin [01:37] [ComfyUI] [comfy-env] [3] /home/runner/.local/bin [01:37] [ComfyUI] [comfy-env] [4] /opt/pipx_bin [01:37] [ComfyUI] [comfy-env] [5] /home/runner/.cargo/bin [01:37] [ComfyUI] [comfy-env] [6] /home/runner/.config/composer/vendor/bin [01:37] [ComfyUI] [comfy-env] [7] /usr/local/.ghcup/bin [01:37] [ComfyUI] [comfy-env] [8] /home/runner/.dotnet/tools [01:37] [ComfyUI] [comfy-env] [9] /usr/local/sbin [01:37] [ComfyUI] [comfy-env] [10] /usr/local/bin [01:37] [ComfyUI] [comfy-env] [11] /usr/sbin [01:37] [ComfyUI] [comfy-env] [12] /usr/bin [01:37] [ComfyUI] [comfy-env] [13] /sbin [01:37] [ComfyUI] [comfy-env] [14] /bin [01:37] [ComfyUI] [comfy-env] [15] /usr/games [01:37] [ComfyUI] [comfy-env] [16] /usr/local/games [01:37] [ComfyUI] [comfy-env] [17] /snap/bin [01:40] [ComfyUI] [comfy-env] Metadata scan stderr for nodes: [01:40] [ComfyUI] [comfy-env] [meta-scan] importing nodes from /home/runner/work/comfy-gpu-ci/comfy-gpu-ci/test_workspaces/Sharp-2211/ComfyUI/custom_nodes/ComfyUI-GaussianPack [01:40] [ComfyUI] [comfy-env] SPZ route not registered (ModuleNotFoundError: No module named 'comfy_aimdo') [01:40] [ComfyUI] [comfy-env] [meta-scan] import OK [01:40] [ComfyUI] [comfy-env] Scanned nodes: 11 nodes (3.3s) [01:40] [ComfyUI] [comfy-env] Scanned nodes root: 11 nodes (3.3s) [01:40] [ComfyUI] [comfy-env] Imported nodes root: 11 nodes (isolation) [01:40] [ComfyUI] [comfy-env] Registered 11 total nodes [01:40] [ComfyUI] [comfy-env] Version: 0.3.89 [01:40] [ComfyUI] [comfy-env] register_nodes: ComfyUI-PanoPack [01:40] [ComfyUI] [comfy-env] ComfyUI source dir: /home/runner/work/comfy-gpu-ci/comfy-gpu-ci/test_workspaces/Sharp-2211/ComfyUI [01:40] [ComfyUI] [comfy-env] Found 1 isolation env(s) [01:40] [ComfyUI] [comfy-env] Scanning nodes metadata (isolation root)... [01:40] [ComfyUI] [comfy-env] Metadata scan: /home/runner/.pixi/bin/pixi run --as-is --manifest-path /home/runner/.ce/pixi.toml -e panopack-nodes python /tmp/comfy_meta_jn4m46m9.py /home/runner/work/comfy-gpu-ci/comfy-gpu-ci/test_workspaces/Sharp-2211/ComfyUI/custom_nodes/ComfyUI-PanoPack nodes /tmp/comfy_meta_out_dp90tqj2.pkl [01:40] [ComfyUI] [comfy-env] Scan env PATH for nodes: [01:40] [ComfyUI] [comfy-env] [0] /opt/hostedtoolcache/Python/3.13.13/x64/bin [01:40] [ComfyUI] [comfy-env] [1] /opt/hostedtoolcache/Python/3.13.13/x64 [01:40] [ComfyUI] [comfy-env] [2] /snap/bin [01:40] [ComfyUI] [comfy-env] [3] /home/runner/.local/bin [01:40] [ComfyUI] [comfy-env] [4] /opt/pipx_bin [01:40] [ComfyUI] [comfy-env] [5] /home/runner/.cargo/bin [01:40] [ComfyUI] [comfy-env] [6] /home/runner/.config/composer/vendor/bin [01:40] [ComfyUI] [comfy-env] [7] /usr/local/.ghcup/bin [01:40] [ComfyUI] [comfy-env] [8] /home/runner/.dotnet/tools [01:40] [ComfyUI] [comfy-env] [9] /usr/local/sbin [01:40] [ComfyUI] [comfy-env] [10] /usr/local/bin [01:40] [ComfyUI] [comfy-env] [11] /usr/sbin [01:40] [ComfyUI] [comfy-env] [12] /usr/bin [01:40] [ComfyUI] [comfy-env] [13] /sbin [01:40] [ComfyUI] [comfy-env] [14] /bin [01:40] [ComfyUI] [comfy-env] [15] /usr/games [01:40] [ComfyUI] [comfy-env] [16] /usr/local/games [01:40] [ComfyUI] [comfy-env] [17] /snap/bin [01:43] [ComfyUI] [comfy-env] Metadata scan stderr for nodes: [01:43] [ComfyUI] [comfy-env] [meta-scan] importing nodes from /home/runner/work/comfy-gpu-ci/comfy-gpu-ci/test_workspaces/Sharp-2211/ComfyUI/custom_nodes/ComfyUI-PanoPack [01:43] [ComfyUI] [comfy-env] [meta-scan] import OK [01:43] [ComfyUI] [comfy-env] Scanned nodes: 15 nodes (3.2s) [01:43] [ComfyUI] [comfy-env] Scanned nodes root: 15 nodes (3.2s) [01:43] [ComfyUI] [comfy-env] Imported nodes root: 15 nodes (isolation) [01:43] [ComfyUI] [comfy-env] Registered 15 total nodes [01:43] [ComfyUI] [comfy-env] Version: 0.3.89 [01:43] [ComfyUI] [comfy-env] register_nodes: ComfyUI-MoGe2 [01:43] [ComfyUI] [comfy-env] ComfyUI source dir: /home/runner/work/comfy-gpu-ci/comfy-gpu-ci/test_workspaces/Sharp-2211/ComfyUI [01:43] [ComfyUI] [comfy-env] Found 1 isolation env(s) [01:43] [ComfyUI] [comfy-env] Scanning nodes metadata (isolation root)... [01:43] [ComfyUI] [comfy-env] Metadata scan: /home/runner/.pixi/bin/pixi run --as-is --manifest-path /home/runner/.ce/pixi.toml -e moge2-nodes python /tmp/comfy_meta_bysy3d1z.py /home/runner/work/comfy-gpu-ci/comfy-gpu-ci/test_workspaces/Sharp-2211/ComfyUI/custom_nodes/ComfyUI-MoGe2 nodes /tmp/comfy_meta_out_wptpr2pg.pkl [01:43] [ComfyUI] [comfy-env] Scan env PATH for nodes: [01:43] [ComfyUI] [comfy-env] [0] /opt/hostedtoolcache/Python/3.13.13/x64/bin [01:43] [ComfyUI] [comfy-env] [1] /opt/hostedtoolcache/Python/3.13.13/x64 [01:43] [ComfyUI] [comfy-env] [2] /snap/bin [01:43] [ComfyUI] [comfy-env] [3] /home/runner/.local/bin [01:43] [ComfyUI] [comfy-env] [4] /opt/pipx_bin [01:43] [ComfyUI] [comfy-env] [5] /home/runner/.cargo/bin [01:43] [ComfyUI] [comfy-env] [6] /home/runner/.config/composer/vendor/bin [01:43] [ComfyUI] [comfy-env] [7] /usr/local/.ghcup/bin [01:43] [ComfyUI] [comfy-env] [8] /home/runner/.dotnet/tools [01:43] [ComfyUI] [comfy-env] [9] /usr/local/sbin [01:43] [ComfyUI] [comfy-env] [10] /usr/local/bin [01:43] [ComfyUI] [comfy-env] [11] /usr/sbin [01:43] [ComfyUI] [comfy-env] [12] /usr/bin [01:43] [ComfyUI] [comfy-env] [13] /sbin [01:43] [ComfyUI] [comfy-env] [14] /bin [01:43] [ComfyUI] [comfy-env] [15] /usr/games [01:43] [ComfyUI] [comfy-env] [16] /usr/local/games [01:43] [ComfyUI] [comfy-env] [17] /snap/bin [01:46] [ComfyUI] [comfy-env] Metadata scan stderr for nodes: [01:46] [ComfyUI] [comfy-env] [meta-scan] importing nodes from /home/runner/work/comfy-gpu-ci/comfy-gpu-ci/test_workspaces/Sharp-2211/ComfyUI/custom_nodes/ComfyUI-MoGe2 [01:46] [ComfyUI] [comfy-env] ERROR:root:Failed to import comfy_kitchen, Error: No module named 'comfy_kitchen', fp8 and fp4 support will not be available. [01:46] [ComfyUI] [comfy-env] WARNING:root:comfy_kitchen does not support stochastic FP8 rounding, please update comfy_kitchen. [01:46] [ComfyUI] [comfy-env] [meta-scan] import OK [01:46] [ComfyUI] [comfy-env] Scanned nodes: 3 nodes (3.0s) [01:46] [ComfyUI] [comfy-env] Scanned nodes root: 3 nodes (3.0s) [01:46] [ComfyUI] [comfy-env] Imported nodes root: 3 nodes (isolation) [01:46] [ComfyUI] [comfy-env] Registered 3 total nodes [01:46] [ComfyUI] [INFO] [01:46] [ComfyUI] Import times for custom nodes: [01:46] [ComfyUI] [INFO] 0.0 seconds: /home/runner/work/comfy-gpu-ci/comfy-gpu-ci/test_workspaces/Sharp-2211/ComfyUI/custom_nodes/websocket_image_save.py [01:46] [ComfyUI] [INFO] 0.0 seconds: /home/runner/work/comfy-gpu-ci/comfy-gpu-ci/test_workspaces/Sharp-2211/ComfyUI/custom_nodes/ComfyUI-validate-endpoint [01:46] [ComfyUI] [INFO] 3.0 seconds: /home/runner/work/comfy-gpu-ci/comfy-gpu-ci/test_workspaces/Sharp-2211/ComfyUI/custom_nodes/ComfyUI-MoGe2 [01:46] [ComfyUI] [INFO] 3.3 seconds: /home/runner/work/comfy-gpu-ci/comfy-gpu-ci/test_workspaces/Sharp-2211/ComfyUI/custom_nodes/ComfyUI-PanoPack [01:46] [ComfyUI] [INFO] 3.3 seconds: /home/runner/work/comfy-gpu-ci/comfy-gpu-ci/test_workspaces/Sharp-2211/ComfyUI/custom_nodes/ComfyUI-GaussianPack [01:46] [ComfyUI] [INFO] 3.7 seconds: /home/runner/work/comfy-gpu-ci/comfy-gpu-ci/test_workspaces/Sharp-2211/ComfyUI/custom_nodes/ComfyUI-Sharp [01:46] [ComfyUI] [INFO] 4.7 seconds: /home/runner/work/comfy-gpu-ci/comfy-gpu-ci/test_workspaces/Sharp-2211/ComfyUI/custom_nodes/ComfyUI-GeometryPack [01:46] [ComfyUI] [INFO] [01:46] [ComfyUI] [INFO] Context impl SQLiteImpl. [01:46] [ComfyUI] [INFO] Will assume non-transactional DDL. [01:46] [ComfyUI] [INFO] Context impl SQLiteImpl. [01:46] [ComfyUI] [INFO] Will assume non-transactional DDL. [01:46] [ComfyUI] [INFO] Running upgrade -> 0001_assets, Initial assets schema [01:46] [ComfyUI] Revision ID: 0001_assets [01:46] [ComfyUI] Revises: None [01:46] [ComfyUI] Create Date: 2025-12-10 00:00:00 [01:47] [ComfyUI] [INFO] Running upgrade 0001_assets -> 0002_merge_to_asset_references, Merge AssetInfo and AssetCacheState into unified asset_references table. [01:47] [ComfyUI] [INFO] Running upgrade 0002_merge_to_asset_references -> 0003_add_metadata_job_id, Add system_metadata and job_id columns to asset_references. [01:47] [ComfyUI] Change preview_id FK from assets.id to asset_references.id. [01:47] [ComfyUI] [INFO] Database upgraded from None to 0003_add_metadata_job_id [01:47] [ComfyUI] [INFO] Using RAM pressure cache. [01:47] [ComfyUI] [INFO] Starting server [01:47] [ComfyUI] [01:47] [ComfyUI] [INFO] To see the GUI go to: http://127.0.0.1:41888 [01:47] Server responding, waiting for nodes to load... [02:07] Server is ready! [02:07] Checking for import errors in server logs... [02:07] No import errors detected [02:07] Found 942 registered nodes [02:07] [REGISTRATION] PASSED [02:07] [02:07] [4/5] INSTANTIATION [02:07] ---------------------------------------- [02:07] [DEBUG] server=, api= [02:07] Testing node constructors... [02:08] All 17 node(s) instantiated successfully! [02:08] [INSTANTIATION] PASSED [02:08] [02:08] [5/5] EXECUTION [02:08] ---------------------------------------- [02:08] [DEBUG] server=, api= [02:08] CPU runner - will execute 3 workflow(s) [02:08] Running 4 workflow(s) (all with videos)... [02:08] Installing screenshot dependencies (playwright, pillow)... [02:09] Packages installed, downloading chromium browser... [02:19] Screenshot dependencies installed successfully [02:20] Starting headless browser... [02:20] Installing Mesa llvmpipe (apt)... [02:30] Mesa install failed: E: Unable to locate package libegl1-mesa [02:30] No GPU, no Mesa -- using SwiftShader software rendering [02:31] [1/4] SKIPPED (not in cpu list) pano.json [02:31] [ComfyUI] [INFO] Using RAM pressure cache. [02:31] [ComfyUI] [INFO] Using RAM pressure cache. [02:31] Capturing execution frames: sharp_basic.json [02:31] [ComfyUI] [INFO] Using RAM pressure cache. [02:38] Frame 1 saved (frame_000.jpg, t=0.0s) [02:38] Validating workflow... [02:38] [ComfyUI] [INFO] === /validate endpoint called === [02:38] [ComfyUI] [INFO] Received JSON with keys: ['prompt'] [02:38] [ComfyUI] [INFO] Prompt has 4 nodes [02:38] [ComfyUI] [INFO] Node 1: LoadImage [02:38] [ComfyUI] [INFO] Inputs: {"image": "beach.jpg"} [02:38] [ComfyUI] [INFO] Node 2: LoadSharpModel [02:38] [ComfyUI] [INFO] Inputs: {"precision": "auto"} [02:38] [ComfyUI] [INFO] Node 5: SharpPredict [02:38] [ComfyUI] [INFO] Inputs: {"focal_length_mm": 30, "output_prefix": "sharp", "model": ["2", 0], "image": ["1", 0]} [02:38] [ComfyUI] [INFO] Node 6: PreviewGaussianSharp [02:38] [ComfyUI] [INFO] Inputs: {"preview_gaussian": "", "ply_path": ["5", 0], "extrinsics": ["5", 1], "intrinsics": ["5", 2]} [02:38] [ComfyUI] [INFO] Generated prompt_id: e88ec2c1-e869-4f6b-8e85-30988dd99a98 [02:38] Queuing workflow for execution... [02:38] [ComfyUI] [INFO] Calling execution.validate_prompt()... [02:38] [ComfyUI] [INFO] Validation result: valid=True [02:38] [ComfyUI] [INFO] === Validation PASSED === [02:38] [ComfyUI] [INFO] got prompt [02:38] [ComfyUI] [comfy-env] SubprocessWorker: /home/runner/.ce/.pixi/envs/sharp-nodes/bin/python [02:38] [ComfyUI] [comfy-env] Running LoadSharpModel: precision: 'auto' [02:38] [ComfyUI] [comfy-env] env_vars: {'COMFYUI_BASE': '/home/runner/work/comfy-gpu-ci/comfy-gpu-ci/test_workspaces/Sharp-2211/ComfyUI'} [02:38] [ComfyUI] [SubprocessWorker] call_method: nodes.load_model.LoadSharpModel.EXECUTE_NORMALIZED [02:38] [ComfyUI] [ComfyUI-Sharp] python: /home/runner/.ce/.pixi/envs/sharp-nodes/bin/python [02:38] [ComfyUI] [SubprocessWorker] acquired lock, ensuring started... [02:38] [ComfyUI] [ComfyUI-Sharp] sys_path sent to worker: ['/home/runner/work/comfy-gpu-ci/comfy-gpu-ci/test_workspaces/Sharp-2211/ComfyUI', '/home/runner/work/comfy-gpu-ci/comfy-gpu-ci/test_workspaces/Sharp-2211/ComfyUI/custom_nodes/ComfyUI-Sharp', '/home/runner/.ce/.pixi/envs/sharp-nodes/lib/python3.11/site-packages', '/home/runner/work/comfy-gpu-ci/comfy-gpu-ci/test_workspaces/Sharp-2211/ComfyUI/custom_nodes/ComfyUI-Sharp'] [02:38] [ComfyUI] [SubprocessWorker] is_pixi=True, python=/home/runner/.ce/.pixi/envs/sharp-nodes/bin/python [02:38] [ComfyUI] [SubprocessWorker] launching cmd=['/home/runner/.pixi/bin/pixi', 'run', '--as-is', '--manifest-path', '/home/runner/.ce/pixi.toml', '-e', 'sharp-nodes', 'python', '/tmp/comfyui_pvenv_1p20y9l5/persistent_worker.py', 'abstract://comfy_worker_249f956f50b9']... [02:38] [ComfyUI] [SubprocessWorker] socket_addr=abstract://comfy_worker_249f956f50b9 (abstract, no filesystem path) [02:40] [ComfyUI] [worker:ComfyUI-Sharp] ERROR: Failed to import comfy_kitchen, Error: No module named 'comfy_kitchen', fp8 and fp4 support will not be available. [02:40] [ComfyUI] [worker:ComfyUI-Sharp] WARNING: comfy_kitchen does not support stochastic FP8 rounding, please update comfy_kitchen. [02:40] [ComfyUI] [SubprocessWorker] worker started/confirmed [02:40] [ComfyUI] [SubprocessWorker] serializing kwargs to shm... [02:40] [ComfyUI] [SubprocessWorker] created 0 shm blocks [02:40] [ComfyUI] [SubprocessWorker] sending request via socket... [02:40] [ComfyUI] [SubprocessWorker] call_id=1 sending call_method [02:40] [ComfyUI] [worker:ComfyUI-Sharp] [LoadSharpModel] precision='auto' -> dtype=fp32 (device=cpu) [02:40] [ComfyUI] [worker:ComfyUI-Sharp] [LoadSharpModel] checkpoint not found — downloading from HuggingFace repo 'apple/Sharp' file 'sharp_2572gikvuh.pt' -> /home/runner/work/comfy-gpu-ci/comfy-gpu-ci/test_workspaces/Sharp-2211/ComfyUI/models/sharp [02:40] [ComfyUI] [02:40] Frame 2 saved (frame_001.jpg, t=2.3s) [02:40] [capture-periodic] freeze=4ms shot=138ms unfreeze=3ms saved=True [02:42] [ComfyUI] sharp_2572gikvuh.pt: 0%| | 0.00/2.81G [00:00 dtype=fp32 [02:54] [ComfyUI] [SubprocessWorker] got response: ok [02:54] [ComfyUI] [comfy-env] LoadSharpModel done (15.46s): result: NodeOutput [02:54] [ComfyUI] [comfy-env] Running SharpPredict: focal_length_mm: 30.0, output_prefix: 'sharp', model: dict, image: torch.float32 [1,1024,1536,3] cpu [02:54] [ComfyUI] [SubprocessWorker] call_method: nodes.predict.SharpPredict.EXECUTE_NORMALIZED [02:54] [ComfyUI] [SubprocessWorker] acquired lock, ensuring started... [02:54] [ComfyUI] [ComfyUI-Sharp] Health check: ping (timeout=5.0s)... [02:54] [ComfyUI] [ComfyUI-Sharp] Health check: ok [02:54] [ComfyUI] [SubprocessWorker] worker started/confirmed [02:54] [ComfyUI] [comfy-env] PRE-SERIALIZE 'image' shape: torch.Size([1, 1024, 1536, 3]) [02:54] [ComfyUI] [SubprocessWorker] serializing kwargs to shm... [02:54] [ComfyUI] [SubprocessWorker] created 0 shm blocks [02:54] [ComfyUI] [SubprocessWorker] sending request via socket... [02:54] [ComfyUI] [SubprocessWorker] call_id=2 sending call_method [02:54] [ComfyUI] [worker:ComfyUI-Sharp] [comfy-env] _from_shm got dict with keys: ['__type__', 'strategy', 'parent_pid', 'fd', 'storage_size'] [02:54] [ComfyUI] [worker:ComfyUI-Sharp] [comfy-env] DESERIALIZE TensorRef: tensor_size=[1, 1024, 1536, 3] [02:54] [ComfyUI] [worker:ComfyUI-Sharp] [comfy-env] DESERIALIZED tensor shape: torch.Size([1, 1024, 1536, 3]) [02:55] Frame 7 saved (frame_006.jpg, t=16.8s) [02:55] [capture-periodic] freeze=3ms shot=109ms unfreeze=4ms saved=True [02:58] [capture-loop] iter=150 t=20.3s state={'complete': False, 'error': None, 'executedCount': 0, 'wsState': 1} eval_ms=3 ram=2.3/15.6GB (15%) swap=0.0/3.0GB (0%) cpu=38% browser_rss=0.90GB [03:00] [ComfyUI] [worker:ComfyUI-Sharp] [LoadSharpModel] loading checkpoint from /home/runner/work/comfy-gpu-ci/comfy-gpu-ci/test_workspaces/Sharp-2211/ComfyUI/models/sharp/sharp_2572gikvuh.pt (dtype=fp32) [03:02] [ComfyUI] [worker:ComfyUI-Sharp] [LoadSharpModel] initializing model on meta device... [03:02] [ComfyUI] [worker:ComfyUI-Sharp] [LoadSharpModel] model ready (torch.float32) [03:02] [ComfyUI] [SubprocessWorker] callback 'request_vram_budget' from call_id=2 [03:02] [ComfyUI] [comfy-env] VRAM request: 2.81GB, free before eviction: 11.54GB [03:02] [ComfyUI] [comfy-env] VRAM after eviction: 11.54GB [03:04] [capture-loop] iter=200 t=26.0s state={'complete': False, 'error': None, 'executedCount': 0, 'wsState': 1} eval_ms=3 ram=5.1/15.6GB (33%) swap=0.0/3.0GB (0%) cpu=46% browser_rss=0.83GB [03:09] [capture-loop] iter=250 t=31.5s state={'complete': False, 'error': None, 'executedCount': 0, 'wsState': 1} eval_ms=3 ram=5.1/15.6GB (33%) swap=0.0/3.0GB (0%) cpu=45% browser_rss=0.83GB [03:15] [capture-loop] iter=300 t=37.2s state={'complete': False, 'error': None, 'executedCount': 0, 'wsState': 1} eval_ms=3 ram=5.1/15.6GB (33%) swap=0.0/3.0GB (0%) cpu=47% browser_rss=0.83GB [03:21] [capture-loop] iter=350 t=42.9s state={'complete': False, 'error': None, 'executedCount': 0, 'wsState': 1} eval_ms=3 ram=5.1/15.6GB (33%) swap=0.0/3.0GB (0%) cpu=44% browser_rss=0.83GB [03:26] [capture-loop] iter=400 t=48.4s state={'complete': False, 'error': None, 'executedCount': 0, 'wsState': 1} eval_ms=2 ram=5.1/15.6GB (33%) swap=0.0/3.0GB (0%) cpu=45% browser_rss=0.84GB [03:32] [capture-loop] iter=450 t=54.1s state={'complete': False, 'error': None, 'executedCount': 0, 'wsState': 1} eval_ms=3 ram=5.2/15.6GB (33%) swap=0.0/3.0GB (0%) cpu=46% browser_rss=0.83GB [03:37] [capture-loop] iter=500 t=59.6s state={'complete': False, 'error': None, 'executedCount': 0, 'wsState': 1} eval_ms=3 ram=5.2/15.6GB (33%) swap=0.0/3.0GB (0%) cpu=44% browser_rss=0.83GB [03:38] [ComfyUI] [worker:ComfyUI-Sharp] [03:38] [ComfyUI] === WATCHDOG TICK 1 === [03:38] [ComfyUI] [worker:ComfyUI-Sharp] Thread 0x00007f29eaec06c0 (most recent call first): [03:38] [ComfyUI] File "/home/runner/.ce/.pixi/envs/sharp-nodes/lib/python3.11/threading.py", line 331 in wait [03:38] [ComfyUI] File "/home/runner/.ce/.pixi/envs/sharp-nodes/lib/python3.11/threading.py", line 629 in wait [03:38] [ComfyUI] File "/home/runner/.ce/.pixi/envs/sharp-nodes/lib/python3.11/site-packages/tqdm/_monitor.py", line 69 in run [03:38] [ComfyUI] File "/home/runner/.ce/.pixi/envs/sharp-nodes/lib/python3.11/threading.py", line 1045 in _bootstrap_inner [03:38] [ComfyUI] File "/home/runner/.ce/.pixi/envs/sharp-nodes/lib/python3.11/threading.py", line 1002 in _bootstrap [03:38] [ComfyUI] [03:38] [ComfyUI] Current thread 0x00007f29ebec16c0 (most recent call first): [03:38] [ComfyUI] File "/tmp/comfyui_pvenv_1p20y9l5/persistent_worker.py", line 52 in _watchdog [03:38] [ComfyUI] File "/home/runner/.ce/.pixi/envs/sharp-nodes/lib/python3.11/threading.py", line 982 in run [03:38] [ComfyUI] File "/home/runner/.ce/.pixi/envs/sharp-nodes/lib/python3.11/threading.py", line 1045 in _bootstrap_inner [03:38] [ComfyUI] File "/home/runner/.ce/.pixi/envs/sharp-nodes/lib/python3.11/threading.py", line 1002 in _bootstrap [03:38] [ComfyUI] [03:38] [ComfyUI] Thread 0x00007f29ec9e8740 (most recent call first): [03:38] [ComfyUI] File "/home/runner/.ce/.pixi/envs/sharp-nodes/lib/python3.11/site-packages/torch/nn/modules/linear.py", line 134 in forward [03:38] [ComfyUI] File "/home/runner/work/comfy-gpu-ci/comfy-gpu-ci/test_workspaces/Sharp-2211/ComfyUI/comfy/ops.py", line 503 in forward [03:38] [ComfyUI] File "/home/runner/.ce/.pixi/envs/sharp-nodes/lib/python3.11/site-packages/torch/nn/modules/module.py", line 1787 in _call_impl [03:38] [ComfyUI] File "/home/runner/.ce/.pixi/envs/sharp-nodes/lib/python3.11/site-packages/torch/nn/modules/module.py", line 1776 in _wrapped_call_impl [03:38] [ComfyUI] File "/home/runner/work/comfy-gpu-ci/comfy-gpu-ci/test_workspaces/Sharp-2211/ComfyUI/custom_nodes/ComfyUI-Sharp/nodes/sharp/model.py", line 274 in forward [03:38] [ComfyUI] File "/home/runner/.ce/.pixi/envs/sharp-nodes/lib/python3.11/site-packages/torch/nn/modules/module.py", line 1787 in _call_impl [03:38] [ComfyUI] File "/home/runner/.ce/.pixi/envs/sharp-nodes/lib/python3.11/site-packages/torch/nn/modules/module.py", line 1776 in _wrapped_call_impl [03:38] [ComfyUI] File "/home/runner/work/comfy-gpu-ci/comfy-gpu-ci/test_workspaces/Sharp-2211/ComfyUI/custom_nodes/ComfyUI-Sharp/nodes/sharp/model.py", line 310 in forward [03:38] [ComfyUI] File "/home/runner/.ce/.pixi/envs/sharp-nodes/lib/python3.11/site-packages/torch/nn/modules/module.py", line 1787 in _call_impl [03:38] [ComfyUI] File "/home/runner/.ce/.pixi/envs/sharp-nodes/lib/python3.11/site-packages/torch/nn/modules/module.py", line 1776 in _wrapped_call_impl [03:38] [ComfyUI] File "/home/runner/work/comfy-gpu-ci/comfy-gpu-ci/test_workspaces/Sharp-2211/ComfyUI/custom_nodes/ComfyUI-Sharp/nodes/sharp/model.py", line 412 in forward [03:38] [ComfyUI] File "/home/runner/.ce/.pixi/envs/sharp-nodes/lib/python3.11/site-packages/torch/nn/modules/module.py", line 1787 in _call_impl [03:38] [ComfyUI] File "/home/runner/.ce/.pixi/envs/sharp-nodes/lib/python3.11/site-packages/torch/nn/modules/module.py", line 1776 in _wrapped_call_impl [03:38] [ComfyUI] File "/home/runner/work/comfy-gpu-ci/comfy-gpu-ci/test_workspaces/Sharp-2211/ComfyUI/custom_nodes/ComfyUI-Sharp/nodes/sharp/model.py", line 685 in forward [03:38] [ComfyUI] File "/home/runner/.ce/.pixi/envs/sharp-nodes/lib/python3.11/site-packages/torch/nn/modules/module.py", line 1787 in _call_impl [03:38] [ComfyUI] File "/home/runner/.ce/.pixi/envs/sharp-nodes/lib/python3.11/site-packages/torch/nn/modules/module.py", line 1776 in _wrapped_call_impl [03:38] [ComfyUI] File "/home/runner/work/comfy-gpu-ci/comfy-gpu-ci/test_workspaces/Sharp-2211/ComfyUI/custom_nodes/ComfyUI-Sharp/nodes/sharp/model.py", line 1109 in forward [03:38] [ComfyUI] File "/home/runner/.ce/.pixi/envs/sharp-nodes/lib/python3.11/site-packages/torch/nn/modules/module.py", line 1787 in _call_impl [03:38] [ComfyUI] File "/home/runner/.ce/.pixi/envs/sharp-nodes/lib/python3.11/site-packages/torch/nn/modules/module.py", line 1776 in _wrapped_call_impl [03:38] [ComfyUI] File "/home/runner/work/comfy-gpu-ci/comfy-gpu-ci/test_workspaces/Sharp-2211/ComfyUI/custom_nodes/ComfyUI-Sharp/nodes/sharp/model.py", line 2006 in encode [03:38] [ComfyUI] File "/home/runner/work/comfy-gpu-ci/comfy-gpu-ci/test_workspaces/Sharp-2211/ComfyUI/custom_nodes/ComfyUI-Sharp/nodes/predict.py", line 348 in _predict_image_cached [03:38] [ComfyUI] File "/home/runner/work/comfy-gpu-ci/comfy-gpu-ci/test_workspaces/Sharp-2211/ComfyUI/custom_nodes/ComfyUI-Sharp/nodes/predict.py", line 239 in execute [03:38] [ComfyUI] File "/home/runner/.ce/.pixi/envs/sharp-nodes/lib/python3.11/site-packages/torch/utils/_contextlib.py", line 124 in decorate_context [03:38] [ComfyUI] File "/home/runner/work/comfy-gpu-ci/comfy-gpu-ci/test_workspaces/Sharp-2211/ComfyUI/comfy_api/latest/_io.py", line 1892 in EXECUTE_NORMALIZED [03:38] [ComfyUI] File "/tmp/comfyui_pvenv_1p20y9l5/persistent_worker.py", line 1762 in main [03:38] [ComfyUI] File "/tmp/comfyui_pvenv_1p20y9l5/persistent_worker.py", line 1807 in [03:38] [ComfyUI] [03:38] [ComfyUI] [worker:ComfyUI-Sharp] === END === [03:38] [ComfyUI] [03:43] [capture-loop] iter=550 t=65.3s state={'complete': False, 'error': None, 'executedCount': 0, 'wsState': 1} eval_ms=3 ram=5.3/15.6GB (34%) swap=0.0/3.0GB (0%) cpu=44% browser_rss=0.82GB [03:49] [capture-loop] iter=600 t=70.9s state={'complete': False, 'error': None, 'executedCount': 0, 'wsState': 1} eval_ms=2 ram=5.2/15.6GB (34%) swap=0.0/3.0GB (0%) cpu=44% browser_rss=0.82GB [03:54] [capture-loop] iter=650 t=76.5s state={'complete': False, 'error': None, 'executedCount': 0, 'wsState': 1} eval_ms=2 ram=5.2/15.6GB (33%) swap=0.0/3.0GB (0%) cpu=44% browser_rss=0.82GB [04:00] [capture-loop] iter=700 t=82.2s state={'complete': False, 'error': None, 'executedCount': 0, 'wsState': 1} eval_ms=3 ram=5.2/15.6GB (34%) swap=0.0/3.0GB (0%) cpu=46% browser_rss=0.82GB [04:06] [capture-loop] iter=750 t=87.8s state={'complete': False, 'error': None, 'executedCount': 0, 'wsState': 1} eval_ms=3 ram=5.4/15.6GB (34%) swap=0.0/3.0GB (0%) cpu=46% browser_rss=0.83GB [04:11] [capture-loop] iter=800 t=93.3s state={'complete': False, 'error': None, 'executedCount': 0, 'wsState': 1} eval_ms=4 ram=5.3/15.6GB (34%) swap=0.0/3.0GB (0%) cpu=44% browser_rss=0.83GB [04:17] [capture-loop] iter=850 t=98.9s state={'complete': False, 'error': None, 'executedCount': 0, 'wsState': 1} eval_ms=3 ram=5.3/15.6GB (34%) swap=0.0/3.0GB (0%) cpu=43% browser_rss=0.83GB [04:22] [capture-loop] iter=900 t=104.4s state={'complete': False, 'error': None, 'executedCount': 0, 'wsState': 1} eval_ms=3 ram=5.3/15.6GB (34%) swap=0.0/3.0GB (0%) cpu=43% browser_rss=0.83GB [04:28] [capture-loop] iter=950 t=110.1s state={'complete': False, 'error': None, 'executedCount': 0, 'wsState': 1} eval_ms=4 ram=5.4/15.6GB (34%) swap=0.0/3.0GB (0%) cpu=44% browser_rss=0.83GB [04:34] [capture-loop] iter=1000 t=115.7s state={'complete': False, 'error': None, 'executedCount': 0, 'wsState': 1} eval_ms=5 ram=5.3/15.6GB (34%) swap=0.0/3.0GB (0%) cpu=46% browser_rss=0.83GB [04:38] [ComfyUI] [worker:ComfyUI-Sharp] [04:38] [ComfyUI] === WATCHDOG TICK 2 === [04:38] [ComfyUI] [worker:ComfyUI-Sharp] Thread 0x00007f29eaec06c0 (most recent call first): [04:38] [ComfyUI] File "/home/runner/.ce/.pixi/envs/sharp-nodes/lib/python3.11/threading.py", line 331 in wait [04:38] [ComfyUI] File "/home/runner/.ce/.pixi/envs/sharp-nodes/lib/python3.11/threading.py", line 629 in wait [04:38] [ComfyUI] File "/home/runner/.ce/.pixi/envs/sharp-nodes/lib/python3.11/site-packages/tqdm/_monitor.py", line 69 in run [04:38] [ComfyUI] File "/home/runner/.ce/.pixi/envs/sharp-nodes/lib/python3.11/threading.py", line 1045 in _bootstrap_inner [04:38] [ComfyUI] File "/home/runner/.ce/.pixi/envs/sharp-nodes/lib/python3.11/threading.py", line 1002 in _bootstrap [04:38] [ComfyUI] [04:38] [ComfyUI] Current thread 0x00007f29ebec16c0 (most recent call first): [04:38] [ComfyUI] File "/tmp/comfyui_pvenv_1p20y9l5/persistent_worker.py", line 52 in _watchdog [04:38] [ComfyUI] File "/home/runner/.ce/.pixi/envs/sharp-nodes/lib/python3.11/threading.py", line 982 in run [04:38] [ComfyUI] File "/home/runner/.ce/.pixi/envs/sharp-nodes/lib/python3.11/threading.py", line 1045 in _bootstrap_inner [04:38] [ComfyUI] File "/home/runner/.ce/.pixi/envs/sharp-nodes/lib/python3.11/threading.py", line 1002 in _bootstrap [04:38] [ComfyUI] [04:38] [ComfyUI] Thread 0x00007f29ec9e8740 (most recent call first): [04:38] [ComfyUI] File "/home/runner/.ce/.pixi/envs/sharp-nodes/lib/python3.11/site-packages/torch/nn/modules/linear.py", line 134 in forward [04:38] [ComfyUI] File "/home/runner/work/comfy-gpu-ci/comfy-gpu-ci/test_workspaces/Sharp-2211/ComfyUI/comfy/ops.py", line 503 in forward [04:38] [ComfyUI] File "/home/runner/.ce/.pixi/envs/sharp-nodes/lib/python3.11/site-packages/torch/nn/modules/module.py", line 1787 in _call_impl [04:38] [ComfyUI] File "/home/runner/.ce/.pixi/envs/sharp-nodes/lib/python3.11/site-packages/torch/nn/modules/module.py", line 1776 in _wrapped_call_impl [04:38] [ComfyUI] File "/home/runner/work/comfy-gpu-ci/comfy-gpu-ci/test_workspaces/Sharp-2211/ComfyUI/custom_nodes/ComfyUI-Sharp/nodes/sharp/model.py", line 274 in forward [04:38] [ComfyUI] File "/home/runner/.ce/.pixi/envs/sharp-nodes/lib/python3.11/site-packages/torch/nn/modules/module.py", line 1787 in _call_impl [04:38] [ComfyUI] File "/home/runner/.ce/.pixi/envs/sharp-nodes/lib/python3.11/site-packages/torch/nn/modules/module.py", line 1776 in _wrapped_call_impl [04:38] [ComfyUI] File "/home/runner/work/comfy-gpu-ci/comfy-gpu-ci/test_workspaces/Sharp-2211/ComfyUI/custom_nodes/ComfyUI-Sharp/nodes/sharp/model.py", line 310 in forward [04:38] [ComfyUI] File "/home/runner/.ce/.pixi/envs/sharp-nodes/lib/python3.11/site-packages/torch/nn/modules/module.py", line 1787 in _call_impl [04:38] [ComfyUI] File "/home/runner/.ce/.pixi/envs/sharp-nodes/lib/python3.11/site-packages/torch/nn/modules/module.py", line 1776 in _wrapped_call_impl [04:38] [ComfyUI] File "/home/runner/work/comfy-gpu-ci/comfy-gpu-ci/test_workspaces/Sharp-2211/ComfyUI/custom_nodes/ComfyUI-Sharp/nodes/sharp/model.py", line 412 in forward [04:38] [ComfyUI] File "/home/runner/.ce/.pixi/envs/sharp-nodes/lib/python3.11/site-packages/torch/nn/modules/module.py", line 1787 in _call_impl [04:38] [ComfyUI] File "/home/runner/.ce/.pixi/envs/sharp-nodes/lib/python3.11/site-packages/torch/nn/modules/module.py", line 1776 in _wrapped_call_impl [04:38] [ComfyUI] File "/home/runner/work/comfy-gpu-ci/comfy-gpu-ci/test_workspaces/Sharp-2211/ComfyUI/custom_nodes/ComfyUI-Sharp/nodes/sharp/model.py", line 685 in forward [04:38] [ComfyUI] File "/home/runner/.ce/.pixi/envs/sharp-nodes/lib/python3.11/site-packages/torch/nn/modules/module.py", line 1787 in _call_impl [04:38] [ComfyUI] File "/home/runner/.ce/.pixi/envs/sharp-nodes/lib/python3.11/site-packages/torch/nn/modules/module.py", line 1776 in _wrapped_call_impl [04:38] [ComfyUI] File "/home/runner/work/comfy-gpu-ci/comfy-gpu-ci/test_workspaces/Sharp-2211/ComfyUI/custom_nodes/ComfyUI-Sharp/nodes/sharp/model.py", line 1109 in forward [04:38] [ComfyUI] File "/home/runner/.ce/.pixi/envs/sharp-nodes/lib/python3.11/site-packages/torch/nn/modules/module.py", line 1787 in _call_impl [04:38] [ComfyUI] File "/home/runner/.ce/.pixi/envs/sharp-nodes/lib/python3.11/site-packages/torch/nn/modules/module.py", line 1776 in _wrapped_call_impl [04:38] [ComfyUI] File "/home/runner/work/comfy-gpu-ci/comfy-gpu-ci/test_workspaces/Sharp-2211/ComfyUI/custom_nodes/ComfyUI-Sharp/nodes/sharp/model.py", line 2006 in encode [04:38] [ComfyUI] File "/home/runner/work/comfy-gpu-ci/comfy-gpu-ci/test_workspaces/Sharp-2211/ComfyUI/custom_nodes/ComfyUI-Sharp/nodes/predict.py", line 348 in _predict_image_cached [04:38] [ComfyUI] File "/home/runner/work/comfy-gpu-ci/comfy-gpu-ci/test_workspaces/Sharp-2211/ComfyUI/custom_nodes/ComfyUI-Sharp/nodes/predict.py", line 239 in execute [04:38] [ComfyUI] File "/home/runner/.ce/.pixi/envs/sharp-nodes/lib/python3.11/site-packages/torch/utils/_contextlib.py", line 124 in decorate_context [04:38] [ComfyUI] File "/home/runner/work/comfy-gpu-ci/comfy-gpu-ci/test_workspaces/Sharp-2211/ComfyUI/comfy_api/latest/_io.py", line 1892 in EXECUTE_NORMALIZED [04:38] [ComfyUI] File "/tmp/comfyui_pvenv_1p20y9l5/persistent_worker.py", line 1762 in main [04:38] [ComfyUI] File "/tmp/comfyui_pvenv_1p20y9l5/persistent_worker.py", line 1807 in [04:38] [ComfyUI] [04:38] [ComfyUI] [worker:ComfyUI-Sharp] === END === [04:38] [ComfyUI] [04:39] [capture-loop] iter=1050 t=121.3s state={'complete': False, 'error': None, 'executedCount': 0, 'wsState': 1} eval_ms=2 ram=5.3/15.6GB (34%) swap=0.0/3.0GB (0%) cpu=45% browser_rss=0.83GB [04:45] [capture-loop] iter=1100 t=126.9s state={'complete': False, 'error': None, 'executedCount': 0, 'wsState': 1} eval_ms=2 ram=5.3/15.6GB (34%) swap=0.0/3.0GB (0%) cpu=46% browser_rss=0.84GB [04:50] [capture-loop] iter=1150 t=132.4s state={'complete': False, 'error': None, 'executedCount': 0, 'wsState': 1} eval_ms=3 ram=5.3/15.6GB (34%) swap=0.0/3.0GB (0%) cpu=44% browser_rss=0.84GB [04:56] [capture-loop] iter=1200 t=138.0s state={'complete': False, 'error': None, 'executedCount': 0, 'wsState': 1} eval_ms=3 ram=5.4/15.6GB (34%) swap=0.0/3.0GB (0%) cpu=44% browser_rss=0.84GB [05:02] [capture-loop] iter=1250 t=143.7s state={'complete': False, 'error': None, 'executedCount': 0, 'wsState': 1} eval_ms=2 ram=5.4/15.6GB (34%) swap=0.0/3.0GB (0%) cpu=46% browser_rss=0.84GB [05:07] [capture-loop] iter=1300 t=149.3s state={'complete': False, 'error': None, 'executedCount': 0, 'wsState': 1} eval_ms=3 ram=5.3/15.6GB (34%) swap=0.0/3.0GB (0%) cpu=45% browser_rss=0.84GB [05:13] [capture-loop] iter=1350 t=154.9s state={'complete': False, 'error': None, 'executedCount': 0, 'wsState': 1} eval_ms=3 ram=5.4/15.6GB (34%) swap=0.0/3.0GB (0%) cpu=44% browser_rss=0.84GB [05:18] [capture-loop] iter=1400 t=160.6s state={'complete': False, 'error': None, 'executedCount': 0, 'wsState': 1} eval_ms=3 ram=5.5/15.6GB (35%) swap=0.0/3.0GB (0%) cpu=45% browser_rss=0.84GB [05:24] [capture-loop] iter=1450 t=166.1s state={'complete': False, 'error': None, 'executedCount': 0, 'wsState': 1} eval_ms=3 ram=5.4/15.6GB (34%) swap=0.0/3.0GB (0%) cpu=44% browser_rss=0.84GB [05:30] [capture-loop] iter=1500 t=171.7s state={'complete': False, 'error': None, 'executedCount': 0, 'wsState': 1} eval_ms=3 ram=5.4/15.6GB (34%) swap=0.0/3.0GB (0%) cpu=45% browser_rss=0.84GB [05:35] [capture-loop] iter=1550 t=177.4s state={'complete': False, 'error': None, 'executedCount': 0, 'wsState': 1} eval_ms=3 ram=5.4/15.6GB (35%) swap=0.0/3.0GB (0%) cpu=44% browser_rss=0.84GB [05:38] [ComfyUI] [worker:ComfyUI-Sharp] [05:38] [ComfyUI] === WATCHDOG TICK 3 === [05:38] [ComfyUI] [worker:ComfyUI-Sharp] Thread 0x00007f29eaec06c0 (most recent call first): [05:38] [ComfyUI] File "/home/runner/.ce/.pixi/envs/sharp-nodes/lib/python3.11/threading.py", line 331 in wait [05:38] [ComfyUI] File "/home/runner/.ce/.pixi/envs/sharp-nodes/lib/python3.11/threading.py", line 629 in wait [05:38] [ComfyUI] File "/home/runner/.ce/.pixi/envs/sharp-nodes/lib/python3.11/site-packages/tqdm/_monitor.py", line 69 in run [05:38] [ComfyUI] File "/home/runner/.ce/.pixi/envs/sharp-nodes/lib/python3.11/threading.py", line 1045 in _bootstrap_inner [05:38] [ComfyUI] File "/home/runner/.ce/.pixi/envs/sharp-nodes/lib/python3.11/threading.py", line 1002 in _bootstrap [05:38] [ComfyUI] [05:38] [ComfyUI] Current thread 0x00007f29ebec16c0 (most recent call first): [05:38] [ComfyUI] File "/tmp/comfyui_pvenv_1p20y9l5/persistent_worker.py", line 52 in _watchdog [05:38] [ComfyUI] File "/home/runner/.ce/.pixi/envs/sharp-nodes/lib/python3.11/threading.py", line 982 in run [05:38] [ComfyUI] File "/home/runner/.ce/.pixi/envs/sharp-nodes/lib/python3.11/threading.py", line 1045 in _bootstrap_inner [05:38] [ComfyUI] File "/home/runner/.ce/.pixi/envs/sharp-nodes/lib/python3.11/threading.py", line 1002 in _bootstrap [05:38] [ComfyUI] [05:38] [ComfyUI] Thread 0x00007f29ec9e8740 (most recent call first): [05:38] [ComfyUI] File "/home/runner/.ce/.pixi/envs/sharp-nodes/lib/python3.11/site-packages/torch/nn/modules/linear.py", line 134 in forward [05:38] [ComfyUI] File "/home/runner/work/comfy-gpu-ci/comfy-gpu-ci/test_workspaces/Sharp-2211/ComfyUI/comfy/ops.py", line 503 in forward [05:38] [ComfyUI] File "/home/runner/.ce/.pixi/envs/sharp-nodes/lib/python3.11/site-packages/torch/nn/modules/module.py", line 1787 in _call_impl [05:38] [ComfyUI] File "/home/runner/.ce/.pixi/envs/sharp-nodes/lib/python3.11/site-packages/torch/nn/modules/module.py", line 1776 in _wrapped_call_impl [05:38] [ComfyUI] File "/home/runner/work/comfy-gpu-ci/comfy-gpu-ci/test_workspaces/Sharp-2211/ComfyUI/custom_nodes/ComfyUI-Sharp/nodes/sharp/model.py", line 268 in forward [05:38] [ComfyUI] File "/home/runner/.ce/.pixi/envs/sharp-nodes/lib/python3.11/site-packages/torch/nn/modules/module.py", line 1787 in _call_impl [05:38] [ComfyUI] File "/home/runner/.ce/.pixi/envs/sharp-nodes/lib/python3.11/site-packages/torch/nn/modules/module.py", line 1776 in _wrapped_call_impl [05:38] [ComfyUI] File "/home/runner/work/comfy-gpu-ci/comfy-gpu-ci/test_workspaces/Sharp-2211/ComfyUI/custom_nodes/ComfyUI-Sharp/nodes/sharp/model.py", line 310 in forward [05:38] [ComfyUI] File "/home/runner/.ce/.pixi/envs/sharp-nodes/lib/python3.11/site-packages/torch/nn/modules/module.py", line 1787 in _call_impl [05:38] [ComfyUI] File "/home/runner/.ce/.pixi/envs/sharp-nodes/lib/python3.11/site-packages/torch/nn/modules/module.py", line 1776 in _wrapped_call_impl [05:38] [ComfyUI] File "/home/runner/work/comfy-gpu-ci/comfy-gpu-ci/test_workspaces/Sharp-2211/ComfyUI/custom_nodes/ComfyUI-Sharp/nodes/sharp/model.py", line 412 in forward [05:38] [ComfyUI] File "/home/runner/.ce/.pixi/envs/sharp-nodes/lib/python3.11/site-packages/torch/nn/modules/module.py", line 1787 in _call_impl [05:38] [ComfyUI] File "/home/runner/.ce/.pixi/envs/sharp-nodes/lib/python3.11/site-packages/torch/nn/modules/module.py", line 1776 in _wrapped_call_impl [05:38] [ComfyUI] File "/home/runner/work/comfy-gpu-ci/comfy-gpu-ci/test_workspaces/Sharp-2211/ComfyUI/custom_nodes/ComfyUI-Sharp/nodes/sharp/model.py", line 685 in forward [05:38] [ComfyUI] File "/home/runner/.ce/.pixi/envs/sharp-nodes/lib/python3.11/site-packages/torch/nn/modules/module.py", line 1787 in _call_impl [05:38] [ComfyUI] File "/home/runner/.ce/.pixi/envs/sharp-nodes/lib/python3.11/site-packages/torch/nn/modules/module.py", line 1776 in _wrapped_call_impl [05:38] [ComfyUI] File "/home/runner/work/comfy-gpu-ci/comfy-gpu-ci/test_workspaces/Sharp-2211/ComfyUI/custom_nodes/ComfyUI-Sharp/nodes/sharp/model.py", line 1109 in forward [05:38] [ComfyUI] File "/home/runner/.ce/.pixi/envs/sharp-nodes/lib/python3.11/site-packages/torch/nn/modules/module.py", line 1787 in _call_impl [05:38] [ComfyUI] File "/home/runner/.ce/.pixi/envs/sharp-nodes/lib/python3.11/site-packages/torch/nn/modules/module.py", line 1776 in _wrapped_call_impl [05:38] [ComfyUI] File "/home/runner/work/comfy-gpu-ci/comfy-gpu-ci/test_workspaces/Sharp-2211/ComfyUI/custom_nodes/ComfyUI-Sharp/nodes/sharp/model.py", line 2006 in encode [05:38] [ComfyUI] File "/home/runner/work/comfy-gpu-ci/comfy-gpu-ci/test_workspaces/Sharp-2211/ComfyUI/custom_nodes/ComfyUI-Sharp/nodes/predict.py", line 348 in _predict_image_cached [05:38] [ComfyUI] File "/home/runner/work/comfy-gpu-ci/comfy-gpu-ci/test_workspaces/Sharp-2211/ComfyUI/custom_nodes/ComfyUI-Sharp/nodes/predict.py", line 239 in execute [05:38] [ComfyUI] File "/home/runner/.ce/.pixi/envs/sharp-nodes/lib/python3.11/site-packages/torch/utils/_contextlib.py", line 124 in decorate_context [05:38] [ComfyUI] File "/home/runner/work/comfy-gpu-ci/comfy-gpu-ci/test_workspaces/Sharp-2211/ComfyUI/comfy_api/latest/_io.py", line 1892 in EXECUTE_NORMALIZED [05:38] [ComfyUI] File "/tmp/comfyui_pvenv_1p20y9l5/persistent_worker.py", line 1762 in main [05:38] [ComfyUI] File "/tmp/comfyui_pvenv_1p20y9l5/persistent_worker.py", line 1807 in [05:38] [ComfyUI] [05:38] [ComfyUI] [worker:ComfyUI-Sharp] === END === [05:38] [ComfyUI] [05:41] [capture-loop] iter=1600 t=182.9s state={'complete': False, 'error': None, 'executedCount': 0, 'wsState': 1} eval_ms=2 ram=5.4/15.6GB (35%) swap=0.0/3.0GB (0%) cpu=43% browser_rss=0.84GB [05:46] [capture-loop] iter=1650 t=188.5s state={'complete': False, 'error': None, 'executedCount': 0, 'wsState': 1} eval_ms=3 ram=5.4/15.6GB (35%) swap=0.0/3.0GB (0%) cpu=43% browser_rss=0.84GB [05:52] [capture-loop] iter=1700 t=194.1s state={'complete': False, 'error': None, 'executedCount': 0, 'wsState': 1} eval_ms=3 ram=5.6/15.6GB (36%) swap=0.0/3.0GB (0%) cpu=44% browser_rss=0.84GB [05:58] [capture-loop] iter=1750 t=199.8s state={'complete': False, 'error': None, 'executedCount': 0, 'wsState': 1} eval_ms=4 ram=5.7/15.6GB (36%) swap=0.0/3.0GB (0%) cpu=45% browser_rss=0.84GB [06:03] [capture-loop] iter=1800 t=205.4s state={'complete': False, 'error': None, 'executedCount': 0, 'wsState': 1} eval_ms=2 ram=5.7/15.6GB (37%) swap=0.0/3.0GB (0%) cpu=44% browser_rss=0.84GB [06:09] [capture-loop] iter=1850 t=211.0s state={'complete': False, 'error': None, 'executedCount': 0, 'wsState': 1} eval_ms=3 ram=5.8/15.6GB (37%) swap=0.0/3.0GB (0%) cpu=45% browser_rss=0.84GB [06:15] [capture-loop] iter=1900 t=216.7s state={'complete': False, 'error': None, 'executedCount': 0, 'wsState': 1} eval_ms=3 ram=5.7/15.6GB (37%) swap=0.0/3.0GB (0%) cpu=45% browser_rss=0.84GB [06:20] [capture-loop] iter=1950 t=222.3s state={'complete': False, 'error': None, 'executedCount': 0, 'wsState': 1} eval_ms=3 ram=5.8/15.6GB (37%) swap=0.0/3.0GB (0%) cpu=45% browser_rss=0.84GB [06:26] [capture-loop] iter=2000 t=227.9s state={'complete': False, 'error': None, 'executedCount': 0, 'wsState': 1} eval_ms=2 ram=5.8/15.6GB (37%) swap=0.0/3.0GB (0%) cpu=44% browser_rss=0.84GB [06:31] [capture-loop] iter=2050 t=233.5s state={'complete': False, 'error': None, 'executedCount': 0, 'wsState': 1} eval_ms=7 ram=5.8/15.6GB (37%) swap=0.0/3.0GB (0%) cpu=44% browser_rss=0.84GB [06:37] [capture-loop] iter=2100 t=239.1s state={'complete': False, 'error': None, 'executedCount': 0, 'wsState': 1} eval_ms=2 ram=5.8/15.6GB (37%) swap=0.0/3.0GB (0%) cpu=44% browser_rss=0.84GB [06:38] [ComfyUI] [worker:ComfyUI-Sharp] [06:38] [ComfyUI] === WATCHDOG TICK 4 === [06:38] [ComfyUI] [worker:ComfyUI-Sharp] Thread 0x00007f29eaec06c0 (most recent call first): [06:38] [ComfyUI] File "/home/runner/.ce/.pixi/envs/sharp-nodes/lib/python3.11/threading.py", line 331 in wait [06:38] [ComfyUI] File "/home/runner/.ce/.pixi/envs/sharp-nodes/lib/python3.11/threading.py", line 629 in wait [06:38] [ComfyUI] File "/home/runner/.ce/.pixi/envs/sharp-nodes/lib/python3.11/site-packages/tqdm/_monitor.py", line 69 in run [06:38] [ComfyUI] File "/home/runner/.ce/.pixi/envs/sharp-nodes/lib/python3.11/threading.py", line 1045 in _bootstrap_inner [06:38] [ComfyUI] File "/home/runner/.ce/.pixi/envs/sharp-nodes/lib/python3.11/threading.py", line 1002 in _bootstrap [06:38] [ComfyUI] [06:38] [ComfyUI] Current thread 0x00007f29ebec16c0 (most recent call first): [06:38] [ComfyUI] File "/tmp/comfyui_pvenv_1p20y9l5/persistent_worker.py", line 52 in _watchdog [06:38] [ComfyUI] File "/home/runner/.ce/.pixi/envs/sharp-nodes/lib/python3.11/threading.py", line 982 in run [06:38] [ComfyUI] File "/home/runner/.ce/.pixi/envs/sharp-nodes/lib/python3.11/threading.py", line 1045 in _bootstrap_inner [06:38] [ComfyUI] File "/home/runner/.ce/.pixi/envs/sharp-nodes/lib/python3.11/threading.py", line 1002 in _bootstrap [06:38] [ComfyUI] [06:38] [ComfyUI] Thread 0x00007f29ec9e8740 (most recent call first): [06:38] [ComfyUI] File "/home/runner/.ce/.pixi/envs/sharp-nodes/lib/python3.11/site-packages/torch/nn/modules/linear.py", line 134 in forward [06:38] [ComfyUI] File "/home/runner/work/comfy-gpu-ci/comfy-gpu-ci/test_workspaces/Sharp-2211/ComfyUI/comfy/ops.py", line 503 in forward [06:38] [ComfyUI] File "/home/runner/.ce/.pixi/envs/sharp-nodes/lib/python3.11/site-packages/torch/nn/modules/module.py", line 1787 in _call_impl [06:38] [ComfyUI] File "/home/runner/.ce/.pixi/envs/sharp-nodes/lib/python3.11/site-packages/torch/nn/modules/module.py", line 1776 in _wrapped_call_impl [06:38] [ComfyUI] File "/home/runner/work/comfy-gpu-ci/comfy-gpu-ci/test_workspaces/Sharp-2211/ComfyUI/custom_nodes/ComfyUI-Sharp/nodes/sharp/model.py", line 274 in forward [06:38] [ComfyUI] File "/home/runner/.ce/.pixi/envs/sharp-nodes/lib/python3.11/site-packages/torch/nn/modules/module.py", line 1787 in _call_impl [06:38] [ComfyUI] File "/home/runner/.ce/.pixi/envs/sharp-nodes/lib/python3.11/site-packages/torch/nn/modules/module.py", line 1776 in _wrapped_call_impl [06:38] [ComfyUI] File "/home/runner/work/comfy-gpu-ci/comfy-gpu-ci/test_workspaces/Sharp-2211/ComfyUI/custom_nodes/ComfyUI-Sharp/nodes/sharp/model.py", line 310 in forward [06:38] [ComfyUI] File "/home/runner/.ce/.pixi/envs/sharp-nodes/lib/python3.11/site-packages/torch/nn/modules/module.py", line 1787 in _call_impl [06:38] [ComfyUI] File "/home/runner/.ce/.pixi/envs/sharp-nodes/lib/python3.11/site-packages/torch/nn/modules/module.py", line 1776 in _wrapped_call_impl [06:38] [ComfyUI] File "/home/runner/work/comfy-gpu-ci/comfy-gpu-ci/test_workspaces/Sharp-2211/ComfyUI/custom_nodes/ComfyUI-Sharp/nodes/sharp/model.py", line 412 in forward [06:38] [ComfyUI] File "/home/runner/.ce/.pixi/envs/sharp-nodes/lib/python3.11/site-packages/torch/nn/modules/module.py", line 1787 in _call_impl [06:38] [ComfyUI] File "/home/runner/.ce/.pixi/envs/sharp-nodes/lib/python3.11/site-packages/torch/nn/modules/module.py", line 1776 in _wrapped_call_impl [06:38] [ComfyUI] File "/home/runner/work/comfy-gpu-ci/comfy-gpu-ci/test_workspaces/Sharp-2211/ComfyUI/custom_nodes/ComfyUI-Sharp/nodes/sharp/model.py", line 685 in forward [06:38] [ComfyUI] File "/home/runner/.ce/.pixi/envs/sharp-nodes/lib/python3.11/site-packages/torch/nn/modules/module.py", line 1787 in _call_impl [06:38] [ComfyUI] File "/home/runner/.ce/.pixi/envs/sharp-nodes/lib/python3.11/site-packages/torch/nn/modules/module.py", line 1776 in _wrapped_call_impl [06:38] [ComfyUI] File "/home/runner/work/comfy-gpu-ci/comfy-gpu-ci/test_workspaces/Sharp-2211/ComfyUI/custom_nodes/ComfyUI-Sharp/nodes/sharp/model.py", line 1109 in forward [06:38] [ComfyUI] File "/home/runner/.ce/.pixi/envs/sharp-nodes/lib/python3.11/site-packages/torch/nn/modules/module.py", line 1787 in _call_impl [06:38] [ComfyUI] File "/home/runner/.ce/.pixi/envs/sharp-nodes/lib/python3.11/site-packages/torch/nn/modules/module.py", line 1776 in _wrapped_call_impl [06:38] [ComfyUI] File "/home/runner/work/comfy-gpu-ci/comfy-gpu-ci/test_workspaces/Sharp-2211/ComfyUI/custom_nodes/ComfyUI-Sharp/nodes/sharp/model.py", line 2006 in encode [06:38] [ComfyUI] File "/home/runner/work/comfy-gpu-ci/comfy-gpu-ci/test_workspaces/Sharp-2211/ComfyUI/custom_nodes/ComfyUI-Sharp/nodes/predict.py", line 348 in _predict_image_cached [06:38] [ComfyUI] File "/home/runner/work/comfy-gpu-ci/comfy-gpu-ci/test_workspaces/Sharp-2211/ComfyUI/custom_nodes/ComfyUI-Sharp/nodes/predict.py", line 239 in execute [06:38] [ComfyUI] File "/home/runner/.ce/.pixi/envs/sharp-nodes/lib/python3.11/site-packages/torch/utils/_contextlib.py", line 124 in decorate_context [06:38] [ComfyUI] File "/home/runner/work/comfy-gpu-ci/comfy-gpu-ci/test_workspaces/Sharp-2211/ComfyUI/comfy_api/latest/_io.py", line 1892 in EXECUTE_NORMALIZED [06:38] [ComfyUI] File "/tmp/comfyui_pvenv_1p20y9l5/persistent_worker.py", line 1762 in main [06:38] [ComfyUI] File "/tmp/comfyui_pvenv_1p20y9l5/persistent_worker.py", line 1807 in [06:38] [ComfyUI] [06:38] [ComfyUI] [worker:ComfyUI-Sharp] === END === [06:38] [ComfyUI] [06:43] [capture-loop] iter=2150 t=244.7s state={'complete': False, 'error': None, 'executedCount': 0, 'wsState': 1} eval_ms=2 ram=5.8/15.6GB (37%) swap=0.0/3.0GB (0%) cpu=43% browser_rss=0.84GB [06:48] [capture-loop] iter=2200 t=250.3s state={'complete': False, 'error': None, 'executedCount': 0, 'wsState': 1} eval_ms=4 ram=5.5/15.6GB (35%) swap=0.0/3.0GB (0%) cpu=44% browser_rss=0.84GB [06:54] [capture-loop] iter=2250 t=255.9s state={'complete': False, 'error': None, 'executedCount': 0, 'wsState': 1} eval_ms=2 ram=5.9/15.6GB (38%) swap=0.0/3.0GB (0%) cpu=45% browser_rss=0.84GB [06:59] [capture-loop] iter=2300 t=261.6s state={'complete': False, 'error': None, 'executedCount': 0, 'wsState': 1} eval_ms=4 ram=6.1/15.6GB (39%) swap=0.0/3.0GB (0%) cpu=45% browser_rss=0.84GB [07:05] [capture-loop] iter=2350 t=267.1s state={'complete': False, 'error': None, 'executedCount': 0, 'wsState': 1} eval_ms=3 ram=6.4/15.6GB (41%) swap=0.0/3.0GB (0%) cpu=43% browser_rss=0.84GB [07:11] [capture-loop] iter=2400 t=272.8s state={'complete': False, 'error': None, 'executedCount': 0, 'wsState': 1} eval_ms=5 ram=6.8/15.6GB (44%) swap=0.0/3.0GB (0%) cpu=44% browser_rss=0.84GB [07:16] [capture-loop] iter=2450 t=278.4s state={'complete': False, 'error': None, 'executedCount': 0, 'wsState': 1} eval_ms=3 ram=7.1/15.6GB (46%) swap=0.0/3.0GB (0%) cpu=46% browser_rss=0.84GB [07:22] [capture-loop] iter=2500 t=284.0s state={'complete': False, 'error': None, 'executedCount': 0, 'wsState': 1} eval_ms=3 ram=7.5/15.6GB (48%) swap=0.0/3.0GB (0%) cpu=45% browser_rss=0.84GB [07:27] [capture-loop] iter=2550 t=289.6s state={'complete': False, 'error': None, 'executedCount': 0, 'wsState': 1} eval_ms=2 ram=7.3/15.6GB (47%) swap=0.0/3.0GB (0%) cpu=43% browser_rss=0.84GB [07:33] [capture-loop] iter=2600 t=295.3s state={'complete': False, 'error': None, 'executedCount': 0, 'wsState': 1} eval_ms=3 ram=8.2/15.6GB (53%) swap=0.0/3.0GB (0%) cpu=44% browser_rss=0.84GB [07:38] [ComfyUI] [worker:ComfyUI-Sharp] [07:38] [ComfyUI] === WATCHDOG TICK 5 === [07:38] [ComfyUI] [worker:ComfyUI-Sharp] Thread 0x00007f29eaec06c0 (most recent call first): [07:38] [ComfyUI] File "/home/runner/.ce/.pixi/envs/sharp-nodes/lib/python3.11/threading.py", line 331 in wait [07:38] [ComfyUI] File "/home/runner/.ce/.pixi/envs/sharp-nodes/lib/python3.11/threading.py", line 629 in wait [07:38] [ComfyUI] File "/home/runner/.ce/.pixi/envs/sharp-nodes/lib/python3.11/site-packages/tqdm/_monitor.py", line 69 in run [07:38] [ComfyUI] File "/home/runner/.ce/.pixi/envs/sharp-nodes/lib/python3.11/threading.py", line 1045 in _bootstrap_inner [07:38] [ComfyUI] File "/home/runner/.ce/.pixi/envs/sharp-nodes/lib/python3.11/threading.py", line 1002 in _bootstrap [07:38] [ComfyUI] [07:38] [ComfyUI] Current thread 0x00007f29ebec16c0 (most recent call first): [07:38] [ComfyUI] File "/tmp/comfyui_pvenv_1p20y9l5/persistent_worker.py", line 52 in _watchdog [07:38] [ComfyUI] File "/home/runner/.ce/.pixi/envs/sharp-nodes/lib/python3.11/threading.py", line 982 in run [07:38] [ComfyUI] File "/home/runner/.ce/.pixi/envs/sharp-nodes/lib/python3.11/threading.py", line 1045 in _bootstrap_inner [07:38] [ComfyUI] File "/home/runner/.ce/.pixi/envs/sharp-nodes/lib/python3.11/threading.py", line 1002 in _bootstrap [07:38] [ComfyUI] [07:38] [ComfyUI] Thread 0x00007f29ec9e8740 (most recent call first): [07:38] [ComfyUI] File "/home/runner/.ce/.pixi/envs/sharp-nodes/lib/python3.11/site-packages/torch/nn/modules/conv.py", line 548 in _conv_forward [07:38] [ComfyUI] File "/home/runner/.ce/.pixi/envs/sharp-nodes/lib/python3.11/site-packages/torch/nn/modules/conv.py", line 553 in forward [07:38] [ComfyUI] File "/home/runner/work/comfy-gpu-ci/comfy-gpu-ci/test_workspaces/Sharp-2211/ComfyUI/comfy/ops.py", line 537 in forward [07:38] [ComfyUI] File "/home/runner/.ce/.pixi/envs/sharp-nodes/lib/python3.11/site-packages/torch/nn/modules/module.py", line 1787 in _call_impl [07:38] [ComfyUI] File "/home/runner/.ce/.pixi/envs/sharp-nodes/lib/python3.11/site-packages/torch/nn/modules/module.py", line 1776 in _wrapped_call_impl [07:38] [ComfyUI] File "/home/runner/.ce/.pixi/envs/sharp-nodes/lib/python3.11/site-packages/torch/nn/modules/container.py", line 253 in forward [07:38] [ComfyUI] File "/home/runner/.ce/.pixi/envs/sharp-nodes/lib/python3.11/site-packages/torch/nn/modules/module.py", line 1787 in _call_impl [07:38] [ComfyUI] File "/home/runner/.ce/.pixi/envs/sharp-nodes/lib/python3.11/site-packages/torch/nn/modules/module.py", line 1776 in _wrapped_call_impl [07:38] [ComfyUI] File "/home/runner/work/comfy-gpu-ci/comfy-gpu-ci/test_workspaces/Sharp-2211/ComfyUI/custom_nodes/ComfyUI-Sharp/nodes/sharp/model.py", line 766 in forward [07:38] [ComfyUI] File "/home/runner/.ce/.pixi/envs/sharp-nodes/lib/python3.11/site-packages/torch/nn/modules/module.py", line 1787 in _call_impl [07:38] [ComfyUI] File "/home/runner/.ce/.pixi/envs/sharp-nodes/lib/python3.11/site-packages/torch/nn/modules/module.py", line 1776 in _wrapped_call_impl [07:38] [ComfyUI] File "/home/runner/work/comfy-gpu-ci/comfy-gpu-ci/test_workspaces/Sharp-2211/ComfyUI/custom_nodes/ComfyUI-Sharp/nodes/sharp/model.py", line 860 in forward [07:38] [ComfyUI] File "/home/runner/.ce/.pixi/envs/sharp-nodes/lib/python3.11/site-packages/torch/nn/modules/module.py", line 1787 in _call_impl [07:38] [ComfyUI] File "/home/runner/.ce/.pixi/envs/sharp-nodes/lib/python3.11/site-packages/torch/nn/modules/module.py", line 1776 in _wrapped_call_impl [07:38] [ComfyUI] File "/home/runner/work/comfy-gpu-ci/comfy-gpu-ci/test_workspaces/Sharp-2211/ComfyUI/custom_nodes/ComfyUI-Sharp/nodes/sharp/model.py", line 970 in forward [07:38] [ComfyUI] File "/home/runner/.ce/.pixi/envs/sharp-nodes/lib/python3.11/site-packages/torch/nn/modules/module.py", line 1787 in _call_impl [07:38] [ComfyUI] File "/home/runner/.ce/.pixi/envs/sharp-nodes/lib/python3.11/site-packages/torch/nn/modules/module.py", line 1776 in _wrapped_call_impl [07:38] [ComfyUI] File "/home/runner/work/comfy-gpu-ci/comfy-gpu-ci/test_workspaces/Sharp-2211/ComfyUI/custom_nodes/ComfyUI-Sharp/nodes/sharp/model.py", line 1118 in forward [07:38] [ComfyUI] File "/home/runner/.ce/.pixi/envs/sharp-nodes/lib/python3.11/site-packages/torch/nn/modules/module.py", line 1787 in _call_impl [07:38] [ComfyUI] File "/home/runner/.ce/.pixi/envs/sharp-nodes/lib/python3.11/site-packages/torch/nn/modules/module.py", line 1776 in _wrapped_call_impl [07:38] [ComfyUI] File "/home/runner/work/comfy-gpu-ci/comfy-gpu-ci/test_workspaces/Sharp-2211/ComfyUI/custom_nodes/ComfyUI-Sharp/nodes/sharp/model.py", line 2006 in encode [07:38] [ComfyUI] File "/home/runner/work/comfy-gpu-ci/comfy-gpu-ci/test_workspaces/Sharp-2211/ComfyUI/custom_nodes/ComfyUI-Sharp/nodes/predict.py", line 348 in _predict_image_cached [07:38] [ComfyUI] File "/home/runner/work/comfy-gpu-ci/comfy-gpu-ci/test_workspaces/Sharp-2211/ComfyUI/custom_nodes/ComfyUI-Sharp/nodes/predict.py", line 239 in execute [07:38] [ComfyUI] File "/home/runner/.ce/.pixi/envs/sharp-nodes/lib/python3.11/site-packages/torch/utils/_contextlib.py", line 124 in decorate_context [07:38] [ComfyUI] File "/home/runner/work/comfy-gpu-ci/comfy-gpu-ci/test_workspaces/Sharp-2211/ComfyUI/comfy_api/latest/_io.py", line 1892 in EXECUTE_NORMALIZED [07:38] [ComfyUI] File "/tmp/comfyui_pvenv_1p20y9l5/persistent_worker.py", line 1762 in main [07:38] [ComfyUI] File "/tmp/comfyui_pvenv_1p20y9l5/persistent_worker.py", line 1807 in [07:38] [ComfyUI] [07:38] [ComfyUI] [worker:ComfyUI-Sharp] === END === [07:38] [ComfyUI] [07:39] [capture-loop] iter=2650 t=300.8s state={'complete': False, 'error': None, 'executedCount': 0, 'wsState': 1} eval_ms=4 ram=9.2/15.6GB (59%) swap=0.0/3.0GB (0%) cpu=48% browser_rss=0.84GB [07:44] [capture-loop] iter=2700 t=306.5s state={'complete': False, 'error': None, 'executedCount': 0, 'wsState': 1} eval_ms=3 ram=8.9/15.6GB (57%) swap=0.0/3.0GB (0%) cpu=44% browser_rss=0.84GB [07:50] [capture-loop] iter=2750 t=312.0s state={'complete': False, 'error': None, 'executedCount': 0, 'wsState': 1} eval_ms=3 ram=9.4/15.6GB (60%) swap=0.0/3.0GB (0%) cpu=44% browser_rss=0.84GB [07:55] [capture-loop] iter=2800 t=317.6s state={'complete': False, 'error': None, 'executedCount': 0, 'wsState': 1} eval_ms=2 ram=7.3/15.6GB (46%) swap=0.0/3.0GB (0%) cpu=45% browser_rss=0.84GB [08:01] [capture-loop] iter=2850 t=323.3s state={'complete': False, 'error': None, 'executedCount': 0, 'wsState': 1} eval_ms=6 ram=9.6/15.6GB (61%) swap=0.0/3.0GB (0%) cpu=45% browser_rss=0.84GB [08:07] [capture-loop] iter=2900 t=328.9s state={'complete': False, 'error': None, 'executedCount': 0, 'wsState': 1} eval_ms=3 ram=6.6/15.6GB (42%) swap=0.0/3.0GB (0%) cpu=47% browser_rss=0.84GB [08:12] [capture-loop] iter=2950 t=334.6s state={'complete': False, 'error': None, 'executedCount': 0, 'wsState': 1} eval_ms=3 ram=7.2/15.6GB (46%) swap=0.0/3.0GB (0%) cpu=46% browser_rss=0.84GB [08:18] [capture-loop] iter=3000 t=340.2s state={'complete': False, 'error': None, 'executedCount': 0, 'wsState': 1} eval_ms=3 ram=8.3/15.6GB (53%) swap=0.0/3.0GB (0%) cpu=43% browser_rss=0.84GB [08:24] [capture-loop] iter=3050 t=345.8s state={'complete': False, 'error': None, 'executedCount': 0, 'wsState': 1} eval_ms=4 ram=7.8/15.6GB (50%) swap=0.0/3.0GB (0%) cpu=43% browser_rss=0.84GB [08:29] [capture-loop] iter=3100 t=351.4s state={'complete': False, 'error': None, 'executedCount': 0, 'wsState': 1} eval_ms=2 ram=8.5/15.6GB (54%) swap=0.0/3.0GB (0%) cpu=44% browser_rss=0.84GB [08:35] [capture-loop] iter=3150 t=356.9s state={'complete': False, 'error': None, 'executedCount': 0, 'wsState': 1} eval_ms=4 ram=7.6/15.6GB (49%) swap=0.0/3.0GB (0%) cpu=44% browser_rss=0.84GB [08:38] [ComfyUI] [worker:ComfyUI-Sharp] [08:38] [ComfyUI] === WATCHDOG TICK 6 === [08:38] [ComfyUI] [worker:ComfyUI-Sharp] Thread 0x00007f29eaec06c0 (most recent call first): [08:38] [ComfyUI] File "/home/runner/.ce/.pixi/envs/sharp-nodes/lib/python3.11/threading.py", line 331 in wait [08:38] [ComfyUI] File "/home/runner/.ce/.pixi/envs/sharp-nodes/lib/python3.11/threading.py", line 629 in wait [08:38] [ComfyUI] File "/home/runner/.ce/.pixi/envs/sharp-nodes/lib/python3.11/site-packages/tqdm/_monitor.py", line 69 in run [08:38] [ComfyUI] File "/home/runner/.ce/.pixi/envs/sharp-nodes/lib/python3.11/threading.py", line 1045 in _bootstrap_inner [08:38] [ComfyUI] File "/home/runner/.ce/.pixi/envs/sharp-nodes/lib/python3.11/threading.py", line 1002 in _bootstrap [08:38] [ComfyUI] [08:38] [ComfyUI] Current thread 0x00007f29ebec16c0 (most recent call first): [08:38] [ComfyUI] File "/tmp/comfyui_pvenv_1p20y9l5/persistent_worker.py", line 52 in _watchdog [08:38] [ComfyUI] File "/home/runner/.ce/.pixi/envs/sharp-nodes/lib/python3.11/threading.py", line 982 in run [08:38] [ComfyUI] File "/home/runner/.ce/.pixi/envs/sharp-nodes/lib/python3.11/threading.py", line 1045 in _bootstrap_inner [08:38] [ComfyUI] File "/home/runner/.ce/.pixi/envs/sharp-nodes/lib/python3.11/threading.py", line 1002 in _bootstrap [08:38] [ComfyUI] [08:38] [ComfyUI] Thread 0x00007f29ec9e8740 (most recent call first): [08:38] [ComfyUI] File "/home/runner/.ce/.pixi/envs/sharp-nodes/lib/python3.11/site-packages/torch/nn/modules/conv.py", line 548 in _conv_forward [08:38] [ComfyUI] File "/home/runner/.ce/.pixi/envs/sharp-nodes/lib/python3.11/site-packages/torch/nn/modules/conv.py", line 553 in forward [08:38] [ComfyUI] File "/home/runner/work/comfy-gpu-ci/comfy-gpu-ci/test_workspaces/Sharp-2211/ComfyUI/comfy/ops.py", line 537 in forward [08:38] [ComfyUI] File "/home/runner/.ce/.pixi/envs/sharp-nodes/lib/python3.11/site-packages/torch/nn/modules/module.py", line 1787 in _call_impl [08:38] [ComfyUI] File "/home/runner/.ce/.pixi/envs/sharp-nodes/lib/python3.11/site-packages/torch/nn/modules/module.py", line 1776 in _wrapped_call_impl [08:38] [ComfyUI] File "/home/runner/.ce/.pixi/envs/sharp-nodes/lib/python3.11/site-packages/torch/nn/modules/container.py", line 253 in forward [08:38] [ComfyUI] File "/home/runner/.ce/.pixi/envs/sharp-nodes/lib/python3.11/site-packages/torch/nn/modules/module.py", line 1787 in _call_impl [08:38] [ComfyUI] File "/home/runner/.ce/.pixi/envs/sharp-nodes/lib/python3.11/site-packages/torch/nn/modules/module.py", line 1776 in _wrapped_call_impl [08:38] [ComfyUI] File "/home/runner/work/comfy-gpu-ci/comfy-gpu-ci/test_workspaces/Sharp-2211/ComfyUI/custom_nodes/ComfyUI-Sharp/nodes/sharp/model.py", line 766 in forward [08:38] [ComfyUI] File "/home/runner/.ce/.pixi/envs/sharp-nodes/lib/python3.11/site-packages/torch/nn/modules/module.py", line 1787 in _call_impl [08:38] [ComfyUI] File "/home/runner/.ce/.pixi/envs/sharp-nodes/lib/python3.11/site-packages/torch/nn/modules/module.py", line 1776 in _wrapped_call_impl [08:38] [ComfyUI] File "/home/runner/.ce/.pixi/envs/sharp-nodes/lib/python3.11/site-packages/torch/nn/modules/container.py", line 253 in forward [08:38] [ComfyUI] File "/home/runner/.ce/.pixi/envs/sharp-nodes/lib/python3.11/site-packages/torch/nn/modules/module.py", line 1787 in _call_impl [08:38] [ComfyUI] File "/home/runner/.ce/.pixi/envs/sharp-nodes/lib/python3.11/site-packages/torch/nn/modules/module.py", line 1776 in _wrapped_call_impl [08:38] [ComfyUI] File "/home/runner/work/comfy-gpu-ci/comfy-gpu-ci/test_workspaces/Sharp-2211/ComfyUI/custom_nodes/ComfyUI-Sharp/nodes/sharp/model.py", line 1355 in forward [08:38] [ComfyUI] File "/home/runner/.ce/.pixi/envs/sharp-nodes/lib/python3.11/site-packages/torch/nn/modules/module.py", line 1787 in _call_impl [08:38] [ComfyUI] File "/home/runner/.ce/.pixi/envs/sharp-nodes/lib/python3.11/site-packages/torch/nn/modules/module.py", line 1776 in _wrapped_call_impl [08:38] [ComfyUI] File "/home/runner/work/comfy-gpu-ci/comfy-gpu-ci/test_workspaces/Sharp-2211/ComfyUI/custom_nodes/ComfyUI-Sharp/nodes/sharp/model.py", line 2030 in decode [08:38] [ComfyUI] File "/home/runner/work/comfy-gpu-ci/comfy-gpu-ci/test_workspaces/Sharp-2211/ComfyUI/custom_nodes/ComfyUI-Sharp/nodes/predict.py", line 379 in _predict_image_cached [08:38] [ComfyUI] File "/home/runner/work/comfy-gpu-ci/comfy-gpu-ci/test_workspaces/Sharp-2211/ComfyUI/custom_nodes/ComfyUI-Sharp/nodes/predict.py", line 239 in execute [08:38] [ComfyUI] File "/home/runner/.ce/.pixi/envs/sharp-nodes/lib/python3.11/site-packages/torch/utils/_contextlib.py", line 124 in decorate_context [08:38] [ComfyUI] File "/home/runner/work/comfy-gpu-ci/comfy-gpu-ci/test_workspaces/Sharp-2211/ComfyUI/comfy_api/latest/_io.py", line 1892 in EXECUTE_NORMALIZED [08:38] [ComfyUI] File "/tmp/comfyui_pvenv_1p20y9l5/persistent_worker.py", line 1762 in main [08:38] [ComfyUI] File "/tmp/comfyui_pvenv_1p20y9l5/persistent_worker.py", line 1807 in [08:38] [ComfyUI] [08:38] [ComfyUI] [worker:ComfyUI-Sharp] === END === [08:38] [ComfyUI] [08:40] [capture-loop] iter=3200 t=362.6s state={'complete': False, 'error': None, 'executedCount': 0, 'wsState': 1} eval_ms=2 ram=8.1/15.6GB (52%) swap=0.0/3.0GB (0%) cpu=46% browser_rss=0.84GB [08:46] [capture-loop] iter=3250 t=368.3s state={'complete': False, 'error': None, 'executedCount': 0, 'wsState': 1} eval_ms=2 ram=6.8/15.6GB (43%) swap=0.0/3.0GB (0%) cpu=43% browser_rss=0.84GB [08:47] [ComfyUI] [SubprocessWorker] callback 'report_progress' from call_id=2 [08:47] [ComfyUI] [SubprocessWorker] got response: ok [08:47] [ComfyUI] [comfy-env] SharpPredict done (352.98s): result: NodeOutput [08:47] [ComfyUI] [comfy-env] Running PreviewGaussianSharp: ply_path: '/home/runner/work/comfy-gpu-ci/comfy-gpu-ci/test_workspa..., extrinsics: list[4], intrinsics: list[3] [08:47] [ComfyUI] [comfy-env] SubprocessWorker: /home/runner/.ce/.pixi/envs/gaussianpack-nodes/bin/python [08:47] [ComfyUI] [comfy-env] env_vars: {'COMFYUI_BASE': '/home/runner/work/comfy-gpu-ci/comfy-gpu-ci/test_workspaces/Sharp-2211/ComfyUI'} [08:47] [ComfyUI] [SubprocessWorker] call_method: nodes.preview_gaussian_sharp.PreviewGaussianSharp.EXECUTE_NORMALIZED [08:47] [ComfyUI] [ComfyUI-GaussianPack] python: /home/runner/.ce/.pixi/envs/gaussianpack-nodes/bin/python [08:47] [ComfyUI] [SubprocessWorker] acquired lock, ensuring started... [08:47] [ComfyUI] [ComfyUI-GaussianPack] sys_path sent to worker: ['/home/runner/work/comfy-gpu-ci/comfy-gpu-ci/test_workspaces/Sharp-2211/ComfyUI', '/home/runner/work/comfy-gpu-ci/comfy-gpu-ci/test_workspaces/Sharp-2211/ComfyUI/custom_nodes/ComfyUI-GaussianPack', '/home/runner/.ce/.pixi/envs/gaussianpack-nodes/lib/python3.11/site-packages', '/home/runner/work/comfy-gpu-ci/comfy-gpu-ci/test_workspaces/Sharp-2211/ComfyUI/custom_nodes/ComfyUI-GaussianPack'] [08:47] [ComfyUI] [SubprocessWorker] is_pixi=True, python=/home/runner/.ce/.pixi/envs/gaussianpack-nodes/bin/python [08:47] [ComfyUI] [SubprocessWorker] launching cmd=['/home/runner/.pixi/bin/pixi', 'run', '--as-is', '--manifest-path', '/home/runner/.ce/pixi.toml', '-e', 'gaussianpack-nodes', 'python', '/tmp/comfyui_pvenv_w5l8haz9/persistent_worker.py', 'abstract://comfy_worker_165b9265adb5']... [08:47] [ComfyUI] [SubprocessWorker] socket_addr=abstract://comfy_worker_165b9265adb5 (abstract, no filesystem path) [08:48] Frame 8 saved (frame_007.jpg, t=370.0s) [08:48] [capture-periodic] freeze=4ms shot=107ms unfreeze=2ms saved=True [08:48] [ComfyUI] [SubprocessWorker] worker started/confirmed [08:48] [ComfyUI] [SubprocessWorker] serializing kwargs to shm... [08:48] [ComfyUI] [SubprocessWorker] created 0 shm blocks [08:48] [ComfyUI] [SubprocessWorker] sending request via socket... [08:48] [ComfyUI] [SubprocessWorker] call_id=1 sending call_method [08:48] [ComfyUI] [worker:ComfyUI-GaussianPack] WARNING: SPZ route not registered (ModuleNotFoundError: No module named 'comfy_aimdo') [08:48] [ComfyUI] [SubprocessWorker] got response: ok [08:48] [ComfyUI] [comfy-env] PreviewGaussianSharp done (1.83s): result: NodeOutput [08:48] [ComfyUI] [INFO] Prompt executed in 370.35 seconds [08:48] Node executed (1 total), capturing... [08:49] Frame 9 saved (frame_008.jpg, t=370.8s) [08:49] [capture-node] freeze=3ms shot=121ms unfreeze=0ms saved=True [08:49] Execution complete (t=370.8s) [08:49] [3d-wait] Phase 1: Waiting for 'Loading 3D Model' text to disappear... [08:49] [3d-wait] Phase 1 done in 0.0s [08:50] [3d-wait] Phase 2: iframes=1 [08:50] [3d-wait] iframe viewer_ready=True (matched 1 console logs) [08:50] [3d-wait] Unfrozen in 0.151s, rendering for 5s... [09:00] [3d-wait] JS halted via CDP after 10.5s [09:30] [3d-wait] Re-frozen in 40.4s [09:30] [3d-wait] Total 3D wait: 41.3s [09:30] Captured 9 unique frames over 412.3s [09:30] [debug] iframes: 1 [09:30] [debug] iframe[0]: src=http://127.0.0.1:41888/extensions/ComfyUI-GaussianPack/viewer_gaussian_sharp.htm, canvas=1536x1024, rafFrozen=True [09:30] [timing] trigger_3d_previews: 0.0s [09:32] Saved high-quality screenshot: sharp_basic_executed.png [09:32] [timing] final_screenshot: 0.3s [09:33] [ComfyUI] [INFO] Using RAM pressure cache. [09:33] Capturing execution frames: sharp_exif.json [09:33] [ComfyUI] [INFO] Using RAM pressure cache. [09:39] Frame 1 saved (frame_000.jpg, t=0.0s) [09:39] Validating workflow... [09:39] [ComfyUI] [INFO] === /validate endpoint called === [09:39] [ComfyUI] [INFO] Received JSON with keys: ['prompt'] [09:39] [ComfyUI] [INFO] Prompt has 4 nodes [09:39] [ComfyUI] [INFO] Node 2: LoadSharpModel [09:39] [ComfyUI] [INFO] Inputs: {"precision": "auto"} [09:39] [ComfyUI] [INFO] Node 7: SharpPredict [09:39] [ComfyUI] [INFO] Inputs: {"focal_length_mm": ["9", 2], "output_prefix": "sharp", "model": ["2", 0], "image": ["9", 0]} [09:39] [ComfyUI] [INFO] Node 9: LoadImageWithExif [09:39] Queuing workflow for execution... [09:39] [ComfyUI] [INFO] Inputs: {"image": "eth3d.png", "default_focal_mm": 30} [09:39] [ComfyUI] [INFO] Node 11: PreviewGaussianSharp [09:39] [ComfyUI] [INFO] Inputs: {"preview_gaussian": "", "ply_path": ["7", 0], "extrinsics": ["7", 1], "intrinsics": ["7", 2]} [09:39] [ComfyUI] [INFO] Generated prompt_id: d88414f2-dece-451b-b7a5-986d4d92c805 [09:39] [ComfyUI] [INFO] Calling execution.validate_prompt()... [09:39] [ComfyUI] [INFO] Validation result: valid=True [09:39] [ComfyUI] [INFO] === Validation PASSED === [09:39] [ComfyUI] [INFO] got prompt [09:39] [ComfyUI] [comfy-env] Running LoadImageWithExif: image: 'eth3d.png', default_focal_mm: 30.0 [09:39] [ComfyUI] [SubprocessWorker] call_method: nodes.load_image_exif.LoadImageWithExif.EXECUTE_NORMALIZED [09:39] [ComfyUI] [SubprocessWorker] acquired lock, ensuring started... [09:39] [ComfyUI] [ComfyUI-Sharp] Health check: ping (timeout=5.0s)... [09:39] [ComfyUI] [ComfyUI-Sharp] Health check: failed [09:39] [ComfyUI] [ComfyUI-Sharp] python: /home/runner/.ce/.pixi/envs/sharp-nodes/bin/python [09:39] [ComfyUI] [ComfyUI-Sharp] Socket unhealthy, restarting worker... [09:39] [ComfyUI] [ComfyUI-Sharp] sys_path sent to worker: ['/home/runner/work/comfy-gpu-ci/comfy-gpu-ci/test_workspaces/Sharp-2211/ComfyUI', '/home/runner/work/comfy-gpu-ci/comfy-gpu-ci/test_workspaces/Sharp-2211/ComfyUI/custom_nodes/ComfyUI-Sharp', '/home/runner/.ce/.pixi/envs/sharp-nodes/lib/python3.11/site-packages', '/home/runner/work/comfy-gpu-ci/comfy-gpu-ci/test_workspaces/Sharp-2211/ComfyUI/custom_nodes/ComfyUI-Sharp'] [09:39] [ComfyUI] [SubprocessWorker] is_pixi=True, python=/home/runner/.ce/.pixi/envs/sharp-nodes/bin/python [09:39] [ComfyUI] [SubprocessWorker] launching cmd=['/home/runner/.pixi/bin/pixi', 'run', '--as-is', '--manifest-path', '/home/runner/.ce/pixi.toml', '-e', 'sharp-nodes', 'python', '/tmp/comfyui_pvenv_1p20y9l5/persistent_worker.py', 'abstract://comfy_worker_58e8d5234f83']... [09:39] [ComfyUI] [SubprocessWorker] socket_addr=abstract://comfy_worker_58e8d5234f83 (abstract, no filesystem path) [09:41] [ComfyUI] [worker:ComfyUI-Sharp] ERROR: Failed to import comfy_kitchen, Error: No module named 'comfy_kitchen', fp8 and fp4 support will not be available. [09:41] [ComfyUI] [worker:ComfyUI-Sharp] WARNING: comfy_kitchen does not support stochastic FP8 rounding, please update comfy_kitchen. [09:41] [ComfyUI] [SubprocessWorker] worker started/confirmed [09:41] [ComfyUI] [SubprocessWorker] serializing kwargs to shm... [09:41] [ComfyUI] [SubprocessWorker] created 0 shm blocks [09:41] [ComfyUI] [SubprocessWorker] sending request via socket... [09:41] [ComfyUI] [SubprocessWorker] call_id=3 sending call_method [09:41] [ComfyUI] [SubprocessWorker] got response: ok [09:41] [ComfyUI] [comfy-env] LoadImageWithExif done (2.06s): result: NodeOutput [09:41] [ComfyUI] [comfy-env] Running LoadSharpModel: precision: 'auto' [09:41] [ComfyUI] [SubprocessWorker] call_method: nodes.load_model.LoadSharpModel.EXECUTE_NORMALIZED [09:41] [ComfyUI] [SubprocessWorker] acquired lock, ensuring started... [09:41] [ComfyUI] [ComfyUI-Sharp] Health check: ping (timeout=5.0s)... [09:41] [ComfyUI] [ComfyUI-Sharp] Health check: ok [09:41] [ComfyUI] [SubprocessWorker] worker started/confirmed [09:41] [ComfyUI] [SubprocessWorker] serializing kwargs to shm... [09:41] [ComfyUI] [SubprocessWorker] created 0 shm blocks [09:41] [ComfyUI] [SubprocessWorker] sending request via socket... [09:41] [ComfyUI] [SubprocessWorker] call_id=4 sending call_method [09:41] [ComfyUI] [worker:ComfyUI-Sharp] [LoadSharpModel] precision='auto' -> dtype=fp32 (device=cpu) [09:41] [ComfyUI] [worker:ComfyUI-Sharp] [LoadSharpModel] checkpoint already present, reusing (no download): /home/runner/work/comfy-gpu-ci/comfy-gpu-ci/test_workspaces/Sharp-2211/ComfyUI/models/sharp/sharp_2572gikvuh.pt (2679.6 MB) [09:41] [ComfyUI] [worker:ComfyUI-Sharp] [LoadSharpModel] checkpoint ready: /home/runner/work/comfy-gpu-ci/comfy-gpu-ci/test_workspaces/Sharp-2211/ComfyUI/models/sharp/sharp_2572gikvuh.pt (2679.6 MB) [09:41] [ComfyUI] [worker:ComfyUI-Sharp] [LoadSharpModel] config: precision=auto -> dtype=fp32 [09:41] [ComfyUI] [SubprocessWorker] got response: ok [09:41] [ComfyUI] [comfy-env] LoadSharpModel done (0.01s): result: NodeOutput [09:41] [ComfyUI] [comfy-env] Running SharpPredict: focal_length_mm: 20.0, output_prefix: 'sharp', model: dict, image: torch.float32 [1,1011,1520,3] cpu [09:41] [ComfyUI] [SubprocessWorker] call_method: nodes.predict.SharpPredict.EXECUTE_NORMALIZED [09:41] [ComfyUI] [SubprocessWorker] acquired lock, ensuring started... [09:41] [ComfyUI] [ComfyUI-Sharp] Health check: ping (timeout=5.0s)... [09:41] [ComfyUI] [ComfyUI-Sharp] Health check: ok [09:41] [ComfyUI] [SubprocessWorker] worker started/confirmed [09:41] [ComfyUI] [comfy-env] PRE-SERIALIZE 'image' shape: torch.Size([1, 1011, 1520, 3]) [09:41] [ComfyUI] [SubprocessWorker] serializing kwargs to shm... [09:41] [ComfyUI] [SubprocessWorker] created 0 shm blocks [09:41] [ComfyUI] [SubprocessWorker] sending request via socket... [09:41] [ComfyUI] [SubprocessWorker] call_id=5 sending call_method [09:41] [ComfyUI] [worker:ComfyUI-Sharp] [comfy-env] _from_shm got dict with keys: ['__type__', 'strategy', 'parent_pid', 'fd', 'storage_size'] [09:41] [ComfyUI] [worker:ComfyUI-Sharp] [comfy-env] DESERIALIZE TensorRef: tensor_size=[1, 1011, 1520, 3] [09:41] [ComfyUI] [worker:ComfyUI-Sharp] [comfy-env] DESERIALIZED tensor shape: torch.Size([1, 1011, 1520, 3]) [09:41] Frame 2 saved (frame_001.jpg, t=2.3s) [09:41] [capture-periodic] freeze=4ms shot=134ms unfreeze=4ms saved=True [09:44] Frame 3 saved (frame_002.jpg, t=4.5s) [09:44] [capture-periodic] freeze=2ms shot=117ms unfreeze=3ms saved=True [09:44] [ComfyUI] [worker:ComfyUI-Sharp] [LoadSharpModel] loading checkpoint from /home/runner/work/comfy-gpu-ci/comfy-gpu-ci/test_workspaces/Sharp-2211/ComfyUI/models/sharp/sharp_2572gikvuh.pt (dtype=fp32) [09:45] [capture-loop] iter=50 t=5.8s state={'complete': False, 'error': None, 'executedCount': 0, 'wsState': 1} eval_ms=2 ram=3.0/15.6GB (19%) swap=0.0/3.0GB (0%) cpu=79% browser_rss=0.94GB [09:47] [ComfyUI] [worker:ComfyUI-Sharp] [LoadSharpModel] initializing model on meta device... [09:47] [ComfyUI] [worker:ComfyUI-Sharp] [LoadSharpModel] model ready (torch.float32) [09:47] [ComfyUI] [SubprocessWorker] callback 'request_vram_budget' from call_id=5 [09:47] [ComfyUI] [comfy-env] VRAM request: 2.81GB, free before eviction: 11.19GB [09:47] [ComfyUI] [comfy-env] VRAM after eviction: 11.19GB [09:50] [capture-loop] iter=100 t=11.5s state={'complete': False, 'error': None, 'executedCount': 0, 'wsState': 1} eval_ms=3 ram=5.6/15.6GB (36%) swap=0.0/3.0GB (0%) cpu=36% browser_rss=0.93GB [09:56] [capture-loop] iter=150 t=17.0s state={'complete': False, 'error': None, 'executedCount': 0, 'wsState': 1} eval_ms=2 ram=5.6/15.6GB (36%) swap=0.0/3.0GB (0%) cpu=45% browser_rss=0.93GB [10:02] [capture-loop] iter=200 t=22.7s state={'complete': False, 'error': None, 'executedCount': 0, 'wsState': 1} eval_ms=3 ram=5.6/15.6GB (36%) swap=0.0/3.0GB (0%) cpu=44% browser_rss=0.94GB [10:08] [capture-loop] iter=250 t=28.6s state={'complete': False, 'error': None, 'executedCount': 0, 'wsState': 1} eval_ms=2 ram=5.4/15.6GB (35%) swap=0.0/3.0GB (0%) cpu=48% browser_rss=0.86GB [10:13] [capture-loop] iter=300 t=34.1s state={'complete': False, 'error': None, 'executedCount': 0, 'wsState': 1} eval_ms=3 ram=5.5/15.6GB (35%) swap=0.0/3.0GB (0%) cpu=45% browser_rss=0.86GB [10:19] [capture-loop] iter=350 t=39.8s state={'complete': False, 'error': None, 'executedCount': 0, 'wsState': 1} eval_ms=3 ram=5.6/15.6GB (36%) swap=0.0/3.0GB (0%) cpu=44% browser_rss=0.86GB [10:24] [capture-loop] iter=400 t=45.3s state={'complete': False, 'error': None, 'executedCount': 0, 'wsState': 1} eval_ms=3 ram=5.5/15.6GB (35%) swap=0.0/3.0GB (0%) cpu=44% browser_rss=0.86GB [10:30] [capture-loop] iter=450 t=51.0s state={'complete': False, 'error': None, 'executedCount': 0, 'wsState': 1} eval_ms=3 ram=5.6/15.6GB (36%) swap=0.0/3.0GB (0%) cpu=44% browser_rss=0.86GB [10:36] [capture-loop] iter=500 t=56.6s state={'complete': False, 'error': None, 'executedCount': 0, 'wsState': 1} eval_ms=3 ram=5.5/15.6GB (35%) swap=0.0/3.0GB (0%) cpu=45% browser_rss=0.87GB [10:39] [ComfyUI] [worker:ComfyUI-Sharp] [10:39] [ComfyUI] === WATCHDOG TICK 1 === [10:39] [ComfyUI] [worker:ComfyUI-Sharp] Thread 0x00007feb878ab6c0 (most recent call first): [10:39] [ComfyUI] File "/home/runner/.ce/.pixi/envs/sharp-nodes/lib/python3.11/socket.py", line 294 in accept [10:39] [ComfyUI] File "/home/runner/.ce/.pixi/envs/sharp-nodes/lib/python3.11/multiprocessing/connection.py", line 626 in accept [10:39] [ComfyUI] File "/home/runner/.ce/.pixi/envs/sharp-nodes/lib/python3.11/multiprocessing/connection.py", line 480 in accept [10:39] [ComfyUI] File "/home/runner/.ce/.pixi/envs/sharp-nodes/lib/python3.11/multiprocessing/resource_sharer.py", line 138 in _serve [10:39] [ComfyUI] File "/home/runner/.ce/.pixi/envs/sharp-nodes/lib/python3.11/threading.py", line 982 in run [10:39] [ComfyUI] File "/home/runner/.ce/.pixi/envs/sharp-nodes/lib/python3.11/threading.py", line 1045 in _bootstrap_inner [10:39] [ComfyUI] File "/home/runner/.ce/.pixi/envs/sharp-nodes/lib/python3.11/threading.py", line 1002 in _bootstrap [10:39] [ComfyUI] [10:39] [ComfyUI] Current thread 0x00007feb888ac6c0 (most recent call first): [10:39] [ComfyUI] File "/tmp/comfyui_pvenv_1p20y9l5/persistent_worker.py", line 52 in _watchdog [10:39] [ComfyUI] File "/home/runner/.ce/.pixi/envs/sharp-nodes/lib/python3.11/threading.py", line 982 in run [10:39] [ComfyUI] File "/home/runner/.ce/.pixi/envs/sharp-nodes/lib/python3.11/threading.py", line 1045 in _bootstrap_inner [10:39] [ComfyUI] File "/home/runner/.ce/.pixi/envs/sharp-nodes/lib/python3.11/threading.py", line 1002 in _bootstrap [10:39] [ComfyUI] [10:39] [ComfyUI] Thread 0x00007feb893d3740 (most recent call first): [10:39] [ComfyUI] File "/home/runner/.ce/.pixi/envs/sharp-nodes/lib/python3.11/site-packages/torch/nn/modules/linear.py", line 134 in forward [10:39] [ComfyUI] File "/home/runner/work/comfy-gpu-ci/comfy-gpu-ci/test_workspaces/Sharp-2211/ComfyUI/comfy/ops.py", line 503 in forward [10:39] [ComfyUI] File "/home/runner/.ce/.pixi/envs/sharp-nodes/lib/python3.11/site-packages/torch/nn/modules/module.py", line 1787 in _call_impl [10:39] [ComfyUI] File "/home/runner/.ce/.pixi/envs/sharp-nodes/lib/python3.11/site-packages/torch/nn/modules/module.py", line 1776 in _wrapped_call_impl [10:39] [ComfyUI] File "/home/runner/work/comfy-gpu-ci/comfy-gpu-ci/test_workspaces/Sharp-2211/ComfyUI/custom_nodes/ComfyUI-Sharp/nodes/sharp/model.py", line 268 in forward [10:39] [ComfyUI] File "/home/runner/.ce/.pixi/envs/sharp-nodes/lib/python3.11/site-packages/torch/nn/modules/module.py", line 1787 in _call_impl [10:39] [ComfyUI] File "/home/runner/.ce/.pixi/envs/sharp-nodes/lib/python3.11/site-packages/torch/nn/modules/module.py", line 1776 in _wrapped_call_impl [10:39] [ComfyUI] File "/home/runner/work/comfy-gpu-ci/comfy-gpu-ci/test_workspaces/Sharp-2211/ComfyUI/custom_nodes/ComfyUI-Sharp/nodes/sharp/model.py", line 310 in forward [10:39] [ComfyUI] File "/home/runner/.ce/.pixi/envs/sharp-nodes/lib/python3.11/site-packages/torch/nn/modules/module.py", line 1787 in _call_impl [10:39] [ComfyUI] File "/home/runner/.ce/.pixi/envs/sharp-nodes/lib/python3.11/site-packages/torch/nn/modules/module.py", line 1776 in _wrapped_call_impl [10:39] [ComfyUI] File "/home/runner/work/comfy-gpu-ci/comfy-gpu-ci/test_workspaces/Sharp-2211/ComfyUI/custom_nodes/ComfyUI-Sharp/nodes/sharp/model.py", line 412 in forward [10:39] [ComfyUI] File "/home/runner/.ce/.pixi/envs/sharp-nodes/lib/python3.11/site-packages/torch/nn/modules/module.py", line 1787 in _call_impl [10:39] [ComfyUI] File "/home/runner/.ce/.pixi/envs/sharp-nodes/lib/python3.11/site-packages/torch/nn/modules/module.py", line 1776 in _wrapped_call_impl [10:39] [ComfyUI] File "/home/runner/work/comfy-gpu-ci/comfy-gpu-ci/test_workspaces/Sharp-2211/ComfyUI/custom_nodes/ComfyUI-Sharp/nodes/sharp/model.py", line 685 in forward [10:39] [ComfyUI] File "/home/runner/.ce/.pixi/envs/sharp-nodes/lib/python3.11/site-packages/torch/nn/modules/module.py", line 1787 in _call_impl [10:39] [ComfyUI] File "/home/runner/.ce/.pixi/envs/sharp-nodes/lib/python3.11/site-packages/torch/nn/modules/module.py", line 1776 in _wrapped_call_impl [10:39] [ComfyUI] File "/home/runner/work/comfy-gpu-ci/comfy-gpu-ci/test_workspaces/Sharp-2211/ComfyUI/custom_nodes/ComfyUI-Sharp/nodes/sharp/model.py", line 1109 in forward [10:39] [ComfyUI] File "/home/runner/.ce/.pixi/envs/sharp-nodes/lib/python3.11/site-packages/torch/nn/modules/module.py", line 1787 in _call_impl [10:39] [ComfyUI] File "/home/runner/.ce/.pixi/envs/sharp-nodes/lib/python3.11/site-packages/torch/nn/modules/module.py", line 1776 in _wrapped_call_impl [10:39] [ComfyUI] File "/home/runner/work/comfy-gpu-ci/comfy-gpu-ci/test_workspaces/Sharp-2211/ComfyUI/custom_nodes/ComfyUI-Sharp/nodes/sharp/model.py", line 2006 in encode [10:39] [ComfyUI] File "/home/runner/work/comfy-gpu-ci/comfy-gpu-ci/test_workspaces/Sharp-2211/ComfyUI/custom_nodes/ComfyUI-Sharp/nodes/predict.py", line 348 in _predict_image_cached [10:39] [ComfyUI] File "/home/runner/work/comfy-gpu-ci/comfy-gpu-ci/test_workspaces/Sharp-2211/ComfyUI/custom_nodes/ComfyUI-Sharp/nodes/predict.py", line 239 in execute [10:39] [ComfyUI] File "/home/runner/.ce/.pixi/envs/sharp-nodes/lib/python3.11/site-packages/torch/utils/_contextlib.py", line 124 in decorate_context [10:39] [ComfyUI] File "/home/runner/work/comfy-gpu-ci/comfy-gpu-ci/test_workspaces/Sharp-2211/ComfyUI/comfy_api/latest/_io.py", line 1892 in EXECUTE_NORMALIZED [10:39] [ComfyUI] File "/tmp/comfyui_pvenv_1p20y9l5/persistent_worker.py", line 1762 in main [10:39] [ComfyUI] File "/tmp/comfyui_pvenv_1p20y9l5/persistent_worker.py", line 1807 in [10:39] [ComfyUI] [10:39] [ComfyUI] [worker:ComfyUI-Sharp] === END === [10:39] [ComfyUI] [10:41] [capture-loop] iter=550 t=62.2s state={'complete': False, 'error': None, 'executedCount': 0, 'wsState': 1} eval_ms=2 ram=5.5/15.6GB (35%) swap=0.0/3.0GB (0%) cpu=45% browser_rss=0.86GB [10:47] [capture-loop] iter=600 t=67.9s state={'complete': False, 'error': None, 'executedCount': 0, 'wsState': 1} eval_ms=2 ram=5.5/15.6GB (36%) swap=0.0/3.0GB (0%) cpu=45% browser_rss=0.86GB [10:52] [capture-loop] iter=650 t=73.5s state={'complete': False, 'error': None, 'executedCount': 0, 'wsState': 1} eval_ms=3 ram=5.5/15.6GB (36%) swap=0.0/3.0GB (0%) cpu=44% browser_rss=0.86GB [10:58] [capture-loop] iter=700 t=79.1s state={'complete': False, 'error': None, 'executedCount': 0, 'wsState': 1} eval_ms=3 ram=5.5/15.6GB (35%) swap=0.0/3.0GB (0%) cpu=44% browser_rss=0.86GB [11:04] [capture-loop] iter=750 t=84.8s state={'complete': False, 'error': None, 'executedCount': 0, 'wsState': 1} eval_ms=6 ram=5.6/15.6GB (36%) swap=0.0/3.0GB (0%) cpu=44% browser_rss=0.86GB [11:09] [capture-loop] iter=800 t=90.4s state={'complete': False, 'error': None, 'executedCount': 0, 'wsState': 1} eval_ms=3 ram=5.6/15.6GB (36%) swap=0.0/3.0GB (0%) cpu=45% browser_rss=0.86GB [11:15] [capture-loop] iter=850 t=96.0s state={'complete': False, 'error': None, 'executedCount': 0, 'wsState': 1} eval_ms=4 ram=5.6/15.6GB (36%) swap=0.0/3.0GB (0%) cpu=45% browser_rss=0.86GB [11:21] [capture-loop] iter=900 t=101.7s state={'complete': False, 'error': None, 'executedCount': 0, 'wsState': 1} eval_ms=3 ram=5.6/15.6GB (36%) swap=0.0/3.0GB (0%) cpu=45% browser_rss=0.87GB [11:26] [capture-loop] iter=950 t=107.2s state={'complete': False, 'error': None, 'executedCount': 0, 'wsState': 1} eval_ms=4 ram=5.6/15.6GB (36%) swap=0.0/3.0GB (0%) cpu=43% browser_rss=0.87GB [11:32] [capture-loop] iter=1000 t=112.9s state={'complete': False, 'error': None, 'executedCount': 0, 'wsState': 1} eval_ms=2 ram=5.6/15.6GB (36%) swap=0.0/3.0GB (0%) cpu=44% browser_rss=0.87GB [11:38] [capture-loop] iter=1050 t=118.6s state={'complete': False, 'error': None, 'executedCount': 0, 'wsState': 1} eval_ms=7 ram=5.6/15.6GB (36%) swap=0.0/3.0GB (0%) cpu=44% browser_rss=0.87GB [11:39] [ComfyUI] [worker:ComfyUI-Sharp] [11:39] [ComfyUI] === WATCHDOG TICK 2 === [11:39] [ComfyUI] [worker:ComfyUI-Sharp] Thread 0x00007feb878ab6c0 (most recent call first): [11:39] [ComfyUI] File "/home/runner/.ce/.pixi/envs/sharp-nodes/lib/python3.11/socket.py", line 294 in accept [11:39] [ComfyUI] File "/home/runner/.ce/.pixi/envs/sharp-nodes/lib/python3.11/multiprocessing/connection.py", line 626 in accept [11:39] [ComfyUI] File "/home/runner/.ce/.pixi/envs/sharp-nodes/lib/python3.11/multiprocessing/connection.py", line 480 in accept [11:39] [ComfyUI] File "/home/runner/.ce/.pixi/envs/sharp-nodes/lib/python3.11/multiprocessing/resource_sharer.py", line 138 in _serve [11:39] [ComfyUI] File "/home/runner/.ce/.pixi/envs/sharp-nodes/lib/python3.11/threading.py", line 982 in run [11:39] [ComfyUI] File "/home/runner/.ce/.pixi/envs/sharp-nodes/lib/python3.11/threading.py", line 1045 in _bootstrap_inner [11:39] [ComfyUI] File "/home/runner/.ce/.pixi/envs/sharp-nodes/lib/python3.11/threading.py", line 1002 in _bootstrap [11:39] [ComfyUI] [11:39] [ComfyUI] Current thread 0x00007feb888ac6c0 (most recent call first): [11:39] [ComfyUI] File "/tmp/comfyui_pvenv_1p20y9l5/persistent_worker.py", line 52 in _watchdog [11:39] [ComfyUI] File "/home/runner/.ce/.pixi/envs/sharp-nodes/lib/python3.11/threading.py", line 982 in run [11:39] [ComfyUI] File "/home/runner/.ce/.pixi/envs/sharp-nodes/lib/python3.11/threading.py", line 1045 in _bootstrap_inner [11:39] [ComfyUI] File "/home/runner/.ce/.pixi/envs/sharp-nodes/lib/python3.11/threading.py", line 1002 in _bootstrap [11:39] [ComfyUI] [11:39] [ComfyUI] Thread 0x00007feb893d3740 (most recent call first): [11:39] [ComfyUI] File "/home/runner/.ce/.pixi/envs/sharp-nodes/lib/python3.11/site-packages/torch/nn/modules/linear.py", line 134 in forward [11:39] [ComfyUI] File "/home/runner/work/comfy-gpu-ci/comfy-gpu-ci/test_workspaces/Sharp-2211/ComfyUI/comfy/ops.py", line 503 in forward [11:39] [ComfyUI] File "/home/runner/.ce/.pixi/envs/sharp-nodes/lib/python3.11/site-packages/torch/nn/modules/module.py", line 1787 in _call_impl [11:39] [ComfyUI] File "/home/runner/.ce/.pixi/envs/sharp-nodes/lib/python3.11/site-packages/torch/nn/modules/module.py", line 1776 in _wrapped_call_impl [11:39] [ComfyUI] File "/home/runner/work/comfy-gpu-ci/comfy-gpu-ci/test_workspaces/Sharp-2211/ComfyUI/custom_nodes/ComfyUI-Sharp/nodes/sharp/model.py", line 268 in forward [11:39] [ComfyUI] File "/home/runner/.ce/.pixi/envs/sharp-nodes/lib/python3.11/site-packages/torch/nn/modules/module.py", line 1787 in _call_impl [11:39] [ComfyUI] File "/home/runner/.ce/.pixi/envs/sharp-nodes/lib/python3.11/site-packages/torch/nn/modules/module.py", line 1776 in _wrapped_call_impl [11:39] [ComfyUI] File "/home/runner/work/comfy-gpu-ci/comfy-gpu-ci/test_workspaces/Sharp-2211/ComfyUI/custom_nodes/ComfyUI-Sharp/nodes/sharp/model.py", line 310 in forward [11:39] [ComfyUI] File "/home/runner/.ce/.pixi/envs/sharp-nodes/lib/python3.11/site-packages/torch/nn/modules/module.py", line 1787 in _call_impl [11:39] [ComfyUI] File "/home/runner/.ce/.pixi/envs/sharp-nodes/lib/python3.11/site-packages/torch/nn/modules/module.py", line 1776 in _wrapped_call_impl [11:39] [ComfyUI] File "/home/runner/work/comfy-gpu-ci/comfy-gpu-ci/test_workspaces/Sharp-2211/ComfyUI/custom_nodes/ComfyUI-Sharp/nodes/sharp/model.py", line 412 in forward [11:39] [ComfyUI] File "/home/runner/.ce/.pixi/envs/sharp-nodes/lib/python3.11/site-packages/torch/nn/modules/module.py", line 1787 in _call_impl [11:39] [ComfyUI] File "/home/runner/.ce/.pixi/envs/sharp-nodes/lib/python3.11/site-packages/torch/nn/modules/module.py", line 1776 in _wrapped_call_impl [11:39] [ComfyUI] File "/home/runner/work/comfy-gpu-ci/comfy-gpu-ci/test_workspaces/Sharp-2211/ComfyUI/custom_nodes/ComfyUI-Sharp/nodes/sharp/model.py", line 685 in forward [11:39] [ComfyUI] File "/home/runner/.ce/.pixi/envs/sharp-nodes/lib/python3.11/site-packages/torch/nn/modules/module.py", line 1787 in _call_impl [11:39] [ComfyUI] File "/home/runner/.ce/.pixi/envs/sharp-nodes/lib/python3.11/site-packages/torch/nn/modules/module.py", line 1776 in _wrapped_call_impl [11:39] [ComfyUI] File "/home/runner/work/comfy-gpu-ci/comfy-gpu-ci/test_workspaces/Sharp-2211/ComfyUI/custom_nodes/ComfyUI-Sharp/nodes/sharp/model.py", line 1109 in forward [11:39] [ComfyUI] File "/home/runner/.ce/.pixi/envs/sharp-nodes/lib/python3.11/site-packages/torch/nn/modules/module.py", line 1787 in _call_impl [11:39] [ComfyUI] File "/home/runner/.ce/.pixi/envs/sharp-nodes/lib/python3.11/site-packages/torch/nn/modules/module.py", line 1776 in _wrapped_call_impl [11:39] [ComfyUI] File "/home/runner/work/comfy-gpu-ci/comfy-gpu-ci/test_workspaces/Sharp-2211/ComfyUI/custom_nodes/ComfyUI-Sharp/nodes/sharp/model.py", line 2006 in encode [11:39] [ComfyUI] File "/home/runner/work/comfy-gpu-ci/comfy-gpu-ci/test_workspaces/Sharp-2211/ComfyUI/custom_nodes/ComfyUI-Sharp/nodes/predict.py", line 348 in _predict_image_cached [11:39] [ComfyUI] File "/home/runner/work/comfy-gpu-ci/comfy-gpu-ci/test_workspaces/Sharp-2211/ComfyUI/custom_nodes/ComfyUI-Sharp/nodes/predict.py", line 239 in execute [11:39] [ComfyUI] File "/home/runner/.ce/.pixi/envs/sharp-nodes/lib/python3.11/site-packages/torch/utils/_contextlib.py", line 124 in decorate_context [11:39] [ComfyUI] File "/home/runner/work/comfy-gpu-ci/comfy-gpu-ci/test_workspaces/Sharp-2211/ComfyUI/comfy_api/latest/_io.py", line 1892 in EXECUTE_NORMALIZED [11:39] [ComfyUI] File "/tmp/comfyui_pvenv_1p20y9l5/persistent_worker.py", line 1762 in main [11:39] [ComfyUI] File "/tmp/comfyui_pvenv_1p20y9l5/persistent_worker.py", line 1807 in [11:39] [ComfyUI] [11:39] [ComfyUI] [worker:ComfyUI-Sharp] === END === [11:39] [ComfyUI] [11:43] [capture-loop] iter=1100 t=124.1s state={'complete': False, 'error': None, 'executedCount': 0, 'wsState': 1} eval_ms=7 ram=5.7/15.6GB (37%) swap=0.0/3.0GB (0%) cpu=46% browser_rss=0.87GB [11:49] [capture-loop] iter=1150 t=129.8s state={'complete': False, 'error': None, 'executedCount': 0, 'wsState': 1} eval_ms=7 ram=5.6/15.6GB (36%) swap=0.0/3.0GB (0%) cpu=45% browser_rss=0.88GB [11:54] [capture-loop] iter=1200 t=135.3s state={'complete': False, 'error': None, 'executedCount': 0, 'wsState': 1} eval_ms=2 ram=5.7/15.6GB (36%) swap=0.0/3.0GB (0%) cpu=45% browser_rss=0.88GB [12:00] [capture-loop] iter=1250 t=141.0s state={'complete': False, 'error': None, 'executedCount': 0, 'wsState': 1} eval_ms=2 ram=5.7/15.6GB (36%) swap=0.0/3.0GB (0%) cpu=46% browser_rss=0.87GB [12:06] [capture-loop] iter=1300 t=146.7s state={'complete': False, 'error': None, 'executedCount': 0, 'wsState': 1} eval_ms=3 ram=5.6/15.6GB (36%) swap=0.0/3.0GB (0%) cpu=44% browser_rss=0.88GB [12:11] [capture-loop] iter=1350 t=152.4s state={'complete': False, 'error': None, 'executedCount': 0, 'wsState': 1} eval_ms=5 ram=5.7/15.6GB (36%) swap=0.0/3.0GB (0%) cpu=59% browser_rss=0.87GB [12:17] [capture-loop] iter=1400 t=158.1s state={'complete': False, 'error': None, 'executedCount': 0, 'wsState': 1} eval_ms=2 ram=5.7/15.6GB (36%) swap=0.0/3.0GB (0%) cpu=45% browser_rss=0.87GB [12:23] [capture-loop] iter=1450 t=163.8s state={'complete': False, 'error': None, 'executedCount': 0, 'wsState': 1} eval_ms=3 ram=5.7/15.6GB (36%) swap=0.0/3.0GB (0%) cpu=46% browser_rss=0.87GB [12:28] [capture-loop] iter=1500 t=169.3s state={'complete': False, 'error': None, 'executedCount': 0, 'wsState': 1} eval_ms=3 ram=5.7/15.6GB (36%) swap=0.0/3.0GB (0%) cpu=45% browser_rss=0.88GB [12:34] [capture-loop] iter=1550 t=175.0s state={'complete': False, 'error': None, 'executedCount': 0, 'wsState': 1} eval_ms=4 ram=5.7/15.6GB (36%) swap=0.0/3.0GB (0%) cpu=43% browser_rss=0.88GB [12:39] [ComfyUI] [worker:ComfyUI-Sharp] [12:39] [ComfyUI] === WATCHDOG TICK 3 === [12:39] [ComfyUI] [worker:ComfyUI-Sharp] Thread 0x00007feb878ab6c0 (most recent call first): [12:39] [ComfyUI] File "/home/runner/.ce/.pixi/envs/sharp-nodes/lib/python3.11/socket.py", line 294 in accept [12:39] [ComfyUI] File "/home/runner/.ce/.pixi/envs/sharp-nodes/lib/python3.11/multiprocessing/connection.py", line 626 in accept [12:39] [ComfyUI] File "/home/runner/.ce/.pixi/envs/sharp-nodes/lib/python3.11/multiprocessing/connection.py", line 480 in accept [12:39] [ComfyUI] File "/home/runner/.ce/.pixi/envs/sharp-nodes/lib/python3.11/multiprocessing/resource_sharer.py", line 138 in _serve [12:39] [ComfyUI] File "/home/runner/.ce/.pixi/envs/sharp-nodes/lib/python3.11/threading.py", line 982 in run [12:39] [ComfyUI] File "/home/runner/.ce/.pixi/envs/sharp-nodes/lib/python3.11/threading.py", line 1045 in _bootstrap_inner [12:39] [ComfyUI] File "/home/runner/.ce/.pixi/envs/sharp-nodes/lib/python3.11/threading.py", line 1002 in _bootstrap [12:39] [ComfyUI] [12:39] [ComfyUI] Current thread 0x00007feb888ac6c0 (most recent call first): [12:39] [ComfyUI] File "/tmp/comfyui_pvenv_1p20y9l5/persistent_worker.py", line 52 in _watchdog [12:39] [ComfyUI] File "/home/runner/.ce/.pixi/envs/sharp-nodes/lib/python3.11/threading.py", line 982 in run [12:39] [ComfyUI] File "/home/runner/.ce/.pixi/envs/sharp-nodes/lib/python3.11/threading.py", line 1045 in _bootstrap_inner [12:39] [ComfyUI] File "/home/runner/.ce/.pixi/envs/sharp-nodes/lib/python3.11/threading.py", line 1002 in _bootstrap [12:39] [ComfyUI] [12:39] [ComfyUI] Thread 0x00007feb893d3740 (most recent call first): [12:39] [ComfyUI] File "/home/runner/.ce/.pixi/envs/sharp-nodes/lib/python3.11/site-packages/torch/nn/modules/linear.py", line 134 in forward [12:39] [ComfyUI] File "/home/runner/work/comfy-gpu-ci/comfy-gpu-ci/test_workspaces/Sharp-2211/ComfyUI/comfy/ops.py", line 503 in forward [12:39] [ComfyUI] File "/home/runner/.ce/.pixi/envs/sharp-nodes/lib/python3.11/site-packages/torch/nn/modules/module.py", line 1787 in _call_impl [12:39] [ComfyUI] File "/home/runner/.ce/.pixi/envs/sharp-nodes/lib/python3.11/site-packages/torch/nn/modules/module.py", line 1776 in _wrapped_call_impl [12:39] [ComfyUI] File "/home/runner/work/comfy-gpu-ci/comfy-gpu-ci/test_workspaces/Sharp-2211/ComfyUI/custom_nodes/ComfyUI-Sharp/nodes/sharp/model.py", line 232 in forward [12:39] [ComfyUI] File "/home/runner/.ce/.pixi/envs/sharp-nodes/lib/python3.11/site-packages/torch/nn/modules/module.py", line 1787 in _call_impl [12:39] [ComfyUI] File "/home/runner/.ce/.pixi/envs/sharp-nodes/lib/python3.11/site-packages/torch/nn/modules/module.py", line 1776 in _wrapped_call_impl [12:39] [ComfyUI] File "/home/runner/work/comfy-gpu-ci/comfy-gpu-ci/test_workspaces/Sharp-2211/ComfyUI/custom_nodes/ComfyUI-Sharp/nodes/sharp/model.py", line 309 in forward [12:39] [ComfyUI] File "/home/runner/.ce/.pixi/envs/sharp-nodes/lib/python3.11/site-packages/torch/nn/modules/module.py", line 1787 in _call_impl [12:39] [ComfyUI] File "/home/runner/.ce/.pixi/envs/sharp-nodes/lib/python3.11/site-packages/torch/nn/modules/module.py", line 1776 in _wrapped_call_impl [12:39] [ComfyUI] File "/home/runner/work/comfy-gpu-ci/comfy-gpu-ci/test_workspaces/Sharp-2211/ComfyUI/custom_nodes/ComfyUI-Sharp/nodes/sharp/model.py", line 412 in forward [12:39] [ComfyUI] File "/home/runner/.ce/.pixi/envs/sharp-nodes/lib/python3.11/site-packages/torch/nn/modules/module.py", line 1787 in _call_impl [12:39] [ComfyUI] File "/home/runner/.ce/.pixi/envs/sharp-nodes/lib/python3.11/site-packages/torch/nn/modules/module.py", line 1776 in _wrapped_call_impl [12:39] [ComfyUI] File "/home/runner/work/comfy-gpu-ci/comfy-gpu-ci/test_workspaces/Sharp-2211/ComfyUI/custom_nodes/ComfyUI-Sharp/nodes/sharp/model.py", line 685 in forward [12:39] [ComfyUI] File "/home/runner/.ce/.pixi/envs/sharp-nodes/lib/python3.11/site-packages/torch/nn/modules/module.py", line 1787 in _call_impl [12:39] [ComfyUI] File "/home/runner/.ce/.pixi/envs/sharp-nodes/lib/python3.11/site-packages/torch/nn/modules/module.py", line 1776 in _wrapped_call_impl [12:39] [ComfyUI] File "/home/runner/work/comfy-gpu-ci/comfy-gpu-ci/test_workspaces/Sharp-2211/ComfyUI/custom_nodes/ComfyUI-Sharp/nodes/sharp/model.py", line 1109 in forward [12:39] [ComfyUI] File "/home/runner/.ce/.pixi/envs/sharp-nodes/lib/python3.11/site-packages/torch/nn/modules/module.py", line 1787 in _call_impl [12:39] [ComfyUI] File "/home/runner/.ce/.pixi/envs/sharp-nodes/lib/python3.11/site-packages/torch/nn/modules/module.py", line 1776 in _wrapped_call_impl [12:39] [ComfyUI] File "/home/runner/work/comfy-gpu-ci/comfy-gpu-ci/test_workspaces/Sharp-2211/ComfyUI/custom_nodes/ComfyUI-Sharp/nodes/sharp/model.py", line 2006 in encode [12:39] [ComfyUI] File "/home/runner/work/comfy-gpu-ci/comfy-gpu-ci/test_workspaces/Sharp-2211/ComfyUI/custom_nodes/ComfyUI-Sharp/nodes/predict.py", line 348 in _predict_image_cached [12:39] [ComfyUI] File "/home/runner/work/comfy-gpu-ci/comfy-gpu-ci/test_workspaces/Sharp-2211/ComfyUI/custom_nodes/ComfyUI-Sharp/nodes/predict.py", line 239 in execute [12:39] [ComfyUI] File "/home/runner/.ce/.pixi/envs/sharp-nodes/lib/python3.11/site-packages/torch/utils/_contextlib.py", line 124 in decorate_context [12:39] [ComfyUI] File "/home/runner/work/comfy-gpu-ci/comfy-gpu-ci/test_workspaces/Sharp-2211/ComfyUI/comfy_api/latest/_io.py", line 1892 in EXECUTE_NORMALIZED [12:39] [ComfyUI] File "/tmp/comfyui_pvenv_1p20y9l5/persistent_worker.py", line 1762 in main [12:39] [ComfyUI] File "/tmp/comfyui_pvenv_1p20y9l5/persistent_worker.py", line 1807 in [12:39] [ComfyUI] [12:39] [ComfyUI] [worker:ComfyUI-Sharp] === END === [12:39] [ComfyUI] [12:39] [capture-loop] iter=1600 t=180.5s state={'complete': False, 'error': None, 'executedCount': 0, 'wsState': 1} eval_ms=3 ram=5.8/15.6GB (37%) swap=0.0/3.0GB (0%) cpu=44% browser_rss=0.87GB [12:45] [capture-loop] iter=1650 t=186.3s state={'complete': False, 'error': None, 'executedCount': 0, 'wsState': 1} eval_ms=3 ram=5.7/15.6GB (36%) swap=0.0/3.0GB (0%) cpu=46% browser_rss=0.88GB [12:51] [capture-loop] iter=1700 t=191.9s state={'complete': False, 'error': None, 'executedCount': 0, 'wsState': 1} eval_ms=5 ram=5.7/15.6GB (36%) swap=0.0/3.0GB (0%) cpu=44% browser_rss=0.88GB [12:56] [capture-loop] iter=1750 t=197.5s state={'complete': False, 'error': None, 'executedCount': 0, 'wsState': 1} eval_ms=2 ram=5.7/15.6GB (37%) swap=0.0/3.0GB (0%) cpu=45% browser_rss=0.88GB [13:02] [capture-loop] iter=1800 t=203.2s state={'complete': False, 'error': None, 'executedCount': 0, 'wsState': 1} eval_ms=2 ram=5.8/15.6GB (37%) swap=0.0/3.0GB (0%) cpu=46% browser_rss=0.88GB [13:08] [capture-loop] iter=1850 t=208.7s state={'complete': False, 'error': None, 'executedCount': 0, 'wsState': 1} eval_ms=3 ram=5.8/15.6GB (37%) swap=0.0/3.0GB (0%) cpu=46% browser_rss=0.87GB [13:13] [capture-loop] iter=1900 t=214.5s state={'complete': False, 'error': None, 'executedCount': 0, 'wsState': 1} eval_ms=3 ram=5.8/15.6GB (37%) swap=0.0/3.0GB (0%) cpu=46% browser_rss=0.88GB [13:19] [capture-loop] iter=1950 t=220.1s state={'complete': False, 'error': None, 'executedCount': 0, 'wsState': 1} eval_ms=3 ram=5.8/15.6GB (37%) swap=0.0/3.0GB (0%) cpu=45% browser_rss=0.87GB [13:25] [capture-loop] iter=2000 t=225.7s state={'complete': False, 'error': None, 'executedCount': 0, 'wsState': 1} eval_ms=4 ram=5.5/15.6GB (35%) swap=0.0/3.0GB (0%) cpu=43% browser_rss=0.87GB [13:30] [capture-loop] iter=2050 t=231.3s state={'complete': False, 'error': None, 'executedCount': 0, 'wsState': 1} eval_ms=2 ram=6.2/15.6GB (40%) swap=0.0/3.0GB (0%) cpu=46% browser_rss=0.88GB [13:36] [capture-loop] iter=2100 t=237.0s state={'complete': False, 'error': None, 'executedCount': 0, 'wsState': 1} eval_ms=5 ram=6.3/15.6GB (41%) swap=0.0/3.0GB (0%) cpu=44% browser_rss=0.88GB [13:39] [ComfyUI] [worker:ComfyUI-Sharp] [13:39] [ComfyUI] === WATCHDOG TICK 4 === [13:39] [ComfyUI] [worker:ComfyUI-Sharp] Thread 0x00007feb878ab6c0 (most recent call first): [13:39] [ComfyUI] File "/home/runner/.ce/.pixi/envs/sharp-nodes/lib/python3.11/socket.py", line 294 in accept [13:39] [ComfyUI] File "/home/runner/.ce/.pixi/envs/sharp-nodes/lib/python3.11/multiprocessing/connection.py", line 626 in accept [13:39] [ComfyUI] File "/home/runner/.ce/.pixi/envs/sharp-nodes/lib/python3.11/multiprocessing/connection.py", line 480 in accept [13:39] [ComfyUI] File "/home/runner/.ce/.pixi/envs/sharp-nodes/lib/python3.11/multiprocessing/resource_sharer.py", line 138 in _serve [13:39] [ComfyUI] File "/home/runner/.ce/.pixi/envs/sharp-nodes/lib/python3.11/threading.py", line 982 in run [13:39] [ComfyUI] File "/home/runner/.ce/.pixi/envs/sharp-nodes/lib/python3.11/threading.py", line 1045 in _bootstrap_inner [13:39] [ComfyUI] File "/home/runner/.ce/.pixi/envs/sharp-nodes/lib/python3.11/threading.py", line 1002 in _bootstrap [13:39] [ComfyUI] [13:39] [ComfyUI] Current thread 0x00007feb888ac6c0 (most recent call first): [13:39] [ComfyUI] File "/tmp/comfyui_pvenv_1p20y9l5/persistent_worker.py", line 52 in _watchdog [13:39] [ComfyUI] File "/home/runner/.ce/.pixi/envs/sharp-nodes/lib/python3.11/threading.py", line 982 in run [13:39] [ComfyUI] File "/home/runner/.ce/.pixi/envs/sharp-nodes/lib/python3.11/threading.py", line 1045 in _bootstrap_inner [13:39] [ComfyUI] File "/home/runner/.ce/.pixi/envs/sharp-nodes/lib/python3.11/threading.py", line 1002 in _bootstrap [13:39] [ComfyUI] [13:39] [ComfyUI] Thread 0x00007feb893d3740 (most recent call first): [13:39] [ComfyUI] File "/home/runner/.ce/.pixi/envs/sharp-nodes/lib/python3.11/site-packages/torch/nn/modules/conv.py", line 548 in _conv_forward [13:39] [ComfyUI] File "/home/runner/.ce/.pixi/envs/sharp-nodes/lib/python3.11/site-packages/torch/nn/modules/conv.py", line 553 in forward [13:39] [ComfyUI] File "/home/runner/work/comfy-gpu-ci/comfy-gpu-ci/test_workspaces/Sharp-2211/ComfyUI/comfy/ops.py", line 537 in forward [13:39] [ComfyUI] File "/home/runner/.ce/.pixi/envs/sharp-nodes/lib/python3.11/site-packages/torch/nn/modules/module.py", line 1787 in _call_impl [13:39] [ComfyUI] File "/home/runner/.ce/.pixi/envs/sharp-nodes/lib/python3.11/site-packages/torch/nn/modules/module.py", line 1776 in _wrapped_call_impl [13:39] [ComfyUI] File "/home/runner/.ce/.pixi/envs/sharp-nodes/lib/python3.11/site-packages/torch/nn/modules/container.py", line 253 in forward [13:39] [ComfyUI] File "/home/runner/.ce/.pixi/envs/sharp-nodes/lib/python3.11/site-packages/torch/nn/modules/module.py", line 1787 in _call_impl [13:39] [ComfyUI] File "/home/runner/.ce/.pixi/envs/sharp-nodes/lib/python3.11/site-packages/torch/nn/modules/module.py", line 1776 in _wrapped_call_impl [13:39] [ComfyUI] File "/home/runner/work/comfy-gpu-ci/comfy-gpu-ci/test_workspaces/Sharp-2211/ComfyUI/custom_nodes/ComfyUI-Sharp/nodes/sharp/model.py", line 766 in forward [13:39] [ComfyUI] File "/home/runner/.ce/.pixi/envs/sharp-nodes/lib/python3.11/site-packages/torch/nn/modules/module.py", line 1787 in _call_impl [13:39] [ComfyUI] File "/home/runner/.ce/.pixi/envs/sharp-nodes/lib/python3.11/site-packages/torch/nn/modules/module.py", line 1776 in _wrapped_call_impl [13:39] [ComfyUI] File "/home/runner/work/comfy-gpu-ci/comfy-gpu-ci/test_workspaces/Sharp-2211/ComfyUI/custom_nodes/ComfyUI-Sharp/nodes/sharp/model.py", line 858 in forward [13:39] [ComfyUI] File "/home/runner/.ce/.pixi/envs/sharp-nodes/lib/python3.11/site-packages/torch/nn/modules/module.py", line 1787 in _call_impl [13:39] [ComfyUI] File "/home/runner/.ce/.pixi/envs/sharp-nodes/lib/python3.11/site-packages/torch/nn/modules/module.py", line 1776 in _wrapped_call_impl [13:39] [ComfyUI] File "/home/runner/work/comfy-gpu-ci/comfy-gpu-ci/test_workspaces/Sharp-2211/ComfyUI/custom_nodes/ComfyUI-Sharp/nodes/sharp/model.py", line 970 in forward [13:39] [ComfyUI] File "/home/runner/.ce/.pixi/envs/sharp-nodes/lib/python3.11/site-packages/torch/nn/modules/module.py", line 1787 in _call_impl [13:39] [ComfyUI] File "/home/runner/.ce/.pixi/envs/sharp-nodes/lib/python3.11/site-packages/torch/nn/modules/module.py", line 1776 in _wrapped_call_impl [13:39] [ComfyUI] File "/home/runner/work/comfy-gpu-ci/comfy-gpu-ci/test_workspaces/Sharp-2211/ComfyUI/custom_nodes/ComfyUI-Sharp/nodes/sharp/model.py", line 1118 in forward [13:39] [ComfyUI] File "/home/runner/.ce/.pixi/envs/sharp-nodes/lib/python3.11/site-packages/torch/nn/modules/module.py", line 1787 in _call_impl [13:39] [ComfyUI] File "/home/runner/.ce/.pixi/envs/sharp-nodes/lib/python3.11/site-packages/torch/nn/modules/module.py", line 1776 in _wrapped_call_impl [13:39] [ComfyUI] File "/home/runner/work/comfy-gpu-ci/comfy-gpu-ci/test_workspaces/Sharp-2211/ComfyUI/custom_nodes/ComfyUI-Sharp/nodes/sharp/model.py", line 2006 in encode [13:39] [ComfyUI] File "/home/runner/work/comfy-gpu-ci/comfy-gpu-ci/test_workspaces/Sharp-2211/ComfyUI/custom_nodes/ComfyUI-Sharp/nodes/predict.py", line 348 in _predict_image_cached [13:39] [ComfyUI] File "/home/runner/work/comfy-gpu-ci/comfy-gpu-ci/test_workspaces/Sharp-2211/ComfyUI/custom_nodes/ComfyUI-Sharp/nodes/predict.py", line 239 in execute [13:39] [ComfyUI] File "/home/runner/.ce/.pixi/envs/sharp-nodes/lib/python3.11/site-packages/torch/utils/_contextlib.py", line 124 in decorate_context [13:39] [ComfyUI] File "/home/runner/work/comfy-gpu-ci/comfy-gpu-ci/test_workspaces/Sharp-2211/ComfyUI/comfy_api/latest/_io.py", line 1892 in EXECUTE_NORMALIZED [13:39] [ComfyUI] File "/tmp/comfyui_pvenv_1p20y9l5/persistent_worker.py", line 1762 in main [13:39] [ComfyUI] File "/tmp/comfyui_pvenv_1p20y9l5/persistent_worker.py", line 1807 in [13:39] [ComfyUI] [13:39] [ComfyUI] [worker:ComfyUI-Sharp] === END === [13:39] [ComfyUI] [13:42] [capture-loop] iter=2150 t=242.6s state={'complete': False, 'error': None, 'executedCount': 0, 'wsState': 1} eval_ms=2 ram=6.5/15.6GB (42%) swap=0.0/3.0GB (0%) cpu=44% browser_rss=0.88GB [13:47] [capture-loop] iter=2200 t=248.3s state={'complete': False, 'error': None, 'executedCount': 0, 'wsState': 1} eval_ms=2 ram=6.8/15.6GB (44%) swap=0.0/3.0GB (0%) cpu=47% browser_rss=0.87GB [13:53] [capture-loop] iter=2250 t=253.9s state={'complete': False, 'error': None, 'executedCount': 0, 'wsState': 1} eval_ms=2 ram=7.2/15.6GB (46%) swap=0.0/3.0GB (0%) cpu=46% browser_rss=0.87GB [13:59] [capture-loop] iter=2300 t=259.6s state={'complete': False, 'error': None, 'executedCount': 0, 'wsState': 1} eval_ms=4 ram=7.6/15.6GB (49%) swap=0.0/3.0GB (0%) cpu=45% browser_rss=0.87GB [14:04] [capture-loop] iter=2350 t=265.3s state={'complete': False, 'error': None, 'executedCount': 0, 'wsState': 1} eval_ms=3 ram=7.4/15.6GB (47%) swap=0.0/3.0GB (0%) cpu=46% browser_rss=0.87GB [14:10] [capture-loop] iter=2400 t=270.8s state={'complete': False, 'error': None, 'executedCount': 0, 'wsState': 1} eval_ms=5 ram=7.8/15.6GB (50%) swap=0.0/3.0GB (0%) cpu=44% browser_rss=0.87GB [14:15] [capture-loop] iter=2450 t=276.5s state={'complete': False, 'error': None, 'executedCount': 0, 'wsState': 1} eval_ms=3 ram=9.4/15.6GB (60%) swap=0.0/3.0GB (0%) cpu=46% browser_rss=0.87GB [14:21] [capture-loop] iter=2500 t=282.1s state={'complete': False, 'error': None, 'executedCount': 0, 'wsState': 1} eval_ms=2 ram=9.6/15.6GB (62%) swap=0.0/3.0GB (0%) cpu=44% browser_rss=0.86GB [14:27] [capture-loop] iter=2550 t=287.8s state={'complete': False, 'error': None, 'executedCount': 0, 'wsState': 1} eval_ms=4 ram=9.5/15.6GB (61%) swap=0.0/3.0GB (0%) cpu=45% browser_rss=0.87GB [14:32] [capture-loop] iter=2600 t=293.5s state={'complete': False, 'error': None, 'executedCount': 0, 'wsState': 1} eval_ms=2 ram=7.7/15.6GB (50%) swap=0.0/3.0GB (0%) cpu=44% browser_rss=0.87GB [14:38] [capture-loop] iter=2650 t=299.0s state={'complete': False, 'error': None, 'executedCount': 0, 'wsState': 1} eval_ms=6 ram=8.7/15.6GB (56%) swap=0.0/3.0GB (0%) cpu=45% browser_rss=0.87GB [14:39] [ComfyUI] [worker:ComfyUI-Sharp] [14:39] [ComfyUI] === WATCHDOG TICK 5 === [14:39] [ComfyUI] [worker:ComfyUI-Sharp] Thread 0x00007feb878ab6c0 (most recent call first): [14:39] [ComfyUI] File "/home/runner/.ce/.pixi/envs/sharp-nodes/lib/python3.11/socket.py", line 294 in accept [14:39] [ComfyUI] File "/home/runner/.ce/.pixi/envs/sharp-nodes/lib/python3.11/multiprocessing/connection.py", line 626 in accept [14:39] [ComfyUI] File "/home/runner/.ce/.pixi/envs/sharp-nodes/lib/python3.11/multiprocessing/connection.py", line 480 in accept [14:39] [ComfyUI] File "/home/runner/.ce/.pixi/envs/sharp-nodes/lib/python3.11/multiprocessing/resource_sharer.py", line 138 in _serve [14:39] [ComfyUI] File "/home/runner/.ce/.pixi/envs/sharp-nodes/lib/python3.11/threading.py", line 982 in run [14:39] [ComfyUI] File "/home/runner/.ce/.pixi/envs/sharp-nodes/lib/python3.11/threading.py", line 1045 in _bootstrap_inner [14:39] [ComfyUI] File "/home/runner/.ce/.pixi/envs/sharp-nodes/lib/python3.11/threading.py", line 1002 in _bootstrap [14:39] [ComfyUI] [14:39] [ComfyUI] Current thread 0x00007feb888ac6c0 (most recent call first): [14:39] [ComfyUI] File "/tmp/comfyui_pvenv_1p20y9l5/persistent_worker.py", line 52 in _watchdog [14:39] [ComfyUI] File "/home/runner/.ce/.pixi/envs/sharp-nodes/lib/python3.11/threading.py", line 982 in run [14:39] [ComfyUI] File "/home/runner/.ce/.pixi/envs/sharp-nodes/lib/python3.11/threading.py", line 1045 in _bootstrap_inner [14:39] [ComfyUI] File "/home/runner/.ce/.pixi/envs/sharp-nodes/lib/python3.11/threading.py", line 1002 in _bootstrap [14:39] [ComfyUI] [14:39] [ComfyUI] Thread 0x00007feb893d3740 (most recent call first): [14:39] [ComfyUI] File "/home/runner/.ce/.pixi/envs/sharp-nodes/lib/python3.11/site-packages/torch/nn/modules/conv.py", line 1184 in forward [14:39] [ComfyUI] File "/home/runner/work/comfy-gpu-ci/comfy-gpu-ci/test_workspaces/Sharp-2211/ComfyUI/comfy/ops.py", line 670 in forward [14:39] [ComfyUI] File "/home/runner/.ce/.pixi/envs/sharp-nodes/lib/python3.11/site-packages/torch/nn/modules/module.py", line 1787 in _call_impl [14:39] [ComfyUI] File "/home/runner/.ce/.pixi/envs/sharp-nodes/lib/python3.11/site-packages/torch/nn/modules/module.py", line 1776 in _wrapped_call_impl [14:39] [ComfyUI] File "/home/runner/.ce/.pixi/envs/sharp-nodes/lib/python3.11/site-packages/torch/nn/modules/container.py", line 253 in forward [14:39] [ComfyUI] File "/home/runner/.ce/.pixi/envs/sharp-nodes/lib/python3.11/site-packages/torch/nn/modules/module.py", line 1787 in _call_impl [14:39] [ComfyUI] File "/home/runner/.ce/.pixi/envs/sharp-nodes/lib/python3.11/site-packages/torch/nn/modules/module.py", line 1776 in _wrapped_call_impl [14:39] [ComfyUI] File "/home/runner/work/comfy-gpu-ci/comfy-gpu-ci/test_workspaces/Sharp-2211/ComfyUI/custom_nodes/ComfyUI-Sharp/nodes/sharp/model.py", line 1120 in forward [14:39] [ComfyUI] File "/home/runner/.ce/.pixi/envs/sharp-nodes/lib/python3.11/site-packages/torch/nn/modules/module.py", line 1787 in _call_impl [14:39] [ComfyUI] File "/home/runner/.ce/.pixi/envs/sharp-nodes/lib/python3.11/site-packages/torch/nn/modules/module.py", line 1776 in _wrapped_call_impl [14:39] [ComfyUI] File "/home/runner/work/comfy-gpu-ci/comfy-gpu-ci/test_workspaces/Sharp-2211/ComfyUI/custom_nodes/ComfyUI-Sharp/nodes/sharp/model.py", line 2006 in encode [14:39] [ComfyUI] File "/home/runner/work/comfy-gpu-ci/comfy-gpu-ci/test_workspaces/Sharp-2211/ComfyUI/custom_nodes/ComfyUI-Sharp/nodes/predict.py", line 348 in _predict_image_cached [14:39] [ComfyUI] File "/home/runner/work/comfy-gpu-ci/comfy-gpu-ci/test_workspaces/Sharp-2211/ComfyUI/custom_nodes/ComfyUI-Sharp/nodes/predict.py", line 239 in execute [14:39] [ComfyUI] File "/home/runner/.ce/.pixi/envs/sharp-nodes/lib/python3.11/site-packages/torch/utils/_contextlib.py", line 124 in decorate_context [14:39] [ComfyUI] File "/home/runner/work/comfy-gpu-ci/comfy-gpu-ci/test_workspaces/Sharp-2211/ComfyUI/comfy_api/latest/_io.py", line 1892 in EXECUTE_NORMALIZED [14:39] [ComfyUI] File "/tmp/comfyui_pvenv_1p20y9l5/persistent_worker.py", line 1762 in main [14:39] [ComfyUI] File "/tmp/comfyui_pvenv_1p20y9l5/persistent_worker.py", line 1807 in [14:39] [ComfyUI] [14:39] [ComfyUI] [worker:ComfyUI-Sharp] === END === [14:39] [ComfyUI] [14:44] [capture-loop] iter=2700 t=304.7s state={'complete': False, 'error': None, 'executedCount': 0, 'wsState': 1} eval_ms=4 ram=8.2/15.6GB (53%) swap=0.0/3.0GB (0%) cpu=45% browser_rss=0.86GB [14:49] [capture-loop] iter=2750 t=310.4s state={'complete': False, 'error': None, 'executedCount': 0, 'wsState': 1} eval_ms=8 ram=7.3/15.6GB (47%) swap=0.0/3.0GB (0%) cpu=46% browser_rss=0.86GB [14:55] [capture-loop] iter=2800 t=316.0s state={'complete': False, 'error': None, 'executedCount': 0, 'wsState': 1} eval_ms=2 ram=7.8/15.6GB (50%) swap=0.0/3.0GB (0%) cpu=46% browser_rss=0.86GB [15:01] [capture-loop] iter=2850 t=321.7s state={'complete': False, 'error': None, 'executedCount': 0, 'wsState': 1} eval_ms=3 ram=8.8/15.6GB (56%) swap=0.0/3.0GB (0%) cpu=46% browser_rss=0.85GB [15:06] [capture-loop] iter=2900 t=327.2s state={'complete': False, 'error': None, 'executedCount': 0, 'wsState': 1} eval_ms=5 ram=8.0/15.6GB (51%) swap=0.0/3.0GB (0%) cpu=45% browser_rss=0.85GB [15:12] [capture-loop] iter=2950 t=332.9s state={'complete': False, 'error': None, 'executedCount': 0, 'wsState': 1} eval_ms=3 ram=8.1/15.6GB (52%) swap=0.0/3.0GB (0%) cpu=45% browser_rss=0.85GB [15:17] [capture-loop] iter=3000 t=338.5s state={'complete': False, 'error': None, 'executedCount': 0, 'wsState': 1} eval_ms=4 ram=7.8/15.6GB (50%) swap=0.0/3.0GB (0%) cpu=46% browser_rss=0.85GB [15:23] [capture-loop] iter=3050 t=344.1s state={'complete': False, 'error': None, 'executedCount': 0, 'wsState': 1} eval_ms=2 ram=7.0/15.6GB (45%) swap=0.0/3.0GB (0%) cpu=45% browser_rss=0.85GB [15:25] [ComfyUI] [SubprocessWorker] callback 'report_progress' from call_id=5 [15:25] [ComfyUI] [SubprocessWorker] got response: ok [15:25] [ComfyUI] [comfy-env] SharpPredict done (344.13s): result: NodeOutput [15:25] [ComfyUI] [comfy-env] Running PreviewGaussianSharp: ply_path: '/home/runner/work/comfy-gpu-ci/comfy-gpu-ci/test_workspa..., extrinsics: list[4], intrinsics: list[3] [15:25] [ComfyUI] [SubprocessWorker] call_method: nodes.preview_gaussian_sharp.PreviewGaussianSharp.EXECUTE_NORMALIZED [15:25] [ComfyUI] [SubprocessWorker] acquired lock, ensuring started... [15:25] [ComfyUI] [ComfyUI-GaussianPack] Health check: ping (timeout=5.0s)... [15:25] [ComfyUI] [ComfyUI-GaussianPack] Health check: failed [15:25] [ComfyUI] [ComfyUI-GaussianPack] Socket unhealthy, restarting worker... [15:25] [ComfyUI] [ComfyUI-GaussianPack] python: /home/runner/.ce/.pixi/envs/gaussianpack-nodes/bin/python [15:25] [ComfyUI] [ComfyUI-GaussianPack] sys_path sent to worker: ['/home/runner/work/comfy-gpu-ci/comfy-gpu-ci/test_workspaces/Sharp-2211/ComfyUI', '/home/runner/work/comfy-gpu-ci/comfy-gpu-ci/test_workspaces/Sharp-2211/ComfyUI/custom_nodes/ComfyUI-GaussianPack', '/home/runner/.ce/.pixi/envs/gaussianpack-nodes/lib/python3.11/site-packages', '/home/runner/work/comfy-gpu-ci/comfy-gpu-ci/test_workspaces/Sharp-2211/ComfyUI/custom_nodes/ComfyUI-GaussianPack'] [15:25] [ComfyUI] [SubprocessWorker] is_pixi=True, python=/home/runner/.ce/.pixi/envs/gaussianpack-nodes/bin/python [15:25] [ComfyUI] [SubprocessWorker] launching cmd=['/home/runner/.pixi/bin/pixi', 'run', '--as-is', '--manifest-path', '/home/runner/.ce/pixi.toml', '-e', 'gaussianpack-nodes', 'python', '/tmp/comfyui_pvenv_w5l8haz9/persistent_worker.py', 'abstract://comfy_worker_0d93576b864b']... [15:25] [ComfyUI] [SubprocessWorker] socket_addr=abstract://comfy_worker_0d93576b864b (abstract, no filesystem path) [15:26] Frame 4 saved (frame_003.jpg, t=346.6s) [15:26] [capture-periodic] freeze=3ms shot=196ms unfreeze=30ms saved=True [15:27] [ComfyUI] [SubprocessWorker] worker started/confirmed [15:27] [ComfyUI] [SubprocessWorker] serializing kwargs to shm... [15:27] [ComfyUI] [SubprocessWorker] created 0 shm blocks [15:27] [ComfyUI] [SubprocessWorker] sending request via socket... [15:27] [ComfyUI] [SubprocessWorker] call_id=2 sending call_method [15:27] [ComfyUI] [worker:ComfyUI-GaussianPack] WARNING: SPZ route not registered (ModuleNotFoundError: No module named 'comfy_aimdo') [15:27] [ComfyUI] [SubprocessWorker] got response: ok [15:27] [ComfyUI] [comfy-env] PreviewGaussianSharp done (1.97s): result: NodeOutput [15:27] [ComfyUI] [INFO] Prompt executed in 348.18 seconds [15:28] Node executed (1 total), capturing... [15:29] Frame 5 saved (frame_004.jpg, t=349.0s) [15:29] [capture-node] freeze=792ms shot=317ms unfreeze=0ms saved=True [15:29] Execution complete (t=349.0s) [15:29] [3d-wait] Phase 1: Waiting for 'Loading 3D Model' text to disappear... [15:29] [3d-wait] Phase 1 done in 0.0s [15:29] [3d-wait] Phase 2: iframes=1 [15:29] [3d-wait] iframe viewer_ready=True (matched 1 console logs) [15:29] [3d-wait] Unfrozen in 0.002s, rendering for 5s... [15:39] [3d-wait] JS halted via CDP after 10.2s [16:10] [3d-wait] Re-frozen in 41.0s [16:10] [3d-wait] Total 3D wait: 41.0s [16:10] Captured 5 unique frames over 391.07s [16:10] [debug] iframes: 1 [16:10] [debug] iframe[0]: src=http://127.0.0.1:41888/extensions/ComfyUI-GaussianPack/viewer_gaussian_sharp.htm, canvas=1520x1011, rafFrozen=True [16:10] [timing] trigger_3d_previews: 0.0s [16:12] Saved high-quality screenshot: sharp_exif_executed.png [16:12] [timing] final_screenshot: 0.3s [16:12] [ComfyUI] [INFO] Using RAM pressure cache. [16:13] Capturing execution frames: vanilla_vs_image_depth_gaussians.json [16:13] [ComfyUI] [INFO] Using RAM pressure cache. [16:19] Frame 1 saved (frame_000.jpg, t=0.0s) [16:19] Validating workflow... [16:19] [ComfyUI] [INFO] === /validate endpoint called === [16:19] [ComfyUI] [INFO] Received JSON with keys: ['prompt'] [16:19] [ComfyUI] [INFO] Prompt has 8 nodes [16:19] [ComfyUI] [INFO] Node 7: LoadImage [16:19] [ComfyUI] [INFO] Inputs: {"image": "middlebury.jpg"} [16:19] [ComfyUI] [INFO] Node 9: LoadSharpModel [16:19] [ComfyUI] [INFO] Inputs: {"precision": "auto"} [16:19] [ComfyUI] [INFO] Node 47: SharpPredictMetricDepth [16:19] [ComfyUI] [INFO] Inputs: {"focal_length_mm": 30, "model": ["9", 0], "image": ["7", 0]} [16:19] [ComfyUI] [INFO] Node 57: SharpPredict [16:19] [ComfyUI] [INFO] Inputs: {"focal_length_mm": 30, "output_prefix": "sharp", "model": ["9", 0], "image": ["58", 0]} [16:19] [ComfyUI] [INFO] Node 58: ImageFromBatch [16:19] Queuing workflow for execution... [16:19] [ComfyUI] [INFO] Inputs: {"batch_index": 0, "length": 1, "image": ["7", 0]} [16:19] [ComfyUI] [INFO] Node 83: SharpPredictGaussiansFromMetricDepth [16:19] [ComfyUI] [INFO] Inputs: {"snap_to_external_depth": "none", "depth_convention": "planar_z", "focal_length_mm": 30, "output_prefix": "sharp_aligned", "save_background_layer": true, "edge_crop": 0, "model": ["9", 0], "image": [ [16:19] [ComfyUI] [INFO] Node 92: PreviewGaussianSharp [16:19] [ComfyUI] [INFO] Inputs: {"preview_gaussian": "", "ply_path": ["83", 0], "extrinsics": ["83", 2], "intrinsics": ["83", 3]} [16:19] [ComfyUI] [INFO] Node 93: PreviewGaussianSharp [16:19] [ComfyUI] [INFO] Inputs: {"preview_gaussian": "", "ply_path": ["57", 0], "extrinsics": ["57", 1], "intrinsics": ["57", 2]} [16:19] [ComfyUI] [INFO] Generated prompt_id: 5db50a93-7aff-464e-a9c7-8d2052053e1d [16:19] [ComfyUI] [INFO] Calling execution.validate_prompt()... [16:19] [ComfyUI] [INFO] Validation result: valid=True [16:19] [ComfyUI] [INFO] === Validation PASSED === [16:19] [ComfyUI] [INFO] got prompt [16:19] [ComfyUI] [comfy-env] Running LoadSharpModel: precision: 'auto' [16:19] [ComfyUI] [SubprocessWorker] call_method: nodes.load_model.LoadSharpModel.EXECUTE_NORMALIZED [16:19] [ComfyUI] [SubprocessWorker] acquired lock, ensuring started... [16:19] [ComfyUI] [ComfyUI-Sharp] Health check: ping (timeout=5.0s)... [16:19] [ComfyUI] [ComfyUI-Sharp] Health check: failed [16:19] [ComfyUI] [ComfyUI-Sharp] python: /home/runner/.ce/.pixi/envs/sharp-nodes/bin/python [16:19] [ComfyUI] [ComfyUI-Sharp] Socket unhealthy, restarting worker... [16:19] [ComfyUI] [ComfyUI-Sharp] sys_path sent to worker: ['/home/runner/work/comfy-gpu-ci/comfy-gpu-ci/test_workspaces/Sharp-2211/ComfyUI', '/home/runner/work/comfy-gpu-ci/comfy-gpu-ci/test_workspaces/Sharp-2211/ComfyUI/custom_nodes/ComfyUI-Sharp', '/home/runner/.ce/.pixi/envs/sharp-nodes/lib/python3.11/site-packages', '/home/runner/work/comfy-gpu-ci/comfy-gpu-ci/test_workspaces/Sharp-2211/ComfyUI/custom_nodes/ComfyUI-Sharp'] [16:19] [ComfyUI] [SubprocessWorker] is_pixi=True, python=/home/runner/.ce/.pixi/envs/sharp-nodes/bin/python [16:19] [ComfyUI] [SubprocessWorker] launching cmd=['/home/runner/.pixi/bin/pixi', 'run', '--as-is', '--manifest-path', '/home/runner/.ce/pixi.toml', '-e', 'sharp-nodes', 'python', '/tmp/comfyui_pvenv_1p20y9l5/persistent_worker.py', 'abstract://comfy_worker_3f7c06ef62d2']... [16:19] [ComfyUI] [SubprocessWorker] socket_addr=abstract://comfy_worker_3f7c06ef62d2 (abstract, no filesystem path) [16:20] [ComfyUI] [worker:ComfyUI-Sharp] ERROR: Failed to import comfy_kitchen, Error: No module named 'comfy_kitchen', fp8 and fp4 support will not be available. [16:20] [ComfyUI] [worker:ComfyUI-Sharp] WARNING: comfy_kitchen does not support stochastic FP8 rounding, please update comfy_kitchen. [16:20] [ComfyUI] [SubprocessWorker] worker started/confirmed [16:20] [ComfyUI] [SubprocessWorker] serializing kwargs to shm... [16:20] [ComfyUI] [SubprocessWorker] created 0 shm blocks [16:20] [ComfyUI] [SubprocessWorker] sending request via socket... [16:20] [ComfyUI] [SubprocessWorker] call_id=6 sending call_method [16:21] [ComfyUI] [worker:ComfyUI-Sharp] [LoadSharpModel] precision='auto' -> dtype=fp32 (device=cpu) [16:21] [ComfyUI] [worker:ComfyUI-Sharp] [LoadSharpModel] checkpoint already present, reusing (no download): /home/runner/work/comfy-gpu-ci/comfy-gpu-ci/test_workspaces/Sharp-2211/ComfyUI/models/sharp/sharp_2572gikvuh.pt (2679.6 MB) [16:21] [ComfyUI] [worker:ComfyUI-Sharp] [LoadSharpModel] checkpoint ready: /home/runner/work/comfy-gpu-ci/comfy-gpu-ci/test_workspaces/Sharp-2211/ComfyUI/models/sharp/sharp_2572gikvuh.pt (2679.6 MB) [16:21] [ComfyUI] [worker:ComfyUI-Sharp] [LoadSharpModel] config: precision=auto -> dtype=fp32 [16:21] [ComfyUI] [SubprocessWorker] got response: ok [16:21] [ComfyUI] [comfy-env] LoadSharpModel done (1.92s): result: NodeOutput [16:21] [ComfyUI] [comfy-env] Running SharpPredict: focal_length_mm: 30.0, output_prefix: 'sharp', model: dict, image: torch.float32 [1,960,1416,3] cpu [16:21] [ComfyUI] [SubprocessWorker] call_method: nodes.predict.SharpPredict.EXECUTE_NORMALIZED [16:21] [ComfyUI] [SubprocessWorker] acquired lock, ensuring started... [16:21] [ComfyUI] [ComfyUI-Sharp] Health check: ping (timeout=5.0s)... [16:21] [ComfyUI] [ComfyUI-Sharp] Health check: ok [16:21] [ComfyUI] [SubprocessWorker] worker started/confirmed [16:21] [ComfyUI] [comfy-env] PRE-SERIALIZE 'image' shape: torch.Size([1, 960, 1416, 3]) [16:21] [ComfyUI] [SubprocessWorker] serializing kwargs to shm... [16:21] [ComfyUI] [SubprocessWorker] created 0 shm blocks [16:21] [ComfyUI] [SubprocessWorker] sending request via socket... [16:21] [ComfyUI] [SubprocessWorker] call_id=7 sending call_method [16:21] [ComfyUI] [worker:ComfyUI-Sharp] [comfy-env] _from_shm got dict with keys: ['__type__', 'strategy', 'parent_pid', 'fd', 'storage_size'] [16:21] [ComfyUI] [worker:ComfyUI-Sharp] [comfy-env] DESERIALIZE TensorRef: tensor_size=[1, 960, 1416, 3] [16:21] [ComfyUI] [worker:ComfyUI-Sharp] [comfy-env] DESERIALIZED tensor shape: torch.Size([1, 960, 1416, 3]) [16:21] Frame 2 saved (frame_001.jpg, t=2.3s) [16:21] [capture-periodic] freeze=3ms shot=158ms unfreeze=16ms saved=True [16:23] Frame 3 saved (frame_002.jpg, t=4.5s) [16:23] [capture-periodic] freeze=2ms shot=139ms unfreeze=4ms saved=True [16:24] [ComfyUI] [worker:ComfyUI-Sharp] [LoadSharpModel] loading checkpoint from /home/runner/work/comfy-gpu-ci/comfy-gpu-ci/test_workspaces/Sharp-2211/ComfyUI/models/sharp/sharp_2572gikvuh.pt (dtype=fp32) [16:25] [capture-loop] iter=50 t=5.9s state={'complete': False, 'error': None, 'executedCount': 0, 'wsState': 1} eval_ms=6 ram=4.2/15.6GB (27%) swap=0.0/3.0GB (0%) cpu=78% browser_rss=0.97GB [16:27] [ComfyUI] [worker:ComfyUI-Sharp] [LoadSharpModel] initializing model on meta device... [16:27] [ComfyUI] [worker:ComfyUI-Sharp] [LoadSharpModel] model ready (torch.float32) [16:27] [ComfyUI] [SubprocessWorker] callback 'request_vram_budget' from call_id=7 [16:27] [ComfyUI] [comfy-env] VRAM request: 2.81GB, free before eviction: 11.13GB [16:27] [ComfyUI] [comfy-env] VRAM after eviction: 11.13GB [16:30] [capture-loop] iter=100 t=11.6s state={'complete': False, 'error': None, 'executedCount': 0, 'wsState': 1} eval_ms=2 ram=5.7/15.6GB (37%) swap=0.0/3.0GB (0%) cpu=37% browser_rss=0.88GB [16:36] [capture-loop] iter=150 t=17.1s state={'complete': False, 'error': None, 'executedCount': 0, 'wsState': 1} eval_ms=7 ram=5.7/15.6GB (36%) swap=0.0/3.0GB (0%) cpu=47% browser_rss=0.88GB [16:42] [capture-loop] iter=200 t=22.8s state={'complete': False, 'error': None, 'executedCount': 0, 'wsState': 1} eval_ms=2 ram=5.6/15.6GB (36%) swap=0.0/3.0GB (0%) cpu=48% browser_rss=0.89GB [16:47] [capture-loop] iter=250 t=28.6s state={'complete': False, 'error': None, 'executedCount': 0, 'wsState': 1} eval_ms=2 ram=5.5/15.6GB (35%) swap=0.0/3.0GB (0%) cpu=48% browser_rss=0.89GB [16:53] [capture-loop] iter=300 t=34.1s state={'complete': False, 'error': None, 'executedCount': 0, 'wsState': 1} eval_ms=2 ram=5.6/15.6GB (36%) swap=0.0/3.0GB (0%) cpu=47% browser_rss=0.90GB [16:59] [capture-loop] iter=350 t=39.8s state={'complete': False, 'error': None, 'executedCount': 0, 'wsState': 1} eval_ms=2 ram=5.6/15.6GB (36%) swap=0.0/3.0GB (0%) cpu=46% browser_rss=0.90GB [17:04] [capture-loop] iter=400 t=45.3s state={'complete': False, 'error': None, 'executedCount': 0, 'wsState': 1} eval_ms=2 ram=5.6/15.6GB (36%) swap=0.0/3.0GB (0%) cpu=46% browser_rss=0.90GB [17:10] [capture-loop] iter=450 t=51.0s state={'complete': False, 'error': None, 'executedCount': 0, 'wsState': 1} eval_ms=3 ram=5.6/15.6GB (36%) swap=0.0/3.0GB (0%) cpu=47% browser_rss=0.90GB [17:15] [capture-loop] iter=500 t=56.7s state={'complete': False, 'error': None, 'executedCount': 0, 'wsState': 1} eval_ms=4 ram=5.7/15.6GB (37%) swap=0.0/3.0GB (0%) cpu=49% browser_rss=0.90GB [17:19] [ComfyUI] [worker:ComfyUI-Sharp] [17:19] [ComfyUI] === WATCHDOG TICK 1 === [17:19] [ComfyUI] [worker:ComfyUI-Sharp] Current thread 0x00007ff8a4b246c0 (most recent call first): [17:19] [ComfyUI] File "/tmp/comfyui_pvenv_1p20y9l5/persistent_worker.py", line 52 in _watchdog [17:19] [ComfyUI] File "/home/runner/.ce/.pixi/envs/sharp-nodes/lib/python3.11/threading.py", line 982 in run [17:19] [ComfyUI] File "/home/runner/.ce/.pixi/envs/sharp-nodes/lib/python3.11/threading.py", line 1045 in _bootstrap_inner [17:19] [ComfyUI] File "/home/runner/.ce/.pixi/envs/sharp-nodes/lib/python3.11/threading.py", line 1002 in _bootstrap [17:19] [ComfyUI] [17:19] [ComfyUI] Thread 0x00007ff8a5645740 (most recent call first): [17:19] [ComfyUI] File "/home/runner/.ce/.pixi/envs/sharp-nodes/lib/python3.11/site-packages/torch/nn/modules/linear.py", line 134 in forward [17:19] [ComfyUI] File "/home/runner/work/comfy-gpu-ci/comfy-gpu-ci/test_workspaces/Sharp-2211/ComfyUI/comfy/ops.py", line 503 in forward [17:19] [ComfyUI] File "/home/runner/.ce/.pixi/envs/sharp-nodes/lib/python3.11/site-packages/torch/nn/modules/module.py", line 1787 in _call_impl [17:19] [ComfyUI] File "/home/runner/.ce/.pixi/envs/sharp-nodes/lib/python3.11/site-packages/torch/nn/modules/module.py", line 1776 in _wrapped_call_impl [17:19] [ComfyUI] File "/home/runner/work/comfy-gpu-ci/comfy-gpu-ci/test_workspaces/Sharp-2211/ComfyUI/custom_nodes/ComfyUI-Sharp/nodes/sharp/model.py", line 274 in forward [17:19] [ComfyUI] File "/home/runner/.ce/.pixi/envs/sharp-nodes/lib/python3.11/site-packages/torch/nn/modules/module.py", line 1787 in _call_impl [17:19] [ComfyUI] File "/home/runner/.ce/.pixi/envs/sharp-nodes/lib/python3.11/site-packages/torch/nn/modules/module.py", line 1776 in _wrapped_call_impl [17:19] [ComfyUI] File "/home/runner/work/comfy-gpu-ci/comfy-gpu-ci/test_workspaces/Sharp-2211/ComfyUI/custom_nodes/ComfyUI-Sharp/nodes/sharp/model.py", line 310 in forward [17:19] [ComfyUI] File "/home/runner/.ce/.pixi/envs/sharp-nodes/lib/python3.11/site-packages/torch/nn/modules/module.py", line 1787 in _call_impl [17:19] [ComfyUI] File "/home/runner/.ce/.pixi/envs/sharp-nodes/lib/python3.11/site-packages/torch/nn/modules/module.py", line 1776 in _wrapped_call_impl [17:19] [ComfyUI] File "/home/runner/work/comfy-gpu-ci/comfy-gpu-ci/test_workspaces/Sharp-2211/ComfyUI/custom_nodes/ComfyUI-Sharp/nodes/sharp/model.py", line 412 in forward [17:19] [ComfyUI] File "/home/runner/.ce/.pixi/envs/sharp-nodes/lib/python3.11/site-packages/torch/nn/modules/module.py", line 1787 in _call_impl [17:19] [ComfyUI] File "/home/runner/.ce/.pixi/envs/sharp-nodes/lib/python3.11/site-packages/torch/nn/modules/module.py", line 1776 in _wrapped_call_impl [17:19] [ComfyUI] File "/home/runner/work/comfy-gpu-ci/comfy-gpu-ci/test_workspaces/Sharp-2211/ComfyUI/custom_nodes/ComfyUI-Sharp/nodes/sharp/model.py", line 685 in forward [17:19] [ComfyUI] File "/home/runner/.ce/.pixi/envs/sharp-nodes/lib/python3.11/site-packages/torch/nn/modules/module.py", line 1787 in _call_impl [17:19] [ComfyUI] File "/home/runner/.ce/.pixi/envs/sharp-nodes/lib/python3.11/site-packages/torch/nn/modules/module.py", line 1776 in _wrapped_call_impl [17:19] [ComfyUI] File "/home/runner/work/comfy-gpu-ci/comfy-gpu-ci/test_workspaces/Sharp-2211/ComfyUI/custom_nodes/ComfyUI-Sharp/nodes/sharp/model.py", line 1109 in forward [17:19] [ComfyUI] File "/home/runner/.ce/.pixi/envs/sharp-nodes/lib/python3.11/site-packages/torch/nn/modules/module.py", line 1787 in _call_impl [17:19] [ComfyUI] File "/home/runner/.ce/.pixi/envs/sharp-nodes/lib/python3.11/site-packages/torch/nn/modules/module.py", line 1776 in _wrapped_call_impl [17:19] [ComfyUI] File "/home/runner/work/comfy-gpu-ci/comfy-gpu-ci/test_workspaces/Sharp-2211/ComfyUI/custom_nodes/ComfyUI-Sharp/nodes/sharp/model.py", line 2006 in encode [17:19] [ComfyUI] File "/home/runner/work/comfy-gpu-ci/comfy-gpu-ci/test_workspaces/Sharp-2211/ComfyUI/custom_nodes/ComfyUI-Sharp/nodes/predict.py", line 348 in _predict_image_cached [17:19] [ComfyUI] File "/home/runner/work/comfy-gpu-ci/comfy-gpu-ci/test_workspaces/Sharp-2211/ComfyUI/custom_nodes/ComfyUI-Sharp/nodes/predict.py", line 239 in execute [17:19] [ComfyUI] File "/home/runner/.ce/.pixi/envs/sharp-nodes/lib/python3.11/site-packages/torch/utils/_contextlib.py", line 124 in decorate_context [17:19] [ComfyUI] File "/home/runner/work/comfy-gpu-ci/comfy-gpu-ci/test_workspaces/Sharp-2211/ComfyUI/comfy_api/latest/_io.py", line 1892 in EXECUTE_NORMALIZED [17:19] [ComfyUI] File "/tmp/comfyui_pvenv_1p20y9l5/persistent_worker.py", line 1762 in main [17:19] [ComfyUI] File "/tmp/comfyui_pvenv_1p20y9l5/persistent_worker.py", line 1807 in [17:19] [ComfyUI] [17:19] [ComfyUI] [worker:ComfyUI-Sharp] === END === [17:19] [ComfyUI] [17:21] [capture-loop] iter=550 t=62.2s state={'complete': False, 'error': None, 'executedCount': 0, 'wsState': 1} eval_ms=2 ram=5.6/15.6GB (36%) swap=0.0/3.0GB (0%) cpu=49% browser_rss=0.89GB [17:27] [capture-loop] iter=600 t=67.9s state={'complete': False, 'error': None, 'executedCount': 0, 'wsState': 1} eval_ms=5 ram=5.5/15.6GB (36%) swap=0.0/3.0GB (0%) cpu=47% browser_rss=0.89GB [17:32] [capture-loop] iter=650 t=73.6s state={'complete': False, 'error': None, 'executedCount': 0, 'wsState': 1} eval_ms=5 ram=5.7/15.6GB (36%) swap=0.0/3.0GB (0%) cpu=47% browser_rss=0.89GB [17:38] [capture-loop] iter=700 t=79.2s state={'complete': False, 'error': None, 'executedCount': 0, 'wsState': 1} eval_ms=2 ram=5.6/15.6GB (36%) swap=0.0/3.0GB (0%) cpu=48% browser_rss=0.89GB [17:44] [capture-loop] iter=750 t=84.8s state={'complete': False, 'error': None, 'executedCount': 0, 'wsState': 1} eval_ms=2 ram=5.6/15.6GB (36%) swap=0.0/3.0GB (0%) cpu=46% browser_rss=0.90GB [17:49] [capture-loop] iter=800 t=90.4s state={'complete': False, 'error': None, 'executedCount': 0, 'wsState': 1} eval_ms=5 ram=5.7/15.6GB (36%) swap=0.0/3.0GB (0%) cpu=46% browser_rss=0.90GB [17:55] [capture-loop] iter=850 t=96.1s state={'complete': False, 'error': None, 'executedCount': 0, 'wsState': 1} eval_ms=2 ram=5.6/15.6GB (36%) swap=0.0/3.0GB (0%) cpu=48% browser_rss=0.90GB [18:01] [capture-loop] iter=900 t=101.8s state={'complete': False, 'error': None, 'executedCount': 0, 'wsState': 1} eval_ms=3 ram=5.6/15.6GB (36%) swap=0.0/3.0GB (0%) cpu=48% browser_rss=0.91GB [18:06] [capture-loop] iter=950 t=107.4s state={'complete': False, 'error': None, 'executedCount': 0, 'wsState': 1} eval_ms=4 ram=5.7/15.6GB (37%) swap=0.0/3.0GB (0%) cpu=48% browser_rss=0.91GB [18:12] [capture-loop] iter=1000 t=113.1s state={'complete': False, 'error': None, 'executedCount': 0, 'wsState': 1} eval_ms=3 ram=5.7/15.6GB (36%) swap=0.0/3.0GB (0%) cpu=46% browser_rss=0.91GB [18:18] [capture-loop] iter=1050 t=118.8s state={'complete': False, 'error': None, 'executedCount': 0, 'wsState': 1} eval_ms=2 ram=5.7/15.6GB (36%) swap=0.0/3.0GB (0%) cpu=46% browser_rss=0.91GB [18:19] [ComfyUI] [worker:ComfyUI-Sharp] [18:19] [ComfyUI] === WATCHDOG TICK 2 === [18:19] [ComfyUI] [worker:ComfyUI-Sharp] Current thread 0x00007ff8a4b246c0 (most recent call first): [18:19] [ComfyUI] File "/tmp/comfyui_pvenv_1p20y9l5/persistent_worker.py", line 52 in _watchdog [18:19] [ComfyUI] File "/home/runner/.ce/.pixi/envs/sharp-nodes/lib/python3.11/threading.py", line 982 in run [18:19] [ComfyUI] File "/home/runner/.ce/.pixi/envs/sharp-nodes/lib/python3.11/threading.py", line 1045 in _bootstrap_inner [18:19] [ComfyUI] File "/home/runner/.ce/.pixi/envs/sharp-nodes/lib/python3.11/threading.py", line 1002 in _bootstrap [18:19] [ComfyUI] [18:19] [ComfyUI] Thread 0x00007ff8a5645740 (most recent call first): [18:19] [ComfyUI] File "/home/runner/work/comfy-gpu-ci/comfy-gpu-ci/test_workspaces/Sharp-2211/ComfyUI/comfy/ldm/modules/sub_quadratic_attention.py", line 181 in _get_attention_scores_no_kv_chunking [18:19] [ComfyUI] File "/home/runner/work/comfy-gpu-ci/comfy-gpu-ci/test_workspaces/Sharp-2211/ComfyUI/comfy/ldm/modules/sub_quadratic_attention.py", line 259 in efficient_dot_product_attention [18:19] [ComfyUI] File "/home/runner/work/comfy-gpu-ci/comfy-gpu-ci/test_workspaces/Sharp-2211/ComfyUI/comfy/ldm/modules/attention.py", line 275 in attention_sub_quad [18:19] [ComfyUI] File "/home/runner/work/comfy-gpu-ci/comfy-gpu-ci/test_workspaces/Sharp-2211/ComfyUI/comfy/ldm/modules/attention.py", line 139 in wrapper [18:19] [ComfyUI] File "/home/runner/work/comfy-gpu-ci/comfy-gpu-ci/test_workspaces/Sharp-2211/ComfyUI/custom_nodes/ComfyUI-Sharp/nodes/sharp/model.py", line 234 in forward [18:19] [ComfyUI] File "/home/runner/.ce/.pixi/envs/sharp-nodes/lib/python3.11/site-packages/torch/nn/modules/module.py", line 1787 in _call_impl [18:19] [ComfyUI] File "/home/runner/.ce/.pixi/envs/sharp-nodes/lib/python3.11/site-packages/torch/nn/modules/module.py", line 1776 in _wrapped_call_impl [18:19] [ComfyUI] File "/home/runner/work/comfy-gpu-ci/comfy-gpu-ci/test_workspaces/Sharp-2211/ComfyUI/custom_nodes/ComfyUI-Sharp/nodes/sharp/model.py", line 309 in forward [18:19] [ComfyUI] File "/home/runner/.ce/.pixi/envs/sharp-nodes/lib/python3.11/site-packages/torch/nn/modules/module.py", line 1787 in _call_impl [18:19] [ComfyUI] File "/home/runner/.ce/.pixi/envs/sharp-nodes/lib/python3.11/site-packages/torch/nn/modules/module.py", line 1776 in _wrapped_call_impl [18:19] [ComfyUI] File "/home/runner/work/comfy-gpu-ci/comfy-gpu-ci/test_workspaces/Sharp-2211/ComfyUI/custom_nodes/ComfyUI-Sharp/nodes/sharp/model.py", line 412 in forward [18:19] [ComfyUI] File "/home/runner/.ce/.pixi/envs/sharp-nodes/lib/python3.11/site-packages/torch/nn/modules/module.py", line 1787 in _call_impl [18:19] [ComfyUI] File "/home/runner/.ce/.pixi/envs/sharp-nodes/lib/python3.11/site-packages/torch/nn/modules/module.py", line 1776 in _wrapped_call_impl [18:19] [ComfyUI] File "/home/runner/work/comfy-gpu-ci/comfy-gpu-ci/test_workspaces/Sharp-2211/ComfyUI/custom_nodes/ComfyUI-Sharp/nodes/sharp/model.py", line 685 in forward [18:19] [ComfyUI] File "/home/runner/.ce/.pixi/envs/sharp-nodes/lib/python3.11/site-packages/torch/nn/modules/module.py", line 1787 in _call_impl [18:19] [ComfyUI] File "/home/runner/.ce/.pixi/envs/sharp-nodes/lib/python3.11/site-packages/torch/nn/modules/module.py", line 1776 in _wrapped_call_impl [18:19] [ComfyUI] File "/home/runner/work/comfy-gpu-ci/comfy-gpu-ci/test_workspaces/Sharp-2211/ComfyUI/custom_nodes/ComfyUI-Sharp/nodes/sharp/model.py", line 1109 in forward [18:19] [ComfyUI] File "/home/runner/.ce/.pixi/envs/sharp-nodes/lib/python3.11/site-packages/torch/nn/modules/module.py", line 1787 in _call_impl [18:19] [ComfyUI] File "/home/runner/.ce/.pixi/envs/sharp-nodes/lib/python3.11/site-packages/torch/nn/modules/module.py", line 1776 in _wrapped_call_impl [18:19] [ComfyUI] File "/home/runner/work/comfy-gpu-ci/comfy-gpu-ci/test_workspaces/Sharp-2211/ComfyUI/custom_nodes/ComfyUI-Sharp/nodes/sharp/model.py", line 2006 in encode [18:19] [ComfyUI] File "/home/runner/work/comfy-gpu-ci/comfy-gpu-ci/test_workspaces/Sharp-2211/ComfyUI/custom_nodes/ComfyUI-Sharp/nodes/predict.py", line 348 in _predict_image_cached [18:19] [ComfyUI] File "/home/runner/work/comfy-gpu-ci/comfy-gpu-ci/test_workspaces/Sharp-2211/ComfyUI/custom_nodes/ComfyUI-Sharp/nodes/predict.py", line 239 in execute [18:19] [ComfyUI] File "/home/runner/.ce/.pixi/envs/sharp-nodes/lib/python3.11/site-packages/torch/utils/_contextlib.py", line 124 in decorate_context [18:19] [ComfyUI] File "/home/runner/work/comfy-gpu-ci/comfy-gpu-ci/test_workspaces/Sharp-2211/ComfyUI/comfy_api/latest/_io.py", line 1892 in EXECUTE_NORMALIZED [18:19] [ComfyUI] File "/tmp/comfyui_pvenv_1p20y9l5/persistent_worker.py", line 1762 in main [18:19] [ComfyUI] File "/tmp/comfyui_pvenv_1p20y9l5/persistent_worker.py", line 1807 in [18:19] [ComfyUI] [18:19] [ComfyUI] [worker:ComfyUI-Sharp] === END === [18:19] [ComfyUI] [18:23] [capture-loop] iter=1100 t=124.3s state={'complete': False, 'error': None, 'executedCount': 0, 'wsState': 1} eval_ms=6 ram=5.7/15.6GB (37%) swap=0.0/3.0GB (0%) cpu=47% browser_rss=0.91GB [18:29] [capture-loop] iter=1150 t=130.0s state={'complete': False, 'error': None, 'executedCount': 0, 'wsState': 1} eval_ms=2 ram=5.8/15.6GB (37%) swap=0.0/3.0GB (0%) cpu=46% browser_rss=0.92GB [18:34] [capture-loop] iter=1200 t=135.5s state={'complete': False, 'error': None, 'executedCount': 0, 'wsState': 1} eval_ms=4 ram=5.8/15.6GB (37%) swap=0.0/3.0GB (0%) cpu=45% browser_rss=0.91GB [18:40] [capture-loop] iter=1250 t=141.2s state={'complete': False, 'error': None, 'executedCount': 0, 'wsState': 1} eval_ms=3 ram=5.7/15.6GB (37%) swap=0.0/3.0GB (0%) cpu=47% browser_rss=0.91GB [18:46] [capture-loop] iter=1300 t=146.9s state={'complete': False, 'error': None, 'executedCount': 0, 'wsState': 1} eval_ms=3 ram=5.8/15.6GB (37%) swap=0.0/3.0GB (0%) cpu=47% browser_rss=0.91GB [18:51] [capture-loop] iter=1350 t=152.5s state={'complete': False, 'error': None, 'executedCount': 0, 'wsState': 1} eval_ms=2 ram=5.8/15.6GB (37%) swap=0.0/3.0GB (0%) cpu=48% browser_rss=0.91GB [18:57] [capture-loop] iter=1400 t=158.1s state={'complete': False, 'error': None, 'executedCount': 0, 'wsState': 1} eval_ms=2 ram=5.8/15.6GB (37%) swap=0.0/3.0GB (0%) cpu=46% browser_rss=0.91GB [19:03] [capture-loop] iter=1450 t=163.8s state={'complete': False, 'error': None, 'executedCount': 0, 'wsState': 1} eval_ms=3 ram=5.8/15.6GB (37%) swap=0.0/3.0GB (0%) cpu=46% browser_rss=0.91GB [19:08] [capture-loop] iter=1500 t=169.4s state={'complete': False, 'error': None, 'executedCount': 0, 'wsState': 1} eval_ms=3 ram=5.8/15.6GB (37%) swap=0.0/3.0GB (0%) cpu=46% browser_rss=0.91GB [19:14] [capture-loop] iter=1550 t=175.0s state={'complete': False, 'error': None, 'executedCount': 0, 'wsState': 1} eval_ms=3 ram=5.8/15.6GB (37%) swap=0.0/3.0GB (0%) cpu=48% browser_rss=0.92GB [19:19] [ComfyUI] [worker:ComfyUI-Sharp] [19:19] [ComfyUI] === WATCHDOG TICK 3 === [19:19] [ComfyUI] [worker:ComfyUI-Sharp] Current thread 0x00007ff8a4b246c0 (most recent call first): [19:19] [ComfyUI] File "/tmp/comfyui_pvenv_1p20y9l5/persistent_worker.py", line 52 in _watchdog [19:19] [ComfyUI] File "/home/runner/.ce/.pixi/envs/sharp-nodes/lib/python3.11/threading.py", line 982 in run [19:19] [ComfyUI] File "/home/runner/.ce/.pixi/envs/sharp-nodes/lib/python3.11/threading.py", line 1045 in _bootstrap_inner [19:19] [ComfyUI] File "/home/runner/.ce/.pixi/envs/sharp-nodes/lib/python3.11/threading.py", line 1002 in _bootstrap [19:19] [ComfyUI] [19:19] [ComfyUI] Thread 0x00007ff8a5645740 (most recent call first): [19:19] [ComfyUI] File "/home/runner/.ce/.pixi/envs/sharp-nodes/lib/python3.11/site-packages/torch/nn/modules/linear.py", line 134 in forward [19:19] [ComfyUI] File "/home/runner/work/comfy-gpu-ci/comfy-gpu-ci/test_workspaces/Sharp-2211/ComfyUI/comfy/ops.py", line 503 in forward [19:19] [ComfyUI] File "/home/runner/.ce/.pixi/envs/sharp-nodes/lib/python3.11/site-packages/torch/nn/modules/module.py", line 1787 in _call_impl [19:19] [ComfyUI] File "/home/runner/.ce/.pixi/envs/sharp-nodes/lib/python3.11/site-packages/torch/nn/modules/module.py", line 1776 in _wrapped_call_impl [19:19] [ComfyUI] File "/home/runner/work/comfy-gpu-ci/comfy-gpu-ci/test_workspaces/Sharp-2211/ComfyUI/custom_nodes/ComfyUI-Sharp/nodes/sharp/model.py", line 274 in forward [19:19] [ComfyUI] File "/home/runner/.ce/.pixi/envs/sharp-nodes/lib/python3.11/site-packages/torch/nn/modules/module.py", line 1787 in _call_impl [19:19] [ComfyUI] File "/home/runner/.ce/.pixi/envs/sharp-nodes/lib/python3.11/site-packages/torch/nn/modules/module.py", line 1776 in _wrapped_call_impl [19:19] [ComfyUI] File "/home/runner/work/comfy-gpu-ci/comfy-gpu-ci/test_workspaces/Sharp-2211/ComfyUI/custom_nodes/ComfyUI-Sharp/nodes/sharp/model.py", line 310 in forward [19:19] [ComfyUI] File "/home/runner/.ce/.pixi/envs/sharp-nodes/lib/python3.11/site-packages/torch/nn/modules/module.py", line 1787 in _call_impl [19:19] [ComfyUI] File "/home/runner/.ce/.pixi/envs/sharp-nodes/lib/python3.11/site-packages/torch/nn/modules/module.py", line 1776 in _wrapped_call_impl [19:19] [ComfyUI] File "/home/runner/work/comfy-gpu-ci/comfy-gpu-ci/test_workspaces/Sharp-2211/ComfyUI/custom_nodes/ComfyUI-Sharp/nodes/sharp/model.py", line 412 in forward [19:19] [ComfyUI] File "/home/runner/.ce/.pixi/envs/sharp-nodes/lib/python3.11/site-packages/torch/nn/modules/module.py", line 1787 in _call_impl [19:19] [ComfyUI] File "/home/runner/.ce/.pixi/envs/sharp-nodes/lib/python3.11/site-packages/torch/nn/modules/module.py", line 1776 in _wrapped_call_impl [19:19] [ComfyUI] File "/home/runner/work/comfy-gpu-ci/comfy-gpu-ci/test_workspaces/Sharp-2211/ComfyUI/custom_nodes/ComfyUI-Sharp/nodes/sharp/model.py", line 685 in forward [19:19] [ComfyUI] File "/home/runner/.ce/.pixi/envs/sharp-nodes/lib/python3.11/site-packages/torch/nn/modules/module.py", line 1787 in _call_impl [19:19] [ComfyUI] File "/home/runner/.ce/.pixi/envs/sharp-nodes/lib/python3.11/site-packages/torch/nn/modules/module.py", line 1776 in _wrapped_call_impl [19:19] [ComfyUI] File "/home/runner/work/comfy-gpu-ci/comfy-gpu-ci/test_workspaces/Sharp-2211/ComfyUI/custom_nodes/ComfyUI-Sharp/nodes/sharp/model.py", line 1109 in forward [19:19] [ComfyUI] File "/home/runner/.ce/.pixi/envs/sharp-nodes/lib/python3.11/site-packages/torch/nn/modules/module.py", line 1787 in _call_impl [19:19] [ComfyUI] File "/home/runner/.ce/.pixi/envs/sharp-nodes/lib/python3.11/site-packages/torch/nn/modules/module.py", line 1776 in _wrapped_call_impl [19:19] [ComfyUI] File "/home/runner/work/comfy-gpu-ci/comfy-gpu-ci/test_workspaces/Sharp-2211/ComfyUI/custom_nodes/ComfyUI-Sharp/nodes/sharp/model.py", line 2006 in encode [19:19] [ComfyUI] File "/home/runner/work/comfy-gpu-ci/comfy-gpu-ci/test_workspaces/Sharp-2211/ComfyUI/custom_nodes/ComfyUI-Sharp/nodes/predict.py", line 348 in _predict_image_cached [19:19] [ComfyUI] File "/home/runner/work/comfy-gpu-ci/comfy-gpu-ci/test_workspaces/Sharp-2211/ComfyUI/custom_nodes/ComfyUI-Sharp/nodes/predict.py", line 239 in execute [19:19] [ComfyUI] File "/home/runner/.ce/.pixi/envs/sharp-nodes/lib/python3.11/site-packages/torch/utils/_contextlib.py", line 124 in decorate_context [19:19] [ComfyUI] File "/home/runner/work/comfy-gpu-ci/comfy-gpu-ci/test_workspaces/Sharp-2211/ComfyUI/comfy_api/latest/_io.py", line 1892 in EXECUTE_NORMALIZED [19:19] [ComfyUI] File "/tmp/comfyui_pvenv_1p20y9l5/persistent_worker.py", line 1762 in main [19:19] [ComfyUI] File "/tmp/comfyui_pvenv_1p20y9l5/persistent_worker.py", line 1807 in [19:19] [ComfyUI] [19:19] [ComfyUI] [worker:ComfyUI-Sharp] === END === [19:19] [ComfyUI] [19:19] [capture-loop] iter=1600 t=180.6s state={'complete': False, 'error': None, 'executedCount': 0, 'wsState': 1} eval_ms=7 ram=5.8/15.6GB (37%) swap=0.0/3.0GB (0%) cpu=48% browser_rss=0.91GB [19:25] [capture-loop] iter=1650 t=186.3s state={'complete': False, 'error': None, 'executedCount': 0, 'wsState': 1} eval_ms=3 ram=5.8/15.6GB (37%) swap=0.0/3.0GB (0%) cpu=48% browser_rss=0.92GB [19:31] [capture-loop] iter=1700 t=192.0s state={'complete': False, 'error': None, 'executedCount': 0, 'wsState': 1} eval_ms=2 ram=5.9/15.6GB (38%) swap=0.0/3.0GB (0%) cpu=46% browser_rss=0.92GB [19:36] [capture-loop] iter=1750 t=197.5s state={'complete': False, 'error': None, 'executedCount': 0, 'wsState': 1} eval_ms=4 ram=5.9/15.6GB (38%) swap=0.0/3.0GB (0%) cpu=48% browser_rss=0.92GB [19:42] [capture-loop] iter=1800 t=203.3s state={'complete': False, 'error': None, 'executedCount': 0, 'wsState': 1} eval_ms=7 ram=5.9/15.6GB (38%) swap=0.0/3.0GB (0%) cpu=48% browser_rss=0.92GB [19:48] [capture-loop] iter=1850 t=209.0s state={'complete': False, 'error': None, 'executedCount': 0, 'wsState': 1} eval_ms=2 ram=5.9/15.6GB (38%) swap=0.0/3.0GB (0%) cpu=48% browser_rss=0.91GB [19:53] [capture-loop] iter=1900 t=214.6s state={'complete': False, 'error': None, 'executedCount': 0, 'wsState': 1} eval_ms=3 ram=5.9/15.6GB (38%) swap=0.0/3.0GB (0%) cpu=48% browser_rss=0.91GB [19:59] [capture-loop] iter=1950 t=220.3s state={'complete': False, 'error': None, 'executedCount': 0, 'wsState': 1} eval_ms=3 ram=5.6/15.6GB (36%) swap=0.0/3.0GB (0%) cpu=47% browser_rss=0.91GB [20:05] [capture-loop] iter=2000 t=226.0s state={'complete': False, 'error': None, 'executedCount': 0, 'wsState': 1} eval_ms=4 ram=6.3/15.6GB (40%) swap=0.0/3.0GB (0%) cpu=46% browser_rss=0.91GB [20:10] [capture-loop] iter=2050 t=231.5s state={'complete': False, 'error': None, 'executedCount': 0, 'wsState': 1} eval_ms=3 ram=6.6/15.6GB (42%) swap=0.0/3.0GB (0%) cpu=47% browser_rss=0.91GB [20:16] [capture-loop] iter=2100 t=237.2s state={'complete': False, 'error': None, 'executedCount': 0, 'wsState': 1} eval_ms=2 ram=6.7/15.6GB (43%) swap=0.0/3.0GB (0%) cpu=46% browser_rss=0.91GB [20:19] [ComfyUI] [worker:ComfyUI-Sharp] [20:19] [ComfyUI] === WATCHDOG TICK 4 === [20:19] [ComfyUI] [worker:ComfyUI-Sharp] Current thread 0x00007ff8a4b246c0 (most recent call first): [20:19] [ComfyUI] File "/tmp/comfyui_pvenv_1p20y9l5/persistent_worker.py", line 52 in _watchdog [20:19] [ComfyUI] File "/home/runner/.ce/.pixi/envs/sharp-nodes/lib/python3.11/threading.py", line 982 in run [20:19] [ComfyUI] File "/home/runner/.ce/.pixi/envs/sharp-nodes/lib/python3.11/threading.py", line 1045 in _bootstrap_inner [20:19] [ComfyUI] File "/home/runner/.ce/.pixi/envs/sharp-nodes/lib/python3.11/threading.py", line 1002 in _bootstrap [20:19] [ComfyUI] [20:19] [ComfyUI] Thread 0x00007ff8a5645740 (most recent call first): [20:19] [ComfyUI] File "/home/runner/.ce/.pixi/envs/sharp-nodes/lib/python3.11/site-packages/torch/nn/modules/conv.py", line 548 in _conv_forward [20:19] [ComfyUI] File "/home/runner/.ce/.pixi/envs/sharp-nodes/lib/python3.11/site-packages/torch/nn/modules/conv.py", line 553 in forward [20:19] [ComfyUI] File "/home/runner/work/comfy-gpu-ci/comfy-gpu-ci/test_workspaces/Sharp-2211/ComfyUI/comfy/ops.py", line 537 in forward [20:19] [ComfyUI] File "/home/runner/.ce/.pixi/envs/sharp-nodes/lib/python3.11/site-packages/torch/nn/modules/module.py", line 1787 in _call_impl [20:19] [ComfyUI] File "/home/runner/.ce/.pixi/envs/sharp-nodes/lib/python3.11/site-packages/torch/nn/modules/module.py", line 1776 in _wrapped_call_impl [20:19] [ComfyUI] File "/home/runner/.ce/.pixi/envs/sharp-nodes/lib/python3.11/site-packages/torch/nn/modules/container.py", line 253 in forward [20:19] [ComfyUI] File "/home/runner/.ce/.pixi/envs/sharp-nodes/lib/python3.11/site-packages/torch/nn/modules/module.py", line 1787 in _call_impl [20:19] [ComfyUI] File "/home/runner/.ce/.pixi/envs/sharp-nodes/lib/python3.11/site-packages/torch/nn/modules/module.py", line 1776 in _wrapped_call_impl [20:19] [ComfyUI] File "/home/runner/work/comfy-gpu-ci/comfy-gpu-ci/test_workspaces/Sharp-2211/ComfyUI/custom_nodes/ComfyUI-Sharp/nodes/sharp/model.py", line 766 in forward [20:19] [ComfyUI] File "/home/runner/.ce/.pixi/envs/sharp-nodes/lib/python3.11/site-packages/torch/nn/modules/module.py", line 1787 in _call_impl [20:19] [ComfyUI] File "/home/runner/.ce/.pixi/envs/sharp-nodes/lib/python3.11/site-packages/torch/nn/modules/module.py", line 1776 in _wrapped_call_impl [20:19] [ComfyUI] File "/home/runner/work/comfy-gpu-ci/comfy-gpu-ci/test_workspaces/Sharp-2211/ComfyUI/custom_nodes/ComfyUI-Sharp/nodes/sharp/model.py", line 860 in forward [20:19] [ComfyUI] File "/home/runner/.ce/.pixi/envs/sharp-nodes/lib/python3.11/site-packages/torch/nn/modules/module.py", line 1787 in _call_impl [20:19] [ComfyUI] File "/home/runner/.ce/.pixi/envs/sharp-nodes/lib/python3.11/site-packages/torch/nn/modules/module.py", line 1776 in _wrapped_call_impl [20:19] [ComfyUI] File "/home/runner/work/comfy-gpu-ci/comfy-gpu-ci/test_workspaces/Sharp-2211/ComfyUI/custom_nodes/ComfyUI-Sharp/nodes/sharp/model.py", line 970 in forward [20:19] [ComfyUI] File "/home/runner/.ce/.pixi/envs/sharp-nodes/lib/python3.11/site-packages/torch/nn/modules/module.py", line 1787 in _call_impl [20:19] [ComfyUI] File "/home/runner/.ce/.pixi/envs/sharp-nodes/lib/python3.11/site-packages/torch/nn/modules/module.py", line 1776 in _wrapped_call_impl [20:19] [ComfyUI] File "/home/runner/work/comfy-gpu-ci/comfy-gpu-ci/test_workspaces/Sharp-2211/ComfyUI/custom_nodes/ComfyUI-Sharp/nodes/sharp/model.py", line 1118 in forward [20:19] [ComfyUI] File "/home/runner/.ce/.pixi/envs/sharp-nodes/lib/python3.11/site-packages/torch/nn/modules/module.py", line 1787 in _call_impl [20:19] [ComfyUI] File "/home/runner/.ce/.pixi/envs/sharp-nodes/lib/python3.11/site-packages/torch/nn/modules/module.py", line 1776 in _wrapped_call_impl [20:19] [ComfyUI] File "/home/runner/work/comfy-gpu-ci/comfy-gpu-ci/test_workspaces/Sharp-2211/ComfyUI/custom_nodes/ComfyUI-Sharp/nodes/sharp/model.py", line 2006 in encode [20:19] [ComfyUI] File "/home/runner/work/comfy-gpu-ci/comfy-gpu-ci/test_workspaces/Sharp-2211/ComfyUI/custom_nodes/ComfyUI-Sharp/nodes/predict.py", line 348 in _predict_image_cached [20:19] [ComfyUI] File "/home/runner/work/comfy-gpu-ci/comfy-gpu-ci/test_workspaces/Sharp-2211/ComfyUI/custom_nodes/ComfyUI-Sharp/nodes/predict.py", line 239 in execute [20:19] [ComfyUI] File "/home/runner/.ce/.pixi/envs/sharp-nodes/lib/python3.11/site-packages/torch/utils/_contextlib.py", line 124 in decorate_context [20:19] [ComfyUI] File "/home/runner/work/comfy-gpu-ci/comfy-gpu-ci/test_workspaces/Sharp-2211/ComfyUI/comfy_api/latest/_io.py", line 1892 in EXECUTE_NORMALIZED [20:19] [ComfyUI] File "/tmp/comfyui_pvenv_1p20y9l5/persistent_worker.py", line 1762 in main [20:19] [ComfyUI] File "/tmp/comfyui_pvenv_1p20y9l5/persistent_worker.py", line 1807 in [20:19] [ComfyUI] [20:19] [ComfyUI] [worker:ComfyUI-Sharp] === END === [20:19] [ComfyUI] [20:21] [capture-loop] iter=2150 t=242.7s state={'complete': False, 'error': None, 'executedCount': 0, 'wsState': 1} eval_ms=3 ram=7.2/15.6GB (46%) swap=0.0/3.0GB (0%) cpu=48% browser_rss=0.91GB [20:27] [capture-loop] iter=2200 t=248.5s state={'complete': False, 'error': None, 'executedCount': 0, 'wsState': 1} eval_ms=8 ram=7.4/15.6GB (48%) swap=0.0/3.0GB (0%) cpu=48% browser_rss=0.91GB [20:33] [capture-loop] iter=2250 t=254.2s state={'complete': False, 'error': None, 'executedCount': 0, 'wsState': 1} eval_ms=2 ram=7.8/15.6GB (50%) swap=0.0/3.0GB (0%) cpu=46% browser_rss=0.91GB [20:38] [capture-loop] iter=2300 t=259.7s state={'complete': False, 'error': None, 'executedCount': 0, 'wsState': 1} eval_ms=2 ram=7.6/15.6GB (48%) swap=0.0/3.0GB (0%) cpu=46% browser_rss=0.92GB [20:44] [capture-loop] iter=2350 t=265.4s state={'complete': False, 'error': None, 'executedCount': 0, 'wsState': 1} eval_ms=5 ram=7.7/15.6GB (49%) swap=0.0/3.0GB (0%) cpu=48% browser_rss=0.91GB [20:50] [capture-loop] iter=2400 t=271.1s state={'complete': False, 'error': None, 'executedCount': 0, 'wsState': 1} eval_ms=5 ram=9.5/15.6GB (61%) swap=0.0/3.0GB (0%) cpu=47% browser_rss=0.91GB [20:55] [capture-loop] iter=2450 t=276.7s state={'complete': False, 'error': None, 'executedCount': 0, 'wsState': 1} eval_ms=3 ram=9.2/15.6GB (59%) swap=0.0/3.0GB (0%) cpu=48% browser_rss=0.91GB [21:01] [capture-loop] iter=2500 t=282.4s state={'complete': False, 'error': None, 'executedCount': 0, 'wsState': 1} eval_ms=3 ram=9.5/15.6GB (61%) swap=0.0/3.0GB (0%) cpu=45% browser_rss=0.91GB [21:07] [capture-loop] iter=2550 t=287.9s state={'complete': False, 'error': None, 'executedCount': 0, 'wsState': 1} eval_ms=3 ram=7.5/15.6GB (48%) swap=0.0/3.0GB (0%) cpu=47% browser_rss=0.91GB [21:12] [capture-loop] iter=2600 t=293.6s state={'complete': False, 'error': None, 'executedCount': 0, 'wsState': 1} eval_ms=3 ram=9.5/15.6GB (61%) swap=0.0/3.0GB (0%) cpu=48% browser_rss=0.91GB [21:18] [capture-loop] iter=2650 t=299.4s state={'complete': False, 'error': None, 'executedCount': 0, 'wsState': 1} eval_ms=3 ram=7.0/15.6GB (45%) swap=0.0/3.0GB (0%) cpu=50% browser_rss=0.91GB [21:19] [ComfyUI] [worker:ComfyUI-Sharp] [21:19] [ComfyUI] === WATCHDOG TICK 5 === [21:19] [ComfyUI] [worker:ComfyUI-Sharp] Current thread 0x00007ff8a4b246c0 (most recent call first): [21:19] [ComfyUI] File "/tmp/comfyui_pvenv_1p20y9l5/persistent_worker.py", line 52 in _watchdog [21:19] [ComfyUI] File "/home/runner/.ce/.pixi/envs/sharp-nodes/lib/python3.11/threading.py", line 982 in run [21:19] [ComfyUI] File "/home/runner/.ce/.pixi/envs/sharp-nodes/lib/python3.11/threading.py", line 1045 in _bootstrap_inner [21:19] [ComfyUI] File "/home/runner/.ce/.pixi/envs/sharp-nodes/lib/python3.11/threading.py", line 1002 in _bootstrap [21:19] [ComfyUI] [21:19] [ComfyUI] Thread 0x00007ff8a5645740 (most recent call first): [21:19] [ComfyUI] File "/home/runner/.ce/.pixi/envs/sharp-nodes/lib/python3.11/site-packages/torch/nn/modules/conv.py", line 1184 in forward [21:19] [ComfyUI] File "/home/runner/work/comfy-gpu-ci/comfy-gpu-ci/test_workspaces/Sharp-2211/ComfyUI/comfy/ops.py", line 670 in forward [21:19] [ComfyUI] File "/home/runner/.ce/.pixi/envs/sharp-nodes/lib/python3.11/site-packages/torch/nn/modules/module.py", line 1787 in _call_impl [21:19] [ComfyUI] File "/home/runner/.ce/.pixi/envs/sharp-nodes/lib/python3.11/site-packages/torch/nn/modules/module.py", line 1776 in _wrapped_call_impl [21:19] [ComfyUI] File "/home/runner/work/comfy-gpu-ci/comfy-gpu-ci/test_workspaces/Sharp-2211/ComfyUI/custom_nodes/ComfyUI-Sharp/nodes/sharp/model.py", line 861 in forward [21:19] [ComfyUI] File "/home/runner/.ce/.pixi/envs/sharp-nodes/lib/python3.11/site-packages/torch/nn/modules/module.py", line 1787 in _call_impl [21:19] [ComfyUI] File "/home/runner/.ce/.pixi/envs/sharp-nodes/lib/python3.11/site-packages/torch/nn/modules/module.py", line 1776 in _wrapped_call_impl [21:19] [ComfyUI] File "/home/runner/work/comfy-gpu-ci/comfy-gpu-ci/test_workspaces/Sharp-2211/ComfyUI/custom_nodes/ComfyUI-Sharp/nodes/sharp/model.py", line 970 in forward [21:19] [ComfyUI] File "/home/runner/.ce/.pixi/envs/sharp-nodes/lib/python3.11/site-packages/torch/nn/modules/module.py", line 1787 in _call_impl [21:19] [ComfyUI] File "/home/runner/.ce/.pixi/envs/sharp-nodes/lib/python3.11/site-packages/torch/nn/modules/module.py", line 1776 in _wrapped_call_impl [21:19] [ComfyUI] File "/home/runner/work/comfy-gpu-ci/comfy-gpu-ci/test_workspaces/Sharp-2211/ComfyUI/custom_nodes/ComfyUI-Sharp/nodes/sharp/model.py", line 1345 in forward [21:19] [ComfyUI] File "/home/runner/.ce/.pixi/envs/sharp-nodes/lib/python3.11/site-packages/torch/nn/modules/module.py", line 1787 in _call_impl [21:19] [ComfyUI] File "/home/runner/.ce/.pixi/envs/sharp-nodes/lib/python3.11/site-packages/torch/nn/modules/module.py", line 1776 in _wrapped_call_impl [21:19] [ComfyUI] File "/home/runner/work/comfy-gpu-ci/comfy-gpu-ci/test_workspaces/Sharp-2211/ComfyUI/custom_nodes/ComfyUI-Sharp/nodes/sharp/model.py", line 2030 in decode [21:19] [ComfyUI] File "/home/runner/work/comfy-gpu-ci/comfy-gpu-ci/test_workspaces/Sharp-2211/ComfyUI/custom_nodes/ComfyUI-Sharp/nodes/predict.py", line 379 in _predict_image_cached [21:19] [ComfyUI] File "/home/runner/work/comfy-gpu-ci/comfy-gpu-ci/test_workspaces/Sharp-2211/ComfyUI/custom_nodes/ComfyUI-Sharp/nodes/predict.py", line 239 in execute [21:19] [ComfyUI] File "/home/runner/.ce/.pixi/envs/sharp-nodes/lib/python3.11/site-packages/torch/utils/_contextlib.py", line 124 in decorate_context [21:19] [ComfyUI] File "/home/runner/work/comfy-gpu-ci/comfy-gpu-ci/test_workspaces/Sharp-2211/ComfyUI/comfy_api/latest/_io.py", line 1892 in EXECUTE_NORMALIZED [21:19] [ComfyUI] File "/tmp/comfyui_pvenv_1p20y9l5/persistent_worker.py", line 1762 in main [21:19] [ComfyUI] File "/tmp/comfyui_pvenv_1p20y9l5/persistent_worker.py", line 1807 in [21:19] [ComfyUI] [21:19] [ComfyUI] [worker:ComfyUI-Sharp] === END === [21:19] [ComfyUI] [21:24] [capture-loop] iter=2700 t=304.9s state={'complete': False, 'error': None, 'executedCount': 0, 'wsState': 1} eval_ms=3 ram=7.9/15.6GB (50%) swap=0.0/3.0GB (0%) cpu=48% browser_rss=0.91GB [21:29] [capture-loop] iter=2750 t=310.7s state={'complete': False, 'error': None, 'executedCount': 0, 'wsState': 1} eval_ms=6 ram=7.8/15.6GB (50%) swap=0.0/3.0GB (0%) cpu=49% browser_rss=0.91GB [21:35] [capture-loop] iter=2800 t=316.5s state={'complete': False, 'error': None, 'executedCount': 0, 'wsState': 1} eval_ms=5 ram=8.0/15.6GB (51%) swap=0.0/3.0GB (0%) cpu=49% browser_rss=0.91GB [21:41] [capture-loop] iter=2850 t=322.0s state={'complete': False, 'error': None, 'executedCount': 0, 'wsState': 1} eval_ms=3 ram=8.7/15.6GB (56%) swap=0.0/3.0GB (0%) cpu=48% browser_rss=0.91GB [21:46] [capture-loop] iter=2900 t=327.7s state={'complete': False, 'error': None, 'executedCount': 0, 'wsState': 1} eval_ms=2 ram=7.9/15.6GB (50%) swap=0.0/3.0GB (0%) cpu=46% browser_rss=0.91GB [21:52] [capture-loop] iter=2950 t=333.4s state={'complete': False, 'error': None, 'executedCount': 0, 'wsState': 1} eval_ms=7 ram=8.0/15.6GB (51%) swap=0.0/3.0GB (0%) cpu=48% browser_rss=0.90GB [21:58] [capture-loop] iter=3000 t=339.0s state={'complete': False, 'error': None, 'executedCount': 0, 'wsState': 1} eval_ms=6 ram=7.1/15.6GB (46%) swap=0.0/3.0GB (0%) cpu=48% browser_rss=0.90GB [21:59] [ComfyUI] [SubprocessWorker] callback 'report_progress' from call_id=7 [21:59] [ComfyUI] [SubprocessWorker] got response: ok [21:59] [ComfyUI] [comfy-env] SharpPredict done (338.45s): result: NodeOutput [21:59] [ComfyUI] [comfy-env] Running PreviewGaussianSharp: ply_path: '/home/runner/work/comfy-gpu-ci/comfy-gpu-ci/test_workspa..., extrinsics: list[4], intrinsics: list[3] [21:59] [ComfyUI] [SubprocessWorker] call_method: nodes.preview_gaussian_sharp.PreviewGaussianSharp.EXECUTE_NORMALIZED [21:59] [ComfyUI] [SubprocessWorker] acquired lock, ensuring started... [21:59] [ComfyUI] [ComfyUI-GaussianPack] Health check: ping (timeout=5.0s)... [21:59] [ComfyUI] [ComfyUI-GaussianPack] Health check: failed [21:59] [ComfyUI] [ComfyUI-GaussianPack] Socket unhealthy, restarting worker... [21:59] [ComfyUI] [ComfyUI-GaussianPack] python: /home/runner/.ce/.pixi/envs/gaussianpack-nodes/bin/python [21:59] [ComfyUI] [ComfyUI-GaussianPack] sys_path sent to worker: ['/home/runner/work/comfy-gpu-ci/comfy-gpu-ci/test_workspaces/Sharp-2211/ComfyUI', '/home/runner/work/comfy-gpu-ci/comfy-gpu-ci/test_workspaces/Sharp-2211/ComfyUI/custom_nodes/ComfyUI-GaussianPack', '/home/runner/.ce/.pixi/envs/gaussianpack-nodes/lib/python3.11/site-packages', '/home/runner/work/comfy-gpu-ci/comfy-gpu-ci/test_workspaces/Sharp-2211/ComfyUI/custom_nodes/ComfyUI-GaussianPack'] [21:59] [ComfyUI] [SubprocessWorker] is_pixi=True, python=/home/runner/.ce/.pixi/envs/gaussianpack-nodes/bin/python [21:59] [ComfyUI] [SubprocessWorker] launching cmd=['/home/runner/.pixi/bin/pixi', 'run', '--as-is', '--manifest-path', '/home/runner/.ce/pixi.toml', '-e', 'gaussianpack-nodes', 'python', '/tmp/comfyui_pvenv_w5l8haz9/persistent_worker.py', 'abstract://comfy_worker_3382adc438af']... [21:59] [ComfyUI] [SubprocessWorker] socket_addr=abstract://comfy_worker_3382adc438af (abstract, no filesystem path) [22:01] Frame 4 saved (frame_003.jpg, t=341.8s) [22:01] [capture-periodic] freeze=3ms shot=147ms unfreeze=4ms saved=True [22:01] [ComfyUI] [SubprocessWorker] worker started/confirmed [22:01] [ComfyUI] [SubprocessWorker] serializing kwargs to shm... [22:01] [ComfyUI] [SubprocessWorker] created 0 shm blocks [22:01] [ComfyUI] [SubprocessWorker] sending request via socket... [22:01] [ComfyUI] [SubprocessWorker] call_id=3 sending call_method [22:01] [ComfyUI] [worker:ComfyUI-GaussianPack] WARNING: SPZ route not registered (ModuleNotFoundError: No module named 'comfy_aimdo') [22:01] [ComfyUI] [SubprocessWorker] got response: ok [22:01] [ComfyUI] [comfy-env] PreviewGaussianSharp done (1.87s): result: NodeOutput [22:01] [ComfyUI] [comfy-env] Running SharpPredictMetricDepth: focal_length_mm: 30.0, model: dict, image: torch.float32 [1,960,1416,3] cpu [22:01] [ComfyUI] [SubprocessWorker] call_method: nodes.predict_metric_depth.SharpPredictMetricDepth.EXECUTE_NORMALIZED [22:01] [ComfyUI] [SubprocessWorker] acquired lock, ensuring started... [22:01] [ComfyUI] [ComfyUI-Sharp] Health check: ping (timeout=5.0s)... [22:01] [ComfyUI] [ComfyUI-Sharp] Health check: ok [22:01] [ComfyUI] [SubprocessWorker] worker started/confirmed [22:01] [ComfyUI] [comfy-env] PRE-SERIALIZE 'image' shape: torch.Size([1, 960, 1416, 3]) [22:01] [ComfyUI] [SubprocessWorker] serializing kwargs to shm... [22:01] [ComfyUI] [SubprocessWorker] created 0 shm blocks [22:01] [ComfyUI] [SubprocessWorker] sending request via socket... [22:01] [ComfyUI] [SubprocessWorker] call_id=8 sending call_method [22:01] [ComfyUI] [worker:ComfyUI-Sharp] [comfy-env] _from_shm got dict with keys: ['__type__', 'strategy', 'parent_pid', 'fd', 'storage_size'] [22:01] [ComfyUI] [worker:ComfyUI-Sharp] [comfy-env] DESERIALIZE TensorRef: tensor_size=[1, 960, 1416, 3] [22:01] [ComfyUI] [worker:ComfyUI-Sharp] [comfy-env] DESERIALIZED tensor shape: torch.Size([1, 960, 1416, 3]) [22:01] [ComfyUI] [worker:ComfyUI-Sharp] [SharpPredictMetricDepth] intrinsics not wired -> using identity-style K (focal=1186.2px @ image 1416×960, 35mm-equiv 30.0mm). Pass intrinsics from PanoramaSplit for per-face accurate K. [22:01] [ComfyUI] [SubprocessWorker] callback 'request_vram_budget' from call_id=8 [22:01] [ComfyUI] [comfy-env] VRAM request: 2.81GB, free before eviction: 9.38GB [22:01] [ComfyUI] [comfy-env] VRAM after eviction: 9.38GB [22:01] Node executed (1 total), capturing... [22:03] Frame 5 saved (frame_004.jpg, t=342.8s) [22:03] [capture-node] freeze=815ms shot=376ms unfreeze=8ms saved=True [22:19] [ComfyUI] [worker:ComfyUI-Sharp] [22:19] [ComfyUI] === WATCHDOG TICK 6 === [22:19] [ComfyUI] [worker:ComfyUI-Sharp] Thread 0x00007ff77ba7c6c0 (most recent call first): [22:19] [ComfyUI] File "/home/runner/.ce/.pixi/envs/sharp-nodes/lib/python3.11/socket.py", line 294 in accept [22:19] [ComfyUI] File "/home/runner/.ce/.pixi/envs/sharp-nodes/lib/python3.11/multiprocessing/connection.py", line 626 in accept [22:19] [ComfyUI] File "/home/runner/.ce/.pixi/envs/sharp-nodes/lib/python3.11/multiprocessing/connection.py", line 480 in accept [22:19] [ComfyUI] File "/home/runner/.ce/.pixi/envs/sharp-nodes/lib/python3.11/multiprocessing/resource_sharer.py", line 138 in _serve [22:19] [ComfyUI] File "/home/runner/.ce/.pixi/envs/sharp-nodes/lib/python3.11/threading.py", line 982 in run [22:19] [ComfyUI] File "/home/runner/.ce/.pixi/envs/sharp-nodes/lib/python3.11/threading.py", line 1045 in _bootstrap_inner [22:19] [ComfyUI] File "/home/runner/.ce/.pixi/envs/sharp-nodes/lib/python3.11/threading.py", line 1002 in _bootstrap [22:19] [ComfyUI] [22:19] [ComfyUI] Current thread 0x00007ff8a4b246c0 (most recent call first): [22:19] [ComfyUI] File "/tmp/comfyui_pvenv_1p20y9l5/persistent_worker.py", line 52 in _watchdog [22:19] [ComfyUI] File "/home/runner/.ce/.pixi/envs/sharp-nodes/lib/python3.11/threading.py", line 982 in run [22:19] [ComfyUI] File "/home/runner/.ce/.pixi/envs/sharp-nodes/lib/python3.11/threading.py", line 1045 in _bootstrap_inner [22:19] [ComfyUI] File "/home/runner/.ce/.pixi/envs/sharp-nodes/lib/python3.11/threading.py", line 1002 in _bootstrap [22:19] [ComfyUI] [22:19] [ComfyUI] Thread 0x00007ff8a5645740 (most recent call first): [22:19] [ComfyUI] File "/home/runner/work/comfy-gpu-ci/comfy-gpu-ci/test_workspaces/Sharp-2211/ComfyUI/comfy/ldm/modules/sub_quadratic_attention.py", line 159 in _get_attention_scores_no_kv_chunking [22:19] [ComfyUI] File "/home/runner/work/comfy-gpu-ci/comfy-gpu-ci/test_workspaces/Sharp-2211/ComfyUI/comfy/ldm/modules/sub_quadratic_attention.py", line 259 in efficient_dot_product_attention [22:19] [ComfyUI] File "/home/runner/work/comfy-gpu-ci/comfy-gpu-ci/test_workspaces/Sharp-2211/ComfyUI/comfy/ldm/modules/attention.py", line 275 in attention_sub_quad [22:19] [ComfyUI] File "/home/runner/work/comfy-gpu-ci/comfy-gpu-ci/test_workspaces/Sharp-2211/ComfyUI/comfy/ldm/modules/attention.py", line 139 in wrapper [22:19] [ComfyUI] File "/home/runner/work/comfy-gpu-ci/comfy-gpu-ci/test_workspaces/Sharp-2211/ComfyUI/custom_nodes/ComfyUI-Sharp/nodes/sharp/model.py", line 234 in forward [22:19] [ComfyUI] File "/home/runner/.ce/.pixi/envs/sharp-nodes/lib/python3.11/site-packages/torch/nn/modules/module.py", line 1787 in _call_impl [22:19] [ComfyUI] File "/home/runner/.ce/.pixi/envs/sharp-nodes/lib/python3.11/site-packages/torch/nn/modules/module.py", line 1776 in _wrapped_call_impl [22:19] [ComfyUI] File "/home/runner/work/comfy-gpu-ci/comfy-gpu-ci/test_workspaces/Sharp-2211/ComfyUI/custom_nodes/ComfyUI-Sharp/nodes/sharp/model.py", line 309 in forward [22:19] [ComfyUI] File "/home/runner/.ce/.pixi/envs/sharp-nodes/lib/python3.11/site-packages/torch/nn/modules/module.py", line 1787 in _call_impl [22:19] [ComfyUI] File "/home/runner/.ce/.pixi/envs/sharp-nodes/lib/python3.11/site-packages/torch/nn/modules/module.py", line 1776 in _wrapped_call_impl [22:19] [ComfyUI] File "/home/runner/work/comfy-gpu-ci/comfy-gpu-ci/test_workspaces/Sharp-2211/ComfyUI/custom_nodes/ComfyUI-Sharp/nodes/sharp/model.py", line 412 in forward [22:19] [ComfyUI] File "/home/runner/.ce/.pixi/envs/sharp-nodes/lib/python3.11/site-packages/torch/nn/modules/module.py", line 1787 in _call_impl [22:19] [ComfyUI] File "/home/runner/.ce/.pixi/envs/sharp-nodes/lib/python3.11/site-packages/torch/nn/modules/module.py", line 1776 in _wrapped_call_impl [22:19] [ComfyUI] File "/home/runner/work/comfy-gpu-ci/comfy-gpu-ci/test_workspaces/Sharp-2211/ComfyUI/custom_nodes/ComfyUI-Sharp/nodes/sharp/model.py", line 662 in forward [22:19] [ComfyUI] File "/home/runner/.ce/.pixi/envs/sharp-nodes/lib/python3.11/site-packages/torch/nn/modules/module.py", line 1787 in _call_impl [22:19] [ComfyUI] File "/home/runner/.ce/.pixi/envs/sharp-nodes/lib/python3.11/site-packages/torch/nn/modules/module.py", line 1776 in _wrapped_call_impl [22:19] [ComfyUI] File "/home/runner/work/comfy-gpu-ci/comfy-gpu-ci/test_workspaces/Sharp-2211/ComfyUI/custom_nodes/ComfyUI-Sharp/nodes/sharp/model.py", line 1109 in forward [22:19] [ComfyUI] File "/home/runner/.ce/.pixi/envs/sharp-nodes/lib/python3.11/site-packages/torch/nn/modules/module.py", line 1787 in _call_impl [22:19] [ComfyUI] File "/home/runner/.ce/.pixi/envs/sharp-nodes/lib/python3.11/site-packages/torch/nn/modules/module.py", line 1776 in _wrapped_call_impl [22:19] [ComfyUI] File "/home/runner/work/comfy-gpu-ci/comfy-gpu-ci/test_workspaces/Sharp-2211/ComfyUI/custom_nodes/ComfyUI-Sharp/nodes/sharp/model.py", line 2006 in encode [22:19] [ComfyUI] File "/home/runner/work/comfy-gpu-ci/comfy-gpu-ci/test_workspaces/Sharp-2211/ComfyUI/custom_nodes/ComfyUI-Sharp/nodes/predict_metric_depth.py", line 231 in execute [22:19] [ComfyUI] File "/home/runner/.ce/.pixi/envs/sharp-nodes/lib/python3.11/site-packages/torch/utils/_contextlib.py", line 124 in decorate_context [22:19] [ComfyUI] File "/home/runner/work/comfy-gpu-ci/comfy-gpu-ci/test_workspaces/Sharp-2211/ComfyUI/comfy_api/latest/_io.py", line 1892 in EXECUTE_NORMALIZED [22:19] [ComfyUI] File "/tmp/comfyui_pvenv_1p20y9l5/persistent_worker.py", line 1762 in main [22:19] [ComfyUI] File "/tmp/comfyui_pvenv_1p20y9l5/persistent_worker.py", line 1807 in [22:19] [ComfyUI] [22:19] [ComfyUI] [worker:ComfyUI-Sharp] === END === [22:19] [ComfyUI] [22:52] Frame 6 saved (frame_005.jpg, t=360.3s) [22:52] [capture-periodic] freeze=16416ms shot=16559ms unfreeze=4ms saved=True [23:19] [ComfyUI] [worker:ComfyUI-Sharp] [23:19] [ComfyUI] === WATCHDOG TICK 7 === [23:19] [ComfyUI] [worker:ComfyUI-Sharp] Thread 0x00007ff77ba7c6c0 (most recent call first): [23:19] [ComfyUI] File "/home/runner/.ce/.pixi/envs/sharp-nodes/lib/python3.11/socket.py", line 294 in accept [23:19] [ComfyUI] File "/home/runner/.ce/.pixi/envs/sharp-nodes/lib/python3.11/multiprocessing/connection.py", line 626 in accept [23:19] [ComfyUI] File "/home/runner/.ce/.pixi/envs/sharp-nodes/lib/python3.11/multiprocessing/connection.py", line 480 in accept [23:19] [ComfyUI] File "/home/runner/.ce/.pixi/envs/sharp-nodes/lib/python3.11/multiprocessing/resource_sharer.py", line 138 in _serve [23:19] [ComfyUI] File "/home/runner/.ce/.pixi/envs/sharp-nodes/lib/python3.11/threading.py", line 982 in run [23:19] [ComfyUI] File "/home/runner/.ce/.pixi/envs/sharp-nodes/lib/python3.11/threading.py", line 1045 in _bootstrap_inner [23:19] [ComfyUI] File "/home/runner/.ce/.pixi/envs/sharp-nodes/lib/python3.11/threading.py", line 1002 in _bootstrap [23:19] [ComfyUI] [23:19] [ComfyUI] Current thread 0x00007ff8a4b246c0 (most recent call first): [23:19] [ComfyUI] File "/tmp/comfyui_pvenv_1p20y9l5/persistent_worker.py", line 52 in _watchdog [23:19] [ComfyUI] File "/home/runner/.ce/.pixi/envs/sharp-nodes/lib/python3.11/threading.py", line 982 in run [23:19] [ComfyUI] File "/home/runner/.ce/.pixi/envs/sharp-nodes/lib/python3.11/threading.py", line 1045 in _bootstrap_inner [23:19] [ComfyUI] File "/home/runner/.ce/.pixi/envs/sharp-nodes/lib/python3.11/threading.py", line 1002 in _bootstrap [23:19] [ComfyUI] [23:19] [ComfyUI] Thread 0x00007ff8a5645740 (most recent call first): [23:19] [ComfyUI] File "/home/runner/.ce/.pixi/envs/sharp-nodes/lib/python3.11/site-packages/torch/nn/modules/linear.py", line 134 in forward [23:19] [ComfyUI] File "/home/runner/work/comfy-gpu-ci/comfy-gpu-ci/test_workspaces/Sharp-2211/ComfyUI/comfy/ops.py", line 503 in forward [23:19] [ComfyUI] File "/home/runner/.ce/.pixi/envs/sharp-nodes/lib/python3.11/site-packages/torch/nn/modules/module.py", line 1787 in _call_impl [23:19] [ComfyUI] File "/home/runner/.ce/.pixi/envs/sharp-nodes/lib/python3.11/site-packages/torch/nn/modules/module.py", line 1776 in _wrapped_call_impl [23:19] [ComfyUI] File "/home/runner/work/comfy-gpu-ci/comfy-gpu-ci/test_workspaces/Sharp-2211/ComfyUI/custom_nodes/ComfyUI-Sharp/nodes/sharp/model.py", line 274 in forward [23:19] [ComfyUI] File "/home/runner/.ce/.pixi/envs/sharp-nodes/lib/python3.11/site-packages/torch/nn/modules/module.py", line 1787 in _call_impl [23:19] [ComfyUI] File "/home/runner/.ce/.pixi/envs/sharp-nodes/lib/python3.11/site-packages/torch/nn/modules/module.py", line 1776 in _wrapped_call_impl [23:19] [ComfyUI] File "/home/runner/work/comfy-gpu-ci/comfy-gpu-ci/test_workspaces/Sharp-2211/ComfyUI/custom_nodes/ComfyUI-Sharp/nodes/sharp/model.py", line 310 in forward [23:19] [ComfyUI] File "/home/runner/.ce/.pixi/envs/sharp-nodes/lib/python3.11/site-packages/torch/nn/modules/module.py", line 1787 in _call_impl [23:19] [ComfyUI] File "/home/runner/.ce/.pixi/envs/sharp-nodes/lib/python3.11/site-packages/torch/nn/modules/module.py", line 1776 in _wrapped_call_impl [23:19] [ComfyUI] File "/home/runner/work/comfy-gpu-ci/comfy-gpu-ci/test_workspaces/Sharp-2211/ComfyUI/custom_nodes/ComfyUI-Sharp/nodes/sharp/model.py", line 412 in forward [23:19] [ComfyUI] File "/home/runner/.ce/.pixi/envs/sharp-nodes/lib/python3.11/site-packages/torch/nn/modules/module.py", line 1787 in _call_impl [23:19] [ComfyUI] File "/home/runner/.ce/.pixi/envs/sharp-nodes/lib/python3.11/site-packages/torch/nn/modules/module.py", line 1776 in _wrapped_call_impl [23:19] [ComfyUI] File "/home/runner/work/comfy-gpu-ci/comfy-gpu-ci/test_workspaces/Sharp-2211/ComfyUI/custom_nodes/ComfyUI-Sharp/nodes/sharp/model.py", line 685 in forward [23:19] [ComfyUI] File "/home/runner/.ce/.pixi/envs/sharp-nodes/lib/python3.11/site-packages/torch/nn/modules/module.py", line 1787 in _call_impl [23:19] [ComfyUI] File "/home/runner/.ce/.pixi/envs/sharp-nodes/lib/python3.11/site-packages/torch/nn/modules/module.py", line 1776 in _wrapped_call_impl [23:19] [ComfyUI] File "/home/runner/work/comfy-gpu-ci/comfy-gpu-ci/test_workspaces/Sharp-2211/ComfyUI/custom_nodes/ComfyUI-Sharp/nodes/sharp/model.py", line 1109 in forward [23:19] [ComfyUI] File "/home/runner/.ce/.pixi/envs/sharp-nodes/lib/python3.11/site-packages/torch/nn/modules/module.py", line 1787 in _call_impl [23:19] [ComfyUI] File "/home/runner/.ce/.pixi/envs/sharp-nodes/lib/python3.11/site-packages/torch/nn/modules/module.py", line 1776 in _wrapped_call_impl [23:19] [ComfyUI] File "/home/runner/work/comfy-gpu-ci/comfy-gpu-ci/test_workspaces/Sharp-2211/ComfyUI/custom_nodes/ComfyUI-Sharp/nodes/sharp/model.py", line 2006 in encode [23:19] [ComfyUI] File "/home/runner/work/comfy-gpu-ci/comfy-gpu-ci/test_workspaces/Sharp-2211/ComfyUI/custom_nodes/ComfyUI-Sharp/nodes/predict_metric_depth.py", line 231 in execute [23:19] [ComfyUI] File "/home/runner/.ce/.pixi/envs/sharp-nodes/lib/python3.11/site-packages/torch/utils/_contextlib.py", line 124 in decorate_context [23:19] [ComfyUI] File "/home/runner/work/comfy-gpu-ci/comfy-gpu-ci/test_workspaces/Sharp-2211/ComfyUI/comfy_api/latest/_io.py", line 1892 in EXECUTE_NORMALIZED [23:19] [ComfyUI] File "/tmp/comfyui_pvenv_1p20y9l5/persistent_worker.py", line 1762 in main [23:19] [ComfyUI] File "/tmp/comfyui_pvenv_1p20y9l5/persistent_worker.py", line 1807 in [23:19] [ComfyUI] [23:19] [ComfyUI] [worker:ComfyUI-Sharp] === END === [23:19] [ComfyUI] [24:19] [ComfyUI] [worker:ComfyUI-Sharp] [24:19] [ComfyUI] === WATCHDOG TICK 8 === [24:19] [ComfyUI] [worker:ComfyUI-Sharp] Thread 0x00007ff77ba7c6c0 (most recent call first): [24:19] [ComfyUI] File "/home/runner/.ce/.pixi/envs/sharp-nodes/lib/python3.11/socket.py", line 294 in accept [24:19] [ComfyUI] File "/home/runner/.ce/.pixi/envs/sharp-nodes/lib/python3.11/multiprocessing/connection.py", line 626 in accept [24:19] [ComfyUI] File "/home/runner/.ce/.pixi/envs/sharp-nodes/lib/python3.11/multiprocessing/connection.py", line 480 in accept [24:19] [ComfyUI] File "/home/runner/.ce/.pixi/envs/sharp-nodes/lib/python3.11/multiprocessing/resource_sharer.py", line 138 in _serve [24:19] [ComfyUI] File "/home/runner/.ce/.pixi/envs/sharp-nodes/lib/python3.11/threading.py", line 982 in run [24:19] [ComfyUI] File "/home/runner/.ce/.pixi/envs/sharp-nodes/lib/python3.11/threading.py", line 1045 in _bootstrap_inner [24:19] [ComfyUI] File "/home/runner/.ce/.pixi/envs/sharp-nodes/lib/python3.11/threading.py", line 1002 in _bootstrap [24:19] [ComfyUI] [24:19] [ComfyUI] Current thread 0x00007ff8a4b246c0 (most recent call first): [24:19] [ComfyUI] File "/tmp/comfyui_pvenv_1p20y9l5/persistent_worker.py", line 52 in _watchdog [24:19] [ComfyUI] File "/home/runner/.ce/.pixi/envs/sharp-nodes/lib/python3.11/threading.py", line 982 in run [24:19] [ComfyUI] File "/home/runner/.ce/.pixi/envs/sharp-nodes/lib/python3.11/threading.py", line 1045 in _bootstrap_inner [24:19] [ComfyUI] File "/home/runner/.ce/.pixi/envs/sharp-nodes/lib/python3.11/threading.py", line 1002 in _bootstrap [24:19] [ComfyUI] [24:19] [ComfyUI] Thread 0x00007ff8a5645740 (most recent call first): [24:19] [ComfyUI] File "/home/runner/work/comfy-gpu-ci/comfy-gpu-ci/test_workspaces/Sharp-2211/ComfyUI/comfy/ldm/modules/sub_quadratic_attention.py", line 181 in _get_attention_scores_no_kv_chunking [24:19] [ComfyUI] File "/home/runner/work/comfy-gpu-ci/comfy-gpu-ci/test_workspaces/Sharp-2211/ComfyUI/comfy/ldm/modules/sub_quadratic_attention.py", line 259 in efficient_dot_product_attention [24:19] [ComfyUI] File "/home/runner/work/comfy-gpu-ci/comfy-gpu-ci/test_workspaces/Sharp-2211/ComfyUI/comfy/ldm/modules/attention.py", line 275 in attention_sub_quad [24:19] [ComfyUI] File "/home/runner/work/comfy-gpu-ci/comfy-gpu-ci/test_workspaces/Sharp-2211/ComfyUI/comfy/ldm/modules/attention.py", line 139 in wrapper [24:19] [ComfyUI] File "/home/runner/work/comfy-gpu-ci/comfy-gpu-ci/test_workspaces/Sharp-2211/ComfyUI/custom_nodes/ComfyUI-Sharp/nodes/sharp/model.py", line 234 in forward [24:19] [ComfyUI] File "/home/runner/.ce/.pixi/envs/sharp-nodes/lib/python3.11/site-packages/torch/nn/modules/module.py", line 1787 in _call_impl [24:19] [ComfyUI] File "/home/runner/.ce/.pixi/envs/sharp-nodes/lib/python3.11/site-packages/torch/nn/modules/module.py", line 1776 in _wrapped_call_impl [24:19] [ComfyUI] File "/home/runner/work/comfy-gpu-ci/comfy-gpu-ci/test_workspaces/Sharp-2211/ComfyUI/custom_nodes/ComfyUI-Sharp/nodes/sharp/model.py", line 309 in forward [24:19] [ComfyUI] File "/home/runner/.ce/.pixi/envs/sharp-nodes/lib/python3.11/site-packages/torch/nn/modules/module.py", line 1787 in _call_impl [24:19] [ComfyUI] File "/home/runner/.ce/.pixi/envs/sharp-nodes/lib/python3.11/site-packages/torch/nn/modules/module.py", line 1776 in _wrapped_call_impl [24:19] [ComfyUI] File "/home/runner/work/comfy-gpu-ci/comfy-gpu-ci/test_workspaces/Sharp-2211/ComfyUI/custom_nodes/ComfyUI-Sharp/nodes/sharp/model.py", line 412 in forward [24:19] [ComfyUI] File "/home/runner/.ce/.pixi/envs/sharp-nodes/lib/python3.11/site-packages/torch/nn/modules/module.py", line 1787 in _call_impl [24:19] [ComfyUI] File "/home/runner/.ce/.pixi/envs/sharp-nodes/lib/python3.11/site-packages/torch/nn/modules/module.py", line 1776 in _wrapped_call_impl [24:19] [ComfyUI] File "/home/runner/work/comfy-gpu-ci/comfy-gpu-ci/test_workspaces/Sharp-2211/ComfyUI/custom_nodes/ComfyUI-Sharp/nodes/sharp/model.py", line 685 in forward [24:19] [ComfyUI] File "/home/runner/.ce/.pixi/envs/sharp-nodes/lib/python3.11/site-packages/torch/nn/modules/module.py", line 1787 in _call_impl [24:19] [ComfyUI] File "/home/runner/.ce/.pixi/envs/sharp-nodes/lib/python3.11/site-packages/torch/nn/modules/module.py", line 1776 in _wrapped_call_impl [24:19] [ComfyUI] File "/home/runner/work/comfy-gpu-ci/comfy-gpu-ci/test_workspaces/Sharp-2211/ComfyUI/custom_nodes/ComfyUI-Sharp/nodes/sharp/model.py", line 1109 in forward [24:19] [ComfyUI] File "/home/runner/.ce/.pixi/envs/sharp-nodes/lib/python3.11/site-packages/torch/nn/modules/module.py", line 1787 in _call_impl [24:19] [ComfyUI] File "/home/runner/.ce/.pixi/envs/sharp-nodes/lib/python3.11/site-packages/torch/nn/modules/module.py", line 1776 in _wrapped_call_impl [24:19] [ComfyUI] File "/home/runner/work/comfy-gpu-ci/comfy-gpu-ci/test_workspaces/Sharp-2211/ComfyUI/custom_nodes/ComfyUI-Sharp/nodes/sharp/model.py", line 2006 in encode [24:19] [ComfyUI] File "/home/runner/work/comfy-gpu-ci/comfy-gpu-ci/test_workspaces/Sharp-2211/ComfyUI/custom_nodes/ComfyUI-Sharp/nodes/predict_metric_depth.py", line 231 in execute [24:19] [ComfyUI] File "/home/runner/.ce/.pixi/envs/sharp-nodes/lib/python3.11/site-packages/torch/utils/_contextlib.py", line 124 in decorate_context [24:19] [ComfyUI] File "/home/runner/work/comfy-gpu-ci/comfy-gpu-ci/test_workspaces/Sharp-2211/ComfyUI/comfy_api/latest/_io.py", line 1892 in EXECUTE_NORMALIZED [24:19] [ComfyUI] File "/tmp/comfyui_pvenv_1p20y9l5/persistent_worker.py", line 1762 in main [24:19] [ComfyUI] File "/tmp/comfyui_pvenv_1p20y9l5/persistent_worker.py", line 1807 in [24:19] [ComfyUI] [24:19] [ComfyUI] [worker:ComfyUI-Sharp] === END === [24:19] [ComfyUI] [25:19] [ComfyUI] [worker:ComfyUI-Sharp] [25:19] [ComfyUI] === WATCHDOG TICK 9 === [25:19] [ComfyUI] [worker:ComfyUI-Sharp] Thread 0x00007ff77ba7c6c0 (most recent call first): [25:19] [ComfyUI] File "/home/runner/.ce/.pixi/envs/sharp-nodes/lib/python3.11/socket.py", line 294 in accept [25:19] [ComfyUI] File "/home/runner/.ce/.pixi/envs/sharp-nodes/lib/python3.11/multiprocessing/connection.py", line 626 in accept [25:19] [ComfyUI] File "/home/runner/.ce/.pixi/envs/sharp-nodes/lib/python3.11/multiprocessing/connection.py", line 480 in accept [25:19] [ComfyUI] File "/home/runner/.ce/.pixi/envs/sharp-nodes/lib/python3.11/multiprocessing/resource_sharer.py", line 138 in _serve [25:19] [ComfyUI] File "/home/runner/.ce/.pixi/envs/sharp-nodes/lib/python3.11/threading.py", line 982 in run [25:19] [ComfyUI] File "/home/runner/.ce/.pixi/envs/sharp-nodes/lib/python3.11/threading.py", line 1045 in _bootstrap_inner [25:19] [ComfyUI] File "/home/runner/.ce/.pixi/envs/sharp-nodes/lib/python3.11/threading.py", line 1002 in _bootstrap [25:19] [ComfyUI] [25:19] [ComfyUI] Current thread 0x00007ff8a4b246c0 (most recent call first): [25:19] [ComfyUI] File "/tmp/comfyui_pvenv_1p20y9l5/persistent_worker.py", line 52 in _watchdog [25:19] [ComfyUI] File "/home/runner/.ce/.pixi/envs/sharp-nodes/lib/python3.11/threading.py", line 982 in run [25:19] [ComfyUI] File "/home/runner/.ce/.pixi/envs/sharp-nodes/lib/python3.11/threading.py", line 1045 in _bootstrap_inner [25:19] [ComfyUI] File "/home/runner/.ce/.pixi/envs/sharp-nodes/lib/python3.11/threading.py", line 1002 in _bootstrap [25:19] [ComfyUI] [25:19] [ComfyUI] Thread 0x00007ff8a5645740 (most recent call first): [25:19] [ComfyUI] File "/home/runner/.ce/.pixi/envs/sharp-nodes/lib/python3.11/site-packages/torch/nn/modules/linear.py", line 134 in forward [25:19] [ComfyUI] File "/home/runner/work/comfy-gpu-ci/comfy-gpu-ci/test_workspaces/Sharp-2211/ComfyUI/comfy/ops.py", line 503 in forward [25:19] [ComfyUI] File "/home/runner/.ce/.pixi/envs/sharp-nodes/lib/python3.11/site-packages/torch/nn/modules/module.py", line 1787 in _call_impl [25:19] [ComfyUI] File "/home/runner/.ce/.pixi/envs/sharp-nodes/lib/python3.11/site-packages/torch/nn/modules/module.py", line 1776 in _wrapped_call_impl [25:19] [ComfyUI] File "/home/runner/work/comfy-gpu-ci/comfy-gpu-ci/test_workspaces/Sharp-2211/ComfyUI/custom_nodes/ComfyUI-Sharp/nodes/sharp/model.py", line 274 in forward [25:19] [ComfyUI] File "/home/runner/.ce/.pixi/envs/sharp-nodes/lib/python3.11/site-packages/torch/nn/modules/module.py", line 1787 in _call_impl [25:19] [ComfyUI] File "/home/runner/.ce/.pixi/envs/sharp-nodes/lib/python3.11/site-packages/torch/nn/modules/module.py", line 1776 in _wrapped_call_impl [25:19] [ComfyUI] File "/home/runner/work/comfy-gpu-ci/comfy-gpu-ci/test_workspaces/Sharp-2211/ComfyUI/custom_nodes/ComfyUI-Sharp/nodes/sharp/model.py", line 310 in forward [25:19] [ComfyUI] File "/home/runner/.ce/.pixi/envs/sharp-nodes/lib/python3.11/site-packages/torch/nn/modules/module.py", line 1787 in _call_impl [25:19] [ComfyUI] File "/home/runner/.ce/.pixi/envs/sharp-nodes/lib/python3.11/site-packages/torch/nn/modules/module.py", line 1776 in _wrapped_call_impl [25:19] [ComfyUI] File "/home/runner/work/comfy-gpu-ci/comfy-gpu-ci/test_workspaces/Sharp-2211/ComfyUI/custom_nodes/ComfyUI-Sharp/nodes/sharp/model.py", line 412 in forward [25:19] [ComfyUI] File "/home/runner/.ce/.pixi/envs/sharp-nodes/lib/python3.11/site-packages/torch/nn/modules/module.py", line 1787 in _call_impl [25:19] [ComfyUI] File "/home/runner/.ce/.pixi/envs/sharp-nodes/lib/python3.11/site-packages/torch/nn/modules/module.py", line 1776 in _wrapped_call_impl [25:19] [ComfyUI] File "/home/runner/work/comfy-gpu-ci/comfy-gpu-ci/test_workspaces/Sharp-2211/ComfyUI/custom_nodes/ComfyUI-Sharp/nodes/sharp/model.py", line 685 in forward [25:19] [ComfyUI] File "/home/runner/.ce/.pixi/envs/sharp-nodes/lib/python3.11/site-packages/torch/nn/modules/module.py", line 1787 in _call_impl [25:19] [ComfyUI] File "/home/runner/.ce/.pixi/envs/sharp-nodes/lib/python3.11/site-packages/torch/nn/modules/module.py", line 1776 in _wrapped_call_impl [25:19] [ComfyUI] File "/home/runner/work/comfy-gpu-ci/comfy-gpu-ci/test_workspaces/Sharp-2211/ComfyUI/custom_nodes/ComfyUI-Sharp/nodes/sharp/model.py", line 1109 in forward [25:19] [ComfyUI] File "/home/runner/.ce/.pixi/envs/sharp-nodes/lib/python3.11/site-packages/torch/nn/modules/module.py", line 1787 in _call_impl [25:19] [ComfyUI] File "/home/runner/.ce/.pixi/envs/sharp-nodes/lib/python3.11/site-packages/torch/nn/modules/module.py", line 1776 in _wrapped_call_impl [25:19] [ComfyUI] File "/home/runner/work/comfy-gpu-ci/comfy-gpu-ci/test_workspaces/Sharp-2211/ComfyUI/custom_nodes/ComfyUI-Sharp/nodes/sharp/model.py", line 2006 in encode [25:19] [ComfyUI] File "/home/runner/work/comfy-gpu-ci/comfy-gpu-ci/test_workspaces/Sharp-2211/ComfyUI/custom_nodes/ComfyUI-Sharp/nodes/predict_metric_depth.py", line 231 in execute [25:19] [ComfyUI] File "/home/runner/.ce/.pixi/envs/sharp-nodes/lib/python3.11/site-packages/torch/utils/_contextlib.py", line 124 in decorate_context [25:19] [ComfyUI] File "/home/runner/work/comfy-gpu-ci/comfy-gpu-ci/test_workspaces/Sharp-2211/ComfyUI/comfy_api/latest/_io.py", line 1892 in EXECUTE_NORMALIZED [25:19] [ComfyUI] File "/tmp/comfyui_pvenv_1p20y9l5/persistent_worker.py", line 1762 in main [25:19] [ComfyUI] File "/tmp/comfyui_pvenv_1p20y9l5/persistent_worker.py", line 1807 in [25:19] [ComfyUI] [25:19] [ComfyUI] [worker:ComfyUI-Sharp] === END === [25:19] [ComfyUI] [26:19] [ComfyUI] [worker:ComfyUI-Sharp] [26:19] [ComfyUI] === WATCHDOG TICK 10 === [26:19] [ComfyUI] [worker:ComfyUI-Sharp] Thread 0x00007ff77ba7c6c0 (most recent call first): [26:19] [ComfyUI] File "/home/runner/.ce/.pixi/envs/sharp-nodes/lib/python3.11/socket.py", line 294 in accept [26:19] [ComfyUI] File "/home/runner/.ce/.pixi/envs/sharp-nodes/lib/python3.11/multiprocessing/connection.py", line 626 in accept [26:19] [ComfyUI] File "/home/runner/.ce/.pixi/envs/sharp-nodes/lib/python3.11/multiprocessing/connection.py", line 480 in accept [26:19] [ComfyUI] File "/home/runner/.ce/.pixi/envs/sharp-nodes/lib/python3.11/multiprocessing/resource_sharer.py", line 138 in _serve [26:19] [ComfyUI] File "/home/runner/.ce/.pixi/envs/sharp-nodes/lib/python3.11/threading.py", line 982 in run [26:19] [ComfyUI] File "/home/runner/.ce/.pixi/envs/sharp-nodes/lib/python3.11/threading.py", line 1045 in _bootstrap_inner [26:19] [ComfyUI] File "/home/runner/.ce/.pixi/envs/sharp-nodes/lib/python3.11/threading.py", line 1002 in _bootstrap [26:19] [ComfyUI] [26:19] [ComfyUI] Current thread 0x00007ff8a4b246c0 (most recent call first): [26:19] [ComfyUI] File "/tmp/comfyui_pvenv_1p20y9l5/persistent_worker.py", line 52 in _watchdog [26:19] [ComfyUI] File "/home/runner/.ce/.pixi/envs/sharp-nodes/lib/python3.11/threading.py", line 982 in run [26:19] [ComfyUI] File "/home/runner/.ce/.pixi/envs/sharp-nodes/lib/python3.11/threading.py", line 1045 in _bootstrap_inner [26:19] [ComfyUI] File "/home/runner/.ce/.pixi/envs/sharp-nodes/lib/python3.11/threading.py", line 1002 in _bootstrap [26:19] [ComfyUI] [26:19] [ComfyUI] Thread 0x00007ff8a5645740 (most recent call first): [26:19] [ComfyUI] File "/home/runner/.ce/.pixi/envs/sharp-nodes/lib/python3.11/site-packages/torch/nn/modules/conv.py", line 548 in _conv_forward [26:19] [ComfyUI] File "/home/runner/.ce/.pixi/envs/sharp-nodes/lib/python3.11/site-packages/torch/nn/modules/conv.py", line 553 in forward [26:19] [ComfyUI] File "/home/runner/work/comfy-gpu-ci/comfy-gpu-ci/test_workspaces/Sharp-2211/ComfyUI/comfy/ops.py", line 537 in forward [26:19] [ComfyUI] File "/home/runner/.ce/.pixi/envs/sharp-nodes/lib/python3.11/site-packages/torch/nn/modules/module.py", line 1787 in _call_impl [26:19] [ComfyUI] File "/home/runner/.ce/.pixi/envs/sharp-nodes/lib/python3.11/site-packages/torch/nn/modules/module.py", line 1776 in _wrapped_call_impl [26:19] [ComfyUI] File "/home/runner/.ce/.pixi/envs/sharp-nodes/lib/python3.11/site-packages/torch/nn/modules/container.py", line 253 in forward [26:19] [ComfyUI] File "/home/runner/.ce/.pixi/envs/sharp-nodes/lib/python3.11/site-packages/torch/nn/modules/module.py", line 1787 in _call_impl [26:19] [ComfyUI] File "/home/runner/.ce/.pixi/envs/sharp-nodes/lib/python3.11/site-packages/torch/nn/modules/module.py", line 1776 in _wrapped_call_impl [26:19] [ComfyUI] File "/home/runner/work/comfy-gpu-ci/comfy-gpu-ci/test_workspaces/Sharp-2211/ComfyUI/custom_nodes/ComfyUI-Sharp/nodes/sharp/model.py", line 766 in forward [26:19] [ComfyUI] File "/home/runner/.ce/.pixi/envs/sharp-nodes/lib/python3.11/site-packages/torch/nn/modules/module.py", line 1787 in _call_impl [26:19] [ComfyUI] File "/home/runner/.ce/.pixi/envs/sharp-nodes/lib/python3.11/site-packages/torch/nn/modules/module.py", line 1776 in _wrapped_call_impl [26:19] [ComfyUI] File "/home/runner/work/comfy-gpu-ci/comfy-gpu-ci/test_workspaces/Sharp-2211/ComfyUI/custom_nodes/ComfyUI-Sharp/nodes/sharp/model.py", line 858 in forward [26:19] [ComfyUI] File "/home/runner/.ce/.pixi/envs/sharp-nodes/lib/python3.11/site-packages/torch/nn/modules/module.py", line 1787 in _call_impl [26:19] [ComfyUI] File "/home/runner/.ce/.pixi/envs/sharp-nodes/lib/python3.11/site-packages/torch/nn/modules/module.py", line 1776 in _wrapped_call_impl [26:19] [ComfyUI] File "/home/runner/work/comfy-gpu-ci/comfy-gpu-ci/test_workspaces/Sharp-2211/ComfyUI/custom_nodes/ComfyUI-Sharp/nodes/sharp/model.py", line 970 in forward [26:19] [ComfyUI] File "/home/runner/.ce/.pixi/envs/sharp-nodes/lib/python3.11/site-packages/torch/nn/modules/module.py", line 1787 in _call_impl [26:19] [ComfyUI] File "/home/runner/.ce/.pixi/envs/sharp-nodes/lib/python3.11/site-packages/torch/nn/modules/module.py", line 1776 in _wrapped_call_impl [26:19] [ComfyUI] File "/home/runner/work/comfy-gpu-ci/comfy-gpu-ci/test_workspaces/Sharp-2211/ComfyUI/custom_nodes/ComfyUI-Sharp/nodes/sharp/model.py", line 1118 in forward [26:19] [ComfyUI] File "/home/runner/.ce/.pixi/envs/sharp-nodes/lib/python3.11/site-packages/torch/nn/modules/module.py", line 1787 in _call_impl [26:19] [ComfyUI] File "/home/runner/.ce/.pixi/envs/sharp-nodes/lib/python3.11/site-packages/torch/nn/modules/module.py", line 1776 in _wrapped_call_impl [26:19] [ComfyUI] File "/home/runner/work/comfy-gpu-ci/comfy-gpu-ci/test_workspaces/Sharp-2211/ComfyUI/custom_nodes/ComfyUI-Sharp/nodes/sharp/model.py", line 2006 in encode [26:19] [ComfyUI] File "/home/runner/work/comfy-gpu-ci/comfy-gpu-ci/test_workspaces/Sharp-2211/ComfyUI/custom_nodes/ComfyUI-Sharp/nodes/predict_metric_depth.py", line 231 in execute [26:19] [ComfyUI] File "/home/runner/.ce/.pixi/envs/sharp-nodes/lib/python3.11/site-packages/torch/utils/_contextlib.py", line 124 in decorate_context [26:19] [ComfyUI] File "/home/runner/work/comfy-gpu-ci/comfy-gpu-ci/test_workspaces/Sharp-2211/ComfyUI/comfy_api/latest/_io.py", line 1892 in EXECUTE_NORMALIZED [26:19] [ComfyUI] File "/tmp/comfyui_pvenv_1p20y9l5/persistent_worker.py", line 1762 in main [26:19] [ComfyUI] File "/tmp/comfyui_pvenv_1p20y9l5/persistent_worker.py", line 1807 in [26:19] [ComfyUI] [26:19] [ComfyUI] [worker:ComfyUI-Sharp] === END === [26:19] [ComfyUI] [27:19] [ComfyUI] [worker:ComfyUI-Sharp] [27:19] [ComfyUI] === WATCHDOG TICK 11 === [27:19] [ComfyUI] [worker:ComfyUI-Sharp] Thread 0x00007ff77ba7c6c0 (most recent call first): [27:19] [ComfyUI] File "/home/runner/.ce/.pixi/envs/sharp-nodes/lib/python3.11/socket.py", line 294 in accept [27:19] [ComfyUI] File "/home/runner/.ce/.pixi/envs/sharp-nodes/lib/python3.11/multiprocessing/connection.py", line 626 in accept [27:19] [ComfyUI] File "/home/runner/.ce/.pixi/envs/sharp-nodes/lib/python3.11/multiprocessing/connection.py", line 480 in accept [27:19] [ComfyUI] File "/home/runner/.ce/.pixi/envs/sharp-nodes/lib/python3.11/multiprocessing/resource_sharer.py", line 138 in _serve [27:19] [ComfyUI] File "/home/runner/.ce/.pixi/envs/sharp-nodes/lib/python3.11/threading.py", line 982 in run [27:19] [ComfyUI] File "/home/runner/.ce/.pixi/envs/sharp-nodes/lib/python3.11/threading.py", line 1045 in _bootstrap_inner [27:19] [ComfyUI] File "/home/runner/.ce/.pixi/envs/sharp-nodes/lib/python3.11/threading.py", line 1002 in _bootstrap [27:19] [ComfyUI] [27:19] [ComfyUI] Current thread 0x00007ff8a4b246c0 (most recent call first): [27:19] [ComfyUI] File "/tmp/comfyui_pvenv_1p20y9l5/persistent_worker.py", line 52 in _watchdog [27:19] [ComfyUI] File "/home/runner/.ce/.pixi/envs/sharp-nodes/lib/python3.11/threading.py", line 982 in run [27:19] [ComfyUI] File "/home/runner/.ce/.pixi/envs/sharp-nodes/lib/python3.11/threading.py", line 1045 in _bootstrap_inner [27:19] [ComfyUI] File "/home/runner/.ce/.pixi/envs/sharp-nodes/lib/python3.11/threading.py", line 1002 in _bootstrap [27:19] [ComfyUI] [27:19] [ComfyUI] Thread 0x00007ff8a5645740 (most recent call first): [27:19] [ComfyUI] File "/home/runner/.ce/.pixi/envs/sharp-nodes/lib/python3.11/site-packages/torch/nn/modules/conv.py", line 548 in _conv_forward [27:19] [ComfyUI] File "/home/runner/.ce/.pixi/envs/sharp-nodes/lib/python3.11/site-packages/torch/nn/modules/conv.py", line 553 in forward [27:19] [ComfyUI] File "/home/runner/work/comfy-gpu-ci/comfy-gpu-ci/test_workspaces/Sharp-2211/ComfyUI/comfy/ops.py", line 537 in forward [27:19] [ComfyUI] File "/home/runner/.ce/.pixi/envs/sharp-nodes/lib/python3.11/site-packages/torch/nn/modules/module.py", line 1787 in _call_impl [27:19] [ComfyUI] File "/home/runner/.ce/.pixi/envs/sharp-nodes/lib/python3.11/site-packages/torch/nn/modules/module.py", line 1776 in _wrapped_call_impl [27:19] [ComfyUI] File "/home/runner/.ce/.pixi/envs/sharp-nodes/lib/python3.11/site-packages/torch/nn/modules/container.py", line 253 in forward [27:19] [ComfyUI] File "/home/runner/.ce/.pixi/envs/sharp-nodes/lib/python3.11/site-packages/torch/nn/modules/module.py", line 1787 in _call_impl [27:19] [ComfyUI] File "/home/runner/.ce/.pixi/envs/sharp-nodes/lib/python3.11/site-packages/torch/nn/modules/module.py", line 1776 in _wrapped_call_impl [27:19] [ComfyUI] File "/home/runner/work/comfy-gpu-ci/comfy-gpu-ci/test_workspaces/Sharp-2211/ComfyUI/custom_nodes/ComfyUI-Sharp/nodes/sharp/model.py", line 1120 in forward [27:19] [ComfyUI] File "/home/runner/.ce/.pixi/envs/sharp-nodes/lib/python3.11/site-packages/torch/nn/modules/module.py", line 1787 in _call_impl [27:19] [ComfyUI] File "/home/runner/.ce/.pixi/envs/sharp-nodes/lib/python3.11/site-packages/torch/nn/modules/module.py", line 1776 in _wrapped_call_impl [27:19] [ComfyUI] File "/home/runner/work/comfy-gpu-ci/comfy-gpu-ci/test_workspaces/Sharp-2211/ComfyUI/custom_nodes/ComfyUI-Sharp/nodes/sharp/model.py", line 2006 in encode [27:19] [ComfyUI] File "/home/runner/work/comfy-gpu-ci/comfy-gpu-ci/test_workspaces/Sharp-2211/ComfyUI/custom_nodes/ComfyUI-Sharp/nodes/predict_metric_depth.py", line 231 in execute [27:19] [ComfyUI] File "/home/runner/.ce/.pixi/envs/sharp-nodes/lib/python3.11/site-packages/torch/utils/_contextlib.py", line 124 in decorate_context [27:19] [ComfyUI] File "/home/runner/work/comfy-gpu-ci/comfy-gpu-ci/test_workspaces/Sharp-2211/ComfyUI/comfy_api/latest/_io.py", line 1892 in EXECUTE_NORMALIZED [27:19] [ComfyUI] File "/tmp/comfyui_pvenv_1p20y9l5/persistent_worker.py", line 1762 in main [27:19] [ComfyUI] File "/tmp/comfyui_pvenv_1p20y9l5/persistent_worker.py", line 1807 in [27:19] [ComfyUI] [27:19] [ComfyUI] [worker:ComfyUI-Sharp] === END === [27:19] [ComfyUI] [27:31] [ComfyUI] [worker:ComfyUI-Sharp] [SharpPredictMetricDepth] 1 face(s) @ 1536²; layer0/layer1 depth median=2.12/2.12m, K_1536 fx->1286.7; points_raw ||v||=1.32–3.07m; 329.6s [27:31] [ComfyUI] [SubprocessWorker] got response: ok [27:31] [ComfyUI] [comfy-env] SharpPredictMetricDepth done (329.72s): result: NodeOutput [27:31] [ComfyUI] [comfy-env] Running SharpPredictGaussiansFromMetricDepth: snap_to_external_depth: 'none', depth_convention: 'planar_z', focal_length_mm: 30.0, output_prefix: 'sharp_aligned', save_background_layer: True, edge_crop: 0.0, model: dict, image: torch.float32 [1,960,1416,3] cpu, metric_depth_layer0: torch.float32 [1,1536,1536,3] cpu [27:31] [ComfyUI] [SubprocessWorker] call_method: nodes.predict_gaussians_from_depth.SharpPredictGaussiansFromMetricDepth.EXECUTE_NORMALIZED [27:31] [ComfyUI] [SubprocessWorker] acquired lock, ensuring started... [27:31] [ComfyUI] [ComfyUI-Sharp] Health check: ping (timeout=5.0s)... [27:31] [ComfyUI] [ComfyUI-Sharp] Health check: ok [27:31] [ComfyUI] [SubprocessWorker] worker started/confirmed [27:31] [ComfyUI] [comfy-env] PRE-SERIALIZE 'image' shape: torch.Size([1, 960, 1416, 3]) [27:31] [ComfyUI] [comfy-env] PRE-SERIALIZE 'metric_depth_layer0' shape: torch.Size([1, 1536, 1536, 3]) [27:31] [ComfyUI] [SubprocessWorker] serializing kwargs to shm... [27:31] [ComfyUI] [SubprocessWorker] created 0 shm blocks [27:31] [ComfyUI] [SubprocessWorker] sending request via socket... [27:31] [ComfyUI] [SubprocessWorker] call_id=9 sending call_method [27:31] [ComfyUI] [worker:ComfyUI-Sharp] [comfy-env] _from_shm got dict with keys: ['__type__', 'strategy', 'parent_pid', 'fd', 'storage_size'] [27:31] [ComfyUI] [worker:ComfyUI-Sharp] [comfy-env] DESERIALIZE TensorRef: tensor_size=[1, 960, 1416, 3] [27:31] [ComfyUI] [worker:ComfyUI-Sharp] [comfy-env] DESERIALIZED tensor shape: torch.Size([1, 960, 1416, 3]) [27:31] [ComfyUI] [worker:ComfyUI-Sharp] [comfy-env] _from_shm got dict with keys: ['__type__', 'strategy', 'parent_pid', 'fd', 'storage_size'] [27:31] [ComfyUI] [worker:ComfyUI-Sharp] [comfy-env] DESERIALIZE TensorRef: tensor_size=[1, 1536, 1536, 3] [27:31] [ComfyUI] [worker:ComfyUI-Sharp] [comfy-env] DESERIALIZED tensor shape: torch.Size([1, 1536, 1536, 3]) [27:31] [ComfyUI] [worker:ComfyUI-Sharp] [SharpPredictGaussiansFromMetricDepth] metric_depth_layer1 unwired -> layer 1 will duplicate layer 0 (legacy behavior) [27:31] [ComfyUI] [SubprocessWorker] callback 'request_vram_budget' from call_id=9 [27:31] [ComfyUI] [comfy-env] VRAM request: 2.81GB, free before eviction: 8.09GB [27:31] [ComfyUI] [comfy-env] VRAM after eviction: 8.09GB [27:31] [ComfyUI] [worker:ComfyUI-Sharp] [SharpPredictGaussiansFromMetricDepth] face 1/1: 1416×960, extrinsics=none, intrinsics=none, mask=no, snap=none, depth_conv=planar_z [27:56] Frame 7 saved (frame_006.jpg, t=661.6s) [27:56] [capture-periodic] freeze=18134ms shot=17365ms unfreeze=5ms saved=True [28:19] [ComfyUI] [SubprocessWorker] callback 'report_progress' from call_id=9 [28:19] [ComfyUI] [worker:ComfyUI-Sharp] [SharpPredictGaussiansFromMetricDepth] 1 face(s) -> 1.18M gaussians total (both layers, snap=none); saved to /home/runner/work/comfy-gpu-ci/comfy-gpu-ci/test_workspaces/Sharp-2211/ComfyUI/output/sharp_aligned_1780871965355.ply; 47.9s [28:19] [ComfyUI] [SubprocessWorker] got response: ok [28:19] [ComfyUI] [comfy-env] SharpPredictGaussiansFromMetricDepth done (48.01s): result: NodeOutput [28:19] [ComfyUI] [comfy-env] Running PreviewGaussianSharp: ply_path: '/home/runner/work/comfy-gpu-ci/comfy-gpu-ci/test_workspa..., extrinsics: list[4], intrinsics: list[3] [28:19] [ComfyUI] [SubprocessWorker] call_method: nodes.preview_gaussian_sharp.PreviewGaussianSharp.EXECUTE_NORMALIZED [28:19] [ComfyUI] [SubprocessWorker] acquired lock, ensuring started... [28:19] [ComfyUI] [ComfyUI-GaussianPack] Health check: ping (timeout=5.0s)... [28:19] [ComfyUI] [ComfyUI-GaussianPack] Health check: failed [28:19] [ComfyUI] [ComfyUI-GaussianPack] Socket unhealthy, restarting worker... [28:19] [ComfyUI] [ComfyUI-GaussianPack] python: /home/runner/.ce/.pixi/envs/gaussianpack-nodes/bin/python [28:19] [ComfyUI] [ComfyUI-GaussianPack] sys_path sent to worker: ['/home/runner/work/comfy-gpu-ci/comfy-gpu-ci/test_workspaces/Sharp-2211/ComfyUI', '/home/runner/work/comfy-gpu-ci/comfy-gpu-ci/test_workspaces/Sharp-2211/ComfyUI/custom_nodes/ComfyUI-GaussianPack', '/home/runner/.ce/.pixi/envs/gaussianpack-nodes/lib/python3.11/site-packages', '/home/runner/work/comfy-gpu-ci/comfy-gpu-ci/test_workspaces/Sharp-2211/ComfyUI/custom_nodes/ComfyUI-GaussianPack'] [28:19] [ComfyUI] [SubprocessWorker] is_pixi=True, python=/home/runner/.ce/.pixi/envs/gaussianpack-nodes/bin/python [28:19] [ComfyUI] [SubprocessWorker] launching cmd=['/home/runner/.pixi/bin/pixi', 'run', '--as-is', '--manifest-path', '/home/runner/.ce/pixi.toml', '-e', 'gaussianpack-nodes', 'python', '/tmp/comfyui_pvenv_w5l8haz9/persistent_worker.py', 'abstract://comfy_worker_eee5f705b0db']... [28:19] [ComfyUI] [SubprocessWorker] socket_addr=abstract://comfy_worker_eee5f705b0db (abstract, no filesystem path) [28:21] [ComfyUI] [SubprocessWorker] worker started/confirmed [28:21] [ComfyUI] [SubprocessWorker] serializing kwargs to shm... [28:21] [ComfyUI] [SubprocessWorker] created 0 shm blocks [28:21] [ComfyUI] [SubprocessWorker] sending request via socket... [28:21] [ComfyUI] [SubprocessWorker] call_id=4 sending call_method [28:21] [ComfyUI] [worker:ComfyUI-GaussianPack] WARNING: SPZ route not registered (ModuleNotFoundError: No module named 'comfy_aimdo') [28:21] [ComfyUI] [SubprocessWorker] got response: ok [28:21] [ComfyUI] [comfy-env] PreviewGaussianSharp done (2.11s): result: NodeOutput [28:21] [ComfyUI] [INFO] Prompt executed in 00:12:02 [28:41] Frame 8 saved (frame_007.jpg, t=714.3s) [28:41] [capture-periodic] freeze=14706ms shot=13294ms unfreeze=100ms saved=True [28:51] Node executed (2 total), capturing... [29:12] Frame 9 saved (frame_008.jpg, t=752.7s) [29:12] [capture-node] freeze=10040ms shot=10436ms unfreeze=0ms saved=True [29:12] Execution complete (t=752.7s) [29:12] [3d-wait] Phase 1: Waiting for 'Loading 3D Model' text to disappear... [29:12] [3d-wait] Phase 1 done in 0.0s [29:12] [3d-wait] Phase 2: iframes=2 [29:12] [3d-wait] iframe viewer_ready=True (matched 2 console logs) [29:12] [3d-wait] Unfrozen in 0.002s, rendering for 5s... [29:32] [3d-wait] JS halted via CDP after 20.5s [30:03] [3d-wait] Re-frozen in 51.0s [30:03] [3d-wait] Total 3D wait: 51.0s [30:03] Captured 9 unique frames over 824.24s [30:03] [debug] iframes: 2 [30:03] [debug] iframe[0]: src=http://127.0.0.1:41888/extensions/ComfyUI-GaussianPack/viewer_gaussian_sharp.htm, canvas=1416x960, rafFrozen=True [30:03] [debug] iframe[1]: src=http://127.0.0.1:41888/extensions/ComfyUI-GaussianPack/viewer_gaussian_sharp.htm, canvas=1416x960, rafFrozen=True [30:03] [timing] trigger_3d_previews: 0.0s [30:05] Saved high-quality screenshot: vanilla_vs_image_depth_gaussians_executed.png [30:05] [timing] final_screenshot: 0.3s [30:05] [ComfyUI] [INFO] Using RAM pressure cache. [30:06] Results saved to /home/runner/work/comfy-gpu-ci/comfy-gpu-ci/comfy-test-logs/Sharp-2211/dev/linux-cpu/results.json [30:06] Model report: 4 files, 2.6 GB -> /home/runner/work/comfy-gpu-ci/comfy-gpu-ci/comfy-test-logs/Sharp-2211/dev/linux-cpu/models.json [30:06] Saved: /home/runner/work/comfy-gpu-ci/comfy-gpu-ci/comfy-test-logs/Sharp-2211/dev/linux-cpu/index.html [30:06] [EXECUTION] PASSED [30:06] linux: PASSED [30:06] Stopping ComfyUI server...