[00:00] Crash dump logging enabled: /home/runner/work/comfy-gpu-ci/comfy-gpu-ci/comfy-test-logs/Sharp-2000/dev/linux-cpu/crash_dump.log [00:00] [00:00] [1/5] SYNTAX [00:00] ---------------------------------------- [00:00] [DEBUG] server=None, api=None [00:00] Found pyproject.toml (modern format) [00:00] Found requirements.txt (legacy format) [00:00] Unicode check: OK (all characters cp1252-safe) [00:00] Forbidden patterns check: OK [00:00] [SYNTAX] PASSED [00:00] [00:00] [2/5] INSTALL [00:00] ---------------------------------------- [00:00] [DEBUG] server=None, api=None [00:00] Setting up ComfyUI... [00:00] Creating virtual environment... [00:00] Running: uv venv /home/runner/work/comfy-gpu-ci/comfy-gpu-ci/test_workspaces/Sharp-2000/.venv --python 3.10 [00:00] torch_version='2.10.0' -> pinning torch==2.10.0 torchvision==0.25.0 torchaudio==2.10.0 [00:00] Cloning ComfyUI (latest)... [00:00] Running: git clone --depth 1 https://github.com/comfyanonymous/ComfyUI.git /home/runner/work/comfy-gpu-ci/comfy-gpu-ci/test_workspaces/Sharp-2000/ComfyUI [00:01] Pinning torch family from https://download.pytorch.org/whl/cpu: torch==2.10.0 torchvision==0.25.0 torchaudio==2.10.0 [00:01] Running: uv pip install --python /home/runner/work/comfy-gpu-ci/comfy-gpu-ci/test_workspaces/Sharp-2000/.venv/bin/python --index-url https://download.pytorch.org/whl/cpu --extra-index-url https://pypi.org/simple --index-strategy unsafe-best-match torch==2.10.0 torchvision==0.25.0 torchaudio==2.10.0 [00:07] Installing ComfyUI requirements... [00:07] Running: uv pip install --python /home/runner/work/comfy-gpu-ci/comfy-gpu-ci/test_workspaces/Sharp-2000/.venv/bin/python --index-url https://download.pytorch.org/whl/cpu --extra-index-url https://pypi.org/simple --index-strategy unsafe-best-match -r /home/runner/work/comfy-gpu-ci/comfy-gpu-ci/test_workspaces/Sharp-2000/ComfyUI/requirements.txt [00:12] Installing custom node... [00:12] Copying ComfyUI-Sharp to custom_nodes/... [00:13] Installing node requirements... [00:13] Running: uv pip install --python /home/runner/work/comfy-gpu-ci/comfy-gpu-ci/test_workspaces/Sharp-2000/.venv/bin/python --index-url https://download.pytorch.org/whl/cpu --extra-index-url https://pypi.org/simple --index-strategy unsafe-best-match -r /home/runner/work/comfy-gpu-ci/comfy-gpu-ci/test_workspaces/Sharp-2000/ComfyUI/custom_nodes/ComfyUI-Sharp/requirements.txt [00:14] Running install.py... [00:14] Running: /home/runner/work/comfy-gpu-ci/comfy-gpu-ci/test_workspaces/Sharp-2000/.venv/bin/python /home/runner/work/comfy-gpu-ci/comfy-gpu-ci/test_workspaces/Sharp-2000/ComfyUI/custom_nodes/ComfyUI-Sharp/install.py [00:15] [00:16] Installing 2 node dependencies... [00:16] Cloning ComfyUI-GaussianPack... [00:18] Installing requirements for ComfyUI-GaussianPack... [00:20] Running install.py for ComfyUI-GaussianPack... [00:21] [comfy-env] _discover: scanning /home/runner/work/comfy-gpu-ci/comfy-gpu-ci/test_workspaces/Sharp-2000/ComfyUI/custom_nodes [00:21] [comfy-env] _discover: ComfyUI-GaussianPack -> gaussianpack-nodes (custom_nodes/ComfyUI-GaussianPack/nodes/comfy-env.toml) [00:21] [comfy-env] _discover: ComfyUI-Sharp -> sharp-nodes (custom_nodes/ComfyUI-Sharp/nodes/comfy-env.toml) [00:21] [comfy-env] Workspace: /home/runner/.ce [00:21] [comfy-env] ComfyUI: /home/runner/work/comfy-gpu-ci/comfy-gpu-ci/test_workspaces/Sharp-2000/ComfyUI [00:21] [comfy-env] Found 2 node config(s): [00:21] - gaussianpack-nodes <- custom_nodes/ComfyUI-GaussianPack/nodes/comfy-env.toml (python=host) [00:21] - sharp-nodes <- custom_nodes/ComfyUI-Sharp/nodes/comfy-env.toml (python=host) [00:21] [comfy-env] Bootstrap interpreter has python 3.10 + torch 2.10.0 (cpu). Looking for cuda-only wheels matching cpu/torch2.10/cp310. [00:24] [comfy-env] GPU: No GPU detected [00:24] [comfy-env] No CUDA detected -- pinning comfyui torch to CPU index [00:24] [comfy-env] Host glibc 2.39 -> system-requirements [00:24] Generated /home/runner/.ce/pixi.toml [00:24] [comfy-env] Installing 2 environment(s): [00:24] - gaussianpack-nodes (python=host, 8 pypi deps, 1 cuda wheels) [00:24] - sharp-nodes (python=host, 15 pypi deps) [00:24] [comfy-env] Running `pixi install -e gaussianpack-nodes -e sharp-nodes`... [00:36] WARN Skipped running the post-link scripts because `run-post-link-scripts` = `false` [00:36] - bin/.librsvg-pre-unlink.sh [00:36] To enable them, run: [00:36] pixi config set --local run-post-link-scripts insecure [00:36] More info: [00:36] https://pixi.sh/latest/reference/pixi_configuration/#run-post-link-scripts [00:37] WARN Skipped running the post-link scripts because `run-post-link-scripts` = `false` [00:37] - bin/.librsvg-pre-unlink.sh [00:37] To enable them, run: [00:37] pixi config set --local run-post-link-scripts insecure [00:37] More info: [00:37] https://pixi.sh/latest/reference/pixi_configuration/#run-post-link-scripts [00:44] ✔ The following environments have been installed: gaussianpack-nodes, sharp-nodes. [00:44] [comfy-env] Recorded install hash c13fd71e660f -> /home/runner/.ce/install.hash [00:44] [comfy-env] Install log: /home/runner/.ce/install.log [00:44] [00:44] Installation complete! [00:44] Cloning ComfyUI-PanoPack... [00:46] Installing requirements for ComfyUI-PanoPack... [00:46] Running install.py for ComfyUI-PanoPack... [00:46] [00:46] Installing 2 node dependencies... [00:46] Cloning ComfyUI-MoGe2... [00:47] Installing requirements for ComfyUI-MoGe2... [00:47] Running install.py for ComfyUI-MoGe2... [00:47] [comfy-env] _discover: scanning /home/runner/work/comfy-gpu-ci/comfy-gpu-ci/test_workspaces/Sharp-2000/ComfyUI/custom_nodes [00:47] [comfy-env] _discover: ComfyUI-GaussianPack -> gaussianpack-nodes (custom_nodes/ComfyUI-GaussianPack/nodes/comfy-env.toml) [00:47] [comfy-env] _discover: ComfyUI-MoGe2 -> moge2-nodes (custom_nodes/ComfyUI-MoGe2/nodes/comfy-env.toml) [00:47] [comfy-env] _discover: ComfyUI-PanoPack -> panopack-nodes (custom_nodes/ComfyUI-PanoPack/nodes/comfy-env.toml) [00:47] [comfy-env] _discover: ComfyUI-Sharp -> sharp-nodes (custom_nodes/ComfyUI-Sharp/nodes/comfy-env.toml) [00:47] [comfy-env] Workspace: /home/runner/.ce [00:47] [comfy-env] ComfyUI: /home/runner/work/comfy-gpu-ci/comfy-gpu-ci/test_workspaces/Sharp-2000/ComfyUI [00:47] [comfy-env] Found 4 node config(s): [00:47] - gaussianpack-nodes <- custom_nodes/ComfyUI-GaussianPack/nodes/comfy-env.toml (python=host) [00:47] - moge2-nodes <- custom_nodes/ComfyUI-MoGe2/nodes/comfy-env.toml (python=host) [00:47] - panopack-nodes <- custom_nodes/ComfyUI-PanoPack/nodes/comfy-env.toml (python=host) [00:47] - sharp-nodes <- custom_nodes/ComfyUI-Sharp/nodes/comfy-env.toml (python=host) [00:47] [comfy-env] Bootstrap interpreter has python 3.10 + torch 2.10.0 (cpu). Looking for cuda-only wheels matching cpu/torch2.10/cp310. [00:48] [comfy-env] GPU: No GPU detected [00:48] [comfy-env] No CUDA detected -- pinning comfyui torch to CPU index [00:48] [comfy-env] Host glibc 2.39 -> system-requirements [00:48] Generated /home/runner/.ce/pixi.toml [00:48] [comfy-env] Installing 4 environment(s): [00:48] - gaussianpack-nodes (python=host, 8 pypi deps, 1 cuda wheels) [00:48] - moge2-nodes (python=host, 12 pypi deps, 2 cuda wheels) [00:48] - panopack-nodes (python=host, 21 pypi deps) [00:48] - sharp-nodes (python=host, 15 pypi deps) [00:48] [comfy-env] Running `pixi install -e gaussianpack-nodes -e moge2-nodes -e panopack-nodes -e sharp-nodes`... [00:57] WARN Skipped running the post-link scripts because `run-post-link-scripts` = `false` [00:57] - bin/.librsvg-pre-unlink.sh [00:57] To enable them, run: [00:57] pixi config set --local run-post-link-scripts insecure [00:57] More info: [00:57] https://pixi.sh/latest/reference/pixi_configuration/#run-post-link-scripts [00:58] WARN Skipped running the post-link scripts because `run-post-link-scripts` = `false` [00:58] - bin/.librsvg-pre-unlink.sh [00:58] To enable them, run: [00:58] pixi config set --local run-post-link-scripts insecure [00:58] More info: [00:58] https://pixi.sh/latest/reference/pixi_configuration/#run-post-link-scripts [00:59] ✔ The following environments have been installed: gaussianpack-nodes, moge2-nodes, panopack-nodes, sharp-nodes. [00:59] [comfy-env] Recorded install hash ead5c265d7a8 -> /home/runner/.ce/install.hash [00:59] [comfy-env] Install log: /home/runner/.ce/install.log [00:59] [00:59] Installation complete! [01:00] Cloning ComfyUI-GeometryPack... [01:02] Installing requirements for ComfyUI-GeometryPack... [01:02] Running install.py for ComfyUI-GeometryPack... [01:02] [comfy-env] _discover: scanning /home/runner/work/comfy-gpu-ci/comfy-gpu-ci/test_workspaces/Sharp-2000/ComfyUI/custom_nodes [01:02] [comfy-env] _discover: ComfyUI-GaussianPack -> gaussianpack-nodes (custom_nodes/ComfyUI-GaussianPack/nodes/comfy-env.toml) [01:02] [comfy-env] _discover: ComfyUI-GeometryPack -> geometrypack-nodes (custom_nodes/ComfyUI-GeometryPack/nodes/comfy-env.toml) [01:02] [comfy-env] _discover: ComfyUI-MoGe2 -> moge2-nodes (custom_nodes/ComfyUI-MoGe2/nodes/comfy-env.toml) [01:02] [comfy-env] _discover: ComfyUI-PanoPack -> panopack-nodes (custom_nodes/ComfyUI-PanoPack/nodes/comfy-env.toml) [01:02] [comfy-env] _discover: ComfyUI-Sharp -> sharp-nodes (custom_nodes/ComfyUI-Sharp/nodes/comfy-env.toml) [01:02] [comfy-env] Workspace: /home/runner/.ce [01:02] [comfy-env] ComfyUI: /home/runner/work/comfy-gpu-ci/comfy-gpu-ci/test_workspaces/Sharp-2000/ComfyUI [01:02] [comfy-env] Found 5 node config(s): [01:02] - gaussianpack-nodes <- custom_nodes/ComfyUI-GaussianPack/nodes/comfy-env.toml (python=host) [01:02] - geometrypack-nodes <- custom_nodes/ComfyUI-GeometryPack/nodes/comfy-env.toml (python=host) [01:02] - moge2-nodes <- custom_nodes/ComfyUI-MoGe2/nodes/comfy-env.toml (python=host) [01:02] - panopack-nodes <- custom_nodes/ComfyUI-PanoPack/nodes/comfy-env.toml (python=host) [01:02] - sharp-nodes <- custom_nodes/ComfyUI-Sharp/nodes/comfy-env.toml (python=host) [01:02] [comfy-env] Bootstrap interpreter has python 3.10 + torch 2.10.0 (cpu). Looking for cuda-only wheels matching cpu/torch2.10/cp310. [01:03] [comfy-env] GPU: No GPU detected [01:03] [comfy-env] No CUDA detected -- pinning comfyui torch to CPU index [01:03] [comfy-env] Host glibc 2.39 -> system-requirements [01:03] Generated /home/runner/.ce/pixi.toml [01:03] [comfy-env] Installing 5 environment(s): [01:03] - gaussianpack-nodes (python=host, 8 pypi deps, 1 cuda wheels) [01:03] - geometrypack-nodes (python=host, 14 pypi deps, 1 cuda wheels) [01:03] - moge2-nodes (python=host, 12 pypi deps, 2 cuda wheels) [01:03] - panopack-nodes (python=host, 21 pypi deps) [01:03] - sharp-nodes (python=host, 15 pypi deps) [01:03] [comfy-env] Running `pixi install -e gaussianpack-nodes -e geometrypack-nodes -e moge2-nodes -e panopack-nodes -e sharp-nodes`... [01:20] WARN Skipped running the post-link scripts because `run-post-link-scripts` = `false` [01:20] - bin/.librsvg-pre-unlink.sh [01:20] To enable them, run: [01:20] pixi config set --local run-post-link-scripts insecure [01:20] More info: [01:20] https://pixi.sh/latest/reference/pixi_configuration/#run-post-link-scripts [01:21] ✔ The following environments have been installed: gaussianpack-nodes, geometrypack-nodes, moge2-nodes, panopack-nodes, sharp-nodes. [01:21] [comfy-env] Recorded install hash 6a7bc6f93489 -> /home/runner/.ce/install.hash [01:21] [comfy-env] Install log: /home/runner/.ce/install.log [01:21] [01:21] Installation complete! [01:22] [01:22] [requirements] Re-installing main package requirements... [01:22] Installing requirements for ComfyUI-PanoPack... [01:22] [comfy-env] _discover: scanning /home/runner/work/comfy-gpu-ci/comfy-gpu-ci/test_workspaces/Sharp-2000/ComfyUI/custom_nodes [01:22] [comfy-env] _discover: ComfyUI-GaussianPack -> gaussianpack-nodes (custom_nodes/ComfyUI-GaussianPack/nodes/comfy-env.toml) [01:22] [comfy-env] _discover: ComfyUI-GeometryPack -> geometrypack-nodes (custom_nodes/ComfyUI-GeometryPack/nodes/comfy-env.toml) [01:22] [comfy-env] _discover: ComfyUI-MoGe2 -> moge2-nodes (custom_nodes/ComfyUI-MoGe2/nodes/comfy-env.toml) [01:22] [comfy-env] _discover: ComfyUI-PanoPack -> panopack-nodes (custom_nodes/ComfyUI-PanoPack/nodes/comfy-env.toml) [01:22] [comfy-env] _discover: ComfyUI-Sharp -> sharp-nodes (custom_nodes/ComfyUI-Sharp/nodes/comfy-env.toml) [01:22] [comfy-env] Workspace inputs unchanged (hash 6a7bc6f93489) -- skipping install. Delete /home/runner/.ce/install.hash to force. [01:22] [01:22] Installation complete! [01:22] ComfyUI-MoGe2: exists [01:22] ComfyUI-GeometryPack: exists [01:22] [01:22] [requirements] Re-installing main package requirements... [01:22] Installing requirements for ComfyUI-Sharp... [01:22] [comfy-env] _discover: scanning /home/runner/work/comfy-gpu-ci/comfy-gpu-ci/test_workspaces/Sharp-2000/ComfyUI/custom_nodes [01:22] [comfy-env] _discover: ComfyUI-GaussianPack -> gaussianpack-nodes (custom_nodes/ComfyUI-GaussianPack/nodes/comfy-env.toml) [01:22] [comfy-env] _discover: ComfyUI-GeometryPack -> geometrypack-nodes (custom_nodes/ComfyUI-GeometryPack/nodes/comfy-env.toml) [01:22] [comfy-env] _discover: ComfyUI-MoGe2 -> moge2-nodes (custom_nodes/ComfyUI-MoGe2/nodes/comfy-env.toml) [01:22] [comfy-env] _discover: ComfyUI-PanoPack -> panopack-nodes (custom_nodes/ComfyUI-PanoPack/nodes/comfy-env.toml) [01:22] [comfy-env] _discover: ComfyUI-Sharp -> sharp-nodes (custom_nodes/ComfyUI-Sharp/nodes/comfy-env.toml) [01:22] [comfy-env] Workspace inputs unchanged (hash 6a7bc6f93489) -- skipping install. Delete /home/runner/.ce/install.hash to force. [01:22] [01:22] Installation complete! [01:22] Installing 2 node dependency(ies)... [01:22] ComfyUI-GaussianPack from PozzettiAndrea/ComfyUI-GaussianPack [01:22] ComfyUI-GaussianPack already exists, skipping... [01:22] ComfyUI-PanoPack from PozzettiAndrea/ComfyUI-PanoPack [01:22] ComfyUI-PanoPack already exists, skipping... [01:22] Installing validation endpoint... [01:22] Cloning PozzettiAndrea/ComfyUI-validate-endpoint... [01:22] Running: git clone --depth 1 https://x-access-token:***@github.com/PozzettiAndrea/ComfyUI-validate-endpoint.git /home/runner/work/comfy-gpu-ci/comfy-gpu-ci/test_workspaces/Sharp-2000/ComfyUI/custom_nodes/ComfyUI-validate-endpoint [01:22] [INSTALL] PASSED [01:22] [01:22] [3/5] REGISTRATION [01:22] ---------------------------------------- [01:22] [DEBUG] server=None, api=None [01:22] Starting ComfyUI server... [01:22] Starting ComfyUI server on port 41882... [01:22] Starting ComfyUI server on port 41882... [01:22] Waiting for server to be ready (timeout: 600s)... [01:23] [ComfyUI] [INFO] setup plugin alembic.autogenerate.schemas [01:23] [ComfyUI] [INFO] setup plugin alembic.autogenerate.tables [01:23] [ComfyUI] [INFO] setup plugin alembic.autogenerate.types [01:23] [ComfyUI] [INFO] setup plugin alembic.autogenerate.constraints [01:23] [ComfyUI] [INFO] setup plugin alembic.autogenerate.defaults [01:23] [ComfyUI] [INFO] setup plugin alembic.autogenerate.comments [01:24] [ComfyUI] [comfy-env] ComfyUI-Sharp: 1 isolation env(s): [01:24] [ComfyUI] [comfy-env] nodes -> /home/runner/work/comfy-gpu-ci/comfy-gpu-ci/test_workspaces/Sharp-2000/ComfyUI/custom_nodes/ComfyUI-Sharp/nodes [01:24] [ComfyUI] [comfy-env] Workspace: /home/runner/.ce [01:24] [ComfyUI] [comfy-env] env: /home/runner/.ce/.pixi/envs/sharp-nodes [OK] [01:24] [ComfyUI] [comfy-env] prestartup complete [01:24] [ComfyUI] [comfy-env] ComfyUI-GeometryPack: 1 isolation env(s): [01:24] [ComfyUI] [comfy-env] nodes -> /home/runner/work/comfy-gpu-ci/comfy-gpu-ci/test_workspaces/Sharp-2000/ComfyUI/custom_nodes/ComfyUI-GeometryPack/nodes [01:24] [ComfyUI] [comfy-env] env: /home/runner/.ce/.pixi/envs/geometrypack-nodes [OK] [01:24] [ComfyUI] [comfy-env] prestartup complete [01:24] [ComfyUI] [comfy-env] ComfyUI-PanoPack: 1 isolation env(s): [01:24] [ComfyUI] [comfy-env] nodes -> /home/runner/work/comfy-gpu-ci/comfy-gpu-ci/test_workspaces/Sharp-2000/ComfyUI/custom_nodes/ComfyUI-PanoPack/nodes [01:24] [ComfyUI] [comfy-env] env: /home/runner/.ce/.pixi/envs/panopack-nodes [OK] [01:24] [ComfyUI] [comfy-env] prestartup complete [01:24] [ComfyUI] [comfy-env] ComfyUI-MoGe2: 1 isolation env(s): [01:24] [ComfyUI] [comfy-env] nodes -> /home/runner/work/comfy-gpu-ci/comfy-gpu-ci/test_workspaces/Sharp-2000/ComfyUI/custom_nodes/ComfyUI-MoGe2/nodes [01:24] [ComfyUI] [comfy-env] env: /home/runner/.ce/.pixi/envs/moge2-nodes [OK] [01:24] [ComfyUI] [comfy-env] prestartup complete [01:24] [ComfyUI] [INFO] [01:24] [ComfyUI] Prestartup times for custom nodes: [01:24] [ComfyUI] [INFO] 0.0 seconds: /home/runner/work/comfy-gpu-ci/comfy-gpu-ci/test_workspaces/Sharp-2000/ComfyUI/custom_nodes/ComfyUI-MoGe2 [01:24] [ComfyUI] [INFO] 0.0 seconds: /home/runner/work/comfy-gpu-ci/comfy-gpu-ci/test_workspaces/Sharp-2000/ComfyUI/custom_nodes/ComfyUI-GaussianPack [01:24] [ComfyUI] [INFO] 0.0 seconds: /home/runner/work/comfy-gpu-ci/comfy-gpu-ci/test_workspaces/Sharp-2000/ComfyUI/custom_nodes/ComfyUI-PanoPack [01:24] [ComfyUI] [INFO] 0.1 seconds: /home/runner/work/comfy-gpu-ci/comfy-gpu-ci/test_workspaces/Sharp-2000/ComfyUI/custom_nodes/ComfyUI-GeometryPack [01:24] [ComfyUI] [INFO] 0.2 seconds: /home/runner/work/comfy-gpu-ci/comfy-gpu-ci/test_workspaces/Sharp-2000/ComfyUI/custom_nodes/ComfyUI-Sharp [01:24] [ComfyUI] [INFO] [01:28] [ComfyUI] [INFO] Found comfy_kitchen backend eager: {'available': True, 'disabled': False, 'unavailable_reason': None, 'capabilities': ['apply_rope', 'apply_rope1', 'apply_rope_split_half', 'apply_rope_split_half1', 'dequantize_mxfp8', 'dequantize_nvfp4', 'dequantize_per_tensor_fp8', 'gemv_awq_w4a16', 'quantize_mxfp8', 'quantize_nvfp4', 'quantize_per_tensor_fp8', 'quantize_svdquant_w4a4', 'scaled_mm_mxfp8', 'scaled_mm_nvfp4', 'scaled_mm_svdquant_w4a4', 'stochastic_rounding_fp8']} [01:28] [ComfyUI] [INFO] Found comfy_kitchen backend triton: {'available': False, 'disabled': True, 'unavailable_reason': "ImportError: No module named 'triton'", 'capabilities': []} [01:28] [ComfyUI] [INFO] Found comfy_kitchen backend cuda: {'available': False, 'disabled': True, 'unavailable_reason': 'CUDA not available on this system', 'capabilities': []} [01:28] [ComfyUI] [INFO] Checkpoint files will always be loaded safely. [01:28] [ComfyUI] [INFO] Total VRAM 15990 MB, total RAM 15990 MB [01:28] [ComfyUI] [INFO] pytorch version: 2.10.0+cpu [01:28] [ComfyUI] [INFO] Set vram state to: DISABLED [01:28] [ComfyUI] [INFO] Device: cpu [01:29] [ComfyUI] [INFO] Using sub quadratic optimization for attention, if you have memory or speed issues try using: --use-split-cross-attention [01:33] [ComfyUI] [INFO] Python version: 3.10.20 (main, Mar 3 2026, 15:36:40) [GCC 13.3.0] [01:33] [ComfyUI] [INFO] ComfyUI version: 0.24.0 [01:34] [ComfyUI] [INFO] comfy-aimdo version: 0.4.9 [01:34] [ComfyUI] [INFO] comfy-kitchen version: 0.2.10 [01:34] [ComfyUI] [WARNING] ****** User settings have been changed to be stored on the server instead of browser storage. ****** [01:34] [ComfyUI] [WARNING] ****** For multi-user setups add the --multi-user CLI argument to enable multiple user profiles. ****** [01:34] [ComfyUI] [INFO] comfyui-frontend-package version: 1.45.15 [01:34] [ComfyUI] [INFO] comfyui-workflow-templates version: 0.9.98 [01:34] [ComfyUI] [INFO] comfyui-embedded-docs version: 0.5.2 [01:34] [ComfyUI] [INFO] comfy-kitchen version: 0.2.10 [01:34] [ComfyUI] [INFO] comfy-aimdo version: 0.4.9 [01:34] [ComfyUI] [INFO] [Prompt Server] web root: /home/runner/work/comfy-gpu-ci/comfy-gpu-ci/test_workspaces/Sharp-2000/.venv/lib/python3.10/site-packages/comfyui_frontend_package/static [01:34] [ComfyUI] [INFO] Asset seeder disabled [01:36] [ComfyUI] [comfy-env] Version: 0.3.89 [01:36] [ComfyUI] [comfy-env] register_nodes: ComfyUI-Sharp [01:36] [ComfyUI] [comfy-env] ComfyUI source dir: /home/runner/work/comfy-gpu-ci/comfy-gpu-ci/test_workspaces/Sharp-2000/ComfyUI [01:36] [ComfyUI] [comfy-env] Found 1 isolation env(s) [01:36] [ComfyUI] [comfy-env] Scanning nodes metadata (isolation root)... [01:36] [ComfyUI] [comfy-env] Metadata scan: /home/runner/.pixi/bin/pixi run --as-is --manifest-path /home/runner/.ce/pixi.toml -e sharp-nodes python /tmp/comfy_meta_uj7k_h8q.py /home/runner/work/comfy-gpu-ci/comfy-gpu-ci/test_workspaces/Sharp-2000/ComfyUI/custom_nodes/ComfyUI-Sharp nodes /tmp/comfy_meta_out_vylwnzr9.pkl [01:36] [ComfyUI] [comfy-env] Scan env PATH for nodes: [01:36] [ComfyUI] [comfy-env] [0] /opt/hostedtoolcache/Python/3.10.20/x64/bin [01:36] [ComfyUI] [comfy-env] [1] /opt/hostedtoolcache/Python/3.10.20/x64 [01:36] [ComfyUI] [comfy-env] [2] /snap/bin [01:36] [ComfyUI] [comfy-env] [3] /home/runner/.local/bin [01:36] [ComfyUI] [comfy-env] [4] /opt/pipx_bin [01:36] [ComfyUI] [comfy-env] [5] /home/runner/.cargo/bin [01:36] [ComfyUI] [comfy-env] [6] /home/runner/.config/composer/vendor/bin [01:36] [ComfyUI] [comfy-env] [7] /usr/local/.ghcup/bin [01:36] [ComfyUI] [comfy-env] [8] /home/runner/.dotnet/tools [01:36] [ComfyUI] [comfy-env] [9] /usr/local/sbin [01:36] [ComfyUI] [comfy-env] [10] /usr/local/bin [01:36] [ComfyUI] [comfy-env] [11] /usr/sbin [01:36] [ComfyUI] [comfy-env] [12] /usr/bin [01:36] [ComfyUI] [comfy-env] [13] /sbin [01:36] [ComfyUI] [comfy-env] [14] /bin [01:36] [ComfyUI] [comfy-env] [15] /usr/games [01:36] [ComfyUI] [comfy-env] [16] /usr/local/games [01:36] [ComfyUI] [comfy-env] [17] /snap/bin [01:40] [ComfyUI] [comfy-env] Metadata scan stderr for nodes: [01:40] [ComfyUI] [comfy-env] [meta-scan] importing nodes from /home/runner/work/comfy-gpu-ci/comfy-gpu-ci/test_workspaces/Sharp-2000/ComfyUI/custom_nodes/ComfyUI-Sharp [01:40] [ComfyUI] [comfy-env] [meta-scan] import OK [01:40] [ComfyUI] [comfy-env] Scanned nodes: 17 nodes (3.1s) [01:40] [ComfyUI] [comfy-env] Scanned nodes root: 17 nodes (3.1s) [01:40] [ComfyUI] [comfy-env] Imported nodes root: 17 nodes (isolation) [01:40] [ComfyUI] [comfy-env] Registered 17 total nodes [01:40] [ComfyUI] [INFO] loading... [01:40] [ComfyUI] [INFO] calling register_nodes [01:40] [ComfyUI] [comfy-env] Version: 0.3.89 [01:40] [ComfyUI] [comfy-env] register_nodes: ComfyUI-GeometryPack [01:40] [ComfyUI] [comfy-env] ComfyUI source dir: /home/runner/work/comfy-gpu-ci/comfy-gpu-ci/test_workspaces/Sharp-2000/ComfyUI [01:40] [ComfyUI] [comfy-env] Found 1 isolation env(s) [01:40] [ComfyUI] [comfy-env] Scanning nodes metadata (isolation root)... [01:40] [ComfyUI] [comfy-env] Metadata scan: /home/runner/.pixi/bin/pixi run --as-is --manifest-path /home/runner/.ce/pixi.toml -e geometrypack-nodes python /tmp/comfy_meta_1dhwflk1.py /home/runner/work/comfy-gpu-ci/comfy-gpu-ci/test_workspaces/Sharp-2000/ComfyUI/custom_nodes/ComfyUI-GeometryPack nodes /tmp/comfy_meta_out_ps3o4j14.pkl [01:40] [ComfyUI] [comfy-env] Scan env PATH for nodes: [01:40] [ComfyUI] [comfy-env] [0] /opt/hostedtoolcache/Python/3.10.20/x64/bin [01:40] [ComfyUI] [comfy-env] [1] /opt/hostedtoolcache/Python/3.10.20/x64 [01:40] [ComfyUI] [comfy-env] [2] /snap/bin [01:40] [ComfyUI] [comfy-env] [3] /home/runner/.local/bin [01:40] [ComfyUI] [comfy-env] [4] /opt/pipx_bin [01:40] [ComfyUI] [comfy-env] [5] /home/runner/.cargo/bin [01:40] [ComfyUI] [comfy-env] [6] /home/runner/.config/composer/vendor/bin [01:40] [ComfyUI] [comfy-env] [7] /usr/local/.ghcup/bin [01:40] [ComfyUI] [comfy-env] [8] /home/runner/.dotnet/tools [01:40] [ComfyUI] [comfy-env] [9] /usr/local/sbin [01:40] [ComfyUI] [comfy-env] [10] /usr/local/bin [01:40] [ComfyUI] [comfy-env] [11] /usr/sbin [01:40] [ComfyUI] [comfy-env] [12] /usr/bin [01:40] [ComfyUI] [comfy-env] [13] /sbin [01:40] [ComfyUI] [comfy-env] [14] /bin [01:40] [ComfyUI] [comfy-env] [15] /usr/games [01:40] [ComfyUI] [comfy-env] [16] /usr/local/games [01:40] [ComfyUI] [comfy-env] [17] /snap/bin [01:44] [ComfyUI] [comfy-env] Metadata scan stderr for nodes: [01:44] [ComfyUI] [comfy-env] [meta-scan] importing nodes from /home/runner/work/comfy-gpu-ci/comfy-gpu-ci/test_workspaces/Sharp-2000/ComfyUI/custom_nodes/ComfyUI-GeometryPack [01:44] [ComfyUI] [comfy-env] ERROR:root:Failed to import comfy_kitchen, Error: No module named 'comfy_kitchen', fp8 and fp4 support will not be available. [01:44] [ComfyUI] [comfy-env] WARNING:root:comfy_kitchen does not support stochastic FP8 rounding, please update comfy_kitchen. [01:44] [ComfyUI] [comfy-env] [meta-scan] import OK [01:44] [ComfyUI] [comfy-env] Scanned nodes: 125 nodes (4.1s) [01:44] [ComfyUI] [comfy-env] Scanned nodes root: 125 nodes (4.1s) [01:44] [ComfyUI] [comfy-env] Imported nodes root: 125 nodes (isolation) [01:44] [ComfyUI] [comfy-env] Registered 125 total nodes [01:44] [ComfyUI] [comfy-env] Version: 0.3.89 [01:44] [ComfyUI] [comfy-env] register_nodes: ComfyUI-GaussianPack [01:44] [ComfyUI] [comfy-env] ComfyUI source dir: /home/runner/work/comfy-gpu-ci/comfy-gpu-ci/test_workspaces/Sharp-2000/ComfyUI [01:44] [ComfyUI] [comfy-env] Found 1 isolation env(s) [01:44] [ComfyUI] [comfy-env] Scanning nodes metadata (isolation root)... [01:44] [ComfyUI] [comfy-env] Metadata scan: /home/runner/.pixi/bin/pixi run --as-is --manifest-path /home/runner/.ce/pixi.toml -e gaussianpack-nodes python /tmp/comfy_meta_sl6yolrt.py /home/runner/work/comfy-gpu-ci/comfy-gpu-ci/test_workspaces/Sharp-2000/ComfyUI/custom_nodes/ComfyUI-GaussianPack nodes /tmp/comfy_meta_out_q0_et9_9.pkl [01:44] [ComfyUI] [comfy-env] Scan env PATH for nodes: [01:44] [ComfyUI] [comfy-env] [0] /opt/hostedtoolcache/Python/3.10.20/x64/bin [01:44] [ComfyUI] [comfy-env] [1] /opt/hostedtoolcache/Python/3.10.20/x64 [01:44] [ComfyUI] [comfy-env] [2] /snap/bin [01:44] [ComfyUI] [comfy-env] [3] /home/runner/.local/bin [01:44] [ComfyUI] [comfy-env] [4] /opt/pipx_bin [01:44] [ComfyUI] [comfy-env] [5] /home/runner/.cargo/bin [01:44] [ComfyUI] [comfy-env] [6] /home/runner/.config/composer/vendor/bin [01:44] [ComfyUI] [comfy-env] [7] /usr/local/.ghcup/bin [01:44] [ComfyUI] [comfy-env] [8] /home/runner/.dotnet/tools [01:44] [ComfyUI] [comfy-env] [9] /usr/local/sbin [01:44] [ComfyUI] [comfy-env] [10] /usr/local/bin [01:44] [ComfyUI] [comfy-env] [11] /usr/sbin [01:44] [ComfyUI] [comfy-env] [12] /usr/bin [01:44] [ComfyUI] [comfy-env] [13] /sbin [01:44] [ComfyUI] [comfy-env] [14] /bin [01:44] [ComfyUI] [comfy-env] [15] /usr/games [01:44] [ComfyUI] [comfy-env] [16] /usr/local/games [01:44] [ComfyUI] [comfy-env] [17] /snap/bin [01:47] [ComfyUI] [comfy-env] Metadata scan stderr for nodes: [01:47] [ComfyUI] [comfy-env] [meta-scan] importing nodes from /home/runner/work/comfy-gpu-ci/comfy-gpu-ci/test_workspaces/Sharp-2000/ComfyUI/custom_nodes/ComfyUI-GaussianPack [01:47] [ComfyUI] [comfy-env] SPZ route not registered (ModuleNotFoundError: No module named 'comfy_aimdo') [01:47] [ComfyUI] [comfy-env] [meta-scan] import OK [01:47] [ComfyUI] [comfy-env] Scanned nodes: 11 nodes (3.0s) [01:47] [ComfyUI] [comfy-env] Scanned nodes root: 11 nodes (3.0s) [01:47] [ComfyUI] [comfy-env] Imported nodes root: 11 nodes (isolation) [01:47] [ComfyUI] [comfy-env] Registered 11 total nodes [01:47] [ComfyUI] [comfy-env] Version: 0.3.89 [01:47] [ComfyUI] [comfy-env] register_nodes: ComfyUI-PanoPack [01:47] [ComfyUI] [comfy-env] ComfyUI source dir: /home/runner/work/comfy-gpu-ci/comfy-gpu-ci/test_workspaces/Sharp-2000/ComfyUI [01:47] [ComfyUI] [comfy-env] Found 1 isolation env(s) [01:47] [ComfyUI] [comfy-env] Scanning nodes metadata (isolation root)... [01:47] [ComfyUI] [comfy-env] Metadata scan: /home/runner/.pixi/bin/pixi run --as-is --manifest-path /home/runner/.ce/pixi.toml -e panopack-nodes python /tmp/comfy_meta_9nq2ht1v.py /home/runner/work/comfy-gpu-ci/comfy-gpu-ci/test_workspaces/Sharp-2000/ComfyUI/custom_nodes/ComfyUI-PanoPack nodes /tmp/comfy_meta_out_sg8igwka.pkl [01:47] [ComfyUI] [comfy-env] Scan env PATH for nodes: [01:47] [ComfyUI] [comfy-env] [0] /opt/hostedtoolcache/Python/3.10.20/x64/bin [01:47] [ComfyUI] [comfy-env] [1] /opt/hostedtoolcache/Python/3.10.20/x64 [01:47] [ComfyUI] [comfy-env] [2] /snap/bin [01:47] [ComfyUI] [comfy-env] [3] /home/runner/.local/bin [01:47] [ComfyUI] [comfy-env] [4] /opt/pipx_bin [01:47] [ComfyUI] [comfy-env] [5] /home/runner/.cargo/bin [01:47] [ComfyUI] [comfy-env] [6] /home/runner/.config/composer/vendor/bin [01:47] [ComfyUI] [comfy-env] [7] /usr/local/.ghcup/bin [01:47] [ComfyUI] [comfy-env] [8] /home/runner/.dotnet/tools [01:47] [ComfyUI] [comfy-env] [9] /usr/local/sbin [01:47] [ComfyUI] [comfy-env] [10] /usr/local/bin [01:47] [ComfyUI] [comfy-env] [11] /usr/sbin [01:47] [ComfyUI] [comfy-env] [12] /usr/bin [01:47] [ComfyUI] [comfy-env] [13] /sbin [01:47] [ComfyUI] [comfy-env] [14] /bin [01:47] [ComfyUI] [comfy-env] [15] /usr/games [01:47] [ComfyUI] [comfy-env] [16] /usr/local/games [01:47] [ComfyUI] [comfy-env] [17] /snap/bin [01:50] [ComfyUI] [comfy-env] Metadata scan stderr for nodes: [01:50] [ComfyUI] [comfy-env] [meta-scan] importing nodes from /home/runner/work/comfy-gpu-ci/comfy-gpu-ci/test_workspaces/Sharp-2000/ComfyUI/custom_nodes/ComfyUI-PanoPack [01:50] [ComfyUI] [comfy-env] [meta-scan] import OK [01:50] [ComfyUI] [comfy-env] Scanned nodes: 15 nodes (2.8s) [01:50] [ComfyUI] [comfy-env] Scanned nodes root: 15 nodes (2.8s) [01:50] [ComfyUI] [comfy-env] Imported nodes root: 15 nodes (isolation) [01:50] [ComfyUI] [comfy-env] Registered 15 total nodes [01:50] [ComfyUI] [comfy-env] Version: 0.3.89 [01:50] [ComfyUI] [comfy-env] register_nodes: ComfyUI-MoGe2 [01:50] [ComfyUI] [comfy-env] ComfyUI source dir: /home/runner/work/comfy-gpu-ci/comfy-gpu-ci/test_workspaces/Sharp-2000/ComfyUI [01:50] [ComfyUI] [comfy-env] Found 1 isolation env(s) [01:50] [ComfyUI] [comfy-env] Scanning nodes metadata (isolation root)... [01:50] [ComfyUI] [comfy-env] Metadata scan: /home/runner/.pixi/bin/pixi run --as-is --manifest-path /home/runner/.ce/pixi.toml -e moge2-nodes python /tmp/comfy_meta_ptsh542f.py /home/runner/work/comfy-gpu-ci/comfy-gpu-ci/test_workspaces/Sharp-2000/ComfyUI/custom_nodes/ComfyUI-MoGe2 nodes /tmp/comfy_meta_out_ldir9t96.pkl [01:50] [ComfyUI] [comfy-env] Scan env PATH for nodes: [01:50] [ComfyUI] [comfy-env] [0] /opt/hostedtoolcache/Python/3.10.20/x64/bin [01:50] [ComfyUI] [comfy-env] [1] /opt/hostedtoolcache/Python/3.10.20/x64 [01:50] [ComfyUI] [comfy-env] [2] /snap/bin [01:50] [ComfyUI] [comfy-env] [3] /home/runner/.local/bin [01:50] [ComfyUI] [comfy-env] [4] /opt/pipx_bin [01:50] [ComfyUI] [comfy-env] [5] /home/runner/.cargo/bin [01:50] [ComfyUI] [comfy-env] [6] /home/runner/.config/composer/vendor/bin [01:50] [ComfyUI] [comfy-env] [7] /usr/local/.ghcup/bin [01:50] [ComfyUI] [comfy-env] [8] /home/runner/.dotnet/tools [01:50] [ComfyUI] [comfy-env] [9] /usr/local/sbin [01:50] [ComfyUI] [comfy-env] [10] /usr/local/bin [01:50] [ComfyUI] [comfy-env] [11] /usr/sbin [01:50] [ComfyUI] [comfy-env] [12] /usr/bin [01:50] [ComfyUI] [comfy-env] [13] /sbin [01:50] [ComfyUI] [comfy-env] [14] /bin [01:50] [ComfyUI] [comfy-env] [15] /usr/games [01:50] [ComfyUI] [comfy-env] [16] /usr/local/games [01:50] [ComfyUI] [comfy-env] [17] /snap/bin [01:53] [ComfyUI] [comfy-env] Metadata scan stderr for nodes: [01:53] [ComfyUI] [comfy-env] [meta-scan] importing nodes from /home/runner/work/comfy-gpu-ci/comfy-gpu-ci/test_workspaces/Sharp-2000/ComfyUI/custom_nodes/ComfyUI-MoGe2 [01:53] [ComfyUI] [comfy-env] ERROR:root:Failed to import comfy_kitchen, Error: No module named 'comfy_kitchen', fp8 and fp4 support will not be available. [01:53] [ComfyUI] [comfy-env] WARNING:root:comfy_kitchen does not support stochastic FP8 rounding, please update comfy_kitchen. [01:53] [ComfyUI] [comfy-env] [meta-scan] import OK [01:53] [ComfyUI] [comfy-env] Scanned nodes: 3 nodes (3.2s) [01:53] [ComfyUI] [comfy-env] Scanned nodes root: 3 nodes (3.2s) [01:53] [ComfyUI] [comfy-env] Imported nodes root: 3 nodes (isolation) [01:53] [ComfyUI] [comfy-env] Registered 3 total nodes [01:53] [ComfyUI] [INFO] [01:53] [ComfyUI] Import times for custom nodes: [01:53] [ComfyUI] [INFO] 0.0 seconds: /home/runner/work/comfy-gpu-ci/comfy-gpu-ci/test_workspaces/Sharp-2000/ComfyUI/custom_nodes/websocket_image_save.py [01:53] [ComfyUI] [INFO] 0.0 seconds: /home/runner/work/comfy-gpu-ci/comfy-gpu-ci/test_workspaces/Sharp-2000/ComfyUI/custom_nodes/ComfyUI-validate-endpoint [01:53] [ComfyUI] [INFO] 2.8 seconds: /home/runner/work/comfy-gpu-ci/comfy-gpu-ci/test_workspaces/Sharp-2000/ComfyUI/custom_nodes/ComfyUI-PanoPack [01:53] [ComfyUI] [INFO] 3.0 seconds: /home/runner/work/comfy-gpu-ci/comfy-gpu-ci/test_workspaces/Sharp-2000/ComfyUI/custom_nodes/ComfyUI-GaussianPack [01:53] [ComfyUI] [INFO] 3.2 seconds: /home/runner/work/comfy-gpu-ci/comfy-gpu-ci/test_workspaces/Sharp-2000/ComfyUI/custom_nodes/ComfyUI-MoGe2 [01:53] [ComfyUI] [INFO] 3.4 seconds: /home/runner/work/comfy-gpu-ci/comfy-gpu-ci/test_workspaces/Sharp-2000/ComfyUI/custom_nodes/ComfyUI-Sharp [01:53] [ComfyUI] [INFO] 4.2 seconds: /home/runner/work/comfy-gpu-ci/comfy-gpu-ci/test_workspaces/Sharp-2000/ComfyUI/custom_nodes/ComfyUI-GeometryPack [01:53] [ComfyUI] [INFO] [01:53] [ComfyUI] [INFO] Context impl SQLiteImpl. [01:53] [ComfyUI] [INFO] Will assume non-transactional DDL. [01:53] [ComfyUI] [INFO] Context impl SQLiteImpl. [01:53] [ComfyUI] [INFO] Will assume non-transactional DDL. [01:53] [ComfyUI] [INFO] Running upgrade -> 0001_assets, Initial assets schema [01:53] [ComfyUI] Revision ID: 0001_assets [01:53] [ComfyUI] Revises: None [01:53] [ComfyUI] Create Date: 2025-12-10 00:00:00 [01:53] [ComfyUI] [INFO] Running upgrade 0001_assets -> 0002_merge_to_asset_references, Merge AssetInfo and AssetCacheState into unified asset_references table. [01:53] [ComfyUI] [INFO] Running upgrade 0002_merge_to_asset_references -> 0003_add_metadata_job_id, Add system_metadata and job_id columns to asset_references. [01:53] [ComfyUI] Change preview_id FK from assets.id to asset_references.id. [01:53] [ComfyUI] [INFO] Database upgraded from None to 0003_add_metadata_job_id [01:53] [ComfyUI] [INFO] Using RAM pressure cache. [01:53] [ComfyUI] [INFO] Starting server [01:53] [ComfyUI] [01:53] [ComfyUI] [INFO] To see the GUI go to: http://127.0.0.1:41882 [01:53] Server responding, waiting for nodes to load... [02:13] Server is ready! [02:13] Checking for import errors in server logs... [02:13] No import errors detected [02:14] Found 942 registered nodes [02:14] [REGISTRATION] PASSED [02:14] [02:14] [4/5] INSTANTIATION [02:14] ---------------------------------------- [02:14] [DEBUG] server=, api= [02:14] Testing node constructors... [02:15] All 17 node(s) instantiated successfully! [02:15] [INSTANTIATION] PASSED [02:15] [02:15] [5/5] EXECUTION [02:15] ---------------------------------------- [02:15] [DEBUG] server=, api= [02:15] CPU runner - will execute 3 workflow(s) [02:15] Running 4 workflow(s) (all with videos)... [02:15] Installing screenshot dependencies (playwright, pillow)... [02:16] Packages installed, downloading chromium browser... [02:27] Screenshot dependencies installed successfully [02:27] Starting headless browser... [02:27] Installing Mesa llvmpipe (apt)... [02:40] Mesa install failed: E: Unable to locate package libegl1-mesa [02:40] No GPU, no Mesa -- using SwiftShader software rendering [02:42] [ComfyUI] [INFO] Using RAM pressure cache. [02:42] [1/4] SKIPPED (not in cpu list) pano.json [02:42] Capturing execution frames: sharp_basic.json [02:42] [ComfyUI] [INFO] Using RAM pressure cache. [02:49] Frame 1 saved (frame_000.jpg, t=0.0s) [02:49] Validating workflow... [02:49] [ComfyUI] [INFO] === /validate endpoint called === [02:49] [ComfyUI] [INFO] Received JSON with keys: ['prompt'] [02:49] [ComfyUI] [INFO] Prompt has 4 nodes [02:49] [ComfyUI] [INFO] Node 1: LoadImage [02:49] [ComfyUI] [INFO] Inputs: {"image": "beach.jpg"} [02:49] [ComfyUI] [INFO] Node 2: LoadSharpModel [02:49] [ComfyUI] [INFO] Inputs: {"precision": "auto"} [02:49] [ComfyUI] [INFO] Node 5: SharpPredict [02:49] [ComfyUI] [INFO] Inputs: {"focal_length_mm": 30, "output_prefix": "sharp", "model": ["2", 0], "image": ["1", 0]} [02:49] Queuing workflow for execution... [02:49] [ComfyUI] [INFO] Node 6: PreviewGaussianSharp [02:49] [ComfyUI] [INFO] Inputs: {"preview_gaussian": "", "ply_path": ["5", 0], "extrinsics": ["5", 1], "intrinsics": ["5", 2]} [02:49] [ComfyUI] [INFO] Generated prompt_id: f60db974-bba3-4940-9ec4-8ade7912239d [02:49] [ComfyUI] [INFO] Calling execution.validate_prompt()... [02:49] [ComfyUI] [INFO] Validation result: valid=True [02:49] [ComfyUI] [INFO] === Validation PASSED === [02:49] [ComfyUI] [INFO] got prompt [02:49] [ComfyUI] [comfy-env] Running LoadSharpModel: precision: 'auto' [02:49] [ComfyUI] [comfy-env] SubprocessWorker: /home/runner/.ce/.pixi/envs/sharp-nodes/bin/python [02:49] [ComfyUI] [comfy-env] env_vars: {'COMFYUI_BASE': '/home/runner/work/comfy-gpu-ci/comfy-gpu-ci/test_workspaces/Sharp-2000/ComfyUI'} [02:49] [ComfyUI] [SubprocessWorker] call_method: nodes.load_model.LoadSharpModel.EXECUTE_NORMALIZED [02:49] [ComfyUI] [SubprocessWorker] acquired lock, ensuring started... [02:49] [ComfyUI] [ComfyUI-Sharp] python: /home/runner/.ce/.pixi/envs/sharp-nodes/bin/python [02:49] [ComfyUI] [ComfyUI-Sharp] sys_path sent to worker: ['/home/runner/work/comfy-gpu-ci/comfy-gpu-ci/test_workspaces/Sharp-2000/ComfyUI', '/home/runner/work/comfy-gpu-ci/comfy-gpu-ci/test_workspaces/Sharp-2000/ComfyUI/custom_nodes/ComfyUI-Sharp', '/home/runner/.ce/.pixi/envs/sharp-nodes/lib/python3.10/site-packages', '/home/runner/work/comfy-gpu-ci/comfy-gpu-ci/test_workspaces/Sharp-2000/ComfyUI/custom_nodes/ComfyUI-Sharp'] [02:49] [ComfyUI] [SubprocessWorker] is_pixi=True, python=/home/runner/.ce/.pixi/envs/sharp-nodes/bin/python [02:49] [ComfyUI] [SubprocessWorker] launching cmd=['/home/runner/.pixi/bin/pixi', 'run', '--as-is', '--manifest-path', '/home/runner/.ce/pixi.toml', '-e', 'sharp-nodes', 'python', '/tmp/comfyui_pvenv_r05k2fkl/persistent_worker.py', 'abstract://comfy_worker_16b94109a9bf']... [02:49] [ComfyUI] [SubprocessWorker] socket_addr=abstract://comfy_worker_16b94109a9bf (abstract, no filesystem path) [02:50] [ComfyUI] [worker:ComfyUI-Sharp] ERROR: Failed to import comfy_kitchen, Error: No module named 'comfy_kitchen', fp8 and fp4 support will not be available. [02:50] [ComfyUI] [worker:ComfyUI-Sharp] WARNING: comfy_kitchen does not support stochastic FP8 rounding, please update comfy_kitchen. [02:50] [ComfyUI] [SubprocessWorker] worker started/confirmed [02:50] [ComfyUI] [SubprocessWorker] serializing kwargs to shm... [02:50] [ComfyUI] [SubprocessWorker] created 0 shm blocks [02:50] [ComfyUI] [SubprocessWorker] sending request via socket... [02:50] [ComfyUI] [SubprocessWorker] call_id=1 sending call_method [02:51] [ComfyUI] [worker:ComfyUI-Sharp] [LoadSharpModel] precision='auto' -> dtype=fp32 (device=cpu) [02:51] [ComfyUI] [worker:ComfyUI-Sharp] [LoadSharpModel] checkpoint not found at /home/runner/work/comfy-gpu-ci/comfy-gpu-ci/test_workspaces/Sharp-2000/ComfyUI/models/sharp/sharp_2572gikvuh.pt — downloading from HuggingFace repo 'apple/Sharp' file 'sharp_2572gikvuh.pt' -> /home/runner/work/comfy-gpu-ci/comfy-gpu-ci/test_workspaces/Sharp-2000/ComfyUI/models/sharp [02:51] Frame 2 saved (frame_001.jpg, t=2.3s) [02:51] [capture-periodic] freeze=2ms shot=132ms unfreeze=3ms saved=True [02:51] [ComfyUI] Warning: You are sending unauthenticated requests to the HF Hub. Please set a HF_TOKEN to enable higher rate limits and faster downloads. [02:51] [ComfyUI] [worker:ComfyUI-Sharp] WARNING: Warning: You are sending unauthenticated requests to the HF Hub. Please set a HF_TOKEN to enable higher rate limits and faster downloads. [02:51] [ComfyUI] [02:53] [ComfyUI] sharp_2572gikvuh.pt: 0%| | 0.00/2.81G [00:00 dtype=fp32 [03:04] [ComfyUI] [SubprocessWorker] got response: ok [03:04] [ComfyUI] [comfy-env] LoadSharpModel done (15.37s): result: NodeOutput [03:04] [ComfyUI] [comfy-env] Running SharpPredict: focal_length_mm: 30.0, output_prefix: 'sharp', model: dict, image: torch.float32 [1,1024,1536,3] cpu [03:04] [ComfyUI] [SubprocessWorker] call_method: nodes.predict.SharpPredict.EXECUTE_NORMALIZED [03:04] [ComfyUI] [SubprocessWorker] acquired lock, ensuring started... [03:04] [ComfyUI] [ComfyUI-Sharp] Health check: ping (timeout=5.0s)... [03:04] [ComfyUI] [ComfyUI-Sharp] Health check: ok [03:04] [ComfyUI] [SubprocessWorker] worker started/confirmed [03:04] [ComfyUI] [comfy-env] PRE-SERIALIZE 'image' shape: torch.Size([1, 1024, 1536, 3]) [03:04] [ComfyUI] [SubprocessWorker] serializing kwargs to shm... [03:04] [ComfyUI] [SubprocessWorker] created 0 shm blocks [03:04] [ComfyUI] [SubprocessWorker] sending request via socket... [03:04] [ComfyUI] [SubprocessWorker] call_id=2 sending call_method [03:04] [ComfyUI] [worker:ComfyUI-Sharp] [comfy-env] _from_shm got dict with keys: ['__type__', 'strategy', 'parent_pid', 'fd', 'storage_size'] [03:04] [ComfyUI] [worker:ComfyUI-Sharp] [comfy-env] DESERIALIZE TensorRef: tensor_size=[1, 1024, 1536, 3] [03:04] [ComfyUI] [worker:ComfyUI-Sharp] [comfy-env] DESERIALIZED tensor shape: torch.Size([1, 1024, 1536, 3]) [03:06] Frame 7 saved (frame_006.jpg, t=17.2s) [03:06] [capture-periodic] freeze=2ms shot=103ms unfreeze=2ms saved=True [03:09] [capture-loop] iter=150 t=20.2s state={'complete': False, 'error': None, 'executedCount': 0, 'wsState': 1} eval_ms=2 ram=2.2/15.6GB (14%) swap=0.0/3.0GB (0%) cpu=39% browser_rss=0.92GB [03:11] [ComfyUI] [worker:ComfyUI-Sharp] [LoadSharpModel] loading checkpoint from /home/runner/work/comfy-gpu-ci/comfy-gpu-ci/test_workspaces/Sharp-2000/ComfyUI/models/sharp/sharp_2572gikvuh.pt (dtype=fp32) [03:12] [ComfyUI] [worker:ComfyUI-Sharp] [LoadSharpModel] initializing model on meta device... [03:12] [ComfyUI] [worker:ComfyUI-Sharp] [LoadSharpModel] model ready (torch.float32) [03:12] [ComfyUI] [SubprocessWorker] callback 'request_vram_budget' from call_id=2 [03:12] [ComfyUI] [comfy-env] VRAM request: 2.81GB, free before eviction: 11.56GB [03:12] [ComfyUI] [comfy-env] VRAM after eviction: 11.56GB [03:14] [capture-loop] iter=200 t=25.7s state={'complete': False, 'error': None, 'executedCount': 0, 'wsState': 1} eval_ms=2 ram=5.0/15.6GB (32%) swap=0.0/3.0GB (0%) cpu=44% browser_rss=0.85GB [03:20] [capture-loop] iter=250 t=31.2s state={'complete': False, 'error': None, 'executedCount': 0, 'wsState': 1} eval_ms=4 ram=5.2/15.6GB (33%) swap=0.0/3.0GB (0%) cpu=43% browser_rss=0.85GB [03:25] [capture-loop] iter=300 t=36.7s state={'complete': False, 'error': None, 'executedCount': 0, 'wsState': 1} eval_ms=2 ram=5.1/15.6GB (32%) swap=0.0/3.0GB (0%) cpu=45% browser_rss=0.85GB [03:31] [capture-loop] iter=350 t=42.3s state={'complete': False, 'error': None, 'executedCount': 0, 'wsState': 1} eval_ms=2 ram=5.1/15.6GB (32%) swap=0.0/3.0GB (0%) cpu=44% browser_rss=0.85GB [03:36] [capture-loop] iter=400 t=47.8s state={'complete': False, 'error': None, 'executedCount': 0, 'wsState': 1} eval_ms=2 ram=5.1/15.6GB (33%) swap=0.0/3.0GB (0%) cpu=43% browser_rss=0.85GB [03:42] [capture-loop] iter=450 t=53.3s state={'complete': False, 'error': None, 'executedCount': 0, 'wsState': 1} eval_ms=2 ram=5.1/15.6GB (33%) swap=0.0/3.0GB (0%) cpu=44% browser_rss=0.85GB [03:47] [capture-loop] iter=500 t=58.8s state={'complete': False, 'error': None, 'executedCount': 0, 'wsState': 1} eval_ms=2 ram=5.1/15.6GB (32%) swap=0.0/3.0GB (0%) cpu=45% browser_rss=0.85GB [03:49] [ComfyUI] [worker:ComfyUI-Sharp] [03:49] [ComfyUI] === WATCHDOG TICK 1 === [03:49] [ComfyUI] [worker:ComfyUI-Sharp] Thread 0x00007f35fa7d86c0 (most recent call first): [03:49] [ComfyUI] File "/home/runner/.ce/.pixi/envs/sharp-nodes/lib/python3.10/threading.py", line 324 in wait [03:49] [ComfyUI] File "/home/runner/.ce/.pixi/envs/sharp-nodes/lib/python3.10/threading.py", line 607 in wait [03:49] [ComfyUI] File "/home/runner/.ce/.pixi/envs/sharp-nodes/lib/python3.10/site-packages/tqdm/_monitor.py", line 69 in run [03:49] [ComfyUI] File "/home/runner/.ce/.pixi/envs/sharp-nodes/lib/python3.10/threading.py", line 1016 in _bootstrap_inner [03:49] [ComfyUI] File "/home/runner/.ce/.pixi/envs/sharp-nodes/lib/python3.10/threading.py", line 973 in _bootstrap [03:49] [ComfyUI] [03:49] [ComfyUI] Current thread 0x00007f35fb7d96c0 (most recent call first): [03:49] [ComfyUI] File "/tmp/comfyui_pvenv_r05k2fkl/persistent_worker.py", line 52 in _watchdog [03:49] [ComfyUI] File "/home/runner/.ce/.pixi/envs/sharp-nodes/lib/python3.10/threading.py", line 953 in run [03:49] [ComfyUI] File "/home/runner/.ce/.pixi/envs/sharp-nodes/lib/python3.10/threading.py", line 1016 in _bootstrap_inner [03:49] [ComfyUI] File "/home/runner/.ce/.pixi/envs/sharp-nodes/lib/python3.10/threading.py", line 973 in _bootstrap [03:49] [ComfyUI] [03:49] [ComfyUI] Thread 0x00007f35fc2b0740 (most recent call first): [03:49] [ComfyUI] File "/home/runner/.ce/.pixi/envs/sharp-nodes/lib/python3.10/site-packages/torch/nn/modules/linear.py", line 134 in forward [03:49] [ComfyUI] File "/home/runner/work/comfy-gpu-ci/comfy-gpu-ci/test_workspaces/Sharp-2000/ComfyUI/comfy/ops.py", line 503 in forward [03:49] [ComfyUI] File "/home/runner/.ce/.pixi/envs/sharp-nodes/lib/python3.10/site-packages/torch/nn/modules/module.py", line 1787 in _call_impl [03:49] [ComfyUI] File "/home/runner/.ce/.pixi/envs/sharp-nodes/lib/python3.10/site-packages/torch/nn/modules/module.py", line 1776 in _wrapped_call_impl [03:49] [ComfyUI] File "/home/runner/work/comfy-gpu-ci/comfy-gpu-ci/test_workspaces/Sharp-2000/ComfyUI/custom_nodes/ComfyUI-Sharp/nodes/sharp/model.py", line 268 in forward [03:49] [ComfyUI] File "/home/runner/.ce/.pixi/envs/sharp-nodes/lib/python3.10/site-packages/torch/nn/modules/module.py", line 1787 in _call_impl [03:49] [ComfyUI] File "/home/runner/.ce/.pixi/envs/sharp-nodes/lib/python3.10/site-packages/torch/nn/modules/module.py", line 1776 in _wrapped_call_impl [03:49] [ComfyUI] File "/home/runner/work/comfy-gpu-ci/comfy-gpu-ci/test_workspaces/Sharp-2000/ComfyUI/custom_nodes/ComfyUI-Sharp/nodes/sharp/model.py", line 310 in forward [03:49] [ComfyUI] File "/home/runner/.ce/.pixi/envs/sharp-nodes/lib/python3.10/site-packages/torch/nn/modules/module.py", line 1787 in _call_impl [03:49] [ComfyUI] File "/home/runner/.ce/.pixi/envs/sharp-nodes/lib/python3.10/site-packages/torch/nn/modules/module.py", line 1776 in _wrapped_call_impl [03:49] [ComfyUI] File "/home/runner/work/comfy-gpu-ci/comfy-gpu-ci/test_workspaces/Sharp-2000/ComfyUI/custom_nodes/ComfyUI-Sharp/nodes/sharp/model.py", line 412 in forward [03:49] [ComfyUI] File "/home/runner/.ce/.pixi/envs/sharp-nodes/lib/python3.10/site-packages/torch/nn/modules/module.py", line 1787 in _call_impl [03:49] [ComfyUI] File "/home/runner/.ce/.pixi/envs/sharp-nodes/lib/python3.10/site-packages/torch/nn/modules/module.py", line 1776 in _wrapped_call_impl [03:49] [ComfyUI] File "/home/runner/work/comfy-gpu-ci/comfy-gpu-ci/test_workspaces/Sharp-2000/ComfyUI/custom_nodes/ComfyUI-Sharp/nodes/sharp/model.py", line 685 in forward [03:49] [ComfyUI] File "/home/runner/.ce/.pixi/envs/sharp-nodes/lib/python3.10/site-packages/torch/nn/modules/module.py", line 1787 in _call_impl [03:49] [ComfyUI] File "/home/runner/.ce/.pixi/envs/sharp-nodes/lib/python3.10/site-packages/torch/nn/modules/module.py", line 1776 in _wrapped_call_impl [03:49] [ComfyUI] File "/home/runner/work/comfy-gpu-ci/comfy-gpu-ci/test_workspaces/Sharp-2000/ComfyUI/custom_nodes/ComfyUI-Sharp/nodes/sharp/model.py", line 1109 in forward [03:49] [ComfyUI] File "/home/runner/.ce/.pixi/envs/sharp-nodes/lib/python3.10/site-packages/torch/nn/modules/module.py", line 1787 in _call_impl [03:49] [ComfyUI] File "/home/runner/.ce/.pixi/envs/sharp-nodes/lib/python3.10/site-packages/torch/nn/modules/module.py", line 1776 in _wrapped_call_impl [03:49] [ComfyUI] File "/home/runner/work/comfy-gpu-ci/comfy-gpu-ci/test_workspaces/Sharp-2000/ComfyUI/custom_nodes/ComfyUI-Sharp/nodes/sharp/model.py", line 2006 in encode [03:49] [ComfyUI] File "/home/runner/work/comfy-gpu-ci/comfy-gpu-ci/test_workspaces/Sharp-2000/ComfyUI/custom_nodes/ComfyUI-Sharp/nodes/predict.py", line 348 in _predict_image_cached [03:49] [ComfyUI] File "/home/runner/work/comfy-gpu-ci/comfy-gpu-ci/test_workspaces/Sharp-2000/ComfyUI/custom_nodes/ComfyUI-Sharp/nodes/predict.py", line 239 in execute [03:49] [ComfyUI] File "/home/runner/.ce/.pixi/envs/sharp-nodes/lib/python3.10/site-packages/torch/utils/_contextlib.py", line 124 in decorate_context [03:49] [ComfyUI] File "/home/runner/work/comfy-gpu-ci/comfy-gpu-ci/test_workspaces/Sharp-2000/ComfyUI/comfy_api/latest/_io.py", line 1892 in EXECUTE_NORMALIZED [03:49] [ComfyUI] File "/tmp/comfyui_pvenv_r05k2fkl/persistent_worker.py", line 1762 in main [03:49] [ComfyUI] File "/tmp/comfyui_pvenv_r05k2fkl/persistent_worker.py", line 1807 in [03:49] [ComfyUI] [03:49] [ComfyUI] [worker:ComfyUI-Sharp] === END === [03:49] [ComfyUI] [03:53] [capture-loop] iter=550 t=64.3s state={'complete': False, 'error': None, 'executedCount': 0, 'wsState': 1} eval_ms=2 ram=5.1/15.6GB (33%) swap=0.0/3.0GB (0%) cpu=45% browser_rss=0.84GB [03:58] [capture-loop] iter=600 t=69.7s state={'complete': False, 'error': None, 'executedCount': 0, 'wsState': 1} eval_ms=2 ram=5.2/15.6GB (33%) swap=0.0/3.0GB (0%) cpu=43% browser_rss=0.84GB [04:04] [capture-loop] iter=650 t=75.3s state={'complete': False, 'error': None, 'executedCount': 0, 'wsState': 1} eval_ms=2 ram=5.5/15.6GB (35%) swap=0.0/3.0GB (0%) cpu=44% browser_rss=0.84GB [04:09] [capture-loop] iter=700 t=80.8s state={'complete': False, 'error': None, 'executedCount': 0, 'wsState': 1} eval_ms=2 ram=5.2/15.6GB (33%) swap=0.0/3.0GB (0%) cpu=45% browser_rss=0.84GB [04:15] [capture-loop] iter=750 t=86.3s state={'complete': False, 'error': None, 'executedCount': 0, 'wsState': 1} eval_ms=2 ram=5.2/15.6GB (33%) swap=0.0/3.0GB (0%) cpu=44% browser_rss=0.84GB [04:20] [capture-loop] iter=800 t=91.7s state={'complete': False, 'error': None, 'executedCount': 0, 'wsState': 1} eval_ms=2 ram=5.2/15.6GB (33%) swap=0.0/3.0GB (0%) cpu=43% browser_rss=0.84GB [04:26] [capture-loop] iter=850 t=97.3s state={'complete': False, 'error': None, 'executedCount': 0, 'wsState': 1} eval_ms=2 ram=5.2/15.6GB (34%) swap=0.0/3.0GB (0%) cpu=44% browser_rss=0.85GB [04:31] [capture-loop] iter=900 t=102.8s state={'complete': False, 'error': None, 'executedCount': 0, 'wsState': 1} eval_ms=2 ram=5.2/15.6GB (34%) swap=0.0/3.0GB (0%) cpu=43% browser_rss=0.85GB [04:37] [capture-loop] iter=950 t=108.3s state={'complete': False, 'error': None, 'executedCount': 0, 'wsState': 1} eval_ms=2 ram=5.2/15.6GB (34%) swap=0.0/3.0GB (0%) cpu=44% browser_rss=0.85GB [04:42] [capture-loop] iter=1000 t=113.8s state={'complete': False, 'error': None, 'executedCount': 0, 'wsState': 1} eval_ms=2 ram=5.2/15.6GB (33%) swap=0.0/3.0GB (0%) cpu=43% browser_rss=0.85GB [04:48] [capture-loop] iter=1050 t=119.3s state={'complete': False, 'error': None, 'executedCount': 0, 'wsState': 1} eval_ms=2 ram=5.2/15.6GB (34%) swap=0.0/3.0GB (0%) cpu=43% browser_rss=0.85GB [04:49] [ComfyUI] [worker:ComfyUI-Sharp] [04:49] [ComfyUI] === WATCHDOG TICK 2 === [04:49] [ComfyUI] [worker:ComfyUI-Sharp] Thread 0x00007f35fa7d86c0 (most recent call first): [04:49] [ComfyUI] File "/home/runner/.ce/.pixi/envs/sharp-nodes/lib/python3.10/threading.py", line 324 in wait [04:49] [ComfyUI] File "/home/runner/.ce/.pixi/envs/sharp-nodes/lib/python3.10/threading.py", line 607 in wait [04:49] [ComfyUI] File "/home/runner/.ce/.pixi/envs/sharp-nodes/lib/python3.10/site-packages/tqdm/_monitor.py", line 69 in run [04:49] [ComfyUI] File "/home/runner/.ce/.pixi/envs/sharp-nodes/lib/python3.10/threading.py", line 1016 in _bootstrap_inner [04:49] [ComfyUI] File "/home/runner/.ce/.pixi/envs/sharp-nodes/lib/python3.10/threading.py", line 973 in _bootstrap [04:49] [ComfyUI] [04:49] [ComfyUI] Current thread 0x00007f35fb7d96c0 (most recent call first): [04:49] [ComfyUI] File "/tmp/comfyui_pvenv_r05k2fkl/persistent_worker.py", line 52 in _watchdog [04:49] [ComfyUI] File "/home/runner/.ce/.pixi/envs/sharp-nodes/lib/python3.10/threading.py", line 953 in run [04:49] [ComfyUI] File "/home/runner/.ce/.pixi/envs/sharp-nodes/lib/python3.10/threading.py", line 1016 in _bootstrap_inner [04:49] [ComfyUI] File "/home/runner/.ce/.pixi/envs/sharp-nodes/lib/python3.10/threading.py", line 973 in _bootstrap [04:49] [ComfyUI] [04:49] [ComfyUI] Thread 0x00007f35fc2b0740 (most recent call first): [04:49] [ComfyUI] File "/home/runner/work/comfy-gpu-ci/comfy-gpu-ci/test_workspaces/Sharp-2000/ComfyUI/comfy/ldm/modules/sub_quadratic_attention.py", line 170 in _get_attention_scores_no_kv_chunking [04:49] [ComfyUI] File "/home/runner/work/comfy-gpu-ci/comfy-gpu-ci/test_workspaces/Sharp-2000/ComfyUI/comfy/ldm/modules/sub_quadratic_attention.py", line 259 in efficient_dot_product_attention [04:49] [ComfyUI] File "/home/runner/work/comfy-gpu-ci/comfy-gpu-ci/test_workspaces/Sharp-2000/ComfyUI/comfy/ldm/modules/attention.py", line 275 in attention_sub_quad [04:49] [ComfyUI] File "/home/runner/work/comfy-gpu-ci/comfy-gpu-ci/test_workspaces/Sharp-2000/ComfyUI/comfy/ldm/modules/attention.py", line 139 in wrapper [04:49] [ComfyUI] File "/home/runner/work/comfy-gpu-ci/comfy-gpu-ci/test_workspaces/Sharp-2000/ComfyUI/custom_nodes/ComfyUI-Sharp/nodes/sharp/model.py", line 234 in forward [04:49] [ComfyUI] File "/home/runner/.ce/.pixi/envs/sharp-nodes/lib/python3.10/site-packages/torch/nn/modules/module.py", line 1787 in _call_impl [04:49] [ComfyUI] File "/home/runner/.ce/.pixi/envs/sharp-nodes/lib/python3.10/site-packages/torch/nn/modules/module.py", line 1776 in _wrapped_call_impl [04:49] [ComfyUI] File "/home/runner/work/comfy-gpu-ci/comfy-gpu-ci/test_workspaces/Sharp-2000/ComfyUI/custom_nodes/ComfyUI-Sharp/nodes/sharp/model.py", line 309 in forward [04:49] [ComfyUI] File "/home/runner/.ce/.pixi/envs/sharp-nodes/lib/python3.10/site-packages/torch/nn/modules/module.py", line 1787 in _call_impl [04:49] [ComfyUI] File "/home/runner/.ce/.pixi/envs/sharp-nodes/lib/python3.10/site-packages/torch/nn/modules/module.py", line 1776 in _wrapped_call_impl [04:49] [ComfyUI] File "/home/runner/work/comfy-gpu-ci/comfy-gpu-ci/test_workspaces/Sharp-2000/ComfyUI/custom_nodes/ComfyUI-Sharp/nodes/sharp/model.py", line 412 in forward [04:49] [ComfyUI] File "/home/runner/.ce/.pixi/envs/sharp-nodes/lib/python3.10/site-packages/torch/nn/modules/module.py", line 1787 in _call_impl [04:49] [ComfyUI] File "/home/runner/.ce/.pixi/envs/sharp-nodes/lib/python3.10/site-packages/torch/nn/modules/module.py", line 1776 in _wrapped_call_impl [04:49] [ComfyUI] File "/home/runner/work/comfy-gpu-ci/comfy-gpu-ci/test_workspaces/Sharp-2000/ComfyUI/custom_nodes/ComfyUI-Sharp/nodes/sharp/model.py", line 685 in forward [04:49] [ComfyUI] File "/home/runner/.ce/.pixi/envs/sharp-nodes/lib/python3.10/site-packages/torch/nn/modules/module.py", line 1787 in _call_impl [04:49] [ComfyUI] File "/home/runner/.ce/.pixi/envs/sharp-nodes/lib/python3.10/site-packages/torch/nn/modules/module.py", line 1776 in _wrapped_call_impl [04:49] [ComfyUI] File "/home/runner/work/comfy-gpu-ci/comfy-gpu-ci/test_workspaces/Sharp-2000/ComfyUI/custom_nodes/ComfyUI-Sharp/nodes/sharp/model.py", line 1109 in forward [04:49] [ComfyUI] File "/home/runner/.ce/.pixi/envs/sharp-nodes/lib/python3.10/site-packages/torch/nn/modules/module.py", line 1787 in _call_impl [04:49] [ComfyUI] File "/home/runner/.ce/.pixi/envs/sharp-nodes/lib/python3.10/site-packages/torch/nn/modules/module.py", line 1776 in _wrapped_call_impl [04:49] [ComfyUI] File "/home/runner/work/comfy-gpu-ci/comfy-gpu-ci/test_workspaces/Sharp-2000/ComfyUI/custom_nodes/ComfyUI-Sharp/nodes/sharp/model.py", line 2006 in encode [04:49] [ComfyUI] File "/home/runner/work/comfy-gpu-ci/comfy-gpu-ci/test_workspaces/Sharp-2000/ComfyUI/custom_nodes/ComfyUI-Sharp/nodes/predict.py", line 348 in _predict_image_cached [04:49] [ComfyUI] File "/home/runner/work/comfy-gpu-ci/comfy-gpu-ci/test_workspaces/Sharp-2000/ComfyUI/custom_nodes/ComfyUI-Sharp/nodes/predict.py", line 239 in execute [04:49] [ComfyUI] File "/home/runner/.ce/.pixi/envs/sharp-nodes/lib/python3.10/site-packages/torch/utils/_contextlib.py", line 124 in decorate_context [04:49] [ComfyUI] File "/home/runner/work/comfy-gpu-ci/comfy-gpu-ci/test_workspaces/Sharp-2000/ComfyUI/comfy_api/latest/_io.py", line 1892 in EXECUTE_NORMALIZED [04:49] [ComfyUI] File "/tmp/comfyui_pvenv_r05k2fkl/persistent_worker.py", line 1762 in main [04:49] [ComfyUI] File "/tmp/comfyui_pvenv_r05k2fkl/persistent_worker.py", line 1807 in [04:49] [ComfyUI] [04:49] [ComfyUI] [worker:ComfyUI-Sharp] === END === [04:49] [ComfyUI] [04:53] [capture-loop] iter=1100 t=124.8s state={'complete': False, 'error': None, 'executedCount': 0, 'wsState': 1} eval_ms=2 ram=5.3/15.6GB (34%) swap=0.0/3.0GB (0%) cpu=44% browser_rss=0.85GB [04:59] [capture-loop] iter=1150 t=130.3s state={'complete': False, 'error': None, 'executedCount': 0, 'wsState': 1} eval_ms=2 ram=5.3/15.6GB (34%) swap=0.0/3.0GB (0%) cpu=43% browser_rss=0.86GB [05:04] [capture-loop] iter=1200 t=135.7s state={'complete': False, 'error': None, 'executedCount': 0, 'wsState': 1} eval_ms=2 ram=5.3/15.6GB (34%) swap=0.0/3.0GB (0%) cpu=43% browser_rss=0.86GB [05:10] [capture-loop] iter=1250 t=141.3s state={'complete': False, 'error': None, 'executedCount': 0, 'wsState': 1} eval_ms=2 ram=5.3/15.6GB (34%) swap=0.0/3.0GB (0%) cpu=43% browser_rss=0.86GB [05:15] [capture-loop] iter=1300 t=146.7s state={'complete': False, 'error': None, 'executedCount': 0, 'wsState': 1} eval_ms=3 ram=5.3/15.6GB (34%) swap=0.0/3.0GB (0%) cpu=43% browser_rss=0.86GB [05:21] [capture-loop] iter=1350 t=152.3s state={'complete': False, 'error': None, 'executedCount': 0, 'wsState': 1} eval_ms=2 ram=5.3/15.6GB (34%) swap=0.0/3.0GB (0%) cpu=43% browser_rss=0.85GB [05:26] [capture-loop] iter=1400 t=157.7s state={'complete': False, 'error': None, 'executedCount': 0, 'wsState': 1} eval_ms=2 ram=5.3/15.6GB (34%) swap=0.0/3.0GB (0%) cpu=42% browser_rss=0.85GB [05:32] [capture-loop] iter=1450 t=163.3s state={'complete': False, 'error': None, 'executedCount': 0, 'wsState': 1} eval_ms=6 ram=5.3/15.6GB (34%) swap=0.0/3.0GB (0%) cpu=44% browser_rss=0.86GB [05:37] [capture-loop] iter=1500 t=168.7s state={'complete': False, 'error': None, 'executedCount': 0, 'wsState': 1} eval_ms=2 ram=5.6/15.6GB (36%) swap=0.0/3.0GB (0%) cpu=44% browser_rss=0.86GB [05:43] [capture-loop] iter=1550 t=174.3s state={'complete': False, 'error': None, 'executedCount': 0, 'wsState': 1} eval_ms=5 ram=5.5/15.6GB (35%) swap=0.0/3.0GB (0%) cpu=44% browser_rss=0.86GB [05:48] [capture-loop] iter=1600 t=179.7s state={'complete': False, 'error': None, 'executedCount': 0, 'wsState': 1} eval_ms=2 ram=5.4/15.6GB (34%) swap=0.0/3.0GB (0%) cpu=43% browser_rss=0.86GB [05:49] [ComfyUI] [worker:ComfyUI-Sharp] [05:49] [ComfyUI] === WATCHDOG TICK 3 === [05:49] [ComfyUI] [worker:ComfyUI-Sharp] Thread 0x00007f35fa7d86c0 (most recent call first): [05:49] [ComfyUI] File "/home/runner/.ce/.pixi/envs/sharp-nodes/lib/python3.10/threading.py", line 324 in wait [05:49] [ComfyUI] File "/home/runner/.ce/.pixi/envs/sharp-nodes/lib/python3.10/threading.py", line 607 in wait [05:49] [ComfyUI] File "/home/runner/.ce/.pixi/envs/sharp-nodes/lib/python3.10/site-packages/tqdm/_monitor.py", line 69 in run [05:49] [ComfyUI] File "/home/runner/.ce/.pixi/envs/sharp-nodes/lib/python3.10/threading.py", line 1016 in _bootstrap_inner [05:49] [ComfyUI] File "/home/runner/.ce/.pixi/envs/sharp-nodes/lib/python3.10/threading.py", line 973 in _bootstrap [05:49] [ComfyUI] [05:49] [ComfyUI] Current thread 0x00007f35fb7d96c0 (most recent call first): [05:49] [ComfyUI] File "/tmp/comfyui_pvenv_r05k2fkl/persistent_worker.py", line 52 in _watchdog [05:49] [ComfyUI] File "/home/runner/.ce/.pixi/envs/sharp-nodes/lib/python3.10/threading.py", line 953 in run [05:49] [ComfyUI] File "/home/runner/.ce/.pixi/envs/sharp-nodes/lib/python3.10/threading.py", line 1016 in _bootstrap_inner [05:49] [ComfyUI] File "/home/runner/.ce/.pixi/envs/sharp-nodes/lib/python3.10/threading.py", line 973 in _bootstrap [05:49] [ComfyUI] [05:49] [ComfyUI] Thread 0x00007f35fc2b0740 (most recent call first): [05:49] [ComfyUI] File "/home/runner/.ce/.pixi/envs/sharp-nodes/lib/python3.10/site-packages/torch/nn/modules/linear.py", line 134 in forward [05:49] [ComfyUI] File "/home/runner/work/comfy-gpu-ci/comfy-gpu-ci/test_workspaces/Sharp-2000/ComfyUI/comfy/ops.py", line 503 in forward [05:49] [ComfyUI] File "/home/runner/.ce/.pixi/envs/sharp-nodes/lib/python3.10/site-packages/torch/nn/modules/module.py", line 1787 in _call_impl [05:49] [ComfyUI] File "/home/runner/.ce/.pixi/envs/sharp-nodes/lib/python3.10/site-packages/torch/nn/modules/module.py", line 1776 in _wrapped_call_impl [05:49] [ComfyUI] File "/home/runner/work/comfy-gpu-ci/comfy-gpu-ci/test_workspaces/Sharp-2000/ComfyUI/custom_nodes/ComfyUI-Sharp/nodes/sharp/model.py", line 268 in forward [05:49] [ComfyUI] File "/home/runner/.ce/.pixi/envs/sharp-nodes/lib/python3.10/site-packages/torch/nn/modules/module.py", line 1787 in _call_impl [05:49] [ComfyUI] File "/home/runner/.ce/.pixi/envs/sharp-nodes/lib/python3.10/site-packages/torch/nn/modules/module.py", line 1776 in _wrapped_call_impl [05:49] [ComfyUI] File "/home/runner/work/comfy-gpu-ci/comfy-gpu-ci/test_workspaces/Sharp-2000/ComfyUI/custom_nodes/ComfyUI-Sharp/nodes/sharp/model.py", line 310 in forward [05:49] [ComfyUI] File "/home/runner/.ce/.pixi/envs/sharp-nodes/lib/python3.10/site-packages/torch/nn/modules/module.py", line 1787 in _call_impl [05:49] [ComfyUI] File "/home/runner/.ce/.pixi/envs/sharp-nodes/lib/python3.10/site-packages/torch/nn/modules/module.py", line 1776 in _wrapped_call_impl [05:49] [ComfyUI] File "/home/runner/work/comfy-gpu-ci/comfy-gpu-ci/test_workspaces/Sharp-2000/ComfyUI/custom_nodes/ComfyUI-Sharp/nodes/sharp/model.py", line 412 in forward [05:49] [ComfyUI] File "/home/runner/.ce/.pixi/envs/sharp-nodes/lib/python3.10/site-packages/torch/nn/modules/module.py", line 1787 in _call_impl [05:49] [ComfyUI] File "/home/runner/.ce/.pixi/envs/sharp-nodes/lib/python3.10/site-packages/torch/nn/modules/module.py", line 1776 in _wrapped_call_impl [05:49] [ComfyUI] File "/home/runner/work/comfy-gpu-ci/comfy-gpu-ci/test_workspaces/Sharp-2000/ComfyUI/custom_nodes/ComfyUI-Sharp/nodes/sharp/model.py", line 685 in forward [05:49] [ComfyUI] File "/home/runner/.ce/.pixi/envs/sharp-nodes/lib/python3.10/site-packages/torch/nn/modules/module.py", line 1787 in _call_impl [05:49] [ComfyUI] File "/home/runner/.ce/.pixi/envs/sharp-nodes/lib/python3.10/site-packages/torch/nn/modules/module.py", line 1776 in _wrapped_call_impl [05:49] [ComfyUI] File "/home/runner/work/comfy-gpu-ci/comfy-gpu-ci/test_workspaces/Sharp-2000/ComfyUI/custom_nodes/ComfyUI-Sharp/nodes/sharp/model.py", line 1109 in forward [05:49] [ComfyUI] File "/home/runner/.ce/.pixi/envs/sharp-nodes/lib/python3.10/site-packages/torch/nn/modules/module.py", line 1787 in _call_impl [05:49] [ComfyUI] File "/home/runner/.ce/.pixi/envs/sharp-nodes/lib/python3.10/site-packages/torch/nn/modules/module.py", line 1776 in _wrapped_call_impl [05:49] [ComfyUI] File "/home/runner/work/comfy-gpu-ci/comfy-gpu-ci/test_workspaces/Sharp-2000/ComfyUI/custom_nodes/ComfyUI-Sharp/nodes/sharp/model.py", line 2006 in encode [05:49] [ComfyUI] File "/home/runner/work/comfy-gpu-ci/comfy-gpu-ci/test_workspaces/Sharp-2000/ComfyUI/custom_nodes/ComfyUI-Sharp/nodes/predict.py", line 348 in _predict_image_cached [05:49] [ComfyUI] File "/home/runner/work/comfy-gpu-ci/comfy-gpu-ci/test_workspaces/Sharp-2000/ComfyUI/custom_nodes/ComfyUI-Sharp/nodes/predict.py", line 239 in execute [05:49] [ComfyUI] File "/home/runner/.ce/.pixi/envs/sharp-nodes/lib/python3.10/site-packages/torch/utils/_contextlib.py", line 124 in decorate_context [05:49] [ComfyUI] File "/home/runner/work/comfy-gpu-ci/comfy-gpu-ci/test_workspaces/Sharp-2000/ComfyUI/comfy_api/latest/_io.py", line 1892 in EXECUTE_NORMALIZED [05:49] [ComfyUI] File "/tmp/comfyui_pvenv_r05k2fkl/persistent_worker.py", line 1762 in main [05:49] [ComfyUI] File "/tmp/comfyui_pvenv_r05k2fkl/persistent_worker.py", line 1807 in [05:49] [ComfyUI] [05:49] [ComfyUI] [worker:ComfyUI-Sharp] === END === [05:49] [ComfyUI] [05:54] [capture-loop] iter=1650 t=185.3s state={'complete': False, 'error': None, 'executedCount': 0, 'wsState': 1} eval_ms=4 ram=5.4/15.6GB (35%) swap=0.0/3.0GB (0%) cpu=42% browser_rss=0.86GB [05:59] [capture-loop] iter=1700 t=190.7s state={'complete': False, 'error': None, 'executedCount': 0, 'wsState': 1} eval_ms=2 ram=5.4/15.6GB (35%) swap=0.0/3.0GB (0%) cpu=44% browser_rss=0.86GB [06:05] [capture-loop] iter=1750 t=196.2s state={'complete': False, 'error': None, 'executedCount': 0, 'wsState': 1} eval_ms=2 ram=5.5/15.6GB (35%) swap=0.0/3.0GB (0%) cpu=44% browser_rss=0.86GB [06:10] [capture-loop] iter=1800 t=201.7s state={'complete': False, 'error': None, 'executedCount': 0, 'wsState': 1} eval_ms=2 ram=5.4/15.6GB (35%) swap=0.0/3.0GB (0%) cpu=43% browser_rss=0.86GB [06:16] [capture-loop] iter=1850 t=207.2s state={'complete': False, 'error': None, 'executedCount': 0, 'wsState': 1} eval_ms=2 ram=5.5/15.6GB (35%) swap=0.0/3.0GB (0%) cpu=43% browser_rss=0.86GB [06:21] [capture-loop] iter=1900 t=212.7s state={'complete': False, 'error': None, 'executedCount': 0, 'wsState': 1} eval_ms=4 ram=5.5/15.6GB (35%) swap=0.0/3.0GB (0%) cpu=43% browser_rss=0.86GB [06:27] [capture-loop] iter=1950 t=218.3s state={'complete': False, 'error': None, 'executedCount': 0, 'wsState': 1} eval_ms=2 ram=5.2/15.6GB (33%) swap=0.0/3.0GB (0%) cpu=44% browser_rss=0.86GB [06:32] [capture-loop] iter=2000 t=223.7s state={'complete': False, 'error': None, 'executedCount': 0, 'wsState': 1} eval_ms=2 ram=5.9/15.6GB (38%) swap=0.0/3.0GB (0%) cpu=44% browser_rss=0.86GB [06:38] [capture-loop] iter=2050 t=229.3s state={'complete': False, 'error': None, 'executedCount': 0, 'wsState': 1} eval_ms=2 ram=6.0/15.6GB (38%) swap=0.0/3.0GB (0%) cpu=45% browser_rss=0.86GB [06:43] [capture-loop] iter=2100 t=234.7s state={'complete': False, 'error': None, 'executedCount': 0, 'wsState': 1} eval_ms=2 ram=6.2/15.6GB (40%) swap=0.0/3.0GB (0%) cpu=44% browser_rss=0.86GB [06:49] [capture-loop] iter=2150 t=240.3s state={'complete': False, 'error': None, 'executedCount': 0, 'wsState': 1} eval_ms=2 ram=6.8/15.6GB (44%) swap=0.0/3.0GB (0%) cpu=43% browser_rss=0.86GB [06:49] [ComfyUI] [worker:ComfyUI-Sharp] [06:49] [ComfyUI] === WATCHDOG TICK 4 === [06:49] [ComfyUI] [worker:ComfyUI-Sharp] Thread 0x00007f35fa7d86c0 (most recent call first): [06:49] [ComfyUI] File "/home/runner/.ce/.pixi/envs/sharp-nodes/lib/python3.10/threading.py", line 324 in wait [06:49] [ComfyUI] File "/home/runner/.ce/.pixi/envs/sharp-nodes/lib/python3.10/threading.py", line 607 in wait [06:49] [ComfyUI] File "/home/runner/.ce/.pixi/envs/sharp-nodes/lib/python3.10/site-packages/tqdm/_monitor.py", line 69 in run [06:49] [ComfyUI] File "/home/runner/.ce/.pixi/envs/sharp-nodes/lib/python3.10/threading.py", line 1016 in _bootstrap_inner [06:49] [ComfyUI] File "/home/runner/.ce/.pixi/envs/sharp-nodes/lib/python3.10/threading.py", line 973 in _bootstrap [06:49] [ComfyUI] [06:49] [ComfyUI] Current thread 0x00007f35fb7d96c0 (most recent call first): [06:49] [ComfyUI] File "/tmp/comfyui_pvenv_r05k2fkl/persistent_worker.py", line 52 in _watchdog [06:49] [ComfyUI] File "/home/runner/.ce/.pixi/envs/sharp-nodes/lib/python3.10/threading.py", line 953 in run [06:49] [ComfyUI] File "/home/runner/.ce/.pixi/envs/sharp-nodes/lib/python3.10/threading.py", line 1016 in _bootstrap_inner [06:49] [ComfyUI] File "/home/runner/.ce/.pixi/envs/sharp-nodes/lib/python3.10/threading.py", line 973 in _bootstrap [06:49] [ComfyUI] [06:49] [ComfyUI] Thread 0x00007f35fc2b0740 (most recent call first): [06:49] [ComfyUI] File "/home/runner/.ce/.pixi/envs/sharp-nodes/lib/python3.10/site-packages/torch/nn/modules/conv.py", line 548 in _conv_forward [06:49] [ComfyUI] File "/home/runner/.ce/.pixi/envs/sharp-nodes/lib/python3.10/site-packages/torch/nn/modules/conv.py", line 553 in forward [06:49] [ComfyUI] File "/home/runner/work/comfy-gpu-ci/comfy-gpu-ci/test_workspaces/Sharp-2000/ComfyUI/comfy/ops.py", line 537 in forward [06:49] [ComfyUI] File "/home/runner/.ce/.pixi/envs/sharp-nodes/lib/python3.10/site-packages/torch/nn/modules/module.py", line 1787 in _call_impl [06:49] [ComfyUI] File "/home/runner/.ce/.pixi/envs/sharp-nodes/lib/python3.10/site-packages/torch/nn/modules/module.py", line 1776 in _wrapped_call_impl [06:49] [ComfyUI] File "/home/runner/.ce/.pixi/envs/sharp-nodes/lib/python3.10/site-packages/torch/nn/modules/container.py", line 253 in forward [06:49] [ComfyUI] File "/home/runner/.ce/.pixi/envs/sharp-nodes/lib/python3.10/site-packages/torch/nn/modules/module.py", line 1787 in _call_impl [06:49] [ComfyUI] File "/home/runner/.ce/.pixi/envs/sharp-nodes/lib/python3.10/site-packages/torch/nn/modules/module.py", line 1776 in _wrapped_call_impl [06:49] [ComfyUI] File "/home/runner/work/comfy-gpu-ci/comfy-gpu-ci/test_workspaces/Sharp-2000/ComfyUI/custom_nodes/ComfyUI-Sharp/nodes/sharp/model.py", line 766 in forward [06:49] [ComfyUI] File "/home/runner/.ce/.pixi/envs/sharp-nodes/lib/python3.10/site-packages/torch/nn/modules/module.py", line 1787 in _call_impl [06:49] [ComfyUI] File "/home/runner/.ce/.pixi/envs/sharp-nodes/lib/python3.10/site-packages/torch/nn/modules/module.py", line 1776 in _wrapped_call_impl [06:49] [ComfyUI] File "/home/runner/work/comfy-gpu-ci/comfy-gpu-ci/test_workspaces/Sharp-2000/ComfyUI/custom_nodes/ComfyUI-Sharp/nodes/sharp/model.py", line 860 in forward [06:49] [ComfyUI] File "/home/runner/.ce/.pixi/envs/sharp-nodes/lib/python3.10/site-packages/torch/nn/modules/module.py", line 1787 in _call_impl [06:49] [ComfyUI] File "/home/runner/.ce/.pixi/envs/sharp-nodes/lib/python3.10/site-packages/torch/nn/modules/module.py", line 1776 in _wrapped_call_impl [06:49] [ComfyUI] File "/home/runner/work/comfy-gpu-ci/comfy-gpu-ci/test_workspaces/Sharp-2000/ComfyUI/custom_nodes/ComfyUI-Sharp/nodes/sharp/model.py", line 970 in forward [06:49] [ComfyUI] File "/home/runner/.ce/.pixi/envs/sharp-nodes/lib/python3.10/site-packages/torch/nn/modules/module.py", line 1787 in _call_impl [06:49] [ComfyUI] File "/home/runner/.ce/.pixi/envs/sharp-nodes/lib/python3.10/site-packages/torch/nn/modules/module.py", line 1776 in _wrapped_call_impl [06:49] [ComfyUI] File "/home/runner/work/comfy-gpu-ci/comfy-gpu-ci/test_workspaces/Sharp-2000/ComfyUI/custom_nodes/ComfyUI-Sharp/nodes/sharp/model.py", line 1118 in forward [06:49] [ComfyUI] File "/home/runner/.ce/.pixi/envs/sharp-nodes/lib/python3.10/site-packages/torch/nn/modules/module.py", line 1787 in _call_impl [06:49] [ComfyUI] File "/home/runner/.ce/.pixi/envs/sharp-nodes/lib/python3.10/site-packages/torch/nn/modules/module.py", line 1776 in _wrapped_call_impl [06:49] [ComfyUI] File "/home/runner/work/comfy-gpu-ci/comfy-gpu-ci/test_workspaces/Sharp-2000/ComfyUI/custom_nodes/ComfyUI-Sharp/nodes/sharp/model.py", line 2006 in encode [06:49] [ComfyUI] File "/home/runner/work/comfy-gpu-ci/comfy-gpu-ci/test_workspaces/Sharp-2000/ComfyUI/custom_nodes/ComfyUI-Sharp/nodes/predict.py", line 348 in _predict_image_cached [06:49] [ComfyUI] File "/home/runner/work/comfy-gpu-ci/comfy-gpu-ci/test_workspaces/Sharp-2000/ComfyUI/custom_nodes/ComfyUI-Sharp/nodes/predict.py", line 239 in execute [06:49] [ComfyUI] File "/home/runner/.ce/.pixi/envs/sharp-nodes/lib/python3.10/site-packages/torch/utils/_contextlib.py", line 124 in decorate_context [06:49] [ComfyUI] File "/home/runner/work/comfy-gpu-ci/comfy-gpu-ci/test_workspaces/Sharp-2000/ComfyUI/comfy_api/latest/_io.py", line 1892 in EXECUTE_NORMALIZED [06:49] [ComfyUI] File "/tmp/comfyui_pvenv_r05k2fkl/persistent_worker.py", line 1762 in main [06:49] [ComfyUI] File "/tmp/comfyui_pvenv_r05k2fkl/persistent_worker.py", line 1807 in [06:49] [ComfyUI] [06:49] [ComfyUI] [worker:ComfyUI-Sharp] === END === [06:49] [ComfyUI] [06:54] [capture-loop] iter=2200 t=245.7s state={'complete': False, 'error': None, 'executedCount': 0, 'wsState': 1} eval_ms=2 ram=7.0/15.6GB (45%) swap=0.0/3.0GB (0%) cpu=45% browser_rss=0.86GB [07:00] [capture-loop] iter=2250 t=251.3s state={'complete': False, 'error': None, 'executedCount': 0, 'wsState': 1} eval_ms=2 ram=7.4/15.6GB (48%) swap=0.0/3.0GB (0%) cpu=44% browser_rss=0.86GB [07:05] [capture-loop] iter=2300 t=256.8s state={'complete': False, 'error': None, 'executedCount': 0, 'wsState': 1} eval_ms=4 ram=7.3/15.6GB (47%) swap=0.0/3.0GB (0%) cpu=43% browser_rss=0.85GB [07:11] [capture-loop] iter=2350 t=262.4s state={'complete': False, 'error': None, 'executedCount': 0, 'wsState': 1} eval_ms=2 ram=8.7/15.6GB (56%) swap=0.0/3.0GB (0%) cpu=45% browser_rss=0.85GB [07:16] [capture-loop] iter=2400 t=267.8s state={'complete': False, 'error': None, 'executedCount': 0, 'wsState': 1} eval_ms=2 ram=9.2/15.6GB (59%) swap=0.0/3.0GB (0%) cpu=44% browser_rss=0.85GB [07:22] [capture-loop] iter=2450 t=273.4s state={'complete': False, 'error': None, 'executedCount': 0, 'wsState': 1} eval_ms=2 ram=9.1/15.6GB (58%) swap=0.0/3.0GB (0%) cpu=43% browser_rss=0.85GB [07:28] [capture-loop] iter=2500 t=278.9s state={'complete': False, 'error': None, 'executedCount': 0, 'wsState': 1} eval_ms=2 ram=9.2/15.6GB (59%) swap=0.0/3.0GB (0%) cpu=43% browser_rss=0.85GB [07:33] [capture-loop] iter=2550 t=284.4s state={'complete': False, 'error': None, 'executedCount': 0, 'wsState': 1} eval_ms=2 ram=7.2/15.6GB (46%) swap=0.0/3.0GB (0%) cpu=43% browser_rss=0.85GB [07:39] [capture-loop] iter=2600 t=289.9s state={'complete': False, 'error': None, 'executedCount': 0, 'wsState': 1} eval_ms=5 ram=8.8/15.6GB (56%) swap=0.0/3.0GB (0%) cpu=44% browser_rss=0.85GB [07:44] [capture-loop] iter=2650 t=295.4s state={'complete': False, 'error': None, 'executedCount': 0, 'wsState': 1} eval_ms=2 ram=6.9/15.6GB (44%) swap=0.0/3.0GB (0%) cpu=42% browser_rss=0.85GB [07:49] [ComfyUI] [worker:ComfyUI-Sharp] [07:49] [ComfyUI] === WATCHDOG TICK 5 === [07:49] [ComfyUI] [worker:ComfyUI-Sharp] Thread 0x00007f35fa7d86c0 (most recent call first): [07:49] [ComfyUI] File "/home/runner/.ce/.pixi/envs/sharp-nodes/lib/python3.10/threading.py", line 324 in wait [07:49] [ComfyUI] File "/home/runner/.ce/.pixi/envs/sharp-nodes/lib/python3.10/threading.py", line 607 in wait [07:49] [ComfyUI] File "/home/runner/.ce/.pixi/envs/sharp-nodes/lib/python3.10/site-packages/tqdm/_monitor.py", line 69 in run [07:49] [ComfyUI] File "/home/runner/.ce/.pixi/envs/sharp-nodes/lib/python3.10/threading.py", line 1016 in _bootstrap_inner [07:49] [ComfyUI] File "/home/runner/.ce/.pixi/envs/sharp-nodes/lib/python3.10/threading.py", line 973 in _bootstrap [07:49] [ComfyUI] [07:49] [ComfyUI] Current thread 0x00007f35fb7d96c0 (most recent call first): [07:49] [ComfyUI] File "/tmp/comfyui_pvenv_r05k2fkl/persistent_worker.py", line 52 in _watchdog [07:49] [ComfyUI] File "/home/runner/.ce/.pixi/envs/sharp-nodes/lib/python3.10/threading.py", line 953 in run [07:49] [ComfyUI] File "/home/runner/.ce/.pixi/envs/sharp-nodes/lib/python3.10/threading.py", line 1016 in _bootstrap_inner [07:49] [ComfyUI] File "/home/runner/.ce/.pixi/envs/sharp-nodes/lib/python3.10/threading.py", line 973 in _bootstrap [07:49] [ComfyUI] [07:49] [ComfyUI] Thread 0x00007f35fc2b0740 (most recent call first): [07:49] [ComfyUI] File "/home/runner/.ce/.pixi/envs/sharp-nodes/lib/python3.10/site-packages/torch/nn/modules/conv.py", line 548 in _conv_forward [07:49] [ComfyUI] File "/home/runner/.ce/.pixi/envs/sharp-nodes/lib/python3.10/site-packages/torch/nn/modules/conv.py", line 553 in forward [07:49] [ComfyUI] File "/home/runner/work/comfy-gpu-ci/comfy-gpu-ci/test_workspaces/Sharp-2000/ComfyUI/comfy/ops.py", line 537 in forward [07:49] [ComfyUI] File "/home/runner/.ce/.pixi/envs/sharp-nodes/lib/python3.10/site-packages/torch/nn/modules/module.py", line 1787 in _call_impl [07:49] [ComfyUI] File "/home/runner/.ce/.pixi/envs/sharp-nodes/lib/python3.10/site-packages/torch/nn/modules/module.py", line 1776 in _wrapped_call_impl [07:49] [ComfyUI] File "/home/runner/.ce/.pixi/envs/sharp-nodes/lib/python3.10/site-packages/torch/nn/modules/container.py", line 253 in forward [07:49] [ComfyUI] File "/home/runner/.ce/.pixi/envs/sharp-nodes/lib/python3.10/site-packages/torch/nn/modules/module.py", line 1787 in _call_impl [07:49] [ComfyUI] File "/home/runner/.ce/.pixi/envs/sharp-nodes/lib/python3.10/site-packages/torch/nn/modules/module.py", line 1776 in _wrapped_call_impl [07:49] [ComfyUI] File "/home/runner/work/comfy-gpu-ci/comfy-gpu-ci/test_workspaces/Sharp-2000/ComfyUI/custom_nodes/ComfyUI-Sharp/nodes/sharp/model.py", line 766 in forward [07:49] [ComfyUI] File "/home/runner/.ce/.pixi/envs/sharp-nodes/lib/python3.10/site-packages/torch/nn/modules/module.py", line 1787 in _call_impl [07:49] [ComfyUI] File "/home/runner/.ce/.pixi/envs/sharp-nodes/lib/python3.10/site-packages/torch/nn/modules/module.py", line 1776 in _wrapped_call_impl [07:49] [ComfyUI] File "/home/runner/work/comfy-gpu-ci/comfy-gpu-ci/test_workspaces/Sharp-2000/ComfyUI/custom_nodes/ComfyUI-Sharp/nodes/sharp/model.py", line 858 in forward [07:49] [ComfyUI] File "/home/runner/.ce/.pixi/envs/sharp-nodes/lib/python3.10/site-packages/torch/nn/modules/module.py", line 1787 in _call_impl [07:49] [ComfyUI] File "/home/runner/.ce/.pixi/envs/sharp-nodes/lib/python3.10/site-packages/torch/nn/modules/module.py", line 1776 in _wrapped_call_impl [07:49] [ComfyUI] File "/home/runner/work/comfy-gpu-ci/comfy-gpu-ci/test_workspaces/Sharp-2000/ComfyUI/custom_nodes/ComfyUI-Sharp/nodes/sharp/model.py", line 970 in forward [07:49] [ComfyUI] File "/home/runner/.ce/.pixi/envs/sharp-nodes/lib/python3.10/site-packages/torch/nn/modules/module.py", line 1787 in _call_impl [07:49] [ComfyUI] File "/home/runner/.ce/.pixi/envs/sharp-nodes/lib/python3.10/site-packages/torch/nn/modules/module.py", line 1776 in _wrapped_call_impl [07:49] [ComfyUI] File "/home/runner/work/comfy-gpu-ci/comfy-gpu-ci/test_workspaces/Sharp-2000/ComfyUI/custom_nodes/ComfyUI-Sharp/nodes/sharp/model.py", line 1345 in forward [07:49] [ComfyUI] File "/home/runner/.ce/.pixi/envs/sharp-nodes/lib/python3.10/site-packages/torch/nn/modules/module.py", line 1787 in _call_impl [07:49] [ComfyUI] File "/home/runner/.ce/.pixi/envs/sharp-nodes/lib/python3.10/site-packages/torch/nn/modules/module.py", line 1776 in _wrapped_call_impl [07:49] [ComfyUI] File "/home/runner/work/comfy-gpu-ci/comfy-gpu-ci/test_workspaces/Sharp-2000/ComfyUI/custom_nodes/ComfyUI-Sharp/nodes/sharp/model.py", line 2030 in decode [07:49] [ComfyUI] File "/home/runner/work/comfy-gpu-ci/comfy-gpu-ci/test_workspaces/Sharp-2000/ComfyUI/custom_nodes/ComfyUI-Sharp/nodes/predict.py", line 379 in _predict_image_cached [07:49] [ComfyUI] File "/home/runner/work/comfy-gpu-ci/comfy-gpu-ci/test_workspaces/Sharp-2000/ComfyUI/custom_nodes/ComfyUI-Sharp/nodes/predict.py", line 239 in execute [07:49] [ComfyUI] File "/home/runner/.ce/.pixi/envs/sharp-nodes/lib/python3.10/site-packages/torch/utils/_contextlib.py", line 124 in decorate_context [07:49] [ComfyUI] File "/home/runner/work/comfy-gpu-ci/comfy-gpu-ci/test_workspaces/Sharp-2000/ComfyUI/comfy_api/latest/_io.py", line 1892 in EXECUTE_NORMALIZED [07:49] [ComfyUI] File "/tmp/comfyui_pvenv_r05k2fkl/persistent_worker.py", line 1762 in main [07:49] [ComfyUI] File "/tmp/comfyui_pvenv_r05k2fkl/persistent_worker.py", line 1807 in [07:49] [ComfyUI] [07:49] [ComfyUI] [worker:ComfyUI-Sharp] === END === [07:49] [ComfyUI] [07:49] [capture-loop] iter=2700 t=300.9s state={'complete': False, 'error': None, 'executedCount': 0, 'wsState': 1} eval_ms=4 ram=7.4/15.6GB (48%) swap=0.0/3.0GB (0%) cpu=42% browser_rss=0.85GB [07:55] [capture-loop] iter=2750 t=306.4s state={'complete': False, 'error': None, 'executedCount': 0, 'wsState': 1} eval_ms=2 ram=8.4/15.6GB (54%) swap=0.0/3.0GB (0%) cpu=42% browser_rss=0.85GB [08:00] [capture-loop] iter=2800 t=311.8s state={'complete': False, 'error': None, 'executedCount': 0, 'wsState': 1} eval_ms=2 ram=8.2/15.6GB (52%) swap=0.0/3.0GB (0%) cpu=44% browser_rss=0.85GB [08:06] [capture-loop] iter=2850 t=317.4s state={'complete': False, 'error': None, 'executedCount': 0, 'wsState': 1} eval_ms=2 ram=7.3/15.6GB (47%) swap=0.0/3.0GB (0%) cpu=43% browser_rss=0.86GB [08:11] [capture-loop] iter=2900 t=322.8s state={'complete': False, 'error': None, 'executedCount': 0, 'wsState': 1} eval_ms=3 ram=7.6/15.6GB (48%) swap=0.0/3.0GB (0%) cpu=45% browser_rss=0.86GB [08:17] [capture-loop] iter=2950 t=328.4s state={'complete': False, 'error': None, 'executedCount': 0, 'wsState': 1} eval_ms=2 ram=6.8/15.6GB (43%) swap=0.0/3.0GB (0%) cpu=43% browser_rss=0.86GB [08:19] [ComfyUI] [SubprocessWorker] callback 'report_progress' from call_id=2 [08:19] [ComfyUI] [SubprocessWorker] got response: ok [08:19] [ComfyUI] [comfy-env] SharpPredict done (314.42s): result: NodeOutput [08:19] [ComfyUI] [comfy-env] SubprocessWorker: /home/runner/.ce/.pixi/envs/gaussianpack-nodes/bin/python [08:19] [ComfyUI] [comfy-env] Running PreviewGaussianSharp: ply_path: '/home/runner/work/comfy-gpu-ci/comfy-gpu-ci/test_workspa..., extrinsics: list[4], intrinsics: list[3] [08:19] [ComfyUI] [SubprocessWorker] call_method: nodes.preview_gaussian_sharp.PreviewGaussianSharp.EXECUTE_NORMALIZED [08:19] [ComfyUI] [comfy-env] env_vars: {'COMFYUI_BASE': '/home/runner/work/comfy-gpu-ci/comfy-gpu-ci/test_workspaces/Sharp-2000/ComfyUI'} [08:19] [ComfyUI] [SubprocessWorker] acquired lock, ensuring started... [08:19] [ComfyUI] [ComfyUI-GaussianPack] python: /home/runner/.ce/.pixi/envs/gaussianpack-nodes/bin/python [08:19] [ComfyUI] [ComfyUI-GaussianPack] sys_path sent to worker: ['/home/runner/work/comfy-gpu-ci/comfy-gpu-ci/test_workspaces/Sharp-2000/ComfyUI', '/home/runner/work/comfy-gpu-ci/comfy-gpu-ci/test_workspaces/Sharp-2000/ComfyUI/custom_nodes/ComfyUI-GaussianPack', '/home/runner/.ce/.pixi/envs/gaussianpack-nodes/lib/python3.10/site-packages', '/home/runner/work/comfy-gpu-ci/comfy-gpu-ci/test_workspaces/Sharp-2000/ComfyUI/custom_nodes/ComfyUI-GaussianPack'] [08:19] [ComfyUI] [SubprocessWorker] is_pixi=True, python=/home/runner/.ce/.pixi/envs/gaussianpack-nodes/bin/python [08:19] [ComfyUI] [SubprocessWorker] launching cmd=['/home/runner/.pixi/bin/pixi', 'run', '--as-is', '--manifest-path', '/home/runner/.ce/pixi.toml', '-e', 'gaussianpack-nodes', 'python', '/tmp/comfyui_pvenv_g6q6yfx2/persistent_worker.py', 'abstract://comfy_worker_72e682b17c65']... [08:19] [ComfyUI] [SubprocessWorker] socket_addr=abstract://comfy_worker_72e682b17c65 (abstract, no filesystem path) [08:20] [ComfyUI] [SubprocessWorker] worker started/confirmed [08:20] [ComfyUI] [SubprocessWorker] serializing kwargs to shm... [08:20] [ComfyUI] [SubprocessWorker] created 0 shm blocks [08:20] [ComfyUI] [SubprocessWorker] sending request via socket... [08:20] [ComfyUI] [SubprocessWorker] call_id=1 sending call_method [08:20] [ComfyUI] [worker:ComfyUI-GaussianPack] WARNING: SPZ route not registered (ModuleNotFoundError: No module named 'comfy_aimdo') [08:21] [ComfyUI] [SubprocessWorker] got response: ok [08:21] [ComfyUI] [comfy-env] PreviewGaussianSharp done (1.79s): result: NodeOutput [08:21] [ComfyUI] [INFO] Prompt executed in 331.65 seconds [08:21] Node executed (1 total), capturing... [08:21] Frame 8 saved (frame_007.jpg, t=332.1s) [08:21] [capture-node] freeze=2ms shot=155ms unfreeze=29ms saved=True [08:22] Execution complete (t=333.2s) [08:22] [3d-wait] Phase 1: Waiting for 'Loading 3D Model' text to disappear... [08:22] [3d-wait] Phase 1 done in 0.0s [08:22] [3d-wait] Phase 2: iframes=1 [08:22] [3d-wait] iframe viewer_ready=True (matched 1 console logs) [08:22] [3d-wait] Unfrozen in 0.005s, rendering for 5s... [08:32] [3d-wait] JS halted via CDP after 10.4s [09:03] [3d-wait] Re-frozen in 41.2s [09:03] [3d-wait] Total 3D wait: 41.2s [09:03] Captured 8 unique frames over 374.56s [09:03] [debug] iframes: 1 [09:03] [debug] iframe[0]: src=http://127.0.0.1:41882/extensions/ComfyUI-GaussianPack/viewer_gaussian_sharp.htm, canvas=1536x1024, rafFrozen=True [09:03] [timing] trigger_3d_previews: 0.0s [09:05] Saved high-quality screenshot: sharp_basic_executed.png [09:06] [timing] final_screenshot: 0.3s [09:06] [ComfyUI] [INFO] Using RAM pressure cache. [09:06] Capturing execution frames: sharp_exif.json [09:06] [ComfyUI] [INFO] Using RAM pressure cache. [09:12] Frame 1 saved (frame_000.jpg, t=0.0s) [09:12] Validating workflow... [09:12] [ComfyUI] [INFO] === /validate endpoint called === [09:12] [ComfyUI] [INFO] Received JSON with keys: ['prompt'] [09:12] [ComfyUI] [INFO] Prompt has 4 nodes [09:12] [ComfyUI] [INFO] Node 2: LoadSharpModel [09:12] [ComfyUI] [INFO] Inputs: {"precision": "auto"} [09:12] [ComfyUI] [INFO] Node 7: SharpPredict [09:12] [ComfyUI] [INFO] Inputs: {"focal_length_mm": ["9", 2], "output_prefix": "sharp", "model": ["2", 0], "image": ["9", 0]} [09:12] Queuing workflow for execution... [09:12] [ComfyUI] [INFO] Node 9: LoadImageWithExif [09:12] [ComfyUI] [INFO] Inputs: {"image": "eth3d.png", "default_focal_mm": 30} [09:12] [ComfyUI] [INFO] Node 11: PreviewGaussianSharp [09:12] [ComfyUI] [INFO] Inputs: {"preview_gaussian": "", "ply_path": ["7", 0], "extrinsics": ["7", 1], "intrinsics": ["7", 2]} [09:12] [ComfyUI] [INFO] Generated prompt_id: 0bf0ce1a-d291-4429-98b7-50b2fc85ae65 [09:12] [ComfyUI] [INFO] Calling execution.validate_prompt()... [09:12] [ComfyUI] [INFO] Validation result: valid=True [09:12] [ComfyUI] [INFO] === Validation PASSED === [09:12] [ComfyUI] [INFO] got prompt [09:12] [ComfyUI] [comfy-env] Running LoadImageWithExif: image: 'eth3d.png', default_focal_mm: 30.0 [09:12] [ComfyUI] [SubprocessWorker] call_method: nodes.load_image_exif.LoadImageWithExif.EXECUTE_NORMALIZED [09:12] [ComfyUI] [SubprocessWorker] acquired lock, ensuring started... [09:12] [ComfyUI] [ComfyUI-Sharp] Health check: ping (timeout=5.0s)... [09:12] [ComfyUI] [ComfyUI-Sharp] Health check: failed [09:12] [ComfyUI] [ComfyUI-Sharp] Socket unhealthy, restarting worker... [09:12] [ComfyUI] [ComfyUI-Sharp] python: /home/runner/.ce/.pixi/envs/sharp-nodes/bin/python [09:12] [ComfyUI] [ComfyUI-Sharp] sys_path sent to worker: ['/home/runner/work/comfy-gpu-ci/comfy-gpu-ci/test_workspaces/Sharp-2000/ComfyUI', '/home/runner/work/comfy-gpu-ci/comfy-gpu-ci/test_workspaces/Sharp-2000/ComfyUI/custom_nodes/ComfyUI-Sharp', '/home/runner/.ce/.pixi/envs/sharp-nodes/lib/python3.10/site-packages', '/home/runner/work/comfy-gpu-ci/comfy-gpu-ci/test_workspaces/Sharp-2000/ComfyUI/custom_nodes/ComfyUI-Sharp'] [09:12] [ComfyUI] [SubprocessWorker] is_pixi=True, python=/home/runner/.ce/.pixi/envs/sharp-nodes/bin/python [09:12] [ComfyUI] [SubprocessWorker] launching cmd=['/home/runner/.pixi/bin/pixi', 'run', '--as-is', '--manifest-path', '/home/runner/.ce/pixi.toml', '-e', 'sharp-nodes', 'python', '/tmp/comfyui_pvenv_r05k2fkl/persistent_worker.py', 'abstract://comfy_worker_147e55615769']... [09:12] [ComfyUI] [SubprocessWorker] socket_addr=abstract://comfy_worker_147e55615769 (abstract, no filesystem path) [09:14] [ComfyUI] [worker:ComfyUI-Sharp] ERROR: Failed to import comfy_kitchen, Error: No module named 'comfy_kitchen', fp8 and fp4 support will not be available. [09:14] [ComfyUI] [worker:ComfyUI-Sharp] WARNING: comfy_kitchen does not support stochastic FP8 rounding, please update comfy_kitchen. [09:14] [ComfyUI] [SubprocessWorker] worker started/confirmed [09:14] [ComfyUI] [SubprocessWorker] serializing kwargs to shm... [09:14] [ComfyUI] [SubprocessWorker] created 0 shm blocks [09:14] [ComfyUI] [SubprocessWorker] sending request via socket... [09:14] [ComfyUI] [SubprocessWorker] call_id=3 sending call_method [09:14] [ComfyUI] [SubprocessWorker] got response: ok [09:14] [ComfyUI] [comfy-env] LoadImageWithExif done (2.02s): result: NodeOutput [09:14] [ComfyUI] [comfy-env] Running LoadSharpModel: precision: 'auto' [09:14] [ComfyUI] [SubprocessWorker] call_method: nodes.load_model.LoadSharpModel.EXECUTE_NORMALIZED [09:14] [ComfyUI] [SubprocessWorker] acquired lock, ensuring started... [09:14] [ComfyUI] [ComfyUI-Sharp] Health check: ping (timeout=5.0s)... [09:14] [ComfyUI] [ComfyUI-Sharp] Health check: ok [09:14] [ComfyUI] [SubprocessWorker] worker started/confirmed [09:14] [ComfyUI] [SubprocessWorker] serializing kwargs to shm... [09:14] [ComfyUI] [SubprocessWorker] created 0 shm blocks [09:14] [ComfyUI] [SubprocessWorker] sending request via socket... [09:14] [ComfyUI] [SubprocessWorker] call_id=4 sending call_method [09:14] [ComfyUI] [worker:ComfyUI-Sharp] [LoadSharpModel] precision='auto' -> dtype=fp32 (device=cpu) [09:14] [ComfyUI] [worker:ComfyUI-Sharp] [LoadSharpModel] checkpoint already present, reusing (no download): /home/runner/work/comfy-gpu-ci/comfy-gpu-ci/test_workspaces/Sharp-2000/ComfyUI/models/sharp/sharp_2572gikvuh.pt (2679.6 MB) [09:14] [ComfyUI] [worker:ComfyUI-Sharp] [LoadSharpModel] checkpoint ready: /home/runner/work/comfy-gpu-ci/comfy-gpu-ci/test_workspaces/Sharp-2000/ComfyUI/models/sharp/sharp_2572gikvuh.pt (2679.6 MB) [09:14] [ComfyUI] [worker:ComfyUI-Sharp] [LoadSharpModel] config: precision=auto -> dtype=fp32 [09:14] [ComfyUI] [SubprocessWorker] got response: ok [09:14] [ComfyUI] [comfy-env] LoadSharpModel done (0.01s): result: NodeOutput [09:14] [ComfyUI] [comfy-env] Running SharpPredict: focal_length_mm: 20.0, output_prefix: 'sharp', model: dict, image: torch.float32 [1,1011,1520,3] cpu [09:14] [ComfyUI] [SubprocessWorker] call_method: nodes.predict.SharpPredict.EXECUTE_NORMALIZED [09:14] [ComfyUI] [SubprocessWorker] acquired lock, ensuring started... [09:14] [ComfyUI] [ComfyUI-Sharp] Health check: ping (timeout=5.0s)... [09:14] [ComfyUI] [ComfyUI-Sharp] Health check: ok [09:14] [ComfyUI] [SubprocessWorker] worker started/confirmed [09:14] [ComfyUI] [comfy-env] PRE-SERIALIZE 'image' shape: torch.Size([1, 1011, 1520, 3]) [09:14] [ComfyUI] [SubprocessWorker] serializing kwargs to shm... [09:14] [ComfyUI] [SubprocessWorker] created 0 shm blocks [09:14] [ComfyUI] [SubprocessWorker] sending request via socket... [09:14] [ComfyUI] [SubprocessWorker] call_id=5 sending call_method [09:14] [ComfyUI] [worker:ComfyUI-Sharp] [comfy-env] _from_shm got dict with keys: ['__type__', 'strategy', 'parent_pid', 'fd', 'storage_size'] [09:14] [ComfyUI] [worker:ComfyUI-Sharp] [comfy-env] DESERIALIZE TensorRef: tensor_size=[1, 1011, 1520, 3] [09:14] [ComfyUI] [worker:ComfyUI-Sharp] [comfy-env] DESERIALIZED tensor shape: torch.Size([1, 1011, 1520, 3]) [09:14] Frame 2 saved (frame_001.jpg, t=2.2s) [09:14] [capture-periodic] freeze=5ms shot=150ms unfreeze=4ms saved=True [09:16] [ComfyUI] [worker:ComfyUI-Sharp] [LoadSharpModel] loading checkpoint from /home/runner/work/comfy-gpu-ci/comfy-gpu-ci/test_workspaces/Sharp-2000/ComfyUI/models/sharp/sharp_2572gikvuh.pt (dtype=fp32) [09:16] Frame 3 saved (frame_002.jpg, t=4.5s) [09:17] [capture-periodic] freeze=1ms shot=128ms unfreeze=2ms saved=True [09:18] [capture-loop] iter=50 t=5.8s state={'complete': False, 'error': None, 'executedCount': 0, 'wsState': 1} eval_ms=2 ram=3.1/15.6GB (20%) swap=0.0/3.0GB (0%) cpu=77% browser_rss=0.96GB [09:19] [ComfyUI] [worker:ComfyUI-Sharp] [LoadSharpModel] initializing model on meta device... [09:19] [ComfyUI] [worker:ComfyUI-Sharp] [LoadSharpModel] model ready (torch.float32) [09:19] [ComfyUI] [SubprocessWorker] callback 'request_vram_budget' from call_id=5 [09:19] [ComfyUI] [comfy-env] VRAM request: 2.81GB, free before eviction: 11.22GB [09:19] [ComfyUI] [comfy-env] VRAM after eviction: 11.22GB [09:23] [capture-loop] iter=100 t=11.2s state={'complete': False, 'error': None, 'executedCount': 0, 'wsState': 1} eval_ms=2 ram=5.6/15.6GB (36%) swap=0.0/3.0GB (0%) cpu=39% browser_rss=0.96GB [09:29] [capture-loop] iter=150 t=16.8s state={'complete': False, 'error': None, 'executedCount': 0, 'wsState': 1} eval_ms=2 ram=5.5/15.6GB (35%) swap=0.0/3.0GB (0%) cpu=44% browser_rss=0.96GB [09:34] [capture-loop] iter=200 t=22.2s state={'complete': False, 'error': None, 'executedCount': 0, 'wsState': 1} eval_ms=2 ram=5.5/15.6GB (35%) swap=0.0/3.0GB (0%) cpu=44% browser_rss=0.96GB [09:40] [capture-loop] iter=250 t=27.9s state={'complete': False, 'error': None, 'executedCount': 0, 'wsState': 1} eval_ms=5 ram=5.3/15.6GB (34%) swap=0.0/3.0GB (0%) cpu=47% browser_rss=0.88GB [09:45] [capture-loop] iter=300 t=33.4s state={'complete': False, 'error': None, 'executedCount': 0, 'wsState': 1} eval_ms=2 ram=5.4/15.6GB (35%) swap=0.0/3.0GB (0%) cpu=44% browser_rss=0.87GB [09:51] [capture-loop] iter=350 t=39.0s state={'complete': False, 'error': None, 'executedCount': 0, 'wsState': 1} eval_ms=2 ram=5.4/15.6GB (35%) swap=0.0/3.0GB (0%) cpu=44% browser_rss=0.88GB [09:56] [capture-loop] iter=400 t=44.4s state={'complete': False, 'error': None, 'executedCount': 0, 'wsState': 1} eval_ms=2 ram=5.5/15.6GB (35%) swap=0.0/3.0GB (0%) cpu=43% browser_rss=0.88GB [10:02] [capture-loop] iter=450 t=50.0s state={'complete': False, 'error': None, 'executedCount': 0, 'wsState': 1} eval_ms=4 ram=5.5/15.6GB (35%) swap=0.0/3.0GB (0%) cpu=44% browser_rss=0.88GB [10:07] [capture-loop] iter=500 t=55.5s state={'complete': False, 'error': None, 'executedCount': 0, 'wsState': 1} eval_ms=2 ram=5.4/15.6GB (35%) swap=0.0/3.0GB (0%) cpu=42% browser_rss=0.88GB [10:12] [ComfyUI] [worker:ComfyUI-Sharp] [10:12] [ComfyUI] === WATCHDOG TICK 1 === [10:12] [ComfyUI] [worker:ComfyUI-Sharp] Thread 0x00007f129140e6c0 (most recent call first): [10:12] [ComfyUI] File "/home/runner/.ce/.pixi/envs/sharp-nodes/lib/python3.10/socket.py", line 293 in accept [10:12] [ComfyUI] File "/home/runner/.ce/.pixi/envs/sharp-nodes/lib/python3.10/multiprocessing/connection.py", line 609 in accept [10:12] [ComfyUI] File "/home/runner/.ce/.pixi/envs/sharp-nodes/lib/python3.10/multiprocessing/connection.py", line 463 in accept [10:12] [ComfyUI] File "/home/runner/.ce/.pixi/envs/sharp-nodes/lib/python3.10/multiprocessing/resource_sharer.py", line 138 in _serve [10:12] [ComfyUI] File "/home/runner/.ce/.pixi/envs/sharp-nodes/lib/python3.10/threading.py", line 953 in run [10:12] [ComfyUI] File "/home/runner/.ce/.pixi/envs/sharp-nodes/lib/python3.10/threading.py", line 1016 in _bootstrap_inner [10:12] [ComfyUI] File "/home/runner/.ce/.pixi/envs/sharp-nodes/lib/python3.10/threading.py", line 973 in _bootstrap [10:12] [ComfyUI] [10:12] [ComfyUI] Current thread 0x00007f129240f6c0 (most recent call first): [10:12] [ComfyUI] File "/tmp/comfyui_pvenv_r05k2fkl/persistent_worker.py", line 52 in _watchdog [10:12] [ComfyUI] File "/home/runner/.ce/.pixi/envs/sharp-nodes/lib/python3.10/threading.py", line 953 in run [10:12] [ComfyUI] File "/home/runner/.ce/.pixi/envs/sharp-nodes/lib/python3.10/threading.py", line 1016 in _bootstrap_inner [10:12] [ComfyUI] File "/home/runner/.ce/.pixi/envs/sharp-nodes/lib/python3.10/threading.py", line 973 in _bootstrap [10:12] [ComfyUI] [10:12] [ComfyUI] Thread 0x00007f1292eed740 (most recent call first): [10:12] [ComfyUI] File "/home/runner/.ce/.pixi/envs/sharp-nodes/lib/python3.10/site-packages/torch/nn/modules/linear.py", line 134 in forward [10:12] [ComfyUI] File "/home/runner/work/comfy-gpu-ci/comfy-gpu-ci/test_workspaces/Sharp-2000/ComfyUI/comfy/ops.py", line 503 in forward [10:12] [ComfyUI] File "/home/runner/.ce/.pixi/envs/sharp-nodes/lib/python3.10/site-packages/torch/nn/modules/module.py", line 1787 in _call_impl [10:12] [ComfyUI] File "/home/runner/.ce/.pixi/envs/sharp-nodes/lib/python3.10/site-packages/torch/nn/modules/module.py", line 1776 in _wrapped_call_impl [10:12] [ComfyUI] File "/home/runner/work/comfy-gpu-ci/comfy-gpu-ci/test_workspaces/Sharp-2000/ComfyUI/custom_nodes/ComfyUI-Sharp/nodes/sharp/model.py", line 274 in forward [10:12] [ComfyUI] File "/home/runner/.ce/.pixi/envs/sharp-nodes/lib/python3.10/site-packages/torch/nn/modules/module.py", line 1787 in _call_impl [10:12] [ComfyUI] File "/home/runner/.ce/.pixi/envs/sharp-nodes/lib/python3.10/site-packages/torch/nn/modules/module.py", line 1776 in _wrapped_call_impl [10:12] [ComfyUI] File "/home/runner/work/comfy-gpu-ci/comfy-gpu-ci/test_workspaces/Sharp-2000/ComfyUI/custom_nodes/ComfyUI-Sharp/nodes/sharp/model.py", line 310 in forward [10:12] [ComfyUI] File "/home/runner/.ce/.pixi/envs/sharp-nodes/lib/python3.10/site-packages/torch/nn/modules/module.py", line 1787 in _call_impl [10:12] [ComfyUI] File "/home/runner/.ce/.pixi/envs/sharp-nodes/lib/python3.10/site-packages/torch/nn/modules/module.py", line 1776 in _wrapped_call_impl [10:12] [ComfyUI] File "/home/runner/work/comfy-gpu-ci/comfy-gpu-ci/test_workspaces/Sharp-2000/ComfyUI/custom_nodes/ComfyUI-Sharp/nodes/sharp/model.py", line 412 in forward [10:12] [ComfyUI] File "/home/runner/.ce/.pixi/envs/sharp-nodes/lib/python3.10/site-packages/torch/nn/modules/module.py", line 1787 in _call_impl [10:12] [ComfyUI] File "/home/runner/.ce/.pixi/envs/sharp-nodes/lib/python3.10/site-packages/torch/nn/modules/module.py", line 1776 in _wrapped_call_impl [10:12] [ComfyUI] File "/home/runner/work/comfy-gpu-ci/comfy-gpu-ci/test_workspaces/Sharp-2000/ComfyUI/custom_nodes/ComfyUI-Sharp/nodes/sharp/model.py", line 685 in forward [10:12] [ComfyUI] File "/home/runner/.ce/.pixi/envs/sharp-nodes/lib/python3.10/site-packages/torch/nn/modules/module.py", line 1787 in _call_impl [10:12] [ComfyUI] File "/home/runner/.ce/.pixi/envs/sharp-nodes/lib/python3.10/site-packages/torch/nn/modules/module.py", line 1776 in _wrapped_call_impl [10:12] [ComfyUI] File "/home/runner/work/comfy-gpu-ci/comfy-gpu-ci/test_workspaces/Sharp-2000/ComfyUI/custom_nodes/ComfyUI-Sharp/nodes/sharp/model.py", line 1109 in forward [10:12] [ComfyUI] File "/home/runner/.ce/.pixi/envs/sharp-nodes/lib/python3.10/site-packages/torch/nn/modules/module.py", line 1787 in _call_impl [10:12] [ComfyUI] File "/home/runner/.ce/.pixi/envs/sharp-nodes/lib/python3.10/site-packages/torch/nn/modules/module.py", line 1776 in _wrapped_call_impl [10:12] [ComfyUI] File "/home/runner/work/comfy-gpu-ci/comfy-gpu-ci/test_workspaces/Sharp-2000/ComfyUI/custom_nodes/ComfyUI-Sharp/nodes/sharp/model.py", line 2006 in encode [10:12] [ComfyUI] File "/home/runner/work/comfy-gpu-ci/comfy-gpu-ci/test_workspaces/Sharp-2000/ComfyUI/custom_nodes/ComfyUI-Sharp/nodes/predict.py", line 348 in _predict_image_cached [10:12] [ComfyUI] File "/home/runner/work/comfy-gpu-ci/comfy-gpu-ci/test_workspaces/Sharp-2000/ComfyUI/custom_nodes/ComfyUI-Sharp/nodes/predict.py", line 239 in execute [10:12] [ComfyUI] File "/home/runner/.ce/.pixi/envs/sharp-nodes/lib/python3.10/site-packages/torch/utils/_contextlib.py", line 124 in decorate_context [10:12] [ComfyUI] File "/home/runner/work/comfy-gpu-ci/comfy-gpu-ci/test_workspaces/Sharp-2000/ComfyUI/comfy_api/latest/_io.py", line 1892 in EXECUTE_NORMALIZED [10:12] [ComfyUI] File "/tmp/comfyui_pvenv_r05k2fkl/persistent_worker.py", line 1762 in main [10:12] [ComfyUI] File "/tmp/comfyui_pvenv_r05k2fkl/persistent_worker.py", line 1807 in [10:12] [ComfyUI] [10:12] [ComfyUI] [worker:ComfyUI-Sharp] === END === [10:12] [ComfyUI] [10:13] [capture-loop] iter=550 t=61.0s state={'complete': False, 'error': None, 'executedCount': 0, 'wsState': 1} eval_ms=2 ram=5.5/15.6GB (35%) swap=0.0/3.0GB (0%) cpu=44% browser_rss=0.88GB [10:18] [capture-loop] iter=600 t=66.5s state={'complete': False, 'error': None, 'executedCount': 0, 'wsState': 1} eval_ms=2 ram=5.4/15.6GB (35%) swap=0.0/3.0GB (0%) cpu=44% browser_rss=0.87GB [10:24] [capture-loop] iter=650 t=72.1s state={'complete': False, 'error': None, 'executedCount': 0, 'wsState': 1} eval_ms=2 ram=5.5/15.6GB (35%) swap=0.0/3.0GB (0%) cpu=43% browser_rss=0.88GB [10:29] [capture-loop] iter=700 t=77.5s state={'complete': False, 'error': None, 'executedCount': 0, 'wsState': 1} eval_ms=2 ram=5.5/15.6GB (35%) swap=0.0/3.0GB (0%) cpu=44% browser_rss=0.88GB [10:35] [capture-loop] iter=750 t=83.1s state={'complete': False, 'error': None, 'executedCount': 0, 'wsState': 1} eval_ms=2 ram=5.5/15.6GB (35%) swap=0.0/3.0GB (0%) cpu=44% browser_rss=0.88GB [10:40] [capture-loop] iter=800 t=88.5s state={'complete': False, 'error': None, 'executedCount': 0, 'wsState': 1} eval_ms=2 ram=5.5/15.6GB (35%) swap=0.0/3.0GB (0%) cpu=44% browser_rss=0.88GB [10:46] [capture-loop] iter=850 t=94.2s state={'complete': False, 'error': None, 'executedCount': 0, 'wsState': 1} eval_ms=2 ram=5.6/15.6GB (36%) swap=0.0/3.0GB (0%) cpu=45% browser_rss=0.88GB [10:51] [capture-loop] iter=900 t=99.6s state={'complete': False, 'error': None, 'executedCount': 0, 'wsState': 1} eval_ms=2 ram=5.6/15.6GB (36%) swap=0.0/3.0GB (0%) cpu=44% browser_rss=0.88GB [10:57] [capture-loop] iter=950 t=105.2s state={'complete': False, 'error': None, 'executedCount': 0, 'wsState': 1} eval_ms=3 ram=5.5/15.6GB (35%) swap=0.0/3.0GB (0%) cpu=45% browser_rss=0.88GB [11:02] [capture-loop] iter=1000 t=110.6s state={'complete': False, 'error': None, 'executedCount': 0, 'wsState': 1} eval_ms=2 ram=5.6/15.6GB (36%) swap=0.0/3.0GB (0%) cpu=44% browser_rss=0.89GB [11:08] [capture-loop] iter=1050 t=116.2s state={'complete': False, 'error': None, 'executedCount': 0, 'wsState': 1} eval_ms=2 ram=5.6/15.6GB (36%) swap=0.0/3.0GB (0%) cpu=43% browser_rss=0.89GB [11:12] [ComfyUI] [worker:ComfyUI-Sharp] [11:12] [ComfyUI] === WATCHDOG TICK 2 === [11:12] [ComfyUI] [worker:ComfyUI-Sharp] Thread 0x00007f129140e6c0 (most recent call first): [11:12] [ComfyUI] File "/home/runner/.ce/.pixi/envs/sharp-nodes/lib/python3.10/socket.py", line 293 in accept [11:12] [ComfyUI] File "/home/runner/.ce/.pixi/envs/sharp-nodes/lib/python3.10/multiprocessing/connection.py", line 609 in accept [11:12] [ComfyUI] File "/home/runner/.ce/.pixi/envs/sharp-nodes/lib/python3.10/multiprocessing/connection.py", line 463 in accept [11:12] [ComfyUI] File "/home/runner/.ce/.pixi/envs/sharp-nodes/lib/python3.10/multiprocessing/resource_sharer.py", line 138 in _serve [11:12] [ComfyUI] File "/home/runner/.ce/.pixi/envs/sharp-nodes/lib/python3.10/threading.py", line 953 in run [11:12] [ComfyUI] File "/home/runner/.ce/.pixi/envs/sharp-nodes/lib/python3.10/threading.py", line 1016 in _bootstrap_inner [11:12] [ComfyUI] File "/home/runner/.ce/.pixi/envs/sharp-nodes/lib/python3.10/threading.py", line 973 in _bootstrap [11:12] [ComfyUI] [11:12] [ComfyUI] Current thread 0x00007f129240f6c0 (most recent call first): [11:12] [ComfyUI] File "/tmp/comfyui_pvenv_r05k2fkl/persistent_worker.py", line 52 in _watchdog [11:12] [ComfyUI] File "/home/runner/.ce/.pixi/envs/sharp-nodes/lib/python3.10/threading.py", line 953 in run [11:12] [ComfyUI] File "/home/runner/.ce/.pixi/envs/sharp-nodes/lib/python3.10/threading.py", line 1016 in _bootstrap_inner [11:12] [ComfyUI] File "/home/runner/.ce/.pixi/envs/sharp-nodes/lib/python3.10/threading.py", line 973 in _bootstrap [11:12] [ComfyUI] [11:12] [ComfyUI] Thread 0x00007f1292eed740 (most recent call first): [11:12] [ComfyUI] File "/home/runner/work/comfy-gpu-ci/comfy-gpu-ci/test_workspaces/Sharp-2000/ComfyUI/comfy/ldm/modules/sub_quadratic_attention.py", line 170 in _get_attention_scores_no_kv_chunking [11:12] [ComfyUI] File "/home/runner/work/comfy-gpu-ci/comfy-gpu-ci/test_workspaces/Sharp-2000/ComfyUI/comfy/ldm/modules/sub_quadratic_attention.py", line 259 in efficient_dot_product_attention [11:12] [ComfyUI] File "/home/runner/work/comfy-gpu-ci/comfy-gpu-ci/test_workspaces/Sharp-2000/ComfyUI/comfy/ldm/modules/attention.py", line 275 in attention_sub_quad [11:12] [ComfyUI] File "/home/runner/work/comfy-gpu-ci/comfy-gpu-ci/test_workspaces/Sharp-2000/ComfyUI/comfy/ldm/modules/attention.py", line 139 in wrapper [11:12] [ComfyUI] File "/home/runner/work/comfy-gpu-ci/comfy-gpu-ci/test_workspaces/Sharp-2000/ComfyUI/custom_nodes/ComfyUI-Sharp/nodes/sharp/model.py", line 234 in forward [11:12] [ComfyUI] File "/home/runner/.ce/.pixi/envs/sharp-nodes/lib/python3.10/site-packages/torch/nn/modules/module.py", line 1787 in _call_impl [11:12] [ComfyUI] File "/home/runner/.ce/.pixi/envs/sharp-nodes/lib/python3.10/site-packages/torch/nn/modules/module.py", line 1776 in _wrapped_call_impl [11:12] [ComfyUI] File "/home/runner/work/comfy-gpu-ci/comfy-gpu-ci/test_workspaces/Sharp-2000/ComfyUI/custom_nodes/ComfyUI-Sharp/nodes/sharp/model.py", line 309 in forward [11:12] [ComfyUI] File "/home/runner/.ce/.pixi/envs/sharp-nodes/lib/python3.10/site-packages/torch/nn/modules/module.py", line 1787 in _call_impl [11:12] [ComfyUI] File "/home/runner/.ce/.pixi/envs/sharp-nodes/lib/python3.10/site-packages/torch/nn/modules/module.py", line 1776 in _wrapped_call_impl [11:12] [ComfyUI] File "/home/runner/work/comfy-gpu-ci/comfy-gpu-ci/test_workspaces/Sharp-2000/ComfyUI/custom_nodes/ComfyUI-Sharp/nodes/sharp/model.py", line 412 in forward [11:12] [ComfyUI] File "/home/runner/.ce/.pixi/envs/sharp-nodes/lib/python3.10/site-packages/torch/nn/modules/module.py", line 1787 in _call_impl [11:12] [ComfyUI] File "/home/runner/.ce/.pixi/envs/sharp-nodes/lib/python3.10/site-packages/torch/nn/modules/module.py", line 1776 in _wrapped_call_impl [11:12] [ComfyUI] File "/home/runner/work/comfy-gpu-ci/comfy-gpu-ci/test_workspaces/Sharp-2000/ComfyUI/custom_nodes/ComfyUI-Sharp/nodes/sharp/model.py", line 685 in forward [11:12] [ComfyUI] File "/home/runner/.ce/.pixi/envs/sharp-nodes/lib/python3.10/site-packages/torch/nn/modules/module.py", line 1787 in _call_impl [11:12] [ComfyUI] File "/home/runner/.ce/.pixi/envs/sharp-nodes/lib/python3.10/site-packages/torch/nn/modules/module.py", line 1776 in _wrapped_call_impl [11:12] [ComfyUI] File "/home/runner/work/comfy-gpu-ci/comfy-gpu-ci/test_workspaces/Sharp-2000/ComfyUI/custom_nodes/ComfyUI-Sharp/nodes/sharp/model.py", line 1109 in forward [11:12] [ComfyUI] File "/home/runner/.ce/.pixi/envs/sharp-nodes/lib/python3.10/site-packages/torch/nn/modules/module.py", line 1787 in _call_impl [11:12] [ComfyUI] File "/home/runner/.ce/.pixi/envs/sharp-nodes/lib/python3.10/site-packages/torch/nn/modules/module.py", line 1776 in _wrapped_call_impl [11:12] [ComfyUI] File "/home/runner/work/comfy-gpu-ci/comfy-gpu-ci/test_workspaces/Sharp-2000/ComfyUI/custom_nodes/ComfyUI-Sharp/nodes/sharp/model.py", line 2006 in encode [11:12] [ComfyUI] File "/home/runner/work/comfy-gpu-ci/comfy-gpu-ci/test_workspaces/Sharp-2000/ComfyUI/custom_nodes/ComfyUI-Sharp/nodes/predict.py", line 348 in _predict_image_cached [11:12] [ComfyUI] File "/home/runner/work/comfy-gpu-ci/comfy-gpu-ci/test_workspaces/Sharp-2000/ComfyUI/custom_nodes/ComfyUI-Sharp/nodes/predict.py", line 239 in execute [11:12] [ComfyUI] File "/home/runner/.ce/.pixi/envs/sharp-nodes/lib/python3.10/site-packages/torch/utils/_contextlib.py", line 124 in decorate_context [11:12] [ComfyUI] File "/home/runner/work/comfy-gpu-ci/comfy-gpu-ci/test_workspaces/Sharp-2000/ComfyUI/comfy_api/latest/_io.py", line 1892 in EXECUTE_NORMALIZED [11:12] [ComfyUI] File "/tmp/comfyui_pvenv_r05k2fkl/persistent_worker.py", line 1762 in main [11:12] [ComfyUI] File "/tmp/comfyui_pvenv_r05k2fkl/persistent_worker.py", line 1807 in [11:12] [ComfyUI] [11:12] [ComfyUI] [worker:ComfyUI-Sharp] === END === [11:12] [ComfyUI] [11:13] [capture-loop] iter=1100 t=121.7s state={'complete': False, 'error': None, 'executedCount': 0, 'wsState': 1} eval_ms=5 ram=5.6/15.6GB (36%) swap=0.0/3.0GB (0%) cpu=44% browser_rss=0.89GB [11:19] [capture-loop] iter=1150 t=127.3s state={'complete': False, 'error': None, 'executedCount': 0, 'wsState': 1} eval_ms=2 ram=5.6/15.6GB (36%) swap=0.0/3.0GB (0%) cpu=43% browser_rss=0.89GB [11:25] [capture-loop] iter=1200 t=132.7s state={'complete': False, 'error': None, 'executedCount': 0, 'wsState': 1} eval_ms=2 ram=5.7/15.6GB (36%) swap=0.0/3.0GB (0%) cpu=44% browser_rss=0.90GB [11:30] [capture-loop] iter=1250 t=138.3s state={'complete': False, 'error': None, 'executedCount': 0, 'wsState': 1} eval_ms=2 ram=5.7/15.6GB (36%) swap=0.0/3.0GB (0%) cpu=44% browser_rss=0.90GB [11:36] [capture-loop] iter=1300 t=143.8s state={'complete': False, 'error': None, 'executedCount': 0, 'wsState': 1} eval_ms=2 ram=5.7/15.6GB (36%) swap=0.0/3.0GB (0%) cpu=44% browser_rss=0.90GB [11:41] [capture-loop] iter=1350 t=149.4s state={'complete': False, 'error': None, 'executedCount': 0, 'wsState': 1} eval_ms=2 ram=5.7/15.6GB (36%) swap=0.0/3.0GB (0%) cpu=42% browser_rss=0.90GB [11:47] [capture-loop] iter=1400 t=154.8s state={'complete': False, 'error': None, 'executedCount': 0, 'wsState': 1} eval_ms=5 ram=5.8/15.6GB (37%) swap=0.0/3.0GB (0%) cpu=52% browser_rss=0.90GB [11:52] [capture-loop] iter=1450 t=160.5s state={'complete': False, 'error': None, 'executedCount': 0, 'wsState': 1} eval_ms=2 ram=5.7/15.6GB (37%) swap=0.0/3.0GB (0%) cpu=49% browser_rss=0.90GB [11:58] [capture-loop] iter=1500 t=165.9s state={'complete': False, 'error': None, 'executedCount': 0, 'wsState': 1} eval_ms=2 ram=5.7/15.6GB (36%) swap=0.0/3.0GB (0%) cpu=44% browser_rss=0.90GB [12:03] [capture-loop] iter=1550 t=171.5s state={'complete': False, 'error': None, 'executedCount': 0, 'wsState': 1} eval_ms=6 ram=5.7/15.6GB (37%) swap=0.0/3.0GB (0%) cpu=44% browser_rss=0.90GB [12:09] [capture-loop] iter=1600 t=177.0s state={'complete': False, 'error': None, 'executedCount': 0, 'wsState': 1} eval_ms=2 ram=5.8/15.6GB (37%) swap=0.0/3.0GB (0%) cpu=43% browser_rss=0.90GB [12:12] [ComfyUI] [worker:ComfyUI-Sharp] [12:12] [ComfyUI] === WATCHDOG TICK 3 === [12:12] [ComfyUI] [worker:ComfyUI-Sharp] Thread 0x00007f129140e6c0 (most recent call first): [12:12] [ComfyUI] File "/home/runner/.ce/.pixi/envs/sharp-nodes/lib/python3.10/socket.py", line 293 in accept [12:12] [ComfyUI] File "/home/runner/.ce/.pixi/envs/sharp-nodes/lib/python3.10/multiprocessing/connection.py", line 609 in accept [12:12] [ComfyUI] File "/home/runner/.ce/.pixi/envs/sharp-nodes/lib/python3.10/multiprocessing/connection.py", line 463 in accept [12:12] [ComfyUI] File "/home/runner/.ce/.pixi/envs/sharp-nodes/lib/python3.10/multiprocessing/resource_sharer.py", line 138 in _serve [12:12] [ComfyUI] File "/home/runner/.ce/.pixi/envs/sharp-nodes/lib/python3.10/threading.py", line 953 in run [12:12] [ComfyUI] File "/home/runner/.ce/.pixi/envs/sharp-nodes/lib/python3.10/threading.py", line 1016 in _bootstrap_inner [12:12] [ComfyUI] File "/home/runner/.ce/.pixi/envs/sharp-nodes/lib/python3.10/threading.py", line 973 in _bootstrap [12:12] [ComfyUI] [12:12] [ComfyUI] Current thread 0x00007f129240f6c0 (most recent call first): [12:12] [ComfyUI] File "/tmp/comfyui_pvenv_r05k2fkl/persistent_worker.py", line 52 in _watchdog [12:12] [ComfyUI] File "/home/runner/.ce/.pixi/envs/sharp-nodes/lib/python3.10/threading.py", line 953 in run [12:12] [ComfyUI] File "/home/runner/.ce/.pixi/envs/sharp-nodes/lib/python3.10/threading.py", line 1016 in _bootstrap_inner [12:12] [ComfyUI] File "/home/runner/.ce/.pixi/envs/sharp-nodes/lib/python3.10/threading.py", line 973 in _bootstrap [12:12] [ComfyUI] [12:12] [ComfyUI] Thread 0x00007f1292eed740 (most recent call first): [12:12] [ComfyUI] File "/home/runner/.ce/.pixi/envs/sharp-nodes/lib/python3.10/site-packages/torch/nn/modules/linear.py", line 134 in forward [12:12] [ComfyUI] File "/home/runner/work/comfy-gpu-ci/comfy-gpu-ci/test_workspaces/Sharp-2000/ComfyUI/comfy/ops.py", line 503 in forward [12:12] [ComfyUI] File "/home/runner/.ce/.pixi/envs/sharp-nodes/lib/python3.10/site-packages/torch/nn/modules/module.py", line 1787 in _call_impl [12:12] [ComfyUI] File "/home/runner/.ce/.pixi/envs/sharp-nodes/lib/python3.10/site-packages/torch/nn/modules/module.py", line 1776 in _wrapped_call_impl [12:12] [ComfyUI] File "/home/runner/work/comfy-gpu-ci/comfy-gpu-ci/test_workspaces/Sharp-2000/ComfyUI/custom_nodes/ComfyUI-Sharp/nodes/sharp/model.py", line 274 in forward [12:12] [ComfyUI] File "/home/runner/.ce/.pixi/envs/sharp-nodes/lib/python3.10/site-packages/torch/nn/modules/module.py", line 1787 in _call_impl [12:12] [ComfyUI] File "/home/runner/.ce/.pixi/envs/sharp-nodes/lib/python3.10/site-packages/torch/nn/modules/module.py", line 1776 in _wrapped_call_impl [12:12] [ComfyUI] File "/home/runner/work/comfy-gpu-ci/comfy-gpu-ci/test_workspaces/Sharp-2000/ComfyUI/custom_nodes/ComfyUI-Sharp/nodes/sharp/model.py", line 310 in forward [12:12] [ComfyUI] File "/home/runner/.ce/.pixi/envs/sharp-nodes/lib/python3.10/site-packages/torch/nn/modules/module.py", line 1787 in _call_impl [12:12] [ComfyUI] File "/home/runner/.ce/.pixi/envs/sharp-nodes/lib/python3.10/site-packages/torch/nn/modules/module.py", line 1776 in _wrapped_call_impl [12:12] [ComfyUI] File "/home/runner/work/comfy-gpu-ci/comfy-gpu-ci/test_workspaces/Sharp-2000/ComfyUI/custom_nodes/ComfyUI-Sharp/nodes/sharp/model.py", line 412 in forward [12:12] [ComfyUI] File "/home/runner/.ce/.pixi/envs/sharp-nodes/lib/python3.10/site-packages/torch/nn/modules/module.py", line 1787 in _call_impl [12:12] [ComfyUI] File "/home/runner/.ce/.pixi/envs/sharp-nodes/lib/python3.10/site-packages/torch/nn/modules/module.py", line 1776 in _wrapped_call_impl [12:12] [ComfyUI] File "/home/runner/work/comfy-gpu-ci/comfy-gpu-ci/test_workspaces/Sharp-2000/ComfyUI/custom_nodes/ComfyUI-Sharp/nodes/sharp/model.py", line 685 in forward [12:12] [ComfyUI] File "/home/runner/.ce/.pixi/envs/sharp-nodes/lib/python3.10/site-packages/torch/nn/modules/module.py", line 1787 in _call_impl [12:12] [ComfyUI] File "/home/runner/.ce/.pixi/envs/sharp-nodes/lib/python3.10/site-packages/torch/nn/modules/module.py", line 1776 in _wrapped_call_impl [12:12] [ComfyUI] File "/home/runner/work/comfy-gpu-ci/comfy-gpu-ci/test_workspaces/Sharp-2000/ComfyUI/custom_nodes/ComfyUI-Sharp/nodes/sharp/model.py", line 1109 in forward [12:12] [ComfyUI] File "/home/runner/.ce/.pixi/envs/sharp-nodes/lib/python3.10/site-packages/torch/nn/modules/module.py", line 1787 in _call_impl [12:12] [ComfyUI] File "/home/runner/.ce/.pixi/envs/sharp-nodes/lib/python3.10/site-packages/torch/nn/modules/module.py", line 1776 in _wrapped_call_impl [12:12] [ComfyUI] File "/home/runner/work/comfy-gpu-ci/comfy-gpu-ci/test_workspaces/Sharp-2000/ComfyUI/custom_nodes/ComfyUI-Sharp/nodes/sharp/model.py", line 2006 in encode [12:12] [ComfyUI] File "/home/runner/work/comfy-gpu-ci/comfy-gpu-ci/test_workspaces/Sharp-2000/ComfyUI/custom_nodes/ComfyUI-Sharp/nodes/predict.py", line 348 in _predict_image_cached [12:12] [ComfyUI] File "/home/runner/work/comfy-gpu-ci/comfy-gpu-ci/test_workspaces/Sharp-2000/ComfyUI/custom_nodes/ComfyUI-Sharp/nodes/predict.py", line 239 in execute [12:12] [ComfyUI] File "/home/runner/.ce/.pixi/envs/sharp-nodes/lib/python3.10/site-packages/torch/utils/_contextlib.py", line 124 in decorate_context [12:12] [ComfyUI] File "/home/runner/work/comfy-gpu-ci/comfy-gpu-ci/test_workspaces/Sharp-2000/ComfyUI/comfy_api/latest/_io.py", line 1892 in EXECUTE_NORMALIZED [12:12] [ComfyUI] File "/tmp/comfyui_pvenv_r05k2fkl/persistent_worker.py", line 1762 in main [12:12] [ComfyUI] File "/tmp/comfyui_pvenv_r05k2fkl/persistent_worker.py", line 1807 in [12:12] [ComfyUI] [12:12] [ComfyUI] [worker:ComfyUI-Sharp] === END === [12:12] [ComfyUI] [12:14] [capture-loop] iter=1650 t=182.6s state={'complete': False, 'error': None, 'executedCount': 0, 'wsState': 1} eval_ms=6 ram=5.8/15.6GB (37%) swap=0.0/3.0GB (0%) cpu=44% browser_rss=0.90GB [12:20] [capture-loop] iter=1700 t=188.0s state={'complete': False, 'error': None, 'executedCount': 0, 'wsState': 1} eval_ms=2 ram=5.8/15.6GB (37%) swap=0.0/3.0GB (0%) cpu=44% browser_rss=0.90GB [12:25] [capture-loop] iter=1750 t=193.6s state={'complete': False, 'error': None, 'executedCount': 0, 'wsState': 1} eval_ms=2 ram=5.5/15.6GB (35%) swap=0.0/3.0GB (0%) cpu=44% browser_rss=0.90GB [12:31] [capture-loop] iter=1800 t=199.0s state={'complete': False, 'error': None, 'executedCount': 0, 'wsState': 1} eval_ms=2 ram=6.2/15.6GB (40%) swap=0.0/3.0GB (0%) cpu=44% browser_rss=0.90GB [12:36] [capture-loop] iter=1850 t=204.6s state={'complete': False, 'error': None, 'executedCount': 0, 'wsState': 1} eval_ms=2 ram=6.5/15.6GB (42%) swap=0.0/3.0GB (0%) cpu=43% browser_rss=0.90GB [12:42] [capture-loop] iter=1900 t=210.1s state={'complete': False, 'error': None, 'executedCount': 0, 'wsState': 1} eval_ms=2 ram=7.1/15.6GB (45%) swap=0.0/3.0GB (0%) cpu=42% browser_rss=0.90GB [12:47] [capture-loop] iter=1950 t=215.7s state={'complete': False, 'error': None, 'executedCount': 0, 'wsState': 1} eval_ms=6 ram=8.1/15.6GB (52%) swap=0.0/3.0GB (0%) cpu=43% browser_rss=0.90GB [12:53] [capture-loop] iter=2000 t=221.1s state={'complete': False, 'error': None, 'executedCount': 0, 'wsState': 1} eval_ms=5 ram=7.4/15.6GB (48%) swap=0.0/3.0GB (0%) cpu=41% browser_rss=0.90GB [12:58] [capture-loop] iter=2050 t=226.7s state={'complete': False, 'error': None, 'executedCount': 0, 'wsState': 1} eval_ms=3 ram=7.2/15.6GB (46%) swap=0.0/3.0GB (0%) cpu=42% browser_rss=0.90GB [13:04] [capture-loop] iter=2100 t=232.2s state={'complete': False, 'error': None, 'executedCount': 0, 'wsState': 1} eval_ms=3 ram=7.6/15.6GB (49%) swap=0.0/3.0GB (0%) cpu=43% browser_rss=0.89GB [13:10] [capture-loop] iter=2150 t=237.8s state={'complete': False, 'error': None, 'executedCount': 0, 'wsState': 1} eval_ms=2 ram=9.1/15.6GB (58%) swap=0.0/3.0GB (0%) cpu=44% browser_rss=0.89GB [13:12] [ComfyUI] [worker:ComfyUI-Sharp] [13:12] [ComfyUI] === WATCHDOG TICK 4 === [13:12] [ComfyUI] [worker:ComfyUI-Sharp] Thread 0x00007f129140e6c0 (most recent call first): [13:12] [ComfyUI] File "/home/runner/.ce/.pixi/envs/sharp-nodes/lib/python3.10/socket.py", line 293 in accept [13:12] [ComfyUI] File "/home/runner/.ce/.pixi/envs/sharp-nodes/lib/python3.10/multiprocessing/connection.py", line 609 in accept [13:12] [ComfyUI] File "/home/runner/.ce/.pixi/envs/sharp-nodes/lib/python3.10/multiprocessing/connection.py", line 463 in accept [13:12] [ComfyUI] File "/home/runner/.ce/.pixi/envs/sharp-nodes/lib/python3.10/multiprocessing/resource_sharer.py", line 138 in _serve [13:12] [ComfyUI] File "/home/runner/.ce/.pixi/envs/sharp-nodes/lib/python3.10/threading.py", line 953 in run [13:12] [ComfyUI] File "/home/runner/.ce/.pixi/envs/sharp-nodes/lib/python3.10/threading.py", line 1016 in _bootstrap_inner [13:12] [ComfyUI] File "/home/runner/.ce/.pixi/envs/sharp-nodes/lib/python3.10/threading.py", line 973 in _bootstrap [13:12] [ComfyUI] [13:12] [ComfyUI] Current thread 0x00007f129240f6c0 (most recent call first): [13:12] [ComfyUI] File "/tmp/comfyui_pvenv_r05k2fkl/persistent_worker.py", line 52 in _watchdog [13:12] [ComfyUI] File "/home/runner/.ce/.pixi/envs/sharp-nodes/lib/python3.10/threading.py", line 953 in run [13:12] [ComfyUI] File "/home/runner/.ce/.pixi/envs/sharp-nodes/lib/python3.10/threading.py", line 1016 in _bootstrap_inner [13:12] [ComfyUI] File "/home/runner/.ce/.pixi/envs/sharp-nodes/lib/python3.10/threading.py", line 973 in _bootstrap [13:12] [ComfyUI] [13:12] [ComfyUI] Thread 0x00007f1292eed740 (most recent call first): [13:12] [ComfyUI] File "/home/runner/.ce/.pixi/envs/sharp-nodes/lib/python3.10/site-packages/torch/nn/modules/conv.py", line 548 in _conv_forward [13:12] [ComfyUI] File "/home/runner/.ce/.pixi/envs/sharp-nodes/lib/python3.10/site-packages/torch/nn/modules/conv.py", line 553 in forward [13:12] [ComfyUI] File "/home/runner/work/comfy-gpu-ci/comfy-gpu-ci/test_workspaces/Sharp-2000/ComfyUI/comfy/ops.py", line 537 in forward [13:12] [ComfyUI] File "/home/runner/.ce/.pixi/envs/sharp-nodes/lib/python3.10/site-packages/torch/nn/modules/module.py", line 1787 in _call_impl [13:12] [ComfyUI] File "/home/runner/.ce/.pixi/envs/sharp-nodes/lib/python3.10/site-packages/torch/nn/modules/module.py", line 1776 in _wrapped_call_impl [13:12] [ComfyUI] File "/home/runner/.ce/.pixi/envs/sharp-nodes/lib/python3.10/site-packages/torch/nn/modules/container.py", line 253 in forward [13:12] [ComfyUI] File "/home/runner/.ce/.pixi/envs/sharp-nodes/lib/python3.10/site-packages/torch/nn/modules/module.py", line 1787 in _call_impl [13:12] [ComfyUI] File "/home/runner/.ce/.pixi/envs/sharp-nodes/lib/python3.10/site-packages/torch/nn/modules/module.py", line 1776 in _wrapped_call_impl [13:12] [ComfyUI] File "/home/runner/work/comfy-gpu-ci/comfy-gpu-ci/test_workspaces/Sharp-2000/ComfyUI/custom_nodes/ComfyUI-Sharp/nodes/sharp/model.py", line 766 in forward [13:12] [ComfyUI] File "/home/runner/.ce/.pixi/envs/sharp-nodes/lib/python3.10/site-packages/torch/nn/modules/module.py", line 1787 in _call_impl [13:12] [ComfyUI] File "/home/runner/.ce/.pixi/envs/sharp-nodes/lib/python3.10/site-packages/torch/nn/modules/module.py", line 1776 in _wrapped_call_impl [13:12] [ComfyUI] File "/home/runner/work/comfy-gpu-ci/comfy-gpu-ci/test_workspaces/Sharp-2000/ComfyUI/custom_nodes/ComfyUI-Sharp/nodes/sharp/model.py", line 860 in forward [13:12] [ComfyUI] File "/home/runner/.ce/.pixi/envs/sharp-nodes/lib/python3.10/site-packages/torch/nn/modules/module.py", line 1787 in _call_impl [13:12] [ComfyUI] File "/home/runner/.ce/.pixi/envs/sharp-nodes/lib/python3.10/site-packages/torch/nn/modules/module.py", line 1776 in _wrapped_call_impl [13:12] [ComfyUI] File "/home/runner/work/comfy-gpu-ci/comfy-gpu-ci/test_workspaces/Sharp-2000/ComfyUI/custom_nodes/ComfyUI-Sharp/nodes/sharp/model.py", line 970 in forward [13:12] [ComfyUI] File "/home/runner/.ce/.pixi/envs/sharp-nodes/lib/python3.10/site-packages/torch/nn/modules/module.py", line 1787 in _call_impl [13:12] [ComfyUI] File "/home/runner/.ce/.pixi/envs/sharp-nodes/lib/python3.10/site-packages/torch/nn/modules/module.py", line 1776 in _wrapped_call_impl [13:12] [ComfyUI] File "/home/runner/work/comfy-gpu-ci/comfy-gpu-ci/test_workspaces/Sharp-2000/ComfyUI/custom_nodes/ComfyUI-Sharp/nodes/sharp/model.py", line 1118 in forward [13:12] [ComfyUI] File "/home/runner/.ce/.pixi/envs/sharp-nodes/lib/python3.10/site-packages/torch/nn/modules/module.py", line 1787 in _call_impl [13:12] [ComfyUI] File "/home/runner/.ce/.pixi/envs/sharp-nodes/lib/python3.10/site-packages/torch/nn/modules/module.py", line 1776 in _wrapped_call_impl [13:12] [ComfyUI] File "/home/runner/work/comfy-gpu-ci/comfy-gpu-ci/test_workspaces/Sharp-2000/ComfyUI/custom_nodes/ComfyUI-Sharp/nodes/sharp/model.py", line 2006 in encode [13:12] [ComfyUI] File "/home/runner/work/comfy-gpu-ci/comfy-gpu-ci/test_workspaces/Sharp-2000/ComfyUI/custom_nodes/ComfyUI-Sharp/nodes/predict.py", line 348 in _predict_image_cached [13:12] [ComfyUI] File "/home/runner/work/comfy-gpu-ci/comfy-gpu-ci/test_workspaces/Sharp-2000/ComfyUI/custom_nodes/ComfyUI-Sharp/nodes/predict.py", line 239 in execute [13:12] [ComfyUI] File "/home/runner/.ce/.pixi/envs/sharp-nodes/lib/python3.10/site-packages/torch/utils/_contextlib.py", line 124 in decorate_context [13:12] [ComfyUI] File "/home/runner/work/comfy-gpu-ci/comfy-gpu-ci/test_workspaces/Sharp-2000/ComfyUI/comfy_api/latest/_io.py", line 1892 in EXECUTE_NORMALIZED [13:12] [ComfyUI] File "/tmp/comfyui_pvenv_r05k2fkl/persistent_worker.py", line 1762 in main [13:12] [ComfyUI] File "/tmp/comfyui_pvenv_r05k2fkl/persistent_worker.py", line 1807 in [13:12] [ComfyUI] [13:12] [ComfyUI] [worker:ComfyUI-Sharp] === END === [13:12] [ComfyUI] [13:15] [capture-loop] iter=2200 t=243.2s state={'complete': False, 'error': None, 'executedCount': 0, 'wsState': 1} eval_ms=2 ram=9.4/15.6GB (60%) swap=0.0/3.0GB (0%) cpu=42% browser_rss=0.89GB [13:21] [capture-loop] iter=2250 t=248.8s state={'complete': False, 'error': None, 'executedCount': 0, 'wsState': 1} eval_ms=5 ram=9.4/15.6GB (60%) swap=0.0/3.0GB (0%) cpu=46% browser_rss=0.88GB [13:26] [capture-loop] iter=2300 t=254.3s state={'complete': False, 'error': None, 'executedCount': 0, 'wsState': 1} eval_ms=2 ram=8.3/15.6GB (53%) swap=0.0/3.0GB (0%) cpu=43% browser_rss=0.88GB [13:32] [capture-loop] iter=2350 t=259.8s state={'complete': False, 'error': None, 'executedCount': 0, 'wsState': 1} eval_ms=2 ram=7.5/15.6GB (48%) swap=0.0/3.0GB (0%) cpu=44% browser_rss=0.89GB [13:37] [capture-loop] iter=2400 t=265.3s state={'complete': False, 'error': None, 'executedCount': 0, 'wsState': 1} eval_ms=2 ram=9.1/15.6GB (58%) swap=0.0/3.0GB (0%) cpu=44% browser_rss=0.85GB [13:43] [capture-loop] iter=2450 t=270.9s state={'complete': False, 'error': None, 'executedCount': 0, 'wsState': 1} eval_ms=3 ram=7.2/15.6GB (46%) swap=0.0/3.0GB (0%) cpu=43% browser_rss=0.86GB [13:48] [capture-loop] iter=2500 t=276.3s state={'complete': False, 'error': None, 'executedCount': 0, 'wsState': 1} eval_ms=3 ram=7.7/15.6GB (49%) swap=0.0/3.0GB (0%) cpu=42% browser_rss=0.86GB [13:54] [capture-loop] iter=2550 t=281.9s state={'complete': False, 'error': None, 'executedCount': 0, 'wsState': 1} eval_ms=2 ram=8.6/15.6GB (55%) swap=0.0/3.0GB (0%) cpu=44% browser_rss=0.85GB [13:59] [capture-loop] iter=2600 t=287.4s state={'complete': False, 'error': None, 'executedCount': 0, 'wsState': 1} eval_ms=2 ram=8.1/15.6GB (52%) swap=0.0/3.0GB (0%) cpu=44% browser_rss=0.86GB [14:05] [capture-loop] iter=2650 t=293.0s state={'complete': False, 'error': None, 'executedCount': 0, 'wsState': 1} eval_ms=2 ram=8.1/15.6GB (52%) swap=0.0/3.0GB (0%) cpu=43% browser_rss=0.86GB [14:10] [capture-loop] iter=2700 t=298.5s state={'complete': False, 'error': None, 'executedCount': 0, 'wsState': 1} eval_ms=2 ram=7.9/15.6GB (50%) swap=0.0/3.0GB (0%) cpu=43% browser_rss=0.86GB [14:12] [ComfyUI] [worker:ComfyUI-Sharp] [14:12] [ComfyUI] === WATCHDOG TICK 5 === [14:12] [ComfyUI] [worker:ComfyUI-Sharp] Thread 0x00007f129140e6c0 (most recent call first): [14:12] [ComfyUI] File "/home/runner/.ce/.pixi/envs/sharp-nodes/lib/python3.10/socket.py", line 293 in accept [14:12] [ComfyUI] File "/home/runner/.ce/.pixi/envs/sharp-nodes/lib/python3.10/multiprocessing/connection.py", line 609 in accept [14:12] [ComfyUI] File "/home/runner/.ce/.pixi/envs/sharp-nodes/lib/python3.10/multiprocessing/connection.py", line 463 in accept [14:12] [ComfyUI] File "/home/runner/.ce/.pixi/envs/sharp-nodes/lib/python3.10/multiprocessing/resource_sharer.py", line 138 in _serve [14:12] [ComfyUI] File "/home/runner/.ce/.pixi/envs/sharp-nodes/lib/python3.10/threading.py", line 953 in run [14:12] [ComfyUI] File "/home/runner/.ce/.pixi/envs/sharp-nodes/lib/python3.10/threading.py", line 1016 in _bootstrap_inner [14:12] [ComfyUI] File "/home/runner/.ce/.pixi/envs/sharp-nodes/lib/python3.10/threading.py", line 973 in _bootstrap [14:12] [ComfyUI] [14:12] [ComfyUI] Current thread 0x00007f129240f6c0 (most recent call first): [14:12] [ComfyUI] File "/tmp/comfyui_pvenv_r05k2fkl/persistent_worker.py", line 52 in _watchdog [14:12] [ComfyUI] File "/home/runner/.ce/.pixi/envs/sharp-nodes/lib/python3.10/threading.py", line 953 in run [14:12] [ComfyUI] File "/home/runner/.ce/.pixi/envs/sharp-nodes/lib/python3.10/threading.py", line 1016 in _bootstrap_inner [14:12] [ComfyUI] File "/home/runner/.ce/.pixi/envs/sharp-nodes/lib/python3.10/threading.py", line 973 in _bootstrap [14:12] [ComfyUI] [14:12] [ComfyUI] Thread 0x00007f1292eed740 (most recent call first): [14:12] [ComfyUI] File "/home/runner/.ce/.pixi/envs/sharp-nodes/lib/python3.10/site-packages/torch/nn/modules/conv.py", line 548 in _conv_forward [14:12] [ComfyUI] File "/home/runner/.ce/.pixi/envs/sharp-nodes/lib/python3.10/site-packages/torch/nn/modules/conv.py", line 553 in forward [14:12] [ComfyUI] File "/home/runner/work/comfy-gpu-ci/comfy-gpu-ci/test_workspaces/Sharp-2000/ComfyUI/comfy/ops.py", line 537 in forward [14:12] [ComfyUI] File "/home/runner/.ce/.pixi/envs/sharp-nodes/lib/python3.10/site-packages/torch/nn/modules/module.py", line 1787 in _call_impl [14:12] [ComfyUI] File "/home/runner/.ce/.pixi/envs/sharp-nodes/lib/python3.10/site-packages/torch/nn/modules/module.py", line 1776 in _wrapped_call_impl [14:12] [ComfyUI] File "/home/runner/.ce/.pixi/envs/sharp-nodes/lib/python3.10/site-packages/torch/nn/modules/container.py", line 253 in forward [14:12] [ComfyUI] File "/home/runner/.ce/.pixi/envs/sharp-nodes/lib/python3.10/site-packages/torch/nn/modules/module.py", line 1787 in _call_impl [14:12] [ComfyUI] File "/home/runner/.ce/.pixi/envs/sharp-nodes/lib/python3.10/site-packages/torch/nn/modules/module.py", line 1776 in _wrapped_call_impl [14:12] [ComfyUI] File "/home/runner/work/comfy-gpu-ci/comfy-gpu-ci/test_workspaces/Sharp-2000/ComfyUI/custom_nodes/ComfyUI-Sharp/nodes/sharp/model.py", line 766 in forward [14:12] [ComfyUI] File "/home/runner/.ce/.pixi/envs/sharp-nodes/lib/python3.10/site-packages/torch/nn/modules/module.py", line 1787 in _call_impl [14:12] [ComfyUI] File "/home/runner/.ce/.pixi/envs/sharp-nodes/lib/python3.10/site-packages/torch/nn/modules/module.py", line 1776 in _wrapped_call_impl [14:12] [ComfyUI] File "/home/runner/.ce/.pixi/envs/sharp-nodes/lib/python3.10/site-packages/torch/nn/modules/container.py", line 253 in forward [14:12] [ComfyUI] File "/home/runner/.ce/.pixi/envs/sharp-nodes/lib/python3.10/site-packages/torch/nn/modules/module.py", line 1787 in _call_impl [14:12] [ComfyUI] File "/home/runner/.ce/.pixi/envs/sharp-nodes/lib/python3.10/site-packages/torch/nn/modules/module.py", line 1776 in _wrapped_call_impl [14:12] [ComfyUI] File "/home/runner/work/comfy-gpu-ci/comfy-gpu-ci/test_workspaces/Sharp-2000/ComfyUI/custom_nodes/ComfyUI-Sharp/nodes/sharp/model.py", line 1355 in forward [14:12] [ComfyUI] File "/home/runner/.ce/.pixi/envs/sharp-nodes/lib/python3.10/site-packages/torch/nn/modules/module.py", line 1787 in _call_impl [14:12] [ComfyUI] File "/home/runner/.ce/.pixi/envs/sharp-nodes/lib/python3.10/site-packages/torch/nn/modules/module.py", line 1776 in _wrapped_call_impl [14:12] [ComfyUI] File "/home/runner/work/comfy-gpu-ci/comfy-gpu-ci/test_workspaces/Sharp-2000/ComfyUI/custom_nodes/ComfyUI-Sharp/nodes/sharp/model.py", line 2030 in decode [14:12] [ComfyUI] File "/home/runner/work/comfy-gpu-ci/comfy-gpu-ci/test_workspaces/Sharp-2000/ComfyUI/custom_nodes/ComfyUI-Sharp/nodes/predict.py", line 379 in _predict_image_cached [14:12] [ComfyUI] File "/home/runner/work/comfy-gpu-ci/comfy-gpu-ci/test_workspaces/Sharp-2000/ComfyUI/custom_nodes/ComfyUI-Sharp/nodes/predict.py", line 239 in execute [14:12] [ComfyUI] File "/home/runner/.ce/.pixi/envs/sharp-nodes/lib/python3.10/site-packages/torch/utils/_contextlib.py", line 124 in decorate_context [14:12] [ComfyUI] File "/home/runner/work/comfy-gpu-ci/comfy-gpu-ci/test_workspaces/Sharp-2000/ComfyUI/comfy_api/latest/_io.py", line 1892 in EXECUTE_NORMALIZED [14:12] [ComfyUI] File "/tmp/comfyui_pvenv_r05k2fkl/persistent_worker.py", line 1762 in main [14:12] [ComfyUI] File "/tmp/comfyui_pvenv_r05k2fkl/persistent_worker.py", line 1807 in [14:12] [ComfyUI] [14:12] [ComfyUI] [worker:ComfyUI-Sharp] === END === [14:12] [ComfyUI] [14:16] [capture-loop] iter=2750 t=304.0s state={'complete': False, 'error': None, 'executedCount': 0, 'wsState': 1} eval_ms=2 ram=7.0/15.6GB (45%) swap=0.0/3.0GB (0%) cpu=43% browser_rss=0.86GB [14:19] [ComfyUI] [SubprocessWorker] callback 'report_progress' from call_id=5 [14:20] [ComfyUI] [SubprocessWorker] got response: ok [14:20] [ComfyUI] [comfy-env] SharpPredict done (305.54s): result: NodeOutput [14:20] [ComfyUI] [comfy-env] Running PreviewGaussianSharp: ply_path: '/home/runner/work/comfy-gpu-ci/comfy-gpu-ci/test_workspa..., extrinsics: list[4], intrinsics: list[3] [14:20] [ComfyUI] [SubprocessWorker] call_method: nodes.preview_gaussian_sharp.PreviewGaussianSharp.EXECUTE_NORMALIZED [14:20] [ComfyUI] [SubprocessWorker] acquired lock, ensuring started... [14:20] [ComfyUI] [ComfyUI-GaussianPack] Health check: ping (timeout=5.0s)... [14:20] [ComfyUI] [ComfyUI-GaussianPack] Health check: failed [14:20] [ComfyUI] [ComfyUI-GaussianPack] Socket unhealthy, restarting worker... [14:20] [ComfyUI] [ComfyUI-GaussianPack] python: /home/runner/.ce/.pixi/envs/gaussianpack-nodes/bin/python [14:20] [ComfyUI] [ComfyUI-GaussianPack] sys_path sent to worker: ['/home/runner/work/comfy-gpu-ci/comfy-gpu-ci/test_workspaces/Sharp-2000/ComfyUI', '/home/runner/work/comfy-gpu-ci/comfy-gpu-ci/test_workspaces/Sharp-2000/ComfyUI/custom_nodes/ComfyUI-GaussianPack', '/home/runner/.ce/.pixi/envs/gaussianpack-nodes/lib/python3.10/site-packages', '/home/runner/work/comfy-gpu-ci/comfy-gpu-ci/test_workspaces/Sharp-2000/ComfyUI/custom_nodes/ComfyUI-GaussianPack'] [14:20] [ComfyUI] [SubprocessWorker] is_pixi=True, python=/home/runner/.ce/.pixi/envs/gaussianpack-nodes/bin/python [14:20] [ComfyUI] [SubprocessWorker] launching cmd=['/home/runner/.pixi/bin/pixi', 'run', '--as-is', '--manifest-path', '/home/runner/.ce/pixi.toml', '-e', 'gaussianpack-nodes', 'python', '/tmp/comfyui_pvenv_g6q6yfx2/persistent_worker.py', 'abstract://comfy_worker_44709a1e3f17']... [14:20] [ComfyUI] [SubprocessWorker] socket_addr=abstract://comfy_worker_44709a1e3f17 (abstract, no filesystem path) [14:21] [ComfyUI] [SubprocessWorker] worker started/confirmed [14:21] [ComfyUI] [SubprocessWorker] serializing kwargs to shm... [14:21] [ComfyUI] [SubprocessWorker] created 0 shm blocks [14:21] [ComfyUI] [SubprocessWorker] sending request via socket... [14:21] [ComfyUI] [SubprocessWorker] call_id=2 sending call_method [14:21] [ComfyUI] [worker:ComfyUI-GaussianPack] WARNING: SPZ route not registered (ModuleNotFoundError: No module named 'comfy_aimdo') [14:21] [ComfyUI] [SubprocessWorker] got response: ok [14:21] [ComfyUI] [comfy-env] PreviewGaussianSharp done (1.63s): result: NodeOutput [14:21] [ComfyUI] [INFO] Prompt executed in 309.22 seconds [14:21] [capture-loop] iter=2800 t=309.5s state={'complete': False, 'error': None, 'executedCount': 1, 'wsState': 1} eval_ms=2 ram=6.7/15.6GB (43%) swap=0.0/3.0GB (0%) cpu=44% browser_rss=0.86GB [14:21] Node executed (1 total), capturing... [14:22] Frame 4 saved (frame_003.jpg, t=309.7s) [14:22] [capture-node] freeze=3ms shot=154ms unfreeze=24ms saved=True [14:23] Execution complete (t=310.7s) [14:23] [3d-wait] Phase 1: Waiting for 'Loading 3D Model' text to disappear... [14:23] [3d-wait] Phase 1 done in 0.0s [14:23] [3d-wait] Phase 2: iframes=1 [14:23] [3d-wait] iframe viewer_ready=True (matched 1 console logs) [14:23] [3d-wait] Unfrozen in 0.005s, rendering for 5s... [14:33] [3d-wait] JS halted via CDP after 10.5s [15:04] [3d-wait] Re-frozen in 41.7s [15:04] [3d-wait] Total 3D wait: 41.8s [15:04] Captured 4 unique frames over 352.69s [15:05] [debug] iframes: 1 [15:05] [debug] iframe[0]: src=http://127.0.0.1:41882/extensions/ComfyUI-GaussianPack/viewer_gaussian_sharp.htm, canvas=1520x1011, rafFrozen=True [15:05] [timing] trigger_3d_previews: 0.0s [15:07] Saved high-quality screenshot: sharp_exif_executed.png [15:07] [timing] final_screenshot: 0.3s [15:07] [ComfyUI] [INFO] Using RAM pressure cache. [15:07] Capturing execution frames: vanilla_vs_image_depth_gaussians.json [15:07] [ComfyUI] [INFO] Using RAM pressure cache. [15:13] Frame 1 saved (frame_000.jpg, t=0.0s) [15:13] Validating workflow... [15:13] [ComfyUI] [INFO] === /validate endpoint called === [15:13] [ComfyUI] [INFO] Received JSON with keys: ['prompt'] [15:13] [ComfyUI] [INFO] Prompt has 8 nodes [15:13] [ComfyUI] [INFO] Node 7: LoadImage [15:13] [ComfyUI] [INFO] Inputs: {"image": "middlebury.jpg"} [15:13] [ComfyUI] [INFO] Node 9: LoadSharpModel [15:13] [ComfyUI] [INFO] Inputs: {"precision": "auto"} [15:13] [ComfyUI] [INFO] Node 47: SharpPredictMetricDepth [15:13] [ComfyUI] [INFO] Inputs: {"focal_length_mm": 30, "model": ["9", 0], "image": ["7", 0]} [15:13] [ComfyUI] [INFO] Node 57: SharpPredict [15:13] [ComfyUI] [INFO] Inputs: {"focal_length_mm": 30, "output_prefix": "sharp", "model": ["9", 0], "image": ["58", 0]} [15:13] Queuing workflow for execution... [15:13] [ComfyUI] [INFO] Node 58: ImageFromBatch [15:13] [ComfyUI] [INFO] Inputs: {"batch_index": 0, "length": 1, "image": ["7", 0]} [15:13] [ComfyUI] [INFO] Node 83: SharpPredictGaussiansFromMetricDepth [15:13] [ComfyUI] [INFO] Inputs: {"snap_to_external_depth": "none", "depth_convention": "planar_z", "focal_length_mm": 30, "output_prefix": "sharp_aligned", "save_background_layer": true, "edge_crop": 0, "model": ["9", 0], "image": [ [15:13] [ComfyUI] [INFO] Node 92: PreviewGaussianSharp [15:13] [ComfyUI] [INFO] Inputs: {"preview_gaussian": "", "ply_path": ["83", 0], "extrinsics": ["83", 2], "intrinsics": ["83", 3]} [15:13] [ComfyUI] [INFO] Node 93: PreviewGaussianSharp [15:13] [ComfyUI] [INFO] Inputs: {"preview_gaussian": "", "ply_path": ["57", 0], "extrinsics": ["57", 1], "intrinsics": ["57", 2]} [15:13] [ComfyUI] [INFO] Generated prompt_id: 23f5ed20-2840-443f-af28-3c4ae1f8661b [15:13] [ComfyUI] [INFO] Calling execution.validate_prompt()... [15:13] [ComfyUI] [INFO] Validation result: valid=True [15:13] [ComfyUI] [INFO] === Validation PASSED === [15:13] [ComfyUI] [INFO] got prompt [15:14] [ComfyUI] [comfy-env] Running LoadSharpModel: precision: 'auto' [15:14] [ComfyUI] [SubprocessWorker] call_method: nodes.load_model.LoadSharpModel.EXECUTE_NORMALIZED [15:14] [ComfyUI] [SubprocessWorker] acquired lock, ensuring started... [15:14] [ComfyUI] [ComfyUI-Sharp] Health check: ping (timeout=5.0s)... [15:14] [ComfyUI] [ComfyUI-Sharp] python: /home/runner/.ce/.pixi/envs/sharp-nodes/bin/python [15:14] [ComfyUI] [ComfyUI-Sharp] sys_path sent to worker: ['/home/runner/work/comfy-gpu-ci/comfy-gpu-ci/test_workspaces/Sharp-2000/ComfyUI', '/home/runner/work/comfy-gpu-ci/comfy-gpu-ci/test_workspaces/Sharp-2000/ComfyUI/custom_nodes/ComfyUI-Sharp', '/home/runner/.ce/.pixi/envs/sharp-nodes/lib/python3.10/site-packages', '/home/runner/work/comfy-gpu-ci/comfy-gpu-ci/test_workspaces/Sharp-2000/ComfyUI/custom_nodes/ComfyUI-Sharp'] [15:14] [ComfyUI] [SubprocessWorker] is_pixi=True, python=/home/runner/.ce/.pixi/envs/sharp-nodes/bin/python [15:14] [ComfyUI] [ComfyUI-Sharp] Health check: failed [15:14] [ComfyUI] [SubprocessWorker] launching cmd=['/home/runner/.pixi/bin/pixi', 'run', '--as-is', '--manifest-path', '/home/runner/.ce/pixi.toml', '-e', 'sharp-nodes', 'python', '/tmp/comfyui_pvenv_r05k2fkl/persistent_worker.py', 'abstract://comfy_worker_df5d7e093fa1']... [15:14] [ComfyUI] [SubprocessWorker] socket_addr=abstract://comfy_worker_df5d7e093fa1 (abstract, no filesystem path) [15:14] [ComfyUI] [ComfyUI-Sharp] Socket unhealthy, restarting worker... [15:15] [ComfyUI] [worker:ComfyUI-Sharp] ERROR: Failed to import comfy_kitchen, Error: No module named 'comfy_kitchen', fp8 and fp4 support will not be available. [15:15] [ComfyUI] [worker:ComfyUI-Sharp] WARNING: comfy_kitchen does not support stochastic FP8 rounding, please update comfy_kitchen. [15:15] [ComfyUI] [SubprocessWorker] worker started/confirmed [15:15] [ComfyUI] [SubprocessWorker] serializing kwargs to shm... [15:15] [ComfyUI] [SubprocessWorker] created 0 shm blocks [15:15] [ComfyUI] [SubprocessWorker] sending request via socket... [15:15] [ComfyUI] [SubprocessWorker] call_id=6 sending call_method [15:15] [ComfyUI] [worker:ComfyUI-Sharp] [LoadSharpModel] precision='auto' -> dtype=fp32 (device=cpu) [15:15] [ComfyUI] [worker:ComfyUI-Sharp] [LoadSharpModel] checkpoint already present, reusing (no download): /home/runner/work/comfy-gpu-ci/comfy-gpu-ci/test_workspaces/Sharp-2000/ComfyUI/models/sharp/sharp_2572gikvuh.pt (2679.6 MB) [15:15] [ComfyUI] [worker:ComfyUI-Sharp] [LoadSharpModel] checkpoint ready: /home/runner/work/comfy-gpu-ci/comfy-gpu-ci/test_workspaces/Sharp-2000/ComfyUI/models/sharp/sharp_2572gikvuh.pt (2679.6 MB) [15:15] [ComfyUI] [worker:ComfyUI-Sharp] [LoadSharpModel] config: precision=auto -> dtype=fp32 [15:15] [ComfyUI] [SubprocessWorker] got response: ok [15:15] [ComfyUI] [comfy-env] LoadSharpModel done (1.76s): result: NodeOutput [15:15] [ComfyUI] [comfy-env] Running SharpPredict: focal_length_mm: 30.0, output_prefix: 'sharp', model: dict, image: torch.float32 [1,960,1416,3] cpu [15:15] [ComfyUI] [SubprocessWorker] call_method: nodes.predict.SharpPredict.EXECUTE_NORMALIZED [15:15] [ComfyUI] [SubprocessWorker] acquired lock, ensuring started... [15:15] [ComfyUI] [ComfyUI-Sharp] Health check: ping (timeout=5.0s)... [15:15] [ComfyUI] [ComfyUI-Sharp] Health check: ok [15:15] [ComfyUI] [SubprocessWorker] worker started/confirmed [15:15] [ComfyUI] [comfy-env] PRE-SERIALIZE 'image' shape: torch.Size([1, 960, 1416, 3]) [15:15] [ComfyUI] [SubprocessWorker] serializing kwargs to shm... [15:15] [ComfyUI] [SubprocessWorker] created 0 shm blocks [15:15] [ComfyUI] [SubprocessWorker] sending request via socket... [15:15] [ComfyUI] [SubprocessWorker] call_id=7 sending call_method [15:15] [ComfyUI] [worker:ComfyUI-Sharp] [comfy-env] _from_shm got dict with keys: ['__type__', 'strategy', 'parent_pid', 'fd', 'storage_size'] [15:15] [ComfyUI] [worker:ComfyUI-Sharp] [comfy-env] DESERIALIZE TensorRef: tensor_size=[1, 960, 1416, 3] [15:15] [ComfyUI] [worker:ComfyUI-Sharp] [comfy-env] DESERIALIZED tensor shape: torch.Size([1, 960, 1416, 3]) [15:16] Frame 2 saved (frame_001.jpg, t=2.2s) [15:16] [capture-periodic] freeze=13ms shot=139ms unfreeze=2ms saved=True [15:17] [ComfyUI] [worker:ComfyUI-Sharp] [LoadSharpModel] loading checkpoint from /home/runner/work/comfy-gpu-ci/comfy-gpu-ci/test_workspaces/Sharp-2000/ComfyUI/models/sharp/sharp_2572gikvuh.pt (dtype=fp32) [15:18] Frame 3 saved (frame_002.jpg, t=4.5s) [15:18] [capture-periodic] freeze=2ms shot=125ms unfreeze=2ms saved=True [15:19] [capture-loop] iter=50 t=5.7s state={'complete': False, 'error': None, 'executedCount': 0, 'wsState': 1} eval_ms=2 ram=4.2/15.6GB (27%) swap=0.0/3.0GB (0%) cpu=79% browser_rss=0.98GB [15:21] [ComfyUI] [worker:ComfyUI-Sharp] [LoadSharpModel] initializing model on meta device... [15:21] [ComfyUI] [worker:ComfyUI-Sharp] [LoadSharpModel] model ready (torch.float32) [15:21] [ComfyUI] [SubprocessWorker] callback 'request_vram_budget' from call_id=7 [15:21] [ComfyUI] [comfy-env] VRAM request: 2.81GB, free before eviction: 11.23GB [15:21] [ComfyUI] [comfy-env] VRAM after eviction: 11.23GB [15:24] [capture-loop] iter=100 t=11.2s state={'complete': False, 'error': None, 'executedCount': 0, 'wsState': 1} eval_ms=2 ram=5.4/15.6GB (35%) swap=0.0/3.0GB (0%) cpu=38% browser_rss=0.98GB [15:30] [capture-loop] iter=150 t=16.8s state={'complete': False, 'error': None, 'executedCount': 0, 'wsState': 1} eval_ms=2 ram=5.5/15.6GB (35%) swap=0.0/3.0GB (0%) cpu=46% browser_rss=0.98GB [15:36] [capture-loop] iter=200 t=22.3s state={'complete': False, 'error': None, 'executedCount': 0, 'wsState': 1} eval_ms=7 ram=5.5/15.6GB (36%) swap=0.0/3.0GB (0%) cpu=47% browser_rss=0.98GB [15:41] [capture-loop] iter=250 t=28.0s state={'complete': False, 'error': None, 'executedCount': 0, 'wsState': 1} eval_ms=2 ram=5.4/15.6GB (34%) swap=0.0/3.0GB (0%) cpu=49% browser_rss=0.90GB [15:47] [capture-loop] iter=300 t=33.6s state={'complete': False, 'error': None, 'executedCount': 0, 'wsState': 1} eval_ms=2 ram=5.5/15.6GB (35%) swap=0.0/3.0GB (0%) cpu=46% browser_rss=0.90GB [15:52] [capture-loop] iter=350 t=39.0s state={'complete': False, 'error': None, 'executedCount': 0, 'wsState': 1} eval_ms=2 ram=5.5/15.6GB (35%) swap=0.0/3.0GB (0%) cpu=46% browser_rss=0.91GB [15:58] [capture-loop] iter=400 t=44.6s state={'complete': False, 'error': None, 'executedCount': 0, 'wsState': 1} eval_ms=2 ram=5.6/15.6GB (36%) swap=0.0/3.0GB (0%) cpu=45% browser_rss=0.91GB [16:03] [capture-loop] iter=450 t=50.1s state={'complete': False, 'error': None, 'executedCount': 0, 'wsState': 1} eval_ms=2 ram=5.6/15.6GB (36%) swap=0.0/3.0GB (0%) cpu=45% browser_rss=0.91GB [16:09] [capture-loop] iter=500 t=55.7s state={'complete': False, 'error': None, 'executedCount': 0, 'wsState': 1} eval_ms=2 ram=5.5/15.6GB (35%) swap=0.0/3.0GB (0%) cpu=45% browser_rss=0.91GB [16:14] [ComfyUI] [worker:ComfyUI-Sharp] [16:14] [ComfyUI] === WATCHDOG TICK 1 === [16:14] [ComfyUI] [worker:ComfyUI-Sharp] Current thread 0x00007fd6d0ea76c0 (most recent call first): [16:14] [ComfyUI] File "/tmp/comfyui_pvenv_r05k2fkl/persistent_worker.py", line 52 in _watchdog [16:14] [ComfyUI] File "/home/runner/.ce/.pixi/envs/sharp-nodes/lib/python3.10/threading.py", line 953 in run [16:14] [ComfyUI] File "/home/runner/.ce/.pixi/envs/sharp-nodes/lib/python3.10/threading.py", line 1016 in _bootstrap_inner [16:14] [ComfyUI] File "/home/runner/.ce/.pixi/envs/sharp-nodes/lib/python3.10/threading.py", line 973 in _bootstrap [16:14] [ComfyUI] [16:14] [ComfyUI] Thread 0x00007fd6d197a740 (most recent call first): [16:14] [ComfyUI] File "/home/runner/.ce/.pixi/envs/sharp-nodes/lib/python3.10/site-packages/torch/nn/modules/linear.py", line 134 in forward [16:14] [ComfyUI] File "/home/runner/work/comfy-gpu-ci/comfy-gpu-ci/test_workspaces/Sharp-2000/ComfyUI/comfy/ops.py", line 503 in forward [16:14] [ComfyUI] File "/home/runner/.ce/.pixi/envs/sharp-nodes/lib/python3.10/site-packages/torch/nn/modules/module.py", line 1787 in _call_impl [16:14] [ComfyUI] File "/home/runner/.ce/.pixi/envs/sharp-nodes/lib/python3.10/site-packages/torch/nn/modules/module.py", line 1776 in _wrapped_call_impl [16:14] [ComfyUI] File "/home/runner/work/comfy-gpu-ci/comfy-gpu-ci/test_workspaces/Sharp-2000/ComfyUI/custom_nodes/ComfyUI-Sharp/nodes/sharp/model.py", line 232 in forward [16:14] [ComfyUI] File "/home/runner/.ce/.pixi/envs/sharp-nodes/lib/python3.10/site-packages/torch/nn/modules/module.py", line 1787 in _call_impl [16:14] [ComfyUI] File "/home/runner/.ce/.pixi/envs/sharp-nodes/lib/python3.10/site-packages/torch/nn/modules/module.py", line 1776 in _wrapped_call_impl [16:14] [ComfyUI] File "/home/runner/work/comfy-gpu-ci/comfy-gpu-ci/test_workspaces/Sharp-2000/ComfyUI/custom_nodes/ComfyUI-Sharp/nodes/sharp/model.py", line 309 in forward [16:14] [ComfyUI] File "/home/runner/.ce/.pixi/envs/sharp-nodes/lib/python3.10/site-packages/torch/nn/modules/module.py", line 1787 in _call_impl [16:14] [ComfyUI] File "/home/runner/.ce/.pixi/envs/sharp-nodes/lib/python3.10/site-packages/torch/nn/modules/module.py", line 1776 in _wrapped_call_impl [16:14] [ComfyUI] File "/home/runner/work/comfy-gpu-ci/comfy-gpu-ci/test_workspaces/Sharp-2000/ComfyUI/custom_nodes/ComfyUI-Sharp/nodes/sharp/model.py", line 412 in forward [16:14] [ComfyUI] File "/home/runner/.ce/.pixi/envs/sharp-nodes/lib/python3.10/site-packages/torch/nn/modules/module.py", line 1787 in _call_impl [16:14] [ComfyUI] File "/home/runner/.ce/.pixi/envs/sharp-nodes/lib/python3.10/site-packages/torch/nn/modules/module.py", line 1776 in _wrapped_call_impl [16:14] [ComfyUI] File "/home/runner/work/comfy-gpu-ci/comfy-gpu-ci/test_workspaces/Sharp-2000/ComfyUI/custom_nodes/ComfyUI-Sharp/nodes/sharp/model.py", line 685 in forward [16:14] [ComfyUI] File "/home/runner/.ce/.pixi/envs/sharp-nodes/lib/python3.10/site-packages/torch/nn/modules/module.py", line 1787 in _call_impl [16:14] [ComfyUI] File "/home/runner/.ce/.pixi/envs/sharp-nodes/lib/python3.10/site-packages/torch/nn/modules/module.py", line 1776 in _wrapped_call_impl [16:14] [ComfyUI] File "/home/runner/work/comfy-gpu-ci/comfy-gpu-ci/test_workspaces/Sharp-2000/ComfyUI/custom_nodes/ComfyUI-Sharp/nodes/sharp/model.py", line 1109 in forward [16:14] [ComfyUI] File "/home/runner/.ce/.pixi/envs/sharp-nodes/lib/python3.10/site-packages/torch/nn/modules/module.py", line 1787 in _call_impl [16:14] [ComfyUI] File "/home/runner/.ce/.pixi/envs/sharp-nodes/lib/python3.10/site-packages/torch/nn/modules/module.py", line 1776 in _wrapped_call_impl [16:14] [ComfyUI] File "/home/runner/work/comfy-gpu-ci/comfy-gpu-ci/test_workspaces/Sharp-2000/ComfyUI/custom_nodes/ComfyUI-Sharp/nodes/sharp/model.py", line 2006 in encode [16:14] [ComfyUI] File "/home/runner/work/comfy-gpu-ci/comfy-gpu-ci/test_workspaces/Sharp-2000/ComfyUI/custom_nodes/ComfyUI-Sharp/nodes/predict.py", line 348 in _predict_image_cached [16:14] [ComfyUI] File "/home/runner/work/comfy-gpu-ci/comfy-gpu-ci/test_workspaces/Sharp-2000/ComfyUI/custom_nodes/ComfyUI-Sharp/nodes/predict.py", line 239 in execute [16:14] [ComfyUI] File "/home/runner/.ce/.pixi/envs/sharp-nodes/lib/python3.10/site-packages/torch/utils/_contextlib.py", line 124 in decorate_context [16:14] [ComfyUI] File "/home/runner/work/comfy-gpu-ci/comfy-gpu-ci/test_workspaces/Sharp-2000/ComfyUI/comfy_api/latest/_io.py", line 1892 in EXECUTE_NORMALIZED [16:14] [ComfyUI] File "/tmp/comfyui_pvenv_r05k2fkl/persistent_worker.py", line 1762 in main [16:14] [ComfyUI] File "/tmp/comfyui_pvenv_r05k2fkl/persistent_worker.py", line 1807 in [16:14] [ComfyUI] [16:14] [ComfyUI] [worker:ComfyUI-Sharp] === END === [16:14] [ComfyUI] [16:14] [capture-loop] iter=550 t=61.2s state={'complete': False, 'error': None, 'executedCount': 0, 'wsState': 1} eval_ms=4 ram=5.6/15.6GB (36%) swap=0.0/3.0GB (0%) cpu=48% browser_rss=0.92GB [16:20] [capture-loop] iter=600 t=66.7s state={'complete': False, 'error': None, 'executedCount': 0, 'wsState': 1} eval_ms=3 ram=5.6/15.6GB (36%) swap=0.0/3.0GB (0%) cpu=46% browser_rss=0.90GB [16:26] [capture-loop] iter=650 t=72.2s state={'complete': False, 'error': None, 'executedCount': 0, 'wsState': 1} eval_ms=2 ram=5.6/15.6GB (36%) swap=0.0/3.0GB (0%) cpu=46% browser_rss=0.90GB [16:31] [capture-loop] iter=700 t=77.8s state={'complete': False, 'error': None, 'executedCount': 0, 'wsState': 1} eval_ms=2 ram=5.6/15.6GB (36%) swap=0.0/3.0GB (0%) cpu=48% browser_rss=0.90GB [16:37] [capture-loop] iter=750 t=83.3s state={'complete': False, 'error': None, 'executedCount': 0, 'wsState': 1} eval_ms=7 ram=5.5/15.6GB (35%) swap=0.0/3.0GB (0%) cpu=47% browser_rss=0.90GB [16:42] [capture-loop] iter=800 t=89.0s state={'complete': False, 'error': None, 'executedCount': 0, 'wsState': 1} eval_ms=2 ram=5.5/15.6GB (36%) swap=0.0/3.0GB (0%) cpu=47% browser_rss=0.91GB [16:48] [capture-loop] iter=850 t=94.4s state={'complete': False, 'error': None, 'executedCount': 0, 'wsState': 1} eval_ms=2 ram=5.6/15.6GB (36%) swap=0.0/3.0GB (0%) cpu=46% browser_rss=0.91GB [16:53] [capture-loop] iter=900 t=100.0s state={'complete': False, 'error': None, 'executedCount': 0, 'wsState': 1} eval_ms=6 ram=5.6/15.6GB (36%) swap=0.0/3.0GB (0%) cpu=47% browser_rss=0.91GB [16:59] [capture-loop] iter=950 t=105.5s state={'complete': False, 'error': None, 'executedCount': 0, 'wsState': 1} eval_ms=5 ram=5.7/15.6GB (36%) swap=0.0/3.0GB (0%) cpu=46% browser_rss=0.92GB [17:04] [capture-loop] iter=1000 t=111.1s state={'complete': False, 'error': None, 'executedCount': 0, 'wsState': 1} eval_ms=2 ram=5.6/15.6GB (36%) swap=0.0/3.0GB (0%) cpu=47% browser_rss=0.92GB [17:10] [capture-loop] iter=1050 t=116.6s state={'complete': False, 'error': None, 'executedCount': 0, 'wsState': 1} eval_ms=2 ram=5.7/15.6GB (36%) swap=0.0/3.0GB (0%) cpu=46% browser_rss=0.92GB [17:14] [ComfyUI] [worker:ComfyUI-Sharp] [17:14] [ComfyUI] === WATCHDOG TICK 2 === [17:14] [ComfyUI] [worker:ComfyUI-Sharp] Current thread 0x00007fd6d0ea76c0 (most recent call first): [17:14] [ComfyUI] File "/tmp/comfyui_pvenv_r05k2fkl/persistent_worker.py", line 52 in _watchdog [17:14] [ComfyUI] File "/home/runner/.ce/.pixi/envs/sharp-nodes/lib/python3.10/threading.py", line 953 in run [17:14] [ComfyUI] File "/home/runner/.ce/.pixi/envs/sharp-nodes/lib/python3.10/threading.py", line 1016 in _bootstrap_inner [17:14] [ComfyUI] File "/home/runner/.ce/.pixi/envs/sharp-nodes/lib/python3.10/threading.py", line 973 in _bootstrap [17:14] [ComfyUI] [17:14] [ComfyUI] Thread 0x00007fd6d197a740 (most recent call first): [17:14] [ComfyUI] File "/home/runner/work/comfy-gpu-ci/comfy-gpu-ci/test_workspaces/Sharp-2000/ComfyUI/comfy/ldm/modules/sub_quadratic_attention.py", line 159 in _get_attention_scores_no_kv_chunking [17:14] [ComfyUI] File "/home/runner/work/comfy-gpu-ci/comfy-gpu-ci/test_workspaces/Sharp-2000/ComfyUI/comfy/ldm/modules/sub_quadratic_attention.py", line 259 in efficient_dot_product_attention [17:14] [ComfyUI] File "/home/runner/work/comfy-gpu-ci/comfy-gpu-ci/test_workspaces/Sharp-2000/ComfyUI/comfy/ldm/modules/attention.py", line 275 in attention_sub_quad [17:14] [ComfyUI] File "/home/runner/work/comfy-gpu-ci/comfy-gpu-ci/test_workspaces/Sharp-2000/ComfyUI/comfy/ldm/modules/attention.py", line 139 in wrapper [17:14] [ComfyUI] File "/home/runner/work/comfy-gpu-ci/comfy-gpu-ci/test_workspaces/Sharp-2000/ComfyUI/custom_nodes/ComfyUI-Sharp/nodes/sharp/model.py", line 234 in forward [17:14] [ComfyUI] File "/home/runner/.ce/.pixi/envs/sharp-nodes/lib/python3.10/site-packages/torch/nn/modules/module.py", line 1787 in _call_impl [17:14] [ComfyUI] File "/home/runner/.ce/.pixi/envs/sharp-nodes/lib/python3.10/site-packages/torch/nn/modules/module.py", line 1776 in _wrapped_call_impl [17:14] [ComfyUI] File "/home/runner/work/comfy-gpu-ci/comfy-gpu-ci/test_workspaces/Sharp-2000/ComfyUI/custom_nodes/ComfyUI-Sharp/nodes/sharp/model.py", line 309 in forward [17:14] [ComfyUI] File "/home/runner/.ce/.pixi/envs/sharp-nodes/lib/python3.10/site-packages/torch/nn/modules/module.py", line 1787 in _call_impl [17:14] [ComfyUI] File "/home/runner/.ce/.pixi/envs/sharp-nodes/lib/python3.10/site-packages/torch/nn/modules/module.py", line 1776 in _wrapped_call_impl [17:14] [ComfyUI] File "/home/runner/work/comfy-gpu-ci/comfy-gpu-ci/test_workspaces/Sharp-2000/ComfyUI/custom_nodes/ComfyUI-Sharp/nodes/sharp/model.py", line 412 in forward [17:14] [ComfyUI] File "/home/runner/.ce/.pixi/envs/sharp-nodes/lib/python3.10/site-packages/torch/nn/modules/module.py", line 1787 in _call_impl [17:14] [ComfyUI] File "/home/runner/.ce/.pixi/envs/sharp-nodes/lib/python3.10/site-packages/torch/nn/modules/module.py", line 1776 in _wrapped_call_impl [17:14] [ComfyUI] File "/home/runner/work/comfy-gpu-ci/comfy-gpu-ci/test_workspaces/Sharp-2000/ComfyUI/custom_nodes/ComfyUI-Sharp/nodes/sharp/model.py", line 685 in forward [17:14] [ComfyUI] File "/home/runner/.ce/.pixi/envs/sharp-nodes/lib/python3.10/site-packages/torch/nn/modules/module.py", line 1787 in _call_impl [17:14] [ComfyUI] File "/home/runner/.ce/.pixi/envs/sharp-nodes/lib/python3.10/site-packages/torch/nn/modules/module.py", line 1776 in _wrapped_call_impl [17:14] [ComfyUI] File "/home/runner/work/comfy-gpu-ci/comfy-gpu-ci/test_workspaces/Sharp-2000/ComfyUI/custom_nodes/ComfyUI-Sharp/nodes/sharp/model.py", line 1109 in forward [17:14] [ComfyUI] File "/home/runner/.ce/.pixi/envs/sharp-nodes/lib/python3.10/site-packages/torch/nn/modules/module.py", line 1787 in _call_impl [17:14] [ComfyUI] File "/home/runner/.ce/.pixi/envs/sharp-nodes/lib/python3.10/site-packages/torch/nn/modules/module.py", line 1776 in _wrapped_call_impl [17:14] [ComfyUI] File "/home/runner/work/comfy-gpu-ci/comfy-gpu-ci/test_workspaces/Sharp-2000/ComfyUI/custom_nodes/ComfyUI-Sharp/nodes/sharp/model.py", line 2006 in encode [17:14] [ComfyUI] File "/home/runner/work/comfy-gpu-ci/comfy-gpu-ci/test_workspaces/Sharp-2000/ComfyUI/custom_nodes/ComfyUI-Sharp/nodes/predict.py", line 348 in _predict_image_cached [17:14] [ComfyUI] File "/home/runner/work/comfy-gpu-ci/comfy-gpu-ci/test_workspaces/Sharp-2000/ComfyUI/custom_nodes/ComfyUI-Sharp/nodes/predict.py", line 239 in execute [17:14] [ComfyUI] File "/home/runner/.ce/.pixi/envs/sharp-nodes/lib/python3.10/site-packages/torch/utils/_contextlib.py", line 124 in decorate_context [17:14] [ComfyUI] File "/home/runner/work/comfy-gpu-ci/comfy-gpu-ci/test_workspaces/Sharp-2000/ComfyUI/comfy_api/latest/_io.py", line 1892 in EXECUTE_NORMALIZED [17:14] [ComfyUI] File "/tmp/comfyui_pvenv_r05k2fkl/persistent_worker.py", line 1762 in main [17:14] [ComfyUI] File "/tmp/comfyui_pvenv_r05k2fkl/persistent_worker.py", line 1807 in [17:14] [ComfyUI] [17:14] [ComfyUI] [worker:ComfyUI-Sharp] === END === [17:14] [ComfyUI] [17:16] [capture-loop] iter=1100 t=122.3s state={'complete': False, 'error': None, 'executedCount': 0, 'wsState': 1} eval_ms=7 ram=5.7/15.6GB (36%) swap=0.0/3.0GB (0%) cpu=49% browser_rss=0.93GB [17:21] [capture-loop] iter=1150 t=127.8s state={'complete': False, 'error': None, 'executedCount': 0, 'wsState': 1} eval_ms=2 ram=5.7/15.6GB (36%) swap=0.0/3.0GB (0%) cpu=46% browser_rss=0.92GB [17:27] [capture-loop] iter=1200 t=133.4s state={'complete': False, 'error': None, 'executedCount': 0, 'wsState': 1} eval_ms=2 ram=5.7/15.6GB (36%) swap=0.0/3.0GB (0%) cpu=46% browser_rss=0.93GB [17:32] [capture-loop] iter=1250 t=138.9s state={'complete': False, 'error': None, 'executedCount': 0, 'wsState': 1} eval_ms=2 ram=5.7/15.6GB (37%) swap=0.0/3.0GB (0%) cpu=46% browser_rss=0.92GB [17:38] [capture-loop] iter=1300 t=144.4s state={'complete': False, 'error': None, 'executedCount': 0, 'wsState': 1} eval_ms=2 ram=5.7/15.6GB (37%) swap=0.0/3.0GB (0%) cpu=46% browser_rss=0.92GB [17:43] [capture-loop] iter=1350 t=150.0s state={'complete': False, 'error': None, 'executedCount': 0, 'wsState': 1} eval_ms=2 ram=5.8/15.6GB (37%) swap=0.0/3.0GB (0%) cpu=47% browser_rss=0.92GB [17:49] [capture-loop] iter=1400 t=155.6s state={'complete': False, 'error': None, 'executedCount': 0, 'wsState': 1} eval_ms=5 ram=5.8/15.6GB (37%) swap=0.0/3.0GB (0%) cpu=46% browser_rss=0.92GB [17:54] [capture-loop] iter=1450 t=161.0s state={'complete': False, 'error': None, 'executedCount': 0, 'wsState': 1} eval_ms=2 ram=5.8/15.6GB (37%) swap=0.0/3.0GB (0%) cpu=45% browser_rss=0.92GB [18:00] [capture-loop] iter=1500 t=166.6s state={'complete': False, 'error': None, 'executedCount': 0, 'wsState': 1} eval_ms=2 ram=5.7/15.6GB (37%) swap=0.0/3.0GB (0%) cpu=47% browser_rss=0.92GB [18:05] [capture-loop] iter=1550 t=172.1s state={'complete': False, 'error': None, 'executedCount': 0, 'wsState': 1} eval_ms=5 ram=5.9/15.6GB (38%) swap=0.0/3.0GB (0%) cpu=44% browser_rss=0.92GB [18:11] [capture-loop] iter=1600 t=177.6s state={'complete': False, 'error': None, 'executedCount': 0, 'wsState': 1} eval_ms=2 ram=5.8/15.6GB (37%) swap=0.0/3.0GB (0%) cpu=46% browser_rss=0.93GB [18:14] [ComfyUI] [worker:ComfyUI-Sharp] [18:14] [ComfyUI] === WATCHDOG TICK 3 === [18:14] [ComfyUI] [worker:ComfyUI-Sharp] Current thread 0x00007fd6d0ea76c0 (most recent call first): [18:14] [ComfyUI] File "/tmp/comfyui_pvenv_r05k2fkl/persistent_worker.py", line 52 in _watchdog [18:14] [ComfyUI] File "/home/runner/.ce/.pixi/envs/sharp-nodes/lib/python3.10/threading.py", line 953 in run [18:14] [ComfyUI] File "/home/runner/.ce/.pixi/envs/sharp-nodes/lib/python3.10/threading.py", line 1016 in _bootstrap_inner [18:14] [ComfyUI] File "/home/runner/.ce/.pixi/envs/sharp-nodes/lib/python3.10/threading.py", line 973 in _bootstrap [18:14] [ComfyUI] [18:14] [ComfyUI] Thread 0x00007fd6d197a740 (most recent call first): [18:14] [ComfyUI] File "/home/runner/work/comfy-gpu-ci/comfy-gpu-ci/test_workspaces/Sharp-2000/ComfyUI/comfy/ldm/modules/attention.py", line 240 in attention_sub_quad [18:14] [ComfyUI] File "/home/runner/work/comfy-gpu-ci/comfy-gpu-ci/test_workspaces/Sharp-2000/ComfyUI/comfy/ldm/modules/attention.py", line 139 in wrapper [18:14] [ComfyUI] File "/home/runner/work/comfy-gpu-ci/comfy-gpu-ci/test_workspaces/Sharp-2000/ComfyUI/custom_nodes/ComfyUI-Sharp/nodes/sharp/model.py", line 234 in forward [18:14] [ComfyUI] File "/home/runner/.ce/.pixi/envs/sharp-nodes/lib/python3.10/site-packages/torch/nn/modules/module.py", line 1787 in _call_impl [18:14] [ComfyUI] File "/home/runner/.ce/.pixi/envs/sharp-nodes/lib/python3.10/site-packages/torch/nn/modules/module.py", line 1776 in _wrapped_call_impl [18:14] [ComfyUI] File "/home/runner/work/comfy-gpu-ci/comfy-gpu-ci/test_workspaces/Sharp-2000/ComfyUI/custom_nodes/ComfyUI-Sharp/nodes/sharp/model.py", line 309 in forward [18:14] [ComfyUI] File "/home/runner/.ce/.pixi/envs/sharp-nodes/lib/python3.10/site-packages/torch/nn/modules/module.py", line 1787 in _call_impl [18:14] [ComfyUI] File "/home/runner/.ce/.pixi/envs/sharp-nodes/lib/python3.10/site-packages/torch/nn/modules/module.py", line 1776 in _wrapped_call_impl [18:14] [ComfyUI] File "/home/runner/work/comfy-gpu-ci/comfy-gpu-ci/test_workspaces/Sharp-2000/ComfyUI/custom_nodes/ComfyUI-Sharp/nodes/sharp/model.py", line 412 in forward [18:14] [ComfyUI] File "/home/runner/.ce/.pixi/envs/sharp-nodes/lib/python3.10/site-packages/torch/nn/modules/module.py", line 1787 in _call_impl [18:14] [ComfyUI] File "/home/runner/.ce/.pixi/envs/sharp-nodes/lib/python3.10/site-packages/torch/nn/modules/module.py", line 1776 in _wrapped_call_impl [18:14] [ComfyUI] File "/home/runner/work/comfy-gpu-ci/comfy-gpu-ci/test_workspaces/Sharp-2000/ComfyUI/custom_nodes/ComfyUI-Sharp/nodes/sharp/model.py", line 685 in forward [18:14] [ComfyUI] File "/home/runner/.ce/.pixi/envs/sharp-nodes/lib/python3.10/site-packages/torch/nn/modules/module.py", line 1787 in _call_impl [18:14] [ComfyUI] File "/home/runner/.ce/.pixi/envs/sharp-nodes/lib/python3.10/site-packages/torch/nn/modules/module.py", line 1776 in _wrapped_call_impl [18:14] [ComfyUI] File "/home/runner/work/comfy-gpu-ci/comfy-gpu-ci/test_workspaces/Sharp-2000/ComfyUI/custom_nodes/ComfyUI-Sharp/nodes/sharp/model.py", line 1109 in forward [18:14] [ComfyUI] File "/home/runner/.ce/.pixi/envs/sharp-nodes/lib/python3.10/site-packages/torch/nn/modules/module.py", line 1787 in _call_impl [18:14] [ComfyUI] File "/home/runner/.ce/.pixi/envs/sharp-nodes/lib/python3.10/site-packages/torch/nn/modules/module.py", line 1776 in _wrapped_call_impl [18:14] [ComfyUI] File "/home/runner/work/comfy-gpu-ci/comfy-gpu-ci/test_workspaces/Sharp-2000/ComfyUI/custom_nodes/ComfyUI-Sharp/nodes/sharp/model.py", line 2006 in encode [18:14] [ComfyUI] File "/home/runner/work/comfy-gpu-ci/comfy-gpu-ci/test_workspaces/Sharp-2000/ComfyUI/custom_nodes/ComfyUI-Sharp/nodes/predict.py", line 348 in _predict_image_cached [18:14] [ComfyUI] File "/home/runner/work/comfy-gpu-ci/comfy-gpu-ci/test_workspaces/Sharp-2000/ComfyUI/custom_nodes/ComfyUI-Sharp/nodes/predict.py", line 239 in execute [18:14] [ComfyUI] File "/home/runner/.ce/.pixi/envs/sharp-nodes/lib/python3.10/site-packages/torch/utils/_contextlib.py", line 124 in decorate_context [18:14] [ComfyUI] File "/home/runner/work/comfy-gpu-ci/comfy-gpu-ci/test_workspaces/Sharp-2000/ComfyUI/comfy_api/latest/_io.py", line 1892 in EXECUTE_NORMALIZED [18:14] [ComfyUI] File "/tmp/comfyui_pvenv_r05k2fkl/persistent_worker.py", line 1762 in main [18:14] [ComfyUI] File "/tmp/comfyui_pvenv_r05k2fkl/persistent_worker.py", line 1807 in [18:14] [ComfyUI] [18:14] [ComfyUI] [worker:ComfyUI-Sharp] === END === [18:14] [ComfyUI] [18:16] [capture-loop] iter=1650 t=183.2s state={'complete': False, 'error': None, 'executedCount': 0, 'wsState': 1} eval_ms=2 ram=5.9/15.6GB (38%) swap=0.0/3.0GB (0%) cpu=47% browser_rss=0.93GB [18:22] [capture-loop] iter=1700 t=188.7s state={'complete': False, 'error': None, 'executedCount': 0, 'wsState': 1} eval_ms=2 ram=5.8/15.6GB (37%) swap=0.0/3.0GB (0%) cpu=47% browser_rss=0.93GB [18:28] [capture-loop] iter=1750 t=194.2s state={'complete': False, 'error': None, 'executedCount': 0, 'wsState': 1} eval_ms=5 ram=5.5/15.6GB (35%) swap=0.0/3.0GB (0%) cpu=46% browser_rss=0.93GB [18:33] [capture-loop] iter=1800 t=199.8s state={'complete': False, 'error': None, 'executedCount': 0, 'wsState': 1} eval_ms=2 ram=6.2/15.6GB (40%) swap=0.0/3.0GB (0%) cpu=44% browser_rss=0.93GB [18:39] [capture-loop] iter=1850 t=205.2s state={'complete': False, 'error': None, 'executedCount': 0, 'wsState': 1} eval_ms=2 ram=6.4/15.6GB (41%) swap=0.0/3.0GB (0%) cpu=45% browser_rss=0.92GB [18:44] [capture-loop] iter=1900 t=210.8s state={'complete': False, 'error': None, 'executedCount': 0, 'wsState': 1} eval_ms=2 ram=7.0/15.6GB (45%) swap=0.0/3.0GB (0%) cpu=46% browser_rss=0.92GB [18:50] [capture-loop] iter=1950 t=216.4s state={'complete': False, 'error': None, 'executedCount': 0, 'wsState': 1} eval_ms=6 ram=7.8/15.6GB (50%) swap=0.0/3.0GB (0%) cpu=46% browser_rss=0.92GB [18:55] [capture-loop] iter=2000 t=222.0s state={'complete': False, 'error': None, 'executedCount': 0, 'wsState': 1} eval_ms=2 ram=7.4/15.6GB (47%) swap=0.0/3.0GB (0%) cpu=47% browser_rss=0.92GB [19:01] [capture-loop] iter=2050 t=227.4s state={'complete': False, 'error': None, 'executedCount': 0, 'wsState': 1} eval_ms=2 ram=7.8/15.6GB (50%) swap=0.0/3.0GB (0%) cpu=45% browser_rss=0.92GB [19:06] [capture-loop] iter=2100 t=233.0s state={'complete': False, 'error': None, 'executedCount': 0, 'wsState': 1} eval_ms=2 ram=7.6/15.6GB (49%) swap=0.0/3.0GB (0%) cpu=44% browser_rss=0.92GB [19:12] [capture-loop] iter=2150 t=238.5s state={'complete': False, 'error': None, 'executedCount': 0, 'wsState': 1} eval_ms=2 ram=9.0/15.6GB (57%) swap=0.0/3.0GB (0%) cpu=46% browser_rss=0.92GB [19:14] [ComfyUI] [worker:ComfyUI-Sharp] [19:14] [ComfyUI] === WATCHDOG TICK 4 === [19:14] [ComfyUI] [worker:ComfyUI-Sharp] Current thread 0x00007fd6d0ea76c0 (most recent call first): [19:14] [ComfyUI] File "/tmp/comfyui_pvenv_r05k2fkl/persistent_worker.py", line 52 in _watchdog [19:14] [ComfyUI] File "/home/runner/.ce/.pixi/envs/sharp-nodes/lib/python3.10/threading.py", line 953 in run [19:14] [ComfyUI] File "/home/runner/.ce/.pixi/envs/sharp-nodes/lib/python3.10/threading.py", line 1016 in _bootstrap_inner [19:14] [ComfyUI] File "/home/runner/.ce/.pixi/envs/sharp-nodes/lib/python3.10/threading.py", line 973 in _bootstrap [19:14] [ComfyUI] [19:14] [ComfyUI] Thread 0x00007fd6d197a740 (most recent call first): [19:14] [ComfyUI] File "/home/runner/.ce/.pixi/envs/sharp-nodes/lib/python3.10/site-packages/torch/nn/modules/conv.py", line 548 in _conv_forward [19:14] [ComfyUI] File "/home/runner/.ce/.pixi/envs/sharp-nodes/lib/python3.10/site-packages/torch/nn/modules/conv.py", line 553 in forward [19:14] [ComfyUI] File "/home/runner/work/comfy-gpu-ci/comfy-gpu-ci/test_workspaces/Sharp-2000/ComfyUI/comfy/ops.py", line 537 in forward [19:14] [ComfyUI] File "/home/runner/.ce/.pixi/envs/sharp-nodes/lib/python3.10/site-packages/torch/nn/modules/module.py", line 1787 in _call_impl [19:14] [ComfyUI] File "/home/runner/.ce/.pixi/envs/sharp-nodes/lib/python3.10/site-packages/torch/nn/modules/module.py", line 1776 in _wrapped_call_impl [19:14] [ComfyUI] File "/home/runner/.ce/.pixi/envs/sharp-nodes/lib/python3.10/site-packages/torch/nn/modules/container.py", line 253 in forward [19:14] [ComfyUI] File "/home/runner/.ce/.pixi/envs/sharp-nodes/lib/python3.10/site-packages/torch/nn/modules/module.py", line 1787 in _call_impl [19:14] [ComfyUI] File "/home/runner/.ce/.pixi/envs/sharp-nodes/lib/python3.10/site-packages/torch/nn/modules/module.py", line 1776 in _wrapped_call_impl [19:14] [ComfyUI] File "/home/runner/work/comfy-gpu-ci/comfy-gpu-ci/test_workspaces/Sharp-2000/ComfyUI/custom_nodes/ComfyUI-Sharp/nodes/sharp/model.py", line 766 in forward [19:14] [ComfyUI] File "/home/runner/.ce/.pixi/envs/sharp-nodes/lib/python3.10/site-packages/torch/nn/modules/module.py", line 1787 in _call_impl [19:14] [ComfyUI] File "/home/runner/.ce/.pixi/envs/sharp-nodes/lib/python3.10/site-packages/torch/nn/modules/module.py", line 1776 in _wrapped_call_impl [19:14] [ComfyUI] File "/home/runner/work/comfy-gpu-ci/comfy-gpu-ci/test_workspaces/Sharp-2000/ComfyUI/custom_nodes/ComfyUI-Sharp/nodes/sharp/model.py", line 860 in forward [19:14] [ComfyUI] File "/home/runner/.ce/.pixi/envs/sharp-nodes/lib/python3.10/site-packages/torch/nn/modules/module.py", line 1787 in _call_impl [19:14] [ComfyUI] File "/home/runner/.ce/.pixi/envs/sharp-nodes/lib/python3.10/site-packages/torch/nn/modules/module.py", line 1776 in _wrapped_call_impl [19:14] [ComfyUI] File "/home/runner/work/comfy-gpu-ci/comfy-gpu-ci/test_workspaces/Sharp-2000/ComfyUI/custom_nodes/ComfyUI-Sharp/nodes/sharp/model.py", line 970 in forward [19:14] [ComfyUI] File "/home/runner/.ce/.pixi/envs/sharp-nodes/lib/python3.10/site-packages/torch/nn/modules/module.py", line 1787 in _call_impl [19:14] [ComfyUI] File "/home/runner/.ce/.pixi/envs/sharp-nodes/lib/python3.10/site-packages/torch/nn/modules/module.py", line 1776 in _wrapped_call_impl [19:14] [ComfyUI] File "/home/runner/work/comfy-gpu-ci/comfy-gpu-ci/test_workspaces/Sharp-2000/ComfyUI/custom_nodes/ComfyUI-Sharp/nodes/sharp/model.py", line 1118 in forward [19:14] [ComfyUI] File "/home/runner/.ce/.pixi/envs/sharp-nodes/lib/python3.10/site-packages/torch/nn/modules/module.py", line 1787 in _call_impl [19:14] [ComfyUI] File "/home/runner/.ce/.pixi/envs/sharp-nodes/lib/python3.10/site-packages/torch/nn/modules/module.py", line 1776 in _wrapped_call_impl [19:14] [ComfyUI] File "/home/runner/work/comfy-gpu-ci/comfy-gpu-ci/test_workspaces/Sharp-2000/ComfyUI/custom_nodes/ComfyUI-Sharp/nodes/sharp/model.py", line 2006 in encode [19:14] [ComfyUI] File "/home/runner/work/comfy-gpu-ci/comfy-gpu-ci/test_workspaces/Sharp-2000/ComfyUI/custom_nodes/ComfyUI-Sharp/nodes/predict.py", line 348 in _predict_image_cached [19:14] [ComfyUI] File "/home/runner/work/comfy-gpu-ci/comfy-gpu-ci/test_workspaces/Sharp-2000/ComfyUI/custom_nodes/ComfyUI-Sharp/nodes/predict.py", line 239 in execute [19:14] [ComfyUI] File "/home/runner/.ce/.pixi/envs/sharp-nodes/lib/python3.10/site-packages/torch/utils/_contextlib.py", line 124 in decorate_context [19:14] [ComfyUI] File "/home/runner/work/comfy-gpu-ci/comfy-gpu-ci/test_workspaces/Sharp-2000/ComfyUI/comfy_api/latest/_io.py", line 1892 in EXECUTE_NORMALIZED [19:14] [ComfyUI] File "/tmp/comfyui_pvenv_r05k2fkl/persistent_worker.py", line 1762 in main [19:14] [ComfyUI] File "/tmp/comfyui_pvenv_r05k2fkl/persistent_worker.py", line 1807 in [19:14] [ComfyUI] [19:14] [ComfyUI] [worker:ComfyUI-Sharp] === END === [19:14] [ComfyUI] [19:17] [capture-loop] iter=2200 t=244.1s state={'complete': False, 'error': None, 'executedCount': 0, 'wsState': 1} eval_ms=3 ram=9.5/15.6GB (61%) swap=0.0/3.0GB (0%) cpu=48% browser_rss=0.92GB [19:23] [capture-loop] iter=2250 t=249.6s state={'complete': False, 'error': None, 'executedCount': 0, 'wsState': 1} eval_ms=2 ram=9.3/15.6GB (60%) swap=0.0/3.0GB (0%) cpu=48% browser_rss=0.92GB [19:29] [capture-loop] iter=2300 t=255.2s state={'complete': False, 'error': None, 'executedCount': 0, 'wsState': 1} eval_ms=2 ram=9.5/15.6GB (61%) swap=0.0/3.0GB (0%) cpu=47% browser_rss=0.92GB [19:34] [capture-loop] iter=2350 t=260.7s state={'complete': False, 'error': None, 'executedCount': 0, 'wsState': 1} eval_ms=2 ram=7.5/15.6GB (48%) swap=0.0/3.0GB (0%) cpu=46% browser_rss=0.92GB [19:40] [capture-loop] iter=2400 t=266.3s state={'complete': False, 'error': None, 'executedCount': 0, 'wsState': 1} eval_ms=2 ram=10.0/15.6GB (64%) swap=0.0/3.0GB (0%) cpu=46% browser_rss=0.92GB [19:45] [capture-loop] iter=2450 t=271.8s state={'complete': False, 'error': None, 'executedCount': 0, 'wsState': 1} eval_ms=2 ram=7.0/15.6GB (45%) swap=0.0/3.0GB (0%) cpu=48% browser_rss=0.92GB [19:51] [capture-loop] iter=2500 t=277.4s state={'complete': False, 'error': None, 'executedCount': 0, 'wsState': 1} eval_ms=3 ram=7.8/15.6GB (50%) swap=0.0/3.0GB (0%) cpu=46% browser_rss=0.92GB [19:56] [capture-loop] iter=2550 t=282.9s state={'complete': False, 'error': None, 'executedCount': 0, 'wsState': 1} eval_ms=2 ram=8.8/15.6GB (56%) swap=0.0/3.0GB (0%) cpu=46% browser_rss=0.92GB [20:02] [capture-loop] iter=2600 t=288.5s state={'complete': False, 'error': None, 'executedCount': 0, 'wsState': 1} eval_ms=2 ram=8.2/15.6GB (52%) swap=0.0/3.0GB (0%) cpu=45% browser_rss=0.92GB [20:07] [capture-loop] iter=2650 t=293.9s state={'complete': False, 'error': None, 'executedCount': 0, 'wsState': 1} eval_ms=2 ram=8.7/15.6GB (56%) swap=0.0/3.0GB (0%) cpu=45% browser_rss=0.92GB [20:13] [capture-loop] iter=2700 t=299.5s state={'complete': False, 'error': None, 'executedCount': 0, 'wsState': 1} eval_ms=4 ram=8.1/15.6GB (52%) swap=0.0/3.0GB (0%) cpu=45% browser_rss=0.92GB [20:14] [ComfyUI] [worker:ComfyUI-Sharp] [20:14] [ComfyUI] === WATCHDOG TICK 5 === [20:14] [ComfyUI] [worker:ComfyUI-Sharp] Current thread 0x00007fd6d0ea76c0 (most recent call first): [20:14] [ComfyUI] File "/tmp/comfyui_pvenv_r05k2fkl/persistent_worker.py", line 52 in _watchdog [20:14] [ComfyUI] File "/home/runner/.ce/.pixi/envs/sharp-nodes/lib/python3.10/threading.py", line 953 in run [20:14] [ComfyUI] File "/home/runner/.ce/.pixi/envs/sharp-nodes/lib/python3.10/threading.py", line 1016 in _bootstrap_inner [20:14] [ComfyUI] File "/home/runner/.ce/.pixi/envs/sharp-nodes/lib/python3.10/threading.py", line 973 in _bootstrap [20:14] [ComfyUI] [20:14] [ComfyUI] Thread 0x00007fd6d197a740 (most recent call first): [20:14] [ComfyUI] File "/home/runner/.ce/.pixi/envs/sharp-nodes/lib/python3.10/site-packages/torch/nn/modules/conv.py", line 548 in _conv_forward [20:14] [ComfyUI] File "/home/runner/.ce/.pixi/envs/sharp-nodes/lib/python3.10/site-packages/torch/nn/modules/conv.py", line 553 in forward [20:14] [ComfyUI] File "/home/runner/work/comfy-gpu-ci/comfy-gpu-ci/test_workspaces/Sharp-2000/ComfyUI/comfy/ops.py", line 537 in forward [20:14] [ComfyUI] File "/home/runner/.ce/.pixi/envs/sharp-nodes/lib/python3.10/site-packages/torch/nn/modules/module.py", line 1787 in _call_impl [20:14] [ComfyUI] File "/home/runner/.ce/.pixi/envs/sharp-nodes/lib/python3.10/site-packages/torch/nn/modules/module.py", line 1776 in _wrapped_call_impl [20:14] [ComfyUI] File "/home/runner/.ce/.pixi/envs/sharp-nodes/lib/python3.10/site-packages/torch/nn/modules/container.py", line 253 in forward [20:14] [ComfyUI] File "/home/runner/.ce/.pixi/envs/sharp-nodes/lib/python3.10/site-packages/torch/nn/modules/module.py", line 1787 in _call_impl [20:14] [ComfyUI] File "/home/runner/.ce/.pixi/envs/sharp-nodes/lib/python3.10/site-packages/torch/nn/modules/module.py", line 1776 in _wrapped_call_impl [20:14] [ComfyUI] File "/home/runner/work/comfy-gpu-ci/comfy-gpu-ci/test_workspaces/Sharp-2000/ComfyUI/custom_nodes/ComfyUI-Sharp/nodes/sharp/model.py", line 766 in forward [20:14] [ComfyUI] File "/home/runner/.ce/.pixi/envs/sharp-nodes/lib/python3.10/site-packages/torch/nn/modules/module.py", line 1787 in _call_impl [20:14] [ComfyUI] File "/home/runner/.ce/.pixi/envs/sharp-nodes/lib/python3.10/site-packages/torch/nn/modules/module.py", line 1776 in _wrapped_call_impl [20:14] [ComfyUI] File "/home/runner/.ce/.pixi/envs/sharp-nodes/lib/python3.10/site-packages/torch/nn/modules/container.py", line 253 in forward [20:14] [ComfyUI] File "/home/runner/.ce/.pixi/envs/sharp-nodes/lib/python3.10/site-packages/torch/nn/modules/module.py", line 1787 in _call_impl [20:14] [ComfyUI] File "/home/runner/.ce/.pixi/envs/sharp-nodes/lib/python3.10/site-packages/torch/nn/modules/module.py", line 1776 in _wrapped_call_impl [20:14] [ComfyUI] File "/home/runner/work/comfy-gpu-ci/comfy-gpu-ci/test_workspaces/Sharp-2000/ComfyUI/custom_nodes/ComfyUI-Sharp/nodes/sharp/model.py", line 1355 in forward [20:14] [ComfyUI] File "/home/runner/.ce/.pixi/envs/sharp-nodes/lib/python3.10/site-packages/torch/nn/modules/module.py", line 1787 in _call_impl [20:14] [ComfyUI] File "/home/runner/.ce/.pixi/envs/sharp-nodes/lib/python3.10/site-packages/torch/nn/modules/module.py", line 1776 in _wrapped_call_impl [20:14] [ComfyUI] File "/home/runner/work/comfy-gpu-ci/comfy-gpu-ci/test_workspaces/Sharp-2000/ComfyUI/custom_nodes/ComfyUI-Sharp/nodes/sharp/model.py", line 2030 in decode [20:14] [ComfyUI] File "/home/runner/work/comfy-gpu-ci/comfy-gpu-ci/test_workspaces/Sharp-2000/ComfyUI/custom_nodes/ComfyUI-Sharp/nodes/predict.py", line 379 in _predict_image_cached [20:14] [ComfyUI] File "/home/runner/work/comfy-gpu-ci/comfy-gpu-ci/test_workspaces/Sharp-2000/ComfyUI/custom_nodes/ComfyUI-Sharp/nodes/predict.py", line 239 in execute [20:14] [ComfyUI] File "/home/runner/.ce/.pixi/envs/sharp-nodes/lib/python3.10/site-packages/torch/utils/_contextlib.py", line 124 in decorate_context [20:14] [ComfyUI] File "/home/runner/work/comfy-gpu-ci/comfy-gpu-ci/test_workspaces/Sharp-2000/ComfyUI/comfy_api/latest/_io.py", line 1892 in EXECUTE_NORMALIZED [20:14] [ComfyUI] File "/tmp/comfyui_pvenv_r05k2fkl/persistent_worker.py", line 1762 in main [20:14] [ComfyUI] File "/tmp/comfyui_pvenv_r05k2fkl/persistent_worker.py", line 1807 in [20:14] [ComfyUI] [20:14] [ComfyUI] [worker:ComfyUI-Sharp] === END === [20:14] [ComfyUI] [20:18] [capture-loop] iter=2750 t=305.0s state={'complete': False, 'error': None, 'executedCount': 0, 'wsState': 1} eval_ms=2 ram=7.8/15.6GB (50%) swap=0.0/3.0GB (0%) cpu=47% browser_rss=0.92GB [20:23] [ComfyUI] [SubprocessWorker] callback 'report_progress' from call_id=7 [20:23] [ComfyUI] [SubprocessWorker] got response: ok [20:23] [ComfyUI] [comfy-env] SharpPredict done (307.40s): result: NodeOutput [20:23] [ComfyUI] [comfy-env] Running PreviewGaussianSharp: ply_path: '/home/runner/work/comfy-gpu-ci/comfy-gpu-ci/test_workspa..., extrinsics: list[4], intrinsics: list[3] [20:23] [ComfyUI] [SubprocessWorker] call_method: nodes.preview_gaussian_sharp.PreviewGaussianSharp.EXECUTE_NORMALIZED [20:23] [ComfyUI] [SubprocessWorker] acquired lock, ensuring started... [20:23] [ComfyUI] [ComfyUI-GaussianPack] Health check: ping (timeout=5.0s)... [20:23] [ComfyUI] [ComfyUI-GaussianPack] Health check: failed [20:23] [ComfyUI] [ComfyUI-GaussianPack] Socket unhealthy, restarting worker... [20:23] [ComfyUI] [ComfyUI-GaussianPack] python: /home/runner/.ce/.pixi/envs/gaussianpack-nodes/bin/python [20:23] [ComfyUI] [ComfyUI-GaussianPack] sys_path sent to worker: ['/home/runner/work/comfy-gpu-ci/comfy-gpu-ci/test_workspaces/Sharp-2000/ComfyUI', '/home/runner/work/comfy-gpu-ci/comfy-gpu-ci/test_workspaces/Sharp-2000/ComfyUI/custom_nodes/ComfyUI-GaussianPack', '/home/runner/.ce/.pixi/envs/gaussianpack-nodes/lib/python3.10/site-packages', '/home/runner/work/comfy-gpu-ci/comfy-gpu-ci/test_workspaces/Sharp-2000/ComfyUI/custom_nodes/ComfyUI-GaussianPack'] [20:23] [ComfyUI] [SubprocessWorker] is_pixi=True, python=/home/runner/.ce/.pixi/envs/gaussianpack-nodes/bin/python [20:23] [ComfyUI] [SubprocessWorker] launching cmd=['/home/runner/.pixi/bin/pixi', 'run', '--as-is', '--manifest-path', '/home/runner/.ce/pixi.toml', '-e', 'gaussianpack-nodes', 'python', '/tmp/comfyui_pvenv_g6q6yfx2/persistent_worker.py', 'abstract://comfy_worker_a939e13ad09e']... [20:23] [ComfyUI] [SubprocessWorker] socket_addr=abstract://comfy_worker_a939e13ad09e (abstract, no filesystem path) [20:24] Frame 4 saved (frame_003.jpg, t=310.4s) [20:24] [capture-periodic] freeze=2ms shot=168ms unfreeze=5ms saved=True [20:24] [capture-loop] iter=2800 t=310.7s state={'complete': False, 'error': None, 'executedCount': 0, 'wsState': 1} eval_ms=6 ram=6.8/15.6GB (44%) swap=0.0/3.0GB (0%) cpu=49% browser_rss=0.93GB [20:24] [ComfyUI] [SubprocessWorker] worker started/confirmed [20:24] [ComfyUI] [SubprocessWorker] serializing kwargs to shm... [20:24] [ComfyUI] [SubprocessWorker] created 0 shm blocks [20:24] [ComfyUI] [SubprocessWorker] sending request via socket... [20:24] [ComfyUI] [SubprocessWorker] call_id=3 sending call_method [20:24] [ComfyUI] [worker:ComfyUI-GaussianPack] WARNING: SPZ route not registered (ModuleNotFoundError: No module named 'comfy_aimdo') [20:24] [ComfyUI] [SubprocessWorker] got response: ok [20:24] [ComfyUI] [comfy-env] PreviewGaussianSharp done (1.77s): result: NodeOutput [20:24] [ComfyUI] [comfy-env] Running SharpPredictMetricDepth: focal_length_mm: 30.0, model: dict, image: torch.float32 [1,960,1416,3] cpu [20:24] [ComfyUI] [SubprocessWorker] call_method: nodes.predict_metric_depth.SharpPredictMetricDepth.EXECUTE_NORMALIZED [20:24] [ComfyUI] [SubprocessWorker] acquired lock, ensuring started... [20:24] [ComfyUI] [ComfyUI-Sharp] Health check: ping (timeout=5.0s)... [20:24] [ComfyUI] [ComfyUI-Sharp] Health check: ok [20:24] [ComfyUI] [SubprocessWorker] worker started/confirmed [20:24] [ComfyUI] [comfy-env] PRE-SERIALIZE 'image' shape: torch.Size([1, 960, 1416, 3]) [20:24] [ComfyUI] [SubprocessWorker] serializing kwargs to shm... [20:24] [ComfyUI] [SubprocessWorker] created 0 shm blocks [20:24] [ComfyUI] [SubprocessWorker] sending request via socket... [20:24] [ComfyUI] [SubprocessWorker] call_id=8 sending call_method [20:24] [ComfyUI] [worker:ComfyUI-Sharp] [comfy-env] _from_shm got dict with keys: ['__type__', 'strategy', 'parent_pid', 'fd', 'storage_size'] [20:24] [ComfyUI] [worker:ComfyUI-Sharp] [comfy-env] DESERIALIZE TensorRef: tensor_size=[1, 960, 1416, 3] [20:24] [ComfyUI] [worker:ComfyUI-Sharp] [comfy-env] DESERIALIZED tensor shape: torch.Size([1, 960, 1416, 3]) [20:24] [ComfyUI] [worker:ComfyUI-Sharp] [SharpPredictMetricDepth] intrinsics not wired -> using identity-style K (focal=1186.2px @ image 1416×960, 35mm-equiv 30.0mm). Pass intrinsics from PanoramaSplit for per-face accurate K. [20:24] [ComfyUI] [SubprocessWorker] callback 'request_vram_budget' from call_id=8 [20:24] [ComfyUI] [comfy-env] VRAM request: 2.81GB, free before eviction: 9.46GB [20:24] [ComfyUI] [comfy-env] VRAM after eviction: 9.46GB [20:25] Node executed (1 total), capturing... [20:26] Frame 5 saved (frame_004.jpg, t=311.4s) [20:26] [capture-node] freeze=965ms shot=394ms unfreeze=4ms saved=True [21:14] [ComfyUI] [worker:ComfyUI-Sharp] [21:14] [ComfyUI] === WATCHDOG TICK 6 === [21:14] [ComfyUI] [worker:ComfyUI-Sharp] Thread 0x00007fd5aa3976c0 (most recent call first): [21:14] [ComfyUI] File "/home/runner/.ce/.pixi/envs/sharp-nodes/lib/python3.10/socket.py", line 293 in accept [21:14] [ComfyUI] File "/home/runner/.ce/.pixi/envs/sharp-nodes/lib/python3.10/multiprocessing/connection.py", line 609 in accept [21:14] [ComfyUI] File "/home/runner/.ce/.pixi/envs/sharp-nodes/lib/python3.10/multiprocessing/connection.py", line 463 in accept [21:14] [ComfyUI] File "/home/runner/.ce/.pixi/envs/sharp-nodes/lib/python3.10/multiprocessing/resource_sharer.py", line 138 in _serve [21:14] [ComfyUI] File "/home/runner/.ce/.pixi/envs/sharp-nodes/lib/python3.10/threading.py", line 953 in run [21:14] [ComfyUI] File "/home/runner/.ce/.pixi/envs/sharp-nodes/lib/python3.10/threading.py", line 1016 in _bootstrap_inner [21:14] [ComfyUI] File "/home/runner/.ce/.pixi/envs/sharp-nodes/lib/python3.10/threading.py", line 973 in _bootstrap [21:14] [ComfyUI] [21:14] [ComfyUI] Current thread 0x00007fd6d0ea76c0 (most recent call first): [21:14] [ComfyUI] File "/tmp/comfyui_pvenv_r05k2fkl/persistent_worker.py", line 52 in _watchdog [21:14] [ComfyUI] File "/home/runner/.ce/.pixi/envs/sharp-nodes/lib/python3.10/threading.py", line 953 in run [21:14] [ComfyUI] File "/home/runner/.ce/.pixi/envs/sharp-nodes/lib/python3.10/threading.py", line 1016 in _bootstrap_inner [21:14] [ComfyUI] File "/home/runner/.ce/.pixi/envs/sharp-nodes/lib/python3.10/threading.py", line 973 in _bootstrap [21:14] [ComfyUI] [21:14] [ComfyUI] Thread 0x00007fd6d197a740 (most recent call first): [21:14] [ComfyUI] File "/home/runner/work/comfy-gpu-ci/comfy-gpu-ci/test_workspaces/Sharp-2000/ComfyUI/comfy/ldm/modules/sub_quadratic_attention.py", line 159 in _get_attention_scores_no_kv_chunking [21:14] [ComfyUI] File "/home/runner/work/comfy-gpu-ci/comfy-gpu-ci/test_workspaces/Sharp-2000/ComfyUI/comfy/ldm/modules/sub_quadratic_attention.py", line 259 in efficient_dot_product_attention [21:14] [ComfyUI] File "/home/runner/work/comfy-gpu-ci/comfy-gpu-ci/test_workspaces/Sharp-2000/ComfyUI/comfy/ldm/modules/attention.py", line 275 in attention_sub_quad [21:14] [ComfyUI] File "/home/runner/work/comfy-gpu-ci/comfy-gpu-ci/test_workspaces/Sharp-2000/ComfyUI/comfy/ldm/modules/attention.py", line 139 in wrapper [21:14] [ComfyUI] File "/home/runner/work/comfy-gpu-ci/comfy-gpu-ci/test_workspaces/Sharp-2000/ComfyUI/custom_nodes/ComfyUI-Sharp/nodes/sharp/model.py", line 234 in forward [21:14] [ComfyUI] File "/home/runner/.ce/.pixi/envs/sharp-nodes/lib/python3.10/site-packages/torch/nn/modules/module.py", line 1787 in _call_impl [21:14] [ComfyUI] File "/home/runner/.ce/.pixi/envs/sharp-nodes/lib/python3.10/site-packages/torch/nn/modules/module.py", line 1776 in _wrapped_call_impl [21:14] [ComfyUI] File "/home/runner/work/comfy-gpu-ci/comfy-gpu-ci/test_workspaces/Sharp-2000/ComfyUI/custom_nodes/ComfyUI-Sharp/nodes/sharp/model.py", line 309 in forward [21:14] [ComfyUI] File "/home/runner/.ce/.pixi/envs/sharp-nodes/lib/python3.10/site-packages/torch/nn/modules/module.py", line 1787 in _call_impl [21:14] [ComfyUI] File "/home/runner/.ce/.pixi/envs/sharp-nodes/lib/python3.10/site-packages/torch/nn/modules/module.py", line 1776 in _wrapped_call_impl [21:14] [ComfyUI] File "/home/runner/work/comfy-gpu-ci/comfy-gpu-ci/test_workspaces/Sharp-2000/ComfyUI/custom_nodes/ComfyUI-Sharp/nodes/sharp/model.py", line 412 in forward [21:14] [ComfyUI] File "/home/runner/.ce/.pixi/envs/sharp-nodes/lib/python3.10/site-packages/torch/nn/modules/module.py", line 1787 in _call_impl [21:14] [ComfyUI] File "/home/runner/.ce/.pixi/envs/sharp-nodes/lib/python3.10/site-packages/torch/nn/modules/module.py", line 1776 in _wrapped_call_impl [21:14] [ComfyUI] File "/home/runner/work/comfy-gpu-ci/comfy-gpu-ci/test_workspaces/Sharp-2000/ComfyUI/custom_nodes/ComfyUI-Sharp/nodes/sharp/model.py", line 685 in forward [21:14] [ComfyUI] File "/home/runner/.ce/.pixi/envs/sharp-nodes/lib/python3.10/site-packages/torch/nn/modules/module.py", line 1787 in _call_impl [21:14] [ComfyUI] File "/home/runner/.ce/.pixi/envs/sharp-nodes/lib/python3.10/site-packages/torch/nn/modules/module.py", line 1776 in _wrapped_call_impl [21:14] [ComfyUI] File "/home/runner/work/comfy-gpu-ci/comfy-gpu-ci/test_workspaces/Sharp-2000/ComfyUI/custom_nodes/ComfyUI-Sharp/nodes/sharp/model.py", line 1109 in forward [21:14] [ComfyUI] File "/home/runner/.ce/.pixi/envs/sharp-nodes/lib/python3.10/site-packages/torch/nn/modules/module.py", line 1787 in _call_impl [21:14] [ComfyUI] File "/home/runner/.ce/.pixi/envs/sharp-nodes/lib/python3.10/site-packages/torch/nn/modules/module.py", line 1776 in _wrapped_call_impl [21:14] [ComfyUI] File "/home/runner/work/comfy-gpu-ci/comfy-gpu-ci/test_workspaces/Sharp-2000/ComfyUI/custom_nodes/ComfyUI-Sharp/nodes/sharp/model.py", line 2006 in encode [21:14] [ComfyUI] File "/home/runner/work/comfy-gpu-ci/comfy-gpu-ci/test_workspaces/Sharp-2000/ComfyUI/custom_nodes/ComfyUI-Sharp/nodes/predict_metric_depth.py", line 231 in execute [21:14] [ComfyUI] File "/home/runner/.ce/.pixi/envs/sharp-nodes/lib/python3.10/site-packages/torch/utils/_contextlib.py", line 124 in decorate_context [21:14] [ComfyUI] File "/home/runner/work/comfy-gpu-ci/comfy-gpu-ci/test_workspaces/Sharp-2000/ComfyUI/comfy_api/latest/_io.py", line 1892 in EXECUTE_NORMALIZED [21:14] [ComfyUI] File "/tmp/comfyui_pvenv_r05k2fkl/persistent_worker.py", line 1762 in main [21:14] [ComfyUI] File "/tmp/comfyui_pvenv_r05k2fkl/persistent_worker.py", line 1807 in [21:14] [ComfyUI] [21:14] [ComfyUI] [worker:ComfyUI-Sharp] === END === [21:14] [ComfyUI] [21:19] Frame 6 saved (frame_005.jpg, t=330.2s) [21:19] [capture-periodic] freeze=17727ms shot=17829ms unfreeze=2ms saved=True [22:14] [ComfyUI] [worker:ComfyUI-Sharp] [22:14] [ComfyUI] === WATCHDOG TICK 7 === [22:14] [ComfyUI] [worker:ComfyUI-Sharp] Thread 0x00007fd5aa3976c0 (most recent call first): [22:14] [ComfyUI] File "/home/runner/.ce/.pixi/envs/sharp-nodes/lib/python3.10/socket.py", line 293 in accept [22:14] [ComfyUI] File "/home/runner/.ce/.pixi/envs/sharp-nodes/lib/python3.10/multiprocessing/connection.py", line 609 in accept [22:14] [ComfyUI] File "/home/runner/.ce/.pixi/envs/sharp-nodes/lib/python3.10/multiprocessing/connection.py", line 463 in accept [22:14] [ComfyUI] File "/home/runner/.ce/.pixi/envs/sharp-nodes/lib/python3.10/multiprocessing/resource_sharer.py", line 138 in _serve [22:14] [ComfyUI] File "/home/runner/.ce/.pixi/envs/sharp-nodes/lib/python3.10/threading.py", line 953 in run [22:14] [ComfyUI] File "/home/runner/.ce/.pixi/envs/sharp-nodes/lib/python3.10/threading.py", line 1016 in _bootstrap_inner [22:14] [ComfyUI] File "/home/runner/.ce/.pixi/envs/sharp-nodes/lib/python3.10/threading.py", line 973 in _bootstrap [22:14] [ComfyUI] [22:14] [ComfyUI] Current thread 0x00007fd6d0ea76c0 (most recent call first): [22:14] [ComfyUI] File "/tmp/comfyui_pvenv_r05k2fkl/persistent_worker.py", line 52 in _watchdog [22:14] [ComfyUI] File "/home/runner/.ce/.pixi/envs/sharp-nodes/lib/python3.10/threading.py", line 953 in run [22:14] [ComfyUI] File "/home/runner/.ce/.pixi/envs/sharp-nodes/lib/python3.10/threading.py", line 1016 in _bootstrap_inner [22:14] [ComfyUI] File "/home/runner/.ce/.pixi/envs/sharp-nodes/lib/python3.10/threading.py", line 973 in _bootstrap [22:14] [ComfyUI] [22:14] [ComfyUI] Thread 0x00007fd6d197a740 (most recent call first): [22:14] [ComfyUI] File "/home/runner/.ce/.pixi/envs/sharp-nodes/lib/python3.10/site-packages/torch/nn/modules/linear.py", line 134 in forward [22:14] [ComfyUI] File "/home/runner/work/comfy-gpu-ci/comfy-gpu-ci/test_workspaces/Sharp-2000/ComfyUI/comfy/ops.py", line 503 in forward [22:14] [ComfyUI] File "/home/runner/.ce/.pixi/envs/sharp-nodes/lib/python3.10/site-packages/torch/nn/modules/module.py", line 1787 in _call_impl [22:14] [ComfyUI] File "/home/runner/.ce/.pixi/envs/sharp-nodes/lib/python3.10/site-packages/torch/nn/modules/module.py", line 1776 in _wrapped_call_impl [22:14] [ComfyUI] File "/home/runner/work/comfy-gpu-ci/comfy-gpu-ci/test_workspaces/Sharp-2000/ComfyUI/custom_nodes/ComfyUI-Sharp/nodes/sharp/model.py", line 274 in forward [22:14] [ComfyUI] File "/home/runner/.ce/.pixi/envs/sharp-nodes/lib/python3.10/site-packages/torch/nn/modules/module.py", line 1787 in _call_impl [22:14] [ComfyUI] File "/home/runner/.ce/.pixi/envs/sharp-nodes/lib/python3.10/site-packages/torch/nn/modules/module.py", line 1776 in _wrapped_call_impl [22:14] [ComfyUI] File "/home/runner/work/comfy-gpu-ci/comfy-gpu-ci/test_workspaces/Sharp-2000/ComfyUI/custom_nodes/ComfyUI-Sharp/nodes/sharp/model.py", line 310 in forward [22:14] [ComfyUI] File "/home/runner/.ce/.pixi/envs/sharp-nodes/lib/python3.10/site-packages/torch/nn/modules/module.py", line 1787 in _call_impl [22:14] [ComfyUI] File "/home/runner/.ce/.pixi/envs/sharp-nodes/lib/python3.10/site-packages/torch/nn/modules/module.py", line 1776 in _wrapped_call_impl [22:14] [ComfyUI] File "/home/runner/work/comfy-gpu-ci/comfy-gpu-ci/test_workspaces/Sharp-2000/ComfyUI/custom_nodes/ComfyUI-Sharp/nodes/sharp/model.py", line 412 in forward [22:14] [ComfyUI] File "/home/runner/.ce/.pixi/envs/sharp-nodes/lib/python3.10/site-packages/torch/nn/modules/module.py", line 1787 in _call_impl [22:14] [ComfyUI] File "/home/runner/.ce/.pixi/envs/sharp-nodes/lib/python3.10/site-packages/torch/nn/modules/module.py", line 1776 in _wrapped_call_impl [22:14] [ComfyUI] File "/home/runner/work/comfy-gpu-ci/comfy-gpu-ci/test_workspaces/Sharp-2000/ComfyUI/custom_nodes/ComfyUI-Sharp/nodes/sharp/model.py", line 685 in forward [22:14] [ComfyUI] File "/home/runner/.ce/.pixi/envs/sharp-nodes/lib/python3.10/site-packages/torch/nn/modules/module.py", line 1787 in _call_impl [22:14] [ComfyUI] File "/home/runner/.ce/.pixi/envs/sharp-nodes/lib/python3.10/site-packages/torch/nn/modules/module.py", line 1776 in _wrapped_call_impl [22:14] [ComfyUI] File "/home/runner/work/comfy-gpu-ci/comfy-gpu-ci/test_workspaces/Sharp-2000/ComfyUI/custom_nodes/ComfyUI-Sharp/nodes/sharp/model.py", line 1109 in forward [22:14] [ComfyUI] File "/home/runner/.ce/.pixi/envs/sharp-nodes/lib/python3.10/site-packages/torch/nn/modules/module.py", line 1787 in _call_impl [22:14] [ComfyUI] File "/home/runner/.ce/.pixi/envs/sharp-nodes/lib/python3.10/site-packages/torch/nn/modules/module.py", line 1776 in _wrapped_call_impl [22:14] [ComfyUI] File "/home/runner/work/comfy-gpu-ci/comfy-gpu-ci/test_workspaces/Sharp-2000/ComfyUI/custom_nodes/ComfyUI-Sharp/nodes/sharp/model.py", line 2006 in encode [22:14] [ComfyUI] File "/home/runner/work/comfy-gpu-ci/comfy-gpu-ci/test_workspaces/Sharp-2000/ComfyUI/custom_nodes/ComfyUI-Sharp/nodes/predict_metric_depth.py", line 231 in execute [22:14] [ComfyUI] File "/home/runner/.ce/.pixi/envs/sharp-nodes/lib/python3.10/site-packages/torch/utils/_contextlib.py", line 124 in decorate_context [22:14] [ComfyUI] File "/home/runner/work/comfy-gpu-ci/comfy-gpu-ci/test_workspaces/Sharp-2000/ComfyUI/comfy_api/latest/_io.py", line 1892 in EXECUTE_NORMALIZED [22:14] [ComfyUI] File "/tmp/comfyui_pvenv_r05k2fkl/persistent_worker.py", line 1762 in main [22:14] [ComfyUI] File "/tmp/comfyui_pvenv_r05k2fkl/persistent_worker.py", line 1807 in [22:14] [ComfyUI] [22:14] [ComfyUI] [worker:ComfyUI-Sharp] === END === [22:14] [ComfyUI] [23:14] [ComfyUI] [worker:ComfyUI-Sharp] [23:14] [ComfyUI] === WATCHDOG TICK 8 === [23:14] [ComfyUI] [worker:ComfyUI-Sharp] Thread 0x00007fd5aa3976c0 (most recent call first): [23:14] [ComfyUI] File "/home/runner/.ce/.pixi/envs/sharp-nodes/lib/python3.10/socket.py", line 293 in accept [23:14] [ComfyUI] File "/home/runner/.ce/.pixi/envs/sharp-nodes/lib/python3.10/multiprocessing/connection.py", line 609 in accept [23:14] [ComfyUI] File "/home/runner/.ce/.pixi/envs/sharp-nodes/lib/python3.10/multiprocessing/connection.py", line 463 in accept [23:14] [ComfyUI] File "/home/runner/.ce/.pixi/envs/sharp-nodes/lib/python3.10/multiprocessing/resource_sharer.py", line 138 in _serve [23:14] [ComfyUI] File "/home/runner/.ce/.pixi/envs/sharp-nodes/lib/python3.10/threading.py", line 953 in run [23:14] [ComfyUI] File "/home/runner/.ce/.pixi/envs/sharp-nodes/lib/python3.10/threading.py", line 1016 in _bootstrap_inner [23:14] [ComfyUI] File "/home/runner/.ce/.pixi/envs/sharp-nodes/lib/python3.10/threading.py", line 973 in _bootstrap [23:14] [ComfyUI] [23:14] [ComfyUI] Current thread 0x00007fd6d0ea76c0 (most recent call first): [23:14] [ComfyUI] File "/tmp/comfyui_pvenv_r05k2fkl/persistent_worker.py", line 52 in _watchdog [23:14] [ComfyUI] File "/home/runner/.ce/.pixi/envs/sharp-nodes/lib/python3.10/threading.py", line 953 in run [23:14] [ComfyUI] File "/home/runner/.ce/.pixi/envs/sharp-nodes/lib/python3.10/threading.py", line 1016 in _bootstrap_inner [23:14] [ComfyUI] File "/home/runner/.ce/.pixi/envs/sharp-nodes/lib/python3.10/threading.py", line 973 in _bootstrap [23:14] [ComfyUI] [23:14] [ComfyUI] Thread 0x00007fd6d197a740 (most recent call first): [23:14] [ComfyUI] File "/home/runner/work/comfy-gpu-ci/comfy-gpu-ci/test_workspaces/Sharp-2000/ComfyUI/comfy/ldm/modules/sub_quadratic_attention.py", line 170 in _get_attention_scores_no_kv_chunking [23:14] [ComfyUI] File "/home/runner/work/comfy-gpu-ci/comfy-gpu-ci/test_workspaces/Sharp-2000/ComfyUI/comfy/ldm/modules/sub_quadratic_attention.py", line 259 in efficient_dot_product_attention [23:14] [ComfyUI] File "/home/runner/work/comfy-gpu-ci/comfy-gpu-ci/test_workspaces/Sharp-2000/ComfyUI/comfy/ldm/modules/attention.py", line 275 in attention_sub_quad [23:14] [ComfyUI] File "/home/runner/work/comfy-gpu-ci/comfy-gpu-ci/test_workspaces/Sharp-2000/ComfyUI/comfy/ldm/modules/attention.py", line 139 in wrapper [23:14] [ComfyUI] File "/home/runner/work/comfy-gpu-ci/comfy-gpu-ci/test_workspaces/Sharp-2000/ComfyUI/custom_nodes/ComfyUI-Sharp/nodes/sharp/model.py", line 234 in forward [23:14] [ComfyUI] File "/home/runner/.ce/.pixi/envs/sharp-nodes/lib/python3.10/site-packages/torch/nn/modules/module.py", line 1787 in _call_impl [23:14] [ComfyUI] File "/home/runner/.ce/.pixi/envs/sharp-nodes/lib/python3.10/site-packages/torch/nn/modules/module.py", line 1776 in _wrapped_call_impl [23:14] [ComfyUI] File "/home/runner/work/comfy-gpu-ci/comfy-gpu-ci/test_workspaces/Sharp-2000/ComfyUI/custom_nodes/ComfyUI-Sharp/nodes/sharp/model.py", line 309 in forward [23:14] [ComfyUI] File "/home/runner/.ce/.pixi/envs/sharp-nodes/lib/python3.10/site-packages/torch/nn/modules/module.py", line 1787 in _call_impl [23:14] [ComfyUI] File "/home/runner/.ce/.pixi/envs/sharp-nodes/lib/python3.10/site-packages/torch/nn/modules/module.py", line 1776 in _wrapped_call_impl [23:14] [ComfyUI] File "/home/runner/work/comfy-gpu-ci/comfy-gpu-ci/test_workspaces/Sharp-2000/ComfyUI/custom_nodes/ComfyUI-Sharp/nodes/sharp/model.py", line 412 in forward [23:14] [ComfyUI] File "/home/runner/.ce/.pixi/envs/sharp-nodes/lib/python3.10/site-packages/torch/nn/modules/module.py", line 1787 in _call_impl [23:14] [ComfyUI] File "/home/runner/.ce/.pixi/envs/sharp-nodes/lib/python3.10/site-packages/torch/nn/modules/module.py", line 1776 in _wrapped_call_impl [23:14] [ComfyUI] File "/home/runner/work/comfy-gpu-ci/comfy-gpu-ci/test_workspaces/Sharp-2000/ComfyUI/custom_nodes/ComfyUI-Sharp/nodes/sharp/model.py", line 685 in forward [23:14] [ComfyUI] File "/home/runner/.ce/.pixi/envs/sharp-nodes/lib/python3.10/site-packages/torch/nn/modules/module.py", line 1787 in _call_impl [23:14] [ComfyUI] File "/home/runner/.ce/.pixi/envs/sharp-nodes/lib/python3.10/site-packages/torch/nn/modules/module.py", line 1776 in _wrapped_call_impl [23:14] [ComfyUI] File "/home/runner/work/comfy-gpu-ci/comfy-gpu-ci/test_workspaces/Sharp-2000/ComfyUI/custom_nodes/ComfyUI-Sharp/nodes/sharp/model.py", line 1109 in forward [23:14] [ComfyUI] File "/home/runner/.ce/.pixi/envs/sharp-nodes/lib/python3.10/site-packages/torch/nn/modules/module.py", line 1787 in _call_impl [23:14] [ComfyUI] File "/home/runner/.ce/.pixi/envs/sharp-nodes/lib/python3.10/site-packages/torch/nn/modules/module.py", line 1776 in _wrapped_call_impl [23:14] [ComfyUI] File "/home/runner/work/comfy-gpu-ci/comfy-gpu-ci/test_workspaces/Sharp-2000/ComfyUI/custom_nodes/ComfyUI-Sharp/nodes/sharp/model.py", line 2006 in encode [23:14] [ComfyUI] File "/home/runner/work/comfy-gpu-ci/comfy-gpu-ci/test_workspaces/Sharp-2000/ComfyUI/custom_nodes/ComfyUI-Sharp/nodes/predict_metric_depth.py", line 231 in execute [23:14] [ComfyUI] File "/home/runner/.ce/.pixi/envs/sharp-nodes/lib/python3.10/site-packages/torch/utils/_contextlib.py", line 124 in decorate_context [23:14] [ComfyUI] File "/home/runner/work/comfy-gpu-ci/comfy-gpu-ci/test_workspaces/Sharp-2000/ComfyUI/comfy_api/latest/_io.py", line 1892 in EXECUTE_NORMALIZED [23:14] [ComfyUI] File "/tmp/comfyui_pvenv_r05k2fkl/persistent_worker.py", line 1762 in main [23:14] [ComfyUI] File "/tmp/comfyui_pvenv_r05k2fkl/persistent_worker.py", line 1807 in [23:14] [ComfyUI] [23:14] [ComfyUI] [worker:ComfyUI-Sharp] === END === [23:14] [ComfyUI] [24:14] [ComfyUI] [worker:ComfyUI-Sharp] [24:14] [ComfyUI] === WATCHDOG TICK 9 === [24:14] [ComfyUI] [worker:ComfyUI-Sharp] Thread 0x00007fd5aa3976c0 (most recent call first): [24:14] [ComfyUI] File "/home/runner/.ce/.pixi/envs/sharp-nodes/lib/python3.10/socket.py", line 293 in accept [24:14] [ComfyUI] File "/home/runner/.ce/.pixi/envs/sharp-nodes/lib/python3.10/multiprocessing/connection.py", line 609 in accept [24:14] [ComfyUI] File "/home/runner/.ce/.pixi/envs/sharp-nodes/lib/python3.10/multiprocessing/connection.py", line 463 in accept [24:14] [ComfyUI] File "/home/runner/.ce/.pixi/envs/sharp-nodes/lib/python3.10/multiprocessing/resource_sharer.py", line 138 in _serve [24:14] [ComfyUI] File "/home/runner/.ce/.pixi/envs/sharp-nodes/lib/python3.10/threading.py", line 953 in run [24:14] [ComfyUI] File "/home/runner/.ce/.pixi/envs/sharp-nodes/lib/python3.10/threading.py", line 1016 in _bootstrap_inner [24:14] [ComfyUI] File "/home/runner/.ce/.pixi/envs/sharp-nodes/lib/python3.10/threading.py", line 973 in _bootstrap [24:14] [ComfyUI] [24:14] [ComfyUI] Current thread 0x00007fd6d0ea76c0 (most recent call first): [24:14] [ComfyUI] File "/tmp/comfyui_pvenv_r05k2fkl/persistent_worker.py", line 52 in _watchdog [24:14] [ComfyUI] File "/home/runner/.ce/.pixi/envs/sharp-nodes/lib/python3.10/threading.py", line 953 in run [24:14] [ComfyUI] File "/home/runner/.ce/.pixi/envs/sharp-nodes/lib/python3.10/threading.py", line 1016 in _bootstrap_inner [24:14] [ComfyUI] File "/home/runner/.ce/.pixi/envs/sharp-nodes/lib/python3.10/threading.py", line 973 in _bootstrap [24:14] [ComfyUI] [24:14] [ComfyUI] Thread 0x00007fd6d197a740 (most recent call first): [24:14] [ComfyUI] File "/home/runner/.ce/.pixi/envs/sharp-nodes/lib/python3.10/site-packages/torch/nn/modules/conv.py", line 548 in _conv_forward [24:14] [ComfyUI] File "/home/runner/.ce/.pixi/envs/sharp-nodes/lib/python3.10/site-packages/torch/nn/modules/conv.py", line 553 in forward [24:14] [ComfyUI] File "/home/runner/work/comfy-gpu-ci/comfy-gpu-ci/test_workspaces/Sharp-2000/ComfyUI/comfy/ops.py", line 537 in forward [24:14] [ComfyUI] File "/home/runner/.ce/.pixi/envs/sharp-nodes/lib/python3.10/site-packages/torch/nn/modules/module.py", line 1787 in _call_impl [24:14] [ComfyUI] File "/home/runner/.ce/.pixi/envs/sharp-nodes/lib/python3.10/site-packages/torch/nn/modules/module.py", line 1776 in _wrapped_call_impl [24:14] [ComfyUI] File "/home/runner/.ce/.pixi/envs/sharp-nodes/lib/python3.10/site-packages/torch/nn/modules/container.py", line 253 in forward [24:14] [ComfyUI] File "/home/runner/.ce/.pixi/envs/sharp-nodes/lib/python3.10/site-packages/torch/nn/modules/module.py", line 1787 in _call_impl [24:14] [ComfyUI] File "/home/runner/.ce/.pixi/envs/sharp-nodes/lib/python3.10/site-packages/torch/nn/modules/module.py", line 1776 in _wrapped_call_impl [24:14] [ComfyUI] File "/home/runner/work/comfy-gpu-ci/comfy-gpu-ci/test_workspaces/Sharp-2000/ComfyUI/custom_nodes/ComfyUI-Sharp/nodes/sharp/model.py", line 766 in forward [24:14] [ComfyUI] File "/home/runner/.ce/.pixi/envs/sharp-nodes/lib/python3.10/site-packages/torch/nn/modules/module.py", line 1787 in _call_impl [24:14] [ComfyUI] File "/home/runner/.ce/.pixi/envs/sharp-nodes/lib/python3.10/site-packages/torch/nn/modules/module.py", line 1776 in _wrapped_call_impl [24:14] [ComfyUI] File "/home/runner/work/comfy-gpu-ci/comfy-gpu-ci/test_workspaces/Sharp-2000/ComfyUI/custom_nodes/ComfyUI-Sharp/nodes/sharp/model.py", line 860 in forward [24:14] [ComfyUI] File "/home/runner/.ce/.pixi/envs/sharp-nodes/lib/python3.10/site-packages/torch/nn/modules/module.py", line 1787 in _call_impl [24:14] [ComfyUI] File "/home/runner/.ce/.pixi/envs/sharp-nodes/lib/python3.10/site-packages/torch/nn/modules/module.py", line 1776 in _wrapped_call_impl [24:14] [ComfyUI] File "/home/runner/work/comfy-gpu-ci/comfy-gpu-ci/test_workspaces/Sharp-2000/ComfyUI/custom_nodes/ComfyUI-Sharp/nodes/sharp/model.py", line 970 in forward [24:14] [ComfyUI] File "/home/runner/.ce/.pixi/envs/sharp-nodes/lib/python3.10/site-packages/torch/nn/modules/module.py", line 1787 in _call_impl [24:14] [ComfyUI] File "/home/runner/.ce/.pixi/envs/sharp-nodes/lib/python3.10/site-packages/torch/nn/modules/module.py", line 1776 in _wrapped_call_impl [24:14] [ComfyUI] File "/home/runner/work/comfy-gpu-ci/comfy-gpu-ci/test_workspaces/Sharp-2000/ComfyUI/custom_nodes/ComfyUI-Sharp/nodes/sharp/model.py", line 1118 in forward [24:14] [ComfyUI] File "/home/runner/.ce/.pixi/envs/sharp-nodes/lib/python3.10/site-packages/torch/nn/modules/module.py", line 1787 in _call_impl [24:14] [ComfyUI] File "/home/runner/.ce/.pixi/envs/sharp-nodes/lib/python3.10/site-packages/torch/nn/modules/module.py", line 1776 in _wrapped_call_impl [24:14] [ComfyUI] File "/home/runner/work/comfy-gpu-ci/comfy-gpu-ci/test_workspaces/Sharp-2000/ComfyUI/custom_nodes/ComfyUI-Sharp/nodes/sharp/model.py", line 2006 in encode [24:14] [ComfyUI] File "/home/runner/work/comfy-gpu-ci/comfy-gpu-ci/test_workspaces/Sharp-2000/ComfyUI/custom_nodes/ComfyUI-Sharp/nodes/predict_metric_depth.py", line 231 in execute [24:14] [ComfyUI] File "/home/runner/.ce/.pixi/envs/sharp-nodes/lib/python3.10/site-packages/torch/utils/_contextlib.py", line 124 in decorate_context [24:14] [ComfyUI] File "/home/runner/work/comfy-gpu-ci/comfy-gpu-ci/test_workspaces/Sharp-2000/ComfyUI/comfy_api/latest/_io.py", line 1892 in EXECUTE_NORMALIZED [24:14] [ComfyUI] File "/tmp/comfyui_pvenv_r05k2fkl/persistent_worker.py", line 1762 in main [24:14] [ComfyUI] File "/tmp/comfyui_pvenv_r05k2fkl/persistent_worker.py", line 1807 in [24:14] [ComfyUI] [24:14] [ComfyUI] [worker:ComfyUI-Sharp] === END === [24:14] [ComfyUI] [25:14] [ComfyUI] [worker:ComfyUI-Sharp] [25:14] [ComfyUI] === WATCHDOG TICK 10 === [25:14] [ComfyUI] [worker:ComfyUI-Sharp] Thread 0x00007fd5aa3976c0 (most recent call first): [25:14] [ComfyUI] File "/home/runner/.ce/.pixi/envs/sharp-nodes/lib/python3.10/socket.py", line 293 in accept [25:14] [ComfyUI] File "/home/runner/.ce/.pixi/envs/sharp-nodes/lib/python3.10/multiprocessing/connection.py", line 609 in accept [25:14] [ComfyUI] File "/home/runner/.ce/.pixi/envs/sharp-nodes/lib/python3.10/multiprocessing/connection.py", line 463 in accept [25:14] [ComfyUI] File "/home/runner/.ce/.pixi/envs/sharp-nodes/lib/python3.10/multiprocessing/resource_sharer.py", line 138 in _serve [25:14] [ComfyUI] File "/home/runner/.ce/.pixi/envs/sharp-nodes/lib/python3.10/threading.py", line 953 in run [25:14] [ComfyUI] File "/home/runner/.ce/.pixi/envs/sharp-nodes/lib/python3.10/threading.py", line 1016 in _bootstrap_inner [25:14] [ComfyUI] File "/home/runner/.ce/.pixi/envs/sharp-nodes/lib/python3.10/threading.py", line 973 in _bootstrap [25:14] [ComfyUI] [25:14] [ComfyUI] Current thread 0x00007fd6d0ea76c0 (most recent call first): [25:14] [ComfyUI] File "/tmp/comfyui_pvenv_r05k2fkl/persistent_worker.py", line 52 in _watchdog [25:14] [ComfyUI] File "/home/runner/.ce/.pixi/envs/sharp-nodes/lib/python3.10/threading.py", line 953 in run [25:14] [ComfyUI] File "/home/runner/.ce/.pixi/envs/sharp-nodes/lib/python3.10/threading.py", line 1016 in _bootstrap_inner [25:14] [ComfyUI] File "/home/runner/.ce/.pixi/envs/sharp-nodes/lib/python3.10/threading.py", line 973 in _bootstrap [25:14] [ComfyUI] [25:14] [ComfyUI] Thread 0x00007fd6d197a740 (most recent call first): [25:14] [ComfyUI] File "/home/runner/.ce/.pixi/envs/sharp-nodes/lib/python3.10/site-packages/torch/nn/modules/conv.py", line 548 in _conv_forward [25:14] [ComfyUI] File "/home/runner/.ce/.pixi/envs/sharp-nodes/lib/python3.10/site-packages/torch/nn/modules/conv.py", line 553 in forward [25:14] [ComfyUI] File "/home/runner/work/comfy-gpu-ci/comfy-gpu-ci/test_workspaces/Sharp-2000/ComfyUI/comfy/ops.py", line 537 in forward [25:14] [ComfyUI] File "/home/runner/.ce/.pixi/envs/sharp-nodes/lib/python3.10/site-packages/torch/nn/modules/module.py", line 1787 in _call_impl [25:14] [ComfyUI] File "/home/runner/.ce/.pixi/envs/sharp-nodes/lib/python3.10/site-packages/torch/nn/modules/module.py", line 1776 in _wrapped_call_impl [25:14] [ComfyUI] File "/home/runner/.ce/.pixi/envs/sharp-nodes/lib/python3.10/site-packages/torch/nn/modules/container.py", line 253 in forward [25:14] [ComfyUI] File "/home/runner/.ce/.pixi/envs/sharp-nodes/lib/python3.10/site-packages/torch/nn/modules/module.py", line 1787 in _call_impl [25:14] [ComfyUI] File "/home/runner/.ce/.pixi/envs/sharp-nodes/lib/python3.10/site-packages/torch/nn/modules/module.py", line 1776 in _wrapped_call_impl [25:14] [ComfyUI] File "/home/runner/work/comfy-gpu-ci/comfy-gpu-ci/test_workspaces/Sharp-2000/ComfyUI/custom_nodes/ComfyUI-Sharp/nodes/sharp/model.py", line 1120 in forward [25:14] [ComfyUI] File "/home/runner/.ce/.pixi/envs/sharp-nodes/lib/python3.10/site-packages/torch/nn/modules/module.py", line 1787 in _call_impl [25:14] [ComfyUI] File "/home/runner/.ce/.pixi/envs/sharp-nodes/lib/python3.10/site-packages/torch/nn/modules/module.py", line 1776 in _wrapped_call_impl [25:14] [ComfyUI] File "/home/runner/work/comfy-gpu-ci/comfy-gpu-ci/test_workspaces/Sharp-2000/ComfyUI/custom_nodes/ComfyUI-Sharp/nodes/sharp/model.py", line 2006 in encode [25:14] [ComfyUI] File "/home/runner/work/comfy-gpu-ci/comfy-gpu-ci/test_workspaces/Sharp-2000/ComfyUI/custom_nodes/ComfyUI-Sharp/nodes/predict_metric_depth.py", line 231 in execute [25:14] [ComfyUI] File "/home/runner/.ce/.pixi/envs/sharp-nodes/lib/python3.10/site-packages/torch/utils/_contextlib.py", line 124 in decorate_context [25:14] [ComfyUI] File "/home/runner/work/comfy-gpu-ci/comfy-gpu-ci/test_workspaces/Sharp-2000/ComfyUI/comfy_api/latest/_io.py", line 1892 in EXECUTE_NORMALIZED [25:14] [ComfyUI] File "/tmp/comfyui_pvenv_r05k2fkl/persistent_worker.py", line 1762 in main [25:14] [ComfyUI] File "/tmp/comfyui_pvenv_r05k2fkl/persistent_worker.py", line 1807 in [25:14] [ComfyUI] [25:14] [ComfyUI] [worker:ComfyUI-Sharp] === END === [25:14] [ComfyUI] [25:16] [ComfyUI] [worker:ComfyUI-Sharp] [SharpPredictMetricDepth] 1 face(s) @ 1536²; layer0/layer1 depth median=2.12/2.12m, K_1536 fx->1286.7; points_raw ||v||=1.32–3.07m; 291.1s [25:16] [ComfyUI] [SubprocessWorker] got response: ok [25:16] [ComfyUI] [comfy-env] SharpPredictMetricDepth done (291.29s): result: NodeOutput [25:16] [ComfyUI] [comfy-env] Running SharpPredictGaussiansFromMetricDepth: snap_to_external_depth: 'none', depth_convention: 'planar_z', focal_length_mm: 30.0, output_prefix: 'sharp_aligned', save_background_layer: True, edge_crop: 0.0, model: dict, image: torch.float32 [1,960,1416,3] cpu, metric_depth_layer0: torch.float32 [1,1536,1536,3] cpu [25:16] [ComfyUI] [SubprocessWorker] call_method: nodes.predict_gaussians_from_depth.SharpPredictGaussiansFromMetricDepth.EXECUTE_NORMALIZED [25:16] [ComfyUI] [SubprocessWorker] acquired lock, ensuring started... [25:16] [ComfyUI] [ComfyUI-Sharp] Health check: ping (timeout=5.0s)... [25:16] [ComfyUI] [ComfyUI-Sharp] Health check: ok [25:16] [ComfyUI] [SubprocessWorker] worker started/confirmed [25:16] [ComfyUI] [comfy-env] PRE-SERIALIZE 'image' shape: torch.Size([1, 960, 1416, 3]) [25:16] [ComfyUI] [comfy-env] PRE-SERIALIZE 'metric_depth_layer0' shape: torch.Size([1, 1536, 1536, 3]) [25:16] [ComfyUI] [SubprocessWorker] serializing kwargs to shm... [25:16] [ComfyUI] [SubprocessWorker] created 0 shm blocks [25:16] [ComfyUI] [SubprocessWorker] sending request via socket... [25:16] [ComfyUI] [SubprocessWorker] call_id=9 sending call_method [25:16] [ComfyUI] [worker:ComfyUI-Sharp] [comfy-env] _from_shm got dict with keys: ['__type__', 'strategy', 'parent_pid', 'fd', 'storage_size'] [25:16] [ComfyUI] [worker:ComfyUI-Sharp] [comfy-env] DESERIALIZE TensorRef: tensor_size=[1, 960, 1416, 3] [25:16] [ComfyUI] [worker:ComfyUI-Sharp] [comfy-env] DESERIALIZED tensor shape: torch.Size([1, 960, 1416, 3]) [25:16] [ComfyUI] [worker:ComfyUI-Sharp] [comfy-env] _from_shm got dict with keys: ['__type__', 'strategy', 'parent_pid', 'fd', 'storage_size'] [25:16] [ComfyUI] [worker:ComfyUI-Sharp] [comfy-env] DESERIALIZE TensorRef: tensor_size=[1, 1536, 1536, 3] [25:16] [ComfyUI] [worker:ComfyUI-Sharp] [comfy-env] DESERIALIZED tensor shape: torch.Size([1, 1536, 1536, 3]) [25:16] [ComfyUI] [worker:ComfyUI-Sharp] [SharpPredictGaussiansFromMetricDepth] metric_depth_layer1 unwired -> layer 1 will duplicate layer 0 (legacy behavior) [25:16] [ComfyUI] [SubprocessWorker] callback 'request_vram_budget' from call_id=9 [25:16] [ComfyUI] [comfy-env] VRAM request: 2.81GB, free before eviction: 7.99GB [25:16] [ComfyUI] [comfy-env] VRAM after eviction: 7.99GB [25:16] [ComfyUI] [worker:ComfyUI-Sharp] [SharpPredictGaussiansFromMetricDepth] face 1/1: 1416×960, extrinsics=none, intrinsics=none, mask=no, snap=none, depth_conv=planar_z [25:44] Frame 7 saved (frame_006.jpg, t=593.8s) [25:44] [capture-periodic] freeze=18600ms shot=18056ms unfreeze=3ms saved=True [26:01] [ComfyUI] [SubprocessWorker] callback 'report_progress' from call_id=9 [26:01] [ComfyUI] [worker:ComfyUI-Sharp] [SharpPredictGaussiansFromMetricDepth] 1 face(s) -> 1.18M gaussians total (both layers, snap=none); saved to /home/runner/work/comfy-gpu-ci/comfy-gpu-ci/test_workspaces/Sharp-2000/ComfyUI/output/sharp_aligned_1780863970436.ply; 45.0s [26:01] [ComfyUI] [SubprocessWorker] got response: ok [26:01] [ComfyUI] [comfy-env] SharpPredictGaussiansFromMetricDepth done (45.17s): result: NodeOutput [26:01] [ComfyUI] [comfy-env] Running PreviewGaussianSharp: ply_path: '/home/runner/work/comfy-gpu-ci/comfy-gpu-ci/test_workspa..., extrinsics: list[4], intrinsics: list[3] [26:01] [ComfyUI] [SubprocessWorker] call_method: nodes.preview_gaussian_sharp.PreviewGaussianSharp.EXECUTE_NORMALIZED [26:01] [ComfyUI] [SubprocessWorker] acquired lock, ensuring started... [26:01] [ComfyUI] [ComfyUI-GaussianPack] Health check: ping (timeout=5.0s)... [26:01] [ComfyUI] [ComfyUI-GaussianPack] Health check: failed [26:01] [ComfyUI] [ComfyUI-GaussianPack] Socket unhealthy, restarting worker... [26:01] [ComfyUI] [ComfyUI-GaussianPack] python: /home/runner/.ce/.pixi/envs/gaussianpack-nodes/bin/python [26:01] [ComfyUI] [ComfyUI-GaussianPack] sys_path sent to worker: ['/home/runner/work/comfy-gpu-ci/comfy-gpu-ci/test_workspaces/Sharp-2000/ComfyUI', '/home/runner/work/comfy-gpu-ci/comfy-gpu-ci/test_workspaces/Sharp-2000/ComfyUI/custom_nodes/ComfyUI-GaussianPack', '/home/runner/.ce/.pixi/envs/gaussianpack-nodes/lib/python3.10/site-packages', '/home/runner/work/comfy-gpu-ci/comfy-gpu-ci/test_workspaces/Sharp-2000/ComfyUI/custom_nodes/ComfyUI-GaussianPack'] [26:01] [ComfyUI] [SubprocessWorker] is_pixi=True, python=/home/runner/.ce/.pixi/envs/gaussianpack-nodes/bin/python [26:01] [ComfyUI] [SubprocessWorker] launching cmd=['/home/runner/.pixi/bin/pixi', 'run', '--as-is', '--manifest-path', '/home/runner/.ce/pixi.toml', '-e', 'gaussianpack-nodes', 'python', '/tmp/comfyui_pvenv_g6q6yfx2/persistent_worker.py', 'abstract://comfy_worker_8becea7e807c']... [26:01] [ComfyUI] [SubprocessWorker] socket_addr=abstract://comfy_worker_8becea7e807c (abstract, no filesystem path) [26:03] [ComfyUI] [SubprocessWorker] worker started/confirmed [26:03] [ComfyUI] [SubprocessWorker] serializing kwargs to shm... [26:03] [ComfyUI] [SubprocessWorker] created 0 shm blocks [26:03] [ComfyUI] [SubprocessWorker] sending request via socket... [26:03] [ComfyUI] [SubprocessWorker] call_id=4 sending call_method [26:03] [ComfyUI] [worker:ComfyUI-GaussianPack] WARNING: SPZ route not registered (ModuleNotFoundError: No module named 'comfy_aimdo') [26:03] [ComfyUI] [SubprocessWorker] got response: ok [26:03] [ComfyUI] [comfy-env] PreviewGaussianSharp done (2.14s): result: NodeOutput [26:03] [ComfyUI] [INFO] Prompt executed in 00:10:49 [26:27] Frame 8 saved (frame_007.jpg, t=648.0s) [26:27] [capture-periodic] freeze=12359ms shot=13013ms unfreeze=92ms saved=True [26:37] Node executed (2 total), capturing... [26:58] Frame 9 saved (frame_008.jpg, t=683.9s) [26:58] [capture-node] freeze=10149ms shot=10644ms unfreeze=0ms saved=True [26:58] Execution complete (t=683.9s) [26:58] [3d-wait] Phase 1: Waiting for 'Loading 3D Model' text to disappear... [26:58] [3d-wait] Phase 1 done in 0.0s [26:58] [3d-wait] Phase 2: iframes=2 [26:58] [3d-wait] iframe viewer_ready=True (matched 2 console logs) [26:58] [3d-wait] Unfrozen in 0.001s, rendering for 5s... [27:19] [3d-wait] JS halted via CDP after 20.8s [27:50] [3d-wait] Re-frozen in 51.6s [27:50] [3d-wait] Total 3D wait: 51.6s [27:50] Captured 9 unique frames over 756.38s [27:50] [debug] iframes: 2 [27:50] [debug] iframe[0]: src=http://127.0.0.1:41882/extensions/ComfyUI-GaussianPack/viewer_gaussian_sharp.htm, canvas=1416x960, rafFrozen=True [27:50] [debug] iframe[1]: src=http://127.0.0.1:41882/extensions/ComfyUI-GaussianPack/viewer_gaussian_sharp.htm, canvas=1416x960, rafFrozen=True [27:50] [timing] trigger_3d_previews: 0.0s [27:52] Saved high-quality screenshot: vanilla_vs_image_depth_gaussians_executed.png [27:52] [timing] final_screenshot: 0.3s [27:52] [ComfyUI] [INFO] Using RAM pressure cache. [27:52] Results saved to /home/runner/work/comfy-gpu-ci/comfy-gpu-ci/comfy-test-logs/Sharp-2000/dev/linux-cpu/results.json [27:52] Model report: 4 files, 2.6 GB -> /home/runner/work/comfy-gpu-ci/comfy-gpu-ci/comfy-test-logs/Sharp-2000/dev/linux-cpu/models.json [27:52] Saved: /home/runner/work/comfy-gpu-ci/comfy-gpu-ci/comfy-test-logs/Sharp-2000/dev/linux-cpu/index.html [27:52] [EXECUTION] PASSED [27:52] linux: PASSED [27:52] Stopping ComfyUI server...