[00:00] Crash dump logging enabled: /logs/Sharp-2211/dev/linux-gpu/crash_dump.log [00:00] [00:00] [1/5] SYNTAX [00:00] ---------------------------------------- [00:00] [DEBUG] server=None, api=None [00:00] Found pyproject.toml (modern format) [00:00] Found requirements.txt (legacy format) [00:00] Unicode check: OK (all characters cp1252-safe) [00:00] Forbidden patterns check: OK [00:00] [SYNTAX] PASSED [00:00] [00:00] [2/5] INSTALL [00:00] ---------------------------------------- [00:00] [DEBUG] server=None, api=None [00:00] Setting up ComfyUI... [00:00] Creating virtual environment... [00:00] Running: uv venv /workspaces/Sharp-2211/.venv --python 3.11 [00:00] torch_version='2.10.0' -> pinning torch==2.10.0 torchvision==0.25.0 torchaudio==2.10.0 [00:00] Cloning ComfyUI (latest)... [00:00] Running: git clone --depth 1 https://github.com/comfyanonymous/ComfyUI.git /workspaces/Sharp-2211/ComfyUI [00:01] Pinning torch family from https://download.pytorch.org/whl/cu128: torch==2.10.0 torchvision==0.25.0 torchaudio==2.10.0 [00:01] Running: uv pip install --python /workspaces/Sharp-2211/.venv/bin/python --index-url https://download.pytorch.org/whl/cu128 --extra-index-url https://pypi.org/simple --index-strategy unsafe-best-match torch==2.10.0 torchvision==0.25.0 torchaudio==2.10.0 [02:21] Installing ComfyUI requirements... [02:21] Running: uv pip install --python /workspaces/Sharp-2211/.venv/bin/python --index-url https://download.pytorch.org/whl/cu128 --extra-index-url https://pypi.org/simple --index-strategy unsafe-best-match -r /workspaces/Sharp-2211/ComfyUI/requirements.txt [02:40] Installing custom node... [02:40] Copying ComfyUI-Sharp to custom_nodes/... [02:40] Installing node requirements... [02:40] Running: uv pip install --python /workspaces/Sharp-2211/.venv/bin/python --index-url https://download.pytorch.org/whl/cu128 --extra-index-url https://pypi.org/simple --index-strategy unsafe-best-match -r /workspaces/Sharp-2211/ComfyUI/custom_nodes/ComfyUI-Sharp/requirements.txt [02:42] Running install.py... [02:42] Running: /workspaces/Sharp-2211/.venv/bin/python /workspaces/Sharp-2211/ComfyUI/custom_nodes/ComfyUI-Sharp/install.py [02:43] [02:43] Installing 2 node dependencies... [02:43] Cloning ComfyUI-GaussianPack... [02:49] Installing requirements for ComfyUI-GaussianPack... [02:51] Running install.py for ComfyUI-GaussianPack... [02:57] [comfy-env] _discover: scanning /workspaces/Sharp-2211/ComfyUI/custom_nodes [02:57] [comfy-env] _discover: ComfyUI-GaussianPack -> gaussianpack-nodes (custom_nodes/ComfyUI-GaussianPack/nodes/comfy-env.toml) [02:57] [comfy-env] _discover: ComfyUI-Sharp -> sharp-nodes (custom_nodes/ComfyUI-Sharp/nodes/comfy-env.toml) [02:57] [comfy-env] Workspace: /tmp/comfytest-home/.ce [02:57] [comfy-env] ComfyUI: /workspaces/Sharp-2211/ComfyUI [02:57] [comfy-env] Found 2 node config(s): [02:57] - gaussianpack-nodes <- custom_nodes/ComfyUI-GaussianPack/nodes/comfy-env.toml (python=host) [02:57] - sharp-nodes <- custom_nodes/ComfyUI-Sharp/nodes/comfy-env.toml (python=host) [02:57] [comfy-env] Bootstrap interpreter has python 3.11 + torch 2.10.0 (cu128). Looking for cuda-only wheels matching cu128/torch2.10/cp311. [02:57] [comfy-env] GPU: Detection: smi [02:57] Driver: 580.126.20 [02:57] CUDA: 13.0 [02:57] Recommended: CUDA 13.0 [02:57] [02:57] GPU 0: NVIDIA GeForce RTX 3090 (sm_86) [Ampere] 24576MB [02:57] [comfy-env] Comfyui feature -> torch 2.10.0 from https://download.pytorch.org/whl/cu128 (CUDA 12.8 via bootstrap torch) [02:57] [comfy-env] cuda-wheels: 1 package(s) need a matched (cuda, torch, python) combo: ['gsplat'] [02:57] [comfy-env] cuda-wheels tier 1 (bootstrap): probing cu12.8/torch2.10/cp311 [02:57] [cuda-wheels] Looking up gsplat: cu128 torch2.10 cp311 manylinux linux [02:58] [cuda-wheels] Found: gsplat-1.5.3+cu128torch2.10-cp311-cp311-manylinux_2_34_x86_64.manylinux_2_35_x86_64.whl [02:58] [comfy-env] cuda-wheels combo: cu12.8/torch2.10 (bootstrap matches; per-node envs will pin to this) [02:58] [comfy-env] Host glibc 2.35 -> system-requirements [02:58] [cuda-wheels] Looking up gsplat: cu128 torch2.10 cp311 manylinux linux [02:58] [cuda-wheels] Found: gsplat-1.5.3+cu128torch2.10-cp311-cp311-manylinux_2_34_x86_64.manylinux_2_35_x86_64.whl [02:58] [comfy-env] gaussianpack-nodes: cuda-wheels deferred for post-pixi install (gsplat) [02:58] [cuda-wheels] Looking up gsplat: cu128 torch2.10 cp311 manylinux linux [02:58] [cuda-wheels] Found: gsplat-1.5.3+cu128torch2.10-cp311-cp311-manylinux_2_34_x86_64.manylinux_2_35_x86_64.whl [02:58] [comfy-env] sharp-nodes: cuda-wheels deferred for post-pixi install (gsplat) [02:58] Generated /tmp/comfytest-home/.ce/pixi.toml [02:58] [comfy-env] Installing 2 environment(s): [02:58] - gaussianpack-nodes (python=host, 8 pypi deps, 1 cuda wheels) [02:58] - sharp-nodes (python=host, 15 pypi deps, 1 cuda wheels) [02:58] [comfy-env] Running `pixi install -e gaussianpack-nodes -e sharp-nodes`... [03:02] WARN Skipped running the post-link scripts because `run-post-link-scripts` = `false` [03:02] - bin/.librsvg-pre-unlink.sh [03:02] To enable them, run: [03:02] pixi config set --local run-post-link-scripts insecure [03:02] More info: [03:02] https://pixi.sh/latest/reference/pixi_configuration/#run-post-link-scripts [03:08] WARN Skipped running the post-link scripts because `run-post-link-scripts` = `false` [03:08] - bin/.librsvg-pre-unlink.sh [03:08] To enable them, run: [03:08] pixi config set --local run-post-link-scripts insecure [03:08] More info: [03:08] https://pixi.sh/latest/reference/pixi_configuration/#run-post-link-scripts [04:37] The following environments have been installed: gaussianpack-nodes, sharp-nodes. [04:38] [comfy-env] gaussianpack-nodes: installing cuda-wheels with --no-deps (gsplat) [04:38] Using Python 3.11.15 environment at: .pixi/envs/gaussianpack-nodes [04:39] Resolved 1 package in 890ms [04:39] Downloading gsplat (33.9MiB) [04:40] Downloaded gsplat [04:40] Prepared 1 package in 988ms [04:41] Installed 1 package in 435ms [04:41] + gsplat==1.5.3+cu128torch2.10 (from https://github.com/PozzettiAndrea/cuda-wheels/releases/download/gsplat-latest/gsplat-1.5.3%2Bcu128torch2.10-cp311-cp311-manylinux_2_34_x86_64.manylinux_2_35_x86_64.whl) [04:41] [comfy-env] sharp-nodes: installing cuda-wheels with --no-deps (gsplat) [04:42] Using Python 3.11.15 environment at: .pixi/envs/sharp-nodes [04:42] Resolved 1 package in 976ms [04:43] Downloading gsplat (33.9MiB) [04:43] Downloaded gsplat [04:43] Prepared 1 package in 853ms [04:43] Installed 1 package in 301ms [04:43] + gsplat==1.5.3+cu128torch2.10 (from https://github.com/PozzettiAndrea/cuda-wheels/releases/download/gsplat-latest/gsplat-1.5.3%2Bcu128torch2.10-cp311-cp311-manylinux_2_34_x86_64.manylinux_2_35_x86_64.whl) [04:43] [comfy-env] Recorded install hash fbd9bcb6ce25 -> /tmp/comfytest-home/.ce/install.hash [04:43] [comfy-env] Install log: /tmp/comfytest-home/.ce/install.log [04:43] [04:43] Installation complete! [04:43] Cloning ComfyUI-PanoPack... [05:51] Installing requirements for ComfyUI-PanoPack... [05:51] Running install.py for ComfyUI-PanoPack... [05:51] [05:51] Installing 2 node dependencies... [05:51] Cloning ComfyUI-MoGe2... [06:02] Installing requirements for ComfyUI-MoGe2... [06:02] Running install.py for ComfyUI-MoGe2... [06:02] [comfy-env] _discover: scanning /workspaces/Sharp-2211/ComfyUI/custom_nodes [06:02] [comfy-env] _discover: ComfyUI-GaussianPack -> gaussianpack-nodes (custom_nodes/ComfyUI-GaussianPack/nodes/comfy-env.toml) [06:02] [comfy-env] _discover: ComfyUI-MoGe2 -> moge2-nodes (custom_nodes/ComfyUI-MoGe2/nodes/comfy-env.toml) [06:02] [comfy-env] _discover: ComfyUI-PanoPack -> panopack-nodes (custom_nodes/ComfyUI-PanoPack/nodes/comfy-env.toml) [06:02] [comfy-env] _discover: ComfyUI-Sharp -> sharp-nodes (custom_nodes/ComfyUI-Sharp/nodes/comfy-env.toml) [06:02] [comfy-env] Workspace: /tmp/comfytest-home/.ce [06:02] [comfy-env] ComfyUI: /workspaces/Sharp-2211/ComfyUI [06:02] [comfy-env] Found 4 node config(s): [06:02] - gaussianpack-nodes <- custom_nodes/ComfyUI-GaussianPack/nodes/comfy-env.toml (python=host) [06:02] - moge2-nodes <- custom_nodes/ComfyUI-MoGe2/nodes/comfy-env.toml (python=host) [06:02] - panopack-nodes <- custom_nodes/ComfyUI-PanoPack/nodes/comfy-env.toml (python=host) [06:02] - sharp-nodes <- custom_nodes/ComfyUI-Sharp/nodes/comfy-env.toml (python=host) [06:02] [comfy-env] Bootstrap interpreter has python 3.11 + torch 2.10.0 (cu128). Looking for cuda-only wheels matching cu128/torch2.10/cp311. [06:02] [comfy-env] GPU: Detection: smi [06:02] Driver: 580.126.20 [06:02] CUDA: 13.0 [06:02] Recommended: CUDA 13.0 [06:02] [06:02] GPU 0: NVIDIA GeForce RTX 3090 (sm_86) [Ampere] 24576MB [06:02] [comfy-env] Comfyui feature -> torch 2.10.0 from https://download.pytorch.org/whl/cu128 (CUDA 12.8 via bootstrap torch) [06:02] [comfy-env] cuda-wheels: 3 package(s) need a matched (cuda, torch, python) combo: ['gsplat', 'sageattention', 'flash_attn'] [06:02] [comfy-env] cuda-wheels tier 1 (bootstrap): probing cu12.8/torch2.10/cp311 [06:02] [cuda-wheels] Looking up gsplat: cu128 torch2.10 cp311 manylinux linux [06:02] [cuda-wheels] Found: gsplat-1.5.3+cu128torch2.10-cp311-cp311-manylinux_2_34_x86_64.manylinux_2_35_x86_64.whl [06:02] [cuda-wheels] Looking up sageattention: cu128 torch2.10 cp311 manylinux linux [06:02] [cuda-wheels] Found: sageattention-2.2.0+cu128torch2.10-cp311-cp311-manylinux_2_34_x86_64.manylinux_2_35_x86_64.whl [06:02] [cuda-wheels] Looking up flash_attn: cu128 torch2.10 cp311 manylinux linux [06:02] [cuda-wheels] Found: flash_attn-2.8.3+cu128torch2.10-cp311-cp311-manylinux_2_24_x86_64.manylinux_2_28_x86_64.whl [06:02] [comfy-env] cuda-wheels combo: cu12.8/torch2.10 (bootstrap matches; per-node envs will pin to this) [06:02] [comfy-env] Host glibc 2.35 -> system-requirements [06:02] [cuda-wheels] Looking up gsplat: cu128 torch2.10 cp311 manylinux linux [06:03] [cuda-wheels] Found: gsplat-1.5.3+cu128torch2.10-cp311-cp311-manylinux_2_34_x86_64.manylinux_2_35_x86_64.whl [06:03] [comfy-env] gaussianpack-nodes: cuda-wheels deferred for post-pixi install (gsplat) [06:03] [cuda-wheels] Looking up sageattention: cu128 torch2.10 cp311 manylinux linux [06:03] [cuda-wheels] Found: sageattention-2.2.0+cu128torch2.10-cp311-cp311-manylinux_2_34_x86_64.manylinux_2_35_x86_64.whl [06:03] [cuda-wheels] Looking up flash_attn: cu128 torch2.10 cp311 manylinux linux [06:03] [cuda-wheels] Found: flash_attn-2.8.3+cu128torch2.10-cp311-cp311-manylinux_2_24_x86_64.manylinux_2_28_x86_64.whl [06:03] [comfy-env] moge2-nodes: cuda-wheels deferred for post-pixi install (sageattention, flash_attn) [06:03] [cuda-wheels] Looking up gsplat: cu128 torch2.10 cp311 manylinux linux [06:03] [cuda-wheels] Found: gsplat-1.5.3+cu128torch2.10-cp311-cp311-manylinux_2_34_x86_64.manylinux_2_35_x86_64.whl [06:03] [comfy-env] sharp-nodes: cuda-wheels deferred for post-pixi install (gsplat) [06:03] Generated /tmp/comfytest-home/.ce/pixi.toml [06:03] [comfy-env] Installing 4 environment(s): [06:03] - gaussianpack-nodes (python=host, 8 pypi deps, 1 cuda wheels) [06:03] - moge2-nodes (python=host, 12 pypi deps, 2 cuda wheels) [06:03] - panopack-nodes (python=host, 21 pypi deps) [06:03] - sharp-nodes (python=host, 15 pypi deps, 1 cuda wheels) [06:03] [comfy-env] Running `pixi install -e gaussianpack-nodes -e moge2-nodes -e panopack-nodes -e sharp-nodes`... [06:08] WARN Skipped running the post-link scripts because `run-post-link-scripts` = `false` [06:08] - bin/.librsvg-pre-unlink.sh [06:08] To enable them, run: [06:08] pixi config set --local run-post-link-scripts insecure [06:08] More info: [06:08] https://pixi.sh/latest/reference/pixi_configuration/#run-post-link-scripts [06:08] WARN Skipped running the post-link scripts because `run-post-link-scripts` = `false` [06:08] - bin/.librsvg-pre-unlink.sh [06:09] To enable them, run: [06:09] pixi config set --local run-post-link-scripts insecure [06:09] More info: [06:09] https://pixi.sh/latest/reference/pixi_configuration/#run-post-link-scripts [06:11] The following environments have been installed: gaussianpack-nodes, moge2-nodes, panopack-nodes, sharp-nodes. [06:11] [comfy-env] gaussianpack-nodes: installing cuda-wheels with --no-deps (gsplat) [06:11] Using Python 3.11.15 environment at: .pixi/envs/gaussianpack-nodes [06:12] Resolved 1 package in 845ms [06:12] Checked 1 package in 0.07ms [06:12] [comfy-env] moge2-nodes: installing cuda-wheels with --no-deps (sageattention, flash_attn) [06:12] Using Python 3.11.15 environment at: .pixi/envs/moge2-nodes [06:14] Resolved 2 packages in 1.51s [06:14] Downloading sageattention (53.2MiB) [06:14] Downloading flash-attn (241.9MiB) [06:16] Downloaded sageattention [06:20] Downloaded flash-attn [06:20] Prepared 2 packages in 6.29s [06:20] Installed 2 packages in 81ms [06:20] + flash-attn==2.8.3+cu128torch2.10 (from https://github.com/PozzettiAndrea/cuda-wheels/releases/download/flash_attn-latest/flash_attn-2.8.3%2Bcu128torch2.10-cp311-cp311-manylinux_2_24_x86_64.manylinux_2_28_x86_64.whl) [06:20] + sageattention==2.2.0+cu128torch2.10 (from https://github.com/PozzettiAndrea/cuda-wheels/releases/download/sageattention-latest/sageattention-2.2.0%2Bcu128torch2.10-cp311-cp311-manylinux_2_34_x86_64.manylinux_2_35_x86_64.whl) [06:20] [comfy-env] sharp-nodes: installing cuda-wheels with --no-deps (gsplat) [06:20] Using Python 3.11.15 environment at: .pixi/envs/sharp-nodes [06:21] Resolved 1 package in 743ms [06:21] Checked 1 package in 0.07ms [06:21] [comfy-env] Recorded install hash 84e37ee4e920 -> /tmp/comfytest-home/.ce/install.hash [06:21] [comfy-env] Install log: /tmp/comfytest-home/.ce/install.log [06:21] [06:21] Installation complete! [06:21] Cloning ComfyUI-GeometryPack... [06:25] Installing requirements for ComfyUI-GeometryPack... [06:27] Running install.py for ComfyUI-GeometryPack... [06:27] [comfy-env] _discover: scanning /workspaces/Sharp-2211/ComfyUI/custom_nodes [06:27] [comfy-env] _discover: ComfyUI-GaussianPack -> gaussianpack-nodes (custom_nodes/ComfyUI-GaussianPack/nodes/comfy-env.toml) [06:28] [comfy-env] _discover: ComfyUI-GeometryPack -> geometrypack-nodes (custom_nodes/ComfyUI-GeometryPack/nodes/comfy-env.toml) [06:28] [comfy-env] _discover: ComfyUI-MoGe2 -> moge2-nodes (custom_nodes/ComfyUI-MoGe2/nodes/comfy-env.toml) [06:28] [comfy-env] _discover: ComfyUI-PanoPack -> panopack-nodes (custom_nodes/ComfyUI-PanoPack/nodes/comfy-env.toml) [06:28] [comfy-env] _discover: ComfyUI-Sharp -> sharp-nodes (custom_nodes/ComfyUI-Sharp/nodes/comfy-env.toml) [06:28] [comfy-env] Workspace: /tmp/comfytest-home/.ce [06:29] [comfy-env] ComfyUI: /workspaces/Sharp-2211/ComfyUI [06:29] [comfy-env] Found 5 node config(s): [06:29] - gaussianpack-nodes <- custom_nodes/ComfyUI-GaussianPack/nodes/comfy-env.toml (python=host) [06:29] - geometrypack-nodes <- custom_nodes/ComfyUI-GeometryPack/nodes/comfy-env.toml (python=host) [06:30] - moge2-nodes <- custom_nodes/ComfyUI-MoGe2/nodes/comfy-env.toml (python=host) [06:30] - panopack-nodes <- custom_nodes/ComfyUI-PanoPack/nodes/comfy-env.toml (python=host) [06:30] - sharp-nodes <- custom_nodes/ComfyUI-Sharp/nodes/comfy-env.toml (python=host) [06:30] [comfy-env] Bootstrap interpreter has python 3.11 + torch 2.10.0 (cu128). Looking for cuda-only wheels matching cu128/torch2.10/cp311. [06:30] [comfy-env] GPU: Detection: smi [06:30] Driver: 580.126.20 [06:30] CUDA: 13.0 [06:31] Recommended: CUDA 13.0 [06:31] [06:31] GPU 0: NVIDIA GeForce RTX 3090 (sm_86) [Ampere] 24576MB [06:32] [comfy-env] Comfyui feature -> torch 2.10.0 from https://download.pytorch.org/whl/cu128 (CUDA 12.8 via bootstrap torch) [06:32] [comfy-env] cuda-wheels: 4 package(s) need a matched (cuda, torch, python) combo: ['gsplat', 'cumesh', 'sageattention', 'flash_attn'] [06:32] [comfy-env] cuda-wheels tier 1 (bootstrap): probing cu12.8/torch2.10/cp311 [06:32] [cuda-wheels] Looking up gsplat: cu128 torch2.10 cp311 manylinux linux [06:32] [cuda-wheels] Found: gsplat-1.5.3+cu128torch2.10-cp311-cp311-manylinux_2_34_x86_64.manylinux_2_35_x86_64.whl [06:32] [cuda-wheels] Looking up cumesh: cu128 torch2.10 cp311 manylinux linux [06:33] [cuda-wheels] Found: cumesh-0.0.1+cu128torch2.10-cp311-cp311-manylinux_2_35_x86_64.whl [06:33] [cuda-wheels] Looking up sageattention: cu128 torch2.10 cp311 manylinux linux [06:33] [cuda-wheels] Found: sageattention-2.2.0+cu128torch2.10-cp311-cp311-manylinux_2_34_x86_64.manylinux_2_35_x86_64.whl [06:33] [cuda-wheels] Looking up flash_attn: cu128 torch2.10 cp311 manylinux linux [06:33] [cuda-wheels] Found: flash_attn-2.8.3+cu128torch2.10-cp311-cp311-manylinux_2_24_x86_64.manylinux_2_28_x86_64.whl [06:33] [comfy-env] cuda-wheels combo: cu12.8/torch2.10 (bootstrap matches; per-node envs will pin to this) [06:33] [comfy-env] Host glibc 2.35 -> system-requirements [06:33] [cuda-wheels] Looking up gsplat: cu128 torch2.10 cp311 manylinux linux [06:34] [cuda-wheels] Found: gsplat-1.5.3+cu128torch2.10-cp311-cp311-manylinux_2_34_x86_64.manylinux_2_35_x86_64.whl [06:34] [comfy-env] gaussianpack-nodes: cuda-wheels deferred for post-pixi install (gsplat) [06:34] [cuda-wheels] Looking up cumesh: cu128 torch2.10 cp311 manylinux linux [06:34] [cuda-wheels] Found: cumesh-0.0.1+cu128torch2.10-cp311-cp311-manylinux_2_35_x86_64.whl [06:35] [comfy-env] geometrypack-nodes: cuda-wheels deferred for post-pixi install (cumesh) [06:37] [cuda-wheels] Looking up sageattention: cu128 torch2.10 cp311 manylinux linux [06:37] [cuda-wheels] Found: sageattention-2.2.0+cu128torch2.10-cp311-cp311-manylinux_2_34_x86_64.manylinux_2_35_x86_64.whl [06:39] [cuda-wheels] Looking up flash_attn: cu128 torch2.10 cp311 manylinux linux [06:39] [cuda-wheels] Found: flash_attn-2.8.3+cu128torch2.10-cp311-cp311-manylinux_2_24_x86_64.manylinux_2_28_x86_64.whl [06:40] [comfy-env] moge2-nodes: cuda-wheels deferred for post-pixi install (sageattention, flash_attn) [06:40] [cuda-wheels] Looking up gsplat: cu128 torch2.10 cp311 manylinux linux [06:40] [cuda-wheels] Found: gsplat-1.5.3+cu128torch2.10-cp311-cp311-manylinux_2_34_x86_64.manylinux_2_35_x86_64.whl [06:40] [comfy-env] sharp-nodes: cuda-wheels deferred for post-pixi install (gsplat) [06:41] Generated /tmp/comfytest-home/.ce/pixi.toml [06:41] [comfy-env] Installing 5 environment(s): [06:41] - gaussianpack-nodes (python=host, 8 pypi deps, 1 cuda wheels) [06:41] - geometrypack-nodes (python=host, 14 pypi deps, 1 cuda wheels) [06:41] - moge2-nodes (python=host, 12 pypi deps, 2 cuda wheels) [06:41] - panopack-nodes (python=host, 21 pypi deps) [06:41] - sharp-nodes (python=host, 15 pypi deps, 1 cuda wheels) [06:41] [comfy-env] Running `pixi install -e gaussianpack-nodes -e geometrypack-nodes -e moge2-nodes -e panopack-nodes -e sharp-nodes`... [06:44] WARN Skipped running the post-link scripts because `run-post-link-scripts` = `false` [06:44] - bin/.librsvg-pre-unlink.sh [06:44] To enable them, run: [06:44] pixi config set --local run-post-link-scripts insecure [06:44] More info: [06:44] https://pixi.sh/latest/reference/pixi_configuration/#run-post-link-scripts [06:46] The following environments have been installed: gaussianpack-nodes, geometrypack-nodes, moge2-nodes, panopack-nodes, sharp-nodes. [06:46] [comfy-env] gaussianpack-nodes: installing cuda-wheels with --no-deps (gsplat) [06:46] Using Python 3.11.15 environment at: .pixi/envs/gaussianpack-nodes [06:47] Resolved 1 package in 949ms [06:47] Checked 1 package in 0.07ms [06:47] [comfy-env] geometrypack-nodes: installing cuda-wheels with --no-deps (cumesh) [06:47] Using Python 3.11.15 environment at: .pixi/envs/geometrypack-nodes [06:48] Resolved 1 package in 765ms [06:48] Downloading cumesh (22.8MiB) [06:48] Downloaded cumesh [06:49] Prepared 1 package in 444ms [06:49] Installed 1 package in 3ms [06:49] + cumesh==0.0.1+cu128torch2.10 (from https://github.com/PozzettiAndrea/cuda-wheels/releases/download/cumesh-latest/cumesh-0.0.1%2Bcu128torch2.10-cp311-cp311-manylinux_2_35_x86_64.whl) [06:49] [comfy-env] moge2-nodes: installing cuda-wheels with --no-deps (sageattention, flash_attn) [06:49] Using Python 3.11.15 environment at: .pixi/envs/moge2-nodes [06:49] Checked 2 packages in 86ms [06:49] [comfy-env] sharp-nodes: installing cuda-wheels with --no-deps (gsplat) [06:49] Using Python 3.11.15 environment at: .pixi/envs/sharp-nodes [06:50] Resolved 1 package in 1.09s [06:50] Checked 1 package in 0.11ms [06:51] [comfy-env] Recorded install hash 6fd28b8aa152 -> /tmp/comfytest-home/.ce/install.hash [06:51] [comfy-env] Install log: /tmp/comfytest-home/.ce/install.log [06:51] [06:51] Installation complete! [06:51] [06:51] [requirements] Re-installing main package requirements... [06:51] Installing requirements for ComfyUI-PanoPack... [06:51] [comfy-env] _discover: scanning /workspaces/Sharp-2211/ComfyUI/custom_nodes [06:52] [comfy-env] _discover: ComfyUI-GaussianPack -> gaussianpack-nodes (custom_nodes/ComfyUI-GaussianPack/nodes/comfy-env.toml) [06:52] [comfy-env] _discover: ComfyUI-GeometryPack -> geometrypack-nodes (custom_nodes/ComfyUI-GeometryPack/nodes/comfy-env.toml) [06:53] [comfy-env] _discover: ComfyUI-MoGe2 -> moge2-nodes (custom_nodes/ComfyUI-MoGe2/nodes/comfy-env.toml) [06:53] [comfy-env] _discover: ComfyUI-PanoPack -> panopack-nodes (custom_nodes/ComfyUI-PanoPack/nodes/comfy-env.toml) [06:53] [comfy-env] _discover: ComfyUI-Sharp -> sharp-nodes (custom_nodes/ComfyUI-Sharp/nodes/comfy-env.toml) [06:53] [comfy-env] Workspace inputs unchanged (hash 6fd28b8aa152) -- skipping install. Delete /tmp/comfytest-home/.ce/install.hash to force. [06:53] [06:53] Installation complete! [06:53] ComfyUI-MoGe2: exists [06:53] ComfyUI-GeometryPack: exists [06:53] [06:53] [requirements] Re-installing main package requirements... [06:53] Installing requirements for ComfyUI-Sharp... [06:53] [comfy-env] _discover: scanning /workspaces/Sharp-2211/ComfyUI/custom_nodes [06:53] [comfy-env] _discover: ComfyUI-GaussianPack -> gaussianpack-nodes (custom_nodes/ComfyUI-GaussianPack/nodes/comfy-env.toml) [06:53] [comfy-env] _discover: ComfyUI-GeometryPack -> geometrypack-nodes (custom_nodes/ComfyUI-GeometryPack/nodes/comfy-env.toml) [06:53] [comfy-env] _discover: ComfyUI-MoGe2 -> moge2-nodes (custom_nodes/ComfyUI-MoGe2/nodes/comfy-env.toml) [06:53] [comfy-env] _discover: ComfyUI-PanoPack -> panopack-nodes (custom_nodes/ComfyUI-PanoPack/nodes/comfy-env.toml) [06:53] [comfy-env] _discover: ComfyUI-Sharp -> sharp-nodes (custom_nodes/ComfyUI-Sharp/nodes/comfy-env.toml) [06:53] [comfy-env] Workspace inputs unchanged (hash 6fd28b8aa152) -- skipping install. Delete /tmp/comfytest-home/.ce/install.hash to force. [06:54] [06:54] Installation complete! [06:54] Installing 2 node dependency(ies)... [06:54] ComfyUI-GaussianPack from PozzettiAndrea/ComfyUI-GaussianPack [06:54] ComfyUI-GaussianPack already exists, skipping... [06:54] ComfyUI-PanoPack from PozzettiAndrea/ComfyUI-PanoPack [06:54] ComfyUI-PanoPack already exists, skipping... [06:55] Installing validation endpoint... [06:55] Cloning PozzettiAndrea/ComfyUI-validate-endpoint... [06:55] Running: git clone --depth 1 https://x-access-token:***@github.com/PozzettiAndrea/ComfyUI-validate-endpoint.git /workspaces/Sharp-2211/ComfyUI/custom_nodes/ComfyUI-validate-endpoint [06:56] CUDA packages absent (will mock): gsplat [06:57] [INSTALL] PASSED [06:57] [06:57] [3/5] REGISTRATION [06:58] ---------------------------------------- [06:58] [DEBUG] server=None, api=None [06:58] Starting ComfyUI server... [06:59] Starting ComfyUI server on port 41898... [06:59] CUDA mock packages: gsplat [07:00] Starting ComfyUI server on port 41898... [07:00] Waiting for server to be ready (timeout: 600s)... [07:03] [ComfyUI] [INFO] setup plugin alembic.autogenerate.schemas [07:04] [ComfyUI] [INFO] setup plugin alembic.autogenerate.tables [07:04] [ComfyUI] [INFO] setup plugin alembic.autogenerate.types [07:04] [ComfyUI] [INFO] setup plugin alembic.autogenerate.constraints [07:04] [ComfyUI] [INFO] setup plugin alembic.autogenerate.defaults [07:05] [ComfyUI] [INFO] setup plugin alembic.autogenerate.comments [07:05] [ComfyUI] [comfy-env] ComfyUI-PanoPack: 1 isolation env(s): [07:05] [ComfyUI] [comfy-env] nodes -> /workspaces/Sharp-2211/ComfyUI/custom_nodes/ComfyUI-PanoPack/nodes [07:05] [ComfyUI] [comfy-env] Workspace: /tmp/comfytest-home/.ce [07:05] [ComfyUI] [comfy-env] env: /tmp/comfytest-home/.ce/.pixi/envs/panopack-nodes [OK] [07:05] [ComfyUI] [comfy-env] prestartup complete [07:05] [ComfyUI] [comfy-env] ComfyUI-MoGe2: 1 isolation env(s): [07:05] [ComfyUI] [comfy-env] nodes -> /workspaces/Sharp-2211/ComfyUI/custom_nodes/ComfyUI-MoGe2/nodes [07:05] [ComfyUI] [comfy-env] env: /tmp/comfytest-home/.ce/.pixi/envs/moge2-nodes [OK] [07:05] [ComfyUI] [comfy-env] prestartup complete [07:05] [ComfyUI] [comfy-env] ComfyUI-Sharp: 1 isolation env(s): [07:05] [ComfyUI] [comfy-env] nodes -> /workspaces/Sharp-2211/ComfyUI/custom_nodes/ComfyUI-Sharp/nodes [07:05] [ComfyUI] [comfy-env] env: /tmp/comfytest-home/.ce/.pixi/envs/sharp-nodes [OK] [07:05] [ComfyUI] [comfy-env] prestartup complete [07:05] [ComfyUI] [comfy-env] ComfyUI-GeometryPack: 1 isolation env(s): [07:05] [ComfyUI] [comfy-env] nodes -> /workspaces/Sharp-2211/ComfyUI/custom_nodes/ComfyUI-GeometryPack/nodes [07:05] [ComfyUI] [comfy-env] env: /tmp/comfytest-home/.ce/.pixi/envs/geometrypack-nodes [OK] [07:05] [ComfyUI] [comfy-env] prestartup complete [07:05] [ComfyUI] [INFO] [07:05] [ComfyUI] Prestartup times for custom nodes: [07:05] [ComfyUI] [INFO] 0.0 seconds: /workspaces/Sharp-2211/ComfyUI/custom_nodes/ComfyUI-MoGe2 [07:05] [ComfyUI] [INFO] 0.0 seconds: /workspaces/Sharp-2211/ComfyUI/custom_nodes/ComfyUI-Sharp [07:05] [ComfyUI] [INFO] 0.0 seconds: /workspaces/Sharp-2211/ComfyUI/custom_nodes/ComfyUI-GaussianPack [07:05] [ComfyUI] [INFO] 0.1 seconds: /workspaces/Sharp-2211/ComfyUI/custom_nodes/ComfyUI-GeometryPack [07:05] [ComfyUI] [INFO] 0.2 seconds: /workspaces/Sharp-2211/ComfyUI/custom_nodes/ComfyUI-PanoPack [07:05] [ComfyUI] [INFO] [07:09] [ComfyUI] [WARNING] WARNING: You need pytorch with cu130 or higher to use optimized CUDA operations. [07:09] [ComfyUI] [INFO] Found comfy_kitchen backend eager: {'available': True, 'disabled': False, 'unavailable_reason': None, 'capabilities': ['apply_rope', 'apply_rope1', 'apply_rope_split_half', 'apply_rope_split_half1', 'dequantize_mxfp8', 'dequantize_nvfp4', 'dequantize_per_tensor_fp8', 'gemv_awq_w4a16', 'quantize_mxfp8', 'quantize_nvfp4', 'quantize_per_tensor_fp8', 'quantize_svdquant_w4a4', 'scaled_mm_mxfp8', 'scaled_mm_nvfp4', 'scaled_mm_svdquant_w4a4', 'stochastic_rounding_fp8']} [07:09] [ComfyUI] [INFO] Found comfy_kitchen backend triton: {'available': True, 'disabled': True, 'unavailable_reason': None, 'capabilities': ['apply_rope', 'apply_rope1', 'apply_rope_split_half', 'apply_rope_split_half1', 'dequantize_nvfp4', 'dequantize_per_tensor_fp8', 'quantize_mxfp8', 'quantize_nvfp4', 'quantize_per_tensor_fp8']} [07:09] [ComfyUI] [INFO] Found comfy_kitchen backend cuda: {'available': True, 'disabled': True, 'unavailable_reason': None, 'capabilities': ['apply_rope', 'apply_rope1', 'apply_rope_split_half', 'apply_rope_split_half1', 'dequantize_nvfp4', 'dequantize_per_tensor_fp8', 'gemv_awq_w4a16', 'quantize_mxfp8', 'quantize_nvfp4', 'quantize_per_tensor_fp8', 'quantize_svdquant_w4a4', 'scaled_mm_svdquant_w4a4', 'stochastic_rounding_fp8']} [07:09] [ComfyUI] [INFO] Checkpoint files will always be loaded safely. [07:09] [ComfyUI] [INFO] Total VRAM 24122 MB, total RAM 32010 MB [07:09] [ComfyUI] [INFO] pytorch version: 2.10.0+cu128 [07:09] [ComfyUI] [INFO] Set vram state to: NORMAL_VRAM [07:09] [ComfyUI] [INFO] Device: cuda:0 NVIDIA GeForce RTX 3090 : cudaMallocAsync [07:09] [ComfyUI] [INFO] Using async weight offloading with 2 streams [07:09] [ComfyUI] [INFO] Enabled pinned memory 28809.0 [07:09] [ComfyUI] [INFO] working around nvidia conv3d memory bug. [07:09] [ComfyUI] [INFO] Using pytorch attention [07:13] [ComfyUI] aimdo: /project/src-posix/cuda-funchooks.c:52:DEBUG:aimdo_setup_hooks: hooks successfully installed [07:13] [ComfyUI] aimdo: /project/src/control.c:240:INFO:comfy-aimdo inited for GPU: NVIDIA GeForce RTX 3090 (VRAM: 24122 MB) [07:13] [ComfyUI] [INFO] DynamicVRAM support detected and enabled [07:13] [ComfyUI] [INFO] Python version: 3.11.15 (main, Jun 2 2026, 22:26:03) [Clang 22.1.3 ] [07:13] [ComfyUI] [INFO] ComfyUI version: 0.24.0 [07:13] [ComfyUI] [INFO] comfy-aimdo version: 0.4.9 [07:13] [ComfyUI] [INFO] comfy-kitchen version: 0.2.10 [07:13] [ComfyUI] [WARNING] ****** User settings have been changed to be stored on the server instead of browser storage. ****** [07:13] [ComfyUI] [WARNING] ****** For multi-user setups add the --multi-user CLI argument to enable multiple user profiles. ****** [07:13] [ComfyUI] [INFO] comfyui-frontend-package version: 1.45.15 [07:13] [ComfyUI] [INFO] comfyui-workflow-templates version: 0.9.98 [07:13] [ComfyUI] [INFO] comfyui-embedded-docs version: 0.5.2 [07:13] [ComfyUI] [INFO] comfy-kitchen version: 0.2.10 [07:13] [ComfyUI] [INFO] comfy-aimdo version: 0.4.9 [07:13] [ComfyUI] [INFO] [Prompt Server] web root: /workspaces/Sharp-2211/.venv/lib/python3.11/site-packages/comfyui_frontend_package/static [07:13] [ComfyUI] [INFO] Asset seeder disabled [07:15] [ComfyUI] [comfy-env] Version: 0.3.89 [07:15] [ComfyUI] [comfy-env] register_nodes: ComfyUI-PanoPack [07:16] [ComfyUI] [comfy-env] ComfyUI source dir: /workspaces/Sharp-2211/ComfyUI [07:16] [ComfyUI] [comfy-env] Found 1 isolation env(s) [07:16] [ComfyUI] [comfy-env] Scanning nodes metadata (isolation root)... [07:16] [ComfyUI] [comfy-env] Metadata scan: /tmp/comfytest-home/.pixi/bin/pixi run --as-is --manifest-path /tmp/comfytest-home/.ce/pixi.toml -e panopack-nodes python /tmp/comfy_meta_ja_x7olb.py /workspaces/Sharp-2211/ComfyUI/custom_nodes/ComfyUI-PanoPack nodes /tmp/comfy_meta_out_xy0negiy.pkl [07:17] [ComfyUI] [comfy-env] Scan env PATH for nodes: [07:17] [ComfyUI] [comfy-env] [0] /tmp/comfytest-tools/bin [07:17] [ComfyUI] [comfy-env] [1] /opt/uv/bin [07:17] [ComfyUI] [comfy-env] [2] /usr/local/sbin [07:17] [ComfyUI] [comfy-env] [3] /usr/local/bin [07:17] [ComfyUI] [comfy-env] [4] /usr/sbin [07:17] [ComfyUI] [comfy-env] [5] /usr/bin [07:17] [ComfyUI] [comfy-env] [6] /sbin [07:17] [ComfyUI] [comfy-env] [7] /bin [07:19] [ComfyUI] [comfy-env] Metadata scan stderr for nodes: [07:19] [ComfyUI] [comfy-env] [meta-scan] importing nodes from /workspaces/Sharp-2211/ComfyUI/custom_nodes/ComfyUI-PanoPack [07:19] [ComfyUI] [comfy-env] [meta-scan] import OK [07:19] [ComfyUI] [comfy-env] Scanned nodes: 15 nodes (4.3s) [07:19] [ComfyUI] [comfy-env] Scanned nodes root: 15 nodes (4.3s) [07:19] [ComfyUI] [comfy-env] Imported nodes root: 15 nodes (isolation) [07:19] [ComfyUI] [comfy-env] Registered 15 total nodes [07:19] [ComfyUI] [comfy-env] Version: 0.3.89 [07:19] [ComfyUI] [comfy-env] register_nodes: ComfyUI-MoGe2 [07:19] [ComfyUI] [comfy-env] ComfyUI source dir: /workspaces/Sharp-2211/ComfyUI [07:19] [ComfyUI] [comfy-env] Found 1 isolation env(s) [07:19] [ComfyUI] [comfy-env] Scanning nodes metadata (isolation root)... [07:19] [ComfyUI] [comfy-env] Metadata scan: /tmp/comfytest-home/.pixi/bin/pixi run --as-is --manifest-path /tmp/comfytest-home/.ce/pixi.toml -e moge2-nodes python /tmp/comfy_meta_3vb3p9eo.py /workspaces/Sharp-2211/ComfyUI/custom_nodes/ComfyUI-MoGe2 nodes /tmp/comfy_meta_out_zojthgid.pkl [07:19] [ComfyUI] [comfy-env] Scan env PATH for nodes: [07:19] [ComfyUI] [comfy-env] [0] /tmp/comfytest-tools/bin [07:19] [ComfyUI] [comfy-env] [1] /opt/uv/bin [07:19] [ComfyUI] [comfy-env] [2] /usr/local/sbin [07:19] [ComfyUI] [comfy-env] [3] /usr/local/bin [07:19] [ComfyUI] [comfy-env] [4] /usr/sbin [07:19] [ComfyUI] [comfy-env] [5] /usr/bin [07:19] [ComfyUI] [comfy-env] [6] /sbin [07:20] [ComfyUI] [comfy-env] [7] /bin [07:22] [ComfyUI] [comfy-env] Metadata scan stderr for nodes: [07:22] [ComfyUI] [comfy-env] [meta-scan] importing nodes from /workspaces/Sharp-2211/ComfyUI/custom_nodes/ComfyUI-MoGe2 [07:22] [ComfyUI] [comfy-env] ERROR:root:Failed to import comfy_kitchen, Error: No module named 'comfy_kitchen', fp8 and fp4 support will not be available. [07:22] [ComfyUI] [comfy-env] WARNING:root:comfy_kitchen does not support stochastic FP8 rounding, please update comfy_kitchen. [07:22] [ComfyUI] [comfy-env] [meta-scan] import OK [07:22] [ComfyUI] [comfy-env] Scanned nodes: 3 nodes (2.5s) [07:22] [ComfyUI] [comfy-env] Scanned nodes root: 3 nodes (2.5s) [07:22] [ComfyUI] [comfy-env] Imported nodes root: 3 nodes (isolation) [07:22] [ComfyUI] [comfy-env] Registered 3 total nodes [07:22] [ComfyUI] [comfy-env] Version: 0.3.89 [07:22] [ComfyUI] [comfy-env] register_nodes: ComfyUI-Sharp [07:22] [ComfyUI] [comfy-env] ComfyUI source dir: /workspaces/Sharp-2211/ComfyUI [07:22] [ComfyUI] [comfy-env] Found 1 isolation env(s) [07:22] [ComfyUI] [comfy-env] Scanning nodes metadata (isolation root)... [07:22] [ComfyUI] [comfy-env] Metadata scan: /tmp/comfytest-home/.pixi/bin/pixi run --as-is --manifest-path /tmp/comfytest-home/.ce/pixi.toml -e sharp-nodes python /tmp/comfy_meta_eqgjtvqh.py /workspaces/Sharp-2211/ComfyUI/custom_nodes/ComfyUI-Sharp nodes /tmp/comfy_meta_out_kgze_d88.pkl [07:22] [ComfyUI] [comfy-env] Scan env PATH for nodes: [07:22] [ComfyUI] [comfy-env] [0] /tmp/comfytest-tools/bin [07:22] [ComfyUI] [comfy-env] [1] /opt/uv/bin [07:22] [ComfyUI] [comfy-env] [2] /usr/local/sbin [07:22] [ComfyUI] [comfy-env] [3] /usr/local/bin [07:22] [ComfyUI] [comfy-env] [4] /usr/sbin [07:22] [ComfyUI] [comfy-env] [5] /usr/bin [07:22] [ComfyUI] [comfy-env] [6] /sbin [07:22] [ComfyUI] [comfy-env] [7] /bin [07:25] [ComfyUI] [comfy-env] Metadata scan stderr for nodes: [07:25] [ComfyUI] [comfy-env] [meta-scan] importing nodes from /workspaces/Sharp-2211/ComfyUI/custom_nodes/ComfyUI-Sharp [07:25] [ComfyUI] [comfy-env] [meta-scan] import OK [07:25] [ComfyUI] [comfy-env] Scanned nodes: 17 nodes (2.9s) [07:25] [ComfyUI] [comfy-env] Scanned nodes root: 17 nodes (2.9s) [07:25] [ComfyUI] [comfy-env] Imported nodes root: 17 nodes (isolation) [07:25] [ComfyUI] [comfy-env] Registered 17 total nodes [07:25] [ComfyUI] [comfy-env] Version: 0.3.89 [07:25] [ComfyUI] [comfy-env] register_nodes: ComfyUI-GaussianPack [07:25] [ComfyUI] [comfy-env] ComfyUI source dir: /workspaces/Sharp-2211/ComfyUI [07:25] [ComfyUI] [comfy-env] Found 1 isolation env(s) [07:25] [ComfyUI] [comfy-env] Scanning nodes metadata (isolation root)... [07:25] [ComfyUI] [comfy-env] Metadata scan: /tmp/comfytest-home/.pixi/bin/pixi run --as-is --manifest-path /tmp/comfytest-home/.ce/pixi.toml -e gaussianpack-nodes python /tmp/comfy_meta_rrcj2s9m.py /workspaces/Sharp-2211/ComfyUI/custom_nodes/ComfyUI-GaussianPack nodes /tmp/comfy_meta_out_12z_10og.pkl [07:25] [ComfyUI] [comfy-env] Scan env PATH for nodes: [07:25] [ComfyUI] [comfy-env] [0] /tmp/comfytest-tools/bin [07:25] [ComfyUI] [comfy-env] [1] /opt/uv/bin [07:25] [ComfyUI] [comfy-env] [2] /usr/local/sbin [07:25] [ComfyUI] [comfy-env] [3] /usr/local/bin [07:25] [ComfyUI] [comfy-env] [4] /usr/sbin [07:25] [ComfyUI] [comfy-env] [5] /usr/bin [07:25] [ComfyUI] [comfy-env] [6] /sbin [07:25] [ComfyUI] [comfy-env] [7] /bin [07:27] [ComfyUI] [comfy-env] Metadata scan stderr for nodes: [07:28] [ComfyUI] [comfy-env] [meta-scan] importing nodes from /workspaces/Sharp-2211/ComfyUI/custom_nodes/ComfyUI-GaussianPack [07:28] [ComfyUI] [comfy-env] SPZ route not registered (ModuleNotFoundError: No module named 'comfy_aimdo') [07:28] [ComfyUI] [comfy-env] [meta-scan] import OK [07:28] [ComfyUI] [comfy-env] Scanned nodes: 11 nodes (2.6s) [07:28] [ComfyUI] [comfy-env] Scanned nodes root: 11 nodes (2.6s) [07:28] [ComfyUI] [comfy-env] Imported nodes root: 11 nodes (isolation) [07:28] [ComfyUI] [comfy-env] Registered 11 total nodes [07:28] [ComfyUI] [INFO] loading... [07:28] [ComfyUI] [INFO] calling register_nodes [07:28] [ComfyUI] [comfy-env] Version: 0.3.89 [07:28] [ComfyUI] [comfy-env] register_nodes: ComfyUI-GeometryPack [07:28] [ComfyUI] [comfy-env] ComfyUI source dir: /workspaces/Sharp-2211/ComfyUI [07:28] [ComfyUI] [comfy-env] Found 1 isolation env(s) [07:28] [ComfyUI] [comfy-env] Scanning nodes metadata (isolation root)... [07:28] [ComfyUI] [comfy-env] Metadata scan: /tmp/comfytest-home/.pixi/bin/pixi run --as-is --manifest-path /tmp/comfytest-home/.ce/pixi.toml -e geometrypack-nodes python /tmp/comfy_meta_0yrqllpb.py /workspaces/Sharp-2211/ComfyUI/custom_nodes/ComfyUI-GeometryPack nodes /tmp/comfy_meta_out_d5s2bpz9.pkl [07:28] [ComfyUI] [comfy-env] Scan env PATH for nodes: [07:28] [ComfyUI] [comfy-env] [0] /tmp/comfytest-tools/bin [07:28] [ComfyUI] [comfy-env] [1] /opt/uv/bin [07:28] [ComfyUI] [comfy-env] [2] /usr/local/sbin [07:28] [ComfyUI] [comfy-env] [3] /usr/local/bin [07:28] [ComfyUI] [comfy-env] [4] /usr/sbin [07:28] [ComfyUI] [comfy-env] [5] /usr/bin [07:28] [ComfyUI] [comfy-env] [6] /sbin [07:28] [ComfyUI] [comfy-env] [7] /bin [07:31] [ComfyUI] [comfy-env] Metadata scan stderr for nodes: [07:31] [ComfyUI] [comfy-env] [meta-scan] importing nodes from /workspaces/Sharp-2211/ComfyUI/custom_nodes/ComfyUI-GeometryPack [07:31] [ComfyUI] [comfy-env] ERROR:root:Failed to import comfy_kitchen, Error: No module named 'comfy_kitchen', fp8 and fp4 support will not be available. [07:31] [ComfyUI] [comfy-env] WARNING:root:comfy_kitchen does not support stochastic FP8 rounding, please update comfy_kitchen. [07:31] [ComfyUI] [comfy-env] [meta-scan] import OK [07:31] [ComfyUI] [comfy-env] Scanned nodes: 125 nodes (3.5s) [07:31] [ComfyUI] [comfy-env] Scanned nodes root: 125 nodes (3.5s) [07:31] [ComfyUI] [comfy-env] Imported nodes root: 125 nodes (isolation) [07:31] [ComfyUI] [comfy-env] Registered 125 total nodes [07:31] [ComfyUI] [INFO] [07:31] [ComfyUI] Import times for custom nodes: [07:31] [ComfyUI] [INFO] 0.0 seconds: /workspaces/Sharp-2211/ComfyUI/custom_nodes/ComfyUI-validate-endpoint [07:31] [ComfyUI] [INFO] 0.0 seconds: /workspaces/Sharp-2211/ComfyUI/custom_nodes/websocket_image_save.py [07:31] [ComfyUI] [INFO] 2.5 seconds: /workspaces/Sharp-2211/ComfyUI/custom_nodes/ComfyUI-MoGe2 [07:31] [ComfyUI] [INFO] 2.6 seconds: /workspaces/Sharp-2211/ComfyUI/custom_nodes/ComfyUI-GaussianPack [07:31] [ComfyUI] [INFO] 2.9 seconds: /workspaces/Sharp-2211/ComfyUI/custom_nodes/ComfyUI-Sharp [07:31] [ComfyUI] [INFO] 3.6 seconds: /workspaces/Sharp-2211/ComfyUI/custom_nodes/ComfyUI-GeometryPack [07:31] [ComfyUI] [INFO] 4.6 seconds: /workspaces/Sharp-2211/ComfyUI/custom_nodes/ComfyUI-PanoPack [07:31] [ComfyUI] [INFO] [07:31] [ComfyUI] [INFO] Context impl SQLiteImpl. [07:31] [ComfyUI] [INFO] Will assume non-transactional DDL. [07:31] [ComfyUI] [INFO] Context impl SQLiteImpl. [07:31] [ComfyUI] [INFO] Will assume non-transactional DDL. [07:31] [ComfyUI] [INFO] Running upgrade -> 0001_assets, Initial assets schema [07:31] [ComfyUI] Revision ID: 0001_assets [07:31] [ComfyUI] Revises: None [07:31] [ComfyUI] Create Date: 2025-12-10 00:00:00 [07:31] [ComfyUI] [INFO] Running upgrade 0001_assets -> 0002_merge_to_asset_references, Merge AssetInfo and AssetCacheState into unified asset_references table. [07:32] [ComfyUI] [INFO] Running upgrade 0002_merge_to_asset_references -> 0003_add_metadata_job_id, Add system_metadata and job_id columns to asset_references. [07:32] [ComfyUI] Change preview_id FK from assets.id to asset_references.id. [07:32] [ComfyUI] [INFO] Database upgraded from None to 0003_add_metadata_job_id [07:32] [ComfyUI] [INFO] Using RAM pressure cache. [07:32] [ComfyUI] [INFO] Starting server [07:32] [ComfyUI] [07:32] [ComfyUI] [INFO] To see the GUI go to: http://127.0.0.1:41898 [07:32] Server responding, waiting for nodes to load... [07:52] Server is ready! [07:52] Checking for import errors in server logs... [07:52] No import errors detected [07:52] Found 942 registered nodes [07:52] [REGISTRATION] PASSED [07:52] [07:52] [4/5] INSTANTIATION [07:52] ---------------------------------------- [07:52] [DEBUG] server=, api= [07:52] Testing node constructors... [07:52] All 17 node(s) instantiated successfully! [07:52] [INSTANTIATION] PASSED [07:52] [07:52] [5/5] EXECUTION [07:52] ---------------------------------------- [07:52] [DEBUG] server=, api= [07:52] GPU runner - will execute 4 workflow(s) [07:52] Running 4 workflow(s) (all with videos)... [07:52] Installing screenshot dependencies (playwright, pillow)... [07:54] Packages installed, downloading chromium browser... [08:09] Screenshot dependencies installed successfully [08:10] Starting headless browser... [08:10] Installing Vulkan stack (apt)... [08:10] Vulkan install error: [Errno 2] No such file or directory: 'sudo' [08:10] GPU detected (no Vulkan) -- using ANGLE/OpenGL rendering [08:10] [ComfyUI] [INFO] Using RAM pressure cache. [08:10] Capturing execution frames: pano.json [08:10] [ComfyUI] [INFO] Using RAM pressure cache. [08:16] Frame 1 saved (frame_000.jpg, t=0.0s) [08:16] Validating workflow... [08:16] [ComfyUI] [INFO] === /validate endpoint called === [08:16] Queuing workflow for execution... [08:16] [ComfyUI] [INFO] Received JSON with keys: ['prompt'] [08:16] [ComfyUI] [INFO] Prompt has 18 nodes [08:16] [ComfyUI] [INFO] Node 7: LoadImage [08:16] [ComfyUI] [INFO] Inputs: {"image": "pano.png"} [08:16] [ComfyUI] [INFO] Node 9: LoadSharpModel [08:16] [ComfyUI] [INFO] Inputs: {"precision": "auto"} [08:16] [ComfyUI] [INFO] Node 54: MergeGaussians [08:16] [ComfyUI] [INFO] Inputs: {"ply_folder": ["76", 0], "output_prefix": "merged", "max_depth": 0, "min_opacity": 0} [08:16] [ComfyUI] [INFO] Node 59: PanoramaWrap [08:16] [ComfyUI] [comfy-env] SubprocessWorker: /tmp/comfytest-home/.ce/.pixi/envs/sharp-nodes/bin/python [08:16] [ComfyUI] [INFO] Inputs: {"image": ["7", 0]} [08:16] [ComfyUI] [comfy-env] env_vars: {'COMFYUI_BASE': '/workspaces/Sharp-2211/ComfyUI'} [08:16] [ComfyUI] [INFO] Node 60: PanoramaDepthMerge [08:16] [ComfyUI] [ComfyUI-Sharp] python: /tmp/comfytest-home/.ce/.pixi/envs/sharp-nodes/bin/python [08:16] [ComfyUI] [INFO] Inputs: {"out_width": ["61", 0], "out_height": ["61", 1], "use_gpu": true, "scale_anchor": false, "chunk_size": 8, "center_weight_power": 2, "normal_edge_threshold_deg": 0, "normal_consistency_boost": false, [08:16] [ComfyUI] [ComfyUI-Sharp] sys_path sent to worker: ['/workspaces/Sharp-2211/ComfyUI', '/workspaces/Sharp-2211/ComfyUI/custom_nodes/ComfyUI-Sharp', '/tmp/comfytest-home/.ce/.pixi/envs/sharp-nodes/lib/python3.1/site-packages', '/workspaces/Sharp-2211/ComfyUI/custom_nodes/ComfyUI-Sharp'] [08:16] [ComfyUI] [INFO] Node 61: GetImageSize [08:16] [ComfyUI] [SubprocessWorker] is_pixi=True, python=/tmp/comfytest-home/.ce/.pixi/envs/sharp-nodes/bin/python [08:16] [ComfyUI] [INFO] Inputs: {"image": ["7", 0]} [08:16] [ComfyUI] [SubprocessWorker] launching cmd=['/tmp/comfytest-home/.pixi/bin/pixi', 'run', '--as-is', '--manifest-path', '/tmp/comfytest-home/.ce/pixi.toml', '-e', 'sharp-nodes', 'python', '/tmp/comfyui_pvenv_xcjd5ki2/persistent_worker.py', 'abstract://comfy_worker_9a34a9169d7b']... [08:16] [ComfyUI] [INFO] Node 62: PreviewImage [08:16] [ComfyUI] [SubprocessWorker] socket_addr=abstract://comfy_worker_9a34a9169d7b (abstract, no filesystem path) [08:16] [ComfyUI] [INFO] Inputs: {"images": ["60", 2]} [08:16] [ComfyUI] [INFO] Node 68: PreviewImage [08:16] [ComfyUI] [INFO] Inputs: {"images": ["96", 0]} [08:16] [ComfyUI] [INFO] Node 70: PreviewImage [08:16] [ComfyUI] [INFO] Inputs: {"images": ["81", 0]} [08:16] [ComfyUI] [INFO] Node 73: SharpRayToPlanarDepth [08:16] [ComfyUI] [INFO] Inputs: {"image": ["87", 1], "intrinsics": ["87", 4], "extrinsics": ["87", 3]} [08:16] [ComfyUI] [INFO] Node 76: SharpPredictGaussiansFromMetricDepth [08:16] [ComfyUI] [INFO] Inputs: {"snap_to_external_depth": "none", "depth_convention": "planar_z", "focal_length_mm": 30, "output_prefix": "sharp_aligned", "save_background_layer": true, "edge_crop": 0, "model": ["9", 0], "image": [ [08:16] [ComfyUI] [INFO] Node 78: TransformGaussian [08:16] [ComfyUI] [INFO] Inputs: {"rotate_x": -90, "rotate_y": 0, "rotate_z": 0, "ply_path": ["54", 1]} [08:16] [ComfyUI] [INFO] Node 80: DownloadAndLoadMoGe2Model [08:16] [ComfyUI] [INFO] Inputs: {"model": "moge-2-vitl-normal.pt", "precision": "auto", "attention": "auto"} [08:16] [ComfyUI] [INFO] Node 81: MoGe2Inference [08:16] [ComfyUI] [INFO] Inputs: {"resolution_level": 9, "num_tokens": 0, "fov_x_deg": ["96", 3], "force_projection": true, "apply_mask": true, "moge2_model": ["80", 0], "images": ["96", 0]} [08:16] [ComfyUI] [INFO] Node 87: PanoramaSplitAdaptive [08:16] [ComfyUI] [INFO] Inputs: {"split_method": "icosahedron_42", "resolution": 1536, "fov_degrees": 90, "use_gpu": true, "create_masks": true, "mask_method": "closest_to", "panorama": ["59", 0], "depth_panorama": ["60", 0], "norma [08:16] [ComfyUI] [INFO] Node 89: PreviewImage [08:16] [ComfyUI] [INFO] Inputs: {"images": ["87", 8]} [08:16] [ComfyUI] [INFO] Node 95: PreviewGaussians [08:16] [ComfyUI] [INFO] Inputs: {"camera_mode": "orbit", "fov_degrees": 71, "renderer": "playcanvas", "transport_format": "ply", "ply_path": ["78", 0]} [08:16] [ComfyUI] [INFO] Node 96: PanoramaSplit [08:16] [ComfyUI] [INFO] Inputs: {"split_method": "icosahedron_42", "resolution": 952, "fov_degrees": 90, "use_gpu": true, "create_masks": false, "fname": "pano_bank", "panorama": ["59", 0]} [08:16] [ComfyUI] [INFO] Generated prompt_id: c9a2e738-7bd5-458c-a805-4696e5968a47 [08:16] [ComfyUI] [INFO] Calling execution.validate_prompt()... [08:16] [ComfyUI] [INFO] Validation result: valid=True [08:16] [ComfyUI] [INFO] === Validation PASSED === [08:16] [ComfyUI] [INFO] got prompt [08:16] [ComfyUI] [comfy-env] Running LoadSharpModel: precision: 'auto' [08:16] [ComfyUI] [VRAM] Before LoadSharpModel: 697 / 24122 MB [08:16] [ComfyUI] [SubprocessWorker] call_method: nodes.load_model.LoadSharpModel.EXECUTE_NORMALIZED [08:16] [ComfyUI] [SubprocessWorker] acquired lock, ensuring started... [08:17] [ComfyUI] [worker:ComfyUI-Sharp] ERROR: Failed to import comfy_kitchen, Error: No module named 'comfy_kitchen', fp8 and fp4 support will not be available. [08:17] [ComfyUI] [worker:ComfyUI-Sharp] WARNING: comfy_kitchen does not support stochastic FP8 rounding, please update comfy_kitchen. [08:18] [ComfyUI] [SubprocessWorker] worker started/confirmed [08:18] [ComfyUI] [SubprocessWorker] serializing kwargs to shm... [08:18] [ComfyUI] [SubprocessWorker] created 0 shm blocks [08:18] [ComfyUI] [SubprocessWorker] sending request via socket... [08:18] [ComfyUI] [SubprocessWorker] call_id=1 sending call_method [08:18] [ComfyUI] [worker:ComfyUI-Sharp] [LoadSharpModel] precision='auto' -> dtype=bf16 (device=cuda:0) [08:18] [ComfyUI] [worker:ComfyUI-Sharp] [LoadSharpModel] checkpoint not found — downloading from HuggingFace repo 'apple/Sharp' file 'sharp_2572gikvuh.pt' -> /workspaces/Sharp-2211/ComfyUI/models/sharp [08:18] [ComfyUI] Warning: You are sending unauthenticated requests to the HF Hub. Please set a HF_TOKEN to enable higher rate limits and faster downloads. [08:18] [ComfyUI] [worker:ComfyUI-Sharp] WARNING: Warning: You are sending unauthenticated requests to the HF Hub. Please set a HF_TOKEN to enable higher rate limits and faster downloads. [08:18] [ComfyUI] [08:18] Frame 2 saved (frame_001.jpg, t=2.3s) [08:19] [capture-periodic] freeze=1ms shot=105ms unfreeze=5ms saved=True [08:21] Frame 3 saved (frame_002.jpg, t=4.5s) [08:21] [capture-periodic] freeze=2ms shot=134ms unfreeze=4ms saved=True [08:22] [capture-loop] iter=50 t=5.6s state={'complete': False, 'error': None, 'executedCount': 0, 'wsState': 1} eval_ms=2 ram=5.2/31.3GB (17%) swap=1.9/32.0GB (6%) cpu=9% browser_rss=0.99GB [08:26] [ComfyUI] sharp_2572gikvuh.pt: 0%| | 0.00/2.81G [00:00 dtype=bf16 [09:00] [ComfyUI] [SubprocessWorker] got response: ok [09:00] [ComfyUI] [comfy-env] SubprocessWorker: /tmp/comfytest-home/.ce/.pixi/envs/moge2-nodes/bin/python [09:00] [ComfyUI] [comfy-env] LoadSharpModel done (44.05s): result: NodeOutput [09:00] [ComfyUI] [comfy-env] env_vars: {'COMFYUI_BASE': '/workspaces/Sharp-2211/ComfyUI'} [09:00] [ComfyUI] [VRAM] After LoadSharpModel: 959 / 24122 MB [09:00] [ComfyUI] [ComfyUI-MoGe2] python: /tmp/comfytest-home/.ce/.pixi/envs/moge2-nodes/bin/python [09:00] [ComfyUI] [comfy-env] Running DownloadAndLoadMoGe2Model: model: 'moge-2-vitl-normal.pt', precision: 'auto', attention: 'auto' [09:00] [ComfyUI] [ComfyUI-MoGe2] sys_path sent to worker: ['/workspaces/Sharp-2211/ComfyUI', '/workspaces/Sharp-2211/ComfyUI/custom_nodes/ComfyUI-MoGe2', '/tmp/comfytest-home/.ce/.pixi/envs/moge2-nodes/lib/python3.1/site-packages', '/workspaces/Sharp-2211/ComfyUI/custom_nodes/ComfyUI-MoGe2'] [09:00] [ComfyUI] [VRAM] Before DownloadAndLoadMoGe2Model: 959 / 24122 MB [09:00] [ComfyUI] [SubprocessWorker] is_pixi=True, python=/tmp/comfytest-home/.ce/.pixi/envs/moge2-nodes/bin/python [09:00] [ComfyUI] [SubprocessWorker] call_method: nodes.load_model.DownloadAndLoadMoGe2Model.EXECUTE_NORMALIZED [09:00] [ComfyUI] [SubprocessWorker] launching cmd=['/tmp/comfytest-home/.pixi/bin/pixi', 'run', '--as-is', '--manifest-path', '/tmp/comfytest-home/.ce/pixi.toml', '-e', 'moge2-nodes', 'python', '/tmp/comfyui_pvenv_ex649j74/persistent_worker.py', 'abstract://comfy_worker_0b184fc90454']... [09:00] [ComfyUI] [SubprocessWorker] acquired lock, ensuring started... [09:00] [ComfyUI] [SubprocessWorker] socket_addr=abstract://comfy_worker_0b184fc90454 (abstract, no filesystem path) [09:01] Frame 11 saved (frame_010.jpg, t=44.6s) [09:01] [capture-periodic] freeze=1ms shot=100ms unfreeze=5ms saved=True [09:02] [capture-loop] iter=400 t=45.5s state={'complete': False, 'error': None, 'executedCount': 0, 'wsState': 1} eval_ms=2 ram=5.2/31.3GB (17%) swap=1.9/32.0GB (6%) cpu=6% browser_rss=0.92GB [09:02] [ComfyUI] [worker:ComfyUI-MoGe2] ERROR: Failed to import comfy_kitchen, Error: No module named 'comfy_kitchen', fp8 and fp4 support will not be available. [09:02] [ComfyUI] [worker:ComfyUI-MoGe2] WARNING: comfy_kitchen does not support stochastic FP8 rounding, please update comfy_kitchen. [09:02] [ComfyUI] [SubprocessWorker] worker started/confirmed [09:02] [ComfyUI] [SubprocessWorker] serializing kwargs to shm... [09:02] [ComfyUI] [SubprocessWorker] created 0 shm blocks [09:02] [ComfyUI] [SubprocessWorker] sending request via socket... [09:02] [ComfyUI] [SubprocessWorker] call_id=1 sending call_method [09:03] [ComfyUI] Warning: You are sending unauthenticated requests to the HF Hub. Please set a HF_TOKEN to enable higher rate limits and faster downloads. [09:03] [ComfyUI] [worker:ComfyUI-MoGe2] WARNING: Warning: You are sending unauthenticated requests to the HF Hub. Please set a HF_TOKEN to enable higher rate limits and faster downloads. [09:03] [ComfyUI] [09:07] [capture-loop] iter=450 t=50.9s state={'complete': False, 'error': None, 'executedCount': 0, 'wsState': 1} eval_ms=2 ram=5.7/31.3GB (18%) swap=1.9/32.0GB (6%) cpu=9% browser_rss=0.92GB [09:07] [ComfyUI] model.pt: 0%| | 0.00/1.32G [00:00 42 crops @ 952x952, fov=(90,90) via grid_sample (GPU); cameras 1.387s, split 6.031s, total 8.737s [09:34] [ComfyUI] [SubprocessWorker] got response: ok [09:34] [ComfyUI] [comfy-env] PanoramaSplit done (9.90s): result: NodeOutput [09:34] [ComfyUI] [VRAM] After PanoramaSplit: 2855 / 24122 MB [09:34] Frame 17 saved (frame_016.jpg, t=78.2s) [09:34] [capture-periodic] freeze=1ms shot=92ms unfreeze=6ms saved=True [09:35] [capture-loop] iter=700 t=79.2s state={'complete': False, 'error': None, 'executedCount': 0, 'wsState': 1} eval_ms=1 ram=7.3/31.3GB (23%) swap=1.9/32.0GB (6%) cpu=12% browser_rss=0.91GB [09:37] [ComfyUI] [comfy-env] Running MoGe2Inference: resolution_level: 9, num_tokens: 0, fov_x_deg: 90.0, force_projection: True, apply_mask: True, moge2_model: dict, images: torch.float32 [42,952,952,3] cpu [09:37] [ComfyUI] [VRAM] Before MoGe2Inference: 2855 / 24122 MB [09:37] [ComfyUI] [SubprocessWorker] call_method: nodes.nodes_inference.MoGe2Inference.EXECUTE_NORMALIZED [09:37] [ComfyUI] [SubprocessWorker] acquired lock, ensuring started... [09:37] [ComfyUI] [ComfyUI-MoGe2] Health check: ping (timeout=5.0s)... [09:37] [ComfyUI] [ComfyUI-MoGe2] Health check: ok [09:37] [ComfyUI] [SubprocessWorker] worker started/confirmed [09:37] [ComfyUI] [comfy-env] PRE-SERIALIZE 'images' shape: torch.Size([42, 952, 952, 3]) [09:37] Node executed (1 total), capturing... [09:37] [ComfyUI] [SubprocessWorker] serializing kwargs to shm... [09:37] [ComfyUI] [SubprocessWorker] created 0 shm blocks [09:37] [ComfyUI] [SubprocessWorker] sending request via socket... [09:37] [ComfyUI] [SubprocessWorker] call_id=2 sending call_method [09:37] [ComfyUI] [worker:ComfyUI-MoGe2] [comfy-env] _from_shm got dict with keys: ['__type__', 'strategy', 'parent_pid', 'fd', 'storage_size'] [09:37] [ComfyUI] [worker:ComfyUI-MoGe2] [comfy-env] DESERIALIZE TensorRef: tensor_size=[42, 952, 952, 3] [09:37] [ComfyUI] [worker:ComfyUI-MoGe2] [comfy-env] DESERIALIZED tensor shape: torch.Size([42, 952, 952, 3]) [09:37] Frame 18 saved (frame_017.jpg, t=80.9s) [09:37] [capture-node] freeze=6ms shot=117ms unfreeze=1ms saved=True [09:41] [capture-loop] iter=750 t=84.8s state={'complete': False, 'error': None, 'executedCount': 1, 'wsState': 1} eval_ms=1 ram=8.0/31.3GB (25%) swap=1.9/32.0GB (6%) cpu=15% browser_rss=1.09GB [09:44] [ComfyUI] [SubprocessWorker] callback 'request_vram_budget' from call_id=2 [09:44] [ComfyUI] [comfy-env] VRAM request: 0.66GB, free before eviction: 22.30GB [09:44] [ComfyUI] [comfy-env] VRAM after eviction: 22.30GB [09:45] [ComfyUI] [worker:ComfyUI-MoGe2] [VRAM] +208MB (now 208MB) reserved=224MB peak=208MB [09:45] [ComfyUI] [SubprocessWorker] callback 'report_progress' from call_id=2 [09:46] [ComfyUI] [worker:ComfyUI-MoGe2] [VRAM] +463MB (now 671MB) reserved=1568MB peak=949MB [09:46] [ComfyUI] [SubprocessWorker] callback 'report_progress' from call_id=2 [09:46] Frame 19 saved (frame_018.jpg, t=89.6s) [09:46] [capture-periodic] freeze=1ms shot=99ms unfreeze=6ms saved=True [09:46] [ComfyUI] [SubprocessWorker] callback 'report_progress' from call_id=2 [09:46] [ComfyUI] [SubprocessWorker] callback 'report_progress' from call_id=2 [09:46] [ComfyUI] [SubprocessWorker] callback 'report_progress' from call_id=2 [09:46] [ComfyUI] [SubprocessWorker] callback 'report_progress' from call_id=2 [09:46] [capture-loop] iter=800 t=90.4s state={'complete': False, 'error': None, 'executedCount': 1, 'wsState': 1} eval_ms=6 ram=10.1/31.3GB (32%) swap=1.9/32.0GB (6%) cpu=12% browser_rss=1.08GB [09:47] [ComfyUI] [SubprocessWorker] callback 'report_progress' from call_id=2 [09:47] [ComfyUI] [SubprocessWorker] callback 'report_progress' from call_id=2 [09:47] [ComfyUI] [SubprocessWorker] callback 'report_progress' from call_id=2 [09:47] [ComfyUI] [SubprocessWorker] callback 'report_progress' from call_id=2 [09:47] [ComfyUI] [SubprocessWorker] callback 'report_progress' from call_id=2 [09:48] [ComfyUI] [SubprocessWorker] callback 'report_progress' from call_id=2 [09:48] [ComfyUI] [SubprocessWorker] callback 'report_progress' from call_id=2 [09:48] Frame 20 saved (frame_019.jpg, t=91.8s) [09:48] [capture-periodic] freeze=4ms shot=107ms unfreeze=5ms saved=True [09:48] [ComfyUI] [SubprocessWorker] callback 'report_progress' from call_id=2 [09:48] [ComfyUI] [SubprocessWorker] callback 'report_progress' from call_id=2 [09:48] [ComfyUI] [SubprocessWorker] callback 'report_progress' from call_id=2 [09:49] [ComfyUI] [SubprocessWorker] callback 'report_progress' from call_id=2 [09:49] [ComfyUI] [SubprocessWorker] callback 'report_progress' from call_id=2 [09:49] [ComfyUI] [SubprocessWorker] callback 'report_progress' from call_id=2 [09:49] [ComfyUI] [SubprocessWorker] callback 'report_progress' from call_id=2 [09:49] [ComfyUI] [SubprocessWorker] callback 'report_progress' from call_id=2 [09:50] [ComfyUI] [SubprocessWorker] callback 'report_progress' from call_id=2 [09:50] [ComfyUI] [SubprocessWorker] callback 'report_progress' from call_id=2 [09:50] [ComfyUI] [SubprocessWorker] callback 'report_progress' from call_id=2 [09:50] Frame 21 saved (frame_020.jpg, t=94.0s) [09:50] [capture-periodic] freeze=1ms shot=92ms unfreeze=1ms saved=True [09:50] [ComfyUI] [SubprocessWorker] callback 'report_progress' from call_id=2 [09:51] [ComfyUI] [SubprocessWorker] callback 'report_progress' from call_id=2 [09:51] [ComfyUI] [SubprocessWorker] callback 'report_progress' from call_id=2 [09:51] [ComfyUI] [SubprocessWorker] callback 'report_progress' from call_id=2 [09:52] [ComfyUI] [SubprocessWorker] callback 'report_progress' from call_id=2 [09:52] [ComfyUI] [SubprocessWorker] callback 'report_progress' from call_id=2 [09:52] [ComfyUI] [SubprocessWorker] callback 'report_progress' from call_id=2 [09:52] [capture-loop] iter=850 t=96.1s state={'complete': False, 'error': None, 'executedCount': 1, 'wsState': 1} eval_ms=1 ram=10.8/31.3GB (34%) swap=1.9/32.0GB (6%) cpu=15% browser_rss=1.10GB [09:52] [ComfyUI] [SubprocessWorker] callback 'report_progress' from call_id=2 [09:52] Frame 22 saved (frame_021.jpg, t=96.2s) [09:52] [capture-periodic] freeze=1ms shot=98ms unfreeze=1ms saved=True [09:53] [ComfyUI] [SubprocessWorker] callback 'report_progress' from call_id=2 [09:53] [ComfyUI] [SubprocessWorker] callback 'report_progress' from call_id=2 [09:53] [ComfyUI] [SubprocessWorker] callback 'report_progress' from call_id=2 [09:53] [ComfyUI] [SubprocessWorker] callback 'report_progress' from call_id=2 [09:54] [ComfyUI] [SubprocessWorker] callback 'report_progress' from call_id=2 [09:54] [ComfyUI] [SubprocessWorker] callback 'report_progress' from call_id=2 [09:54] [ComfyUI] [worker:ComfyUI-MoGe2] [VRAM] +296MB (now 967MB) reserved=1696MB peak=967MB [09:54] [ComfyUI] [SubprocessWorker] callback 'report_progress' from call_id=2 [09:55] Frame 23 saved (frame_022.jpg, t=98.4s) [09:55] [ComfyUI] [SubprocessWorker] callback 'report_progress' from call_id=2 [09:55] [capture-periodic] freeze=1ms shot=102ms unfreeze=5ms saved=True [09:55] [ComfyUI] [SubprocessWorker] callback 'report_progress' from call_id=2 [09:55] [ComfyUI] [SubprocessWorker] callback 'report_progress' from call_id=2 [09:55] [ComfyUI] [worker:ComfyUI-MoGe2] [VRAM] -297MB (now 671MB) reserved=1696MB peak=967MB [09:57] Frame 24 saved (frame_023.jpg, t=101.0s) [09:57] [capture-periodic] freeze=1ms shot=106ms unfreeze=6ms saved=True [09:58] [capture-loop] iter=900 t=102.1s state={'complete': False, 'error': None, 'executedCount': 1, 'wsState': 1} eval_ms=1 ram=13.6/31.3GB (43%) swap=1.9/32.0GB (6%) cpu=13% browser_rss=1.11GB [09:58] [ComfyUI] [SubprocessWorker] got response: ok [09:58] [ComfyUI] [comfy-env] Created 1 model patchers: ['MoGeWrapper_1'] [09:58] [ComfyUI] [comfy-env] MoGe2Inference done (21.44s): result: NodeOutput [09:58] [ComfyUI] [VRAM] After MoGe2Inference: 4669 / 24122 MB [09:58] [ComfyUI] [VRAM] Loaded: SubprocessModel (631 MB) [09:59] [ComfyUI] [comfy-env] Running PanoramaDepthMerge: out_width: 4096, out_height: 2048, use_gpu: True, scale_anchor: False, chunk_size: 8, center_weight_power: 2.0, normal_edge_threshold_deg: 0.0, normal_consistency_boost: False, max_ray_distance_m: 0.0, face_points: torch.float32 [42,952,952,3] cpu, extrinsics: torch.float32 [42,4,4] cpu, intrinsics: torch.float32 [42,3,3] cpu, face_valid_masks: torch.float32 [42,952,952] cpu, face_normals: torch.float32 [42,952,952,3] cpu [09:59] [ComfyUI] [VRAM] Before PanoramaDepthMerge: 4669 / 24122 MB [09:59] [ComfyUI] [VRAM] Loaded: SubprocessModel (631 MB) [09:59] [ComfyUI] [SubprocessWorker] call_method: nodes.depth_merge.PanoramaDepthMerge.EXECUTE_NORMALIZED [09:59] [ComfyUI] [SubprocessWorker] acquired lock, ensuring started... [09:59] [ComfyUI] [ComfyUI-PanoPack] Health check: ping (timeout=5.0s)... [09:59] [ComfyUI] [ComfyUI-PanoPack] Health check: ok [09:59] [ComfyUI] [SubprocessWorker] worker started/confirmed [09:59] [ComfyUI] [comfy-env] PRE-SERIALIZE 'face_points' shape: torch.Size([42, 952, 952, 3]) [09:59] [ComfyUI] [comfy-env] PRE-SERIALIZE 'extrinsics' shape: torch.Size([42, 4, 4]) [09:59] [ComfyUI] [comfy-env] PRE-SERIALIZE 'intrinsics' shape: torch.Size([42, 3, 3]) [09:59] [ComfyUI] [comfy-env] PRE-SERIALIZE 'face_valid_masks' shape: torch.Size([42, 952, 952]) [09:59] [ComfyUI] [comfy-env] PRE-SERIALIZE 'face_normals' shape: torch.Size([42, 952, 952, 3]) [09:59] [ComfyUI] [SubprocessWorker] serializing kwargs to shm... [09:59] Node executed (2 total), capturing... [10:00] Frame 25 saved (frame_024.jpg, t=103.4s) [10:00] [capture-node] freeze=8ms shot=119ms unfreeze=1ms saved=True [10:00] [ComfyUI] [SubprocessWorker] created 0 shm blocks [10:00] [ComfyUI] [SubprocessWorker] sending request via socket... [10:00] [ComfyUI] [SubprocessWorker] call_id=3 sending call_method [10:00] [ComfyUI] [worker:ComfyUI-PanoPack] [comfy-env] _from_shm got dict with keys: ['__type__', 'strategy', 'parent_pid', 'fd', 'storage_size'] [10:00] [ComfyUI] [worker:ComfyUI-PanoPack] [comfy-env] DESERIALIZE TensorRef: tensor_size=[42, 952, 952, 3] [10:00] [ComfyUI] [worker:ComfyUI-PanoPack] [comfy-env] DESERIALIZED tensor shape: torch.Size([42, 952, 952, 3]) [10:00] [ComfyUI] [worker:ComfyUI-PanoPack] [comfy-env] _from_shm got dict with keys: ['__type__', 'strategy', 'parent_pid', 'fd', 'storage_size'] [10:00] [ComfyUI] [worker:ComfyUI-PanoPack] [comfy-env] DESERIALIZE TensorRef: tensor_size=[42, 4, 4] [10:00] [ComfyUI] [worker:ComfyUI-PanoPack] [comfy-env] DESERIALIZED tensor shape: torch.Size([42, 4, 4]) [10:00] [ComfyUI] [worker:ComfyUI-PanoPack] [comfy-env] _from_shm got dict with keys: ['__type__', 'strategy', 'parent_pid', 'fd', 'storage_size'] [10:00] [ComfyUI] [worker:ComfyUI-PanoPack] [comfy-env] DESERIALIZE TensorRef: tensor_size=[42, 3, 3] [10:00] [ComfyUI] [worker:ComfyUI-PanoPack] [comfy-env] DESERIALIZED tensor shape: torch.Size([42, 3, 3]) [10:00] [ComfyUI] [worker:ComfyUI-PanoPack] [comfy-env] _from_shm got dict with keys: ['__type__', 'strategy', 'parent_pid', 'fd', 'storage_size'] [10:00] [ComfyUI] [worker:ComfyUI-PanoPack] [comfy-env] DESERIALIZE TensorRef: tensor_size=[42, 952, 952] [10:00] [ComfyUI] [worker:ComfyUI-PanoPack] [comfy-env] DESERIALIZED tensor shape: torch.Size([42, 952, 952]) [10:00] [ComfyUI] [worker:ComfyUI-PanoPack] [comfy-env] _from_shm got dict with keys: ['__type__', 'strategy', 'parent_pid', 'fd', 'storage_size'] [10:00] [ComfyUI] [worker:ComfyUI-PanoPack] [comfy-env] DESERIALIZE TensorRef: tensor_size=[42, 952, 952, 3] [10:00] [ComfyUI] [worker:ComfyUI-PanoPack] [comfy-env] DESERIALIZED tensor shape: torch.Size([42, 952, 952, 3]) [10:04] [capture-loop] iter=950 t=107.7s state={'complete': False, 'error': None, 'executedCount': 2, 'wsState': 1} eval_ms=2 ram=15.4/31.3GB (49%) swap=1.9/32.0GB (6%) cpu=15% browser_rss=1.15GB [10:09] [capture-loop] iter=1000 t=113.2s state={'complete': False, 'error': None, 'executedCount': 2, 'wsState': 1} eval_ms=1 ram=16.2/31.3GB (52%) swap=1.9/32.0GB (6%) cpu=17% browser_rss=1.11GB [10:15] [capture-loop] iter=1050 t=118.6s state={'complete': False, 'error': None, 'executedCount': 2, 'wsState': 1} eval_ms=2 ram=16.1/31.3GB (51%) swap=1.9/32.0GB (6%) cpu=20% browser_rss=1.11GB [10:20] [capture-loop] iter=1100 t=124.1s state={'complete': False, 'error': None, 'executedCount': 2, 'wsState': 1} eval_ms=2 ram=16.1/31.3GB (52%) swap=1.9/32.0GB (6%) cpu=19% browser_rss=1.11GB [10:23] [ComfyUI] [worker:ComfyUI-PanoPack] [10:23] [ComfyUI] === WATCHDOG TICK 1 === [10:23] [ComfyUI] [worker:ComfyUI-PanoPack] Thread 0x000070802b3ff640 (most recent call first): [10:23] [ComfyUI] File "/tmp/comfytest-home/.ce/.pixi/envs/panopack-nodes/lib/python3.11/socket.py", line 294 in accept [10:23] [ComfyUI] File "/tmp/comfytest-home/.ce/.pixi/envs/panopack-nodes/lib/python3.11/multiprocessing/connection.py", line 626 in accept [10:23] [ComfyUI] File "/tmp/comfytest-home/.ce/.pixi/envs/panopack-nodes/lib/python3.11/multiprocessing/connection.py", line 480 in accept [10:23] [ComfyUI] File "/tmp/comfytest-home/.ce/.pixi/envs/panopack-nodes/lib/python3.11/multiprocessing/resource_sharer.py", line 138 in _serve [10:23] [ComfyUI] File "/tmp/comfytest-home/.ce/.pixi/envs/panopack-nodes/lib/python3.11/threading.py", line 982 in run [10:23] [ComfyUI] File "/tmp/comfytest-home/.ce/.pixi/envs/panopack-nodes/lib/python3.11/threading.py", line 1045 in _bootstrap_inner [10:23] [ComfyUI] File "/tmp/comfytest-home/.ce/.pixi/envs/panopack-nodes/lib/python3.11/threading.py", line 1002 in _bootstrap [10:23] [ComfyUI] [10:23] [ComfyUI] Thread 0x000070820c18e640 (most recent call first): [10:23] [ComfyUI] File "/tmp/comfyui_pvenv_tqf5i7bh/persistent_worker.py", line 106 in _vram_poller [10:23] [ComfyUI] File "/tmp/comfytest-home/.ce/.pixi/envs/panopack-nodes/lib/python3.11/threading.py", line 982 in run [10:23] [ComfyUI] File "/tmp/comfytest-home/.ce/.pixi/envs/panopack-nodes/lib/python3.11/threading.py", line 1045 in _bootstrap_inner [10:23] [ComfyUI] File "/tmp/comfytest-home/.ce/.pixi/envs/panopack-nodes/lib/python3.11/threading.py", line 1002 in _bootstrap [10:23] [ComfyUI] [10:23] [ComfyUI] Current thread 0x000070820c993640 (most recent call first): [10:23] [ComfyUI] File "/tmp/comfyui_pvenv_tqf5i7bh/persistent_worker.py", line 52 in _watchdog [10:23] [ComfyUI] File "/tmp/comfytest-home/.ce/.pixi/envs/panopack-nodes/lib/python3.11/threading.py", line 982 in run [10:23] [ComfyUI] File "/tmp/comfytest-home/.ce/.pixi/envs/panopack-nodes/lib/python3.11/threading.py", line 1045 in _bootstrap_inner [10:23] [ComfyUI] File "/tmp/comfytest-home/.ce/.pixi/envs/panopack-nodes/lib/python3.11/threading.py", line 1002 in _bootstrap [10:23] [ComfyUI] [10:23] [ComfyUI] Thread 0x000070820cfb3740 (most recent call first): [10:23] [ComfyUI] File "/workspaces/Sharp-2211/ComfyUI/custom_nodes/ComfyUI-PanoPack/nodes/depth_merge.py", line 426 in _merge_world_normals [10:23] [ComfyUI] File "/workspaces/Sharp-2211/ComfyUI/custom_nodes/ComfyUI-PanoPack/nodes/depth_merge.py", line 896 in execute [10:23] [ComfyUI] File "/workspaces/Sharp-2211/ComfyUI/comfy_api/latest/_io.py", line 1892 in EXECUTE_NORMALIZED [10:23] [ComfyUI] File "/tmp/comfyui_pvenv_tqf5i7bh/persistent_worker.py", line 1762 in main [10:23] [ComfyUI] File "/tmp/comfyui_pvenv_tqf5i7bh/persistent_worker.py", line 1807 in [10:23] [ComfyUI] [10:23] [ComfyUI] [worker:ComfyUI-PanoPack] === END === [10:23] [ComfyUI] [10:24] [ComfyUI] [worker:ComfyUI-PanoPack] [PanoramaDepthMerge] normals merged: 2048x4096 [10:24] [ComfyUI] [worker:ComfyUI-PanoPack] [PanoramaDepthMerge] merging 42 faces @ 952x952 -> equirect 2048x4096 (use_gpu=True); input = points (||.|| -> ray distance) [10:24] [ComfyUI] [SubprocessWorker] callback 'report_progress' from call_id=3 [10:24] [ComfyUI] [worker:ComfyUI-PanoPack] [PanoramaDepthMerge] top-level peak VRAM estimate: 3.46 GB (4096x2048, N=42, chunk_size=8) [10:24] [ComfyUI] [SubprocessWorker] callback 'request_vram_budget' from call_id=3 [10:24] [ComfyUI] [comfy-env] VRAM request: 3.46GB, free before eviction: 20.40GB [10:24] [ComfyUI] [comfy-env] VRAM after eviction: 20.40GB [10:24] [ComfyUI] [worker:ComfyUI-PanoPack] [PanoramaDepthMerge] -> requested 3.46 GB eviction via comfy_worker.call_parent [10:24] [ComfyUI] [worker:ComfyUI-PanoPack] [VRAM] +439MB (now 439MB) reserved=608MB peak=822MB [10:24] [ComfyUI] /workspaces/Sharp-2211/ComfyUI/custom_nodes/ComfyUI-PanoPack/nodes/_vendor/worldgen/src/panorama_utils.py:349: UserWarning: Sparse CSR tensor support is in beta state. If you miss a functionality in the sparse tensor support, please submit a feature request to https://github.com/pytorch/pytorch/issues. (Triggered internally at /pytorch/aten/src/ATen/SparseCsrTensorImpl.cpp:49.) [10:24] [ComfyUI] A_gpu = torch.sparse_csr_tensor( [10:25] [ComfyUI] [worker:ComfyUI-PanoPack] [merge_panorama_depth_gpu 256x128 ] done 0.54s (warp 0.31, build 0.01, LSMR 0.22); N=42 K=8 chunks=6; depth min/med/max = 0.384/0.945/3.091; valid 32768/32768 [10:25] [ComfyUI] [worker:ComfyUI-PanoPack] [merge_panorama_depth_gpu 512x256 ] done 0.75s (warp 0.10, build 0.02, LSMR 0.07); N=42 K=8 chunks=6; depth min/med/max = 0.384/0.945/3.094; valid 131072/131072 [10:25] [ComfyUI] [worker:ComfyUI-PanoPack] [merge_panorama_depth_gpu 1024x512 ] done 1.07s (warp 0.11, build 0.06, LSMR 0.13); N=42 K=8 chunks=6; depth min/med/max = 0.384/0.945/3.094; valid 524288/524288 [10:25] [ComfyUI] [worker:ComfyUI-PanoPack] [VRAM] -408MB (now 32MB) reserved=64MB peak=822MB [10:26] [capture-loop] iter=1150 t=129.5s state={'complete': False, 'error': None, 'executedCount': 2, 'wsState': 1} eval_ms=2 ram=16.1/31.3GB (52%) swap=1.9/32.0GB (6%) cpu=19% browser_rss=1.11GB [10:26] Frame 26 saved (frame_025.jpg, t=129.6s) [10:26] [capture-periodic] freeze=1ms shot=98ms unfreeze=5ms saved=True [10:26] [ComfyUI] [worker:ComfyUI-PanoPack] [VRAM] +666MB (now 698MB) reserved=768MB peak=822MB [10:26] [ComfyUI] [worker:ComfyUI-PanoPack] [merge_panorama_depth_gpu 2048x1024] done 2.27s (warp 0.21, build 0.54, LSMR 0.40); N=42 K=8 chunks=6; depth min/med/max = 0.384/0.945/3.095; valid 2097152/2097152 [10:27] [ComfyUI] [worker:ComfyUI-PanoPack] [VRAM] -400MB (now 298MB) reserved=416MB peak=859MB [10:31] [capture-loop] iter=1200 t=135.0s state={'complete': False, 'error': None, 'executedCount': 2, 'wsState': 1} eval_ms=2 ram=18.2/31.3GB (58%) swap=1.9/32.0GB (6%) cpu=11% browser_rss=1.12GB [10:31] [ComfyUI] [worker:ComfyUI-PanoPack] [VRAM] +383MB (now 682MB) reserved=800MB peak=859MB [10:32] [ComfyUI] [worker:ComfyUI-PanoPack] [VRAM] +895MB (now 1578MB) reserved=1664MB peak=1578MB [10:33] [ComfyUI] [worker:ComfyUI-PanoPack] [merge_panorama_depth_gpu 4096x2048] done 9.05s (warp 0.60, build 4.04, LSMR 1.94); N=42 K=8 chunks=6; depth min/med/max = 0.384/0.945/3.094; valid 8388608/8388608 [10:33] [ComfyUI] [worker:ComfyUI-PanoPack] [PanoramaDepthMerge] merged depth: shape (2048, 4096), min=0.384, median=0.945, max=3.094; valid pixels: 8388608 / 8388608 [10:33] [ComfyUI] [worker:ComfyUI-PanoPack] [VRAM] -1571MB (now 8MB) reserved=2176MB peak=1898MB [10:36] [capture-loop] iter=1250 t=140.4s state={'complete': False, 'error': None, 'executedCount': 2, 'wsState': 1} eval_ms=2 ram=16.9/31.3GB (54%) swap=1.9/32.0GB (6%) cpu=15% browser_rss=1.12GB [10:42] [capture-loop] iter=1300 t=145.9s state={'complete': False, 'error': None, 'executedCount': 2, 'wsState': 1} eval_ms=2 ram=16.9/31.3GB (54%) swap=1.9/32.0GB (6%) cpu=17% browser_rss=1.12GB [10:47] [capture-loop] iter=1350 t=151.3s state={'complete': False, 'error': None, 'executedCount': 2, 'wsState': 1} eval_ms=1 ram=16.9/31.3GB (54%) swap=1.9/32.0GB (6%) cpu=17% browser_rss=1.12GB [10:48] [ComfyUI] [worker:ComfyUI-PanoPack] [PanoramaDepthMerge] debug_image: H=2048+102, mult_disagreement (log-d, sphere-uniform): mean=11.22%, p99=24.69%, max=28.22%; overlap_pixels=8388608 [10:48] [ComfyUI] [worker:ComfyUI-PanoPack] [headless_gl] prefix=/tmp/comfytest-home/.ce/.pixi/envs/panopack-nodes [10:48] [ComfyUI] [worker:ComfyUI-PanoPack] [headless_gl] OSMesa: ['libOSMesa.so', 'libOSMesa.so.8', 'libOSMesa.so.8.0.0'] [10:48] [ComfyUI] [worker:ComfyUI-PanoPack] [headless_gl] env: VTK_DEFAULT_OPENGL_WINDOW=vtkOSOpenGLRenderWindow PYVISTA_OFF_SCREEN=true [10:49] [ComfyUI] [worker:ComfyUI-PanoPack] [PanoramaDepthMerge] xyz_views: cloud bbox center=(-0.79, -0.31, +0.03) m, size=(4.27 x 3.57 x 1.96) m, N=80000 (subsampled) [10:51] [ComfyUI] [worker:ComfyUI-PanoPack] [PanoramaDepthMerge] points: merged equirect point map (1, 2048, 4096, 3) [10:51] [ComfyUI] [SubprocessWorker] callback 'report_progress' from call_id=3 [10:51] [ComfyUI] [SubprocessWorker] got response: ok [10:51] [ComfyUI] [comfy-env] PanoramaDepthMerge done (52.09s): result: NodeOutput [10:51] [ComfyUI] [VRAM] After PanoramaDepthMerge: 3399 / 24122 MB [10:51] [ComfyUI] [VRAM] Loaded: SubprocessModel (631 MB) [10:52] [ComfyUI] [comfy-env] Running PanoramaSplitAdaptive: split_method: 'icosahedron_42', resolution: 1536, fov_degrees: 90.0, use_gpu: True, create_masks: True, mask_method: 'closest_to', panorama: dict, depth_panorama: torch.float32 [1,2048,4096,3] cpu, normals_panorama: torch.float32 [1,2048,4096,3] cpu [10:52] [ComfyUI] [VRAM] Before PanoramaSplitAdaptive: 3399 / 24122 MB [10:52] [ComfyUI] [VRAM] Loaded: SubprocessModel (631 MB) [10:52] [ComfyUI] [SubprocessWorker] call_method: nodes.panorama_split_adaptive.PanoramaSplitAdaptive.EXECUTE_NORMALIZED [10:52] [ComfyUI] [SubprocessWorker] acquired lock, ensuring started... [10:52] [ComfyUI] [ComfyUI-PanoPack] Health check: ping (timeout=5.0s)... [10:52] [ComfyUI] [ComfyUI-PanoPack] Health check: ok [10:52] [ComfyUI] [SubprocessWorker] worker started/confirmed [10:52] [ComfyUI] [comfy-env] PRE-SERIALIZE 'depth_panorama' shape: torch.Size([1, 2048, 4096, 3]) [10:52] [ComfyUI] [comfy-env] PRE-SERIALIZE 'normals_panorama' shape: torch.Size([1, 2048, 4096, 3]) [10:52] [ComfyUI] [SubprocessWorker] serializing kwargs to shm... [10:52] Node executed (3 total), capturing... [10:52] [ComfyUI] [SubprocessWorker] created 0 shm blocks [10:52] [ComfyUI] [SubprocessWorker] sending request via socket... [10:52] [ComfyUI] [SubprocessWorker] call_id=4 sending call_method [10:52] [ComfyUI] [worker:ComfyUI-PanoPack] [comfy-env] _from_shm got dict with keys: ['__type__', 'strategy', 'parent_pid', 'fd', 'storage_size'] [10:52] [ComfyUI] [worker:ComfyUI-PanoPack] [comfy-env] DESERIALIZE TensorRef: tensor_size=[1, 2048, 4096, 3] [10:52] [ComfyUI] [worker:ComfyUI-PanoPack] [comfy-env] DESERIALIZED tensor shape: torch.Size([1, 2048, 4096, 3]) [10:52] [ComfyUI] [worker:ComfyUI-PanoPack] [comfy-env] _from_shm got dict with keys: ['__type__', 'strategy', 'parent_pid', 'fd', 'storage_size'] [10:52] [ComfyUI] [worker:ComfyUI-PanoPack] [comfy-env] DESERIALIZE TensorRef: tensor_size=[1, 2048, 4096, 3] [10:52] [ComfyUI] [worker:ComfyUI-PanoPack] [comfy-env] DESERIALIZED tensor shape: torch.Size([1, 2048, 4096, 3]) [10:52] [ComfyUI] [worker:ComfyUI-PanoPack] [comfy-env] _from_shm got dict with keys: ['__type__', 'strategy', 'parent_pid', 'fd', 'storage_size'] [10:52] [ComfyUI] [worker:ComfyUI-PanoPack] [comfy-env] DESERIALIZE TensorRef: tensor_size=[1, 2048, 4096, 3] [10:52] [ComfyUI] [worker:ComfyUI-PanoPack] [comfy-env] DESERIALIZED tensor shape: torch.Size([1, 2048, 4096, 3]) [10:52] Frame 27 saved (frame_026.jpg, t=155.8s) [10:52] [capture-node] freeze=2ms shot=117ms unfreeze=2ms saved=True [10:52] [ComfyUI] [worker:ComfyUI-PanoPack] [PanoramaSplitAdaptive] computing area weights from depth (2048x4096) + normals... [10:52] [ComfyUI] [worker:ComfyUI-PanoPack] [PanoramaSplitAdaptive] weight range: [1.06, 131], mean=11.7 [10:52] [ComfyUI] [worker:ComfyUI-PanoPack] [PanoramaSplitAdaptive] adaptive relax: icosahedron_42 (42 cameras), weighted Lloyd... [10:53] [capture-loop] iter=1400 t=156.9s state={'complete': False, 'error': None, 'executedCount': 3, 'wsState': 1} eval_ms=1 ram=16.8/31.3GB (54%) swap=1.9/32.0GB (6%) cpu=12% browser_rss=1.13GB [10:58] [capture-loop] iter=1450 t=162.3s state={'complete': False, 'error': None, 'executedCount': 3, 'wsState': 1} eval_ms=2 ram=16.3/31.3GB (52%) swap=1.9/32.0GB (6%) cpu=11% browser_rss=1.13GB [11:04] [capture-loop] iter=1500 t=167.8s state={'complete': False, 'error': None, 'executedCount': 3, 'wsState': 1} eval_ms=2 ram=16.7/31.3GB (54%) swap=1.9/32.0GB (6%) cpu=12% browser_rss=1.13GB [11:09] [capture-loop] iter=1550 t=173.2s state={'complete': False, 'error': None, 'executedCount': 3, 'wsState': 1} eval_ms=2 ram=17.7/31.3GB (57%) swap=1.9/32.0GB (6%) cpu=11% browser_rss=1.13GB [11:15] [capture-loop] iter=1600 t=178.7s state={'complete': False, 'error': None, 'executedCount': 3, 'wsState': 1} eval_ms=1 ram=16.6/31.3GB (53%) swap=1.9/32.0GB (6%) cpu=12% browser_rss=1.13GB [11:17] [ComfyUI] [worker:ComfyUI-PanoPack] [PanoramaSplitAdaptive] Lloyd ran 24 iters (max move 1.42e-02) [11:17] [ComfyUI] [worker:ComfyUI-PanoPack] [PanoramaSplitAdaptive] Lloyd relaxation done: 42 camera directions in 24.944s [11:17] [ComfyUI] [worker:ComfyUI-PanoPack] [PanoramaSplitAdaptive] rasterizing 42 faces @ 1536x1536... [11:20] [capture-loop] iter=1650 t=184.0s state={'complete': False, 'error': None, 'executedCount': 3, 'wsState': 1} eval_ms=2 ram=16.3/31.3GB (52%) swap=1.9/32.0GB (6%) cpu=12% browser_rss=1.13GB [11:23] [ComfyUI] [worker:ComfyUI-PanoPack] [11:23] [ComfyUI] === WATCHDOG TICK 2 === [11:23] [ComfyUI] [worker:ComfyUI-PanoPack] Thread 0x000070802b3ff640 (most recent call first): [11:23] [ComfyUI] File "/tmp/comfytest-home/.ce/.pixi/envs/panopack-nodes/lib/python3.11/socket.py", line 294 in accept [11:23] [ComfyUI] File "/tmp/comfytest-home/.ce/.pixi/envs/panopack-nodes/lib/python3.11/multiprocessing/connection.py", line 626 in accept [11:23] [ComfyUI] File "/tmp/comfytest-home/.ce/.pixi/envs/panopack-nodes/lib/python3.11/multiprocessing/connection.py", line 480 in accept [11:23] [ComfyUI] File "/tmp/comfytest-home/.ce/.pixi/envs/panopack-nodes/lib/python3.11/multiprocessing/resource_sharer.py", line 138 in _serve [11:23] [ComfyUI] File "/tmp/comfytest-home/.ce/.pixi/envs/panopack-nodes/lib/python3.11/threading.py", line 982 in run [11:23] [ComfyUI] File "/tmp/comfytest-home/.ce/.pixi/envs/panopack-nodes/lib/python3.11/threading.py", line 1045 in _bootstrap_inner [11:23] [ComfyUI] File "/tmp/comfytest-home/.ce/.pixi/envs/panopack-nodes/lib/python3.11/threading.py", line 1002 in _bootstrap [11:23] [ComfyUI] [11:23] [ComfyUI] Thread 0x000070820c18e640 (most recent call first): [11:23] [ComfyUI] File "/tmp/comfyui_pvenv_tqf5i7bh/persistent_worker.py", line 106 in _vram_poller [11:23] [ComfyUI] File "/tmp/comfytest-home/.ce/.pixi/envs/panopack-nodes/lib/python3.11/threading.py", line 982 in run [11:23] [ComfyUI] File "/tmp/comfytest-home/.ce/.pixi/envs/panopack-nodes/lib/python3.11/threading.py", line 1045 in _bootstrap_inner [11:23] [ComfyUI] File "/tmp/comfytest-home/.ce/.pixi/envs/panopack-nodes/lib/python3.11/threading.py", line 1002 in _bootstrap [11:23] [ComfyUI] [11:23] [ComfyUI] Current thread 0x000070820c993640 (most recent call first): [11:23] [ComfyUI] File "/tmp/comfyui_pvenv_tqf5i7bh/persistent_worker.py", line 52 in _watchdog [11:23] [ComfyUI] File "/tmp/comfytest-home/.ce/.pixi/envs/panopack-nodes/lib/python3.11/threading.py", line 982 in run [11:23] [ComfyUI] File "/tmp/comfytest-home/.ce/.pixi/envs/panopack-nodes/lib/python3.11/threading.py", line 1045 in _bootstrap_inner [11:23] [ComfyUI] File "/tmp/comfytest-home/.ce/.pixi/envs/panopack-nodes/lib/python3.11/threading.py", line 1002 in _bootstrap [11:23] [ComfyUI] [11:23] [ComfyUI] Thread 0x000070820cfb3740 (most recent call first): [11:23] [ComfyUI] File "/workspaces/Sharp-2211/ComfyUI/custom_nodes/ComfyUI-PanoPack/nodes/_vendor/moge_panorama.py", line 36 in directions_to_spherical_uv [11:23] [ComfyUI] File "/workspaces/Sharp-2211/ComfyUI/custom_nodes/ComfyUI-PanoPack/nodes/_vendor/moge_panorama.py", line 92 in split_panorama_image_gpu [11:23] [ComfyUI] File "/workspaces/Sharp-2211/ComfyUI/custom_nodes/ComfyUI-PanoPack/nodes/panorama_split_adaptive.py", line 434 in execute [11:23] [ComfyUI] File "/workspaces/Sharp-2211/ComfyUI/comfy_api/latest/_io.py", line 1892 in EXECUTE_NORMALIZED [11:23] [ComfyUI] File "/tmp/comfyui_pvenv_tqf5i7bh/persistent_worker.py", line 1762 in main [11:23] [ComfyUI] File "/tmp/comfyui_pvenv_tqf5i7bh/persistent_worker.py", line 1807 in [11:23] [ComfyUI] [11:23] [ComfyUI] [worker:ComfyUI-PanoPack] === END === [11:23] [ComfyUI] [11:26] [capture-loop] iter=1700 t=189.5s state={'complete': False, 'error': None, 'executedCount': 3, 'wsState': 1} eval_ms=2 ram=17.0/31.3GB (54%) swap=1.9/32.0GB (6%) cpu=12% browser_rss=1.13GB [11:26] [ComfyUI] [worker:ComfyUI-PanoPack] [VRAM] +756MB (now 764MB) reserved=800MB peak=1898MB [11:27] [ComfyUI] [worker:ComfyUI-PanoPack] [VRAM] +1230MB (now 1994MB) reserved=3168MB peak=1994MB [11:28] [ComfyUI] [worker:ComfyUI-PanoPack] [VRAM] -1986MB (now 8MB) reserved=3168MB peak=1994MB [11:29] [ComfyUI] [worker:ComfyUI-PanoPack] [PanoramaSplitAdaptive] rasterized RGB in 11.543s (GPU) [11:29] [ComfyUI] [worker:ComfyUI-PanoPack] [PanoramaSplitAdaptive] rasterizing depth crops... [11:31] [capture-loop] iter=1750 t=194.9s state={'complete': False, 'error': None, 'executedCount': 3, 'wsState': 1} eval_ms=2 ram=18.5/31.3GB (59%) swap=1.9/32.0GB (6%) cpu=12% browser_rss=1.13GB [11:36] [capture-loop] iter=1800 t=200.3s state={'complete': False, 'error': None, 'executedCount': 3, 'wsState': 1} eval_ms=2 ram=19.1/31.3GB (61%) swap=1.9/32.0GB (6%) cpu=12% browser_rss=1.13GB [11:40] [ComfyUI] [worker:ComfyUI-PanoPack] [VRAM] +1986MB (now 1994MB) reserved=3264MB peak=1994MB [11:41] [ComfyUI] [worker:ComfyUI-PanoPack] [VRAM] -1986MB (now 8MB) reserved=3264MB peak=1994MB [11:42] [capture-loop] iter=1850 t=205.7s state={'complete': False, 'error': None, 'executedCount': 3, 'wsState': 1} eval_ms=2 ram=20.8/31.3GB (66%) swap=1.9/32.0GB (6%) cpu=12% browser_rss=1.13GB [11:43] [ComfyUI] [worker:ComfyUI-PanoPack] [PanoramaSplitAdaptive] rasterizing normals crops... [11:47] [capture-loop] iter=1900 t=211.1s state={'complete': False, 'error': None, 'executedCount': 3, 'wsState': 1} eval_ms=2 ram=21.0/31.3GB (67%) swap=1.9/32.0GB (6%) cpu=11% browser_rss=1.13GB [11:53] [capture-loop] iter=1950 t=216.5s state={'complete': False, 'error': None, 'executedCount': 3, 'wsState': 1} eval_ms=2 ram=21.6/31.3GB (69%) swap=1.9/32.0GB (6%) cpu=12% browser_rss=1.13GB [11:55] [ComfyUI] [worker:ComfyUI-PanoPack] [VRAM] +756MB (now 764MB) reserved=3264MB peak=1994MB [11:56] [ComfyUI] [worker:ComfyUI-PanoPack] [VRAM] +1230MB (now 1994MB) reserved=3264MB peak=1994MB [11:58] [ComfyUI] [worker:ComfyUI-PanoPack] [VRAM] -1986MB (now 8MB) reserved=3264MB peak=1994MB [11:58] [capture-loop] iter=2000 t=222.0s state={'complete': False, 'error': None, 'executedCount': 3, 'wsState': 1} eval_ms=2 ram=22.9/31.3GB (73%) swap=1.9/32.0GB (6%) cpu=11% browser_rss=1.13GB [12:00] [ComfyUI] [worker:ComfyUI-PanoPack] [PanoramaSplitAdaptive] generating closest_to masks... [12:03] [capture-loop] iter=2050 t=227.3s state={'complete': False, 'error': None, 'executedCount': 3, 'wsState': 1} eval_ms=2 ram=23.8/31.3GB (76%) swap=2.1/32.0GB (7%) cpu=11% browser_rss=1.13GB [12:09] [capture-loop] iter=2100 t=232.7s state={'complete': False, 'error': None, 'executedCount': 3, 'wsState': 1} eval_ms=2 ram=23.8/31.3GB (76%) swap=2.1/32.0GB (7%) cpu=11% browser_rss=1.14GB [12:14] [capture-loop] iter=2150 t=238.1s state={'complete': False, 'error': None, 'executedCount': 3, 'wsState': 1} eval_ms=2 ram=23.9/31.3GB (76%) swap=2.1/32.0GB (7%) cpu=12% browser_rss=1.14GB [12:20] [capture-loop] iter=2200 t=243.6s state={'complete': False, 'error': None, 'executedCount': 3, 'wsState': 1} eval_ms=1 ram=23.9/31.3GB (77%) swap=2.1/32.0GB (7%) cpu=12% browser_rss=1.13GB [12:23] [ComfyUI] [worker:ComfyUI-PanoPack] [12:23] [ComfyUI] === WATCHDOG TICK 3 === [12:23] [ComfyUI] [worker:ComfyUI-PanoPack] Thread 0x000070802b3ff640 (most recent call first): [12:23] [ComfyUI] File "/tmp/comfytest-home/.ce/.pixi/envs/panopack-nodes/lib/python3.11/socket.py", line 294 in accept [12:23] [ComfyUI] File "/tmp/comfytest-home/.ce/.pixi/envs/panopack-nodes/lib/python3.11/multiprocessing/connection.py", line 626 in accept [12:23] [ComfyUI] File "/tmp/comfytest-home/.ce/.pixi/envs/panopack-nodes/lib/python3.11/multiprocessing/connection.py", line 480 in accept [12:23] [ComfyUI] File "/tmp/comfytest-home/.ce/.pixi/envs/panopack-nodes/lib/python3.11/multiprocessing/resource_sharer.py", line 138 in _serve [12:23] [ComfyUI] File "/tmp/comfytest-home/.ce/.pixi/envs/panopack-nodes/lib/python3.11/threading.py", line 982 in run [12:23] [ComfyUI] File "/tmp/comfytest-home/.ce/.pixi/envs/panopack-nodes/lib/python3.11/threading.py", line 1045 in _bootstrap_inner [12:23] [ComfyUI] File "/tmp/comfytest-home/.ce/.pixi/envs/panopack-nodes/lib/python3.11/threading.py", line 1002 in _bootstrap [12:23] [ComfyUI] [12:23] [ComfyUI] Thread 0x000070820c18e640 (most recent call first): [12:23] [ComfyUI] File "/tmp/comfyui_pvenv_tqf5i7bh/persistent_worker.py", line 106 in _vram_poller [12:23] [ComfyUI] File "/tmp/comfytest-home/.ce/.pixi/envs/panopack-nodes/lib/python3.11/threading.py", line 982 in run [12:23] [ComfyUI] File "/tmp/comfytest-home/.ce/.pixi/envs/panopack-nodes/lib/python3.11/threading.py", line 1045 in _bootstrap_inner [12:23] [ComfyUI] File "/tmp/comfytest-home/.ce/.pixi/envs/panopack-nodes/lib/python3.11/threading.py", line 1002 in _bootstrap [12:23] [ComfyUI] [12:23] [ComfyUI] Current thread 0x000070820c993640 (most recent call first): [12:23] [ComfyUI] File "/tmp/comfyui_pvenv_tqf5i7bh/persistent_worker.py", line 52 in _watchdog [12:23] [ComfyUI] File "/tmp/comfytest-home/.ce/.pixi/envs/panopack-nodes/lib/python3.11/threading.py", line 982 in run [12:23] [ComfyUI] File "/tmp/comfytest-home/.ce/.pixi/envs/panopack-nodes/lib/python3.11/threading.py", line 1045 in _bootstrap_inner [12:23] [ComfyUI] File "/tmp/comfytest-home/.ce/.pixi/envs/panopack-nodes/lib/python3.11/threading.py", line 1002 in _bootstrap [12:23] [ComfyUI] [12:23] [ComfyUI] Thread 0x000070820cfb3740 (most recent call first): [12:23] [ComfyUI] File "/tmp/comfytest-home/.ce/.pixi/envs/panopack-nodes/lib/python3.11/site-packages/numpy/linalg/_linalg.py", line 2804 in norm [12:23] [ComfyUI] File "/workspaces/Sharp-2211/ComfyUI/custom_nodes/ComfyUI-PanoPack/nodes/panorama_split_adaptive.py", line 482 in execute [12:23] [ComfyUI] File "/workspaces/Sharp-2211/ComfyUI/comfy_api/latest/_io.py", line 1892 in EXECUTE_NORMALIZED [12:23] [ComfyUI] File "/tmp/comfyui_pvenv_tqf5i7bh/persistent_worker.py", line 1762 in main [12:23] [ComfyUI] File "/tmp/comfyui_pvenv_tqf5i7bh/persistent_worker.py", line 1807 in [12:23] [ComfyUI] [12:23] [ComfyUI] [worker:ComfyUI-PanoPack] === END === [12:23] [ComfyUI] [12:25] [capture-loop] iter=2250 t=248.9s state={'complete': False, 'error': None, 'executedCount': 3, 'wsState': 1} eval_ms=2 ram=24.0/31.3GB (77%) swap=2.1/32.0GB (7%) cpu=11% browser_rss=1.13GB [12:27] [ComfyUI] [worker:ComfyUI-PanoPack] [PanoramaSplitAdaptive] generating debug_masks equirect image... [12:30] [capture-loop] iter=2300 t=254.4s state={'complete': False, 'error': None, 'executedCount': 3, 'wsState': 1} eval_ms=2 ram=26.2/31.3GB (84%) swap=2.1/32.0GB (7%) cpu=12% browser_rss=1.13GB [12:32] [ComfyUI] [worker:ComfyUI-PanoPack] [PanoramaSplitAdaptive] pixels/area: lowest 0.243 -> 0.336 (+38% on the worst-sampled cell), highest 6.44 -> 2.85; spread max/min 26.5x -> 8.5x [12:32] [ComfyUI] [worker:ComfyUI-PanoPack] [PanoramaSplitAdaptive] done: 42 adaptive faces, 100.678s total [12:36] [ComfyUI] [SubprocessWorker] got response: ok [12:36] [ComfyUI] [comfy-env] PanoramaSplitAdaptive done (104.08s): result: NodeOutput [12:36] [ComfyUI] [VRAM] After PanoramaSplitAdaptive: 6631 / 24122 MB [12:36] [ComfyUI] [VRAM] Loaded: SubprocessModel (631 MB) [12:36] [capture-loop] iter=2350 t=259.7s state={'complete': False, 'error': None, 'executedCount': 3, 'wsState': 1} eval_ms=1 ram=20.0/31.3GB (64%) swap=2.2/32.0GB (7%) cpu=11% browser_rss=1.13GB [12:36] Frame 28 saved (frame_027.jpg, t=259.7s) [12:36] [capture-periodic] freeze=1ms shot=90ms unfreeze=5ms saved=True [12:36] [ComfyUI] [comfy-env] Running SharpRayToPlanarDepth: image: torch.float32 [42,1536,1536,3] cpu, intrinsics: torch.float32 [42,3,3] cpu, extrinsics: torch.float32 [42,4,4] cpu [12:36] [ComfyUI] [ComfyUI-Sharp] python: /tmp/comfytest-home/.ce/.pixi/envs/sharp-nodes/bin/python [12:36] [ComfyUI] [VRAM] Before SharpRayToPlanarDepth: 6631 / 24122 MB [12:36] [ComfyUI] [ComfyUI-Sharp] sys_path sent to worker: ['/workspaces/Sharp-2211/ComfyUI', '/workspaces/Sharp-2211/ComfyUI/custom_nodes/ComfyUI-Sharp', '/tmp/comfytest-home/.ce/.pixi/envs/sharp-nodes/lib/python3.1/site-packages', '/workspaces/Sharp-2211/ComfyUI/custom_nodes/ComfyUI-Sharp'] [12:36] [ComfyUI] [VRAM] Loaded: SubprocessModel (631 MB) [12:36] [ComfyUI] [SubprocessWorker] is_pixi=True, python=/tmp/comfytest-home/.ce/.pixi/envs/sharp-nodes/bin/python [12:36] [ComfyUI] [SubprocessWorker] call_method: nodes.ray_to_planar_depth.SharpRayToPlanarDepth.EXECUTE_NORMALIZED [12:36] [ComfyUI] [SubprocessWorker] launching cmd=['/tmp/comfytest-home/.pixi/bin/pixi', 'run', '--as-is', '--manifest-path', '/tmp/comfytest-home/.ce/pixi.toml', '-e', 'sharp-nodes', 'python', '/tmp/comfyui_pvenv_xcjd5ki2/persistent_worker.py', 'abstract://comfy_worker_7ea96d07f1d7']... [12:36] [ComfyUI] [SubprocessWorker] acquired lock, ensuring started... [12:36] [ComfyUI] [SubprocessWorker] socket_addr=abstract://comfy_worker_7ea96d07f1d7 (abstract, no filesystem path) [12:36] [ComfyUI] [ComfyUI-Sharp] Health check: ping (timeout=5.0s)... [12:36] [ComfyUI] [ComfyUI-Sharp] Health check: failed [12:36] [ComfyUI] [ComfyUI-Sharp] Socket unhealthy, restarting worker... [12:36] Node executed (4 total), capturing... [12:37] Frame 29 saved (frame_028.jpg, t=260.4s) [12:37] [capture-node] freeze=15ms shot=111ms unfreeze=5ms saved=True [12:38] [ComfyUI] [worker:ComfyUI-Sharp] ERROR: Failed to import comfy_kitchen, Error: No module named 'comfy_kitchen', fp8 and fp4 support will not be available. [12:38] [ComfyUI] [worker:ComfyUI-Sharp] WARNING: comfy_kitchen does not support stochastic FP8 rounding, please update comfy_kitchen. [12:38] [ComfyUI] [SubprocessWorker] worker started/confirmed [12:38] [ComfyUI] [comfy-env] PRE-SERIALIZE 'image' shape: torch.Size([42, 1536, 1536, 3]) [12:38] [ComfyUI] [comfy-env] PRE-SERIALIZE 'intrinsics' shape: torch.Size([42, 3, 3]) [12:38] [ComfyUI] [comfy-env] PRE-SERIALIZE 'extrinsics' shape: torch.Size([42, 4, 4]) [12:38] [ComfyUI] [SubprocessWorker] serializing kwargs to shm... [12:38] [ComfyUI] [SubprocessWorker] created 0 shm blocks [12:38] [ComfyUI] [SubprocessWorker] sending request via socket... [12:38] [ComfyUI] [SubprocessWorker] call_id=2 sending call_method [12:38] [ComfyUI] [worker:ComfyUI-Sharp] [comfy-env] _from_shm got dict with keys: ['__type__', 'strategy', 'parent_pid', 'fd', 'storage_size'] [12:38] [ComfyUI] [worker:ComfyUI-Sharp] [comfy-env] DESERIALIZE TensorRef: tensor_size=[42, 1536, 1536, 3] [12:38] [ComfyUI] [worker:ComfyUI-Sharp] [comfy-env] DESERIALIZED tensor shape: torch.Size([42, 1536, 1536, 3]) [12:38] [ComfyUI] [worker:ComfyUI-Sharp] [comfy-env] _from_shm got dict with keys: ['__type__', 'strategy', 'parent_pid', 'fd', 'storage_size'] [12:38] [ComfyUI] [worker:ComfyUI-Sharp] [comfy-env] DESERIALIZE TensorRef: tensor_size=[42, 3, 3] [12:38] [ComfyUI] [worker:ComfyUI-Sharp] [comfy-env] DESERIALIZED tensor shape: torch.Size([42, 3, 3]) [12:38] [ComfyUI] [worker:ComfyUI-Sharp] [comfy-env] _from_shm got dict with keys: ['__type__', 'strategy', 'parent_pid', 'fd', 'storage_size'] [12:38] [ComfyUI] [worker:ComfyUI-Sharp] [comfy-env] DESERIALIZE TensorRef: tensor_size=[42, 4, 4] [12:38] [ComfyUI] [worker:ComfyUI-Sharp] [comfy-env] DESERIALIZED tensor shape: torch.Size([42, 4, 4]) [12:38] [ComfyUI] [worker:ComfyUI-Sharp] [SharpRayToPlanarDepth] detected normalized intrinsics (fx<2); rescaled to pixel-K for 1536×1536: fx=768.0 [12:40] [ComfyUI] [worker:ComfyUI-Sharp] [SharpRayToPlanarDepth] ray->planar: B=42 1536×1536, cos_map per-face (3D K), intrinsics_rescaled fx=768.0 cx=768.0 [12:41] [ComfyUI] [SubprocessWorker] got response: ok [12:41] [ComfyUI] [comfy-env] SharpRayToPlanarDepth done (4.85s): result: NodeOutput [12:41] [ComfyUI] [VRAM] After SharpRayToPlanarDepth: 6631 / 24122 MB [12:41] [ComfyUI] [VRAM] Loaded: SubprocessModel (631 MB) [12:41] [ComfyUI] [comfy-env] Running SharpPredictGaussiansFromMetricDepth: snap_to_external_depth: 'none', depth_convention: 'planar_z', focal_length_mm: 30.0, output_prefix: 'sharp_aligned', save_background_layer: True, edge_crop: 0.0, model: dict, image: torch.float32 [42,1536,1536,3] cpu, metric_depth_layer0: torch.float32 [42,1536,1536,3] cpu, extrinsics: torch.float32 [42,4,4] cpu, intrinsics: torch.float32 [42,3,3] cpu, mask: torch.float32 [42,1536,1536] cpu [12:41] [ComfyUI] [VRAM] Before SharpPredictGaussiansFromMetricDepth: 6631 / 24122 MB [12:41] [ComfyUI] [VRAM] Loaded: SubprocessModel (631 MB) [12:41] [ComfyUI] [SubprocessWorker] call_method: nodes.predict_gaussians_from_depth.SharpPredictGaussiansFromMetricDepth.EXECUTE_NORMALIZED [12:41] [ComfyUI] [SubprocessWorker] acquired lock, ensuring started... [12:41] [ComfyUI] [ComfyUI-Sharp] Health check: ping (timeout=5.0s)... [12:41] [ComfyUI] [ComfyUI-Sharp] Health check: ok [12:41] [ComfyUI] [SubprocessWorker] worker started/confirmed [12:41] [ComfyUI] [comfy-env] PRE-SERIALIZE 'image' shape: torch.Size([42, 1536, 1536, 3]) [12:41] [ComfyUI] [comfy-env] PRE-SERIALIZE 'metric_depth_layer0' shape: torch.Size([42, 1536, 1536, 3]) [12:41] [ComfyUI] [comfy-env] PRE-SERIALIZE 'extrinsics' shape: torch.Size([42, 4, 4]) [12:41] [ComfyUI] [comfy-env] PRE-SERIALIZE 'intrinsics' shape: torch.Size([42, 3, 3]) [12:41] [ComfyUI] [comfy-env] PRE-SERIALIZE 'mask' shape: torch.Size([42, 1536, 1536]) [12:41] [ComfyUI] [SubprocessWorker] serializing kwargs to shm... [12:42] [capture-loop] iter=2400 t=265.5s state={'complete': False, 'error': None, 'executedCount': 4, 'wsState': 1} eval_ms=1 ram=23.5/31.3GB (75%) swap=2.2/32.0GB (7%) cpu=14% browser_rss=1.21GB [12:42] [ComfyUI] [SubprocessWorker] created 0 shm blocks [12:42] [ComfyUI] [SubprocessWorker] sending request via socket... [12:42] [ComfyUI] [SubprocessWorker] call_id=3 sending call_method [12:42] [ComfyUI] [worker:ComfyUI-Sharp] [comfy-env] _from_shm got dict with keys: ['__type__', 'strategy', 'parent_pid', 'fd', 'storage_size'] [12:42] [ComfyUI] [worker:ComfyUI-Sharp] [comfy-env] DESERIALIZE TensorRef: tensor_size=[42, 1536, 1536, 3] [12:42] [ComfyUI] [worker:ComfyUI-Sharp] [comfy-env] DESERIALIZED tensor shape: torch.Size([42, 1536, 1536, 3]) [12:42] [ComfyUI] [worker:ComfyUI-Sharp] [comfy-env] _from_shm got dict with keys: ['__type__', 'strategy', 'parent_pid', 'fd', 'storage_size'] [12:42] [ComfyUI] [worker:ComfyUI-Sharp] [comfy-env] DESERIALIZE TensorRef: tensor_size=[42, 1536, 1536, 3] [12:42] [ComfyUI] [worker:ComfyUI-Sharp] [comfy-env] DESERIALIZED tensor shape: torch.Size([42, 1536, 1536, 3]) [12:42] [ComfyUI] [worker:ComfyUI-Sharp] [comfy-env] _from_shm got dict with keys: ['__type__', 'strategy', 'parent_pid', 'fd', 'storage_size'] [12:42] [ComfyUI] [worker:ComfyUI-Sharp] [comfy-env] DESERIALIZE TensorRef: tensor_size=[42, 4, 4] [12:42] [ComfyUI] [worker:ComfyUI-Sharp] [comfy-env] DESERIALIZED tensor shape: torch.Size([42, 4, 4]) [12:42] [ComfyUI] [worker:ComfyUI-Sharp] [comfy-env] _from_shm got dict with keys: ['__type__', 'strategy', 'parent_pid', 'fd', 'storage_size'] [12:42] [ComfyUI] [worker:ComfyUI-Sharp] [comfy-env] DESERIALIZE TensorRef: tensor_size=[42, 3, 3] [12:42] [ComfyUI] [worker:ComfyUI-Sharp] [comfy-env] DESERIALIZED tensor shape: torch.Size([42, 3, 3]) [12:42] [ComfyUI] [worker:ComfyUI-Sharp] [comfy-env] _from_shm got dict with keys: ['__type__', 'strategy', 'parent_pid', 'fd', 'storage_size'] [12:42] [ComfyUI] [worker:ComfyUI-Sharp] [comfy-env] DESERIALIZE TensorRef: tensor_size=[42, 1536, 1536] [12:42] [ComfyUI] [worker:ComfyUI-Sharp] [comfy-env] DESERIALIZED tensor shape: torch.Size([42, 1536, 1536]) [12:43] Frame 30 saved (frame_029.jpg, t=267.0s) [12:43] [capture-periodic] freeze=1ms shot=98ms unfreeze=14ms saved=True [12:46] [ComfyUI] [worker:ComfyUI-Sharp] [LoadSharpModel] loading checkpoint from /workspaces/Sharp-2211/ComfyUI/models/sharp/sharp_2572gikvuh.pt (dtype=bf16) [12:47] [capture-loop] iter=2450 t=270.9s state={'complete': False, 'error': None, 'executedCount': 4, 'wsState': 1} eval_ms=1 ram=25.1/31.3GB (80%) swap=2.2/32.0GB (7%) cpu=14% browser_rss=1.21GB [12:50] [ComfyUI] [worker:ComfyUI-Sharp] [LoadSharpModel] initializing model on meta device... [12:50] [ComfyUI] [worker:ComfyUI-Sharp] [LoadSharpModel] model ready (torch.bfloat16) [12:50] [ComfyUI] [worker:ComfyUI-Sharp] [SharpPredictGaussiansFromMetricDepth] metric_depth_layer1 unwired -> layer 1 will duplicate layer 0 (legacy behavior) [12:50] [ComfyUI] [SubprocessWorker] callback 'request_vram_budget' from call_id=3 [12:50] [ComfyUI] [comfy-env] VRAM request: 2.81GB, free before eviction: 18.34GB [12:50] [ComfyUI] [comfy-env] VRAM after eviction: 18.34GB [12:50] [ComfyUI] [worker:ComfyUI-Sharp] [VRAM] +635MB (now 635MB) reserved=640MB peak=635MB [12:50] [ComfyUI] [worker:ComfyUI-Sharp] [SharpPredictGaussiansFromMetricDepth] face 1/42: 1536×1536, extrinsics=[-0.00, -0.00, -0.00], intrinsics=fx=0.5000 cx=0.5000, mask=yes, snap=none, depth_conv=planar_z [12:51] [ComfyUI] [worker:ComfyUI-Sharp] [VRAM] +2661MB (now 3296MB) reserved=3424MB peak=3314MB [12:52] [ComfyUI] [worker:ComfyUI-Sharp] [VRAM] +2618MB (now 5914MB) reserved=6752MB peak=5914MB [12:52] [capture-loop] iter=2500 t=276.4s state={'complete': False, 'error': None, 'executedCount': 4, 'wsState': 1} eval_ms=1 ram=22.6/31.3GB (72%) swap=4.5/32.0GB (14%) cpu=18% browser_rss=1.07GB [12:53] [ComfyUI] [worker:ComfyUI-Sharp] [VRAM] -1742MB (now 4173MB) reserved=7584MB peak=7062MB [12:54] [ComfyUI] [worker:ComfyUI-Sharp] [SharpPredictGaussiansFromMetricDepth] detected normalized intrinsics (fx<2); rescaled to pixel-K for 1536x1536: fx=768.0 cx=768.0 [12:54] [ComfyUI] [worker:ComfyUI-Sharp] [VRAM] +564MB (now 4737MB) reserved=7104MB peak=7062MB [12:55] [ComfyUI] [worker:ComfyUI-Sharp] [SharpPredictGaussiansFromMetricDepth] mask -> kept 89266/1179648 gaussians (7.6%) [12:55] [ComfyUI] [SubprocessWorker] callback 'report_progress' from call_id=3 [12:55] [ComfyUI] [worker:ComfyUI-Sharp] [SharpPredictGaussiansFromMetricDepth] face 2/42: 1536×1536, extrinsics=[-0.00, -0.00, -0.00], intrinsics=fx=0.5000 cx=0.5000, mask=yes, snap=none, depth_conv=planar_z [12:55] [ComfyUI] [worker:ComfyUI-Sharp] [VRAM] +407MB (now 5145MB) reserved=7104MB peak=7062MB [12:56] Frame 31 saved (frame_030.jpg, t=280.0s) [12:56] [capture-periodic] freeze=1ms shot=101ms unfreeze=5ms saved=True [12:57] [ComfyUI] [worker:ComfyUI-Sharp] [VRAM] -555MB (now 4590MB) reserved=9824MB peak=7062MB [12:58] [capture-loop] iter=2550 t=281.8s state={'complete': False, 'error': None, 'executedCount': 4, 'wsState': 1} eval_ms=1 ram=25.0/31.3GB (80%) swap=5.9/32.0GB (18%) cpu=13% browser_rss=1.05GB [13:00] [ComfyUI] [SubprocessWorker] callback 'report_progress' from call_id=3 [13:00] [ComfyUI] [worker:ComfyUI-Sharp] [SharpPredictGaussiansFromMetricDepth] face 3/42: 1536×1536, extrinsics=[-0.00, -0.00, -0.00], intrinsics=fx=0.5000 cx=0.5000, mask=yes, snap=none, depth_conv=planar_z [13:00] [ComfyUI] [worker:ComfyUI-Sharp] [VRAM] +556MB (now 5147MB) reserved=7296MB peak=7062MB [13:01] Frame 32 saved (frame_031.jpg, t=284.4s) [13:01] [capture-periodic] freeze=1ms shot=103ms unfreeze=5ms saved=True [13:01] [ComfyUI] [worker:ComfyUI-Sharp] [VRAM] -555MB (now 4592MB) reserved=11456MB peak=7062MB [13:03] [capture-loop] iter=2600 t=287.3s state={'complete': False, 'error': None, 'executedCount': 4, 'wsState': 1} eval_ms=1 ram=22.2/31.3GB (71%) swap=7.2/32.0GB (22%) cpu=13% browser_rss=1.00GB [13:04] [ComfyUI] [SubprocessWorker] callback 'report_progress' from call_id=3 [13:04] [ComfyUI] [worker:ComfyUI-Sharp] [SharpPredictGaussiansFromMetricDepth] face 4/42: 1536×1536, extrinsics=[-0.00, -0.00, -0.00], intrinsics=fx=0.5000 cx=0.5000, mask=yes, snap=none, depth_conv=planar_z [13:04] [ComfyUI] [worker:ComfyUI-Sharp] [VRAM] +514MB (now 5107MB) reserved=7616MB peak=7062MB [13:05] Frame 33 saved (frame_032.jpg, t=288.8s) [13:05] [capture-periodic] freeze=1ms shot=104ms unfreeze=4ms saved=True [13:05] [ComfyUI] [worker:ComfyUI-Sharp] [VRAM] +345MB (now 5453MB) reserved=6208MB peak=7062MB [13:06] [ComfyUI] [worker:ComfyUI-Sharp] [VRAM] -864MB (now 4589MB) reserved=10624MB peak=7062MB [13:08] [ComfyUI] [SubprocessWorker] callback 'report_progress' from call_id=3 [13:08] [ComfyUI] [worker:ComfyUI-Sharp] [SharpPredictGaussiansFromMetricDepth] face 5/42: 1536×1536, extrinsics=[-0.00, -0.00, -0.00], intrinsics=fx=0.5000 cx=0.5000, mask=yes, snap=none, depth_conv=planar_z [13:08] [ComfyUI] [worker:ComfyUI-Sharp] [VRAM] +567MB (now 5157MB) reserved=7328MB peak=7062MB [13:09] [capture-loop] iter=2650 t=292.7s state={'complete': False, 'error': None, 'executedCount': 4, 'wsState': 1} eval_ms=1 ram=22.5/31.3GB (72%) swap=7.2/32.0GB (22%) cpu=15% browser_rss=1.00GB [13:09] Frame 34 saved (frame_033.jpg, t=293.1s) [13:09] [capture-periodic] freeze=1ms shot=99ms unfreeze=7ms saved=True [13:09] [ComfyUI] [worker:ComfyUI-Sharp] [VRAM] -564MB (now 4593MB) reserved=10752MB peak=7062MB [13:12] [ComfyUI] [SubprocessWorker] callback 'report_progress' from call_id=3 [13:12] [ComfyUI] [worker:ComfyUI-Sharp] [SharpPredictGaussiansFromMetricDepth] face 6/42: 1536×1536, extrinsics=[-0.00, -0.00, -0.00], intrinsics=fx=0.5000 cx=0.5000, mask=yes, snap=none, depth_conv=planar_z [13:12] [ComfyUI] [worker:ComfyUI-Sharp] [VRAM] +523MB (now 5117MB) reserved=7744MB peak=7062MB [13:13] [ComfyUI] [worker:ComfyUI-Sharp] [VRAM] -528MB (now 4590MB) reserved=10144MB peak=7062MB [13:14] Frame 35 saved (frame_034.jpg, t=297.4s) [13:14] [capture-periodic] freeze=1ms shot=104ms unfreeze=4ms saved=True [13:14] [capture-loop] iter=2700 t=298.2s state={'complete': False, 'error': None, 'executedCount': 4, 'wsState': 1} eval_ms=1 ram=23.5/31.3GB (75%) swap=7.4/32.0GB (23%) cpu=13% browser_rss=0.98GB [13:16] [ComfyUI] [SubprocessWorker] callback 'report_progress' from call_id=3 [13:16] [ComfyUI] [worker:ComfyUI-Sharp] [SharpPredictGaussiansFromMetricDepth] face 7/42: 1536×1536, extrinsics=[-0.00, -0.00, -0.00], intrinsics=fx=0.5000 cx=0.5000, mask=yes, snap=none, depth_conv=planar_z [13:16] [ComfyUI] [worker:ComfyUI-Sharp] [VRAM] +552MB (now 5142MB) reserved=7648MB peak=7062MB [13:17] [ComfyUI] [worker:ComfyUI-Sharp] [VRAM] -555MB (now 4588MB) reserved=11584MB peak=7062MB [13:18] Frame 36 saved (frame_035.jpg, t=301.8s) [13:18] [capture-periodic] freeze=1ms shot=104ms unfreeze=5ms saved=True [13:20] [capture-loop] iter=2750 t=303.6s state={'complete': False, 'error': None, 'executedCount': 4, 'wsState': 1} eval_ms=1 ram=22.2/31.3GB (71%) swap=7.6/32.0GB (24%) cpu=12% browser_rss=0.97GB [13:20] [ComfyUI] [SubprocessWorker] callback 'report_progress' from call_id=3 [13:20] [ComfyUI] [worker:ComfyUI-Sharp] [SharpPredictGaussiansFromMetricDepth] face 8/42: 1536×1536, extrinsics=[-0.00, -0.00, -0.00], intrinsics=fx=0.5000 cx=0.5000, mask=yes, snap=none, depth_conv=planar_z [13:20] [ComfyUI] [worker:ComfyUI-Sharp] [VRAM] +556MB (now 5145MB) reserved=7936MB peak=7062MB [13:20] Frame 37 saved (frame_036.jpg, t=304.0s) [13:20] [capture-periodic] freeze=1ms shot=110ms unfreeze=6ms saved=True [13:21] [ComfyUI] [worker:ComfyUI-Sharp] [VRAM] -555MB (now 4591MB) reserved=10656MB peak=7062MB [13:24] [ComfyUI] [SubprocessWorker] callback 'report_progress' from call_id=3 [13:24] [ComfyUI] [worker:ComfyUI-Sharp] [SharpPredictGaussiansFromMetricDepth] face 9/42: 1536×1536, extrinsics=[-0.00, -0.00, -0.00], intrinsics=fx=0.5000 cx=0.5000, mask=yes, snap=none, depth_conv=planar_z [13:24] [ComfyUI] [worker:ComfyUI-Sharp] [VRAM] +520MB (now 5111MB) reserved=7904MB peak=7062MB [13:25] Frame 38 saved (frame_037.jpg, t=308.4s) [13:25] [capture-periodic] freeze=1ms shot=114ms unfreeze=14ms saved=True [13:25] [capture-loop] iter=2800 t=309.1s state={'complete': False, 'error': None, 'executedCount': 4, 'wsState': 1} eval_ms=1 ram=22.2/31.3GB (71%) swap=7.6/32.0GB (24%) cpu=14% browser_rss=0.97GB [13:25] [ComfyUI] [worker:ComfyUI-Sharp] [VRAM] -519MB (now 4593MB) reserved=10688MB peak=7062MB [13:28] [ComfyUI] [SubprocessWorker] callback 'report_progress' from call_id=3 [13:28] [ComfyUI] [worker:ComfyUI-Sharp] [SharpPredictGaussiansFromMetricDepth] face 10/42: 1536×1536, extrinsics=[-0.00, -0.00, -0.00], intrinsics=fx=0.5000 cx=0.5000, mask=yes, snap=none, depth_conv=planar_z [13:28] [ComfyUI] [worker:ComfyUI-Sharp] [VRAM] +508MB (now 5101MB) reserved=8000MB peak=7062MB [13:29] Frame 39 saved (frame_038.jpg, t=312.7s) [13:29] [capture-periodic] freeze=1ms shot=100ms unfreeze=5ms saved=True [13:30] [ComfyUI] [worker:ComfyUI-Sharp] [VRAM] -510MB (now 4592MB) reserved=12160MB peak=7062MB [13:31] [capture-loop] iter=2850 t=314.5s state={'complete': False, 'error': None, 'executedCount': 4, 'wsState': 1} eval_ms=1 ram=23.5/31.3GB (75%) swap=7.6/32.0GB (24%) cpu=11% browser_rss=0.97GB [13:32] [ComfyUI] [SubprocessWorker] callback 'report_progress' from call_id=3 [13:32] [ComfyUI] [worker:ComfyUI-Sharp] [SharpPredictGaussiansFromMetricDepth] face 11/42: 1536×1536, extrinsics=[-0.00, -0.00, -0.00], intrinsics=fx=0.5000 cx=0.5000, mask=yes, snap=none, depth_conv=planar_z [13:32] [ComfyUI] [worker:ComfyUI-Sharp] [VRAM] +578MB (now 5170MB) reserved=7872MB peak=7062MB [13:33] Frame 40 saved (frame_039.jpg, t=317.1s) [13:33] [capture-periodic] freeze=1ms shot=105ms unfreeze=2ms saved=True [13:34] [ComfyUI] [worker:ComfyUI-Sharp] [VRAM] -582MB (now 4589MB) reserved=11616MB peak=7062MB [13:36] [capture-loop] iter=2900 t=320.0s state={'complete': False, 'error': None, 'executedCount': 4, 'wsState': 1} eval_ms=1 ram=22.4/31.3GB (72%) swap=7.6/32.0GB (24%) cpu=14% browser_rss=0.97GB [13:36] [ComfyUI] [SubprocessWorker] callback 'report_progress' from call_id=3 [13:36] [ComfyUI] [worker:ComfyUI-Sharp] [SharpPredictGaussiansFromMetricDepth] face 12/42: 1536×1536, extrinsics=[-0.00, -0.00, -0.00], intrinsics=fx=0.5000 cx=0.5000, mask=yes, snap=none, depth_conv=planar_z [13:36] [ComfyUI] [worker:ComfyUI-Sharp] [13:36] [ComfyUI] === WATCHDOG TICK 1 === [13:36] [ComfyUI] [worker:ComfyUI-Sharp] Thread 0x00007f1480bff640 (most recent call first): [13:36] [ComfyUI] File "/tmp/comfytest-home/.ce/.pixi/envs/sharp-nodes/lib/python3.11/socket.py", line 294 in accept [13:36] [ComfyUI] File "/tmp/comfytest-home/.ce/.pixi/envs/sharp-nodes/lib/python3.11/multiprocessing/connection.py", line 626 in accept [13:36] [ComfyUI] File "/tmp/comfytest-home/.ce/.pixi/envs/sharp-nodes/lib/python3.11/multiprocessing/connection.py", line 480 in accept [13:36] [ComfyUI] File "/tmp/comfytest-home/.ce/.pixi/envs/sharp-nodes/lib/python3.11/multiprocessing/resource_sharer.py", line 138 in _serve [13:36] [ComfyUI] File "/tmp/comfytest-home/.ce/.pixi/envs/sharp-nodes/lib/python3.11/threading.py", line 982 in run [13:36] [ComfyUI] File "/tmp/comfytest-home/.ce/.pixi/envs/sharp-nodes/lib/python3.11/threading.py", line 1045 in _bootstrap_inner [13:36] [ComfyUI] File "/tmp/comfytest-home/.ce/.pixi/envs/sharp-nodes/lib/python3.11/threading.py", line 1002 in _bootstrap [13:36] [ComfyUI] [13:36] [ComfyUI] Thread 0x00007f1634a0f640 (most recent call first): [13:36] [ComfyUI] File "/tmp/comfyui_pvenv_xcjd5ki2/persistent_worker.py", line 106 in _vram_poller [13:36] [ComfyUI] File "/tmp/comfytest-home/.ce/.pixi/envs/sharp-nodes/lib/python3.11/threading.py", line 982 in run [13:36] [ComfyUI] File "/tmp/comfytest-home/.ce/.pixi/envs/sharp-nodes/lib/python3.11/threading.py", line 1045 in _bootstrap_inner [13:36] [ComfyUI] File "/tmp/comfytest-home/.ce/.pixi/envs/sharp-nodes/lib/python3.11/threading.py", line 1002 in _bootstrap [13:36] [ComfyUI] [13:36] [ComfyUI] Current thread 0x00007f1635214640 (most recent call first): [13:36] [ComfyUI] File "/tmp/comfyui_pvenv_xcjd5ki2/persistent_worker.py", line 52 in _watchdog [13:36] [ComfyUI] File "/tmp/comfytest-home/.ce/.pixi/envs/sharp-nodes/lib/python3.11/threading.py", line 982 in run [13:36] [ComfyUI] File "/tmp/comfytest-home/.ce/.pixi/envs/sharp-nodes/lib/python3.11/threading.py", line 1045 in _bootstrap_inner [13:36] [ComfyUI] File "/tmp/comfytest-home/.ce/.pixi/envs/sharp-nodes/lib/python3.11/threading.py", line 1002 in _bootstrap [13:36] [ComfyUI] [13:36] [ComfyUI] Thread 0x00007f1635834740 (most recent call first): [13:36] [ComfyUI] File "/workspaces/Sharp-2211/ComfyUI/custom_nodes/ComfyUI-Sharp/nodes/predict_gaussians_from_depth.py", line 385 in execute [13:36] [ComfyUI] File "/tmp/comfytest-home/.ce/.pixi/envs/sharp-nodes/lib/python3.11/site-packages/torch/utils/_contextlib.py", line 124 in decorate_context [13:36] [ComfyUI] File "/workspaces/Sharp-2211/ComfyUI/comfy_api/latest/_io.py", line 1892 in EXECUTE_NORMALIZED [13:36] [ComfyUI] File "/tmp/comfyui_pvenv_xcjd5ki2/persistent_worker.py", line 1762 in main [13:36] [ComfyUI] File "/tmp/comfyui_pvenv_xcjd5ki2/persistent_worker.py", line 1807 in [13:36] [ComfyUI] [13:36] [ComfyUI] [worker:ComfyUI-Sharp] === END === [13:36] [ComfyUI] [13:36] [ComfyUI] [worker:ComfyUI-Sharp] [VRAM] +555MB (now 5144MB) reserved=7328MB peak=7062MB [13:38] Frame 41 saved (frame_040.jpg, t=321.4s) [13:38] [capture-periodic] freeze=1ms shot=97ms unfreeze=1ms saved=True [13:38] [ComfyUI] [worker:ComfyUI-Sharp] [VRAM] -555MB (now 4590MB) reserved=10048MB peak=7062MB [13:40] [ComfyUI] [SubprocessWorker] callback 'report_progress' from call_id=3 [13:40] [ComfyUI] [worker:ComfyUI-Sharp] [SharpPredictGaussiansFromMetricDepth] face 13/42: 1536×1536, extrinsics=[-0.00, -0.00, -0.00], intrinsics=fx=0.5000 cx=0.5000, mask=yes, snap=none, depth_conv=planar_z [13:40] [ComfyUI] [worker:ComfyUI-Sharp] [VRAM] +519MB (now 5110MB) reserved=7584MB peak=7062MB [13:41] [capture-loop] iter=2950 t=325.3s state={'complete': False, 'error': None, 'executedCount': 4, 'wsState': 1} eval_ms=1 ram=22.3/31.3GB (71%) swap=7.6/32.0GB (24%) cpu=11% browser_rss=0.98GB [13:42] [ComfyUI] [worker:ComfyUI-Sharp] [VRAM] -281MB (now 4830MB) reserved=5440MB peak=7062MB [13:42] Frame 42 saved (frame_041.jpg, t=325.8s) [13:42] [capture-periodic] freeze=1ms shot=95ms unfreeze=5ms saved=True [13:43] [ComfyUI] [worker:ComfyUI-Sharp] [VRAM] -238MB (now 4592MB) reserved=10176MB peak=7062MB [13:44] [ComfyUI] [SubprocessWorker] callback 'report_progress' from call_id=3 [13:44] [ComfyUI] [worker:ComfyUI-Sharp] [SharpPredictGaussiansFromMetricDepth] face 14/42: 1536×1536, extrinsics=[-0.00, -0.00, -0.00], intrinsics=fx=0.5000 cx=0.5000, mask=yes, snap=none, depth_conv=planar_z [13:44] [ComfyUI] [worker:ComfyUI-Sharp] [VRAM] +574MB (now 5166MB) reserved=7744MB peak=7062MB [13:46] [ComfyUI] [worker:ComfyUI-Sharp] [VRAM] -573MB (now 4594MB) reserved=10144MB peak=7062MB [13:46] Frame 43 saved (frame_042.jpg, t=330.1s) [13:46] [capture-periodic] freeze=1ms shot=102ms unfreeze=6ms saved=True [13:47] [capture-loop] iter=3000 t=330.9s state={'complete': False, 'error': None, 'executedCount': 4, 'wsState': 1} eval_ms=1 ram=23.4/31.3GB (75%) swap=7.6/32.0GB (24%) cpu=11% browser_rss=0.98GB [13:48] [ComfyUI] [SubprocessWorker] callback 'report_progress' from call_id=3 [13:48] [ComfyUI] [worker:ComfyUI-Sharp] [SharpPredictGaussiansFromMetricDepth] face 15/42: 1536×1536, extrinsics=[-0.00, -0.00, -0.00], intrinsics=fx=0.5000 cx=0.5000, mask=yes, snap=none, depth_conv=planar_z [13:49] [ComfyUI] [worker:ComfyUI-Sharp] [VRAM] +581MB (now 5176MB) reserved=7264MB peak=7062MB [13:50] [ComfyUI] [worker:ComfyUI-Sharp] [VRAM] -582MB (now 4595MB) reserved=10144MB peak=7062MB [13:51] Frame 44 saved (frame_043.jpg, t=334.5s) [13:51] [capture-periodic] freeze=1ms shot=106ms unfreeze=1ms saved=True [13:52] [capture-loop] iter=3050 t=336.2s state={'complete': False, 'error': None, 'executedCount': 4, 'wsState': 1} eval_ms=1 ram=22.3/31.3GB (71%) swap=7.6/32.0GB (24%) cpu=11% browser_rss=0.99GB [13:52] [ComfyUI] [SubprocessWorker] callback 'report_progress' from call_id=3 [13:53] [ComfyUI] [worker:ComfyUI-Sharp] [SharpPredictGaussiansFromMetricDepth] face 16/42: 1536×1536, extrinsics=[-0.00, -0.00, -0.00], intrinsics=fx=0.5000 cx=0.5000, mask=yes, snap=none, depth_conv=planar_z [13:53] [ComfyUI] [worker:ComfyUI-Sharp] [VRAM] +517MB (now 5113MB) reserved=7744MB peak=7062MB [13:53] Frame 45 saved (frame_044.jpg, t=336.7s) [13:53] [capture-periodic] freeze=4ms shot=102ms unfreeze=1ms saved=True [13:54] [ComfyUI] [worker:ComfyUI-Sharp] [VRAM] -519MB (now 4595MB) reserved=10176MB peak=7062MB [13:56] [ComfyUI] [SubprocessWorker] callback 'report_progress' from call_id=3 [13:56] [ComfyUI] [worker:ComfyUI-Sharp] [SharpPredictGaussiansFromMetricDepth] face 17/42: 1536×1536, extrinsics=[-0.00, -0.00, -0.00], intrinsics=fx=0.5000 cx=0.5000, mask=yes, snap=none, depth_conv=planar_z [13:57] [ComfyUI] [worker:ComfyUI-Sharp] [VRAM] +549MB (now 5144MB) reserved=7840MB peak=7062MB [13:57] Frame 46 saved (frame_045.jpg, t=341.1s) [13:57] [capture-periodic] freeze=1ms shot=102ms unfreeze=1ms saved=True [13:58] [capture-loop] iter=3100 t=341.9s state={'complete': False, 'error': None, 'executedCount': 4, 'wsState': 1} eval_ms=1 ram=22.6/31.3GB (72%) swap=7.6/32.0GB (24%) cpu=12% browser_rss=0.99GB [13:58] [ComfyUI] [worker:ComfyUI-Sharp] [VRAM] -319MB (now 4825MB) reserved=5376MB peak=7062MB [13:59] [ComfyUI] [worker:ComfyUI-Sharp] [VRAM] -236MB (now 4589MB) reserved=10144MB peak=7062MB [14:01] [ComfyUI] [SubprocessWorker] callback 'report_progress' from call_id=3 [14:01] [ComfyUI] [worker:ComfyUI-Sharp] [SharpPredictGaussiansFromMetricDepth] face 18/42: 1536×1536, extrinsics=[-0.00, -0.00, -0.00], intrinsics=fx=0.5000 cx=0.5000, mask=yes, snap=none, depth_conv=planar_z [14:01] [ComfyUI] [worker:ComfyUI-Sharp] [VRAM] +526MB (now 5116MB) reserved=7488MB peak=7062MB [14:02] Frame 47 saved (frame_046.jpg, t=345.4s) [14:02] [capture-periodic] freeze=1ms shot=106ms unfreeze=2ms saved=True [14:02] [ComfyUI] [worker:ComfyUI-Sharp] [VRAM] -528MB (now 4589MB) reserved=10176MB peak=7062MB [14:03] [capture-loop] iter=3150 t=347.2s state={'complete': False, 'error': None, 'executedCount': 4, 'wsState': 1} eval_ms=1 ram=23.5/31.3GB (75%) swap=7.9/32.0GB (25%) cpu=15% browser_rss=0.99GB [14:04] [ComfyUI] [SubprocessWorker] callback 'report_progress' from call_id=3 [14:04] [ComfyUI] [worker:ComfyUI-Sharp] [SharpPredictGaussiansFromMetricDepth] face 19/42: 1536×1536, extrinsics=[-0.00, -0.00, -0.00], intrinsics=fx=0.5000 cx=0.5000, mask=yes, snap=none, depth_conv=planar_z [14:05] [ComfyUI] [worker:ComfyUI-Sharp] [VRAM] +562MB (now 5152MB) reserved=7840MB peak=7062MB [14:06] Frame 48 saved (frame_047.jpg, t=349.8s) [14:06] [capture-periodic] freeze=1ms shot=107ms unfreeze=5ms saved=True [14:06] [ComfyUI] [worker:ComfyUI-Sharp] [VRAM] -564MB (now 4589MB) reserved=10176MB peak=7062MB [14:09] [ComfyUI] [SubprocessWorker] callback 'report_progress' from call_id=3 [14:09] [ComfyUI] [worker:ComfyUI-Sharp] [SharpPredictGaussiansFromMetricDepth] face 20/42: 1536×1536, extrinsics=[-0.00, -0.00, -0.00], intrinsics=fx=0.5000 cx=0.5000, mask=yes, snap=none, depth_conv=planar_z [14:09] [capture-loop] iter=3200 t=352.7s state={'complete': False, 'error': None, 'executedCount': 4, 'wsState': 1} eval_ms=2 ram=22.3/31.3GB (71%) swap=7.9/32.0GB (25%) cpu=12% browser_rss=0.99GB [14:09] [ComfyUI] [worker:ComfyUI-Sharp] [VRAM] +527MB (now 5116MB) reserved=7296MB peak=7062MB [14:10] [ComfyUI] [worker:ComfyUI-Sharp] [VRAM] +336MB (now 5453MB) reserved=6208MB peak=7062MB [14:10] Frame 49 saved (frame_048.jpg, t=354.1s) [14:10] [capture-periodic] freeze=1ms shot=106ms unfreeze=5ms saved=True [14:11] [ComfyUI] [worker:ComfyUI-Sharp] [VRAM] -864MB (now 4589MB) reserved=11616MB peak=7062MB [14:13] [ComfyUI] [SubprocessWorker] callback 'report_progress' from call_id=3 [14:13] [ComfyUI] [worker:ComfyUI-Sharp] [SharpPredictGaussiansFromMetricDepth] face 21/42: 1536×1536, extrinsics=[-0.00, -0.00, -0.00], intrinsics=fx=0.5000 cx=0.5000, mask=yes, snap=none, depth_conv=planar_z [14:13] [ComfyUI] [worker:ComfyUI-Sharp] [VRAM] +581MB (now 5170MB) reserved=7904MB peak=7062MB [14:14] [capture-loop] iter=3250 t=358.1s state={'complete': False, 'error': None, 'executedCount': 4, 'wsState': 1} eval_ms=1 ram=22.4/31.3GB (72%) swap=7.9/32.0GB (25%) cpu=12% browser_rss=0.92GB [14:14] [ComfyUI] [worker:ComfyUI-Sharp] [VRAM] -582MB (now 4589MB) reserved=12128MB peak=7062MB [14:15] Frame 50 saved (frame_049.jpg, t=358.5s) [14:15] [capture-periodic] freeze=1ms shot=96ms unfreeze=5ms saved=True [14:17] [ComfyUI] [SubprocessWorker] callback 'report_progress' from call_id=3 [14:17] [ComfyUI] [worker:ComfyUI-Sharp] [SharpPredictGaussiansFromMetricDepth] face 22/42: 1536×1536, extrinsics=[-0.00, -0.00, -0.00], intrinsics=fx=0.5000 cx=0.5000, mask=yes, snap=none, depth_conv=planar_z [14:17] [ComfyUI] [worker:ComfyUI-Sharp] [VRAM] +582MB (now 5171MB) reserved=7648MB peak=7062MB [14:19] [ComfyUI] [worker:ComfyUI-Sharp] [VRAM] -582MB (now 4590MB) reserved=9984MB peak=7062MB [14:19] Frame 51 saved (frame_050.jpg, t=362.8s) [14:19] [capture-periodic] freeze=1ms shot=100ms unfreeze=5ms saved=True [14:20] [capture-loop] iter=3300 t=363.6s state={'complete': False, 'error': None, 'executedCount': 4, 'wsState': 1} eval_ms=1 ram=23.9/31.3GB (76%) swap=7.9/32.0GB (25%) cpu=12% browser_rss=0.93GB [14:21] [ComfyUI] [SubprocessWorker] callback 'report_progress' from call_id=3 [14:21] [ComfyUI] [worker:ComfyUI-Sharp] [SharpPredictGaussiansFromMetricDepth] face 23/42: 1536×1536, extrinsics=[-0.00, -0.00, -0.00], intrinsics=fx=0.5000 cx=0.5000, mask=yes, snap=none, depth_conv=planar_z [14:21] [ComfyUI] [worker:ComfyUI-Sharp] [VRAM] +563MB (now 5153MB) reserved=7680MB peak=7062MB [14:21] Frame 52 saved (frame_051.jpg, t=365.0s) [14:21] [capture-periodic] freeze=1ms shot=98ms unfreeze=1ms saved=True [14:23] [ComfyUI] [worker:ComfyUI-Sharp] [VRAM] -564MB (now 4590MB) reserved=10176MB peak=7062MB [14:25] [capture-loop] iter=3350 t=369.0s state={'complete': False, 'error': None, 'executedCount': 4, 'wsState': 1} eval_ms=1 ram=22.4/31.3GB (72%) swap=7.8/32.0GB (24%) cpu=13% browser_rss=0.92GB [14:25] [ComfyUI] [SubprocessWorker] callback 'report_progress' from call_id=3 [14:25] [ComfyUI] [worker:ComfyUI-Sharp] [SharpPredictGaussiansFromMetricDepth] face 24/42: 1536×1536, extrinsics=[-0.00, -0.00, -0.00], intrinsics=fx=0.5000 cx=0.5000, mask=yes, snap=none, depth_conv=planar_z [14:25] [ComfyUI] [worker:ComfyUI-Sharp] [VRAM] +580MB (now 5171MB) reserved=7968MB peak=7062MB [14:26] Frame 53 saved (frame_052.jpg, t=369.4s) [14:26] [capture-periodic] freeze=1ms shot=94ms unfreeze=4ms saved=True [14:27] [ComfyUI] [worker:ComfyUI-Sharp] [VRAM] -582MB (now 4590MB) reserved=12032MB peak=7062MB [14:29] [ComfyUI] [SubprocessWorker] callback 'report_progress' from call_id=3 [14:29] [ComfyUI] [worker:ComfyUI-Sharp] [SharpPredictGaussiansFromMetricDepth] face 25/42: 1536×1536, extrinsics=[-0.00, -0.00, -0.00], intrinsics=fx=0.5000 cx=0.5000, mask=yes, snap=none, depth_conv=planar_z [14:29] [ComfyUI] [worker:ComfyUI-Sharp] [VRAM] +508MB (now 5098MB) reserved=7296MB peak=7062MB [14:30] Frame 54 saved (frame_053.jpg, t=373.7s) [14:30] [capture-periodic] freeze=1ms shot=103ms unfreeze=5ms saved=True [14:31] [capture-loop] iter=3400 t=374.5s state={'complete': False, 'error': None, 'executedCount': 4, 'wsState': 1} eval_ms=1 ram=22.5/31.3GB (72%) swap=7.8/32.0GB (24%) cpu=12% browser_rss=0.92GB [14:31] [ComfyUI] [worker:ComfyUI-Sharp] [VRAM] +354MB (now 5453MB) reserved=6144MB peak=7062MB [14:32] [ComfyUI] [worker:ComfyUI-Sharp] [VRAM] -864MB (now 4589MB) reserved=10144MB peak=7062MB [14:33] [ComfyUI] [SubprocessWorker] callback 'report_progress' from call_id=3 [14:33] [ComfyUI] [worker:ComfyUI-Sharp] [SharpPredictGaussiansFromMetricDepth] face 26/42: 1536×1536, extrinsics=[-0.00, -0.00, -0.00], intrinsics=fx=0.5000 cx=0.5000, mask=yes, snap=none, depth_conv=planar_z [14:33] [ComfyUI] [worker:ComfyUI-Sharp] [VRAM] +512MB (now 5102MB) reserved=7584MB peak=7062MB [14:34] Frame 55 saved (frame_054.jpg, t=378.1s) [14:34] [capture-periodic] freeze=1ms shot=95ms unfreeze=5ms saved=True [14:35] [ComfyUI] [worker:ComfyUI-Sharp] [VRAM] +354MB (now 5457MB) reserved=6112MB peak=7062MB [14:36] [ComfyUI] [worker:ComfyUI-Sharp] [VRAM] -864MB (now 4593MB) reserved=10688MB peak=7062MB [14:36] [capture-loop] iter=3450 t=379.8s state={'complete': False, 'error': None, 'executedCount': 4, 'wsState': 1} eval_ms=1 ram=23.8/31.3GB (76%) swap=7.8/32.0GB (24%) cpu=12% browser_rss=0.93GB [14:36] [ComfyUI] [worker:ComfyUI-Sharp] [14:36] [ComfyUI] === WATCHDOG TICK 2 === [14:36] [ComfyUI] [worker:ComfyUI-Sharp] Thread 0x00007f1480bff640 (most recent call first): [14:36] [ComfyUI] File "/tmp/comfytest-home/.ce/.pixi/envs/sharp-nodes/lib/python3.11/socket.py", line 294 in accept [14:36] [ComfyUI] File "/tmp/comfytest-home/.ce/.pixi/envs/sharp-nodes/lib/python3.11/multiprocessing/connection.py", line 626 in accept [14:36] [ComfyUI] File "/tmp/comfytest-home/.ce/.pixi/envs/sharp-nodes/lib/python3.11/multiprocessing/connection.py", line 480 in accept [14:36] [ComfyUI] File "/tmp/comfytest-home/.ce/.pixi/envs/sharp-nodes/lib/python3.11/multiprocessing/resource_sharer.py", line 138 in _serve [14:36] [ComfyUI] File "/tmp/comfytest-home/.ce/.pixi/envs/sharp-nodes/lib/python3.11/threading.py", line 982 in run [14:36] [ComfyUI] File "/tmp/comfytest-home/.ce/.pixi/envs/sharp-nodes/lib/python3.11/threading.py", line 1045 in _bootstrap_inner [14:36] [ComfyUI] File "/tmp/comfytest-home/.ce/.pixi/envs/sharp-nodes/lib/python3.11/threading.py", line 1002 in _bootstrap [14:36] [ComfyUI] [14:36] [ComfyUI] Thread 0x00007f1634a0f640 (most recent call first): [14:36] [ComfyUI] File "/tmp/comfyui_pvenv_xcjd5ki2/persistent_worker.py", line 106 in _vram_poller [14:36] [ComfyUI] File "/tmp/comfytest-home/.ce/.pixi/envs/sharp-nodes/lib/python3.11/threading.py", line 982 in run [14:36] [ComfyUI] File "/tmp/comfytest-home/.ce/.pixi/envs/sharp-nodes/lib/python3.11/threading.py", line 1045 in _bootstrap_inner [14:36] [ComfyUI] File "/tmp/comfytest-home/.ce/.pixi/envs/sharp-nodes/lib/python3.11/threading.py", line 1002 in _bootstrap [14:36] [ComfyUI] [14:36] [ComfyUI] Current thread 0x00007f1635214640 (most recent call first): [14:36] [ComfyUI] File "/tmp/comfyui_pvenv_xcjd5ki2/persistent_worker.py", line 52 in _watchdog [14:36] [ComfyUI] File "/tmp/comfytest-home/.ce/.pixi/envs/sharp-nodes/lib/python3.11/threading.py", line 982 in run [14:36] [ComfyUI] File "/tmp/comfytest-home/.ce/.pixi/envs/sharp-nodes/lib/python3.11/threading.py", line 1045 in _bootstrap_inner [14:36] [ComfyUI] File "/tmp/comfytest-home/.ce/.pixi/envs/sharp-nodes/lib/python3.11/threading.py", line 1002 in _bootstrap [14:36] [ComfyUI] [14:36] [ComfyUI] Thread 0x00007f1635834740 (most recent call first): [14:36] [ComfyUI] File "/workspaces/Sharp-2211/ComfyUI/custom_nodes/ComfyUI-Sharp/nodes/predict_gaussians_from_depth.py", line 394 in execute [14:36] [ComfyUI] File "/tmp/comfytest-home/.ce/.pixi/envs/sharp-nodes/lib/python3.11/site-packages/torch/utils/_contextlib.py", line 124 in decorate_context [14:36] [ComfyUI] File "/workspaces/Sharp-2211/ComfyUI/comfy_api/latest/_io.py", line 1892 in EXECUTE_NORMALIZED [14:36] [ComfyUI] File "/tmp/comfyui_pvenv_xcjd5ki2/persistent_worker.py", line 1762 in main [14:36] [ComfyUI] File "/tmp/comfyui_pvenv_xcjd5ki2/persistent_worker.py", line 1807 in [14:36] [ComfyUI] [14:36] [ComfyUI] [worker:ComfyUI-Sharp] === END === [14:36] [ComfyUI] [14:37] [ComfyUI] [SubprocessWorker] callback 'report_progress' from call_id=3 [14:37] [ComfyUI] [worker:ComfyUI-Sharp] [SharpPredictGaussiansFromMetricDepth] face 27/42: 1536×1536, extrinsics=[-0.00, -0.00, -0.00], intrinsics=fx=0.5000 cx=0.5000, mask=yes, snap=none, depth_conv=planar_z [14:37] [ComfyUI] [worker:ComfyUI-Sharp] [VRAM] +525MB (now 5118MB) reserved=7296MB peak=7062MB [14:39] Frame 56 saved (frame_055.jpg, t=382.4s) [14:39] [capture-periodic] freeze=1ms shot=102ms unfreeze=5ms saved=True [14:39] [ComfyUI] [worker:ComfyUI-Sharp] [VRAM] +469MB (now 5587MB) reserved=6176MB peak=7062MB [14:40] [ComfyUI] [worker:ComfyUI-Sharp] [VRAM] -997MB (now 4591MB) reserved=11968MB peak=7062MB [14:41] [capture-loop] iter=3500 t=385.3s state={'complete': False, 'error': None, 'executedCount': 4, 'wsState': 1} eval_ms=1 ram=21.8/31.3GB (70%) swap=8.1/32.0GB (25%) cpu=14% browser_rss=0.93GB [14:41] [ComfyUI] [SubprocessWorker] callback 'report_progress' from call_id=3 [14:41] [ComfyUI] [worker:ComfyUI-Sharp] [SharpPredictGaussiansFromMetricDepth] face 28/42: 1536×1536, extrinsics=[-0.00, -0.00, -0.00], intrinsics=fx=0.5000 cx=0.5000, mask=yes, snap=none, depth_conv=planar_z [14:42] [ComfyUI] [worker:ComfyUI-Sharp] [VRAM] +557MB (now 5148MB) reserved=7616MB peak=7062MB [14:43] Frame 57 saved (frame_056.jpg, t=386.8s) [14:43] [capture-periodic] freeze=1ms shot=102ms unfreeze=5ms saved=True [14:43] [ComfyUI] [worker:ComfyUI-Sharp] [VRAM] -555MB (now 4594MB) reserved=12128MB peak=7062MB [14:45] [ComfyUI] [SubprocessWorker] callback 'report_progress' from call_id=3 [14:46] [ComfyUI] [worker:ComfyUI-Sharp] [SharpPredictGaussiansFromMetricDepth] face 29/42: 1536×1536, extrinsics=[-0.00, -0.00, -0.00], intrinsics=fx=0.5000 cx=0.5000, mask=yes, snap=none, depth_conv=planar_z [14:46] [ComfyUI] [worker:ComfyUI-Sharp] [VRAM] +525MB (now 5120MB) reserved=7872MB peak=7062MB [14:47] [capture-loop] iter=3550 t=390.7s state={'complete': False, 'error': None, 'executedCount': 4, 'wsState': 1} eval_ms=1 ram=22.3/31.3GB (71%) swap=8.1/32.0GB (25%) cpu=14% browser_rss=0.93GB [14:47] [ComfyUI] [worker:ComfyUI-Sharp] [VRAM] -278MB (now 4842MB) reserved=5440MB peak=7062MB [14:47] Frame 58 saved (frame_057.jpg, t=391.1s) [14:47] [capture-periodic] freeze=1ms shot=103ms unfreeze=6ms saved=True [14:48] [ComfyUI] [worker:ComfyUI-Sharp] [VRAM] -250MB (now 4593MB) reserved=10720MB peak=7062MB [14:50] [ComfyUI] [SubprocessWorker] callback 'report_progress' from call_id=3 [14:50] [ComfyUI] [worker:ComfyUI-Sharp] [SharpPredictGaussiansFromMetricDepth] face 30/42: 1536×1536, extrinsics=[-0.00, -0.00, -0.00], intrinsics=fx=0.5000 cx=0.5000, mask=yes, snap=none, depth_conv=planar_z [14:50] [ComfyUI] [worker:ComfyUI-Sharp] [VRAM] +620MB (now 5214MB) reserved=7680MB peak=7062MB [14:51] [ComfyUI] [worker:ComfyUI-Sharp] [VRAM] -618MB (now 4597MB) reserved=11616MB peak=7062MB [14:52] Frame 59 saved (frame_058.jpg, t=395.5s) [14:52] [capture-periodic] freeze=1ms shot=106ms unfreeze=5ms saved=True [14:52] [capture-loop] iter=3600 t=396.2s state={'complete': False, 'error': None, 'executedCount': 4, 'wsState': 1} eval_ms=1 ram=23.7/31.3GB (76%) swap=8.1/32.0GB (25%) cpu=12% browser_rss=0.93GB [14:54] [ComfyUI] [SubprocessWorker] callback 'report_progress' from call_id=3 [14:54] [ComfyUI] [worker:ComfyUI-Sharp] [SharpPredictGaussiansFromMetricDepth] face 31/42: 1536×1536, extrinsics=[-0.00, -0.00, -0.00], intrinsics=fx=0.5000 cx=0.5000, mask=yes, snap=none, depth_conv=planar_z [14:54] [ComfyUI] [worker:ComfyUI-Sharp] [VRAM] +522MB (now 5119MB) reserved=7936MB peak=7062MB [14:54] Frame 60 saved (frame_059.jpg, t=397.7s) [14:54] [capture-periodic] freeze=1ms shot=92ms unfreeze=1ms saved=True [14:55] [ComfyUI] [worker:ComfyUI-Sharp] [VRAM] +336MB (now 5456MB) reserved=6208MB peak=7062MB [14:56] [ComfyUI] [worker:ComfyUI-Sharp] [VRAM] -864MB (now 4592MB) reserved=11584MB peak=7062MB [14:58] [capture-loop] iter=3650 t=401.6s state={'complete': False, 'error': None, 'executedCount': 4, 'wsState': 1} eval_ms=1 ram=22.2/31.3GB (71%) swap=8.1/32.0GB (25%) cpu=11% browser_rss=0.93GB [14:58] [ComfyUI] [SubprocessWorker] callback 'report_progress' from call_id=3 [14:58] [ComfyUI] [worker:ComfyUI-Sharp] [SharpPredictGaussiansFromMetricDepth] face 32/42: 1536×1536, extrinsics=[-0.00, -0.00, -0.00], intrinsics=fx=0.5000 cx=0.5000, mask=yes, snap=none, depth_conv=planar_z [14:58] [ComfyUI] [worker:ComfyUI-Sharp] [VRAM] +617MB (now 5210MB) reserved=7648MB peak=7062MB [14:58] Frame 61 saved (frame_060.jpg, t=402.0s) [14:58] [capture-periodic] freeze=1ms shot=100ms unfreeze=1ms saved=True [14:59] [ComfyUI] [worker:ComfyUI-Sharp] [VRAM] -618MB (now 4592MB) reserved=10720MB peak=7062MB [15:02] [ComfyUI] [SubprocessWorker] callback 'report_progress' from call_id=3 [15:02] [ComfyUI] [worker:ComfyUI-Sharp] [SharpPredictGaussiansFromMetricDepth] face 33/42: 1536×1536, extrinsics=[-0.00, -0.00, -0.00], intrinsics=fx=0.5000 cx=0.5000, mask=yes, snap=none, depth_conv=planar_z [15:02] [ComfyUI] [worker:ComfyUI-Sharp] [VRAM] +524MB (now 5116MB) reserved=7904MB peak=7062MB [15:03] Frame 62 saved (frame_061.jpg, t=406.3s) [15:03] [capture-periodic] freeze=1ms shot=102ms unfreeze=5ms saved=True [15:03] [capture-loop] iter=3700 t=407.1s state={'complete': False, 'error': None, 'executedCount': 4, 'wsState': 1} eval_ms=1 ram=22.3/31.3GB (71%) swap=8.1/32.0GB (25%) cpu=12% browser_rss=0.92GB [15:04] [ComfyUI] [worker:ComfyUI-Sharp] [VRAM] -528MB (now 4589MB) reserved=10176MB peak=7062MB [15:06] [ComfyUI] [SubprocessWorker] callback 'report_progress' from call_id=3 [15:06] [ComfyUI] [worker:ComfyUI-Sharp] [SharpPredictGaussiansFromMetricDepth] face 34/42: 1536×1536, extrinsics=[-0.00, -0.00, -0.00], intrinsics=fx=0.5000 cx=0.5000, mask=yes, snap=none, depth_conv=planar_z [15:06] [ComfyUI] [worker:ComfyUI-Sharp] [VRAM] +518MB (now 5108MB) reserved=7616MB peak=7062MB [15:07] Frame 63 saved (frame_062.jpg, t=410.7s) [15:07] [capture-periodic] freeze=1ms shot=102ms unfreeze=18ms saved=True [15:08] [ComfyUI] [worker:ComfyUI-Sharp] [VRAM] -519MB (now 4590MB) reserved=10752MB peak=7062MB [15:09] [capture-loop] iter=3750 t=412.5s state={'complete': False, 'error': None, 'executedCount': 4, 'wsState': 1} eval_ms=1 ram=23.2/31.3GB (74%) swap=8.1/32.0GB (25%) cpu=12% browser_rss=0.92GB [15:10] [ComfyUI] [SubprocessWorker] callback 'report_progress' from call_id=3 [15:10] [ComfyUI] [worker:ComfyUI-Sharp] [SharpPredictGaussiansFromMetricDepth] face 35/42: 1536×1536, extrinsics=[-0.00, -0.00, -0.00], intrinsics=fx=0.5000 cx=0.5000, mask=yes, snap=none, depth_conv=planar_z [15:10] [ComfyUI] [worker:ComfyUI-Sharp] [VRAM] +555MB (now 5145MB) reserved=7680MB peak=7062MB [15:11] Frame 64 saved (frame_063.jpg, t=415.0s) [15:11] [capture-periodic] freeze=1ms shot=97ms unfreeze=5ms saved=True [15:12] [ComfyUI] [worker:ComfyUI-Sharp] [VRAM] +309MB (now 5455MB) reserved=6080MB peak=7062MB [15:13] [ComfyUI] [worker:ComfyUI-Sharp] [VRAM] -864MB (now 4591MB) reserved=11584MB peak=7062MB [15:14] [capture-loop] iter=3800 t=417.9s state={'complete': False, 'error': None, 'executedCount': 4, 'wsState': 1} eval_ms=1 ram=22.2/31.3GB (71%) swap=8.1/32.0GB (25%) cpu=11% browser_rss=0.83GB [15:14] [ComfyUI] [SubprocessWorker] callback 'report_progress' from call_id=3 [15:14] [ComfyUI] [worker:ComfyUI-Sharp] [SharpPredictGaussiansFromMetricDepth] face 36/42: 1536×1536, extrinsics=[-0.00, -0.00, -0.00], intrinsics=fx=0.5000 cx=0.5000, mask=yes, snap=none, depth_conv=planar_z [15:14] [ComfyUI] [worker:ComfyUI-Sharp] [VRAM] +561MB (now 5153MB) reserved=7424MB peak=7062MB [15:16] Frame 65 saved (frame_064.jpg, t=419.4s) [15:16] [capture-periodic] freeze=1ms shot=93ms unfreeze=5ms saved=True [15:16] [ComfyUI] [worker:ComfyUI-Sharp] [VRAM] -564MB (now 4589MB) reserved=10080MB peak=7062MB [15:18] [ComfyUI] [SubprocessWorker] callback 'report_progress' from call_id=3 [15:18] [ComfyUI] [worker:ComfyUI-Sharp] [SharpPredictGaussiansFromMetricDepth] face 37/42: 1536×1536, extrinsics=[-0.00, -0.00, -0.00], intrinsics=fx=0.5000 cx=0.5000, mask=yes, snap=none, depth_conv=planar_z [15:18] [ComfyUI] [worker:ComfyUI-Sharp] [VRAM] +517MB (now 5106MB) reserved=7872MB peak=7062MB [15:19] [capture-loop] iter=3850 t=423.3s state={'complete': False, 'error': None, 'executedCount': 4, 'wsState': 1} eval_ms=1 ram=22.6/31.3GB (72%) swap=8.0/32.0GB (25%) cpu=12% browser_rss=0.83GB [15:20] [ComfyUI] [worker:ComfyUI-Sharp] [VRAM] +345MB (now 5452MB) reserved=6048MB peak=7062MB [15:20] Frame 66 saved (frame_065.jpg, t=423.7s) [15:20] [capture-periodic] freeze=1ms shot=98ms unfreeze=7ms saved=True [15:21] [ComfyUI] [worker:ComfyUI-Sharp] [VRAM] -864MB (now 4588MB) reserved=10432MB peak=7062MB [15:22] [ComfyUI] [SubprocessWorker] callback 'report_progress' from call_id=3 [15:22] [ComfyUI] [worker:ComfyUI-Sharp] [SharpPredictGaussiansFromMetricDepth] face 38/42: 1536×1536, extrinsics=[-0.00, -0.00, -0.00], intrinsics=fx=0.5000 cx=0.5000, mask=yes, snap=none, depth_conv=planar_z [15:23] [ComfyUI] [worker:ComfyUI-Sharp] [VRAM] +527MB (now 5116MB) reserved=7904MB peak=7062MB [15:24] [ComfyUI] [worker:ComfyUI-Sharp] [VRAM] -528MB (now 4589MB) reserved=10656MB peak=7062MB [15:24] Frame 67 saved (frame_066.jpg, t=428.0s) [15:24] [capture-periodic] freeze=1ms shot=98ms unfreeze=5ms saved=True [15:25] [capture-loop] iter=3900 t=428.8s state={'complete': False, 'error': None, 'executedCount': 4, 'wsState': 1} eval_ms=1 ram=23.3/31.3GB (75%) swap=8.0/32.0GB (25%) cpu=14% browser_rss=0.83GB [15:27] [ComfyUI] [SubprocessWorker] callback 'report_progress' from call_id=3 [15:27] [ComfyUI] [worker:ComfyUI-Sharp] [SharpPredictGaussiansFromMetricDepth] face 39/42: 1536×1536, extrinsics=[-0.00, -0.00, -0.00], intrinsics=fx=0.5000 cx=0.5000, mask=yes, snap=none, depth_conv=planar_z [15:27] [ComfyUI] [worker:ComfyUI-Sharp] [VRAM] +535MB (now 5125MB) reserved=7648MB peak=7062MB [15:28] [ComfyUI] [worker:ComfyUI-Sharp] [VRAM] -537MB (now 4589MB) reserved=10656MB peak=7062MB [15:29] Frame 68 saved (frame_067.jpg, t=432.4s) [15:29] [capture-periodic] freeze=1ms shot=103ms unfreeze=5ms saved=True [15:30] [capture-loop] iter=3950 t=434.2s state={'complete': False, 'error': None, 'executedCount': 4, 'wsState': 1} eval_ms=1 ram=22.6/31.3GB (72%) swap=8.0/32.0GB (25%) cpu=11% browser_rss=0.83GB [15:31] [ComfyUI] [SubprocessWorker] callback 'report_progress' from call_id=3 [15:31] [ComfyUI] [worker:ComfyUI-Sharp] [SharpPredictGaussiansFromMetricDepth] face 40/42: 1536×1536, extrinsics=[-0.00, -0.00, -0.00], intrinsics=fx=0.5000 cx=0.5000, mask=yes, snap=none, depth_conv=planar_z [15:31] [ComfyUI] [worker:ComfyUI-Sharp] [VRAM] +554MB (now 5143MB) reserved=7904MB peak=7062MB [15:32] [ComfyUI] [worker:ComfyUI-Sharp] [VRAM] -555MB (now 4589MB) reserved=11584MB peak=7062MB [15:33] Frame 69 saved (frame_068.jpg, t=436.7s) [15:33] [capture-periodic] freeze=1ms shot=103ms unfreeze=5ms saved=True [15:35] [ComfyUI] [SubprocessWorker] callback 'report_progress' from call_id=3 [15:35] [ComfyUI] [worker:ComfyUI-Sharp] [SharpPredictGaussiansFromMetricDepth] face 41/42: 1536×1536, extrinsics=[-0.00, -0.00, -0.00], intrinsics=fx=0.5000 cx=0.5000, mask=yes, snap=none, depth_conv=planar_z [15:35] [ComfyUI] [worker:ComfyUI-Sharp] [VRAM] +555MB (now 5144MB) reserved=7872MB peak=7062MB [15:35] Frame 70 saved (frame_069.jpg, t=438.9s) [15:35] [capture-periodic] freeze=1ms shot=98ms unfreeze=1ms saved=True [15:36] [capture-loop] iter=4000 t=439.7s state={'complete': False, 'error': None, 'executedCount': 4, 'wsState': 1} eval_ms=1 ram=22.0/31.3GB (70%) swap=8.3/32.0GB (26%) cpu=13% browser_rss=0.83GB [15:36] [ComfyUI] [worker:ComfyUI-Sharp] [VRAM] +309MB (now 5454MB) reserved=6176MB peak=7062MB [15:36] [ComfyUI] [worker:ComfyUI-Sharp] [15:36] [ComfyUI] === WATCHDOG TICK 3 === [15:36] [ComfyUI] [worker:ComfyUI-Sharp] Thread 0x00007f1480bff640 (most recent call first): [15:36] [ComfyUI] File "/tmp/comfytest-home/.ce/.pixi/envs/sharp-nodes/lib/python3.11/socket.py", line 294 in accept [15:36] [ComfyUI] File "/tmp/comfytest-home/.ce/.pixi/envs/sharp-nodes/lib/python3.11/multiprocessing/connection.py", line 626 in accept [15:36] [ComfyUI] File "/tmp/comfytest-home/.ce/.pixi/envs/sharp-nodes/lib/python3.11/multiprocessing/connection.py", line 480 in accept [15:36] [ComfyUI] File "/tmp/comfytest-home/.ce/.pixi/envs/sharp-nodes/lib/python3.11/multiprocessing/resource_sharer.py", line 138 in _serve [15:36] [ComfyUI] File "/tmp/comfytest-home/.ce/.pixi/envs/sharp-nodes/lib/python3.11/threading.py", line 982 in run [15:36] [ComfyUI] File "/tmp/comfytest-home/.ce/.pixi/envs/sharp-nodes/lib/python3.11/threading.py", line 1045 in _bootstrap_inner [15:36] [ComfyUI] File "/tmp/comfytest-home/.ce/.pixi/envs/sharp-nodes/lib/python3.11/threading.py", line 1002 in _bootstrap [15:36] [ComfyUI] [15:36] [ComfyUI] Thread 0x00007f1634a0f640 (most recent call first): [15:36] [ComfyUI] File "/tmp/comfyui_pvenv_xcjd5ki2/persistent_worker.py", line 106 in _vram_poller [15:36] [ComfyUI] File "/tmp/comfytest-home/.ce/.pixi/envs/sharp-nodes/lib/python3.11/threading.py", line 982 in run [15:36] [ComfyUI] File "/tmp/comfytest-home/.ce/.pixi/envs/sharp-nodes/lib/python3.11/threading.py", line 1045 in _bootstrap_inner [15:36] [ComfyUI] File "/tmp/comfytest-home/.ce/.pixi/envs/sharp-nodes/lib/python3.11/threading.py", line 1002 in _bootstrap [15:36] [ComfyUI] [15:36] [ComfyUI] Current thread 0x00007f1635214640 (most recent call first): [15:36] [ComfyUI] File "/tmp/comfyui_pvenv_xcjd5ki2/persistent_worker.py", line 52 in _watchdog [15:36] [ComfyUI] File "/tmp/comfytest-home/.ce/.pixi/envs/sharp-nodes/lib/python3.11/threading.py", line 982 in run [15:36] [ComfyUI] File "/tmp/comfytest-home/.ce/.pixi/envs/sharp-nodes/lib/python3.11/threading.py", line 1045 in _bootstrap_inner [15:36] [ComfyUI] File "/tmp/comfytest-home/.ce/.pixi/envs/sharp-nodes/lib/python3.11/threading.py", line 1002 in _bootstrap [15:36] [ComfyUI] [15:36] [ComfyUI] Thread 0x00007f1635834740 (most recent call first): [15:36] [ComfyUI] File "/tmp/comfytest-home/.ce/.pixi/envs/sharp-nodes/lib/python3.11/site-packages/torch/nn/modules/conv.py", line 1184 in forward [15:36] [ComfyUI] File "/workspaces/Sharp-2211/ComfyUI/comfy/ops.py", line 670 in forward [15:36] [ComfyUI] File "/tmp/comfytest-home/.ce/.pixi/envs/sharp-nodes/lib/python3.11/site-packages/torch/nn/modules/module.py", line 1787 in _call_impl [15:36] [ComfyUI] File "/tmp/comfytest-home/.ce/.pixi/envs/sharp-nodes/lib/python3.11/site-packages/torch/nn/modules/module.py", line 1776 in _wrapped_call_impl [15:36] [ComfyUI] File "/workspaces/Sharp-2211/ComfyUI/custom_nodes/ComfyUI-Sharp/nodes/sharp/model.py", line 861 in forward [15:36] [ComfyUI] File "/tmp/comfytest-home/.ce/.pixi/envs/sharp-nodes/lib/python3.11/site-packages/torch/nn/modules/module.py", line 1787 in _call_impl [15:36] [ComfyUI] File "/tmp/comfytest-home/.ce/.pixi/envs/sharp-nodes/lib/python3.11/site-packages/torch/nn/modules/module.py", line 1776 in _wrapped_call_impl [15:36] [ComfyUI] File "/workspaces/Sharp-2211/ComfyUI/custom_nodes/ComfyUI-Sharp/nodes/sharp/model.py", line 970 in forward [15:36] [ComfyUI] File "/tmp/comfytest-home/.ce/.pixi/envs/sharp-nodes/lib/python3.11/site-packages/torch/nn/modules/module.py", line 1787 in _call_impl [15:36] [ComfyUI] File "/tmp/comfytest-home/.ce/.pixi/envs/sharp-nodes/lib/python3.11/site-packages/torch/nn/modules/module.py", line 1776 in _wrapped_call_impl [15:36] [ComfyUI] File "/workspaces/Sharp-2211/ComfyUI/custom_nodes/ComfyUI-Sharp/nodes/sharp/model.py", line 1118 in forward [15:36] [ComfyUI] File "/tmp/comfytest-home/.ce/.pixi/envs/sharp-nodes/lib/python3.11/site-packages/torch/nn/modules/module.py", line 1787 in _call_impl [15:36] [ComfyUI] File "/tmp/comfytest-home/.ce/.pixi/envs/sharp-nodes/lib/python3.11/site-packages/torch/nn/modules/module.py", line 1776 in _wrapped_call_impl [15:36] [ComfyUI] File "/workspaces/Sharp-2211/ComfyUI/custom_nodes/ComfyUI-Sharp/nodes/sharp/model.py", line 2006 in encode [15:36] [ComfyUI] File "/workspaces/Sharp-2211/ComfyUI/custom_nodes/ComfyUI-Sharp/nodes/predict_gaussians_from_depth.py", line 392 in execute [15:36] [ComfyUI] File "/tmp/comfytest-home/.ce/.pixi/envs/sharp-nodes/lib/python3.11/site-packages/torch/utils/_contextlib.py", line 124 in decorate_context [15:36] [ComfyUI] File "/workspaces/Sharp-2211/ComfyUI/comfy_api/latest/_io.py", line 1892 in EXECUTE_NORMALIZED [15:36] [ComfyUI] File "/tmp/comfyui_pvenv_xcjd5ki2/persistent_worker.py", line 1762 in main [15:36] [ComfyUI] File "/tmp/comfyui_pvenv_xcjd5ki2/persistent_worker.py", line 1807 in [15:36] [ComfyUI] [15:37] [ComfyUI] [worker:ComfyUI-Sharp] === END === [15:37] [ComfyUI] [15:37] [ComfyUI] [worker:ComfyUI-Sharp] [VRAM] -864MB (now 4590MB) reserved=11552MB peak=7062MB [15:39] [ComfyUI] [SubprocessWorker] callback 'report_progress' from call_id=3 [15:39] [ComfyUI] [worker:ComfyUI-Sharp] [SharpPredictGaussiansFromMetricDepth] face 42/42: 1536×1536, extrinsics=[-0.00, -0.00, -0.00], intrinsics=fx=0.5000 cx=0.5000, mask=yes, snap=none, depth_conv=planar_z [15:39] [ComfyUI] [worker:ComfyUI-Sharp] [VRAM] +562MB (now 5153MB) reserved=7328MB peak=7062MB [15:39] Frame 71 saved (frame_070.jpg, t=443.3s) [15:39] [capture-periodic] freeze=1ms shot=94ms unfreeze=5ms saved=True [15:41] [ComfyUI] [worker:ComfyUI-Sharp] [VRAM] -564MB (now 4590MB) reserved=10112MB peak=7062MB [15:41] [capture-loop] iter=4050 t=445.1s state={'complete': False, 'error': None, 'executedCount': 4, 'wsState': 1} eval_ms=1 ram=22.9/31.3GB (73%) swap=8.3/32.0GB (26%) cpu=12% browser_rss=0.83GB [15:43] [ComfyUI] [SubprocessWorker] callback 'report_progress' from call_id=3 [15:43] [ComfyUI] [worker:ComfyUI-Sharp] [SharpPredictGaussiansFromMetricDepth] 42 face(s) -> 4.07M gaussians total (both layers, snap=none); saved to /workspaces/Sharp-2211/ComfyUI/output/sharp_aligned_1780871075963; 172.6s [15:43] [ComfyUI] [worker:ComfyUI-Sharp] [VRAM] -1903MB (now 2688MB) reserved=7328MB peak=7062MB [15:43] [ComfyUI] [SubprocessWorker] got response: ok [15:43] [ComfyUI] [comfy-env] Created 1 model patchers: ['RGBGaussianPredictor_1'] [15:43] [ComfyUI] [comfy-env] SharpPredictGaussiansFromMetricDepth done (182.06s): result: NodeOutput [15:43] [ComfyUI] [VRAM] After SharpPredictGaussiansFromMetricDepth: 14073 / 24122 MB [15:43] [ComfyUI] [VRAM] Loaded: SubprocessModel (2679 MB), SubprocessModel (631 MB) [15:43] [ComfyUI] [comfy-env] Running MergeGaussians: ply_folder: '/workspaces/Sharp-2211/ComfyUI/output/sharp_aligned_1780..., output_prefix: 'merged', max_depth: 0.0, min_opacity: 0.0 [15:43] [ComfyUI] [VRAM] Before MergeGaussians: 14073 / 24122 MB [15:43] [ComfyUI] [VRAM] Loaded: SubprocessModel (2679 MB), SubprocessModel (631 MB) [15:43] [ComfyUI] [SubprocessWorker] call_method: nodes.merge_gaussians.MergeGaussians.EXECUTE_NORMALIZED [15:43] [ComfyUI] [SubprocessWorker] acquired lock, ensuring started... [15:43] [ComfyUI] [ComfyUI-Sharp] Health check: ping (timeout=5.0s)... [15:43] [ComfyUI] [ComfyUI-Sharp] Health check: ok [15:43] [ComfyUI] [SubprocessWorker] worker started/confirmed [15:43] [ComfyUI] [SubprocessWorker] serializing kwargs to shm... [15:43] [ComfyUI] [SubprocessWorker] created 0 shm blocks [15:43] [ComfyUI] [SubprocessWorker] sending request via socket... [15:43] [ComfyUI] [SubprocessWorker] call_id=4 sending call_method [15:43] [ComfyUI] [worker:ComfyUI-Sharp] [MergeGaussians] merging 42 PLY file(s) from /workspaces/Sharp-2211/ComfyUI/output/sharp_aligned_1780871075963 (no filters) [15:43] [ComfyUI] [SubprocessWorker] callback 'report_progress' from call_id=4 [15:43] [ComfyUI] [SubprocessWorker] callback 'report_progress' from call_id=4 [15:43] [ComfyUI] [SubprocessWorker] callback 'report_progress' from call_id=4 [15:44] [ComfyUI] [SubprocessWorker] callback 'report_progress' from call_id=4 [15:44] [ComfyUI] [SubprocessWorker] callback 'report_progress' from call_id=4 [15:44] Frame 72 saved (frame_071.jpg, t=447.6s) [15:44] [capture-periodic] freeze=11ms shot=127ms unfreeze=7ms saved=True [15:44] [ComfyUI] [worker:ComfyUI-Sharp] [MergeGaussians] merged 42 file(s) -> 4.07M gaussians -> /workspaces/Sharp-2211/ComfyUI/output/merged_1780871249131.ply, 217.5 MB; save 0.5s, total 0.9s [15:44] [ComfyUI] [worker:ComfyUI-Sharp] [MergeGaussians] field PLY (positions + face_id only) -> /workspaces/Sharp-2211/ComfyUI/output/merged_1780871249131_fields.ply [15:44] [ComfyUI] [SubprocessWorker] got response: ok [15:44] [ComfyUI] [comfy-env] MergeGaussians done (1.00s): result: NodeOutput [15:44] [ComfyUI] [comfy-env] SubprocessWorker: /tmp/comfytest-home/.ce/.pixi/envs/gaussianpack-nodes/bin/python [15:44] [ComfyUI] [VRAM] After MergeGaussians: 14073 / 24122 MB [15:44] [ComfyUI] [comfy-env] env_vars: {'COMFYUI_BASE': '/workspaces/Sharp-2211/ComfyUI'} [15:44] [ComfyUI] [VRAM] Loaded: SubprocessModel (2679 MB), SubprocessModel (631 MB) [15:44] [ComfyUI] [comfy-env] Running TransformGaussian: rotate_x: -90.0, rotate_y: 0.0, rotate_z: 0.0, ply_path: '/workspaces/Sharp-2211/ComfyUI/output/merged_17808712491... [15:44] [ComfyUI] [ComfyUI-GaussianPack] python: /tmp/comfytest-home/.ce/.pixi/envs/gaussianpack-nodes/bin/python [15:44] [ComfyUI] [VRAM] Before TransformGaussian: 14073 / 24122 MB [15:44] [ComfyUI] [ComfyUI-GaussianPack] sys_path sent to worker: ['/workspaces/Sharp-2211/ComfyUI', '/workspaces/Sharp-2211/ComfyUI/custom_nodes/ComfyUI-GaussianPack', '/tmp/comfytest-home/.ce/.pixi/envs/gaussianpack-nodes/lib/python3.1/site-packages', '/workspaces/Sharp-2211/ComfyUI/custom_nodes/ComfyUI-GaussianPack'] [15:44] [ComfyUI] [VRAM] Loaded: SubprocessModel (2679 MB), SubprocessModel (631 MB) [15:44] [ComfyUI] [SubprocessWorker] is_pixi=True, python=/tmp/comfytest-home/.ce/.pixi/envs/gaussianpack-nodes/bin/python [15:44] [ComfyUI] [SubprocessWorker] call_method: nodes.transform_gaussian.TransformGaussian.transform [15:44] [ComfyUI] [SubprocessWorker] launching cmd=['/tmp/comfytest-home/.pixi/bin/pixi', 'run', '--as-is', '--manifest-path', '/tmp/comfytest-home/.ce/pixi.toml', '-e', 'gaussianpack-nodes', 'python', '/tmp/comfyui_pvenv_wwutae6l/persistent_worker.py', 'abstract://comfy_worker_6ce6b0c2d3ab']... [15:44] [ComfyUI] [SubprocessWorker] acquired lock, ensuring started... [15:44] [ComfyUI] [SubprocessWorker] socket_addr=abstract://comfy_worker_6ce6b0c2d3ab (abstract, no filesystem path) [15:45] [ComfyUI] [SubprocessWorker] worker started/confirmed [15:45] [ComfyUI] [SubprocessWorker] serializing kwargs to shm... [15:45] [ComfyUI] [SubprocessWorker] created 0 shm blocks [15:45] [ComfyUI] [SubprocessWorker] sending request via socket... [15:45] [ComfyUI] [SubprocessWorker] call_id=1 sending call_method [15:46] [ComfyUI] [worker:ComfyUI-GaussianPack] WARNING: SPZ route not registered (ModuleNotFoundError: No module named 'comfy_aimdo') [15:46] Frame 73 saved (frame_072.jpg, t=449.9s) [15:46] [capture-periodic] freeze=2ms shot=114ms unfreeze=5ms saved=True [15:47] [capture-loop] iter=4100 t=450.6s state={'complete': False, 'error': None, 'executedCount': 4, 'wsState': 1} eval_ms=2 ram=22.6/31.3GB (72%) swap=8.5/32.0GB (27%) cpu=15% browser_rss=0.82GB [15:47] [ComfyUI] [SubprocessWorker] got response: ok [15:47] [ComfyUI] [comfy-env] TransformGaussian done (2.65s): result: list[1] [15:47] [ComfyUI] [VRAM] After TransformGaussian: 14073 / 24122 MB [15:47] [ComfyUI] [VRAM] Loaded: SubprocessModel (2679 MB), SubprocessModel (631 MB) [15:47] [ComfyUI] [comfy-env] Running PreviewGaussians: camera_mode: 'orbit', fov_degrees: 71.0, renderer: 'playcanvas', transport_format: 'ply', ply_path: '/workspaces/Sharp-2211/ComfyUI/output/merged_17808712491... [15:47] [ComfyUI] [VRAM] Before PreviewGaussians: 14073 / 24122 MB [15:47] [ComfyUI] [VRAM] Loaded: SubprocessModel (2679 MB), SubprocessModel (631 MB) [15:47] [ComfyUI] [SubprocessWorker] call_method: nodes.preview_gaussian.PreviewGaussians.preview [15:47] [ComfyUI] [SubprocessWorker] acquired lock, ensuring started... [15:47] [ComfyUI] [ComfyUI-GaussianPack] Health check: ping (timeout=5.0s)... [15:47] [ComfyUI] [ComfyUI-GaussianPack] Health check: ok [15:47] [ComfyUI] [SubprocessWorker] worker started/confirmed [15:47] [ComfyUI] [SubprocessWorker] serializing kwargs to shm... [15:47] [ComfyUI] [SubprocessWorker] created 0 shm blocks [15:47] [ComfyUI] [SubprocessWorker] sending request via socket... [15:47] [ComfyUI] [SubprocessWorker] call_id=2 sending call_method [15:47] [ComfyUI] [SubprocessWorker] got response: ok [15:47] [ComfyUI] [comfy-env] PreviewGaussians done (0.05s): result: dict [15:47] [ComfyUI] [VRAM] After PreviewGaussians: 14073 / 24122 MB [15:47] [ComfyUI] [VRAM] Loaded: SubprocessModel (2679 MB), SubprocessModel (631 MB) [15:47] [ComfyUI] [INFO] Prompt executed in 450.61 seconds [15:47] Node executed (5 total), capturing... [15:47] Frame 74 saved (frame_073.jpg, t=451.0s) [15:47] [capture-node] freeze=1ms shot=104ms unfreeze=1ms saved=True [15:50] Execution complete (t=453.5s) [15:50] [3d-wait] Phase 1: Waiting for 'Loading 3D Model' text to disappear... [15:50] [3d-wait] Phase 1 done in 0.5s [15:50] [3d-wait] Phase 2: iframes=1 [15:50] [3d-wait] iframe viewer_ready=False (matched 0 console logs) [15:50] [3d-wait] Waiting for 'Loaded successfully' console message (timeout=60s)... [15:54] [3d-wait] Got 'Loaded successfully' after 3.4s [15:54] [3d-wait] Unfrozen in 0.095s, rendering for 5s... [15:59] [3d-wait] JS halted via CDP after 5.8s [16:00] [3d-wait] Re-frozen in 6.8s [16:00] [3d-wait] Total 3D wait: 10.7s [16:00] Captured 74 unique frames over 464.27s [16:00] [debug] iframes: 1 [16:00] [debug] iframe[0]: src=http://127.0.0.1:41898/extensions/ComfyUI-GaussianPack/viewer_gaussian.html?v=17, canvas=486x403, rafFrozen=True [16:00] [timing] trigger_3d_previews: 0.0s [16:03] Saved high-quality screenshot: pano_executed.png [16:03] [timing] final_screenshot: 0.3s [16:03] [ComfyUI] [comfy-env] [VRAM] Before offload 'MoGeWrapper_1' (631 MB) -> cpu: 14073 / 24122 MB [16:03] [ComfyUI] [ComfyUI-MoGe2] python: /tmp/comfytest-home/.ce/.pixi/envs/moge2-nodes/bin/python [16:03] [ComfyUI] [ComfyUI-MoGe2] Health check: ping (timeout=5.0s)... [16:03] Capturing execution frames: sharp_basic.json [16:03] [ComfyUI] [ComfyUI-MoGe2] Health check: failed [16:03] [ComfyUI] [ComfyUI-MoGe2] sys_path sent to worker: ['/workspaces/Sharp-2211/ComfyUI', '/workspaces/Sharp-2211/ComfyUI/custom_nodes/ComfyUI-MoGe2', '/tmp/comfytest-home/.ce/.pixi/envs/moge2-nodes/lib/python3.1/site-packages', '/workspaces/Sharp-2211/ComfyUI/custom_nodes/ComfyUI-MoGe2'] [16:03] [ComfyUI] [SubprocessWorker] is_pixi=True, python=/tmp/comfytest-home/.ce/.pixi/envs/moge2-nodes/bin/python [16:03] [ComfyUI] [ComfyUI-MoGe2] Socket unhealthy, restarting worker... [16:03] [ComfyUI] [SubprocessWorker] launching cmd=['/tmp/comfytest-home/.pixi/bin/pixi', 'run', '--as-is', '--manifest-path', '/tmp/comfytest-home/.ce/pixi.toml', '-e', 'moge2-nodes', 'python', '/tmp/comfyui_pvenv_ex649j74/persistent_worker.py', 'abstract://comfy_worker_252cdf4fa006']... [16:03] [ComfyUI] [comfy-env] Invalidated 1 stale model patchers (will be cleaned up during next unload) [16:03] [ComfyUI] [SubprocessWorker] socket_addr=abstract://comfy_worker_252cdf4fa006 (abstract, no filesystem path) [16:04] [ComfyUI] [worker:ComfyUI-MoGe2] ERROR: Failed to import comfy_kitchen, Error: No module named 'comfy_kitchen', fp8 and fp4 support will not be available. [16:04] [ComfyUI] [worker:ComfyUI-MoGe2] WARNING: comfy_kitchen does not support stochastic FP8 rounding, please update comfy_kitchen. [16:04] [ComfyUI] [SubprocessWorker] call_id=3 sending model_to_device [16:04] [ComfyUI] [WARNING] Model 'MoGeWrapper_1' gone from worker (restarted?), treating as offloaded [16:04] [ComfyUI] [comfy-env] [VRAM] After offload 'MoGeWrapper_1' (631 MB): 14334 / 24122 MB [16:04] [ComfyUI] [comfy-env] [VRAM] Before offload 'RGBGaussianPredictor_1' (2679 MB) -> cpu: 14334 / 24122 MB [16:04] [ComfyUI] [ComfyUI-Sharp] Health check: ping (timeout=5.0s)... [16:04] [ComfyUI] [ComfyUI-Sharp] Health check: ok [16:04] [ComfyUI] [SubprocessWorker] call_id=5 sending model_to_device [16:05] [ComfyUI] [worker:ComfyUI-Sharp] [VRAM] -814MB (now 1874MB) reserved=7328MB peak=7062MB [16:06] [ComfyUI] [worker:ComfyUI-Sharp] [VRAM] -1617MB (now 258MB) reserved=7328MB peak=7062MB [16:06] [ComfyUI] [comfy-env] [VRAM] After offload 'RGBGaussianPredictor_1' (2679 MB): 7034 / 24122 MB [16:06] [ComfyUI] [INFO] Using RAM pressure cache. [16:09] Frame 1 saved (frame_000.jpg, t=0.0s) [16:09] Validating workflow... [16:09] [ComfyUI] [INFO] === /validate endpoint called === [16:09] [ComfyUI] [INFO] Received JSON with keys: ['prompt'] [16:09] Queuing workflow for execution... [16:09] [ComfyUI] [INFO] Prompt has 4 nodes [16:09] [ComfyUI] [INFO] Node 1: LoadImage [16:09] [ComfyUI] [INFO] Inputs: {"image": "beach.jpg"} [16:09] [ComfyUI] [INFO] Node 2: LoadSharpModel [16:09] [ComfyUI] [INFO] Inputs: {"precision": "auto"} [16:09] [ComfyUI] [INFO] Node 5: SharpPredict [16:09] [ComfyUI] [INFO] Inputs: {"focal_length_mm": 30, "output_prefix": "sharp", "model": ["2", 0], "image": ["1", 0]} [16:09] [ComfyUI] [INFO] Node 6: PreviewGaussianSharp [16:09] [ComfyUI] [INFO] Inputs: {"preview_gaussian": "", "ply_path": ["5", 0], "extrinsics": ["5", 1], "intrinsics": ["5", 2]} [16:09] [ComfyUI] [INFO] Generated prompt_id: cae6e76c-d568-492d-b085-7aa10b804d9e [16:09] [ComfyUI] [INFO] Calling execution.validate_prompt()... [16:09] [ComfyUI] [INFO] Validation result: valid=True [16:09] [ComfyUI] [INFO] === Validation PASSED === [16:09] [ComfyUI] [INFO] got prompt [16:09] [ComfyUI] [comfy-env] Running LoadSharpModel: precision: 'auto' [16:09] [ComfyUI] [VRAM] Before LoadSharpModel: 4995 / 24122 MB [16:09] [ComfyUI] [ComfyUI-Sharp] python: /tmp/comfytest-home/.ce/.pixi/envs/sharp-nodes/bin/python [16:09] [ComfyUI] [ComfyUI-Sharp] sys_path sent to worker: ['/workspaces/Sharp-2211/ComfyUI', '/workspaces/Sharp-2211/ComfyUI/custom_nodes/ComfyUI-Sharp', '/tmp/comfytest-home/.ce/.pixi/envs/sharp-nodes/lib/python3.1/site-packages', '/workspaces/Sharp-2211/ComfyUI/custom_nodes/ComfyUI-Sharp'] [16:09] [ComfyUI] [SubprocessWorker] call_method: nodes.load_model.LoadSharpModel.EXECUTE_NORMALIZED [16:09] [ComfyUI] [SubprocessWorker] acquired lock, ensuring started... [16:09] [ComfyUI] [SubprocessWorker] is_pixi=True, python=/tmp/comfytest-home/.ce/.pixi/envs/sharp-nodes/bin/python [16:09] [ComfyUI] [SubprocessWorker] launching cmd=['/tmp/comfytest-home/.pixi/bin/pixi', 'run', '--as-is', '--manifest-path', '/tmp/comfytest-home/.ce/pixi.toml', '-e', 'sharp-nodes', 'python', '/tmp/comfyui_pvenv_xcjd5ki2/persistent_worker.py', 'abstract://comfy_worker_398afb58be11']... [16:09] [ComfyUI] [ComfyUI-Sharp] Health check: ping (timeout=5.0s)... [16:09] [ComfyUI] [SubprocessWorker] socket_addr=abstract://comfy_worker_398afb58be11 (abstract, no filesystem path) [16:09] [ComfyUI] [ComfyUI-Sharp] Health check: failed [16:09] [ComfyUI] [ComfyUI-Sharp] Socket unhealthy, restarting worker... [16:09] [ComfyUI] [comfy-env] Invalidated 1 stale model patchers (will be cleaned up during next unload) [16:10] [ComfyUI] [worker:ComfyUI-Sharp] ERROR: Failed to import comfy_kitchen, Error: No module named 'comfy_kitchen', fp8 and fp4 support will not be available. [16:10] [ComfyUI] [worker:ComfyUI-Sharp] WARNING: comfy_kitchen does not support stochastic FP8 rounding, please update comfy_kitchen. [16:10] [ComfyUI] [SubprocessWorker] worker started/confirmed [16:10] [ComfyUI] [SubprocessWorker] serializing kwargs to shm... [16:10] [ComfyUI] [SubprocessWorker] created 0 shm blocks [16:10] [ComfyUI] [SubprocessWorker] sending request via socket... [16:10] [ComfyUI] [SubprocessWorker] call_id=6 sending call_method [16:11] [ComfyUI] [worker:ComfyUI-Sharp] [LoadSharpModel] precision='auto' -> dtype=bf16 (device=cuda:0) [16:11] [ComfyUI] [worker:ComfyUI-Sharp] [LoadSharpModel] checkpoint already present, reusing (no download): /workspaces/Sharp-2211/ComfyUI/models/sharp/sharp_2572gikvuh.pt (2679.6 MB) [16:11] [ComfyUI] [worker:ComfyUI-Sharp] [LoadSharpModel] checkpoint ready: /workspaces/Sharp-2211/ComfyUI/models/sharp/sharp_2572gikvuh.pt (2679.6 MB) [16:11] [ComfyUI] [worker:ComfyUI-Sharp] [LoadSharpModel] config: precision=auto -> dtype=bf16 [16:11] [ComfyUI] [SubprocessWorker] got response: ok [16:11] [ComfyUI] [comfy-env] [VRAM] Before offload 'RGBGaussianPredictor_1' (2679 MB) -> cpu: 4817 / 24122 MB [16:11] [ComfyUI] [ComfyUI-Sharp] Health check: ping (timeout=5.0s)... [16:11] [ComfyUI] [ComfyUI-Sharp] Health check: ok [16:11] [ComfyUI] [SubprocessWorker] call_id=7 sending model_to_device [16:11] [ComfyUI] [WARNING] Model 'RGBGaussianPredictor_1' gone from worker (restarted?), treating as offloaded [16:11] [ComfyUI] [comfy-env] [VRAM] After offload 'RGBGaussianPredictor_1' (2679 MB): 4817 / 24122 MB [16:11] [ComfyUI] [comfy-env] [VRAM] Before offload 'MoGeWrapper_1' (631 MB) -> cpu: 4817 / 24122 MB [16:11] [ComfyUI] [ComfyUI-MoGe2] Health check: ping (timeout=5.0s)... [16:11] [ComfyUI] [ComfyUI-MoGe2] Health check: ok [16:11] [ComfyUI] [SubprocessWorker] call_id=4 sending model_to_device [16:11] [ComfyUI] [WARNING] Model 'MoGeWrapper_1' gone from worker (restarted?), treating as offloaded [16:11] [ComfyUI] [comfy-env] [VRAM] After offload 'MoGeWrapper_1' (631 MB): 4817 / 24122 MB [16:11] [ComfyUI] [comfy-env] LoadSharpModel done (2.07s): result: NodeOutput [16:11] [ComfyUI] [VRAM] After LoadSharpModel: 4817 / 24122 MB [16:11] [ComfyUI] [comfy-env] Running SharpPredict: focal_length_mm: 30.0, output_prefix: 'sharp', model: dict, image: torch.float32 [1,1024,1536,3] cpu [16:11] [ComfyUI] [VRAM] Before SharpPredict: 4817 / 24122 MB [16:11] Frame 2 saved (frame_001.jpg, t=2.2s) [16:11] [capture-periodic] freeze=1ms shot=118ms unfreeze=1ms saved=True [16:11] [ComfyUI] [SubprocessWorker] call_method: nodes.predict.SharpPredict.EXECUTE_NORMALIZED [16:11] [ComfyUI] [SubprocessWorker] acquired lock, ensuring started... [16:11] [ComfyUI] [ComfyUI-Sharp] Health check: ping (timeout=5.0s)... [16:11] [ComfyUI] [ComfyUI-Sharp] Health check: ok [16:11] [ComfyUI] [SubprocessWorker] worker started/confirmed [16:11] [ComfyUI] [comfy-env] PRE-SERIALIZE 'image' shape: torch.Size([1, 1024, 1536, 3]) [16:11] [ComfyUI] [SubprocessWorker] serializing kwargs to shm... [16:12] [ComfyUI] [SubprocessWorker] created 0 shm blocks [16:12] [ComfyUI] [SubprocessWorker] sending request via socket... [16:12] [ComfyUI] [SubprocessWorker] call_id=8 sending call_method [16:12] [ComfyUI] [worker:ComfyUI-Sharp] [comfy-env] _from_shm got dict with keys: ['__type__', 'strategy', 'parent_pid', 'fd', 'storage_size'] [16:12] [ComfyUI] [worker:ComfyUI-Sharp] [comfy-env] DESERIALIZE TensorRef: tensor_size=[1, 1024, 1536, 3] [16:12] [ComfyUI] [worker:ComfyUI-Sharp] [comfy-env] DESERIALIZED tensor shape: torch.Size([1, 1024, 1536, 3]) [16:13] Frame 3 saved (frame_002.jpg, t=4.5s) [16:13] [capture-periodic] freeze=1ms shot=83ms unfreeze=1ms saved=True [16:14] [ComfyUI] [worker:ComfyUI-Sharp] [LoadSharpModel] loading checkpoint from /workspaces/Sharp-2211/ComfyUI/models/sharp/sharp_2572gikvuh.pt (dtype=bf16) [16:14] [capture-loop] iter=50 t=5.5s state={'complete': False, 'error': None, 'executedCount': 0, 'wsState': 1} eval_ms=2 ram=10.3/31.3GB (33%) swap=3.5/32.0GB (11%) cpu=34% browser_rss=0.86GB [16:15] [ComfyUI] [worker:ComfyUI-Sharp] [LoadSharpModel] initializing model on meta device... [16:15] [ComfyUI] [worker:ComfyUI-Sharp] [LoadSharpModel] model ready (torch.bfloat16) [16:15] [ComfyUI] [SubprocessWorker] callback 'request_vram_budget' from call_id=8 [16:15] [ComfyUI] [comfy-env] VRAM request: 2.81GB, free before eviction: 20.24GB [16:15] [ComfyUI] [comfy-env] VRAM after eviction: 20.24GB [16:16] [ComfyUI] [worker:ComfyUI-Sharp] [VRAM] +475MB (now 475MB) reserved=480MB peak=475MB [16:17] [ComfyUI] [worker:ComfyUI-Sharp] [VRAM] +2767MB (now 3242MB) reserved=3456MB peak=3287MB [16:18] [ComfyUI] [worker:ComfyUI-Sharp] [VRAM] +359MB (now 3601MB) reserved=3744MB peak=3601MB [16:19] [ComfyUI] [worker:ComfyUI-Sharp] [VRAM] +562MB (now 4164MB) reserved=7840MB peak=7053MB [16:19] [capture-loop] iter=100 t=10.9s state={'complete': False, 'error': None, 'executedCount': 0, 'wsState': 1} eval_ms=1 ram=12.8/31.3GB (41%) swap=3.5/32.0GB (11%) cpu=14% browser_rss=0.74GB [16:20] [ComfyUI] [worker:ComfyUI-Sharp] [VRAM] +234MB (now 4398MB) reserved=7360MB peak=7053MB [16:20] [ComfyUI] [SubprocessWorker] callback 'report_progress' from call_id=8 [16:20] [ComfyUI] [SubprocessWorker] got response: ok [16:20] [ComfyUI] [comfy-env] Created 1 model patchers: ['RGBGaussianPredictor_1'] [16:20] [ComfyUI] [comfy-env] SharpPredict done (9.78s): result: NodeOutput [16:20] [ComfyUI] [VRAM] After SharpPredict: 12291 / 24122 MB [16:21] [ComfyUI] [VRAM] Loaded: SubprocessModel (2679 MB) [16:21] [ComfyUI] [comfy-env] Running PreviewGaussianSharp: ply_path: '/workspaces/Sharp-2211/ComfyUI/output/sharp_178087128086..., extrinsics: list[4], intrinsics: list[3] [16:21] [ComfyUI] [VRAM] Before PreviewGaussianSharp: 12291 / 24122 MB [16:21] [ComfyUI] [VRAM] Loaded: SubprocessModel (2679 MB) [16:21] [ComfyUI] [SubprocessWorker] call_method: nodes.preview_gaussian_sharp.PreviewGaussianSharp.EXECUTE_NORMALIZED [16:21] [ComfyUI] [SubprocessWorker] acquired lock, ensuring started... [16:21] [ComfyUI] [ComfyUI-GaussianPack] Health check: ping (timeout=5.0s)... [16:21] [ComfyUI] [ComfyUI-GaussianPack] Health check: ok [16:21] [ComfyUI] [SubprocessWorker] worker started/confirmed [16:21] [ComfyUI] [SubprocessWorker] serializing kwargs to shm... [16:21] [ComfyUI] [SubprocessWorker] created 0 shm blocks [16:21] [ComfyUI] [SubprocessWorker] sending request via socket... [16:21] [ComfyUI] [SubprocessWorker] call_id=3 sending call_method [16:21] [ComfyUI] [SubprocessWorker] got response: ok [16:21] [ComfyUI] [comfy-env] PreviewGaussianSharp done (0.05s): result: NodeOutput [16:21] [ComfyUI] [VRAM] After PreviewGaussianSharp: 12291 / 24122 MB [16:21] [ComfyUI] [VRAM] Loaded: SubprocessModel (2679 MB) [16:21] [ComfyUI] [INFO] Prompt executed in 11.96 seconds [16:21] [ComfyUI] [comfy-env] [VRAM] Before offload 'RGBGaussianPredictor_1' (2679 MB) -> cpu: 12291 / 24122 MB [16:21] [ComfyUI] [ComfyUI-Sharp] Health check: ping (timeout=5.0s)... [16:21] [ComfyUI] [ComfyUI-Sharp] Health check: ok [16:21] [ComfyUI] [SubprocessWorker] call_id=9 sending model_to_device [16:21] Node executed (1 total), capturing... [16:21] [ComfyUI] [worker:ComfyUI-Sharp] [VRAM] -2112MB (now 2287MB) reserved=7360MB peak=7053MB [16:22] [ComfyUI] [worker:ComfyUI-Sharp] [VRAM] -1801MB (now 486MB) reserved=7360MB peak=7053MB [16:22] Frame 4 saved (frame_003.jpg, t=12.4s) [16:22] [capture-node] freeze=611ms shot=375ms unfreeze=0ms saved=True [16:22] Execution complete (t=12.4s) [16:22] [3d-wait] Phase 1: Waiting for 'Loading 3D Model' text to disappear... [16:22] [3d-wait] Phase 1 done in 0.0s [16:22] [3d-wait] Phase 2: iframes=1 [16:22] [3d-wait] iframe viewer_ready=True (matched 1 console logs) [16:22] [3d-wait] Unfrozen in 0.001s, rendering for 5s... [16:22] [ComfyUI] [comfy-env] [VRAM] After offload 'RGBGaussianPredictor_1' (2679 MB): 5027 / 24122 MB [16:22] [ComfyUI] [INFO] Using RAM pressure cache. [16:30] [3d-wait] JS halted via CDP after 7.9s [16:53] [3d-wait] Re-frozen in 31.6s [16:53] [3d-wait] Total 3D wait: 31.6s [16:53] Captured 4 unique frames over 45.05s [16:53] [debug] iframes: 1 [16:53] [debug] iframe[0]: src=http://127.0.0.1:41898/extensions/ComfyUI-GaussianPack/viewer_gaussian_sharp.htm, canvas=1536x1024, rafFrozen=True [16:53] [timing] trigger_3d_previews: 0.0s [16:56] Saved high-quality screenshot: sharp_basic_executed.png [16:56] [timing] final_screenshot: 0.3s [16:56] [ComfyUI] [INFO] Using RAM pressure cache. [16:56] Capturing execution frames: sharp_exif.json [16:56] [ComfyUI] [INFO] Using RAM pressure cache. [17:01] Frame 1 saved (frame_000.jpg, t=0.0s) [17:01] Validating workflow... [17:01] [ComfyUI] [INFO] === /validate endpoint called === [17:01] Queuing workflow for execution... [17:01] [ComfyUI] [INFO] Received JSON with keys: ['prompt'] [17:01] [ComfyUI] [INFO] Prompt has 4 nodes [17:01] [ComfyUI] [INFO] Node 2: LoadSharpModel [17:01] [ComfyUI] [INFO] Inputs: {"precision": "auto"} [17:01] [ComfyUI] [ComfyUI-Sharp] python: /tmp/comfytest-home/.ce/.pixi/envs/sharp-nodes/bin/python [17:01] [ComfyUI] [INFO] Node 7: SharpPredict [17:01] [ComfyUI] [ComfyUI-Sharp] sys_path sent to worker: ['/workspaces/Sharp-2211/ComfyUI', '/workspaces/Sharp-2211/ComfyUI/custom_nodes/ComfyUI-Sharp', '/tmp/comfytest-home/.ce/.pixi/envs/sharp-nodes/lib/python3.1/site-packages', '/workspaces/Sharp-2211/ComfyUI/custom_nodes/ComfyUI-Sharp'] [17:01] [ComfyUI] [INFO] Inputs: {"focal_length_mm": ["9", 2], "output_prefix": "sharp", "model": ["2", 0], "image": ["9", 0]} [17:01] [ComfyUI] [SubprocessWorker] is_pixi=True, python=/tmp/comfytest-home/.ce/.pixi/envs/sharp-nodes/bin/python [17:01] [ComfyUI] [INFO] Node 9: LoadImageWithExif [17:01] [ComfyUI] [SubprocessWorker] launching cmd=['/tmp/comfytest-home/.pixi/bin/pixi', 'run', '--as-is', '--manifest-path', '/tmp/comfytest-home/.ce/pixi.toml', '-e', 'sharp-nodes', 'python', '/tmp/comfyui_pvenv_xcjd5ki2/persistent_worker.py', 'abstract://comfy_worker_26bc3eeea4a5']... [17:01] [ComfyUI] [INFO] Inputs: {"image": "eth3d.png", "default_focal_mm": 30} [17:01] [ComfyUI] [SubprocessWorker] socket_addr=abstract://comfy_worker_26bc3eeea4a5 (abstract, no filesystem path) [17:01] [ComfyUI] [INFO] Node 11: PreviewGaussianSharp [17:01] [ComfyUI] [INFO] Inputs: {"preview_gaussian": "", "ply_path": ["7", 0], "extrinsics": ["7", 1], "intrinsics": ["7", 2]} [17:01] [ComfyUI] [INFO] Generated prompt_id: 50ff2490-c0a7-4164-996f-663c5bd585b4 [17:01] [ComfyUI] [INFO] Calling execution.validate_prompt()... [17:01] [ComfyUI] [INFO] Validation result: valid=True [17:01] [ComfyUI] [INFO] === Validation PASSED === [17:01] [ComfyUI] [INFO] got prompt [17:01] [ComfyUI] [comfy-env] Running LoadImageWithExif: image: 'eth3d.png', default_focal_mm: 30.0 [17:01] [ComfyUI] [VRAM] Before LoadImageWithExif: 5027 / 24122 MB [17:01] [ComfyUI] [SubprocessWorker] call_method: nodes.load_image_exif.LoadImageWithExif.EXECUTE_NORMALIZED [17:01] [ComfyUI] [SubprocessWorker] acquired lock, ensuring started... [17:01] [ComfyUI] [ComfyUI-Sharp] Health check: ping (timeout=5.0s)... [17:01] [ComfyUI] [ComfyUI-Sharp] Health check: failed [17:01] [ComfyUI] [ComfyUI-Sharp] Socket unhealthy, restarting worker... [17:01] [ComfyUI] [comfy-env] Invalidated 1 stale model patchers (will be cleaned up during next unload) [17:03] [ComfyUI] [worker:ComfyUI-Sharp] ERROR: Failed to import comfy_kitchen, Error: No module named 'comfy_kitchen', fp8 and fp4 support will not be available. [17:03] [ComfyUI] [worker:ComfyUI-Sharp] WARNING: comfy_kitchen does not support stochastic FP8 rounding, please update comfy_kitchen. [17:03] [ComfyUI] [SubprocessWorker] worker started/confirmed [17:03] [ComfyUI] [SubprocessWorker] serializing kwargs to shm... [17:03] [ComfyUI] [SubprocessWorker] created 0 shm blocks [17:03] [ComfyUI] [SubprocessWorker] sending request via socket... [17:03] [ComfyUI] [SubprocessWorker] call_id=10 sending call_method [17:03] [ComfyUI] [SubprocessWorker] got response: ok [17:03] [ComfyUI] [comfy-env] [VRAM] Before offload 'RGBGaussianPredictor_1' (2679 MB) -> cpu: 4817 / 24122 MB [17:03] [ComfyUI] [ComfyUI-Sharp] Health check: ping (timeout=5.0s)... [17:03] [ComfyUI] [ComfyUI-Sharp] Health check: ok [17:03] [ComfyUI] [SubprocessWorker] call_id=11 sending model_to_device [17:03] [ComfyUI] [WARNING] Model 'RGBGaussianPredictor_1' gone from worker (restarted?), treating as offloaded [17:03] [ComfyUI] [comfy-env] [VRAM] After offload 'RGBGaussianPredictor_1' (2679 MB): 4817 / 24122 MB [17:03] [ComfyUI] [comfy-env] LoadImageWithExif done (1.68s): result: NodeOutput [17:03] [ComfyUI] [VRAM] After LoadImageWithExif: 4817 / 24122 MB [17:03] [ComfyUI] [comfy-env] Running LoadSharpModel: precision: 'auto' [17:03] [ComfyUI] [VRAM] Before LoadSharpModel: 4817 / 24122 MB [17:03] [ComfyUI] [SubprocessWorker] call_method: nodes.load_model.LoadSharpModel.EXECUTE_NORMALIZED [17:03] [ComfyUI] [SubprocessWorker] acquired lock, ensuring started... [17:03] [ComfyUI] [ComfyUI-Sharp] Health check: ping (timeout=5.0s)... [17:03] [ComfyUI] [ComfyUI-Sharp] Health check: ok [17:03] [ComfyUI] [SubprocessWorker] worker started/confirmed [17:03] [ComfyUI] [SubprocessWorker] serializing kwargs to shm... [17:03] [ComfyUI] [SubprocessWorker] created 0 shm blocks [17:03] [ComfyUI] [SubprocessWorker] sending request via socket... [17:03] [ComfyUI] [SubprocessWorker] call_id=12 sending call_method [17:03] [ComfyUI] [worker:ComfyUI-Sharp] [LoadSharpModel] precision='auto' -> dtype=bf16 (device=cuda:0) [17:03] [ComfyUI] [worker:ComfyUI-Sharp] [LoadSharpModel] checkpoint already present, reusing (no download): /workspaces/Sharp-2211/ComfyUI/models/sharp/sharp_2572gikvuh.pt (2679.6 MB) [17:03] [ComfyUI] [worker:ComfyUI-Sharp] [LoadSharpModel] checkpoint ready: /workspaces/Sharp-2211/ComfyUI/models/sharp/sharp_2572gikvuh.pt (2679.6 MB) [17:03] [ComfyUI] [worker:ComfyUI-Sharp] [LoadSharpModel] config: precision=auto -> dtype=bf16 [17:03] [ComfyUI] [SubprocessWorker] got response: ok [17:03] [ComfyUI] [comfy-env] LoadSharpModel done (0.08s): result: NodeOutput [17:03] [ComfyUI] [VRAM] After LoadSharpModel: 4817 / 24122 MB [17:03] [ComfyUI] [comfy-env] Running SharpPredict: focal_length_mm: 20.0, output_prefix: 'sharp', model: dict, image: torch.float32 [1,1011,1520,3] cpu [17:03] [ComfyUI] [VRAM] Before SharpPredict: 4817 / 24122 MB [17:03] [ComfyUI] [SubprocessWorker] call_method: nodes.predict.SharpPredict.EXECUTE_NORMALIZED [17:03] [ComfyUI] [SubprocessWorker] acquired lock, ensuring started... [17:03] [ComfyUI] [ComfyUI-Sharp] Health check: ping (timeout=5.0s)... [17:03] [ComfyUI] [ComfyUI-Sharp] Health check: ok [17:03] [ComfyUI] [SubprocessWorker] worker started/confirmed [17:03] [ComfyUI] [comfy-env] PRE-SERIALIZE 'image' shape: torch.Size([1, 1011, 1520, 3]) [17:03] [ComfyUI] [SubprocessWorker] serializing kwargs to shm... [17:03] [ComfyUI] [SubprocessWorker] created 0 shm blocks [17:03] [ComfyUI] [SubprocessWorker] sending request via socket... [17:03] [ComfyUI] [SubprocessWorker] call_id=13 sending call_method [17:03] [ComfyUI] [worker:ComfyUI-Sharp] [comfy-env] _from_shm got dict with keys: ['__type__', 'strategy', 'parent_pid', 'fd', 'storage_size'] [17:03] [ComfyUI] [worker:ComfyUI-Sharp] [comfy-env] DESERIALIZE TensorRef: tensor_size=[1, 1011, 1520, 3] [17:03] [ComfyUI] [worker:ComfyUI-Sharp] [comfy-env] DESERIALIZED tensor shape: torch.Size([1, 1011, 1520, 3]) [17:04] Frame 2 saved (frame_001.jpg, t=2.3s) [17:04] [capture-periodic] freeze=1ms shot=115ms unfreeze=1ms saved=True [17:05] [ComfyUI] [worker:ComfyUI-Sharp] [LoadSharpModel] loading checkpoint from /workspaces/Sharp-2211/ComfyUI/models/sharp/sharp_2572gikvuh.pt (dtype=bf16) [17:06] Frame 3 saved (frame_002.jpg, t=4.5s) [17:06] [capture-periodic] freeze=1ms shot=110ms unfreeze=1ms saved=True [17:07] [ComfyUI] [worker:ComfyUI-Sharp] [LoadSharpModel] initializing model on meta device... [17:07] [ComfyUI] [worker:ComfyUI-Sharp] [LoadSharpModel] model ready (torch.bfloat16) [17:07] [ComfyUI] [SubprocessWorker] callback 'request_vram_budget' from call_id=13 [17:07] [ComfyUI] [comfy-env] VRAM request: 2.81GB, free before eviction: 20.24GB [17:07] [ComfyUI] [comfy-env] VRAM after eviction: 20.24GB [17:07] [ComfyUI] [worker:ComfyUI-Sharp] [VRAM] +314MB (now 314MB) reserved=320MB peak=314MB [17:07] [capture-loop] iter=50 t=5.8s state={'complete': False, 'error': None, 'executedCount': 0, 'wsState': 1} eval_ms=2 ram=12.8/31.3GB (41%) swap=3.5/32.0GB (11%) cpu=70% browser_rss=0.86GB [17:08] [ComfyUI] [worker:ComfyUI-Sharp] [VRAM] +2990MB (now 3304MB) reserved=3456MB peak=3341MB [17:09] [ComfyUI] [worker:ComfyUI-Sharp] [VRAM] +3748MB (now 7053MB) reserved=7680MB peak=7053MB [17:10] [ComfyUI] [worker:ComfyUI-Sharp] [VRAM] -2890MB (now 4163MB) reserved=7680MB peak=7053MB [17:11] [ComfyUI] [worker:ComfyUI-Sharp] [VRAM] +234MB (now 4397MB) reserved=7328MB peak=7053MB [17:11] [ComfyUI] [SubprocessWorker] callback 'report_progress' from call_id=13 [17:11] [ComfyUI] [SubprocessWorker] got response: ok [17:11] [ComfyUI] [comfy-env] Created 1 model patchers: ['RGBGaussianPredictor_1'] [17:11] [ComfyUI] [ComfyUI-GaussianPack] python: /tmp/comfytest-home/.ce/.pixi/envs/gaussianpack-nodes/bin/python [17:11] [ComfyUI] [ComfyUI-GaussianPack] sys_path sent to worker: ['/workspaces/Sharp-2211/ComfyUI', '/workspaces/Sharp-2211/ComfyUI/custom_nodes/ComfyUI-GaussianPack', '/tmp/comfytest-home/.ce/.pixi/envs/gaussianpack-nodes/lib/python3.1/site-packages', '/workspaces/Sharp-2211/ComfyUI/custom_nodes/ComfyUI-GaussianPack'] [17:11] [ComfyUI] [comfy-env] SharpPredict done (7.99s): result: NodeOutput [17:11] [ComfyUI] [SubprocessWorker] is_pixi=True, python=/tmp/comfytest-home/.ce/.pixi/envs/gaussianpack-nodes/bin/python [17:11] [ComfyUI] [VRAM] After SharpPredict: 12259 / 24122 MB [17:11] [ComfyUI] [VRAM] Loaded: SubprocessModel (2679 MB) [17:11] [ComfyUI] [SubprocessWorker] launching cmd=['/tmp/comfytest-home/.pixi/bin/pixi', 'run', '--as-is', '--manifest-path', '/tmp/comfytest-home/.ce/pixi.toml', '-e', 'gaussianpack-nodes', 'python', '/tmp/comfyui_pvenv_wwutae6l/persistent_worker.py', 'abstract://comfy_worker_4066a9b9374a']... [17:11] [ComfyUI] [SubprocessWorker] socket_addr=abstract://comfy_worker_4066a9b9374a (abstract, no filesystem path) [17:11] [ComfyUI] [comfy-env] Running PreviewGaussianSharp: ply_path: '/workspaces/Sharp-2211/ComfyUI/output/sharp_178087133215..., extrinsics: list[4], intrinsics: list[3] [17:11] [ComfyUI] [VRAM] Before PreviewGaussianSharp: 12259 / 24122 MB [17:11] [ComfyUI] [VRAM] Loaded: SubprocessModel (2679 MB) [17:11] [ComfyUI] [SubprocessWorker] call_method: nodes.preview_gaussian_sharp.PreviewGaussianSharp.EXECUTE_NORMALIZED [17:11] [ComfyUI] [SubprocessWorker] acquired lock, ensuring started... [17:11] [ComfyUI] [ComfyUI-GaussianPack] Health check: ping (timeout=5.0s)... [17:11] [ComfyUI] [ComfyUI-GaussianPack] Health check: failed [17:11] [ComfyUI] [ComfyUI-GaussianPack] Socket unhealthy, restarting worker... [17:12] [capture-loop] iter=100 t=11.1s state={'complete': False, 'error': None, 'executedCount': 0, 'wsState': 1} eval_ms=2 ram=15.3/31.3GB (49%) swap=3.5/32.0GB (11%) cpu=14% browser_rss=0.81GB [17:12] [ComfyUI] [SubprocessWorker] worker started/confirmed [17:12] [ComfyUI] [SubprocessWorker] serializing kwargs to shm... [17:12] [ComfyUI] [SubprocessWorker] created 0 shm blocks [17:12] [ComfyUI] [SubprocessWorker] sending request via socket... [17:12] [ComfyUI] [SubprocessWorker] call_id=4 sending call_method [17:12] Frame 4 saved (frame_003.jpg, t=11.1s) [17:12] [capture-periodic] freeze=1ms shot=127ms unfreeze=2ms saved=True [17:13] [ComfyUI] [worker:ComfyUI-GaussianPack] WARNING: SPZ route not registered (ModuleNotFoundError: No module named 'comfy_aimdo') [17:13] [ComfyUI] [SubprocessWorker] got response: ok [17:13] [ComfyUI] [comfy-env] PreviewGaussianSharp done (1.42s): result: NodeOutput [17:13] [ComfyUI] [VRAM] After PreviewGaussianSharp: 12259 / 24122 MB [17:13] [ComfyUI] [VRAM] Loaded: SubprocessModel (2679 MB) [17:13] [ComfyUI] [INFO] Prompt executed in 11.17 seconds [17:13] Node executed (1 total), capturing... [17:14] Frame 5 saved (frame_004.jpg, t=11.6s) [17:14] [capture-node] freeze=1ms shot=858ms unfreeze=0ms saved=True [17:14] Execution complete (t=11.6s) [17:14] [3d-wait] Phase 1: Waiting for 'Loading 3D Model' text to disappear... [17:14] [3d-wait] Phase 1 done in 0.0s [17:14] [3d-wait] Phase 2: iframes=1 [17:14] [3d-wait] iframe viewer_ready=True (matched 1 console logs) [17:14] [3d-wait] Unfrozen in 0.001s, rendering for 5s... [17:22] [3d-wait] JS halted via CDP after 8.1s [17:46] [3d-wait] Re-frozen in 32.5s [17:46] [3d-wait] Total 3D wait: 32.5s [17:46] Captured 5 unique frames over 45.15s [17:46] [debug] iframes: 1 [17:46] [debug] iframe[0]: src=http://127.0.0.1:41898/extensions/ComfyUI-GaussianPack/viewer_gaussian_sharp.htm, canvas=1520x1011, rafFrozen=True [17:46] [timing] trigger_3d_previews: 0.0s [17:49] Saved high-quality screenshot: sharp_exif_executed.png [17:49] [timing] final_screenshot: 0.3s [17:49] [ComfyUI] [comfy-env] [VRAM] Before offload 'RGBGaussianPredictor_1' (2679 MB) -> cpu: 12259 / 24122 MB [17:49] Capturing execution frames: vanilla_vs_image_depth_gaussians.json [17:49] [ComfyUI] [ComfyUI-Sharp] Health check: ping (timeout=5.0s)... [17:49] [ComfyUI] [ComfyUI-Sharp] python: /tmp/comfytest-home/.ce/.pixi/envs/sharp-nodes/bin/python [17:49] [ComfyUI] [ComfyUI-Sharp] Health check: failed [17:49] [ComfyUI] [ComfyUI-Sharp] sys_path sent to worker: ['/workspaces/Sharp-2211/ComfyUI', '/workspaces/Sharp-2211/ComfyUI/custom_nodes/ComfyUI-Sharp', '/tmp/comfytest-home/.ce/.pixi/envs/sharp-nodes/lib/python3.1/site-packages', '/workspaces/Sharp-2211/ComfyUI/custom_nodes/ComfyUI-Sharp'] [17:49] [ComfyUI] [ComfyUI-Sharp] Socket unhealthy, restarting worker... [17:49] [ComfyUI] [SubprocessWorker] is_pixi=True, python=/tmp/comfytest-home/.ce/.pixi/envs/sharp-nodes/bin/python [17:49] [ComfyUI] [SubprocessWorker] launching cmd=['/tmp/comfytest-home/.pixi/bin/pixi', 'run', '--as-is', '--manifest-path', '/tmp/comfytest-home/.ce/pixi.toml', '-e', 'sharp-nodes', 'python', '/tmp/comfyui_pvenv_xcjd5ki2/persistent_worker.py', 'abstract://comfy_worker_e03edfd0ef80']... [17:49] [ComfyUI] [comfy-env] Invalidated 1 stale model patchers (will be cleaned up during next unload) [17:49] [ComfyUI] [SubprocessWorker] socket_addr=abstract://comfy_worker_e03edfd0ef80 (abstract, no filesystem path) [17:50] [ComfyUI] [worker:ComfyUI-Sharp] ERROR: Failed to import comfy_kitchen, Error: No module named 'comfy_kitchen', fp8 and fp4 support will not be available. [17:50] [ComfyUI] [worker:ComfyUI-Sharp] WARNING: comfy_kitchen does not support stochastic FP8 rounding, please update comfy_kitchen. [17:50] [ComfyUI] [SubprocessWorker] call_id=14 sending model_to_device [17:50] [ComfyUI] [WARNING] Model 'RGBGaussianPredictor_1' gone from worker (restarted?), treating as offloaded [17:50] [ComfyUI] [comfy-env] [VRAM] After offload 'RGBGaussianPredictor_1' (2679 MB): 4817 / 24122 MB [17:50] [ComfyUI] [INFO] Using RAM pressure cache. [17:54] Frame 1 saved (frame_000.jpg, t=0.0s) [17:54] Validating workflow... [17:54] [ComfyUI] [INFO] === /validate endpoint called === [17:54] [ComfyUI] [INFO] Received JSON with keys: ['prompt'] [17:54] Queuing workflow for execution... [17:54] [ComfyUI] [INFO] Prompt has 8 nodes [17:54] [ComfyUI] [INFO] Node 7: LoadImage [17:54] [ComfyUI] [INFO] Inputs: {"image": "middlebury.jpg"} [17:54] [ComfyUI] [INFO] Node 9: LoadSharpModel [17:54] [ComfyUI] [INFO] Inputs: {"precision": "auto"} [17:54] [ComfyUI] [INFO] Node 47: SharpPredictMetricDepth [17:54] [ComfyUI] [INFO] Inputs: {"focal_length_mm": 30, "model": ["9", 0], "image": ["7", 0]} [17:54] [ComfyUI] [INFO] Node 57: SharpPredict [17:54] [ComfyUI] [INFO] Inputs: {"focal_length_mm": 30, "output_prefix": "sharp", "model": ["9", 0], "image": ["58", 0]} [17:54] [ComfyUI] [INFO] Node 58: ImageFromBatch [17:54] [ComfyUI] [INFO] Inputs: {"batch_index": 0, "length": 1, "image": ["7", 0]} [17:54] [ComfyUI] [INFO] Node 83: SharpPredictGaussiansFromMetricDepth [17:54] [ComfyUI] [INFO] Inputs: {"snap_to_external_depth": "none", "depth_convention": "planar_z", "focal_length_mm": 30, "output_prefix": "sharp_aligned", "save_background_layer": true, "edge_crop": 0, "model": ["9", 0], "image": [ [17:54] [ComfyUI] [INFO] Node 92: PreviewGaussianSharp [17:54] [ComfyUI] [INFO] Inputs: {"preview_gaussian": "", "ply_path": ["83", 0], "extrinsics": ["83", 2], "intrinsics": ["83", 3]} [17:54] [ComfyUI] [INFO] Node 93: PreviewGaussianSharp [17:54] [ComfyUI] [INFO] Inputs: {"preview_gaussian": "", "ply_path": ["57", 0], "extrinsics": ["57", 1], "intrinsics": ["57", 2]} [17:54] [ComfyUI] [INFO] Generated prompt_id: a31e7b61-1f7c-4616-952d-ba775f694de8 [17:54] [ComfyUI] [INFO] Calling execution.validate_prompt()... [17:54] [ComfyUI] [INFO] Validation result: valid=True [17:54] [ComfyUI] [INFO] === Validation PASSED === [17:54] [ComfyUI] [INFO] got prompt [17:54] [ComfyUI] [comfy-env] Running LoadSharpModel: precision: 'auto' [17:54] [ComfyUI] [VRAM] Before LoadSharpModel: 4817 / 24122 MB [17:54] [ComfyUI] [SubprocessWorker] call_method: nodes.load_model.LoadSharpModel.EXECUTE_NORMALIZED [17:54] [ComfyUI] [SubprocessWorker] acquired lock, ensuring started... [17:54] [ComfyUI] [ComfyUI-Sharp] Health check: ping (timeout=5.0s)... [17:54] [ComfyUI] [ComfyUI-Sharp] Health check: ok [17:54] [ComfyUI] [SubprocessWorker] worker started/confirmed [17:54] [ComfyUI] [SubprocessWorker] serializing kwargs to shm... [17:54] [ComfyUI] [SubprocessWorker] created 0 shm blocks [17:54] [ComfyUI] [SubprocessWorker] sending request via socket... [17:54] [ComfyUI] [SubprocessWorker] call_id=15 sending call_method [17:54] [ComfyUI] [worker:ComfyUI-Sharp] [LoadSharpModel] precision='auto' -> dtype=bf16 (device=cuda:0) [17:54] [ComfyUI] [worker:ComfyUI-Sharp] [LoadSharpModel] checkpoint already present, reusing (no download): /workspaces/Sharp-2211/ComfyUI/models/sharp/sharp_2572gikvuh.pt (2679.6 MB) [17:54] [ComfyUI] [worker:ComfyUI-Sharp] [LoadSharpModel] checkpoint ready: /workspaces/Sharp-2211/ComfyUI/models/sharp/sharp_2572gikvuh.pt (2679.6 MB) [17:54] [ComfyUI] [worker:ComfyUI-Sharp] [LoadSharpModel] config: precision=auto -> dtype=bf16 [17:54] [ComfyUI] [SubprocessWorker] got response: ok [17:54] [ComfyUI] [comfy-env] [VRAM] Before offload 'RGBGaussianPredictor_1' (2679 MB) -> cpu: 4817 / 24122 MB [17:54] [ComfyUI] [ComfyUI-Sharp] Health check: ping (timeout=5.0s)... [17:54] [ComfyUI] [ComfyUI-Sharp] Health check: ok [17:54] [ComfyUI] [SubprocessWorker] call_id=16 sending model_to_device [17:54] [ComfyUI] [WARNING] Model 'RGBGaussianPredictor_1' gone from worker (restarted?), treating as offloaded [17:54] [ComfyUI] [comfy-env] [VRAM] After offload 'RGBGaussianPredictor_1' (2679 MB): 4817 / 24122 MB [17:54] [ComfyUI] [comfy-env] LoadSharpModel done (0.30s): result: NodeOutput [17:54] [ComfyUI] [VRAM] After LoadSharpModel: 4817 / 24122 MB [17:54] [ComfyUI] [comfy-env] Running SharpPredictMetricDepth: focal_length_mm: 30.0, model: dict, image: torch.float32 [1,960,1416,3] cpu [17:54] [ComfyUI] [VRAM] Before SharpPredictMetricDepth: 4817 / 24122 MB [17:54] [ComfyUI] [SubprocessWorker] call_method: nodes.predict_metric_depth.SharpPredictMetricDepth.EXECUTE_NORMALIZED [17:54] [ComfyUI] [SubprocessWorker] acquired lock, ensuring started... [17:54] [ComfyUI] [ComfyUI-Sharp] Health check: ping (timeout=5.0s)... [17:54] [ComfyUI] [ComfyUI-Sharp] Health check: ok [17:54] [ComfyUI] [SubprocessWorker] worker started/confirmed [17:54] [ComfyUI] [comfy-env] PRE-SERIALIZE 'image' shape: torch.Size([1, 960, 1416, 3]) [17:54] [ComfyUI] [SubprocessWorker] serializing kwargs to shm... [17:54] [ComfyUI] [SubprocessWorker] created 0 shm blocks [17:54] [ComfyUI] [SubprocessWorker] sending request via socket... [17:54] [ComfyUI] [SubprocessWorker] call_id=17 sending call_method [17:54] [ComfyUI] [worker:ComfyUI-Sharp] [comfy-env] _from_shm got dict with keys: ['__type__', 'strategy', 'parent_pid', 'fd', 'storage_size'] [17:54] [ComfyUI] [worker:ComfyUI-Sharp] [comfy-env] DESERIALIZE TensorRef: tensor_size=[1, 960, 1416, 3] [17:54] [ComfyUI] [worker:ComfyUI-Sharp] [comfy-env] DESERIALIZED tensor shape: torch.Size([1, 960, 1416, 3]) [17:56] Frame 2 saved (frame_001.jpg, t=2.3s) [17:56] [capture-periodic] freeze=1ms shot=109ms unfreeze=3ms saved=True [17:57] [ComfyUI] [worker:ComfyUI-Sharp] [LoadSharpModel] loading checkpoint from /workspaces/Sharp-2211/ComfyUI/models/sharp/sharp_2572gikvuh.pt (dtype=bf16) [17:58] Frame 3 saved (frame_002.jpg, t=4.5s) [17:58] [capture-periodic] freeze=1ms shot=100ms unfreeze=2ms saved=True [17:58] [ComfyUI] [worker:ComfyUI-Sharp] [LoadSharpModel] initializing model on meta device... [17:59] [ComfyUI] [worker:ComfyUI-Sharp] [LoadSharpModel] model ready (torch.bfloat16) [17:59] [ComfyUI] [worker:ComfyUI-Sharp] [SharpPredictMetricDepth] intrinsics not wired -> using identity-style K (focal=1186.2px @ image 1416×960, 35mm-equiv 30.0mm). Pass intrinsics from PanoramaSplit for per-face accurate K. [17:59] [ComfyUI] [SubprocessWorker] callback 'request_vram_budget' from call_id=17 [17:59] [ComfyUI] [comfy-env] VRAM request: 2.81GB, free before eviction: 20.24GB [17:59] [ComfyUI] [comfy-env] VRAM after eviction: 20.24GB [17:59] [ComfyUI] [worker:ComfyUI-Sharp] [VRAM] +587MB (now 587MB) reserved=608MB peak=587MB [17:59] [capture-loop] iter=50 t=5.6s state={'complete': False, 'error': None, 'executedCount': 0, 'wsState': 1} eval_ms=1 ram=10.8/31.3GB (34%) swap=3.5/32.0GB (11%) cpu=73% browser_rss=0.83GB [18:00] [ComfyUI] [worker:ComfyUI-Sharp] [VRAM] +2652MB (now 3239MB) reserved=3456MB peak=3311MB [18:01] [ComfyUI] [worker:ComfyUI-Sharp] [VRAM] -267MB (now 2973MB) reserved=3360MB peak=3311MB [18:02] [ComfyUI] [worker:ComfyUI-Sharp] [VRAM] +1188MB (now 4161MB) reserved=7872MB peak=7051MB [18:03] [ComfyUI] [worker:ComfyUI-Sharp] [SharpPredictMetricDepth] 1 face(s) @ 1536²; layer0/layer1 depth median=2.12/2.12m, K_1536 fx->1286.7; points_raw ||v||=1.32–3.07m; 4.1s [18:03] [ComfyUI] [SubprocessWorker] got response: ok [18:03] [ComfyUI] [comfy-env] Created 1 model patchers: ['RGBGaussianPredictor_1'] [18:03] [ComfyUI] [comfy-env] SharpPredictMetricDepth done (8.51s): result: NodeOutput [18:03] [ComfyUI] [VRAM] After SharpPredictMetricDepth: 9277 / 24122 MB [18:03] [ComfyUI] [VRAM] Loaded: SubprocessModel (2679 MB) [18:03] [ComfyUI] [comfy-env] Running SharpPredictGaussiansFromMetricDepth: snap_to_external_depth: 'none', depth_convention: 'planar_z', focal_length_mm: 30.0, output_prefix: 'sharp_aligned', save_background_layer: True, edge_crop: 0.0, model: dict, image: torch.float32 [1,960,1416,3] cpu, metric_depth_layer0: torch.float32 [1,1536,1536,3] cpu [18:03] [ComfyUI] [VRAM] Before SharpPredictGaussiansFromMetricDepth: 9277 / 24122 MB [18:03] [ComfyUI] [VRAM] Loaded: SubprocessModel (2679 MB) [18:03] [ComfyUI] [SubprocessWorker] call_method: nodes.predict_gaussians_from_depth.SharpPredictGaussiansFromMetricDepth.EXECUTE_NORMALIZED [18:03] [ComfyUI] [SubprocessWorker] acquired lock, ensuring started... [18:03] [ComfyUI] [ComfyUI-Sharp] Health check: ping (timeout=5.0s)... [18:03] [ComfyUI] [ComfyUI-Sharp] Health check: ok [18:03] [ComfyUI] [SubprocessWorker] worker started/confirmed [18:03] [ComfyUI] [comfy-env] PRE-SERIALIZE 'image' shape: torch.Size([1, 960, 1416, 3]) [18:03] [ComfyUI] [comfy-env] PRE-SERIALIZE 'metric_depth_layer0' shape: torch.Size([1, 1536, 1536, 3]) [18:03] [ComfyUI] [SubprocessWorker] serializing kwargs to shm... [18:03] [ComfyUI] [SubprocessWorker] created 0 shm blocks [18:03] [ComfyUI] [SubprocessWorker] sending request via socket... [18:03] [ComfyUI] [SubprocessWorker] call_id=18 sending call_method [18:03] [ComfyUI] [worker:ComfyUI-Sharp] [VRAM] -1474MB (now 2688MB) reserved=4384MB peak=7051MB [18:03] [ComfyUI] [worker:ComfyUI-Sharp] [comfy-env] _from_shm got dict with keys: ['__type__', 'strategy', 'parent_pid', 'fd', 'storage_size'] [18:03] [ComfyUI] [worker:ComfyUI-Sharp] [comfy-env] DESERIALIZE TensorRef: tensor_size=[1, 960, 1416, 3] [18:03] [ComfyUI] [worker:ComfyUI-Sharp] [comfy-env] DESERIALIZED tensor shape: torch.Size([1, 960, 1416, 3]) [18:03] [ComfyUI] [worker:ComfyUI-Sharp] [comfy-env] _from_shm got dict with keys: ['__type__', 'strategy', 'parent_pid', 'fd', 'storage_size'] [18:03] [ComfyUI] [worker:ComfyUI-Sharp] [comfy-env] DESERIALIZE TensorRef: tensor_size=[1, 1536, 1536, 3] [18:03] [ComfyUI] [worker:ComfyUI-Sharp] [comfy-env] DESERIALIZED tensor shape: torch.Size([1, 1536, 1536, 3]) [18:03] [ComfyUI] [worker:ComfyUI-Sharp] [SharpPredictGaussiansFromMetricDepth] metric_depth_layer1 unwired -> layer 1 will duplicate layer 0 (legacy behavior) [18:03] [ComfyUI] [SubprocessWorker] callback 'request_vram_budget' from call_id=18 [18:03] [ComfyUI] [comfy-env] VRAM request: 2.81GB, free before eviction: 15.57GB [18:03] [ComfyUI] [comfy-env] VRAM after eviction: 15.57GB [18:03] [ComfyUI] [worker:ComfyUI-Sharp] [SharpPredictGaussiansFromMetricDepth] face 1/1: 1416×960, extrinsics=none, intrinsics=none, mask=no, snap=none, depth_conv=planar_z [18:04] [ComfyUI] [worker:ComfyUI-Sharp] [VRAM] +2859MB (now 5547MB) reserved=7552MB peak=7051MB [18:04] [ComfyUI] [SubprocessWorker] callback 'report_progress' from call_id=18 [18:04] [ComfyUI] [worker:ComfyUI-Sharp] [SharpPredictGaussiansFromMetricDepth] 1 face(s) -> 1.18M gaussians total (both layers, snap=none); saved to /workspaces/Sharp-2211/ComfyUI/output/sharp_aligned_1780871388355.ply; 1.2s [18:04] [ComfyUI] [SubprocessWorker] got response: ok [18:04] [ComfyUI] [comfy-env] SharpPredictGaussiansFromMetricDepth done (1.41s): result: NodeOutput [18:04] [ComfyUI] [VRAM] After SharpPredictGaussiansFromMetricDepth: 12483 / 24122 MB [18:04] [ComfyUI] [VRAM] Loaded: SubprocessModel (2679 MB) [18:04] [ComfyUI] [comfy-env] Running PreviewGaussianSharp: ply_path: '/workspaces/Sharp-2211/ComfyUI/output/sharp_aligned_1780..., extrinsics: list[4], intrinsics: list[3] [18:04] [ComfyUI] [VRAM] Before PreviewGaussianSharp: 12483 / 24122 MB [18:04] [ComfyUI] [VRAM] Loaded: SubprocessModel (2679 MB) [18:04] [ComfyUI] [SubprocessWorker] call_method: nodes.preview_gaussian_sharp.PreviewGaussianSharp.EXECUTE_NORMALIZED [18:04] [ComfyUI] [SubprocessWorker] acquired lock, ensuring started... [18:04] [ComfyUI] [ComfyUI-GaussianPack] Health check: ping (timeout=5.0s)... [18:04] [ComfyUI] [ComfyUI-GaussianPack] Health check: ok [18:04] [ComfyUI] [SubprocessWorker] worker started/confirmed [18:04] [ComfyUI] [SubprocessWorker] serializing kwargs to shm... [18:04] [ComfyUI] [SubprocessWorker] created 0 shm blocks [18:04] [ComfyUI] [SubprocessWorker] sending request via socket... [18:04] [ComfyUI] [SubprocessWorker] call_id=5 sending call_method [18:04] [ComfyUI] [SubprocessWorker] got response: ok [18:04] [ComfyUI] [comfy-env] PreviewGaussianSharp done (0.06s): result: NodeOutput [18:04] [ComfyUI] [VRAM] After PreviewGaussianSharp: 12483 / 24122 MB [18:04] [ComfyUI] [VRAM] Loaded: SubprocessModel (2679 MB) [18:04] [ComfyUI] [comfy-env] Running SharpPredict: focal_length_mm: 30.0, output_prefix: 'sharp', model: dict, image: torch.float32 [1,960,1416,3] cpu [18:04] [ComfyUI] [VRAM] Before SharpPredict: 12483 / 24122 MB [18:04] [ComfyUI] [VRAM] Loaded: SubprocessModel (2679 MB) [18:04] [ComfyUI] [SubprocessWorker] call_method: nodes.predict.SharpPredict.EXECUTE_NORMALIZED [18:04] Node executed (1 total), capturing... [18:04] [ComfyUI] [SubprocessWorker] acquired lock, ensuring started... [18:04] [ComfyUI] [ComfyUI-Sharp] Health check: ping (timeout=5.0s)... [18:04] [ComfyUI] [ComfyUI-Sharp] Health check: ok [18:04] [ComfyUI] [SubprocessWorker] worker started/confirmed [18:04] [ComfyUI] [comfy-env] PRE-SERIALIZE 'image' shape: torch.Size([1, 960, 1416, 3]) [18:04] [ComfyUI] [SubprocessWorker] serializing kwargs to shm... [18:04] [ComfyUI] [SubprocessWorker] created 0 shm blocks [18:04] [ComfyUI] [SubprocessWorker] sending request via socket... [18:04] [ComfyUI] [SubprocessWorker] call_id=19 sending call_method [18:04] [ComfyUI] [worker:ComfyUI-Sharp] [comfy-env] _from_shm got dict with keys: ['__type__', 'strategy', 'parent_pid', 'fd', 'storage_size'] [18:04] [ComfyUI] [worker:ComfyUI-Sharp] [comfy-env] DESERIALIZE TensorRef: tensor_size=[1, 960, 1416, 3] [18:04] [ComfyUI] [worker:ComfyUI-Sharp] [comfy-env] DESERIALIZED tensor shape: torch.Size([1, 960, 1416, 3]) [18:04] [ComfyUI] [SubprocessWorker] callback 'request_vram_budget' from call_id=19 [18:04] [ComfyUI] [comfy-env] VRAM request: 2.81GB, free before eviction: 12.20GB [18:04] [ComfyUI] [comfy-env] VRAM after eviction: 12.20GB [18:05] [ComfyUI] [worker:ComfyUI-Sharp] [VRAM] -2291MB (now 3257MB) reserved=3456MB peak=7051MB [18:05] Frame 4 saved (frame_003.jpg, t=10.7s) [18:05] [capture-node] freeze=710ms shot=372ms unfreeze=2ms saved=True [18:06] [ComfyUI] [worker:ComfyUI-Sharp] [VRAM] +336MB (now 3594MB) reserved=4064MB peak=7051MB [18:07] [ComfyUI] [worker:ComfyUI-Sharp] [VRAM] +567MB (now 4161MB) reserved=7968MB peak=7051MB [18:08] [ComfyUI] [worker:ComfyUI-Sharp] [VRAM] +337MB (now 4499MB) reserved=6816MB peak=7051MB [18:09] [ComfyUI] [SubprocessWorker] callback 'report_progress' from call_id=19 [18:09] [ComfyUI] [SubprocessWorker] got response: ok [18:09] [ComfyUI] [comfy-env] SharpPredict done (4.53s): result: NodeOutput [18:09] [ComfyUI] [VRAM] After SharpPredict: 11747 / 24122 MB [18:09] [ComfyUI] [VRAM] Loaded: SubprocessModel (2679 MB) [18:09] [ComfyUI] [comfy-env] Running PreviewGaussianSharp: ply_path: '/workspaces/Sharp-2211/ComfyUI/output/sharp_178087138974..., extrinsics: list[4], intrinsics: list[3] [18:09] [ComfyUI] [VRAM] Before PreviewGaussianSharp: 11747 / 24122 MB [18:09] [ComfyUI] [VRAM] Loaded: SubprocessModel (2679 MB) [18:09] [ComfyUI] [SubprocessWorker] call_method: nodes.preview_gaussian_sharp.PreviewGaussianSharp.EXECUTE_NORMALIZED [18:09] [ComfyUI] [SubprocessWorker] acquired lock, ensuring started... [18:09] [ComfyUI] [ComfyUI-GaussianPack] Health check: ping (timeout=5.0s)... [18:09] [ComfyUI] [ComfyUI-GaussianPack] Health check: ok [18:09] [ComfyUI] [SubprocessWorker] worker started/confirmed [18:09] [ComfyUI] [SubprocessWorker] serializing kwargs to shm... [18:09] [ComfyUI] [SubprocessWorker] created 0 shm blocks [18:09] [ComfyUI] [SubprocessWorker] sending request via socket... [18:09] [ComfyUI] [SubprocessWorker] call_id=6 sending call_method [18:09] [ComfyUI] [SubprocessWorker] got response: ok [18:09] [ComfyUI] [comfy-env] PreviewGaussianSharp done (0.06s): result: NodeOutput [18:09] [ComfyUI] [VRAM] After PreviewGaussianSharp: 11747 / 24122 MB [18:09] [ComfyUI] [VRAM] Loaded: SubprocessModel (2679 MB) [18:09] [ComfyUI] [INFO] Prompt executed in 14.90 seconds [18:09] [ComfyUI] [comfy-env] [VRAM] Before offload 'RGBGaussianPredictor_1' (2679 MB) -> cpu: 11747 / 24122 MB [18:09] [ComfyUI] [ComfyUI-Sharp] Health check: ping (timeout=5.0s)... [18:09] [ComfyUI] [ComfyUI-Sharp] Health check: ok [18:09] [ComfyUI] [SubprocessWorker] call_id=20 sending model_to_device [18:09] [ComfyUI] [worker:ComfyUI-Sharp] [VRAM] -1972MB (now 2527MB) reserved=6816MB peak=7051MB [18:10] [ComfyUI] [worker:ComfyUI-Sharp] [VRAM] -1421MB (now 1107MB) reserved=6816MB peak=7051MB [18:11] [ComfyUI] [comfy-env] [VRAM] After offload 'RGBGaussianPredictor_1' (2679 MB): 5027 / 24122 MB [18:11] [ComfyUI] [INFO] Using RAM pressure cache. [18:31] Frame 5 saved (frame_004.jpg, t=20.1s) [18:31] [capture-periodic] freeze=8105ms shot=8990ms unfreeze=170ms saved=True [18:39] Node executed (2 total), capturing... [18:56] Frame 6 saved (frame_005.jpg, t=45.8s) [18:56] [capture-node] freeze=7896ms shot=8123ms unfreeze=0ms saved=True [18:56] Execution complete (t=45.8s) [18:56] [3d-wait] Phase 1: Waiting for 'Loading 3D Model' text to disappear... [18:56] [3d-wait] Phase 1 done in 0.0s [18:56] [3d-wait] Phase 2: iframes=2 [18:56] [3d-wait] iframe viewer_ready=True (matched 2 console logs) [18:56] [3d-wait] Unfrozen in 0.001s, rendering for 5s... [19:12] [3d-wait] JS halted via CDP after 16.0s [19:35] [3d-wait] Re-frozen in 39.8s [19:35] [3d-wait] Total 3D wait: 39.9s [19:35] Captured 6 unique frames over 101.76s [19:35] [debug] iframes: 2 [19:35] [debug] iframe[0]: src=http://127.0.0.1:41898/extensions/ComfyUI-GaussianPack/viewer_gaussian_sharp.htm, canvas=1416x960, rafFrozen=True [19:35] [debug] iframe[1]: src=http://127.0.0.1:41898/extensions/ComfyUI-GaussianPack/viewer_gaussian_sharp.htm, canvas=1416x960, rafFrozen=True [19:35] [timing] trigger_3d_previews: 0.0s [19:38] Saved high-quality screenshot: vanilla_vs_image_depth_gaussians_executed.png [19:38] [timing] final_screenshot: 0.3s [19:38] [ComfyUI] [INFO] Using RAM pressure cache. [19:38] Results saved to /logs/Sharp-2211/dev/linux-gpu/results.json [19:38] Model report: 8 files, 3.8 GB -> /logs/Sharp-2211/dev/linux-gpu/models.json [19:38] Saved: /logs/Sharp-2211/dev/linux-gpu/index.html [19:38] [EXECUTION] PASSED [19:38] linux: PASSED [19:38] Stopping ComfyUI server...