nodes/PozzettiAndrea-ComfyUI-Sharp
1
0
Fork 0
Code Issues Pull Requests Packages Projects Releases Wiki Activity
Files
gh-pages
PozzettiAndrea-ComfyUI-Sharp/dev/linux-gpu/session.log
T
comfy-test aa1da364a6 Update dev/linux-gpu
2026-06-07 22:32:04 +00:00

2281 lines
209 KiB
Plaintext
Raw Permalink Blame History

This file contains ambiguous Unicode characters
This file contains Unicode characters that might be confused with other characters. If you think that this is intentional, you can safely ignore this warning. Use the Escape button to reveal them.
[00:00] Crash dump logging enabled: /logs/Sharp-2211/dev/linux-gpu/crash_dump.log
[00:00]
[00:00] [1/5] SYNTAX
[00:00] ----------------------------------------
[00:00]
[DEBUG] server=None, api=None
[00:00] Found pyproject.toml (modern format)
[00:00] Found requirements.txt (legacy format)
[00:00] Unicode check: OK (all characters cp1252-safe)
[00:00] Forbidden patterns check: OK
[00:00] [SYNTAX] PASSED
[00:00]
[00:00] [2/5] INSTALL
[00:00] ----------------------------------------
[00:00]
[DEBUG] server=None, api=None
[00:00]
Setting up ComfyUI...
[00:00] Creating virtual environment...
[00:00] Running: uv venv /workspaces/Sharp-2211/.venv --python 3.11
[00:00] torch_version='2.10.0' -> pinning torch==2.10.0 torchvision==0.25.0 torchaudio==2.10.0
[00:00] Cloning ComfyUI (latest)...
[00:00] Running: git clone --depth 1 https://github.com/comfyanonymous/ComfyUI.git /workspaces/Sharp-2211/ComfyUI
[00:01] Pinning torch family from https://download.pytorch.org/whl/cu128: torch==2.10.0 torchvision==0.25.0 torchaudio==2.10.0
[00:01] Running: uv pip install --python /workspaces/Sharp-2211/.venv/bin/python --index-url https://download.pytorch.org/whl/cu128 --extra-index-url https://pypi.org/simple --index-strategy unsafe-best-match torch==2.10.0 torchvision==0.25.0 torchaudio==2.10.0
[02:21] Installing ComfyUI requirements...
[02:21] Running: uv pip install --python /workspaces/Sharp-2211/.venv/bin/python --index-url https://download.pytorch.org/whl/cu128 --extra-index-url https://pypi.org/simple --index-strategy unsafe-best-match -r /workspaces/Sharp-2211/ComfyUI/requirements.txt
[02:40]
Installing custom node...
[02:40] Copying ComfyUI-Sharp to custom_nodes/...
[02:40] Installing node requirements...
[02:40] Running: uv pip install --python /workspaces/Sharp-2211/.venv/bin/python --index-url https://download.pytorch.org/whl/cu128 --extra-index-url https://pypi.org/simple --index-strategy unsafe-best-match -r /workspaces/Sharp-2211/ComfyUI/custom_nodes/ComfyUI-Sharp/requirements.txt
[02:42]
Running install.py...
[02:42] Running: /workspaces/Sharp-2211/.venv/bin/python /workspaces/Sharp-2211/ComfyUI/custom_nodes/ComfyUI-Sharp/install.py
[02:43]
[02:43] Installing 2 node dependencies...
[02:43] Cloning ComfyUI-GaussianPack...
[02:49] Installing requirements for ComfyUI-GaussianPack...
[02:51] Running install.py for ComfyUI-GaussianPack...
[02:57] [comfy-env] _discover: scanning /workspaces/Sharp-2211/ComfyUI/custom_nodes
[02:57] [comfy-env] _discover: ComfyUI-GaussianPack -> gaussianpack-nodes (custom_nodes/ComfyUI-GaussianPack/nodes/comfy-env.toml)
[02:57] [comfy-env] _discover: ComfyUI-Sharp -> sharp-nodes (custom_nodes/ComfyUI-Sharp/nodes/comfy-env.toml)
[02:57] [comfy-env] Workspace: /tmp/comfytest-home/.ce
[02:57] [comfy-env] ComfyUI: /workspaces/Sharp-2211/ComfyUI
[02:57] [comfy-env] Found 2 node config(s):
[02:57] - gaussianpack-nodes <- custom_nodes/ComfyUI-GaussianPack/nodes/comfy-env.toml (python=host)
[02:57] - sharp-nodes <- custom_nodes/ComfyUI-Sharp/nodes/comfy-env.toml (python=host)
[02:57] [comfy-env] Bootstrap interpreter has python 3.11 + torch 2.10.0 (cu128). Looking for cuda-only wheels matching cu128/torch2.10/cp311.
[02:57] [comfy-env] GPU: Detection: smi
[02:57] Driver: 580.126.20
[02:57] CUDA: 13.0
[02:57] Recommended: CUDA 13.0
[02:57]
[02:57] GPU 0: NVIDIA GeForce RTX 3090 (sm_86) [Ampere] 24576MB
[02:57] [comfy-env] Comfyui feature -> torch 2.10.0 from https://download.pytorch.org/whl/cu128 (CUDA 12.8 via bootstrap torch)
[02:57] [comfy-env] cuda-wheels: 1 package(s) need a matched (cuda, torch, python) combo: ['gsplat']
[02:57] [comfy-env] cuda-wheels tier 1 (bootstrap): probing cu12.8/torch2.10/cp311
[02:57] [cuda-wheels] Looking up gsplat: cu128 torch2.10 cp311 manylinux linux
[02:58] [cuda-wheels] Found: gsplat-1.5.3+cu128torch2.10-cp311-cp311-manylinux_2_34_x86_64.manylinux_2_35_x86_64.whl
[02:58] [comfy-env] cuda-wheels combo: cu12.8/torch2.10 (bootstrap matches; per-node envs will pin to this)
[02:58] [comfy-env] Host glibc 2.35 -> system-requirements
[02:58] [cuda-wheels] Looking up gsplat: cu128 torch2.10 cp311 manylinux linux
[02:58] [cuda-wheels] Found: gsplat-1.5.3+cu128torch2.10-cp311-cp311-manylinux_2_34_x86_64.manylinux_2_35_x86_64.whl
[02:58] [comfy-env] gaussianpack-nodes: cuda-wheels deferred for post-pixi install (gsplat)
[02:58] [cuda-wheels] Looking up gsplat: cu128 torch2.10 cp311 manylinux linux
[02:58] [cuda-wheels] Found: gsplat-1.5.3+cu128torch2.10-cp311-cp311-manylinux_2_34_x86_64.manylinux_2_35_x86_64.whl
[02:58] [comfy-env] sharp-nodes: cuda-wheels deferred for post-pixi install (gsplat)
[02:58] Generated /tmp/comfytest-home/.ce/pixi.toml
[02:58] [comfy-env] Installing 2 environment(s):
[02:58] - gaussianpack-nodes (python=host, 8 pypi deps, 1 cuda wheels)
[02:58] - sharp-nodes (python=host, 15 pypi deps, 1 cuda wheels)
[02:58] [comfy-env] Running `pixi install -e gaussianpack-nodes -e sharp-nodes`...
[03:02] WARN Skipped running the post-link scripts because `run-post-link-scripts` = `false`
[03:02] - bin/.librsvg-pre-unlink.sh
[03:02] To enable them, run:
[03:02] pixi config set --local run-post-link-scripts insecure
[03:02] More info:
[03:02] https://pixi.sh/latest/reference/pixi_configuration/#run-post-link-scripts
[03:08] WARN Skipped running the post-link scripts because `run-post-link-scripts` = `false`
[03:08] - bin/.librsvg-pre-unlink.sh
[03:08] To enable them, run:
[03:08] pixi config set --local run-post-link-scripts insecure
[03:08] More info:
[03:08] https://pixi.sh/latest/reference/pixi_configuration/#run-post-link-scripts
[04:37] The following environments have been installed: gaussianpack-nodes, sharp-nodes.
[04:38] [comfy-env] gaussianpack-nodes: installing cuda-wheels with --no-deps (gsplat)
[04:38] Using Python 3.11.15 environment at: .pixi/envs/gaussianpack-nodes
[04:39] Resolved 1 package in 890ms
[04:39] Downloading gsplat (33.9MiB)
[04:40] Downloaded gsplat
[04:40] Prepared 1 package in 988ms
[04:41] Installed 1 package in 435ms
[04:41] + gsplat==1.5.3+cu128torch2.10 (from https://github.com/PozzettiAndrea/cuda-wheels/releases/download/gsplat-latest/gsplat-1.5.3%2Bcu128torch2.10-cp311-cp311-manylinux_2_34_x86_64.manylinux_2_35_x86_64.whl)
[04:41] [comfy-env] sharp-nodes: installing cuda-wheels with --no-deps (gsplat)
[04:42] Using Python 3.11.15 environment at: .pixi/envs/sharp-nodes
[04:42] Resolved 1 package in 976ms
[04:43] Downloading gsplat (33.9MiB)
[04:43] Downloaded gsplat
[04:43] Prepared 1 package in 853ms
[04:43] Installed 1 package in 301ms
[04:43] + gsplat==1.5.3+cu128torch2.10 (from https://github.com/PozzettiAndrea/cuda-wheels/releases/download/gsplat-latest/gsplat-1.5.3%2Bcu128torch2.10-cp311-cp311-manylinux_2_34_x86_64.manylinux_2_35_x86_64.whl)
[04:43] [comfy-env] Recorded install hash fbd9bcb6ce25 -> /tmp/comfytest-home/.ce/install.hash
[04:43] [comfy-env] Install log: /tmp/comfytest-home/.ce/install.log
[04:43]
[04:43] Installation complete!
[04:43] Cloning ComfyUI-PanoPack...
[05:51] Installing requirements for ComfyUI-PanoPack...
[05:51] Running install.py for ComfyUI-PanoPack...
[05:51]
[05:51] Installing 2 node dependencies...
[05:51] Cloning ComfyUI-MoGe2...
[06:02] Installing requirements for ComfyUI-MoGe2...
[06:02] Running install.py for ComfyUI-MoGe2...
[06:02] [comfy-env] _discover: scanning /workspaces/Sharp-2211/ComfyUI/custom_nodes
[06:02] [comfy-env] _discover: ComfyUI-GaussianPack -> gaussianpack-nodes (custom_nodes/ComfyUI-GaussianPack/nodes/comfy-env.toml)
[06:02] [comfy-env] _discover: ComfyUI-MoGe2 -> moge2-nodes (custom_nodes/ComfyUI-MoGe2/nodes/comfy-env.toml)
[06:02] [comfy-env] _discover: ComfyUI-PanoPack -> panopack-nodes (custom_nodes/ComfyUI-PanoPack/nodes/comfy-env.toml)
[06:02] [comfy-env] _discover: ComfyUI-Sharp -> sharp-nodes (custom_nodes/ComfyUI-Sharp/nodes/comfy-env.toml)
[06:02] [comfy-env] Workspace: /tmp/comfytest-home/.ce
[06:02] [comfy-env] ComfyUI: /workspaces/Sharp-2211/ComfyUI
[06:02] [comfy-env] Found 4 node config(s):
[06:02] - gaussianpack-nodes <- custom_nodes/ComfyUI-GaussianPack/nodes/comfy-env.toml (python=host)
[06:02] - moge2-nodes <- custom_nodes/ComfyUI-MoGe2/nodes/comfy-env.toml (python=host)
[06:02] - panopack-nodes <- custom_nodes/ComfyUI-PanoPack/nodes/comfy-env.toml (python=host)
[06:02] - sharp-nodes <- custom_nodes/ComfyUI-Sharp/nodes/comfy-env.toml (python=host)
[06:02] [comfy-env] Bootstrap interpreter has python 3.11 + torch 2.10.0 (cu128). Looking for cuda-only wheels matching cu128/torch2.10/cp311.
[06:02] [comfy-env] GPU: Detection: smi
[06:02] Driver: 580.126.20
[06:02] CUDA: 13.0
[06:02] Recommended: CUDA 13.0
[06:02]
[06:02] GPU 0: NVIDIA GeForce RTX 3090 (sm_86) [Ampere] 24576MB
[06:02] [comfy-env] Comfyui feature -> torch 2.10.0 from https://download.pytorch.org/whl/cu128 (CUDA 12.8 via bootstrap torch)
[06:02] [comfy-env] cuda-wheels: 3 package(s) need a matched (cuda, torch, python) combo: ['gsplat', 'sageattention', 'flash_attn']
[06:02] [comfy-env] cuda-wheels tier 1 (bootstrap): probing cu12.8/torch2.10/cp311
[06:02] [cuda-wheels] Looking up gsplat: cu128 torch2.10 cp311 manylinux linux
[06:02] [cuda-wheels] Found: gsplat-1.5.3+cu128torch2.10-cp311-cp311-manylinux_2_34_x86_64.manylinux_2_35_x86_64.whl
[06:02] [cuda-wheels] Looking up sageattention: cu128 torch2.10 cp311 manylinux linux
[06:02] [cuda-wheels] Found: sageattention-2.2.0+cu128torch2.10-cp311-cp311-manylinux_2_34_x86_64.manylinux_2_35_x86_64.whl
[06:02] [cuda-wheels] Looking up flash_attn: cu128 torch2.10 cp311 manylinux linux
[06:02] [cuda-wheels] Found: flash_attn-2.8.3+cu128torch2.10-cp311-cp311-manylinux_2_24_x86_64.manylinux_2_28_x86_64.whl
[06:02] [comfy-env] cuda-wheels combo: cu12.8/torch2.10 (bootstrap matches; per-node envs will pin to this)
[06:02] [comfy-env] Host glibc 2.35 -> system-requirements
[06:02] [cuda-wheels] Looking up gsplat: cu128 torch2.10 cp311 manylinux linux
[06:03] [cuda-wheels] Found: gsplat-1.5.3+cu128torch2.10-cp311-cp311-manylinux_2_34_x86_64.manylinux_2_35_x86_64.whl
[06:03] [comfy-env] gaussianpack-nodes: cuda-wheels deferred for post-pixi install (gsplat)
[06:03] [cuda-wheels] Looking up sageattention: cu128 torch2.10 cp311 manylinux linux
[06:03] [cuda-wheels] Found: sageattention-2.2.0+cu128torch2.10-cp311-cp311-manylinux_2_34_x86_64.manylinux_2_35_x86_64.whl
[06:03] [cuda-wheels] Looking up flash_attn: cu128 torch2.10 cp311 manylinux linux
[06:03] [cuda-wheels] Found: flash_attn-2.8.3+cu128torch2.10-cp311-cp311-manylinux_2_24_x86_64.manylinux_2_28_x86_64.whl
[06:03] [comfy-env] moge2-nodes: cuda-wheels deferred for post-pixi install (sageattention, flash_attn)
[06:03] [cuda-wheels] Looking up gsplat: cu128 torch2.10 cp311 manylinux linux
[06:03] [cuda-wheels] Found: gsplat-1.5.3+cu128torch2.10-cp311-cp311-manylinux_2_34_x86_64.manylinux_2_35_x86_64.whl
[06:03] [comfy-env] sharp-nodes: cuda-wheels deferred for post-pixi install (gsplat)
[06:03] Generated /tmp/comfytest-home/.ce/pixi.toml
[06:03] [comfy-env] Installing 4 environment(s):
[06:03] - gaussianpack-nodes (python=host, 8 pypi deps, 1 cuda wheels)
[06:03] - moge2-nodes (python=host, 12 pypi deps, 2 cuda wheels)
[06:03] - panopack-nodes (python=host, 21 pypi deps)
[06:03] - sharp-nodes (python=host, 15 pypi deps, 1 cuda wheels)
[06:03] [comfy-env] Running `pixi install -e gaussianpack-nodes -e moge2-nodes -e panopack-nodes -e sharp-nodes`...
[06:08] WARN Skipped running the post-link scripts because `run-post-link-scripts` = `false`
[06:08] - bin/.librsvg-pre-unlink.sh
[06:08] To enable them, run:
[06:08] pixi config set --local run-post-link-scripts insecure
[06:08] More info:
[06:08] https://pixi.sh/latest/reference/pixi_configuration/#run-post-link-scripts
[06:08] WARN Skipped running the post-link scripts because `run-post-link-scripts` = `false`
[06:08] - bin/.librsvg-pre-unlink.sh
[06:09] To enable them, run:
[06:09] pixi config set --local run-post-link-scripts insecure
[06:09] More info:
[06:09] https://pixi.sh/latest/reference/pixi_configuration/#run-post-link-scripts
[06:11] The following environments have been installed: gaussianpack-nodes, moge2-nodes, panopack-nodes, sharp-nodes.
[06:11] [comfy-env] gaussianpack-nodes: installing cuda-wheels with --no-deps (gsplat)
[06:11] Using Python 3.11.15 environment at: .pixi/envs/gaussianpack-nodes
[06:12] Resolved 1 package in 845ms
[06:12] Checked 1 package in 0.07ms
[06:12] [comfy-env] moge2-nodes: installing cuda-wheels with --no-deps (sageattention, flash_attn)
[06:12] Using Python 3.11.15 environment at: .pixi/envs/moge2-nodes
[06:14] Resolved 2 packages in 1.51s
[06:14] Downloading sageattention (53.2MiB)
[06:14] Downloading flash-attn (241.9MiB)
[06:16] Downloaded sageattention
[06:20] Downloaded flash-attn
[06:20] Prepared 2 packages in 6.29s
[06:20] Installed 2 packages in 81ms
[06:20] + flash-attn==2.8.3+cu128torch2.10 (from https://github.com/PozzettiAndrea/cuda-wheels/releases/download/flash_attn-latest/flash_attn-2.8.3%2Bcu128torch2.10-cp311-cp311-manylinux_2_24_x86_64.manylinux_2_28_x86_64.whl)
[06:20] + sageattention==2.2.0+cu128torch2.10 (from https://github.com/PozzettiAndrea/cuda-wheels/releases/download/sageattention-latest/sageattention-2.2.0%2Bcu128torch2.10-cp311-cp311-manylinux_2_34_x86_64.manylinux_2_35_x86_64.whl)
[06:20] [comfy-env] sharp-nodes: installing cuda-wheels with --no-deps (gsplat)
[06:20] Using Python 3.11.15 environment at: .pixi/envs/sharp-nodes
[06:21] Resolved 1 package in 743ms
[06:21] Checked 1 package in 0.07ms
[06:21] [comfy-env] Recorded install hash 84e37ee4e920 -> /tmp/comfytest-home/.ce/install.hash
[06:21] [comfy-env] Install log: /tmp/comfytest-home/.ce/install.log
[06:21]
[06:21] Installation complete!
[06:21] Cloning ComfyUI-GeometryPack...
[06:25] Installing requirements for ComfyUI-GeometryPack...
[06:27] Running install.py for ComfyUI-GeometryPack...
[06:27] [comfy-env] _discover: scanning /workspaces/Sharp-2211/ComfyUI/custom_nodes
[06:27] [comfy-env] _discover: ComfyUI-GaussianPack -> gaussianpack-nodes (custom_nodes/ComfyUI-GaussianPack/nodes/comfy-env.toml)
[06:28] [comfy-env] _discover: ComfyUI-GeometryPack -> geometrypack-nodes (custom_nodes/ComfyUI-GeometryPack/nodes/comfy-env.toml)
[06:28] [comfy-env] _discover: ComfyUI-MoGe2 -> moge2-nodes (custom_nodes/ComfyUI-MoGe2/nodes/comfy-env.toml)
[06:28] [comfy-env] _discover: ComfyUI-PanoPack -> panopack-nodes (custom_nodes/ComfyUI-PanoPack/nodes/comfy-env.toml)
[06:28] [comfy-env] _discover: ComfyUI-Sharp -> sharp-nodes (custom_nodes/ComfyUI-Sharp/nodes/comfy-env.toml)
[06:28] [comfy-env] Workspace: /tmp/comfytest-home/.ce
[06:29] [comfy-env] ComfyUI: /workspaces/Sharp-2211/ComfyUI
[06:29] [comfy-env] Found 5 node config(s):
[06:29] - gaussianpack-nodes <- custom_nodes/ComfyUI-GaussianPack/nodes/comfy-env.toml (python=host)
[06:29] - geometrypack-nodes <- custom_nodes/ComfyUI-GeometryPack/nodes/comfy-env.toml (python=host)
[06:30] - moge2-nodes <- custom_nodes/ComfyUI-MoGe2/nodes/comfy-env.toml (python=host)
[06:30] - panopack-nodes <- custom_nodes/ComfyUI-PanoPack/nodes/comfy-env.toml (python=host)
[06:30] - sharp-nodes <- custom_nodes/ComfyUI-Sharp/nodes/comfy-env.toml (python=host)
[06:30] [comfy-env] Bootstrap interpreter has python 3.11 + torch 2.10.0 (cu128). Looking for cuda-only wheels matching cu128/torch2.10/cp311.
[06:30] [comfy-env] GPU: Detection: smi
[06:30] Driver: 580.126.20
[06:30] CUDA: 13.0
[06:31] Recommended: CUDA 13.0
[06:31]
[06:31] GPU 0: NVIDIA GeForce RTX 3090 (sm_86) [Ampere] 24576MB
[06:32] [comfy-env] Comfyui feature -> torch 2.10.0 from https://download.pytorch.org/whl/cu128 (CUDA 12.8 via bootstrap torch)
[06:32] [comfy-env] cuda-wheels: 4 package(s) need a matched (cuda, torch, python) combo: ['gsplat', 'cumesh', 'sageattention', 'flash_attn']
[06:32] [comfy-env] cuda-wheels tier 1 (bootstrap): probing cu12.8/torch2.10/cp311
[06:32] [cuda-wheels] Looking up gsplat: cu128 torch2.10 cp311 manylinux linux
[06:32] [cuda-wheels] Found: gsplat-1.5.3+cu128torch2.10-cp311-cp311-manylinux_2_34_x86_64.manylinux_2_35_x86_64.whl
[06:32] [cuda-wheels] Looking up cumesh: cu128 torch2.10 cp311 manylinux linux
[06:33] [cuda-wheels] Found: cumesh-0.0.1+cu128torch2.10-cp311-cp311-manylinux_2_35_x86_64.whl
[06:33] [cuda-wheels] Looking up sageattention: cu128 torch2.10 cp311 manylinux linux
[06:33] [cuda-wheels] Found: sageattention-2.2.0+cu128torch2.10-cp311-cp311-manylinux_2_34_x86_64.manylinux_2_35_x86_64.whl
[06:33] [cuda-wheels] Looking up flash_attn: cu128 torch2.10 cp311 manylinux linux
[06:33] [cuda-wheels] Found: flash_attn-2.8.3+cu128torch2.10-cp311-cp311-manylinux_2_24_x86_64.manylinux_2_28_x86_64.whl
[06:33] [comfy-env] cuda-wheels combo: cu12.8/torch2.10 (bootstrap matches; per-node envs will pin to this)
[06:33] [comfy-env] Host glibc 2.35 -> system-requirements
[06:33] [cuda-wheels] Looking up gsplat: cu128 torch2.10 cp311 manylinux linux
[06:34] [cuda-wheels] Found: gsplat-1.5.3+cu128torch2.10-cp311-cp311-manylinux_2_34_x86_64.manylinux_2_35_x86_64.whl
[06:34] [comfy-env] gaussianpack-nodes: cuda-wheels deferred for post-pixi install (gsplat)
[06:34] [cuda-wheels] Looking up cumesh: cu128 torch2.10 cp311 manylinux linux
[06:34] [cuda-wheels] Found: cumesh-0.0.1+cu128torch2.10-cp311-cp311-manylinux_2_35_x86_64.whl
[06:35] [comfy-env] geometrypack-nodes: cuda-wheels deferred for post-pixi install (cumesh)
[06:37] [cuda-wheels] Looking up sageattention: cu128 torch2.10 cp311 manylinux linux
[06:37] [cuda-wheels] Found: sageattention-2.2.0+cu128torch2.10-cp311-cp311-manylinux_2_34_x86_64.manylinux_2_35_x86_64.whl
[06:39] [cuda-wheels] Looking up flash_attn: cu128 torch2.10 cp311 manylinux linux
[06:39] [cuda-wheels] Found: flash_attn-2.8.3+cu128torch2.10-cp311-cp311-manylinux_2_24_x86_64.manylinux_2_28_x86_64.whl
[06:40] [comfy-env] moge2-nodes: cuda-wheels deferred for post-pixi install (sageattention, flash_attn)
[06:40] [cuda-wheels] Looking up gsplat: cu128 torch2.10 cp311 manylinux linux
[06:40] [cuda-wheels] Found: gsplat-1.5.3+cu128torch2.10-cp311-cp311-manylinux_2_34_x86_64.manylinux_2_35_x86_64.whl
[06:40] [comfy-env] sharp-nodes: cuda-wheels deferred for post-pixi install (gsplat)
[06:41] Generated /tmp/comfytest-home/.ce/pixi.toml
[06:41] [comfy-env] Installing 5 environment(s):
[06:41] - gaussianpack-nodes (python=host, 8 pypi deps, 1 cuda wheels)
[06:41] - geometrypack-nodes (python=host, 14 pypi deps, 1 cuda wheels)
[06:41] - moge2-nodes (python=host, 12 pypi deps, 2 cuda wheels)
[06:41] - panopack-nodes (python=host, 21 pypi deps)
[06:41] - sharp-nodes (python=host, 15 pypi deps, 1 cuda wheels)
[06:41] [comfy-env] Running `pixi install -e gaussianpack-nodes -e geometrypack-nodes -e moge2-nodes -e panopack-nodes -e sharp-nodes`...
[06:44] WARN Skipped running the post-link scripts because `run-post-link-scripts` = `false`
[06:44] - bin/.librsvg-pre-unlink.sh
[06:44] To enable them, run:
[06:44] pixi config set --local run-post-link-scripts insecure
[06:44] More info:
[06:44] https://pixi.sh/latest/reference/pixi_configuration/#run-post-link-scripts
[06:46] The following environments have been installed: gaussianpack-nodes, geometrypack-nodes, moge2-nodes, panopack-nodes, sharp-nodes.
[06:46] [comfy-env] gaussianpack-nodes: installing cuda-wheels with --no-deps (gsplat)
[06:46] Using Python 3.11.15 environment at: .pixi/envs/gaussianpack-nodes
[06:47] Resolved 1 package in 949ms
[06:47] Checked 1 package in 0.07ms
[06:47] [comfy-env] geometrypack-nodes: installing cuda-wheels with --no-deps (cumesh)
[06:47] Using Python 3.11.15 environment at: .pixi/envs/geometrypack-nodes
[06:48] Resolved 1 package in 765ms
[06:48] Downloading cumesh (22.8MiB)
[06:48] Downloaded cumesh
[06:49] Prepared 1 package in 444ms
[06:49] Installed 1 package in 3ms
[06:49] + cumesh==0.0.1+cu128torch2.10 (from https://github.com/PozzettiAndrea/cuda-wheels/releases/download/cumesh-latest/cumesh-0.0.1%2Bcu128torch2.10-cp311-cp311-manylinux_2_35_x86_64.whl)
[06:49] [comfy-env] moge2-nodes: installing cuda-wheels with --no-deps (sageattention, flash_attn)
[06:49] Using Python 3.11.15 environment at: .pixi/envs/moge2-nodes
[06:49] Checked 2 packages in 86ms
[06:49] [comfy-env] sharp-nodes: installing cuda-wheels with --no-deps (gsplat)
[06:49] Using Python 3.11.15 environment at: .pixi/envs/sharp-nodes
[06:50] Resolved 1 package in 1.09s
[06:50] Checked 1 package in 0.11ms
[06:51] [comfy-env] Recorded install hash 6fd28b8aa152 -> /tmp/comfytest-home/.ce/install.hash
[06:51] [comfy-env] Install log: /tmp/comfytest-home/.ce/install.log
[06:51]
[06:51] Installation complete!
[06:51]
[06:51] [requirements] Re-installing main package requirements...
[06:51] Installing requirements for ComfyUI-PanoPack...
[06:51] [comfy-env] _discover: scanning /workspaces/Sharp-2211/ComfyUI/custom_nodes
[06:52] [comfy-env] _discover: ComfyUI-GaussianPack -> gaussianpack-nodes (custom_nodes/ComfyUI-GaussianPack/nodes/comfy-env.toml)
[06:52] [comfy-env] _discover: ComfyUI-GeometryPack -> geometrypack-nodes (custom_nodes/ComfyUI-GeometryPack/nodes/comfy-env.toml)
[06:53] [comfy-env] _discover: ComfyUI-MoGe2 -> moge2-nodes (custom_nodes/ComfyUI-MoGe2/nodes/comfy-env.toml)
[06:53] [comfy-env] _discover: ComfyUI-PanoPack -> panopack-nodes (custom_nodes/ComfyUI-PanoPack/nodes/comfy-env.toml)
[06:53] [comfy-env] _discover: ComfyUI-Sharp -> sharp-nodes (custom_nodes/ComfyUI-Sharp/nodes/comfy-env.toml)
[06:53] [comfy-env] Workspace inputs unchanged (hash 6fd28b8aa152) -- skipping install. Delete /tmp/comfytest-home/.ce/install.hash to force.
[06:53]
[06:53] Installation complete!
[06:53] ComfyUI-MoGe2: exists
[06:53] ComfyUI-GeometryPack: exists
[06:53]
[06:53] [requirements] Re-installing main package requirements...
[06:53] Installing requirements for ComfyUI-Sharp...
[06:53] [comfy-env] _discover: scanning /workspaces/Sharp-2211/ComfyUI/custom_nodes
[06:53] [comfy-env] _discover: ComfyUI-GaussianPack -> gaussianpack-nodes (custom_nodes/ComfyUI-GaussianPack/nodes/comfy-env.toml)
[06:53] [comfy-env] _discover: ComfyUI-GeometryPack -> geometrypack-nodes (custom_nodes/ComfyUI-GeometryPack/nodes/comfy-env.toml)
[06:53] [comfy-env] _discover: ComfyUI-MoGe2 -> moge2-nodes (custom_nodes/ComfyUI-MoGe2/nodes/comfy-env.toml)
[06:53] [comfy-env] _discover: ComfyUI-PanoPack -> panopack-nodes (custom_nodes/ComfyUI-PanoPack/nodes/comfy-env.toml)
[06:53] [comfy-env] _discover: ComfyUI-Sharp -> sharp-nodes (custom_nodes/ComfyUI-Sharp/nodes/comfy-env.toml)
[06:53] [comfy-env] Workspace inputs unchanged (hash 6fd28b8aa152) -- skipping install. Delete /tmp/comfytest-home/.ce/install.hash to force.
[06:54]
[06:54] Installation complete!
[06:54] Installing 2 node dependency(ies)...
[06:54] ComfyUI-GaussianPack from PozzettiAndrea/ComfyUI-GaussianPack
[06:54] ComfyUI-GaussianPack already exists, skipping...
[06:54] ComfyUI-PanoPack from PozzettiAndrea/ComfyUI-PanoPack
[06:54] ComfyUI-PanoPack already exists, skipping...
[06:55] Installing validation endpoint...
[06:55] Cloning PozzettiAndrea/ComfyUI-validate-endpoint...
[06:55] Running: git clone --depth 1 https://x-access-token:***@github.com/PozzettiAndrea/ComfyUI-validate-endpoint.git /workspaces/Sharp-2211/ComfyUI/custom_nodes/ComfyUI-validate-endpoint
[06:56] CUDA packages absent (will mock): gsplat
[06:57] [INSTALL] PASSED
[06:57]
[06:57] [3/5] REGISTRATION
[06:58] ----------------------------------------
[06:58]
[DEBUG] server=None, api=None
[06:58]
Starting ComfyUI server...
[06:59] Starting ComfyUI server on port 41898...
[06:59] CUDA mock packages: gsplat
[07:00] Starting ComfyUI server on port 41898...
[07:00] Waiting for server to be ready (timeout: 600s)...
[07:03] [ComfyUI] [INFO] setup plugin alembic.autogenerate.schemas
[07:04] [ComfyUI] [INFO] setup plugin alembic.autogenerate.tables
[07:04] [ComfyUI] [INFO] setup plugin alembic.autogenerate.types
[07:04] [ComfyUI] [INFO] setup plugin alembic.autogenerate.constraints
[07:04] [ComfyUI] [INFO] setup plugin alembic.autogenerate.defaults
[07:05] [ComfyUI] [INFO] setup plugin alembic.autogenerate.comments
[07:05] [ComfyUI] [comfy-env] ComfyUI-PanoPack: 1 isolation env(s):
[07:05] [ComfyUI] [comfy-env] nodes -> /workspaces/Sharp-2211/ComfyUI/custom_nodes/ComfyUI-PanoPack/nodes
[07:05] [ComfyUI] [comfy-env] Workspace: /tmp/comfytest-home/.ce
[07:05] [ComfyUI] [comfy-env] env: /tmp/comfytest-home/.ce/.pixi/envs/panopack-nodes [OK]
[07:05] [ComfyUI] [comfy-env] prestartup complete
[07:05] [ComfyUI] [comfy-env] ComfyUI-MoGe2: 1 isolation env(s):
[07:05] [ComfyUI] [comfy-env] nodes -> /workspaces/Sharp-2211/ComfyUI/custom_nodes/ComfyUI-MoGe2/nodes
[07:05] [ComfyUI] [comfy-env] env: /tmp/comfytest-home/.ce/.pixi/envs/moge2-nodes [OK]
[07:05] [ComfyUI] [comfy-env] prestartup complete
[07:05] [ComfyUI] [comfy-env] ComfyUI-Sharp: 1 isolation env(s):
[07:05] [ComfyUI] [comfy-env] nodes -> /workspaces/Sharp-2211/ComfyUI/custom_nodes/ComfyUI-Sharp/nodes
[07:05] [ComfyUI] [comfy-env] env: /tmp/comfytest-home/.ce/.pixi/envs/sharp-nodes [OK]
[07:05] [ComfyUI] [comfy-env] prestartup complete
[07:05] [ComfyUI] [comfy-env] ComfyUI-GeometryPack: 1 isolation env(s):
[07:05] [ComfyUI] [comfy-env] nodes -> /workspaces/Sharp-2211/ComfyUI/custom_nodes/ComfyUI-GeometryPack/nodes
[07:05] [ComfyUI] [comfy-env] env: /tmp/comfytest-home/.ce/.pixi/envs/geometrypack-nodes [OK]
[07:05] [ComfyUI] [comfy-env] prestartup complete
[07:05] [ComfyUI] [INFO]
[07:05] [ComfyUI] Prestartup times for custom nodes:
[07:05] [ComfyUI] [INFO] 0.0 seconds: /workspaces/Sharp-2211/ComfyUI/custom_nodes/ComfyUI-MoGe2
[07:05] [ComfyUI] [INFO] 0.0 seconds: /workspaces/Sharp-2211/ComfyUI/custom_nodes/ComfyUI-Sharp
[07:05] [ComfyUI] [INFO] 0.0 seconds: /workspaces/Sharp-2211/ComfyUI/custom_nodes/ComfyUI-GaussianPack
[07:05] [ComfyUI] [INFO] 0.1 seconds: /workspaces/Sharp-2211/ComfyUI/custom_nodes/ComfyUI-GeometryPack
[07:05] [ComfyUI] [INFO] 0.2 seconds: /workspaces/Sharp-2211/ComfyUI/custom_nodes/ComfyUI-PanoPack
[07:05] [ComfyUI] [INFO]
[07:09] [ComfyUI] [WARNING] WARNING: You need pytorch with cu130 or higher to use optimized CUDA operations.
[07:09] [ComfyUI] [INFO] Found comfy_kitchen backend eager: {'available': True, 'disabled': False, 'unavailable_reason': None, 'capabilities': ['apply_rope', 'apply_rope1', 'apply_rope_split_half', 'apply_rope_split_half1', 'dequantize_mxfp8', 'dequantize_nvfp4', 'dequantize_per_tensor_fp8', 'gemv_awq_w4a16', 'quantize_mxfp8', 'quantize_nvfp4', 'quantize_per_tensor_fp8', 'quantize_svdquant_w4a4', 'scaled_mm_mxfp8', 'scaled_mm_nvfp4', 'scaled_mm_svdquant_w4a4', 'stochastic_rounding_fp8']}
[07:09] [ComfyUI] [INFO] Found comfy_kitchen backend triton: {'available': True, 'disabled': True, 'unavailable_reason': None, 'capabilities': ['apply_rope', 'apply_rope1', 'apply_rope_split_half', 'apply_rope_split_half1', 'dequantize_nvfp4', 'dequantize_per_tensor_fp8', 'quantize_mxfp8', 'quantize_nvfp4', 'quantize_per_tensor_fp8']}
[07:09] [ComfyUI] [INFO] Found comfy_kitchen backend cuda: {'available': True, 'disabled': True, 'unavailable_reason': None, 'capabilities': ['apply_rope', 'apply_rope1', 'apply_rope_split_half', 'apply_rope_split_half1', 'dequantize_nvfp4', 'dequantize_per_tensor_fp8', 'gemv_awq_w4a16', 'quantize_mxfp8', 'quantize_nvfp4', 'quantize_per_tensor_fp8', 'quantize_svdquant_w4a4', 'scaled_mm_svdquant_w4a4', 'stochastic_rounding_fp8']}
[07:09] [ComfyUI] [INFO] Checkpoint files will always be loaded safely.
[07:09] [ComfyUI] [INFO] Total VRAM 24122 MB, total RAM 32010 MB
[07:09] [ComfyUI] [INFO] pytorch version: 2.10.0+cu128
[07:09] [ComfyUI] [INFO] Set vram state to: NORMAL_VRAM
[07:09] [ComfyUI] [INFO] Device: cuda:0 NVIDIA GeForce RTX 3090 : cudaMallocAsync
[07:09] [ComfyUI] [INFO] Using async weight offloading with 2 streams
[07:09] [ComfyUI] [INFO] Enabled pinned memory 28809.0
[07:09] [ComfyUI] [INFO] working around nvidia conv3d memory bug.
[07:09] [ComfyUI] [INFO] Using pytorch attention
[07:13] [ComfyUI] aimdo: /project/src-posix/cuda-funchooks.c:52:DEBUG:aimdo_setup_hooks: hooks successfully installed
[07:13] [ComfyUI] aimdo: /project/src/control.c:240:INFO:comfy-aimdo inited for GPU: NVIDIA GeForce RTX 3090 (VRAM: 24122 MB)
[07:13] [ComfyUI] [INFO] DynamicVRAM support detected and enabled
[07:13] [ComfyUI] [INFO] Python version: 3.11.15 (main, Jun 2 2026, 22:26:03) [Clang 22.1.3 ]
[07:13] [ComfyUI] [INFO] ComfyUI version: 0.24.0
[07:13] [ComfyUI] [INFO] comfy-aimdo version: 0.4.9
[07:13] [ComfyUI] [INFO] comfy-kitchen version: 0.2.10
[07:13] [ComfyUI] [WARNING] ****** User settings have been changed to be stored on the server instead of browser storage. ******
[07:13] [ComfyUI] [WARNING] ****** For multi-user setups add the --multi-user CLI argument to enable multiple user profiles. ******
[07:13] [ComfyUI] [INFO] comfyui-frontend-package version: 1.45.15
[07:13] [ComfyUI] [INFO] comfyui-workflow-templates version: 0.9.98
[07:13] [ComfyUI] [INFO] comfyui-embedded-docs version: 0.5.2
[07:13] [ComfyUI] [INFO] comfy-kitchen version: 0.2.10
[07:13] [ComfyUI] [INFO] comfy-aimdo version: 0.4.9
[07:13] [ComfyUI] [INFO] [Prompt Server] web root: /workspaces/Sharp-2211/.venv/lib/python3.11/site-packages/comfyui_frontend_package/static
[07:13] [ComfyUI] [INFO] Asset seeder disabled
[07:15] [ComfyUI] [comfy-env] Version: 0.3.89
[07:15] [ComfyUI] [comfy-env] register_nodes: ComfyUI-PanoPack
[07:16] [ComfyUI] [comfy-env] ComfyUI source dir: /workspaces/Sharp-2211/ComfyUI
[07:16] [ComfyUI] [comfy-env] Found 1 isolation env(s)
[07:16] [ComfyUI] [comfy-env] Scanning nodes metadata (isolation root)...
[07:16] [ComfyUI] [comfy-env] Metadata scan: /tmp/comfytest-home/.pixi/bin/pixi run --as-is --manifest-path /tmp/comfytest-home/.ce/pixi.toml -e panopack-nodes python /tmp/comfy_meta_ja_x7olb.py /workspaces/Sharp-2211/ComfyUI/custom_nodes/ComfyUI-PanoPack nodes /tmp/comfy_meta_out_xy0negiy.pkl
[07:17] [ComfyUI] [comfy-env] Scan env PATH for nodes:
[07:17] [ComfyUI] [comfy-env] [0] /tmp/comfytest-tools/bin
[07:17] [ComfyUI] [comfy-env] [1] /opt/uv/bin
[07:17] [ComfyUI] [comfy-env] [2] /usr/local/sbin
[07:17] [ComfyUI] [comfy-env] [3] /usr/local/bin
[07:17] [ComfyUI] [comfy-env] [4] /usr/sbin
[07:17] [ComfyUI] [comfy-env] [5] /usr/bin
[07:17] [ComfyUI] [comfy-env] [6] /sbin
[07:17] [ComfyUI] [comfy-env] [7] /bin
[07:19] [ComfyUI] [comfy-env] Metadata scan stderr for nodes:
[07:19] [ComfyUI] [comfy-env] [meta-scan] importing nodes from /workspaces/Sharp-2211/ComfyUI/custom_nodes/ComfyUI-PanoPack
[07:19] [ComfyUI] [comfy-env] [meta-scan] import OK
[07:19] [ComfyUI] [comfy-env] Scanned nodes: 15 nodes (4.3s)
[07:19] [ComfyUI] [comfy-env] Scanned nodes root: 15 nodes (4.3s)
[07:19] [ComfyUI] [comfy-env] Imported nodes root: 15 nodes (isolation)
[07:19] [ComfyUI] [comfy-env] Registered 15 total nodes
[07:19] [ComfyUI] [comfy-env] Version: 0.3.89
[07:19] [ComfyUI] [comfy-env] register_nodes: ComfyUI-MoGe2
[07:19] [ComfyUI] [comfy-env] ComfyUI source dir: /workspaces/Sharp-2211/ComfyUI
[07:19] [ComfyUI] [comfy-env] Found 1 isolation env(s)
[07:19] [ComfyUI] [comfy-env] Scanning nodes metadata (isolation root)...
[07:19] [ComfyUI] [comfy-env] Metadata scan: /tmp/comfytest-home/.pixi/bin/pixi run --as-is --manifest-path /tmp/comfytest-home/.ce/pixi.toml -e moge2-nodes python /tmp/comfy_meta_3vb3p9eo.py /workspaces/Sharp-2211/ComfyUI/custom_nodes/ComfyUI-MoGe2 nodes /tmp/comfy_meta_out_zojthgid.pkl
[07:19] [ComfyUI] [comfy-env] Scan env PATH for nodes:
[07:19] [ComfyUI] [comfy-env] [0] /tmp/comfytest-tools/bin
[07:19] [ComfyUI] [comfy-env] [1] /opt/uv/bin
[07:19] [ComfyUI] [comfy-env] [2] /usr/local/sbin
[07:19] [ComfyUI] [comfy-env] [3] /usr/local/bin
[07:19] [ComfyUI] [comfy-env] [4] /usr/sbin
[07:19] [ComfyUI] [comfy-env] [5] /usr/bin
[07:19] [ComfyUI] [comfy-env] [6] /sbin
[07:20] [ComfyUI] [comfy-env] [7] /bin
[07:22] [ComfyUI] [comfy-env] Metadata scan stderr for nodes:
[07:22] [ComfyUI] [comfy-env] [meta-scan] importing nodes from /workspaces/Sharp-2211/ComfyUI/custom_nodes/ComfyUI-MoGe2
[07:22] [ComfyUI] [comfy-env] ERROR:root:Failed to import comfy_kitchen, Error: No module named 'comfy_kitchen', fp8 and fp4 support will not be available.
[07:22] [ComfyUI] [comfy-env] WARNING:root:comfy_kitchen does not support stochastic FP8 rounding, please update comfy_kitchen.
[07:22] [ComfyUI] [comfy-env] [meta-scan] import OK
[07:22] [ComfyUI] [comfy-env] Scanned nodes: 3 nodes (2.5s)
[07:22] [ComfyUI] [comfy-env] Scanned nodes root: 3 nodes (2.5s)
[07:22] [ComfyUI] [comfy-env] Imported nodes root: 3 nodes (isolation)
[07:22] [ComfyUI] [comfy-env] Registered 3 total nodes
[07:22] [ComfyUI] [comfy-env] Version: 0.3.89
[07:22] [ComfyUI] [comfy-env] register_nodes: ComfyUI-Sharp
[07:22] [ComfyUI] [comfy-env] ComfyUI source dir: /workspaces/Sharp-2211/ComfyUI
[07:22] [ComfyUI] [comfy-env] Found 1 isolation env(s)
[07:22] [ComfyUI] [comfy-env] Scanning nodes metadata (isolation root)...
[07:22] [ComfyUI] [comfy-env] Metadata scan: /tmp/comfytest-home/.pixi/bin/pixi run --as-is --manifest-path /tmp/comfytest-home/.ce/pixi.toml -e sharp-nodes python /tmp/comfy_meta_eqgjtvqh.py /workspaces/Sharp-2211/ComfyUI/custom_nodes/ComfyUI-Sharp nodes /tmp/comfy_meta_out_kgze_d88.pkl
[07:22] [ComfyUI] [comfy-env] Scan env PATH for nodes:
[07:22] [ComfyUI] [comfy-env] [0] /tmp/comfytest-tools/bin
[07:22] [ComfyUI] [comfy-env] [1] /opt/uv/bin
[07:22] [ComfyUI] [comfy-env] [2] /usr/local/sbin
[07:22] [ComfyUI] [comfy-env] [3] /usr/local/bin
[07:22] [ComfyUI] [comfy-env] [4] /usr/sbin
[07:22] [ComfyUI] [comfy-env] [5] /usr/bin
[07:22] [ComfyUI] [comfy-env] [6] /sbin
[07:22] [ComfyUI] [comfy-env] [7] /bin
[07:25] [ComfyUI] [comfy-env] Metadata scan stderr for nodes:
[07:25] [ComfyUI] [comfy-env] [meta-scan] importing nodes from /workspaces/Sharp-2211/ComfyUI/custom_nodes/ComfyUI-Sharp
[07:25] [ComfyUI] [comfy-env] [meta-scan] import OK
[07:25] [ComfyUI] [comfy-env] Scanned nodes: 17 nodes (2.9s)
[07:25] [ComfyUI] [comfy-env] Scanned nodes root: 17 nodes (2.9s)
[07:25] [ComfyUI] [comfy-env] Imported nodes root: 17 nodes (isolation)
[07:25] [ComfyUI] [comfy-env] Registered 17 total nodes
[07:25] [ComfyUI] [comfy-env] Version: 0.3.89
[07:25] [ComfyUI] [comfy-env] register_nodes: ComfyUI-GaussianPack
[07:25] [ComfyUI] [comfy-env] ComfyUI source dir: /workspaces/Sharp-2211/ComfyUI
[07:25] [ComfyUI] [comfy-env] Found 1 isolation env(s)
[07:25] [ComfyUI] [comfy-env] Scanning nodes metadata (isolation root)...
[07:25] [ComfyUI] [comfy-env] Metadata scan: /tmp/comfytest-home/.pixi/bin/pixi run --as-is --manifest-path /tmp/comfytest-home/.ce/pixi.toml -e gaussianpack-nodes python /tmp/comfy_meta_rrcj2s9m.py /workspaces/Sharp-2211/ComfyUI/custom_nodes/ComfyUI-GaussianPack nodes /tmp/comfy_meta_out_12z_10og.pkl
[07:25] [ComfyUI] [comfy-env] Scan env PATH for nodes:
[07:25] [ComfyUI] [comfy-env] [0] /tmp/comfytest-tools/bin
[07:25] [ComfyUI] [comfy-env] [1] /opt/uv/bin
[07:25] [ComfyUI] [comfy-env] [2] /usr/local/sbin
[07:25] [ComfyUI] [comfy-env] [3] /usr/local/bin
[07:25] [ComfyUI] [comfy-env] [4] /usr/sbin
[07:25] [ComfyUI] [comfy-env] [5] /usr/bin
[07:25] [ComfyUI] [comfy-env] [6] /sbin
[07:25] [ComfyUI] [comfy-env] [7] /bin
[07:27] [ComfyUI] [comfy-env] Metadata scan stderr for nodes:
[07:28] [ComfyUI] [comfy-env] [meta-scan] importing nodes from /workspaces/Sharp-2211/ComfyUI/custom_nodes/ComfyUI-GaussianPack
[07:28] [ComfyUI] [comfy-env] SPZ route not registered (ModuleNotFoundError: No module named 'comfy_aimdo')
[07:28] [ComfyUI] [comfy-env] [meta-scan] import OK
[07:28] [ComfyUI] [comfy-env] Scanned nodes: 11 nodes (2.6s)
[07:28] [ComfyUI] [comfy-env] Scanned nodes root: 11 nodes (2.6s)
[07:28] [ComfyUI] [comfy-env] Imported nodes root: 11 nodes (isolation)
[07:28] [ComfyUI] [comfy-env] Registered 11 total nodes
[07:28] [ComfyUI] [INFO] loading...
[07:28] [ComfyUI] [INFO] calling register_nodes
[07:28] [ComfyUI] [comfy-env] Version: 0.3.89
[07:28] [ComfyUI] [comfy-env] register_nodes: ComfyUI-GeometryPack
[07:28] [ComfyUI] [comfy-env] ComfyUI source dir: /workspaces/Sharp-2211/ComfyUI
[07:28] [ComfyUI] [comfy-env] Found 1 isolation env(s)
[07:28] [ComfyUI] [comfy-env] Scanning nodes metadata (isolation root)...
[07:28] [ComfyUI] [comfy-env] Metadata scan: /tmp/comfytest-home/.pixi/bin/pixi run --as-is --manifest-path /tmp/comfytest-home/.ce/pixi.toml -e geometrypack-nodes python /tmp/comfy_meta_0yrqllpb.py /workspaces/Sharp-2211/ComfyUI/custom_nodes/ComfyUI-GeometryPack nodes /tmp/comfy_meta_out_d5s2bpz9.pkl
[07:28] [ComfyUI] [comfy-env] Scan env PATH for nodes:
[07:28] [ComfyUI] [comfy-env] [0] /tmp/comfytest-tools/bin
[07:28] [ComfyUI] [comfy-env] [1] /opt/uv/bin
[07:28] [ComfyUI] [comfy-env] [2] /usr/local/sbin
[07:28] [ComfyUI] [comfy-env] [3] /usr/local/bin
[07:28] [ComfyUI] [comfy-env] [4] /usr/sbin
[07:28] [ComfyUI] [comfy-env] [5] /usr/bin
[07:28] [ComfyUI] [comfy-env] [6] /sbin
[07:28] [ComfyUI] [comfy-env] [7] /bin
[07:31] [ComfyUI] [comfy-env] Metadata scan stderr for nodes:
[07:31] [ComfyUI] [comfy-env] [meta-scan] importing nodes from /workspaces/Sharp-2211/ComfyUI/custom_nodes/ComfyUI-GeometryPack
[07:31] [ComfyUI] [comfy-env] ERROR:root:Failed to import comfy_kitchen, Error: No module named 'comfy_kitchen', fp8 and fp4 support will not be available.
[07:31] [ComfyUI] [comfy-env] WARNING:root:comfy_kitchen does not support stochastic FP8 rounding, please update comfy_kitchen.
[07:31] [ComfyUI] [comfy-env] [meta-scan] import OK
[07:31] [ComfyUI] [comfy-env] Scanned nodes: 125 nodes (3.5s)
[07:31] [ComfyUI] [comfy-env] Scanned nodes root: 125 nodes (3.5s)
[07:31] [ComfyUI] [comfy-env] Imported nodes root: 125 nodes (isolation)
[07:31] [ComfyUI] [comfy-env] Registered 125 total nodes
[07:31] [ComfyUI] [INFO]
[07:31] [ComfyUI] Import times for custom nodes:
[07:31] [ComfyUI] [INFO] 0.0 seconds: /workspaces/Sharp-2211/ComfyUI/custom_nodes/ComfyUI-validate-endpoint
[07:31] [ComfyUI] [INFO] 0.0 seconds: /workspaces/Sharp-2211/ComfyUI/custom_nodes/websocket_image_save.py
[07:31] [ComfyUI] [INFO] 2.5 seconds: /workspaces/Sharp-2211/ComfyUI/custom_nodes/ComfyUI-MoGe2
[07:31] [ComfyUI] [INFO] 2.6 seconds: /workspaces/Sharp-2211/ComfyUI/custom_nodes/ComfyUI-GaussianPack
[07:31] [ComfyUI] [INFO] 2.9 seconds: /workspaces/Sharp-2211/ComfyUI/custom_nodes/ComfyUI-Sharp
[07:31] [ComfyUI] [INFO] 3.6 seconds: /workspaces/Sharp-2211/ComfyUI/custom_nodes/ComfyUI-GeometryPack
[07:31] [ComfyUI] [INFO] 4.6 seconds: /workspaces/Sharp-2211/ComfyUI/custom_nodes/ComfyUI-PanoPack
[07:31] [ComfyUI] [INFO]
[07:31] [ComfyUI] [INFO] Context impl SQLiteImpl.
[07:31] [ComfyUI] [INFO] Will assume non-transactional DDL.
[07:31] [ComfyUI] [INFO] Context impl SQLiteImpl.
[07:31] [ComfyUI] [INFO] Will assume non-transactional DDL.
[07:31] [ComfyUI] [INFO] Running upgrade -> 0001_assets, Initial assets schema
[07:31] [ComfyUI] Revision ID: 0001_assets
[07:31] [ComfyUI] Revises: None
[07:31] [ComfyUI] Create Date: 2025-12-10 00:00:00
[07:31] [ComfyUI] [INFO] Running upgrade 0001_assets -> 0002_merge_to_asset_references, Merge AssetInfo and AssetCacheState into unified asset_references table.
[07:32] [ComfyUI] [INFO] Running upgrade 0002_merge_to_asset_references -> 0003_add_metadata_job_id, Add system_metadata and job_id columns to asset_references.
[07:32] [ComfyUI] Change preview_id FK from assets.id to asset_references.id.
[07:32] [ComfyUI] [INFO] Database upgraded from None to 0003_add_metadata_job_id
[07:32] [ComfyUI] [INFO] Using RAM pressure cache.
[07:32] [ComfyUI] [INFO] Starting server
[07:32] [ComfyUI]
[07:32] [ComfyUI] [INFO] To see the GUI go to: http://127.0.0.1:41898
[07:32] Server responding, waiting for nodes to load...
[07:52] Server is ready!
[07:52] Checking for import errors in server logs...
[07:52] No import errors detected
[07:52] Found 942 registered nodes
[07:52] [REGISTRATION] PASSED
[07:52]
[07:52] [4/5] INSTANTIATION
[07:52] ----------------------------------------
[07:52]
[DEBUG] server=<comfy_test.comfyui.server.ComfyUIServer object at 0x7cf3fcc56110>, api=<comfy_test.comfyui.api.ComfyUIAPI object at 0x7cf3fcb889a0>
[07:52] Testing node constructors...
[07:52] All 17 node(s) instantiated successfully!
[07:52] [INSTANTIATION] PASSED
[07:52]
[07:52] [5/5] EXECUTION
[07:52] ----------------------------------------
[07:52]
[DEBUG] server=<comfy_test.comfyui.server.ComfyUIServer object at 0x7cf3fcc56110>, api=<comfy_test.comfyui.api.ComfyUIAPI object at 0x7cf3fcb889a0>
[07:52] GPU runner - will execute 4 workflow(s)
[07:52] Running 4 workflow(s) (all with videos)...
[07:52] Installing screenshot dependencies (playwright, pillow)...
[07:54] Packages installed, downloading chromium browser...
[08:09] Screenshot dependencies installed successfully
[08:10] Starting headless browser...
[08:10] Installing Vulkan stack (apt)...
[08:10] Vulkan install error: [Errno 2] No such file or directory: 'sudo'
[08:10] GPU detected (no Vulkan) -- using ANGLE/OpenGL rendering
[08:10] [ComfyUI] [INFO] Using RAM pressure cache.
[08:10] Capturing execution frames: pano.json
[08:10] [ComfyUI] [INFO] Using RAM pressure cache.
[08:16] Frame 1 saved (frame_000.jpg, t=0.0s)
[08:16] Validating workflow...
[08:16] [ComfyUI] [INFO] === /validate endpoint called ===
[08:16] Queuing workflow for execution...
[08:16] [ComfyUI] [INFO] Received JSON with keys: ['prompt']
[08:16] [ComfyUI] [INFO] Prompt has 18 nodes
[08:16] [ComfyUI] [INFO] Node 7: LoadImage
[08:16] [ComfyUI] [INFO] Inputs: {"image": "pano.png"}
[08:16] [ComfyUI] [INFO] Node 9: LoadSharpModel
[08:16] [ComfyUI] [INFO] Inputs: {"precision": "auto"}
[08:16] [ComfyUI] [INFO] Node 54: MergeGaussians
[08:16] [ComfyUI] [INFO] Inputs: {"ply_folder": ["76", 0], "output_prefix": "merged", "max_depth": 0, "min_opacity": 0}
[08:16] [ComfyUI] [INFO] Node 59: PanoramaWrap
[08:16] [ComfyUI] [comfy-env] SubprocessWorker: /tmp/comfytest-home/.ce/.pixi/envs/sharp-nodes/bin/python
[08:16] [ComfyUI] [INFO] Inputs: {"image": ["7", 0]}
[08:16] [ComfyUI] [comfy-env] env_vars: {'COMFYUI_BASE': '/workspaces/Sharp-2211/ComfyUI'}
[08:16] [ComfyUI] [INFO] Node 60: PanoramaDepthMerge
[08:16] [ComfyUI] [ComfyUI-Sharp] python: /tmp/comfytest-home/.ce/.pixi/envs/sharp-nodes/bin/python
[08:16] [ComfyUI] [INFO] Inputs: {"out_width": ["61", 0], "out_height": ["61", 1], "use_gpu": true, "scale_anchor": false, "chunk_size": 8, "center_weight_power": 2, "normal_edge_threshold_deg": 0, "normal_consistency_boost": false,
[08:16] [ComfyUI] [ComfyUI-Sharp] sys_path sent to worker: ['/workspaces/Sharp-2211/ComfyUI', '/workspaces/Sharp-2211/ComfyUI/custom_nodes/ComfyUI-Sharp', '/tmp/comfytest-home/.ce/.pixi/envs/sharp-nodes/lib/python3.1/site-packages', '/workspaces/Sharp-2211/ComfyUI/custom_nodes/ComfyUI-Sharp']
[08:16] [ComfyUI] [INFO] Node 61: GetImageSize
[08:16] [ComfyUI] [SubprocessWorker] is_pixi=True, python=/tmp/comfytest-home/.ce/.pixi/envs/sharp-nodes/bin/python
[08:16] [ComfyUI] [INFO] Inputs: {"image": ["7", 0]}
[08:16] [ComfyUI] [SubprocessWorker] launching cmd=['/tmp/comfytest-home/.pixi/bin/pixi', 'run', '--as-is', '--manifest-path', '/tmp/comfytest-home/.ce/pixi.toml', '-e', 'sharp-nodes', 'python', '/tmp/comfyui_pvenv_xcjd5ki2/persistent_worker.py', 'abstract://comfy_worker_9a34a9169d7b']...
[08:16] [ComfyUI] [INFO] Node 62: PreviewImage
[08:16] [ComfyUI] [SubprocessWorker] socket_addr=abstract://comfy_worker_9a34a9169d7b (abstract, no filesystem path)
[08:16] [ComfyUI] [INFO] Inputs: {"images": ["60", 2]}
[08:16] [ComfyUI] [INFO] Node 68: PreviewImage
[08:16] [ComfyUI] [INFO] Inputs: {"images": ["96", 0]}
[08:16] [ComfyUI] [INFO] Node 70: PreviewImage
[08:16] [ComfyUI] [INFO] Inputs: {"images": ["81", 0]}
[08:16] [ComfyUI] [INFO] Node 73: SharpRayToPlanarDepth
[08:16] [ComfyUI] [INFO] Inputs: {"image": ["87", 1], "intrinsics": ["87", 4], "extrinsics": ["87", 3]}
[08:16] [ComfyUI] [INFO] Node 76: SharpPredictGaussiansFromMetricDepth
[08:16] [ComfyUI] [INFO] Inputs: {"snap_to_external_depth": "none", "depth_convention": "planar_z", "focal_length_mm": 30, "output_prefix": "sharp_aligned", "save_background_layer": true, "edge_crop": 0, "model": ["9", 0], "image": [
[08:16] [ComfyUI] [INFO] Node 78: TransformGaussian
[08:16] [ComfyUI] [INFO] Inputs: {"rotate_x": -90, "rotate_y": 0, "rotate_z": 0, "ply_path": ["54", 1]}
[08:16] [ComfyUI] [INFO] Node 80: DownloadAndLoadMoGe2Model
[08:16] [ComfyUI] [INFO] Inputs: {"model": "moge-2-vitl-normal.pt", "precision": "auto", "attention": "auto"}
[08:16] [ComfyUI] [INFO] Node 81: MoGe2Inference
[08:16] [ComfyUI] [INFO] Inputs: {"resolution_level": 9, "num_tokens": 0, "fov_x_deg": ["96", 3], "force_projection": true, "apply_mask": true, "moge2_model": ["80", 0], "images": ["96", 0]}
[08:16] [ComfyUI] [INFO] Node 87: PanoramaSplitAdaptive
[08:16] [ComfyUI] [INFO] Inputs: {"split_method": "icosahedron_42", "resolution": 1536, "fov_degrees": 90, "use_gpu": true, "create_masks": true, "mask_method": "closest_to", "panorama": ["59", 0], "depth_panorama": ["60", 0], "norma
[08:16] [ComfyUI] [INFO] Node 89: PreviewImage
[08:16] [ComfyUI] [INFO] Inputs: {"images": ["87", 8]}
[08:16] [ComfyUI] [INFO] Node 95: PreviewGaussians
[08:16] [ComfyUI] [INFO] Inputs: {"camera_mode": "orbit", "fov_degrees": 71, "renderer": "playcanvas", "transport_format": "ply", "ply_path": ["78", 0]}
[08:16] [ComfyUI] [INFO] Node 96: PanoramaSplit
[08:16] [ComfyUI] [INFO] Inputs: {"split_method": "icosahedron_42", "resolution": 952, "fov_degrees": 90, "use_gpu": true, "create_masks": false, "fname": "pano_bank", "panorama": ["59", 0]}
[08:16] [ComfyUI] [INFO] Generated prompt_id: c9a2e738-7bd5-458c-a805-4696e5968a47
[08:16] [ComfyUI] [INFO] Calling execution.validate_prompt()...
[08:16] [ComfyUI] [INFO] Validation result: valid=True
[08:16] [ComfyUI] [INFO] === Validation PASSED ===
[08:16] [ComfyUI] [INFO] got prompt
[08:16] [ComfyUI] [comfy-env] Running LoadSharpModel: precision: 'auto'
[08:16] [ComfyUI] [VRAM] Before LoadSharpModel: 697 / 24122 MB
[08:16] [ComfyUI] [SubprocessWorker] call_method: nodes.load_model.LoadSharpModel.EXECUTE_NORMALIZED
[08:16] [ComfyUI] [SubprocessWorker] acquired lock, ensuring started...
[08:17] [ComfyUI] [worker:ComfyUI-Sharp] ERROR: Failed to import comfy_kitchen, Error: No module named 'comfy_kitchen', fp8 and fp4 support will not be available.
[08:17] [ComfyUI] [worker:ComfyUI-Sharp] WARNING: comfy_kitchen does not support stochastic FP8 rounding, please update comfy_kitchen.
[08:18] [ComfyUI] [SubprocessWorker] worker started/confirmed
[08:18] [ComfyUI] [SubprocessWorker] serializing kwargs to shm...
[08:18] [ComfyUI] [SubprocessWorker] created 0 shm blocks
[08:18] [ComfyUI] [SubprocessWorker] sending request via socket...
[08:18] [ComfyUI] [SubprocessWorker] call_id=1 sending call_method
[08:18] [ComfyUI] [worker:ComfyUI-Sharp] [LoadSharpModel] precision='auto' -> dtype=bf16 (device=cuda:0)
[08:18] [ComfyUI] [worker:ComfyUI-Sharp] [LoadSharpModel] checkpoint not found — downloading from HuggingFace repo 'apple/Sharp' file 'sharp_2572gikvuh.pt' -> /workspaces/Sharp-2211/ComfyUI/models/sharp
[08:18] [ComfyUI] Warning: You are sending unauthenticated requests to the HF Hub. Please set a HF_TOKEN to enable higher rate limits and faster downloads.
[08:18] [ComfyUI] [worker:ComfyUI-Sharp] WARNING: Warning: You are sending unauthenticated requests to the HF Hub. Please set a HF_TOKEN to enable higher rate limits and faster downloads.
[08:18] [ComfyUI]
[08:18] Frame 2 saved (frame_001.jpg, t=2.3s)
[08:19] [capture-periodic] freeze=1ms shot=105ms unfreeze=5ms saved=True
[08:21] Frame 3 saved (frame_002.jpg, t=4.5s)
[08:21] [capture-periodic] freeze=2ms shot=134ms unfreeze=4ms saved=True
[08:22] [capture-loop] iter=50 t=5.6s state={'complete': False, 'error': None, 'executedCount': 0, 'wsState': 1} eval_ms=2 ram=5.2/31.3GB (17%) swap=1.9/32.0GB (6%) cpu=9% browser_rss=0.99GB
[08:26] [ComfyUI] sharp_2572gikvuh.pt: 0%| | 0.00/2.81G [00:00<?, ?B/s]
[08:26] [ComfyUI] sharp_2572gikvuh.pt: 13%|█▎ | 359M/2.81G [00:07<00:49, 49.5MB/s][SubprocessWorker] callback 'report_progress' from call_id=1
[08:27] [ComfyUI]
[08:27] [ComfyUI] sharp_2572gikvuh.pt: 18%|█▊ | 494M/2.81G [00:08<00:38, 60.9MB/s][SubprocessWorker] callback 'report_progress' from call_id=1
[08:27] [capture-loop] iter=100 t=11.0s state={'complete': False, 'error': None, 'executedCount': 0, 'wsState': 1} eval_ms=1 ram=5.4/31.3GB (17%) swap=1.9/32.0GB (6%) cpu=8% browser_rss=0.98GB
[08:27] Frame 4 saved (frame_003.jpg, t=11.1s)
[08:27] [capture-periodic] freeze=4ms shot=100ms unfreeze=1ms saved=True
[08:31] [ComfyUI]
[08:31] [ComfyUI] sharp_2572gikvuh.pt: 25%|██▍ | 695M/2.81G [00:13<00:40, 52.7MB/s][SubprocessWorker] callback 'report_progress' from call_id=1
[08:32] Frame 5 saved (frame_004.jpg, t=15.4s)
[08:32] [capture-periodic] freeze=1ms shot=96ms unfreeze=1ms saved=True
[08:33] [capture-loop] iter=150 t=16.5s state={'complete': False, 'error': None, 'executedCount': 0, 'wsState': 1} eval_ms=1 ram=5.8/31.3GB (19%) swap=1.9/32.0GB (6%) cpu=9% browser_rss=0.98GB
[08:35] [ComfyUI]
[08:35] [ComfyUI] sharp_2572gikvuh.pt: 30%|██▉ | 829M/2.81G [00:16<00:41, 47.6MB/s][SubprocessWorker] callback 'report_progress' from call_id=1
[08:36] [ComfyUI]
[08:36] [ComfyUI] sharp_2572gikvuh.pt: 37%|███▋ | 1.03G/2.81G [00:17<00:26, 67.2MB/s][SubprocessWorker] callback 'report_progress' from call_id=1
[08:36] Frame 6 saved (frame_005.jpg, t=19.8s)
[08:36] [capture-periodic] freeze=1ms shot=99ms unfreeze=1ms saved=True
[08:38] [ComfyUI]
[08:38] [ComfyUI] sharp_2572gikvuh.pt: 39%|███▉ | 1.10G/2.81G [00:19<00:29, 58.2MB/s][SubprocessWorker] callback 'report_progress' from call_id=1
[08:38] [capture-loop] iter=200 t=21.9s state={'complete': False, 'error': None, 'executedCount': 0, 'wsState': 1} eval_ms=1 ram=6.0/31.3GB (19%) swap=1.9/32.0GB (6%) cpu=9% browser_rss=0.99GB
[08:38] Frame 7 saved (frame_006.jpg, t=22.0s)
[08:38] [capture-periodic] freeze=1ms shot=98ms unfreeze=1ms saved=True
[08:39] [ComfyUI]
[08:39] [ComfyUI] sharp_2572gikvuh.pt: 41%|████▏ | 1.16G/2.81G [00:20<00:28, 57.3MB/s][SubprocessWorker] callback 'report_progress' from call_id=1
[08:40] Frame 8 saved (frame_007.jpg, t=24.2s)
[08:40] [capture-periodic] freeze=1ms shot=90ms unfreeze=5ms saved=True
[08:41] [ComfyUI]
[08:41] [ComfyUI] sharp_2572gikvuh.pt: 46%|████▌ | 1.30G/2.81G [00:22<00:24, 62.7MB/s][SubprocessWorker] callback 'report_progress' from call_id=1
[08:42] [ComfyUI]
[08:42] [ComfyUI] sharp_2572gikvuh.pt: 58%|█████▊ | 1.63G/2.81G [00:23<00:10, 113MB/s] [SubprocessWorker] callback 'report_progress' from call_id=1
[08:42] [ComfyUI]
[08:43] Frame 9 saved (frame_008.jpg, t=26.4s)
[08:43] [capture-periodic] freeze=1ms shot=113ms unfreeze=5ms saved=True
[08:43] [ComfyUI] sharp_2572gikvuh.pt: 72%|███████▏ | 2.04G/2.81G [00:24<00:03, 194MB/s][SubprocessWorker] callback 'report_progress' from call_id=1
[08:43] [ComfyUI]
[08:43] [ComfyUI] sharp_2572gikvuh.pt: 96%|█████████▋| 2.71G/2.81G [00:24<00:00, 384MB/s][SubprocessWorker] callback 'report_progress' from call_id=1
[08:43] [ComfyUI] [SubprocessWorker] callback 'report_progress' from call_id=1
[08:44] [capture-loop] iter=250 t=28.0s state={'complete': False, 'error': None, 'executedCount': 0, 'wsState': 1} eval_ms=2 ram=5.0/31.3GB (16%) swap=1.9/32.0GB (6%) cpu=10% browser_rss=0.92GB
[08:45] Frame 10 saved (frame_009.jpg, t=29.1s)
[08:46] [capture-periodic] freeze=2ms shot=128ms unfreeze=5ms saved=True
[08:50] [capture-loop] iter=300 t=34.1s state={'complete': False, 'error': None, 'executedCount': 0, 'wsState': 1} eval_ms=2 ram=4.9/31.3GB (16%) swap=1.9/32.0GB (6%) cpu=5% browser_rss=0.91GB
[08:56] [capture-loop] iter=350 t=39.5s state={'complete': False, 'error': None, 'executedCount': 0, 'wsState': 1} eval_ms=2 ram=4.9/31.3GB (16%) swap=1.9/32.0GB (6%) cpu=5% browser_rss=0.91GB
[08:58] [ComfyUI]
[09:00] [ComfyUI] sharp_2572gikvuh.pt: 100%|██████████| 2.81G/2.81G [00:40<00:00, 384MB/s]
[09:00] [ComfyUI] sharp_2572gikvuh.pt: 100%|██████████| 2.81G/2.81G [00:41<00:00, 67.0MB/s]
[09:00] [ComfyUI] [worker:ComfyUI-Sharp] [LoadSharpModel] checkpoint ready: /workspaces/Sharp-2211/ComfyUI/models/sharp/sharp_2572gikvuh.pt (2679.6 MB)
[09:00] [ComfyUI] [worker:ComfyUI-Sharp] [LoadSharpModel] config: precision=auto -> dtype=bf16
[09:00] [ComfyUI] [SubprocessWorker] got response: ok
[09:00] [ComfyUI] [comfy-env] SubprocessWorker: /tmp/comfytest-home/.ce/.pixi/envs/moge2-nodes/bin/python
[09:00] [ComfyUI] [comfy-env] LoadSharpModel done (44.05s): result: NodeOutput
[09:00] [ComfyUI] [comfy-env] env_vars: {'COMFYUI_BASE': '/workspaces/Sharp-2211/ComfyUI'}
[09:00] [ComfyUI] [VRAM] After LoadSharpModel: 959 / 24122 MB
[09:00] [ComfyUI] [ComfyUI-MoGe2] python: /tmp/comfytest-home/.ce/.pixi/envs/moge2-nodes/bin/python
[09:00] [ComfyUI] [comfy-env] Running DownloadAndLoadMoGe2Model: model: 'moge-2-vitl-normal.pt', precision: 'auto', attention: 'auto'
[09:00] [ComfyUI] [ComfyUI-MoGe2] sys_path sent to worker: ['/workspaces/Sharp-2211/ComfyUI', '/workspaces/Sharp-2211/ComfyUI/custom_nodes/ComfyUI-MoGe2', '/tmp/comfytest-home/.ce/.pixi/envs/moge2-nodes/lib/python3.1/site-packages', '/workspaces/Sharp-2211/ComfyUI/custom_nodes/ComfyUI-MoGe2']
[09:00] [ComfyUI] [VRAM] Before DownloadAndLoadMoGe2Model: 959 / 24122 MB
[09:00] [ComfyUI] [SubprocessWorker] is_pixi=True, python=/tmp/comfytest-home/.ce/.pixi/envs/moge2-nodes/bin/python
[09:00] [ComfyUI] [SubprocessWorker] call_method: nodes.load_model.DownloadAndLoadMoGe2Model.EXECUTE_NORMALIZED
[09:00] [ComfyUI] [SubprocessWorker] launching cmd=['/tmp/comfytest-home/.pixi/bin/pixi', 'run', '--as-is', '--manifest-path', '/tmp/comfytest-home/.ce/pixi.toml', '-e', 'moge2-nodes', 'python', '/tmp/comfyui_pvenv_ex649j74/persistent_worker.py', 'abstract://comfy_worker_0b184fc90454']...
[09:00] [ComfyUI] [SubprocessWorker] acquired lock, ensuring started...
[09:00] [ComfyUI] [SubprocessWorker] socket_addr=abstract://comfy_worker_0b184fc90454 (abstract, no filesystem path)
[09:01] Frame 11 saved (frame_010.jpg, t=44.6s)
[09:01] [capture-periodic] freeze=1ms shot=100ms unfreeze=5ms saved=True
[09:02] [capture-loop] iter=400 t=45.5s state={'complete': False, 'error': None, 'executedCount': 0, 'wsState': 1} eval_ms=2 ram=5.2/31.3GB (17%) swap=1.9/32.0GB (6%) cpu=6% browser_rss=0.92GB
[09:02] [ComfyUI] [worker:ComfyUI-MoGe2] ERROR: Failed to import comfy_kitchen, Error: No module named 'comfy_kitchen', fp8 and fp4 support will not be available.
[09:02] [ComfyUI] [worker:ComfyUI-MoGe2] WARNING: comfy_kitchen does not support stochastic FP8 rounding, please update comfy_kitchen.
[09:02] [ComfyUI] [SubprocessWorker] worker started/confirmed
[09:02] [ComfyUI] [SubprocessWorker] serializing kwargs to shm...
[09:02] [ComfyUI] [SubprocessWorker] created 0 shm blocks
[09:02] [ComfyUI] [SubprocessWorker] sending request via socket...
[09:02] [ComfyUI] [SubprocessWorker] call_id=1 sending call_method
[09:03] [ComfyUI] Warning: You are sending unauthenticated requests to the HF Hub. Please set a HF_TOKEN to enable higher rate limits and faster downloads.
[09:03] [ComfyUI] [worker:ComfyUI-MoGe2] WARNING: Warning: You are sending unauthenticated requests to the HF Hub. Please set a HF_TOKEN to enable higher rate limits and faster downloads.
[09:03] [ComfyUI]
[09:07] [capture-loop] iter=450 t=50.9s state={'complete': False, 'error': None, 'executedCount': 0, 'wsState': 1} eval_ms=2 ram=5.7/31.3GB (18%) swap=1.9/32.0GB (6%) cpu=9% browser_rss=0.92GB
[09:07] [ComfyUI] model.pt: 0%| | 0.00/1.32G [00:00<?, ?B/s]
[09:07] [ComfyUI] model.pt: 10%|█ | 134M/1.32G [00:04<00:42, 28.1MB/s][SubprocessWorker] callback 'report_progress' from call_id=1
[09:08] [ComfyUI]
[09:08] [ComfyUI] model.pt: 15%|█▌ | 201M/1.32G [00:05<00:25, 44.9MB/s][SubprocessWorker] callback 'report_progress' from call_id=1
[09:09] [ComfyUI]
[09:09] [ComfyUI] model.pt: 20%|██ | 268M/1.32G [00:06<00:22, 47.8MB/s][SubprocessWorker] callback 'report_progress' from call_id=1
[09:10] Frame 12 saved (frame_011.jpg, t=53.4s)
[09:10] [capture-periodic] freeze=1ms shot=102ms unfreeze=5ms saved=True
[09:12] [capture-loop] iter=500 t=56.4s state={'complete': False, 'error': None, 'executedCount': 0, 'wsState': 1} eval_ms=2 ram=6.1/31.3GB (19%) swap=1.9/32.0GB (6%) cpu=9% browser_rss=0.91GB
[09:13] [ComfyUI]
[09:13] [ComfyUI] model.pt: 46%|████▌ | 604M/1.32G [00:10<00:09, 72.2MB/s][SubprocessWorker] callback 'report_progress' from call_id=1
[09:14] Frame 13 saved (frame_012.jpg, t=57.7s)
[09:14] [capture-periodic] freeze=1ms shot=89ms unfreeze=6ms saved=True
[09:14] [ComfyUI]
[09:14] [ComfyUI] model.pt: 66%|██████▌ | 872M/1.32G [00:11<00:04, 99.0MB/s][SubprocessWorker] callback 'report_progress' from call_id=1
[09:14] [ComfyUI]
[09:14] [ComfyUI] model.pt: 86%|████████▌ | 1.14G/1.32G [00:11<00:01, 154MB/s][SubprocessWorker] callback 'report_progress' from call_id=1
[09:15] [ComfyUI]
[09:16] [ComfyUI] model.pt: 100%|██████████| 1.32G/1.32G [00:12<00:00, 197MB/s][SubprocessWorker] callback 'report_progress' from call_id=1
[09:16] Frame 14 saved (frame_013.jpg, t=59.9s)
[09:17] [capture-periodic] freeze=2ms shot=145ms unfreeze=13ms saved=True
[09:19] [capture-loop] iter=550 t=62.6s state={'complete': False, 'error': None, 'executedCount': 0, 'wsState': 1} eval_ms=2 ram=5.4/31.3GB (17%) swap=1.9/32.0GB (6%) cpu=8% browser_rss=0.91GB
[09:22] [ComfyUI]
[09:22] [ComfyUI] model.pt: 100%|██████████| 1.32G/1.32G [00:19<00:00, 68.2MB/s]
[09:22] [ComfyUI] [SubprocessWorker] got response: ok
[09:22] [ComfyUI] [comfy-env] DownloadAndLoadMoGe2Model done (21.82s): result: NodeOutput
[09:22] [ComfyUI] [VRAM] After DownloadAndLoadMoGe2Model: 1220 / 24122 MB
[09:22] [ComfyUI] [comfy-env] Running PanoramaWrap: image: torch.float32 [1,2048,4096,3] cpu
[09:22] [ComfyUI] [comfy-env] SubprocessWorker: /tmp/comfytest-home/.ce/.pixi/envs/panopack-nodes/bin/python
[09:22] [ComfyUI] [VRAM] Before PanoramaWrap: 1220 / 24122 MB
[09:22] [ComfyUI] [comfy-env] env_vars: {'COMFYUI_BASE': '/workspaces/Sharp-2211/ComfyUI'}
[09:22] [ComfyUI] [SubprocessWorker] call_method: nodes.panorama_type.PanoramaWrap.EXECUTE_NORMALIZED
[09:22] [ComfyUI] [ComfyUI-PanoPack] python: /tmp/comfytest-home/.ce/.pixi/envs/panopack-nodes/bin/python
[09:22] [ComfyUI] [SubprocessWorker] acquired lock, ensuring started...
[09:23] [ComfyUI] [ComfyUI-PanoPack] sys_path sent to worker: ['/workspaces/Sharp-2211/ComfyUI', '/workspaces/Sharp-2211/ComfyUI/custom_nodes/ComfyUI-PanoPack', '/tmp/comfytest-home/.ce/.pixi/envs/panopack-nodes/lib/python3.1/site-packages', '/workspaces/Sharp-2211/ComfyUI/custom_nodes/ComfyUI-PanoPack']
[09:23] [ComfyUI] [SubprocessWorker] is_pixi=True, python=/tmp/comfytest-home/.ce/.pixi/envs/panopack-nodes/bin/python
[09:23] [ComfyUI] [SubprocessWorker] launching cmd=['/tmp/comfytest-home/.pixi/bin/pixi', 'run', '--as-is', '--manifest-path', '/tmp/comfytest-home/.ce/pixi.toml', '-e', 'panopack-nodes', 'python', '/tmp/comfyui_pvenv_tqf5i7bh/persistent_worker.py', 'abstract://comfy_worker_e89dec27391c']...
[09:23] [ComfyUI] [SubprocessWorker] socket_addr=abstract://comfy_worker_e89dec27391c (abstract, no filesystem path)
[09:24] Frame 15 saved (frame_014.jpg, t=67.3s)
[09:24] [capture-periodic] freeze=1ms shot=100ms unfreeze=7ms saved=True
[09:24] [ComfyUI] [worker:ComfyUI-PanoPack] ERROR: Failed to import comfy_kitchen, Error: No module named 'comfy_kitchen', fp8 and fp4 support will not be available.
[09:24] [ComfyUI] [worker:ComfyUI-PanoPack] WARNING: comfy_kitchen does not support stochastic FP8 rounding, please update comfy_kitchen.
[09:24] [ComfyUI] [SubprocessWorker] worker started/confirmed
[09:24] [ComfyUI] [comfy-env] PRE-SERIALIZE 'image' shape: torch.Size([1, 2048, 4096, 3])
[09:24] [ComfyUI] [SubprocessWorker] serializing kwargs to shm...
[09:24] [ComfyUI] [SubprocessWorker] created 0 shm blocks
[09:24] [ComfyUI] [SubprocessWorker] sending request via socket...
[09:24] [ComfyUI] [SubprocessWorker] call_id=1 sending call_method
[09:24] [ComfyUI] [worker:ComfyUI-PanoPack] [comfy-env] _from_shm got dict with keys: ['__type__', 'strategy', 'parent_pid', 'fd', 'storage_size']
[09:24] [ComfyUI] [worker:ComfyUI-PanoPack] [comfy-env] DESERIALIZE TensorRef: tensor_size=[1, 2048, 4096, 3]
[09:24] [ComfyUI] [worker:ComfyUI-PanoPack] [comfy-env] DESERIALIZED tensor shape: torch.Size([1, 2048, 4096, 3])
[09:24] [ComfyUI] [SubprocessWorker] got response: ok
[09:24] [ComfyUI] [comfy-env] PanoramaWrap done (1.70s): result: NodeOutput
[09:24] [ComfyUI] [VRAM] After PanoramaWrap: 1481 / 24122 MB
[09:24] [ComfyUI] [comfy-env] Running PanoramaSplit: split_method: dict, resolution: 952, fov_degrees: 90.0, use_gpu: True, create_masks: False, fname: 'pano_bank', panorama: dict
[09:24] [ComfyUI] [VRAM] Before PanoramaSplit: 1481 / 24122 MB
[09:24] [ComfyUI] [SubprocessWorker] call_method: nodes.panorama_split.PanoramaSplit.EXECUTE_NORMALIZED
[09:24] [ComfyUI] [SubprocessWorker] acquired lock, ensuring started...
[09:24] [ComfyUI] [ComfyUI-PanoPack] Health check: ping (timeout=5.0s)...
[09:24] [ComfyUI] [ComfyUI-PanoPack] Health check: ok
[09:24] [ComfyUI] [SubprocessWorker] worker started/confirmed
[09:24] [ComfyUI] [SubprocessWorker] serializing kwargs to shm...
[09:24] [ComfyUI] [SubprocessWorker] created 0 shm blocks
[09:24] [ComfyUI] [SubprocessWorker] sending request via socket...
[09:24] [ComfyUI] [SubprocessWorker] call_id=2 sending call_method
[09:24] [ComfyUI] [worker:ComfyUI-PanoPack] [comfy-env] _from_shm got dict with keys: ['__type__', 'strategy', 'parent_pid', 'fd', 'storage_size']
[09:24] [ComfyUI] [worker:ComfyUI-PanoPack] [comfy-env] DESERIALIZE TensorRef: tensor_size=[1, 2048, 4096, 3]
[09:24] [ComfyUI] [worker:ComfyUI-PanoPack] [comfy-env] DESERIALIZED tensor shape: torch.Size([1, 2048, 4096, 3])
[09:24] [capture-loop] iter=600 t=68.3s state={'complete': False, 'error': None, 'executedCount': 0, 'wsState': 1} eval_ms=1 ram=6.0/31.3GB (19%) swap=1.9/32.0GB (6%) cpu=9% browser_rss=0.92GB
[09:26] Frame 16 saved (frame_015.jpg, t=69.5s)
[09:26] [capture-periodic] freeze=1ms shot=98ms unfreeze=7ms saved=True
[09:26] [ComfyUI] [worker:ComfyUI-PanoPack] [PanoramaSplit] swapped up=[0,1,0] for 2 pole vertices
[09:30] [capture-loop] iter=650 t=73.7s state={'complete': False, 'error': None, 'executedCount': 0, 'wsState': 1} eval_ms=1 ram=6.5/31.3GB (21%) swap=1.9/32.0GB (6%) cpu=13% browser_rss=0.92GB
[09:32] [ComfyUI] [worker:ComfyUI-PanoPack] [VRAM] +822MB (now 822MB) reserved=1312MB peak=822MB
[09:33] [ComfyUI] [worker:ComfyUI-PanoPack] [VRAM] -823MB (now 0MB) reserved=1312MB peak=822MB
[09:33] [ComfyUI] [worker:ComfyUI-PanoPack] [PanoramaSplit] icosahedron_42: (4096x2048) -> 42 crops @ 952x952, fov=(90,90) via grid_sample (GPU); cameras 1.387s, split 6.031s, total 8.737s
[09:34] [ComfyUI] [SubprocessWorker] got response: ok
[09:34] [ComfyUI] [comfy-env] PanoramaSplit done (9.90s): result: NodeOutput
[09:34] [ComfyUI] [VRAM] After PanoramaSplit: 2855 / 24122 MB
[09:34] Frame 17 saved (frame_016.jpg, t=78.2s)
[09:34] [capture-periodic] freeze=1ms shot=92ms unfreeze=6ms saved=True
[09:35] [capture-loop] iter=700 t=79.2s state={'complete': False, 'error': None, 'executedCount': 0, 'wsState': 1} eval_ms=1 ram=7.3/31.3GB (23%) swap=1.9/32.0GB (6%) cpu=12% browser_rss=0.91GB
[09:37] [ComfyUI] [comfy-env] Running MoGe2Inference: resolution_level: 9, num_tokens: 0, fov_x_deg: 90.0, force_projection: True, apply_mask: True, moge2_model: dict, images: torch.float32 [42,952,952,3] cpu
[09:37] [ComfyUI] [VRAM] Before MoGe2Inference: 2855 / 24122 MB
[09:37] [ComfyUI] [SubprocessWorker] call_method: nodes.nodes_inference.MoGe2Inference.EXECUTE_NORMALIZED
[09:37] [ComfyUI] [SubprocessWorker] acquired lock, ensuring started...
[09:37] [ComfyUI] [ComfyUI-MoGe2] Health check: ping (timeout=5.0s)...
[09:37] [ComfyUI] [ComfyUI-MoGe2] Health check: ok
[09:37] [ComfyUI] [SubprocessWorker] worker started/confirmed
[09:37] [ComfyUI] [comfy-env] PRE-SERIALIZE 'images' shape: torch.Size([42, 952, 952, 3])
[09:37] Node executed (1 total), capturing...
[09:37] [ComfyUI] [SubprocessWorker] serializing kwargs to shm...
[09:37] [ComfyUI] [SubprocessWorker] created 0 shm blocks
[09:37] [ComfyUI] [SubprocessWorker] sending request via socket...
[09:37] [ComfyUI] [SubprocessWorker] call_id=2 sending call_method
[09:37] [ComfyUI] [worker:ComfyUI-MoGe2] [comfy-env] _from_shm got dict with keys: ['__type__', 'strategy', 'parent_pid', 'fd', 'storage_size']
[09:37] [ComfyUI] [worker:ComfyUI-MoGe2] [comfy-env] DESERIALIZE TensorRef: tensor_size=[42, 952, 952, 3]
[09:37] [ComfyUI] [worker:ComfyUI-MoGe2] [comfy-env] DESERIALIZED tensor shape: torch.Size([42, 952, 952, 3])
[09:37] Frame 18 saved (frame_017.jpg, t=80.9s)
[09:37] [capture-node] freeze=6ms shot=117ms unfreeze=1ms saved=True
[09:41] [capture-loop] iter=750 t=84.8s state={'complete': False, 'error': None, 'executedCount': 1, 'wsState': 1} eval_ms=1 ram=8.0/31.3GB (25%) swap=1.9/32.0GB (6%) cpu=15% browser_rss=1.09GB
[09:44] [ComfyUI] [SubprocessWorker] callback 'request_vram_budget' from call_id=2
[09:44] [ComfyUI] [comfy-env] VRAM request: 0.66GB, free before eviction: 22.30GB
[09:44] [ComfyUI] [comfy-env] VRAM after eviction: 22.30GB
[09:45] [ComfyUI] [worker:ComfyUI-MoGe2] [VRAM] +208MB (now 208MB) reserved=224MB peak=208MB
[09:45] [ComfyUI] [SubprocessWorker] callback 'report_progress' from call_id=2
[09:46] [ComfyUI] [worker:ComfyUI-MoGe2] [VRAM] +463MB (now 671MB) reserved=1568MB peak=949MB
[09:46] [ComfyUI] [SubprocessWorker] callback 'report_progress' from call_id=2
[09:46] Frame 19 saved (frame_018.jpg, t=89.6s)
[09:46] [capture-periodic] freeze=1ms shot=99ms unfreeze=6ms saved=True
[09:46] [ComfyUI] [SubprocessWorker] callback 'report_progress' from call_id=2
[09:46] [ComfyUI] [SubprocessWorker] callback 'report_progress' from call_id=2
[09:46] [ComfyUI] [SubprocessWorker] callback 'report_progress' from call_id=2
[09:46] [ComfyUI] [SubprocessWorker] callback 'report_progress' from call_id=2
[09:46] [capture-loop] iter=800 t=90.4s state={'complete': False, 'error': None, 'executedCount': 1, 'wsState': 1} eval_ms=6 ram=10.1/31.3GB (32%) swap=1.9/32.0GB (6%) cpu=12% browser_rss=1.08GB
[09:47] [ComfyUI] [SubprocessWorker] callback 'report_progress' from call_id=2
[09:47] [ComfyUI] [SubprocessWorker] callback 'report_progress' from call_id=2
[09:47] [ComfyUI] [SubprocessWorker] callback 'report_progress' from call_id=2
[09:47] [ComfyUI] [SubprocessWorker] callback 'report_progress' from call_id=2
[09:47] [ComfyUI] [SubprocessWorker] callback 'report_progress' from call_id=2
[09:48] [ComfyUI] [SubprocessWorker] callback 'report_progress' from call_id=2
[09:48] [ComfyUI] [SubprocessWorker] callback 'report_progress' from call_id=2
[09:48] Frame 20 saved (frame_019.jpg, t=91.8s)
[09:48] [capture-periodic] freeze=4ms shot=107ms unfreeze=5ms saved=True
[09:48] [ComfyUI] [SubprocessWorker] callback 'report_progress' from call_id=2
[09:48] [ComfyUI] [SubprocessWorker] callback 'report_progress' from call_id=2
[09:48] [ComfyUI] [SubprocessWorker] callback 'report_progress' from call_id=2
[09:49] [ComfyUI] [SubprocessWorker] callback 'report_progress' from call_id=2
[09:49] [ComfyUI] [SubprocessWorker] callback 'report_progress' from call_id=2
[09:49] [ComfyUI] [SubprocessWorker] callback 'report_progress' from call_id=2
[09:49] [ComfyUI] [SubprocessWorker] callback 'report_progress' from call_id=2
[09:49] [ComfyUI] [SubprocessWorker] callback 'report_progress' from call_id=2
[09:50] [ComfyUI] [SubprocessWorker] callback 'report_progress' from call_id=2
[09:50] [ComfyUI] [SubprocessWorker] callback 'report_progress' from call_id=2
[09:50] [ComfyUI] [SubprocessWorker] callback 'report_progress' from call_id=2
[09:50] Frame 21 saved (frame_020.jpg, t=94.0s)
[09:50] [capture-periodic] freeze=1ms shot=92ms unfreeze=1ms saved=True
[09:50] [ComfyUI] [SubprocessWorker] callback 'report_progress' from call_id=2
[09:51] [ComfyUI] [SubprocessWorker] callback 'report_progress' from call_id=2
[09:51] [ComfyUI] [SubprocessWorker] callback 'report_progress' from call_id=2
[09:51] [ComfyUI] [SubprocessWorker] callback 'report_progress' from call_id=2
[09:52] [ComfyUI] [SubprocessWorker] callback 'report_progress' from call_id=2
[09:52] [ComfyUI] [SubprocessWorker] callback 'report_progress' from call_id=2
[09:52] [ComfyUI] [SubprocessWorker] callback 'report_progress' from call_id=2
[09:52] [capture-loop] iter=850 t=96.1s state={'complete': False, 'error': None, 'executedCount': 1, 'wsState': 1} eval_ms=1 ram=10.8/31.3GB (34%) swap=1.9/32.0GB (6%) cpu=15% browser_rss=1.10GB
[09:52] [ComfyUI] [SubprocessWorker] callback 'report_progress' from call_id=2
[09:52] Frame 22 saved (frame_021.jpg, t=96.2s)
[09:52] [capture-periodic] freeze=1ms shot=98ms unfreeze=1ms saved=True
[09:53] [ComfyUI] [SubprocessWorker] callback 'report_progress' from call_id=2
[09:53] [ComfyUI] [SubprocessWorker] callback 'report_progress' from call_id=2
[09:53] [ComfyUI] [SubprocessWorker] callback 'report_progress' from call_id=2
[09:53] [ComfyUI] [SubprocessWorker] callback 'report_progress' from call_id=2
[09:54] [ComfyUI] [SubprocessWorker] callback 'report_progress' from call_id=2
[09:54] [ComfyUI] [SubprocessWorker] callback 'report_progress' from call_id=2
[09:54] [ComfyUI] [worker:ComfyUI-MoGe2] [VRAM] +296MB (now 967MB) reserved=1696MB peak=967MB
[09:54] [ComfyUI] [SubprocessWorker] callback 'report_progress' from call_id=2
[09:55] Frame 23 saved (frame_022.jpg, t=98.4s)
[09:55] [ComfyUI] [SubprocessWorker] callback 'report_progress' from call_id=2
[09:55] [capture-periodic] freeze=1ms shot=102ms unfreeze=5ms saved=True
[09:55] [ComfyUI] [SubprocessWorker] callback 'report_progress' from call_id=2
[09:55] [ComfyUI] [SubprocessWorker] callback 'report_progress' from call_id=2
[09:55] [ComfyUI] [worker:ComfyUI-MoGe2] [VRAM] -297MB (now 671MB) reserved=1696MB peak=967MB
[09:57] Frame 24 saved (frame_023.jpg, t=101.0s)
[09:57] [capture-periodic] freeze=1ms shot=106ms unfreeze=6ms saved=True
[09:58] [capture-loop] iter=900 t=102.1s state={'complete': False, 'error': None, 'executedCount': 1, 'wsState': 1} eval_ms=1 ram=13.6/31.3GB (43%) swap=1.9/32.0GB (6%) cpu=13% browser_rss=1.11GB
[09:58] [ComfyUI] [SubprocessWorker] got response: ok
[09:58] [ComfyUI] [comfy-env] Created 1 model patchers: ['MoGeWrapper_1']
[09:58] [ComfyUI] [comfy-env] MoGe2Inference done (21.44s): result: NodeOutput
[09:58] [ComfyUI] [VRAM] After MoGe2Inference: 4669 / 24122 MB
[09:58] [ComfyUI] [VRAM] Loaded: SubprocessModel (631 MB)
[09:59] [ComfyUI] [comfy-env] Running PanoramaDepthMerge: out_width: 4096, out_height: 2048, use_gpu: True, scale_anchor: False, chunk_size: 8, center_weight_power: 2.0, normal_edge_threshold_deg: 0.0, normal_consistency_boost: False, max_ray_distance_m: 0.0, face_points: torch.float32 [42,952,952,3] cpu, extrinsics: torch.float32 [42,4,4] cpu, intrinsics: torch.float32 [42,3,3] cpu, face_valid_masks: torch.float32 [42,952,952] cpu, face_normals: torch.float32 [42,952,952,3] cpu
[09:59] [ComfyUI] [VRAM] Before PanoramaDepthMerge: 4669 / 24122 MB
[09:59] [ComfyUI] [VRAM] Loaded: SubprocessModel (631 MB)
[09:59] [ComfyUI] [SubprocessWorker] call_method: nodes.depth_merge.PanoramaDepthMerge.EXECUTE_NORMALIZED
[09:59] [ComfyUI] [SubprocessWorker] acquired lock, ensuring started...
[09:59] [ComfyUI] [ComfyUI-PanoPack] Health check: ping (timeout=5.0s)...
[09:59] [ComfyUI] [ComfyUI-PanoPack] Health check: ok
[09:59] [ComfyUI] [SubprocessWorker] worker started/confirmed
[09:59] [ComfyUI] [comfy-env] PRE-SERIALIZE 'face_points' shape: torch.Size([42, 952, 952, 3])
[09:59] [ComfyUI] [comfy-env] PRE-SERIALIZE 'extrinsics' shape: torch.Size([42, 4, 4])
[09:59] [ComfyUI] [comfy-env] PRE-SERIALIZE 'intrinsics' shape: torch.Size([42, 3, 3])
[09:59] [ComfyUI] [comfy-env] PRE-SERIALIZE 'face_valid_masks' shape: torch.Size([42, 952, 952])
[09:59] [ComfyUI] [comfy-env] PRE-SERIALIZE 'face_normals' shape: torch.Size([42, 952, 952, 3])
[09:59] [ComfyUI] [SubprocessWorker] serializing kwargs to shm...
[09:59] Node executed (2 total), capturing...
[10:00] Frame 25 saved (frame_024.jpg, t=103.4s)
[10:00] [capture-node] freeze=8ms shot=119ms unfreeze=1ms saved=True
[10:00] [ComfyUI] [SubprocessWorker] created 0 shm blocks
[10:00] [ComfyUI] [SubprocessWorker] sending request via socket...
[10:00] [ComfyUI] [SubprocessWorker] call_id=3 sending call_method
[10:00] [ComfyUI] [worker:ComfyUI-PanoPack] [comfy-env] _from_shm got dict with keys: ['__type__', 'strategy', 'parent_pid', 'fd', 'storage_size']
[10:00] [ComfyUI] [worker:ComfyUI-PanoPack] [comfy-env] DESERIALIZE TensorRef: tensor_size=[42, 952, 952, 3]
[10:00] [ComfyUI] [worker:ComfyUI-PanoPack] [comfy-env] DESERIALIZED tensor shape: torch.Size([42, 952, 952, 3])
[10:00] [ComfyUI] [worker:ComfyUI-PanoPack] [comfy-env] _from_shm got dict with keys: ['__type__', 'strategy', 'parent_pid', 'fd', 'storage_size']
[10:00] [ComfyUI] [worker:ComfyUI-PanoPack] [comfy-env] DESERIALIZE TensorRef: tensor_size=[42, 4, 4]
[10:00] [ComfyUI] [worker:ComfyUI-PanoPack] [comfy-env] DESERIALIZED tensor shape: torch.Size([42, 4, 4])
[10:00] [ComfyUI] [worker:ComfyUI-PanoPack] [comfy-env] _from_shm got dict with keys: ['__type__', 'strategy', 'parent_pid', 'fd', 'storage_size']
[10:00] [ComfyUI] [worker:ComfyUI-PanoPack] [comfy-env] DESERIALIZE TensorRef: tensor_size=[42, 3, 3]
[10:00] [ComfyUI] [worker:ComfyUI-PanoPack] [comfy-env] DESERIALIZED tensor shape: torch.Size([42, 3, 3])
[10:00] [ComfyUI] [worker:ComfyUI-PanoPack] [comfy-env] _from_shm got dict with keys: ['__type__', 'strategy', 'parent_pid', 'fd', 'storage_size']
[10:00] [ComfyUI] [worker:ComfyUI-PanoPack] [comfy-env] DESERIALIZE TensorRef: tensor_size=[42, 952, 952]
[10:00] [ComfyUI] [worker:ComfyUI-PanoPack] [comfy-env] DESERIALIZED tensor shape: torch.Size([42, 952, 952])
[10:00] [ComfyUI] [worker:ComfyUI-PanoPack] [comfy-env] _from_shm got dict with keys: ['__type__', 'strategy', 'parent_pid', 'fd', 'storage_size']
[10:00] [ComfyUI] [worker:ComfyUI-PanoPack] [comfy-env] DESERIALIZE TensorRef: tensor_size=[42, 952, 952, 3]
[10:00] [ComfyUI] [worker:ComfyUI-PanoPack] [comfy-env] DESERIALIZED tensor shape: torch.Size([42, 952, 952, 3])
[10:04] [capture-loop] iter=950 t=107.7s state={'complete': False, 'error': None, 'executedCount': 2, 'wsState': 1} eval_ms=2 ram=15.4/31.3GB (49%) swap=1.9/32.0GB (6%) cpu=15% browser_rss=1.15GB
[10:09] [capture-loop] iter=1000 t=113.2s state={'complete': False, 'error': None, 'executedCount': 2, 'wsState': 1} eval_ms=1 ram=16.2/31.3GB (52%) swap=1.9/32.0GB (6%) cpu=17% browser_rss=1.11GB
[10:15] [capture-loop] iter=1050 t=118.6s state={'complete': False, 'error': None, 'executedCount': 2, 'wsState': 1} eval_ms=2 ram=16.1/31.3GB (51%) swap=1.9/32.0GB (6%) cpu=20% browser_rss=1.11GB
[10:20] [capture-loop] iter=1100 t=124.1s state={'complete': False, 'error': None, 'executedCount': 2, 'wsState': 1} eval_ms=2 ram=16.1/31.3GB (52%) swap=1.9/32.0GB (6%) cpu=19% browser_rss=1.11GB
[10:23] [ComfyUI] [worker:ComfyUI-PanoPack]
[10:23] [ComfyUI] === WATCHDOG TICK 1 ===
[10:23] [ComfyUI] [worker:ComfyUI-PanoPack] Thread 0x000070802b3ff640 (most recent call first):
[10:23] [ComfyUI] File "/tmp/comfytest-home/.ce/.pixi/envs/panopack-nodes/lib/python3.11/socket.py", line 294 in accept
[10:23] [ComfyUI] File "/tmp/comfytest-home/.ce/.pixi/envs/panopack-nodes/lib/python3.11/multiprocessing/connection.py", line 626 in accept
[10:23] [ComfyUI] File "/tmp/comfytest-home/.ce/.pixi/envs/panopack-nodes/lib/python3.11/multiprocessing/connection.py", line 480 in accept
[10:23] [ComfyUI] File "/tmp/comfytest-home/.ce/.pixi/envs/panopack-nodes/lib/python3.11/multiprocessing/resource_sharer.py", line 138 in _serve
[10:23] [ComfyUI] File "/tmp/comfytest-home/.ce/.pixi/envs/panopack-nodes/lib/python3.11/threading.py", line 982 in run
[10:23] [ComfyUI] File "/tmp/comfytest-home/.ce/.pixi/envs/panopack-nodes/lib/python3.11/threading.py", line 1045 in _bootstrap_inner
[10:23] [ComfyUI] File "/tmp/comfytest-home/.ce/.pixi/envs/panopack-nodes/lib/python3.11/threading.py", line 1002 in _bootstrap
[10:23] [ComfyUI]
[10:23] [ComfyUI] Thread 0x000070820c18e640 (most recent call first):
[10:23] [ComfyUI] File "/tmp/comfyui_pvenv_tqf5i7bh/persistent_worker.py", line 106 in _vram_poller
[10:23] [ComfyUI] File "/tmp/comfytest-home/.ce/.pixi/envs/panopack-nodes/lib/python3.11/threading.py", line 982 in run
[10:23] [ComfyUI] File "/tmp/comfytest-home/.ce/.pixi/envs/panopack-nodes/lib/python3.11/threading.py", line 1045 in _bootstrap_inner
[10:23] [ComfyUI] File "/tmp/comfytest-home/.ce/.pixi/envs/panopack-nodes/lib/python3.11/threading.py", line 1002 in _bootstrap
[10:23] [ComfyUI]
[10:23] [ComfyUI] Current thread 0x000070820c993640 (most recent call first):
[10:23] [ComfyUI] File "/tmp/comfyui_pvenv_tqf5i7bh/persistent_worker.py", line 52 in _watchdog
[10:23] [ComfyUI] File "/tmp/comfytest-home/.ce/.pixi/envs/panopack-nodes/lib/python3.11/threading.py", line 982 in run
[10:23] [ComfyUI] File "/tmp/comfytest-home/.ce/.pixi/envs/panopack-nodes/lib/python3.11/threading.py", line 1045 in _bootstrap_inner
[10:23] [ComfyUI] File "/tmp/comfytest-home/.ce/.pixi/envs/panopack-nodes/lib/python3.11/threading.py", line 1002 in _bootstrap
[10:23] [ComfyUI]
[10:23] [ComfyUI] Thread 0x000070820cfb3740 (most recent call first):
[10:23] [ComfyUI] File "/workspaces/Sharp-2211/ComfyUI/custom_nodes/ComfyUI-PanoPack/nodes/depth_merge.py", line 426 in _merge_world_normals
[10:23] [ComfyUI] File "/workspaces/Sharp-2211/ComfyUI/custom_nodes/ComfyUI-PanoPack/nodes/depth_merge.py", line 896 in execute
[10:23] [ComfyUI] File "/workspaces/Sharp-2211/ComfyUI/comfy_api/latest/_io.py", line 1892 in EXECUTE_NORMALIZED
[10:23] [ComfyUI] File "/tmp/comfyui_pvenv_tqf5i7bh/persistent_worker.py", line 1762 in main
[10:23] [ComfyUI] File "/tmp/comfyui_pvenv_tqf5i7bh/persistent_worker.py", line 1807 in <module>
[10:23] [ComfyUI]
[10:23] [ComfyUI] [worker:ComfyUI-PanoPack] === END ===
[10:23] [ComfyUI]
[10:24] [ComfyUI] [worker:ComfyUI-PanoPack] [PanoramaDepthMerge] normals merged: 2048x4096
[10:24] [ComfyUI] [worker:ComfyUI-PanoPack] [PanoramaDepthMerge] merging 42 faces @ 952x952 -> equirect 2048x4096 (use_gpu=True); input = points (||.|| -> ray distance)
[10:24] [ComfyUI] [SubprocessWorker] callback 'report_progress' from call_id=3
[10:24] [ComfyUI] [worker:ComfyUI-PanoPack] [PanoramaDepthMerge] top-level peak VRAM estimate: 3.46 GB (4096x2048, N=42, chunk_size=8)
[10:24] [ComfyUI] [SubprocessWorker] callback 'request_vram_budget' from call_id=3
[10:24] [ComfyUI] [comfy-env] VRAM request: 3.46GB, free before eviction: 20.40GB
[10:24] [ComfyUI] [comfy-env] VRAM after eviction: 20.40GB
[10:24] [ComfyUI] [worker:ComfyUI-PanoPack] [PanoramaDepthMerge] -> requested 3.46 GB eviction via comfy_worker.call_parent
[10:24] [ComfyUI] [worker:ComfyUI-PanoPack] [VRAM] +439MB (now 439MB) reserved=608MB peak=822MB
[10:24] [ComfyUI] /workspaces/Sharp-2211/ComfyUI/custom_nodes/ComfyUI-PanoPack/nodes/_vendor/worldgen/src/panorama_utils.py:349: UserWarning: Sparse CSR tensor support is in beta state. If you miss a functionality in the sparse tensor support, please submit a feature request to https://github.com/pytorch/pytorch/issues. (Triggered internally at /pytorch/aten/src/ATen/SparseCsrTensorImpl.cpp:49.)
[10:24] [ComfyUI] A_gpu = torch.sparse_csr_tensor(
[10:25] [ComfyUI] [worker:ComfyUI-PanoPack] [merge_panorama_depth_gpu 256x128 ] done 0.54s (warp 0.31, build 0.01, LSMR 0.22); N=42 K=8 chunks=6; depth min/med/max = 0.384/0.945/3.091; valid 32768/32768
[10:25] [ComfyUI] [worker:ComfyUI-PanoPack] [merge_panorama_depth_gpu 512x256 ] done 0.75s (warp 0.10, build 0.02, LSMR 0.07); N=42 K=8 chunks=6; depth min/med/max = 0.384/0.945/3.094; valid 131072/131072
[10:25] [ComfyUI] [worker:ComfyUI-PanoPack] [merge_panorama_depth_gpu 1024x512 ] done 1.07s (warp 0.11, build 0.06, LSMR 0.13); N=42 K=8 chunks=6; depth min/med/max = 0.384/0.945/3.094; valid 524288/524288
[10:25] [ComfyUI] [worker:ComfyUI-PanoPack] [VRAM] -408MB (now 32MB) reserved=64MB peak=822MB
[10:26] [capture-loop] iter=1150 t=129.5s state={'complete': False, 'error': None, 'executedCount': 2, 'wsState': 1} eval_ms=2 ram=16.1/31.3GB (52%) swap=1.9/32.0GB (6%) cpu=19% browser_rss=1.11GB
[10:26] Frame 26 saved (frame_025.jpg, t=129.6s)
[10:26] [capture-periodic] freeze=1ms shot=98ms unfreeze=5ms saved=True
[10:26] [ComfyUI] [worker:ComfyUI-PanoPack] [VRAM] +666MB (now 698MB) reserved=768MB peak=822MB
[10:26] [ComfyUI] [worker:ComfyUI-PanoPack] [merge_panorama_depth_gpu 2048x1024] done 2.27s (warp 0.21, build 0.54, LSMR 0.40); N=42 K=8 chunks=6; depth min/med/max = 0.384/0.945/3.095; valid 2097152/2097152
[10:27] [ComfyUI] [worker:ComfyUI-PanoPack] [VRAM] -400MB (now 298MB) reserved=416MB peak=859MB
[10:31] [capture-loop] iter=1200 t=135.0s state={'complete': False, 'error': None, 'executedCount': 2, 'wsState': 1} eval_ms=2 ram=18.2/31.3GB (58%) swap=1.9/32.0GB (6%) cpu=11% browser_rss=1.12GB
[10:31] [ComfyUI] [worker:ComfyUI-PanoPack] [VRAM] +383MB (now 682MB) reserved=800MB peak=859MB
[10:32] [ComfyUI] [worker:ComfyUI-PanoPack] [VRAM] +895MB (now 1578MB) reserved=1664MB peak=1578MB
[10:33] [ComfyUI] [worker:ComfyUI-PanoPack] [merge_panorama_depth_gpu 4096x2048] done 9.05s (warp 0.60, build 4.04, LSMR 1.94); N=42 K=8 chunks=6; depth min/med/max = 0.384/0.945/3.094; valid 8388608/8388608
[10:33] [ComfyUI] [worker:ComfyUI-PanoPack] [PanoramaDepthMerge] merged depth: shape (2048, 4096), min=0.384, median=0.945, max=3.094; valid pixels: 8388608 / 8388608
[10:33] [ComfyUI] [worker:ComfyUI-PanoPack] [VRAM] -1571MB (now 8MB) reserved=2176MB peak=1898MB
[10:36] [capture-loop] iter=1250 t=140.4s state={'complete': False, 'error': None, 'executedCount': 2, 'wsState': 1} eval_ms=2 ram=16.9/31.3GB (54%) swap=1.9/32.0GB (6%) cpu=15% browser_rss=1.12GB
[10:42] [capture-loop] iter=1300 t=145.9s state={'complete': False, 'error': None, 'executedCount': 2, 'wsState': 1} eval_ms=2 ram=16.9/31.3GB (54%) swap=1.9/32.0GB (6%) cpu=17% browser_rss=1.12GB
[10:47] [capture-loop] iter=1350 t=151.3s state={'complete': False, 'error': None, 'executedCount': 2, 'wsState': 1} eval_ms=1 ram=16.9/31.3GB (54%) swap=1.9/32.0GB (6%) cpu=17% browser_rss=1.12GB
[10:48] [ComfyUI] [worker:ComfyUI-PanoPack] [PanoramaDepthMerge] debug_image: H=2048+102, mult_disagreement (log-d, sphere-uniform): mean=11.22%, p99=24.69%, max=28.22%; overlap_pixels=8388608
[10:48] [ComfyUI] [worker:ComfyUI-PanoPack] [headless_gl] prefix=/tmp/comfytest-home/.ce/.pixi/envs/panopack-nodes
[10:48] [ComfyUI] [worker:ComfyUI-PanoPack] [headless_gl] OSMesa: ['libOSMesa.so', 'libOSMesa.so.8', 'libOSMesa.so.8.0.0']
[10:48] [ComfyUI] [worker:ComfyUI-PanoPack] [headless_gl] env: VTK_DEFAULT_OPENGL_WINDOW=vtkOSOpenGLRenderWindow PYVISTA_OFF_SCREEN=true
[10:49] [ComfyUI] [worker:ComfyUI-PanoPack] [PanoramaDepthMerge] xyz_views: cloud bbox center=(-0.79, -0.31, +0.03) m, size=(4.27 x 3.57 x 1.96) m, N=80000 (subsampled)
[10:51] [ComfyUI] [worker:ComfyUI-PanoPack] [PanoramaDepthMerge] points: merged equirect point map (1, 2048, 4096, 3)
[10:51] [ComfyUI] [SubprocessWorker] callback 'report_progress' from call_id=3
[10:51] [ComfyUI] [SubprocessWorker] got response: ok
[10:51] [ComfyUI] [comfy-env] PanoramaDepthMerge done (52.09s): result: NodeOutput
[10:51] [ComfyUI] [VRAM] After PanoramaDepthMerge: 3399 / 24122 MB
[10:51] [ComfyUI] [VRAM] Loaded: SubprocessModel (631 MB)
[10:52] [ComfyUI] [comfy-env] Running PanoramaSplitAdaptive: split_method: 'icosahedron_42', resolution: 1536, fov_degrees: 90.0, use_gpu: True, create_masks: True, mask_method: 'closest_to', panorama: dict, depth_panorama: torch.float32 [1,2048,4096,3] cpu, normals_panorama: torch.float32 [1,2048,4096,3] cpu
[10:52] [ComfyUI] [VRAM] Before PanoramaSplitAdaptive: 3399 / 24122 MB
[10:52] [ComfyUI] [VRAM] Loaded: SubprocessModel (631 MB)
[10:52] [ComfyUI] [SubprocessWorker] call_method: nodes.panorama_split_adaptive.PanoramaSplitAdaptive.EXECUTE_NORMALIZED
[10:52] [ComfyUI] [SubprocessWorker] acquired lock, ensuring started...
[10:52] [ComfyUI] [ComfyUI-PanoPack] Health check: ping (timeout=5.0s)...
[10:52] [ComfyUI] [ComfyUI-PanoPack] Health check: ok
[10:52] [ComfyUI] [SubprocessWorker] worker started/confirmed
[10:52] [ComfyUI] [comfy-env] PRE-SERIALIZE 'depth_panorama' shape: torch.Size([1, 2048, 4096, 3])
[10:52] [ComfyUI] [comfy-env] PRE-SERIALIZE 'normals_panorama' shape: torch.Size([1, 2048, 4096, 3])
[10:52] [ComfyUI] [SubprocessWorker] serializing kwargs to shm...
[10:52] Node executed (3 total), capturing...
[10:52] [ComfyUI] [SubprocessWorker] created 0 shm blocks
[10:52] [ComfyUI] [SubprocessWorker] sending request via socket...
[10:52] [ComfyUI] [SubprocessWorker] call_id=4 sending call_method
[10:52] [ComfyUI] [worker:ComfyUI-PanoPack] [comfy-env] _from_shm got dict with keys: ['__type__', 'strategy', 'parent_pid', 'fd', 'storage_size']
[10:52] [ComfyUI] [worker:ComfyUI-PanoPack] [comfy-env] DESERIALIZE TensorRef: tensor_size=[1, 2048, 4096, 3]
[10:52] [ComfyUI] [worker:ComfyUI-PanoPack] [comfy-env] DESERIALIZED tensor shape: torch.Size([1, 2048, 4096, 3])
[10:52] [ComfyUI] [worker:ComfyUI-PanoPack] [comfy-env] _from_shm got dict with keys: ['__type__', 'strategy', 'parent_pid', 'fd', 'storage_size']
[10:52] [ComfyUI] [worker:ComfyUI-PanoPack] [comfy-env] DESERIALIZE TensorRef: tensor_size=[1, 2048, 4096, 3]
[10:52] [ComfyUI] [worker:ComfyUI-PanoPack] [comfy-env] DESERIALIZED tensor shape: torch.Size([1, 2048, 4096, 3])
[10:52] [ComfyUI] [worker:ComfyUI-PanoPack] [comfy-env] _from_shm got dict with keys: ['__type__', 'strategy', 'parent_pid', 'fd', 'storage_size']
[10:52] [ComfyUI] [worker:ComfyUI-PanoPack] [comfy-env] DESERIALIZE TensorRef: tensor_size=[1, 2048, 4096, 3]
[10:52] [ComfyUI] [worker:ComfyUI-PanoPack] [comfy-env] DESERIALIZED tensor shape: torch.Size([1, 2048, 4096, 3])
[10:52] Frame 27 saved (frame_026.jpg, t=155.8s)
[10:52] [capture-node] freeze=2ms shot=117ms unfreeze=2ms saved=True
[10:52] [ComfyUI] [worker:ComfyUI-PanoPack] [PanoramaSplitAdaptive] computing area weights from depth (2048x4096) + normals...
[10:52] [ComfyUI] [worker:ComfyUI-PanoPack] [PanoramaSplitAdaptive] weight range: [1.06, 131], mean=11.7
[10:52] [ComfyUI] [worker:ComfyUI-PanoPack] [PanoramaSplitAdaptive] adaptive relax: icosahedron_42 (42 cameras), weighted Lloyd...
[10:53] [capture-loop] iter=1400 t=156.9s state={'complete': False, 'error': None, 'executedCount': 3, 'wsState': 1} eval_ms=1 ram=16.8/31.3GB (54%) swap=1.9/32.0GB (6%) cpu=12% browser_rss=1.13GB
[10:58] [capture-loop] iter=1450 t=162.3s state={'complete': False, 'error': None, 'executedCount': 3, 'wsState': 1} eval_ms=2 ram=16.3/31.3GB (52%) swap=1.9/32.0GB (6%) cpu=11% browser_rss=1.13GB
[11:04] [capture-loop] iter=1500 t=167.8s state={'complete': False, 'error': None, 'executedCount': 3, 'wsState': 1} eval_ms=2 ram=16.7/31.3GB (54%) swap=1.9/32.0GB (6%) cpu=12% browser_rss=1.13GB
[11:09] [capture-loop] iter=1550 t=173.2s state={'complete': False, 'error': None, 'executedCount': 3, 'wsState': 1} eval_ms=2 ram=17.7/31.3GB (57%) swap=1.9/32.0GB (6%) cpu=11% browser_rss=1.13GB
[11:15] [capture-loop] iter=1600 t=178.7s state={'complete': False, 'error': None, 'executedCount': 3, 'wsState': 1} eval_ms=1 ram=16.6/31.3GB (53%) swap=1.9/32.0GB (6%) cpu=12% browser_rss=1.13GB
[11:17] [ComfyUI] [worker:ComfyUI-PanoPack] [PanoramaSplitAdaptive] Lloyd ran 24 iters (max move 1.42e-02)
[11:17] [ComfyUI] [worker:ComfyUI-PanoPack] [PanoramaSplitAdaptive] Lloyd relaxation done: 42 camera directions in 24.944s
[11:17] [ComfyUI] [worker:ComfyUI-PanoPack] [PanoramaSplitAdaptive] rasterizing 42 faces @ 1536x1536...
[11:20] [capture-loop] iter=1650 t=184.0s state={'complete': False, 'error': None, 'executedCount': 3, 'wsState': 1} eval_ms=2 ram=16.3/31.3GB (52%) swap=1.9/32.0GB (6%) cpu=12% browser_rss=1.13GB
[11:23] [ComfyUI] [worker:ComfyUI-PanoPack]
[11:23] [ComfyUI] === WATCHDOG TICK 2 ===
[11:23] [ComfyUI] [worker:ComfyUI-PanoPack] Thread 0x000070802b3ff640 (most recent call first):
[11:23] [ComfyUI] File "/tmp/comfytest-home/.ce/.pixi/envs/panopack-nodes/lib/python3.11/socket.py", line 294 in accept
[11:23] [ComfyUI] File "/tmp/comfytest-home/.ce/.pixi/envs/panopack-nodes/lib/python3.11/multiprocessing/connection.py", line 626 in accept
[11:23] [ComfyUI] File "/tmp/comfytest-home/.ce/.pixi/envs/panopack-nodes/lib/python3.11/multiprocessing/connection.py", line 480 in accept
[11:23] [ComfyUI] File "/tmp/comfytest-home/.ce/.pixi/envs/panopack-nodes/lib/python3.11/multiprocessing/resource_sharer.py", line 138 in _serve
[11:23] [ComfyUI] File "/tmp/comfytest-home/.ce/.pixi/envs/panopack-nodes/lib/python3.11/threading.py", line 982 in run
[11:23] [ComfyUI] File "/tmp/comfytest-home/.ce/.pixi/envs/panopack-nodes/lib/python3.11/threading.py", line 1045 in _bootstrap_inner
[11:23] [ComfyUI] File "/tmp/comfytest-home/.ce/.pixi/envs/panopack-nodes/lib/python3.11/threading.py", line 1002 in _bootstrap
[11:23] [ComfyUI]
[11:23] [ComfyUI] Thread 0x000070820c18e640 (most recent call first):
[11:23] [ComfyUI] File "/tmp/comfyui_pvenv_tqf5i7bh/persistent_worker.py", line 106 in _vram_poller
[11:23] [ComfyUI] File "/tmp/comfytest-home/.ce/.pixi/envs/panopack-nodes/lib/python3.11/threading.py", line 982 in run
[11:23] [ComfyUI] File "/tmp/comfytest-home/.ce/.pixi/envs/panopack-nodes/lib/python3.11/threading.py", line 1045 in _bootstrap_inner
[11:23] [ComfyUI] File "/tmp/comfytest-home/.ce/.pixi/envs/panopack-nodes/lib/python3.11/threading.py", line 1002 in _bootstrap
[11:23] [ComfyUI]
[11:23] [ComfyUI] Current thread 0x000070820c993640 (most recent call first):
[11:23] [ComfyUI] File "/tmp/comfyui_pvenv_tqf5i7bh/persistent_worker.py", line 52 in _watchdog
[11:23] [ComfyUI] File "/tmp/comfytest-home/.ce/.pixi/envs/panopack-nodes/lib/python3.11/threading.py", line 982 in run
[11:23] [ComfyUI] File "/tmp/comfytest-home/.ce/.pixi/envs/panopack-nodes/lib/python3.11/threading.py", line 1045 in _bootstrap_inner
[11:23] [ComfyUI] File "/tmp/comfytest-home/.ce/.pixi/envs/panopack-nodes/lib/python3.11/threading.py", line 1002 in _bootstrap
[11:23] [ComfyUI]
[11:23] [ComfyUI] Thread 0x000070820cfb3740 (most recent call first):
[11:23] [ComfyUI] File "/workspaces/Sharp-2211/ComfyUI/custom_nodes/ComfyUI-PanoPack/nodes/_vendor/moge_panorama.py", line 36 in directions_to_spherical_uv
[11:23] [ComfyUI] File "/workspaces/Sharp-2211/ComfyUI/custom_nodes/ComfyUI-PanoPack/nodes/_vendor/moge_panorama.py", line 92 in split_panorama_image_gpu
[11:23] [ComfyUI] File "/workspaces/Sharp-2211/ComfyUI/custom_nodes/ComfyUI-PanoPack/nodes/panorama_split_adaptive.py", line 434 in execute
[11:23] [ComfyUI] File "/workspaces/Sharp-2211/ComfyUI/comfy_api/latest/_io.py", line 1892 in EXECUTE_NORMALIZED
[11:23] [ComfyUI] File "/tmp/comfyui_pvenv_tqf5i7bh/persistent_worker.py", line 1762 in main
[11:23] [ComfyUI] File "/tmp/comfyui_pvenv_tqf5i7bh/persistent_worker.py", line 1807 in <module>
[11:23] [ComfyUI]
[11:23] [ComfyUI] [worker:ComfyUI-PanoPack] === END ===
[11:23] [ComfyUI]
[11:26] [capture-loop] iter=1700 t=189.5s state={'complete': False, 'error': None, 'executedCount': 3, 'wsState': 1} eval_ms=2 ram=17.0/31.3GB (54%) swap=1.9/32.0GB (6%) cpu=12% browser_rss=1.13GB
[11:26] [ComfyUI] [worker:ComfyUI-PanoPack] [VRAM] +756MB (now 764MB) reserved=800MB peak=1898MB
[11:27] [ComfyUI] [worker:ComfyUI-PanoPack] [VRAM] +1230MB (now 1994MB) reserved=3168MB peak=1994MB
[11:28] [ComfyUI] [worker:ComfyUI-PanoPack] [VRAM] -1986MB (now 8MB) reserved=3168MB peak=1994MB
[11:29] [ComfyUI] [worker:ComfyUI-PanoPack] [PanoramaSplitAdaptive] rasterized RGB in 11.543s (GPU)
[11:29] [ComfyUI] [worker:ComfyUI-PanoPack] [PanoramaSplitAdaptive] rasterizing depth crops...
[11:31] [capture-loop] iter=1750 t=194.9s state={'complete': False, 'error': None, 'executedCount': 3, 'wsState': 1} eval_ms=2 ram=18.5/31.3GB (59%) swap=1.9/32.0GB (6%) cpu=12% browser_rss=1.13GB
[11:36] [capture-loop] iter=1800 t=200.3s state={'complete': False, 'error': None, 'executedCount': 3, 'wsState': 1} eval_ms=2 ram=19.1/31.3GB (61%) swap=1.9/32.0GB (6%) cpu=12% browser_rss=1.13GB
[11:40] [ComfyUI] [worker:ComfyUI-PanoPack] [VRAM] +1986MB (now 1994MB) reserved=3264MB peak=1994MB
[11:41] [ComfyUI] [worker:ComfyUI-PanoPack] [VRAM] -1986MB (now 8MB) reserved=3264MB peak=1994MB
[11:42] [capture-loop] iter=1850 t=205.7s state={'complete': False, 'error': None, 'executedCount': 3, 'wsState': 1} eval_ms=2 ram=20.8/31.3GB (66%) swap=1.9/32.0GB (6%) cpu=12% browser_rss=1.13GB
[11:43] [ComfyUI] [worker:ComfyUI-PanoPack] [PanoramaSplitAdaptive] rasterizing normals crops...
[11:47] [capture-loop] iter=1900 t=211.1s state={'complete': False, 'error': None, 'executedCount': 3, 'wsState': 1} eval_ms=2 ram=21.0/31.3GB (67%) swap=1.9/32.0GB (6%) cpu=11% browser_rss=1.13GB
[11:53] [capture-loop] iter=1950 t=216.5s state={'complete': False, 'error': None, 'executedCount': 3, 'wsState': 1} eval_ms=2 ram=21.6/31.3GB (69%) swap=1.9/32.0GB (6%) cpu=12% browser_rss=1.13GB
[11:55] [ComfyUI] [worker:ComfyUI-PanoPack] [VRAM] +756MB (now 764MB) reserved=3264MB peak=1994MB
[11:56] [ComfyUI] [worker:ComfyUI-PanoPack] [VRAM] +1230MB (now 1994MB) reserved=3264MB peak=1994MB
[11:58] [ComfyUI] [worker:ComfyUI-PanoPack] [VRAM] -1986MB (now 8MB) reserved=3264MB peak=1994MB
[11:58] [capture-loop] iter=2000 t=222.0s state={'complete': False, 'error': None, 'executedCount': 3, 'wsState': 1} eval_ms=2 ram=22.9/31.3GB (73%) swap=1.9/32.0GB (6%) cpu=11% browser_rss=1.13GB
[12:00] [ComfyUI] [worker:ComfyUI-PanoPack] [PanoramaSplitAdaptive] generating closest_to masks...
[12:03] [capture-loop] iter=2050 t=227.3s state={'complete': False, 'error': None, 'executedCount': 3, 'wsState': 1} eval_ms=2 ram=23.8/31.3GB (76%) swap=2.1/32.0GB (7%) cpu=11% browser_rss=1.13GB
[12:09] [capture-loop] iter=2100 t=232.7s state={'complete': False, 'error': None, 'executedCount': 3, 'wsState': 1} eval_ms=2 ram=23.8/31.3GB (76%) swap=2.1/32.0GB (7%) cpu=11% browser_rss=1.14GB
[12:14] [capture-loop] iter=2150 t=238.1s state={'complete': False, 'error': None, 'executedCount': 3, 'wsState': 1} eval_ms=2 ram=23.9/31.3GB (76%) swap=2.1/32.0GB (7%) cpu=12% browser_rss=1.14GB
[12:20] [capture-loop] iter=2200 t=243.6s state={'complete': False, 'error': None, 'executedCount': 3, 'wsState': 1} eval_ms=1 ram=23.9/31.3GB (77%) swap=2.1/32.0GB (7%) cpu=12% browser_rss=1.13GB
[12:23] [ComfyUI] [worker:ComfyUI-PanoPack]
[12:23] [ComfyUI] === WATCHDOG TICK 3 ===
[12:23] [ComfyUI] [worker:ComfyUI-PanoPack] Thread 0x000070802b3ff640 (most recent call first):
[12:23] [ComfyUI] File "/tmp/comfytest-home/.ce/.pixi/envs/panopack-nodes/lib/python3.11/socket.py", line 294 in accept
[12:23] [ComfyUI] File "/tmp/comfytest-home/.ce/.pixi/envs/panopack-nodes/lib/python3.11/multiprocessing/connection.py", line 626 in accept
[12:23] [ComfyUI] File "/tmp/comfytest-home/.ce/.pixi/envs/panopack-nodes/lib/python3.11/multiprocessing/connection.py", line 480 in accept
[12:23] [ComfyUI] File "/tmp/comfytest-home/.ce/.pixi/envs/panopack-nodes/lib/python3.11/multiprocessing/resource_sharer.py", line 138 in _serve
[12:23] [ComfyUI] File "/tmp/comfytest-home/.ce/.pixi/envs/panopack-nodes/lib/python3.11/threading.py", line 982 in run
[12:23] [ComfyUI] File "/tmp/comfytest-home/.ce/.pixi/envs/panopack-nodes/lib/python3.11/threading.py", line 1045 in _bootstrap_inner
[12:23] [ComfyUI] File "/tmp/comfytest-home/.ce/.pixi/envs/panopack-nodes/lib/python3.11/threading.py", line 1002 in _bootstrap
[12:23] [ComfyUI]
[12:23] [ComfyUI] Thread 0x000070820c18e640 (most recent call first):
[12:23] [ComfyUI] File "/tmp/comfyui_pvenv_tqf5i7bh/persistent_worker.py", line 106 in _vram_poller
[12:23] [ComfyUI] File "/tmp/comfytest-home/.ce/.pixi/envs/panopack-nodes/lib/python3.11/threading.py", line 982 in run
[12:23] [ComfyUI] File "/tmp/comfytest-home/.ce/.pixi/envs/panopack-nodes/lib/python3.11/threading.py", line 1045 in _bootstrap_inner
[12:23] [ComfyUI] File "/tmp/comfytest-home/.ce/.pixi/envs/panopack-nodes/lib/python3.11/threading.py", line 1002 in _bootstrap
[12:23] [ComfyUI]
[12:23] [ComfyUI] Current thread 0x000070820c993640 (most recent call first):
[12:23] [ComfyUI] File "/tmp/comfyui_pvenv_tqf5i7bh/persistent_worker.py", line 52 in _watchdog
[12:23] [ComfyUI] File "/tmp/comfytest-home/.ce/.pixi/envs/panopack-nodes/lib/python3.11/threading.py", line 982 in run
[12:23] [ComfyUI] File "/tmp/comfytest-home/.ce/.pixi/envs/panopack-nodes/lib/python3.11/threading.py", line 1045 in _bootstrap_inner
[12:23] [ComfyUI] File "/tmp/comfytest-home/.ce/.pixi/envs/panopack-nodes/lib/python3.11/threading.py", line 1002 in _bootstrap
[12:23] [ComfyUI]
[12:23] [ComfyUI] Thread 0x000070820cfb3740 (most recent call first):
[12:23] [ComfyUI] File "/tmp/comfytest-home/.ce/.pixi/envs/panopack-nodes/lib/python3.11/site-packages/numpy/linalg/_linalg.py", line 2804 in norm
[12:23] [ComfyUI] File "/workspaces/Sharp-2211/ComfyUI/custom_nodes/ComfyUI-PanoPack/nodes/panorama_split_adaptive.py", line 482 in execute
[12:23] [ComfyUI] File "/workspaces/Sharp-2211/ComfyUI/comfy_api/latest/_io.py", line 1892 in EXECUTE_NORMALIZED
[12:23] [ComfyUI] File "/tmp/comfyui_pvenv_tqf5i7bh/persistent_worker.py", line 1762 in main
[12:23] [ComfyUI] File "/tmp/comfyui_pvenv_tqf5i7bh/persistent_worker.py", line 1807 in <module>
[12:23] [ComfyUI]
[12:23] [ComfyUI] [worker:ComfyUI-PanoPack] === END ===
[12:23] [ComfyUI]
[12:25] [capture-loop] iter=2250 t=248.9s state={'complete': False, 'error': None, 'executedCount': 3, 'wsState': 1} eval_ms=2 ram=24.0/31.3GB (77%) swap=2.1/32.0GB (7%) cpu=11% browser_rss=1.13GB
[12:27] [ComfyUI] [worker:ComfyUI-PanoPack] [PanoramaSplitAdaptive] generating debug_masks equirect image...
[12:30] [capture-loop] iter=2300 t=254.4s state={'complete': False, 'error': None, 'executedCount': 3, 'wsState': 1} eval_ms=2 ram=26.2/31.3GB (84%) swap=2.1/32.0GB (7%) cpu=12% browser_rss=1.13GB
[12:32] [ComfyUI] [worker:ComfyUI-PanoPack] [PanoramaSplitAdaptive] pixels/area: lowest 0.243 -> 0.336 (+38% on the worst-sampled cell), highest 6.44 -> 2.85; spread max/min 26.5x -> 8.5x
[12:32] [ComfyUI] [worker:ComfyUI-PanoPack] [PanoramaSplitAdaptive] done: 42 adaptive faces, 100.678s total
[12:36] [ComfyUI] [SubprocessWorker] got response: ok
[12:36] [ComfyUI] [comfy-env] PanoramaSplitAdaptive done (104.08s): result: NodeOutput
[12:36] [ComfyUI] [VRAM] After PanoramaSplitAdaptive: 6631 / 24122 MB
[12:36] [ComfyUI] [VRAM] Loaded: SubprocessModel (631 MB)
[12:36] [capture-loop] iter=2350 t=259.7s state={'complete': False, 'error': None, 'executedCount': 3, 'wsState': 1} eval_ms=1 ram=20.0/31.3GB (64%) swap=2.2/32.0GB (7%) cpu=11% browser_rss=1.13GB
[12:36] Frame 28 saved (frame_027.jpg, t=259.7s)
[12:36] [capture-periodic] freeze=1ms shot=90ms unfreeze=5ms saved=True
[12:36] [ComfyUI] [comfy-env] Running SharpRayToPlanarDepth: image: torch.float32 [42,1536,1536,3] cpu, intrinsics: torch.float32 [42,3,3] cpu, extrinsics: torch.float32 [42,4,4] cpu
[12:36] [ComfyUI] [ComfyUI-Sharp] python: /tmp/comfytest-home/.ce/.pixi/envs/sharp-nodes/bin/python
[12:36] [ComfyUI] [VRAM] Before SharpRayToPlanarDepth: 6631 / 24122 MB
[12:36] [ComfyUI] [ComfyUI-Sharp] sys_path sent to worker: ['/workspaces/Sharp-2211/ComfyUI', '/workspaces/Sharp-2211/ComfyUI/custom_nodes/ComfyUI-Sharp', '/tmp/comfytest-home/.ce/.pixi/envs/sharp-nodes/lib/python3.1/site-packages', '/workspaces/Sharp-2211/ComfyUI/custom_nodes/ComfyUI-Sharp']
[12:36] [ComfyUI] [VRAM] Loaded: SubprocessModel (631 MB)
[12:36] [ComfyUI] [SubprocessWorker] is_pixi=True, python=/tmp/comfytest-home/.ce/.pixi/envs/sharp-nodes/bin/python
[12:36] [ComfyUI] [SubprocessWorker] call_method: nodes.ray_to_planar_depth.SharpRayToPlanarDepth.EXECUTE_NORMALIZED
[12:36] [ComfyUI] [SubprocessWorker] launching cmd=['/tmp/comfytest-home/.pixi/bin/pixi', 'run', '--as-is', '--manifest-path', '/tmp/comfytest-home/.ce/pixi.toml', '-e', 'sharp-nodes', 'python', '/tmp/comfyui_pvenv_xcjd5ki2/persistent_worker.py', 'abstract://comfy_worker_7ea96d07f1d7']...
[12:36] [ComfyUI] [SubprocessWorker] acquired lock, ensuring started...
[12:36] [ComfyUI] [SubprocessWorker] socket_addr=abstract://comfy_worker_7ea96d07f1d7 (abstract, no filesystem path)
[12:36] [ComfyUI] [ComfyUI-Sharp] Health check: ping (timeout=5.0s)...
[12:36] [ComfyUI] [ComfyUI-Sharp] Health check: failed
[12:36] [ComfyUI] [ComfyUI-Sharp] Socket unhealthy, restarting worker...
[12:36] Node executed (4 total), capturing...
[12:37] Frame 29 saved (frame_028.jpg, t=260.4s)
[12:37] [capture-node] freeze=15ms shot=111ms unfreeze=5ms saved=True
[12:38] [ComfyUI] [worker:ComfyUI-Sharp] ERROR: Failed to import comfy_kitchen, Error: No module named 'comfy_kitchen', fp8 and fp4 support will not be available.
[12:38] [ComfyUI] [worker:ComfyUI-Sharp] WARNING: comfy_kitchen does not support stochastic FP8 rounding, please update comfy_kitchen.
[12:38] [ComfyUI] [SubprocessWorker] worker started/confirmed
[12:38] [ComfyUI] [comfy-env] PRE-SERIALIZE 'image' shape: torch.Size([42, 1536, 1536, 3])
[12:38] [ComfyUI] [comfy-env] PRE-SERIALIZE 'intrinsics' shape: torch.Size([42, 3, 3])
[12:38] [ComfyUI] [comfy-env] PRE-SERIALIZE 'extrinsics' shape: torch.Size([42, 4, 4])
[12:38] [ComfyUI] [SubprocessWorker] serializing kwargs to shm...
[12:38] [ComfyUI] [SubprocessWorker] created 0 shm blocks
[12:38] [ComfyUI] [SubprocessWorker] sending request via socket...
[12:38] [ComfyUI] [SubprocessWorker] call_id=2 sending call_method
[12:38] [ComfyUI] [worker:ComfyUI-Sharp] [comfy-env] _from_shm got dict with keys: ['__type__', 'strategy', 'parent_pid', 'fd', 'storage_size']
[12:38] [ComfyUI] [worker:ComfyUI-Sharp] [comfy-env] DESERIALIZE TensorRef: tensor_size=[42, 1536, 1536, 3]
[12:38] [ComfyUI] [worker:ComfyUI-Sharp] [comfy-env] DESERIALIZED tensor shape: torch.Size([42, 1536, 1536, 3])
[12:38] [ComfyUI] [worker:ComfyUI-Sharp] [comfy-env] _from_shm got dict with keys: ['__type__', 'strategy', 'parent_pid', 'fd', 'storage_size']
[12:38] [ComfyUI] [worker:ComfyUI-Sharp] [comfy-env] DESERIALIZE TensorRef: tensor_size=[42, 3, 3]
[12:38] [ComfyUI] [worker:ComfyUI-Sharp] [comfy-env] DESERIALIZED tensor shape: torch.Size([42, 3, 3])
[12:38] [ComfyUI] [worker:ComfyUI-Sharp] [comfy-env] _from_shm got dict with keys: ['__type__', 'strategy', 'parent_pid', 'fd', 'storage_size']
[12:38] [ComfyUI] [worker:ComfyUI-Sharp] [comfy-env] DESERIALIZE TensorRef: tensor_size=[42, 4, 4]
[12:38] [ComfyUI] [worker:ComfyUI-Sharp] [comfy-env] DESERIALIZED tensor shape: torch.Size([42, 4, 4])
[12:38] [ComfyUI] [worker:ComfyUI-Sharp] [SharpRayToPlanarDepth] detected normalized intrinsics (fx<2); rescaled to pixel-K for 1536×1536: fx=768.0
[12:40] [ComfyUI] [worker:ComfyUI-Sharp] [SharpRayToPlanarDepth] ray->planar: B=42 1536×1536, cos_map per-face (3D K), intrinsics_rescaled fx=768.0 cx=768.0
[12:41] [ComfyUI] [SubprocessWorker] got response: ok
[12:41] [ComfyUI] [comfy-env] SharpRayToPlanarDepth done (4.85s): result: NodeOutput
[12:41] [ComfyUI] [VRAM] After SharpRayToPlanarDepth: 6631 / 24122 MB
[12:41] [ComfyUI] [VRAM] Loaded: SubprocessModel (631 MB)
[12:41] [ComfyUI] [comfy-env] Running SharpPredictGaussiansFromMetricDepth: snap_to_external_depth: 'none', depth_convention: 'planar_z', focal_length_mm: 30.0, output_prefix: 'sharp_aligned', save_background_layer: True, edge_crop: 0.0, model: dict, image: torch.float32 [42,1536,1536,3] cpu, metric_depth_layer0: torch.float32 [42,1536,1536,3] cpu, extrinsics: torch.float32 [42,4,4] cpu, intrinsics: torch.float32 [42,3,3] cpu, mask: torch.float32 [42,1536,1536] cpu
[12:41] [ComfyUI] [VRAM] Before SharpPredictGaussiansFromMetricDepth: 6631 / 24122 MB
[12:41] [ComfyUI] [VRAM] Loaded: SubprocessModel (631 MB)
[12:41] [ComfyUI] [SubprocessWorker] call_method: nodes.predict_gaussians_from_depth.SharpPredictGaussiansFromMetricDepth.EXECUTE_NORMALIZED
[12:41] [ComfyUI] [SubprocessWorker] acquired lock, ensuring started...
[12:41] [ComfyUI] [ComfyUI-Sharp] Health check: ping (timeout=5.0s)...
[12:41] [ComfyUI] [ComfyUI-Sharp] Health check: ok
[12:41] [ComfyUI] [SubprocessWorker] worker started/confirmed
[12:41] [ComfyUI] [comfy-env] PRE-SERIALIZE 'image' shape: torch.Size([42, 1536, 1536, 3])
[12:41] [ComfyUI] [comfy-env] PRE-SERIALIZE 'metric_depth_layer0' shape: torch.Size([42, 1536, 1536, 3])
[12:41] [ComfyUI] [comfy-env] PRE-SERIALIZE 'extrinsics' shape: torch.Size([42, 4, 4])
[12:41] [ComfyUI] [comfy-env] PRE-SERIALIZE 'intrinsics' shape: torch.Size([42, 3, 3])
[12:41] [ComfyUI] [comfy-env] PRE-SERIALIZE 'mask' shape: torch.Size([42, 1536, 1536])
[12:41] [ComfyUI] [SubprocessWorker] serializing kwargs to shm...
[12:42] [capture-loop] iter=2400 t=265.5s state={'complete': False, 'error': None, 'executedCount': 4, 'wsState': 1} eval_ms=1 ram=23.5/31.3GB (75%) swap=2.2/32.0GB (7%) cpu=14% browser_rss=1.21GB
[12:42] [ComfyUI] [SubprocessWorker] created 0 shm blocks
[12:42] [ComfyUI] [SubprocessWorker] sending request via socket...
[12:42] [ComfyUI] [SubprocessWorker] call_id=3 sending call_method
[12:42] [ComfyUI] [worker:ComfyUI-Sharp] [comfy-env] _from_shm got dict with keys: ['__type__', 'strategy', 'parent_pid', 'fd', 'storage_size']
[12:42] [ComfyUI] [worker:ComfyUI-Sharp] [comfy-env] DESERIALIZE TensorRef: tensor_size=[42, 1536, 1536, 3]
[12:42] [ComfyUI] [worker:ComfyUI-Sharp] [comfy-env] DESERIALIZED tensor shape: torch.Size([42, 1536, 1536, 3])
[12:42] [ComfyUI] [worker:ComfyUI-Sharp] [comfy-env] _from_shm got dict with keys: ['__type__', 'strategy', 'parent_pid', 'fd', 'storage_size']
[12:42] [ComfyUI] [worker:ComfyUI-Sharp] [comfy-env] DESERIALIZE TensorRef: tensor_size=[42, 1536, 1536, 3]
[12:42] [ComfyUI] [worker:ComfyUI-Sharp] [comfy-env] DESERIALIZED tensor shape: torch.Size([42, 1536, 1536, 3])
[12:42] [ComfyUI] [worker:ComfyUI-Sharp] [comfy-env] _from_shm got dict with keys: ['__type__', 'strategy', 'parent_pid', 'fd', 'storage_size']
[12:42] [ComfyUI] [worker:ComfyUI-Sharp] [comfy-env] DESERIALIZE TensorRef: tensor_size=[42, 4, 4]
[12:42] [ComfyUI] [worker:ComfyUI-Sharp] [comfy-env] DESERIALIZED tensor shape: torch.Size([42, 4, 4])
[12:42] [ComfyUI] [worker:ComfyUI-Sharp] [comfy-env] _from_shm got dict with keys: ['__type__', 'strategy', 'parent_pid', 'fd', 'storage_size']
[12:42] [ComfyUI] [worker:ComfyUI-Sharp] [comfy-env] DESERIALIZE TensorRef: tensor_size=[42, 3, 3]
[12:42] [ComfyUI] [worker:ComfyUI-Sharp] [comfy-env] DESERIALIZED tensor shape: torch.Size([42, 3, 3])
[12:42] [ComfyUI] [worker:ComfyUI-Sharp] [comfy-env] _from_shm got dict with keys: ['__type__', 'strategy', 'parent_pid', 'fd', 'storage_size']
[12:42] [ComfyUI] [worker:ComfyUI-Sharp] [comfy-env] DESERIALIZE TensorRef: tensor_size=[42, 1536, 1536]
[12:42] [ComfyUI] [worker:ComfyUI-Sharp] [comfy-env] DESERIALIZED tensor shape: torch.Size([42, 1536, 1536])
[12:43] Frame 30 saved (frame_029.jpg, t=267.0s)
[12:43] [capture-periodic] freeze=1ms shot=98ms unfreeze=14ms saved=True
[12:46] [ComfyUI] [worker:ComfyUI-Sharp] [LoadSharpModel] loading checkpoint from /workspaces/Sharp-2211/ComfyUI/models/sharp/sharp_2572gikvuh.pt (dtype=bf16)
[12:47] [capture-loop] iter=2450 t=270.9s state={'complete': False, 'error': None, 'executedCount': 4, 'wsState': 1} eval_ms=1 ram=25.1/31.3GB (80%) swap=2.2/32.0GB (7%) cpu=14% browser_rss=1.21GB
[12:50] [ComfyUI] [worker:ComfyUI-Sharp] [LoadSharpModel] initializing model on meta device...
[12:50] [ComfyUI] [worker:ComfyUI-Sharp] [LoadSharpModel] model ready (torch.bfloat16)
[12:50] [ComfyUI] [worker:ComfyUI-Sharp] [SharpPredictGaussiansFromMetricDepth] metric_depth_layer1 unwired -> layer 1 will duplicate layer 0 (legacy behavior)
[12:50] [ComfyUI] [SubprocessWorker] callback 'request_vram_budget' from call_id=3
[12:50] [ComfyUI] [comfy-env] VRAM request: 2.81GB, free before eviction: 18.34GB
[12:50] [ComfyUI] [comfy-env] VRAM after eviction: 18.34GB
[12:50] [ComfyUI] [worker:ComfyUI-Sharp] [VRAM] +635MB (now 635MB) reserved=640MB peak=635MB
[12:50] [ComfyUI] [worker:ComfyUI-Sharp] [SharpPredictGaussiansFromMetricDepth] face 1/42: 1536×1536, extrinsics=[-0.00, -0.00, -0.00], intrinsics=fx=0.5000 cx=0.5000, mask=yes, snap=none, depth_conv=planar_z
[12:51] [ComfyUI] [worker:ComfyUI-Sharp] [VRAM] +2661MB (now 3296MB) reserved=3424MB peak=3314MB
[12:52] [ComfyUI] [worker:ComfyUI-Sharp] [VRAM] +2618MB (now 5914MB) reserved=6752MB peak=5914MB
[12:52] [capture-loop] iter=2500 t=276.4s state={'complete': False, 'error': None, 'executedCount': 4, 'wsState': 1} eval_ms=1 ram=22.6/31.3GB (72%) swap=4.5/32.0GB (14%) cpu=18% browser_rss=1.07GB
[12:53] [ComfyUI] [worker:ComfyUI-Sharp] [VRAM] -1742MB (now 4173MB) reserved=7584MB peak=7062MB
[12:54] [ComfyUI] [worker:ComfyUI-Sharp] [SharpPredictGaussiansFromMetricDepth] detected normalized intrinsics (fx<2); rescaled to pixel-K for 1536x1536: fx=768.0 cx=768.0
[12:54] [ComfyUI] [worker:ComfyUI-Sharp] [VRAM] +564MB (now 4737MB) reserved=7104MB peak=7062MB
[12:55] [ComfyUI] [worker:ComfyUI-Sharp] [SharpPredictGaussiansFromMetricDepth] mask -> kept 89266/1179648 gaussians (7.6%)
[12:55] [ComfyUI] [SubprocessWorker] callback 'report_progress' from call_id=3
[12:55] [ComfyUI] [worker:ComfyUI-Sharp] [SharpPredictGaussiansFromMetricDepth] face 2/42: 1536×1536, extrinsics=[-0.00, -0.00, -0.00], intrinsics=fx=0.5000 cx=0.5000, mask=yes, snap=none, depth_conv=planar_z
[12:55] [ComfyUI] [worker:ComfyUI-Sharp] [VRAM] +407MB (now 5145MB) reserved=7104MB peak=7062MB
[12:56] Frame 31 saved (frame_030.jpg, t=280.0s)
[12:56] [capture-periodic] freeze=1ms shot=101ms unfreeze=5ms saved=True
[12:57] [ComfyUI] [worker:ComfyUI-Sharp] [VRAM] -555MB (now 4590MB) reserved=9824MB peak=7062MB
[12:58] [capture-loop] iter=2550 t=281.8s state={'complete': False, 'error': None, 'executedCount': 4, 'wsState': 1} eval_ms=1 ram=25.0/31.3GB (80%) swap=5.9/32.0GB (18%) cpu=13% browser_rss=1.05GB
[13:00] [ComfyUI] [SubprocessWorker] callback 'report_progress' from call_id=3
[13:00] [ComfyUI] [worker:ComfyUI-Sharp] [SharpPredictGaussiansFromMetricDepth] face 3/42: 1536×1536, extrinsics=[-0.00, -0.00, -0.00], intrinsics=fx=0.5000 cx=0.5000, mask=yes, snap=none, depth_conv=planar_z
[13:00] [ComfyUI] [worker:ComfyUI-Sharp] [VRAM] +556MB (now 5147MB) reserved=7296MB peak=7062MB
[13:01] Frame 32 saved (frame_031.jpg, t=284.4s)
[13:01] [capture-periodic] freeze=1ms shot=103ms unfreeze=5ms saved=True
[13:01] [ComfyUI] [worker:ComfyUI-Sharp] [VRAM] -555MB (now 4592MB) reserved=11456MB peak=7062MB
[13:03] [capture-loop] iter=2600 t=287.3s state={'complete': False, 'error': None, 'executedCount': 4, 'wsState': 1} eval_ms=1 ram=22.2/31.3GB (71%) swap=7.2/32.0GB (22%) cpu=13% browser_rss=1.00GB
[13:04] [ComfyUI] [SubprocessWorker] callback 'report_progress' from call_id=3
[13:04] [ComfyUI] [worker:ComfyUI-Sharp] [SharpPredictGaussiansFromMetricDepth] face 4/42: 1536×1536, extrinsics=[-0.00, -0.00, -0.00], intrinsics=fx=0.5000 cx=0.5000, mask=yes, snap=none, depth_conv=planar_z
[13:04] [ComfyUI] [worker:ComfyUI-Sharp] [VRAM] +514MB (now 5107MB) reserved=7616MB peak=7062MB
[13:05] Frame 33 saved (frame_032.jpg, t=288.8s)
[13:05] [capture-periodic] freeze=1ms shot=104ms unfreeze=4ms saved=True
[13:05] [ComfyUI] [worker:ComfyUI-Sharp] [VRAM] +345MB (now 5453MB) reserved=6208MB peak=7062MB
[13:06] [ComfyUI] [worker:ComfyUI-Sharp] [VRAM] -864MB (now 4589MB) reserved=10624MB peak=7062MB
[13:08] [ComfyUI] [SubprocessWorker] callback 'report_progress' from call_id=3
[13:08] [ComfyUI] [worker:ComfyUI-Sharp] [SharpPredictGaussiansFromMetricDepth] face 5/42: 1536×1536, extrinsics=[-0.00, -0.00, -0.00], intrinsics=fx=0.5000 cx=0.5000, mask=yes, snap=none, depth_conv=planar_z
[13:08] [ComfyUI] [worker:ComfyUI-Sharp] [VRAM] +567MB (now 5157MB) reserved=7328MB peak=7062MB
[13:09] [capture-loop] iter=2650 t=292.7s state={'complete': False, 'error': None, 'executedCount': 4, 'wsState': 1} eval_ms=1 ram=22.5/31.3GB (72%) swap=7.2/32.0GB (22%) cpu=15% browser_rss=1.00GB
[13:09] Frame 34 saved (frame_033.jpg, t=293.1s)
[13:09] [capture-periodic] freeze=1ms shot=99ms unfreeze=7ms saved=True
[13:09] [ComfyUI] [worker:ComfyUI-Sharp] [VRAM] -564MB (now 4593MB) reserved=10752MB peak=7062MB
[13:12] [ComfyUI] [SubprocessWorker] callback 'report_progress' from call_id=3
[13:12] [ComfyUI] [worker:ComfyUI-Sharp] [SharpPredictGaussiansFromMetricDepth] face 6/42: 1536×1536, extrinsics=[-0.00, -0.00, -0.00], intrinsics=fx=0.5000 cx=0.5000, mask=yes, snap=none, depth_conv=planar_z
[13:12] [ComfyUI] [worker:ComfyUI-Sharp] [VRAM] +523MB (now 5117MB) reserved=7744MB peak=7062MB
[13:13] [ComfyUI] [worker:ComfyUI-Sharp] [VRAM] -528MB (now 4590MB) reserved=10144MB peak=7062MB
[13:14] Frame 35 saved (frame_034.jpg, t=297.4s)
[13:14] [capture-periodic] freeze=1ms shot=104ms unfreeze=4ms saved=True
[13:14] [capture-loop] iter=2700 t=298.2s state={'complete': False, 'error': None, 'executedCount': 4, 'wsState': 1} eval_ms=1 ram=23.5/31.3GB (75%) swap=7.4/32.0GB (23%) cpu=13% browser_rss=0.98GB
[13:16] [ComfyUI] [SubprocessWorker] callback 'report_progress' from call_id=3
[13:16] [ComfyUI] [worker:ComfyUI-Sharp] [SharpPredictGaussiansFromMetricDepth] face 7/42: 1536×1536, extrinsics=[-0.00, -0.00, -0.00], intrinsics=fx=0.5000 cx=0.5000, mask=yes, snap=none, depth_conv=planar_z
[13:16] [ComfyUI] [worker:ComfyUI-Sharp] [VRAM] +552MB (now 5142MB) reserved=7648MB peak=7062MB
[13:17] [ComfyUI] [worker:ComfyUI-Sharp] [VRAM] -555MB (now 4588MB) reserved=11584MB peak=7062MB
[13:18] Frame 36 saved (frame_035.jpg, t=301.8s)
[13:18] [capture-periodic] freeze=1ms shot=104ms unfreeze=5ms saved=True
[13:20] [capture-loop] iter=2750 t=303.6s state={'complete': False, 'error': None, 'executedCount': 4, 'wsState': 1} eval_ms=1 ram=22.2/31.3GB (71%) swap=7.6/32.0GB (24%) cpu=12% browser_rss=0.97GB
[13:20] [ComfyUI] [SubprocessWorker] callback 'report_progress' from call_id=3
[13:20] [ComfyUI] [worker:ComfyUI-Sharp] [SharpPredictGaussiansFromMetricDepth] face 8/42: 1536×1536, extrinsics=[-0.00, -0.00, -0.00], intrinsics=fx=0.5000 cx=0.5000, mask=yes, snap=none, depth_conv=planar_z
[13:20] [ComfyUI] [worker:ComfyUI-Sharp] [VRAM] +556MB (now 5145MB) reserved=7936MB peak=7062MB
[13:20] Frame 37 saved (frame_036.jpg, t=304.0s)
[13:20] [capture-periodic] freeze=1ms shot=110ms unfreeze=6ms saved=True
[13:21] [ComfyUI] [worker:ComfyUI-Sharp] [VRAM] -555MB (now 4591MB) reserved=10656MB peak=7062MB
[13:24] [ComfyUI] [SubprocessWorker] callback 'report_progress' from call_id=3
[13:24] [ComfyUI] [worker:ComfyUI-Sharp] [SharpPredictGaussiansFromMetricDepth] face 9/42: 1536×1536, extrinsics=[-0.00, -0.00, -0.00], intrinsics=fx=0.5000 cx=0.5000, mask=yes, snap=none, depth_conv=planar_z
[13:24] [ComfyUI] [worker:ComfyUI-Sharp] [VRAM] +520MB (now 5111MB) reserved=7904MB peak=7062MB
[13:25] Frame 38 saved (frame_037.jpg, t=308.4s)
[13:25] [capture-periodic] freeze=1ms shot=114ms unfreeze=14ms saved=True
[13:25] [capture-loop] iter=2800 t=309.1s state={'complete': False, 'error': None, 'executedCount': 4, 'wsState': 1} eval_ms=1 ram=22.2/31.3GB (71%) swap=7.6/32.0GB (24%) cpu=14% browser_rss=0.97GB
[13:25] [ComfyUI] [worker:ComfyUI-Sharp] [VRAM] -519MB (now 4593MB) reserved=10688MB peak=7062MB
[13:28] [ComfyUI] [SubprocessWorker] callback 'report_progress' from call_id=3
[13:28] [ComfyUI] [worker:ComfyUI-Sharp] [SharpPredictGaussiansFromMetricDepth] face 10/42: 1536×1536, extrinsics=[-0.00, -0.00, -0.00], intrinsics=fx=0.5000 cx=0.5000, mask=yes, snap=none, depth_conv=planar_z
[13:28] [ComfyUI] [worker:ComfyUI-Sharp] [VRAM] +508MB (now 5101MB) reserved=8000MB peak=7062MB
[13:29] Frame 39 saved (frame_038.jpg, t=312.7s)
[13:29] [capture-periodic] freeze=1ms shot=100ms unfreeze=5ms saved=True
[13:30] [ComfyUI] [worker:ComfyUI-Sharp] [VRAM] -510MB (now 4592MB) reserved=12160MB peak=7062MB
[13:31] [capture-loop] iter=2850 t=314.5s state={'complete': False, 'error': None, 'executedCount': 4, 'wsState': 1} eval_ms=1 ram=23.5/31.3GB (75%) swap=7.6/32.0GB (24%) cpu=11% browser_rss=0.97GB
[13:32] [ComfyUI] [SubprocessWorker] callback 'report_progress' from call_id=3
[13:32] [ComfyUI] [worker:ComfyUI-Sharp] [SharpPredictGaussiansFromMetricDepth] face 11/42: 1536×1536, extrinsics=[-0.00, -0.00, -0.00], intrinsics=fx=0.5000 cx=0.5000, mask=yes, snap=none, depth_conv=planar_z
[13:32] [ComfyUI] [worker:ComfyUI-Sharp] [VRAM] +578MB (now 5170MB) reserved=7872MB peak=7062MB
[13:33] Frame 40 saved (frame_039.jpg, t=317.1s)
[13:33] [capture-periodic] freeze=1ms shot=105ms unfreeze=2ms saved=True
[13:34] [ComfyUI] [worker:ComfyUI-Sharp] [VRAM] -582MB (now 4589MB) reserved=11616MB peak=7062MB
[13:36] [capture-loop] iter=2900 t=320.0s state={'complete': False, 'error': None, 'executedCount': 4, 'wsState': 1} eval_ms=1 ram=22.4/31.3GB (72%) swap=7.6/32.0GB (24%) cpu=14% browser_rss=0.97GB
[13:36] [ComfyUI] [SubprocessWorker] callback 'report_progress' from call_id=3
[13:36] [ComfyUI] [worker:ComfyUI-Sharp] [SharpPredictGaussiansFromMetricDepth] face 12/42: 1536×1536, extrinsics=[-0.00, -0.00, -0.00], intrinsics=fx=0.5000 cx=0.5000, mask=yes, snap=none, depth_conv=planar_z
[13:36] [ComfyUI] [worker:ComfyUI-Sharp]
[13:36] [ComfyUI] === WATCHDOG TICK 1 ===
[13:36] [ComfyUI] [worker:ComfyUI-Sharp] Thread 0x00007f1480bff640 (most recent call first):
[13:36] [ComfyUI] File "/tmp/comfytest-home/.ce/.pixi/envs/sharp-nodes/lib/python3.11/socket.py", line 294 in accept
[13:36] [ComfyUI] File "/tmp/comfytest-home/.ce/.pixi/envs/sharp-nodes/lib/python3.11/multiprocessing/connection.py", line 626 in accept
[13:36] [ComfyUI] File "/tmp/comfytest-home/.ce/.pixi/envs/sharp-nodes/lib/python3.11/multiprocessing/connection.py", line 480 in accept
[13:36] [ComfyUI] File "/tmp/comfytest-home/.ce/.pixi/envs/sharp-nodes/lib/python3.11/multiprocessing/resource_sharer.py", line 138 in _serve
[13:36] [ComfyUI] File "/tmp/comfytest-home/.ce/.pixi/envs/sharp-nodes/lib/python3.11/threading.py", line 982 in run
[13:36] [ComfyUI] File "/tmp/comfytest-home/.ce/.pixi/envs/sharp-nodes/lib/python3.11/threading.py", line 1045 in _bootstrap_inner
[13:36] [ComfyUI] File "/tmp/comfytest-home/.ce/.pixi/envs/sharp-nodes/lib/python3.11/threading.py", line 1002 in _bootstrap
[13:36] [ComfyUI]
[13:36] [ComfyUI] Thread 0x00007f1634a0f640 (most recent call first):
[13:36] [ComfyUI] File "/tmp/comfyui_pvenv_xcjd5ki2/persistent_worker.py", line 106 in _vram_poller
[13:36] [ComfyUI] File "/tmp/comfytest-home/.ce/.pixi/envs/sharp-nodes/lib/python3.11/threading.py", line 982 in run
[13:36] [ComfyUI] File "/tmp/comfytest-home/.ce/.pixi/envs/sharp-nodes/lib/python3.11/threading.py", line 1045 in _bootstrap_inner
[13:36] [ComfyUI] File "/tmp/comfytest-home/.ce/.pixi/envs/sharp-nodes/lib/python3.11/threading.py", line 1002 in _bootstrap
[13:36] [ComfyUI]
[13:36] [ComfyUI] Current thread 0x00007f1635214640 (most recent call first):
[13:36] [ComfyUI] File "/tmp/comfyui_pvenv_xcjd5ki2/persistent_worker.py", line 52 in _watchdog
[13:36] [ComfyUI] File "/tmp/comfytest-home/.ce/.pixi/envs/sharp-nodes/lib/python3.11/threading.py", line 982 in run
[13:36] [ComfyUI] File "/tmp/comfytest-home/.ce/.pixi/envs/sharp-nodes/lib/python3.11/threading.py", line 1045 in _bootstrap_inner
[13:36] [ComfyUI] File "/tmp/comfytest-home/.ce/.pixi/envs/sharp-nodes/lib/python3.11/threading.py", line 1002 in _bootstrap
[13:36] [ComfyUI]
[13:36] [ComfyUI] Thread 0x00007f1635834740 (most recent call first):
[13:36] [ComfyUI] File "/workspaces/Sharp-2211/ComfyUI/custom_nodes/ComfyUI-Sharp/nodes/predict_gaussians_from_depth.py", line 385 in execute
[13:36] [ComfyUI] File "/tmp/comfytest-home/.ce/.pixi/envs/sharp-nodes/lib/python3.11/site-packages/torch/utils/_contextlib.py", line 124 in decorate_context
[13:36] [ComfyUI] File "/workspaces/Sharp-2211/ComfyUI/comfy_api/latest/_io.py", line 1892 in EXECUTE_NORMALIZED
[13:36] [ComfyUI] File "/tmp/comfyui_pvenv_xcjd5ki2/persistent_worker.py", line 1762 in main
[13:36] [ComfyUI] File "/tmp/comfyui_pvenv_xcjd5ki2/persistent_worker.py", line 1807 in <module>
[13:36] [ComfyUI]
[13:36] [ComfyUI] [worker:ComfyUI-Sharp] === END ===
[13:36] [ComfyUI]
[13:36] [ComfyUI] [worker:ComfyUI-Sharp] [VRAM] +555MB (now 5144MB) reserved=7328MB peak=7062MB
[13:38] Frame 41 saved (frame_040.jpg, t=321.4s)
[13:38] [capture-periodic] freeze=1ms shot=97ms unfreeze=1ms saved=True
[13:38] [ComfyUI] [worker:ComfyUI-Sharp] [VRAM] -555MB (now 4590MB) reserved=10048MB peak=7062MB
[13:40] [ComfyUI] [SubprocessWorker] callback 'report_progress' from call_id=3
[13:40] [ComfyUI] [worker:ComfyUI-Sharp] [SharpPredictGaussiansFromMetricDepth] face 13/42: 1536×1536, extrinsics=[-0.00, -0.00, -0.00], intrinsics=fx=0.5000 cx=0.5000, mask=yes, snap=none, depth_conv=planar_z
[13:40] [ComfyUI] [worker:ComfyUI-Sharp] [VRAM] +519MB (now 5110MB) reserved=7584MB peak=7062MB
[13:41] [capture-loop] iter=2950 t=325.3s state={'complete': False, 'error': None, 'executedCount': 4, 'wsState': 1} eval_ms=1 ram=22.3/31.3GB (71%) swap=7.6/32.0GB (24%) cpu=11% browser_rss=0.98GB
[13:42] [ComfyUI] [worker:ComfyUI-Sharp] [VRAM] -281MB (now 4830MB) reserved=5440MB peak=7062MB
[13:42] Frame 42 saved (frame_041.jpg, t=325.8s)
[13:42] [capture-periodic] freeze=1ms shot=95ms unfreeze=5ms saved=True
[13:43] [ComfyUI] [worker:ComfyUI-Sharp] [VRAM] -238MB (now 4592MB) reserved=10176MB peak=7062MB
[13:44] [ComfyUI] [SubprocessWorker] callback 'report_progress' from call_id=3
[13:44] [ComfyUI] [worker:ComfyUI-Sharp] [SharpPredictGaussiansFromMetricDepth] face 14/42: 1536×1536, extrinsics=[-0.00, -0.00, -0.00], intrinsics=fx=0.5000 cx=0.5000, mask=yes, snap=none, depth_conv=planar_z
[13:44] [ComfyUI] [worker:ComfyUI-Sharp] [VRAM] +574MB (now 5166MB) reserved=7744MB peak=7062MB
[13:46] [ComfyUI] [worker:ComfyUI-Sharp] [VRAM] -573MB (now 4594MB) reserved=10144MB peak=7062MB
[13:46] Frame 43 saved (frame_042.jpg, t=330.1s)
[13:46] [capture-periodic] freeze=1ms shot=102ms unfreeze=6ms saved=True
[13:47] [capture-loop] iter=3000 t=330.9s state={'complete': False, 'error': None, 'executedCount': 4, 'wsState': 1} eval_ms=1 ram=23.4/31.3GB (75%) swap=7.6/32.0GB (24%) cpu=11% browser_rss=0.98GB
[13:48] [ComfyUI] [SubprocessWorker] callback 'report_progress' from call_id=3
[13:48] [ComfyUI] [worker:ComfyUI-Sharp] [SharpPredictGaussiansFromMetricDepth] face 15/42: 1536×1536, extrinsics=[-0.00, -0.00, -0.00], intrinsics=fx=0.5000 cx=0.5000, mask=yes, snap=none, depth_conv=planar_z
[13:49] [ComfyUI] [worker:ComfyUI-Sharp] [VRAM] +581MB (now 5176MB) reserved=7264MB peak=7062MB
[13:50] [ComfyUI] [worker:ComfyUI-Sharp] [VRAM] -582MB (now 4595MB) reserved=10144MB peak=7062MB
[13:51] Frame 44 saved (frame_043.jpg, t=334.5s)
[13:51] [capture-periodic] freeze=1ms shot=106ms unfreeze=1ms saved=True
[13:52] [capture-loop] iter=3050 t=336.2s state={'complete': False, 'error': None, 'executedCount': 4, 'wsState': 1} eval_ms=1 ram=22.3/31.3GB (71%) swap=7.6/32.0GB (24%) cpu=11% browser_rss=0.99GB
[13:52] [ComfyUI] [SubprocessWorker] callback 'report_progress' from call_id=3
[13:53] [ComfyUI] [worker:ComfyUI-Sharp] [SharpPredictGaussiansFromMetricDepth] face 16/42: 1536×1536, extrinsics=[-0.00, -0.00, -0.00], intrinsics=fx=0.5000 cx=0.5000, mask=yes, snap=none, depth_conv=planar_z
[13:53] [ComfyUI] [worker:ComfyUI-Sharp] [VRAM] +517MB (now 5113MB) reserved=7744MB peak=7062MB
[13:53] Frame 45 saved (frame_044.jpg, t=336.7s)
[13:53] [capture-periodic] freeze=4ms shot=102ms unfreeze=1ms saved=True
[13:54] [ComfyUI] [worker:ComfyUI-Sharp] [VRAM] -519MB (now 4595MB) reserved=10176MB peak=7062MB
[13:56] [ComfyUI] [SubprocessWorker] callback 'report_progress' from call_id=3
[13:56] [ComfyUI] [worker:ComfyUI-Sharp] [SharpPredictGaussiansFromMetricDepth] face 17/42: 1536×1536, extrinsics=[-0.00, -0.00, -0.00], intrinsics=fx=0.5000 cx=0.5000, mask=yes, snap=none, depth_conv=planar_z
[13:57] [ComfyUI] [worker:ComfyUI-Sharp] [VRAM] +549MB (now 5144MB) reserved=7840MB peak=7062MB
[13:57] Frame 46 saved (frame_045.jpg, t=341.1s)
[13:57] [capture-periodic] freeze=1ms shot=102ms unfreeze=1ms saved=True
[13:58] [capture-loop] iter=3100 t=341.9s state={'complete': False, 'error': None, 'executedCount': 4, 'wsState': 1} eval_ms=1 ram=22.6/31.3GB (72%) swap=7.6/32.0GB (24%) cpu=12% browser_rss=0.99GB
[13:58] [ComfyUI] [worker:ComfyUI-Sharp] [VRAM] -319MB (now 4825MB) reserved=5376MB peak=7062MB
[13:59] [ComfyUI] [worker:ComfyUI-Sharp] [VRAM] -236MB (now 4589MB) reserved=10144MB peak=7062MB
[14:01] [ComfyUI] [SubprocessWorker] callback 'report_progress' from call_id=3
[14:01] [ComfyUI] [worker:ComfyUI-Sharp] [SharpPredictGaussiansFromMetricDepth] face 18/42: 1536×1536, extrinsics=[-0.00, -0.00, -0.00], intrinsics=fx=0.5000 cx=0.5000, mask=yes, snap=none, depth_conv=planar_z
[14:01] [ComfyUI] [worker:ComfyUI-Sharp] [VRAM] +526MB (now 5116MB) reserved=7488MB peak=7062MB
[14:02] Frame 47 saved (frame_046.jpg, t=345.4s)
[14:02] [capture-periodic] freeze=1ms shot=106ms unfreeze=2ms saved=True
[14:02] [ComfyUI] [worker:ComfyUI-Sharp] [VRAM] -528MB (now 4589MB) reserved=10176MB peak=7062MB
[14:03] [capture-loop] iter=3150 t=347.2s state={'complete': False, 'error': None, 'executedCount': 4, 'wsState': 1} eval_ms=1 ram=23.5/31.3GB (75%) swap=7.9/32.0GB (25%) cpu=15% browser_rss=0.99GB
[14:04] [ComfyUI] [SubprocessWorker] callback 'report_progress' from call_id=3
[14:04] [ComfyUI] [worker:ComfyUI-Sharp] [SharpPredictGaussiansFromMetricDepth] face 19/42: 1536×1536, extrinsics=[-0.00, -0.00, -0.00], intrinsics=fx=0.5000 cx=0.5000, mask=yes, snap=none, depth_conv=planar_z
[14:05] [ComfyUI] [worker:ComfyUI-Sharp] [VRAM] +562MB (now 5152MB) reserved=7840MB peak=7062MB
[14:06] Frame 48 saved (frame_047.jpg, t=349.8s)
[14:06] [capture-periodic] freeze=1ms shot=107ms unfreeze=5ms saved=True
[14:06] [ComfyUI] [worker:ComfyUI-Sharp] [VRAM] -564MB (now 4589MB) reserved=10176MB peak=7062MB
[14:09] [ComfyUI] [SubprocessWorker] callback 'report_progress' from call_id=3
[14:09] [ComfyUI] [worker:ComfyUI-Sharp] [SharpPredictGaussiansFromMetricDepth] face 20/42: 1536×1536, extrinsics=[-0.00, -0.00, -0.00], intrinsics=fx=0.5000 cx=0.5000, mask=yes, snap=none, depth_conv=planar_z
[14:09] [capture-loop] iter=3200 t=352.7s state={'complete': False, 'error': None, 'executedCount': 4, 'wsState': 1} eval_ms=2 ram=22.3/31.3GB (71%) swap=7.9/32.0GB (25%) cpu=12% browser_rss=0.99GB
[14:09] [ComfyUI] [worker:ComfyUI-Sharp] [VRAM] +527MB (now 5116MB) reserved=7296MB peak=7062MB
[14:10] [ComfyUI] [worker:ComfyUI-Sharp] [VRAM] +336MB (now 5453MB) reserved=6208MB peak=7062MB
[14:10] Frame 49 saved (frame_048.jpg, t=354.1s)
[14:10] [capture-periodic] freeze=1ms shot=106ms unfreeze=5ms saved=True
[14:11] [ComfyUI] [worker:ComfyUI-Sharp] [VRAM] -864MB (now 4589MB) reserved=11616MB peak=7062MB
[14:13] [ComfyUI] [SubprocessWorker] callback 'report_progress' from call_id=3
[14:13] [ComfyUI] [worker:ComfyUI-Sharp] [SharpPredictGaussiansFromMetricDepth] face 21/42: 1536×1536, extrinsics=[-0.00, -0.00, -0.00], intrinsics=fx=0.5000 cx=0.5000, mask=yes, snap=none, depth_conv=planar_z
[14:13] [ComfyUI] [worker:ComfyUI-Sharp] [VRAM] +581MB (now 5170MB) reserved=7904MB peak=7062MB
[14:14] [capture-loop] iter=3250 t=358.1s state={'complete': False, 'error': None, 'executedCount': 4, 'wsState': 1} eval_ms=1 ram=22.4/31.3GB (72%) swap=7.9/32.0GB (25%) cpu=12% browser_rss=0.92GB
[14:14] [ComfyUI] [worker:ComfyUI-Sharp] [VRAM] -582MB (now 4589MB) reserved=12128MB peak=7062MB
[14:15] Frame 50 saved (frame_049.jpg, t=358.5s)
[14:15] [capture-periodic] freeze=1ms shot=96ms unfreeze=5ms saved=True
[14:17] [ComfyUI] [SubprocessWorker] callback 'report_progress' from call_id=3
[14:17] [ComfyUI] [worker:ComfyUI-Sharp] [SharpPredictGaussiansFromMetricDepth] face 22/42: 1536×1536, extrinsics=[-0.00, -0.00, -0.00], intrinsics=fx=0.5000 cx=0.5000, mask=yes, snap=none, depth_conv=planar_z
[14:17] [ComfyUI] [worker:ComfyUI-Sharp] [VRAM] +582MB (now 5171MB) reserved=7648MB peak=7062MB
[14:19] [ComfyUI] [worker:ComfyUI-Sharp] [VRAM] -582MB (now 4590MB) reserved=9984MB peak=7062MB
[14:19] Frame 51 saved (frame_050.jpg, t=362.8s)
[14:19] [capture-periodic] freeze=1ms shot=100ms unfreeze=5ms saved=True
[14:20] [capture-loop] iter=3300 t=363.6s state={'complete': False, 'error': None, 'executedCount': 4, 'wsState': 1} eval_ms=1 ram=23.9/31.3GB (76%) swap=7.9/32.0GB (25%) cpu=12% browser_rss=0.93GB
[14:21] [ComfyUI] [SubprocessWorker] callback 'report_progress' from call_id=3
[14:21] [ComfyUI] [worker:ComfyUI-Sharp] [SharpPredictGaussiansFromMetricDepth] face 23/42: 1536×1536, extrinsics=[-0.00, -0.00, -0.00], intrinsics=fx=0.5000 cx=0.5000, mask=yes, snap=none, depth_conv=planar_z
[14:21] [ComfyUI] [worker:ComfyUI-Sharp] [VRAM] +563MB (now 5153MB) reserved=7680MB peak=7062MB
[14:21] Frame 52 saved (frame_051.jpg, t=365.0s)
[14:21] [capture-periodic] freeze=1ms shot=98ms unfreeze=1ms saved=True
[14:23] [ComfyUI] [worker:ComfyUI-Sharp] [VRAM] -564MB (now 4590MB) reserved=10176MB peak=7062MB
[14:25] [capture-loop] iter=3350 t=369.0s state={'complete': False, 'error': None, 'executedCount': 4, 'wsState': 1} eval_ms=1 ram=22.4/31.3GB (72%) swap=7.8/32.0GB (24%) cpu=13% browser_rss=0.92GB
[14:25] [ComfyUI] [SubprocessWorker] callback 'report_progress' from call_id=3
[14:25] [ComfyUI] [worker:ComfyUI-Sharp] [SharpPredictGaussiansFromMetricDepth] face 24/42: 1536×1536, extrinsics=[-0.00, -0.00, -0.00], intrinsics=fx=0.5000 cx=0.5000, mask=yes, snap=none, depth_conv=planar_z
[14:25] [ComfyUI] [worker:ComfyUI-Sharp] [VRAM] +580MB (now 5171MB) reserved=7968MB peak=7062MB
[14:26] Frame 53 saved (frame_052.jpg, t=369.4s)
[14:26] [capture-periodic] freeze=1ms shot=94ms unfreeze=4ms saved=True
[14:27] [ComfyUI] [worker:ComfyUI-Sharp] [VRAM] -582MB (now 4590MB) reserved=12032MB peak=7062MB
[14:29] [ComfyUI] [SubprocessWorker] callback 'report_progress' from call_id=3
[14:29] [ComfyUI] [worker:ComfyUI-Sharp] [SharpPredictGaussiansFromMetricDepth] face 25/42: 1536×1536, extrinsics=[-0.00, -0.00, -0.00], intrinsics=fx=0.5000 cx=0.5000, mask=yes, snap=none, depth_conv=planar_z
[14:29] [ComfyUI] [worker:ComfyUI-Sharp] [VRAM] +508MB (now 5098MB) reserved=7296MB peak=7062MB
[14:30] Frame 54 saved (frame_053.jpg, t=373.7s)
[14:30] [capture-periodic] freeze=1ms shot=103ms unfreeze=5ms saved=True
[14:31] [capture-loop] iter=3400 t=374.5s state={'complete': False, 'error': None, 'executedCount': 4, 'wsState': 1} eval_ms=1 ram=22.5/31.3GB (72%) swap=7.8/32.0GB (24%) cpu=12% browser_rss=0.92GB
[14:31] [ComfyUI] [worker:ComfyUI-Sharp] [VRAM] +354MB (now 5453MB) reserved=6144MB peak=7062MB
[14:32] [ComfyUI] [worker:ComfyUI-Sharp] [VRAM] -864MB (now 4589MB) reserved=10144MB peak=7062MB
[14:33] [ComfyUI] [SubprocessWorker] callback 'report_progress' from call_id=3
[14:33] [ComfyUI] [worker:ComfyUI-Sharp] [SharpPredictGaussiansFromMetricDepth] face 26/42: 1536×1536, extrinsics=[-0.00, -0.00, -0.00], intrinsics=fx=0.5000 cx=0.5000, mask=yes, snap=none, depth_conv=planar_z
[14:33] [ComfyUI] [worker:ComfyUI-Sharp] [VRAM] +512MB (now 5102MB) reserved=7584MB peak=7062MB
[14:34] Frame 55 saved (frame_054.jpg, t=378.1s)
[14:34] [capture-periodic] freeze=1ms shot=95ms unfreeze=5ms saved=True
[14:35] [ComfyUI] [worker:ComfyUI-Sharp] [VRAM] +354MB (now 5457MB) reserved=6112MB peak=7062MB
[14:36] [ComfyUI] [worker:ComfyUI-Sharp] [VRAM] -864MB (now 4593MB) reserved=10688MB peak=7062MB
[14:36] [capture-loop] iter=3450 t=379.8s state={'complete': False, 'error': None, 'executedCount': 4, 'wsState': 1} eval_ms=1 ram=23.8/31.3GB (76%) swap=7.8/32.0GB (24%) cpu=12% browser_rss=0.93GB
[14:36] [ComfyUI] [worker:ComfyUI-Sharp]
[14:36] [ComfyUI] === WATCHDOG TICK 2 ===
[14:36] [ComfyUI] [worker:ComfyUI-Sharp] Thread 0x00007f1480bff640 (most recent call first):
[14:36] [ComfyUI] File "/tmp/comfytest-home/.ce/.pixi/envs/sharp-nodes/lib/python3.11/socket.py", line 294 in accept
[14:36] [ComfyUI] File "/tmp/comfytest-home/.ce/.pixi/envs/sharp-nodes/lib/python3.11/multiprocessing/connection.py", line 626 in accept
[14:36] [ComfyUI] File "/tmp/comfytest-home/.ce/.pixi/envs/sharp-nodes/lib/python3.11/multiprocessing/connection.py", line 480 in accept
[14:36] [ComfyUI] File "/tmp/comfytest-home/.ce/.pixi/envs/sharp-nodes/lib/python3.11/multiprocessing/resource_sharer.py", line 138 in _serve
[14:36] [ComfyUI] File "/tmp/comfytest-home/.ce/.pixi/envs/sharp-nodes/lib/python3.11/threading.py", line 982 in run
[14:36] [ComfyUI] File "/tmp/comfytest-home/.ce/.pixi/envs/sharp-nodes/lib/python3.11/threading.py", line 1045 in _bootstrap_inner
[14:36] [ComfyUI] File "/tmp/comfytest-home/.ce/.pixi/envs/sharp-nodes/lib/python3.11/threading.py", line 1002 in _bootstrap
[14:36] [ComfyUI]
[14:36] [ComfyUI] Thread 0x00007f1634a0f640 (most recent call first):
[14:36] [ComfyUI] File "/tmp/comfyui_pvenv_xcjd5ki2/persistent_worker.py", line 106 in _vram_poller
[14:36] [ComfyUI] File "/tmp/comfytest-home/.ce/.pixi/envs/sharp-nodes/lib/python3.11/threading.py", line 982 in run
[14:36] [ComfyUI] File "/tmp/comfytest-home/.ce/.pixi/envs/sharp-nodes/lib/python3.11/threading.py", line 1045 in _bootstrap_inner
[14:36] [ComfyUI] File "/tmp/comfytest-home/.ce/.pixi/envs/sharp-nodes/lib/python3.11/threading.py", line 1002 in _bootstrap
[14:36] [ComfyUI]
[14:36] [ComfyUI] Current thread 0x00007f1635214640 (most recent call first):
[14:36] [ComfyUI] File "/tmp/comfyui_pvenv_xcjd5ki2/persistent_worker.py", line 52 in _watchdog
[14:36] [ComfyUI] File "/tmp/comfytest-home/.ce/.pixi/envs/sharp-nodes/lib/python3.11/threading.py", line 982 in run
[14:36] [ComfyUI] File "/tmp/comfytest-home/.ce/.pixi/envs/sharp-nodes/lib/python3.11/threading.py", line 1045 in _bootstrap_inner
[14:36] [ComfyUI] File "/tmp/comfytest-home/.ce/.pixi/envs/sharp-nodes/lib/python3.11/threading.py", line 1002 in _bootstrap
[14:36] [ComfyUI]
[14:36] [ComfyUI] Thread 0x00007f1635834740 (most recent call first):
[14:36] [ComfyUI] File "/workspaces/Sharp-2211/ComfyUI/custom_nodes/ComfyUI-Sharp/nodes/predict_gaussians_from_depth.py", line 394 in execute
[14:36] [ComfyUI] File "/tmp/comfytest-home/.ce/.pixi/envs/sharp-nodes/lib/python3.11/site-packages/torch/utils/_contextlib.py", line 124 in decorate_context
[14:36] [ComfyUI] File "/workspaces/Sharp-2211/ComfyUI/comfy_api/latest/_io.py", line 1892 in EXECUTE_NORMALIZED
[14:36] [ComfyUI] File "/tmp/comfyui_pvenv_xcjd5ki2/persistent_worker.py", line 1762 in main
[14:36] [ComfyUI] File "/tmp/comfyui_pvenv_xcjd5ki2/persistent_worker.py", line 1807 in <module>
[14:36] [ComfyUI]
[14:36] [ComfyUI] [worker:ComfyUI-Sharp] === END ===
[14:36] [ComfyUI]
[14:37] [ComfyUI] [SubprocessWorker] callback 'report_progress' from call_id=3
[14:37] [ComfyUI] [worker:ComfyUI-Sharp] [SharpPredictGaussiansFromMetricDepth] face 27/42: 1536×1536, extrinsics=[-0.00, -0.00, -0.00], intrinsics=fx=0.5000 cx=0.5000, mask=yes, snap=none, depth_conv=planar_z
[14:37] [ComfyUI] [worker:ComfyUI-Sharp] [VRAM] +525MB (now 5118MB) reserved=7296MB peak=7062MB
[14:39] Frame 56 saved (frame_055.jpg, t=382.4s)
[14:39] [capture-periodic] freeze=1ms shot=102ms unfreeze=5ms saved=True
[14:39] [ComfyUI] [worker:ComfyUI-Sharp] [VRAM] +469MB (now 5587MB) reserved=6176MB peak=7062MB
[14:40] [ComfyUI] [worker:ComfyUI-Sharp] [VRAM] -997MB (now 4591MB) reserved=11968MB peak=7062MB
[14:41] [capture-loop] iter=3500 t=385.3s state={'complete': False, 'error': None, 'executedCount': 4, 'wsState': 1} eval_ms=1 ram=21.8/31.3GB (70%) swap=8.1/32.0GB (25%) cpu=14% browser_rss=0.93GB
[14:41] [ComfyUI] [SubprocessWorker] callback 'report_progress' from call_id=3
[14:41] [ComfyUI] [worker:ComfyUI-Sharp] [SharpPredictGaussiansFromMetricDepth] face 28/42: 1536×1536, extrinsics=[-0.00, -0.00, -0.00], intrinsics=fx=0.5000 cx=0.5000, mask=yes, snap=none, depth_conv=planar_z
[14:42] [ComfyUI] [worker:ComfyUI-Sharp] [VRAM] +557MB (now 5148MB) reserved=7616MB peak=7062MB
[14:43] Frame 57 saved (frame_056.jpg, t=386.8s)
[14:43] [capture-periodic] freeze=1ms shot=102ms unfreeze=5ms saved=True
[14:43] [ComfyUI] [worker:ComfyUI-Sharp] [VRAM] -555MB (now 4594MB) reserved=12128MB peak=7062MB
[14:45] [ComfyUI] [SubprocessWorker] callback 'report_progress' from call_id=3
[14:46] [ComfyUI] [worker:ComfyUI-Sharp] [SharpPredictGaussiansFromMetricDepth] face 29/42: 1536×1536, extrinsics=[-0.00, -0.00, -0.00], intrinsics=fx=0.5000 cx=0.5000, mask=yes, snap=none, depth_conv=planar_z
[14:46] [ComfyUI] [worker:ComfyUI-Sharp] [VRAM] +525MB (now 5120MB) reserved=7872MB peak=7062MB
[14:47] [capture-loop] iter=3550 t=390.7s state={'complete': False, 'error': None, 'executedCount': 4, 'wsState': 1} eval_ms=1 ram=22.3/31.3GB (71%) swap=8.1/32.0GB (25%) cpu=14% browser_rss=0.93GB
[14:47] [ComfyUI] [worker:ComfyUI-Sharp] [VRAM] -278MB (now 4842MB) reserved=5440MB peak=7062MB
[14:47] Frame 58 saved (frame_057.jpg, t=391.1s)
[14:47] [capture-periodic] freeze=1ms shot=103ms unfreeze=6ms saved=True
[14:48] [ComfyUI] [worker:ComfyUI-Sharp] [VRAM] -250MB (now 4593MB) reserved=10720MB peak=7062MB
[14:50] [ComfyUI] [SubprocessWorker] callback 'report_progress' from call_id=3
[14:50] [ComfyUI] [worker:ComfyUI-Sharp] [SharpPredictGaussiansFromMetricDepth] face 30/42: 1536×1536, extrinsics=[-0.00, -0.00, -0.00], intrinsics=fx=0.5000 cx=0.5000, mask=yes, snap=none, depth_conv=planar_z
[14:50] [ComfyUI] [worker:ComfyUI-Sharp] [VRAM] +620MB (now 5214MB) reserved=7680MB peak=7062MB
[14:51] [ComfyUI] [worker:ComfyUI-Sharp] [VRAM] -618MB (now 4597MB) reserved=11616MB peak=7062MB
[14:52] Frame 59 saved (frame_058.jpg, t=395.5s)
[14:52] [capture-periodic] freeze=1ms shot=106ms unfreeze=5ms saved=True
[14:52] [capture-loop] iter=3600 t=396.2s state={'complete': False, 'error': None, 'executedCount': 4, 'wsState': 1} eval_ms=1 ram=23.7/31.3GB (76%) swap=8.1/32.0GB (25%) cpu=12% browser_rss=0.93GB
[14:54] [ComfyUI] [SubprocessWorker] callback 'report_progress' from call_id=3
[14:54] [ComfyUI] [worker:ComfyUI-Sharp] [SharpPredictGaussiansFromMetricDepth] face 31/42: 1536×1536, extrinsics=[-0.00, -0.00, -0.00], intrinsics=fx=0.5000 cx=0.5000, mask=yes, snap=none, depth_conv=planar_z
[14:54] [ComfyUI] [worker:ComfyUI-Sharp] [VRAM] +522MB (now 5119MB) reserved=7936MB peak=7062MB
[14:54] Frame 60 saved (frame_059.jpg, t=397.7s)
[14:54] [capture-periodic] freeze=1ms shot=92ms unfreeze=1ms saved=True
[14:55] [ComfyUI] [worker:ComfyUI-Sharp] [VRAM] +336MB (now 5456MB) reserved=6208MB peak=7062MB
[14:56] [ComfyUI] [worker:ComfyUI-Sharp] [VRAM] -864MB (now 4592MB) reserved=11584MB peak=7062MB
[14:58] [capture-loop] iter=3650 t=401.6s state={'complete': False, 'error': None, 'executedCount': 4, 'wsState': 1} eval_ms=1 ram=22.2/31.3GB (71%) swap=8.1/32.0GB (25%) cpu=11% browser_rss=0.93GB
[14:58] [ComfyUI] [SubprocessWorker] callback 'report_progress' from call_id=3
[14:58] [ComfyUI] [worker:ComfyUI-Sharp] [SharpPredictGaussiansFromMetricDepth] face 32/42: 1536×1536, extrinsics=[-0.00, -0.00, -0.00], intrinsics=fx=0.5000 cx=0.5000, mask=yes, snap=none, depth_conv=planar_z
[14:58] [ComfyUI] [worker:ComfyUI-Sharp] [VRAM] +617MB (now 5210MB) reserved=7648MB peak=7062MB
[14:58] Frame 61 saved (frame_060.jpg, t=402.0s)
[14:58] [capture-periodic] freeze=1ms shot=100ms unfreeze=1ms saved=True
[14:59] [ComfyUI] [worker:ComfyUI-Sharp] [VRAM] -618MB (now 4592MB) reserved=10720MB peak=7062MB
[15:02] [ComfyUI] [SubprocessWorker] callback 'report_progress' from call_id=3
[15:02] [ComfyUI] [worker:ComfyUI-Sharp] [SharpPredictGaussiansFromMetricDepth] face 33/42: 1536×1536, extrinsics=[-0.00, -0.00, -0.00], intrinsics=fx=0.5000 cx=0.5000, mask=yes, snap=none, depth_conv=planar_z
[15:02] [ComfyUI] [worker:ComfyUI-Sharp] [VRAM] +524MB (now 5116MB) reserved=7904MB peak=7062MB
[15:03] Frame 62 saved (frame_061.jpg, t=406.3s)
[15:03] [capture-periodic] freeze=1ms shot=102ms unfreeze=5ms saved=True
[15:03] [capture-loop] iter=3700 t=407.1s state={'complete': False, 'error': None, 'executedCount': 4, 'wsState': 1} eval_ms=1 ram=22.3/31.3GB (71%) swap=8.1/32.0GB (25%) cpu=12% browser_rss=0.92GB
[15:04] [ComfyUI] [worker:ComfyUI-Sharp] [VRAM] -528MB (now 4589MB) reserved=10176MB peak=7062MB
[15:06] [ComfyUI] [SubprocessWorker] callback 'report_progress' from call_id=3
[15:06] [ComfyUI] [worker:ComfyUI-Sharp] [SharpPredictGaussiansFromMetricDepth] face 34/42: 1536×1536, extrinsics=[-0.00, -0.00, -0.00], intrinsics=fx=0.5000 cx=0.5000, mask=yes, snap=none, depth_conv=planar_z
[15:06] [ComfyUI] [worker:ComfyUI-Sharp] [VRAM] +518MB (now 5108MB) reserved=7616MB peak=7062MB
[15:07] Frame 63 saved (frame_062.jpg, t=410.7s)
[15:07] [capture-periodic] freeze=1ms shot=102ms unfreeze=18ms saved=True
[15:08] [ComfyUI] [worker:ComfyUI-Sharp] [VRAM] -519MB (now 4590MB) reserved=10752MB peak=7062MB
[15:09] [capture-loop] iter=3750 t=412.5s state={'complete': False, 'error': None, 'executedCount': 4, 'wsState': 1} eval_ms=1 ram=23.2/31.3GB (74%) swap=8.1/32.0GB (25%) cpu=12% browser_rss=0.92GB
[15:10] [ComfyUI] [SubprocessWorker] callback 'report_progress' from call_id=3
[15:10] [ComfyUI] [worker:ComfyUI-Sharp] [SharpPredictGaussiansFromMetricDepth] face 35/42: 1536×1536, extrinsics=[-0.00, -0.00, -0.00], intrinsics=fx=0.5000 cx=0.5000, mask=yes, snap=none, depth_conv=planar_z
[15:10] [ComfyUI] [worker:ComfyUI-Sharp] [VRAM] +555MB (now 5145MB) reserved=7680MB peak=7062MB
[15:11] Frame 64 saved (frame_063.jpg, t=415.0s)
[15:11] [capture-periodic] freeze=1ms shot=97ms unfreeze=5ms saved=True
[15:12] [ComfyUI] [worker:ComfyUI-Sharp] [VRAM] +309MB (now 5455MB) reserved=6080MB peak=7062MB
[15:13] [ComfyUI] [worker:ComfyUI-Sharp] [VRAM] -864MB (now 4591MB) reserved=11584MB peak=7062MB
[15:14] [capture-loop] iter=3800 t=417.9s state={'complete': False, 'error': None, 'executedCount': 4, 'wsState': 1} eval_ms=1 ram=22.2/31.3GB (71%) swap=8.1/32.0GB (25%) cpu=11% browser_rss=0.83GB
[15:14] [ComfyUI] [SubprocessWorker] callback 'report_progress' from call_id=3
[15:14] [ComfyUI] [worker:ComfyUI-Sharp] [SharpPredictGaussiansFromMetricDepth] face 36/42: 1536×1536, extrinsics=[-0.00, -0.00, -0.00], intrinsics=fx=0.5000 cx=0.5000, mask=yes, snap=none, depth_conv=planar_z
[15:14] [ComfyUI] [worker:ComfyUI-Sharp] [VRAM] +561MB (now 5153MB) reserved=7424MB peak=7062MB
[15:16] Frame 65 saved (frame_064.jpg, t=419.4s)
[15:16] [capture-periodic] freeze=1ms shot=93ms unfreeze=5ms saved=True
[15:16] [ComfyUI] [worker:ComfyUI-Sharp] [VRAM] -564MB (now 4589MB) reserved=10080MB peak=7062MB
[15:18] [ComfyUI] [SubprocessWorker] callback 'report_progress' from call_id=3
[15:18] [ComfyUI] [worker:ComfyUI-Sharp] [SharpPredictGaussiansFromMetricDepth] face 37/42: 1536×1536, extrinsics=[-0.00, -0.00, -0.00], intrinsics=fx=0.5000 cx=0.5000, mask=yes, snap=none, depth_conv=planar_z
[15:18] [ComfyUI] [worker:ComfyUI-Sharp] [VRAM] +517MB (now 5106MB) reserved=7872MB peak=7062MB
[15:19] [capture-loop] iter=3850 t=423.3s state={'complete': False, 'error': None, 'executedCount': 4, 'wsState': 1} eval_ms=1 ram=22.6/31.3GB (72%) swap=8.0/32.0GB (25%) cpu=12% browser_rss=0.83GB
[15:20] [ComfyUI] [worker:ComfyUI-Sharp] [VRAM] +345MB (now 5452MB) reserved=6048MB peak=7062MB
[15:20] Frame 66 saved (frame_065.jpg, t=423.7s)
[15:20] [capture-periodic] freeze=1ms shot=98ms unfreeze=7ms saved=True
[15:21] [ComfyUI] [worker:ComfyUI-Sharp] [VRAM] -864MB (now 4588MB) reserved=10432MB peak=7062MB
[15:22] [ComfyUI] [SubprocessWorker] callback 'report_progress' from call_id=3
[15:22] [ComfyUI] [worker:ComfyUI-Sharp] [SharpPredictGaussiansFromMetricDepth] face 38/42: 1536×1536, extrinsics=[-0.00, -0.00, -0.00], intrinsics=fx=0.5000 cx=0.5000, mask=yes, snap=none, depth_conv=planar_z
[15:23] [ComfyUI] [worker:ComfyUI-Sharp] [VRAM] +527MB (now 5116MB) reserved=7904MB peak=7062MB
[15:24] [ComfyUI] [worker:ComfyUI-Sharp] [VRAM] -528MB (now 4589MB) reserved=10656MB peak=7062MB
[15:24] Frame 67 saved (frame_066.jpg, t=428.0s)
[15:24] [capture-periodic] freeze=1ms shot=98ms unfreeze=5ms saved=True
[15:25] [capture-loop] iter=3900 t=428.8s state={'complete': False, 'error': None, 'executedCount': 4, 'wsState': 1} eval_ms=1 ram=23.3/31.3GB (75%) swap=8.0/32.0GB (25%) cpu=14% browser_rss=0.83GB
[15:27] [ComfyUI] [SubprocessWorker] callback 'report_progress' from call_id=3
[15:27] [ComfyUI] [worker:ComfyUI-Sharp] [SharpPredictGaussiansFromMetricDepth] face 39/42: 1536×1536, extrinsics=[-0.00, -0.00, -0.00], intrinsics=fx=0.5000 cx=0.5000, mask=yes, snap=none, depth_conv=planar_z
[15:27] [ComfyUI] [worker:ComfyUI-Sharp] [VRAM] +535MB (now 5125MB) reserved=7648MB peak=7062MB
[15:28] [ComfyUI] [worker:ComfyUI-Sharp] [VRAM] -537MB (now 4589MB) reserved=10656MB peak=7062MB
[15:29] Frame 68 saved (frame_067.jpg, t=432.4s)
[15:29] [capture-periodic] freeze=1ms shot=103ms unfreeze=5ms saved=True
[15:30] [capture-loop] iter=3950 t=434.2s state={'complete': False, 'error': None, 'executedCount': 4, 'wsState': 1} eval_ms=1 ram=22.6/31.3GB (72%) swap=8.0/32.0GB (25%) cpu=11% browser_rss=0.83GB
[15:31] [ComfyUI] [SubprocessWorker] callback 'report_progress' from call_id=3
[15:31] [ComfyUI] [worker:ComfyUI-Sharp] [SharpPredictGaussiansFromMetricDepth] face 40/42: 1536×1536, extrinsics=[-0.00, -0.00, -0.00], intrinsics=fx=0.5000 cx=0.5000, mask=yes, snap=none, depth_conv=planar_z
[15:31] [ComfyUI] [worker:ComfyUI-Sharp] [VRAM] +554MB (now 5143MB) reserved=7904MB peak=7062MB
[15:32] [ComfyUI] [worker:ComfyUI-Sharp] [VRAM] -555MB (now 4589MB) reserved=11584MB peak=7062MB
[15:33] Frame 69 saved (frame_068.jpg, t=436.7s)
[15:33] [capture-periodic] freeze=1ms shot=103ms unfreeze=5ms saved=True
[15:35] [ComfyUI] [SubprocessWorker] callback 'report_progress' from call_id=3
[15:35] [ComfyUI] [worker:ComfyUI-Sharp] [SharpPredictGaussiansFromMetricDepth] face 41/42: 1536×1536, extrinsics=[-0.00, -0.00, -0.00], intrinsics=fx=0.5000 cx=0.5000, mask=yes, snap=none, depth_conv=planar_z
[15:35] [ComfyUI] [worker:ComfyUI-Sharp] [VRAM] +555MB (now 5144MB) reserved=7872MB peak=7062MB
[15:35] Frame 70 saved (frame_069.jpg, t=438.9s)
[15:35] [capture-periodic] freeze=1ms shot=98ms unfreeze=1ms saved=True
[15:36] [capture-loop] iter=4000 t=439.7s state={'complete': False, 'error': None, 'executedCount': 4, 'wsState': 1} eval_ms=1 ram=22.0/31.3GB (70%) swap=8.3/32.0GB (26%) cpu=13% browser_rss=0.83GB
[15:36] [ComfyUI] [worker:ComfyUI-Sharp] [VRAM] +309MB (now 5454MB) reserved=6176MB peak=7062MB
[15:36] [ComfyUI] [worker:ComfyUI-Sharp]
[15:36] [ComfyUI] === WATCHDOG TICK 3 ===
[15:36] [ComfyUI] [worker:ComfyUI-Sharp] Thread 0x00007f1480bff640 (most recent call first):
[15:36] [ComfyUI] File "/tmp/comfytest-home/.ce/.pixi/envs/sharp-nodes/lib/python3.11/socket.py", line 294 in accept
[15:36] [ComfyUI] File "/tmp/comfytest-home/.ce/.pixi/envs/sharp-nodes/lib/python3.11/multiprocessing/connection.py", line 626 in accept
[15:36] [ComfyUI] File "/tmp/comfytest-home/.ce/.pixi/envs/sharp-nodes/lib/python3.11/multiprocessing/connection.py", line 480 in accept
[15:36] [ComfyUI] File "/tmp/comfytest-home/.ce/.pixi/envs/sharp-nodes/lib/python3.11/multiprocessing/resource_sharer.py", line 138 in _serve
[15:36] [ComfyUI] File "/tmp/comfytest-home/.ce/.pixi/envs/sharp-nodes/lib/python3.11/threading.py", line 982 in run
[15:36] [ComfyUI] File "/tmp/comfytest-home/.ce/.pixi/envs/sharp-nodes/lib/python3.11/threading.py", line 1045 in _bootstrap_inner
[15:36] [ComfyUI] File "/tmp/comfytest-home/.ce/.pixi/envs/sharp-nodes/lib/python3.11/threading.py", line 1002 in _bootstrap
[15:36] [ComfyUI]
[15:36] [ComfyUI] Thread 0x00007f1634a0f640 (most recent call first):
[15:36] [ComfyUI] File "/tmp/comfyui_pvenv_xcjd5ki2/persistent_worker.py", line 106 in _vram_poller
[15:36] [ComfyUI] File "/tmp/comfytest-home/.ce/.pixi/envs/sharp-nodes/lib/python3.11/threading.py", line 982 in run
[15:36] [ComfyUI] File "/tmp/comfytest-home/.ce/.pixi/envs/sharp-nodes/lib/python3.11/threading.py", line 1045 in _bootstrap_inner
[15:36] [ComfyUI] File "/tmp/comfytest-home/.ce/.pixi/envs/sharp-nodes/lib/python3.11/threading.py", line 1002 in _bootstrap
[15:36] [ComfyUI]
[15:36] [ComfyUI] Current thread 0x00007f1635214640 (most recent call first):
[15:36] [ComfyUI] File "/tmp/comfyui_pvenv_xcjd5ki2/persistent_worker.py", line 52 in _watchdog
[15:36] [ComfyUI] File "/tmp/comfytest-home/.ce/.pixi/envs/sharp-nodes/lib/python3.11/threading.py", line 982 in run
[15:36] [ComfyUI] File "/tmp/comfytest-home/.ce/.pixi/envs/sharp-nodes/lib/python3.11/threading.py", line 1045 in _bootstrap_inner
[15:36] [ComfyUI] File "/tmp/comfytest-home/.ce/.pixi/envs/sharp-nodes/lib/python3.11/threading.py", line 1002 in _bootstrap
[15:36] [ComfyUI]
[15:36] [ComfyUI] Thread 0x00007f1635834740 (most recent call first):
[15:36] [ComfyUI] File "/tmp/comfytest-home/.ce/.pixi/envs/sharp-nodes/lib/python3.11/site-packages/torch/nn/modules/conv.py", line 1184 in forward
[15:36] [ComfyUI] File "/workspaces/Sharp-2211/ComfyUI/comfy/ops.py", line 670 in forward
[15:36] [ComfyUI] File "/tmp/comfytest-home/.ce/.pixi/envs/sharp-nodes/lib/python3.11/site-packages/torch/nn/modules/module.py", line 1787 in _call_impl
[15:36] [ComfyUI] File "/tmp/comfytest-home/.ce/.pixi/envs/sharp-nodes/lib/python3.11/site-packages/torch/nn/modules/module.py", line 1776 in _wrapped_call_impl
[15:36] [ComfyUI] File "/workspaces/Sharp-2211/ComfyUI/custom_nodes/ComfyUI-Sharp/nodes/sharp/model.py", line 861 in forward
[15:36] [ComfyUI] File "/tmp/comfytest-home/.ce/.pixi/envs/sharp-nodes/lib/python3.11/site-packages/torch/nn/modules/module.py", line 1787 in _call_impl
[15:36] [ComfyUI] File "/tmp/comfytest-home/.ce/.pixi/envs/sharp-nodes/lib/python3.11/site-packages/torch/nn/modules/module.py", line 1776 in _wrapped_call_impl
[15:36] [ComfyUI] File "/workspaces/Sharp-2211/ComfyUI/custom_nodes/ComfyUI-Sharp/nodes/sharp/model.py", line 970 in forward
[15:36] [ComfyUI] File "/tmp/comfytest-home/.ce/.pixi/envs/sharp-nodes/lib/python3.11/site-packages/torch/nn/modules/module.py", line 1787 in _call_impl
[15:36] [ComfyUI] File "/tmp/comfytest-home/.ce/.pixi/envs/sharp-nodes/lib/python3.11/site-packages/torch/nn/modules/module.py", line 1776 in _wrapped_call_impl
[15:36] [ComfyUI] File "/workspaces/Sharp-2211/ComfyUI/custom_nodes/ComfyUI-Sharp/nodes/sharp/model.py", line 1118 in forward
[15:36] [ComfyUI] File "/tmp/comfytest-home/.ce/.pixi/envs/sharp-nodes/lib/python3.11/site-packages/torch/nn/modules/module.py", line 1787 in _call_impl
[15:36] [ComfyUI] File "/tmp/comfytest-home/.ce/.pixi/envs/sharp-nodes/lib/python3.11/site-packages/torch/nn/modules/module.py", line 1776 in _wrapped_call_impl
[15:36] [ComfyUI] File "/workspaces/Sharp-2211/ComfyUI/custom_nodes/ComfyUI-Sharp/nodes/sharp/model.py", line 2006 in encode
[15:36] [ComfyUI] File "/workspaces/Sharp-2211/ComfyUI/custom_nodes/ComfyUI-Sharp/nodes/predict_gaussians_from_depth.py", line 392 in execute
[15:36] [ComfyUI] File "/tmp/comfytest-home/.ce/.pixi/envs/sharp-nodes/lib/python3.11/site-packages/torch/utils/_contextlib.py", line 124 in decorate_context
[15:36] [ComfyUI] File "/workspaces/Sharp-2211/ComfyUI/comfy_api/latest/_io.py", line 1892 in EXECUTE_NORMALIZED
[15:36] [ComfyUI] File "/tmp/comfyui_pvenv_xcjd5ki2/persistent_worker.py", line 1762 in main
[15:36] [ComfyUI] File "/tmp/comfyui_pvenv_xcjd5ki2/persistent_worker.py", line 1807 in <module>
[15:36] [ComfyUI]
[15:37] [ComfyUI] [worker:ComfyUI-Sharp] === END ===
[15:37] [ComfyUI]
[15:37] [ComfyUI] [worker:ComfyUI-Sharp] [VRAM] -864MB (now 4590MB) reserved=11552MB peak=7062MB
[15:39] [ComfyUI] [SubprocessWorker] callback 'report_progress' from call_id=3
[15:39] [ComfyUI] [worker:ComfyUI-Sharp] [SharpPredictGaussiansFromMetricDepth] face 42/42: 1536×1536, extrinsics=[-0.00, -0.00, -0.00], intrinsics=fx=0.5000 cx=0.5000, mask=yes, snap=none, depth_conv=planar_z
[15:39] [ComfyUI] [worker:ComfyUI-Sharp] [VRAM] +562MB (now 5153MB) reserved=7328MB peak=7062MB
[15:39] Frame 71 saved (frame_070.jpg, t=443.3s)
[15:39] [capture-periodic] freeze=1ms shot=94ms unfreeze=5ms saved=True
[15:41] [ComfyUI] [worker:ComfyUI-Sharp] [VRAM] -564MB (now 4590MB) reserved=10112MB peak=7062MB
[15:41] [capture-loop] iter=4050 t=445.1s state={'complete': False, 'error': None, 'executedCount': 4, 'wsState': 1} eval_ms=1 ram=22.9/31.3GB (73%) swap=8.3/32.0GB (26%) cpu=12% browser_rss=0.83GB
[15:43] [ComfyUI] [SubprocessWorker] callback 'report_progress' from call_id=3
[15:43] [ComfyUI] [worker:ComfyUI-Sharp] [SharpPredictGaussiansFromMetricDepth] 42 face(s) -> 4.07M gaussians total (both layers, snap=none); saved to /workspaces/Sharp-2211/ComfyUI/output/sharp_aligned_1780871075963; 172.6s
[15:43] [ComfyUI] [worker:ComfyUI-Sharp] [VRAM] -1903MB (now 2688MB) reserved=7328MB peak=7062MB
[15:43] [ComfyUI] [SubprocessWorker] got response: ok
[15:43] [ComfyUI] [comfy-env] Created 1 model patchers: ['RGBGaussianPredictor_1']
[15:43] [ComfyUI] [comfy-env] SharpPredictGaussiansFromMetricDepth done (182.06s): result: NodeOutput
[15:43] [ComfyUI] [VRAM] After SharpPredictGaussiansFromMetricDepth: 14073 / 24122 MB
[15:43] [ComfyUI] [VRAM] Loaded: SubprocessModel (2679 MB), SubprocessModel (631 MB)
[15:43] [ComfyUI] [comfy-env] Running MergeGaussians: ply_folder: '/workspaces/Sharp-2211/ComfyUI/output/sharp_aligned_1780..., output_prefix: 'merged', max_depth: 0.0, min_opacity: 0.0
[15:43] [ComfyUI] [VRAM] Before MergeGaussians: 14073 / 24122 MB
[15:43] [ComfyUI] [VRAM] Loaded: SubprocessModel (2679 MB), SubprocessModel (631 MB)
[15:43] [ComfyUI] [SubprocessWorker] call_method: nodes.merge_gaussians.MergeGaussians.EXECUTE_NORMALIZED
[15:43] [ComfyUI] [SubprocessWorker] acquired lock, ensuring started...
[15:43] [ComfyUI] [ComfyUI-Sharp] Health check: ping (timeout=5.0s)...
[15:43] [ComfyUI] [ComfyUI-Sharp] Health check: ok
[15:43] [ComfyUI] [SubprocessWorker] worker started/confirmed
[15:43] [ComfyUI] [SubprocessWorker] serializing kwargs to shm...
[15:43] [ComfyUI] [SubprocessWorker] created 0 shm blocks
[15:43] [ComfyUI] [SubprocessWorker] sending request via socket...
[15:43] [ComfyUI] [SubprocessWorker] call_id=4 sending call_method
[15:43] [ComfyUI] [worker:ComfyUI-Sharp] [MergeGaussians] merging 42 PLY file(s) from /workspaces/Sharp-2211/ComfyUI/output/sharp_aligned_1780871075963 (no filters)
[15:43] [ComfyUI] [SubprocessWorker] callback 'report_progress' from call_id=4
[15:43] [ComfyUI] [SubprocessWorker] callback 'report_progress' from call_id=4
[15:43] [ComfyUI] [SubprocessWorker] callback 'report_progress' from call_id=4
[15:44] [ComfyUI] [SubprocessWorker] callback 'report_progress' from call_id=4
[15:44] [ComfyUI] [SubprocessWorker] callback 'report_progress' from call_id=4
[15:44] Frame 72 saved (frame_071.jpg, t=447.6s)
[15:44] [capture-periodic] freeze=11ms shot=127ms unfreeze=7ms saved=True
[15:44] [ComfyUI] [worker:ComfyUI-Sharp] [MergeGaussians] merged 42 file(s) -> 4.07M gaussians -> /workspaces/Sharp-2211/ComfyUI/output/merged_1780871249131.ply, 217.5 MB; save 0.5s, total 0.9s
[15:44] [ComfyUI] [worker:ComfyUI-Sharp] [MergeGaussians] field PLY (positions + face_id only) -> /workspaces/Sharp-2211/ComfyUI/output/merged_1780871249131_fields.ply
[15:44] [ComfyUI] [SubprocessWorker] got response: ok
[15:44] [ComfyUI] [comfy-env] MergeGaussians done (1.00s): result: NodeOutput
[15:44] [ComfyUI] [comfy-env] SubprocessWorker: /tmp/comfytest-home/.ce/.pixi/envs/gaussianpack-nodes/bin/python
[15:44] [ComfyUI] [VRAM] After MergeGaussians: 14073 / 24122 MB
[15:44] [ComfyUI] [comfy-env] env_vars: {'COMFYUI_BASE': '/workspaces/Sharp-2211/ComfyUI'}
[15:44] [ComfyUI] [VRAM] Loaded: SubprocessModel (2679 MB), SubprocessModel (631 MB)
[15:44] [ComfyUI] [comfy-env] Running TransformGaussian: rotate_x: -90.0, rotate_y: 0.0, rotate_z: 0.0, ply_path: '/workspaces/Sharp-2211/ComfyUI/output/merged_17808712491...
[15:44] [ComfyUI] [ComfyUI-GaussianPack] python: /tmp/comfytest-home/.ce/.pixi/envs/gaussianpack-nodes/bin/python
[15:44] [ComfyUI] [VRAM] Before TransformGaussian: 14073 / 24122 MB
[15:44] [ComfyUI] [ComfyUI-GaussianPack] sys_path sent to worker: ['/workspaces/Sharp-2211/ComfyUI', '/workspaces/Sharp-2211/ComfyUI/custom_nodes/ComfyUI-GaussianPack', '/tmp/comfytest-home/.ce/.pixi/envs/gaussianpack-nodes/lib/python3.1/site-packages', '/workspaces/Sharp-2211/ComfyUI/custom_nodes/ComfyUI-GaussianPack']
[15:44] [ComfyUI] [VRAM] Loaded: SubprocessModel (2679 MB), SubprocessModel (631 MB)
[15:44] [ComfyUI] [SubprocessWorker] is_pixi=True, python=/tmp/comfytest-home/.ce/.pixi/envs/gaussianpack-nodes/bin/python
[15:44] [ComfyUI] [SubprocessWorker] call_method: nodes.transform_gaussian.TransformGaussian.transform
[15:44] [ComfyUI] [SubprocessWorker] launching cmd=['/tmp/comfytest-home/.pixi/bin/pixi', 'run', '--as-is', '--manifest-path', '/tmp/comfytest-home/.ce/pixi.toml', '-e', 'gaussianpack-nodes', 'python', '/tmp/comfyui_pvenv_wwutae6l/persistent_worker.py', 'abstract://comfy_worker_6ce6b0c2d3ab']...
[15:44] [ComfyUI] [SubprocessWorker] acquired lock, ensuring started...
[15:44] [ComfyUI] [SubprocessWorker] socket_addr=abstract://comfy_worker_6ce6b0c2d3ab (abstract, no filesystem path)
[15:45] [ComfyUI] [SubprocessWorker] worker started/confirmed
[15:45] [ComfyUI] [SubprocessWorker] serializing kwargs to shm...
[15:45] [ComfyUI] [SubprocessWorker] created 0 shm blocks
[15:45] [ComfyUI] [SubprocessWorker] sending request via socket...
[15:45] [ComfyUI] [SubprocessWorker] call_id=1 sending call_method
[15:46] [ComfyUI] [worker:ComfyUI-GaussianPack] WARNING: SPZ route not registered (ModuleNotFoundError: No module named 'comfy_aimdo')
[15:46] Frame 73 saved (frame_072.jpg, t=449.9s)
[15:46] [capture-periodic] freeze=2ms shot=114ms unfreeze=5ms saved=True
[15:47] [capture-loop] iter=4100 t=450.6s state={'complete': False, 'error': None, 'executedCount': 4, 'wsState': 1} eval_ms=2 ram=22.6/31.3GB (72%) swap=8.5/32.0GB (27%) cpu=15% browser_rss=0.82GB
[15:47] [ComfyUI] [SubprocessWorker] got response: ok
[15:47] [ComfyUI] [comfy-env] TransformGaussian done (2.65s): result: list[1]
[15:47] [ComfyUI] [VRAM] After TransformGaussian: 14073 / 24122 MB
[15:47] [ComfyUI] [VRAM] Loaded: SubprocessModel (2679 MB), SubprocessModel (631 MB)
[15:47] [ComfyUI] [comfy-env] Running PreviewGaussians: camera_mode: 'orbit', fov_degrees: 71.0, renderer: 'playcanvas', transport_format: 'ply', ply_path: '/workspaces/Sharp-2211/ComfyUI/output/merged_17808712491...
[15:47] [ComfyUI] [VRAM] Before PreviewGaussians: 14073 / 24122 MB
[15:47] [ComfyUI] [VRAM] Loaded: SubprocessModel (2679 MB), SubprocessModel (631 MB)
[15:47] [ComfyUI] [SubprocessWorker] call_method: nodes.preview_gaussian.PreviewGaussians.preview
[15:47] [ComfyUI] [SubprocessWorker] acquired lock, ensuring started...
[15:47] [ComfyUI] [ComfyUI-GaussianPack] Health check: ping (timeout=5.0s)...
[15:47] [ComfyUI] [ComfyUI-GaussianPack] Health check: ok
[15:47] [ComfyUI] [SubprocessWorker] worker started/confirmed
[15:47] [ComfyUI] [SubprocessWorker] serializing kwargs to shm...
[15:47] [ComfyUI] [SubprocessWorker] created 0 shm blocks
[15:47] [ComfyUI] [SubprocessWorker] sending request via socket...
[15:47] [ComfyUI] [SubprocessWorker] call_id=2 sending call_method
[15:47] [ComfyUI] [SubprocessWorker] got response: ok
[15:47] [ComfyUI] [comfy-env] PreviewGaussians done (0.05s): result: dict
[15:47] [ComfyUI] [VRAM] After PreviewGaussians: 14073 / 24122 MB
[15:47] [ComfyUI] [VRAM] Loaded: SubprocessModel (2679 MB), SubprocessModel (631 MB)
[15:47] [ComfyUI] [INFO] Prompt executed in 450.61 seconds
[15:47] Node executed (5 total), capturing...
[15:47] Frame 74 saved (frame_073.jpg, t=451.0s)
[15:47] [capture-node] freeze=1ms shot=104ms unfreeze=1ms saved=True
[15:50] Execution complete (t=453.5s)
[15:50] [3d-wait] Phase 1: Waiting for 'Loading 3D Model' text to disappear...
[15:50] [3d-wait] Phase 1 done in 0.5s
[15:50] [3d-wait] Phase 2: iframes=1
[15:50] [3d-wait] iframe viewer_ready=False (matched 0 console logs)
[15:50] [3d-wait] Waiting for 'Loaded successfully' console message (timeout=60s)...
[15:54] [3d-wait] Got 'Loaded successfully' after 3.4s
[15:54] [3d-wait] Unfrozen in 0.095s, rendering for 5s...
[15:59] [3d-wait] JS halted via CDP after 5.8s
[16:00] [3d-wait] Re-frozen in 6.8s
[16:00] [3d-wait] Total 3D wait: 10.7s
[16:00] Captured 74 unique frames over 464.27s
[16:00] [debug] iframes: 1
[16:00] [debug] iframe[0]: src=http://127.0.0.1:41898/extensions/ComfyUI-GaussianPack/viewer_gaussian.html?v=17, canvas=486x403, rafFrozen=True
[16:00] [timing] trigger_3d_previews: 0.0s
[16:03] Saved high-quality screenshot: pano_executed.png
[16:03] [timing] final_screenshot: 0.3s
[16:03] [ComfyUI] [comfy-env] [VRAM] Before offload 'MoGeWrapper_1' (631 MB) -> cpu: 14073 / 24122 MB
[16:03] [ComfyUI] [ComfyUI-MoGe2] python: /tmp/comfytest-home/.ce/.pixi/envs/moge2-nodes/bin/python
[16:03] [ComfyUI] [ComfyUI-MoGe2] Health check: ping (timeout=5.0s)...
[16:03] Capturing execution frames: sharp_basic.json
[16:03] [ComfyUI] [ComfyUI-MoGe2] Health check: failed
[16:03] [ComfyUI] [ComfyUI-MoGe2] sys_path sent to worker: ['/workspaces/Sharp-2211/ComfyUI', '/workspaces/Sharp-2211/ComfyUI/custom_nodes/ComfyUI-MoGe2', '/tmp/comfytest-home/.ce/.pixi/envs/moge2-nodes/lib/python3.1/site-packages', '/workspaces/Sharp-2211/ComfyUI/custom_nodes/ComfyUI-MoGe2']
[16:03] [ComfyUI] [SubprocessWorker] is_pixi=True, python=/tmp/comfytest-home/.ce/.pixi/envs/moge2-nodes/bin/python
[16:03] [ComfyUI] [ComfyUI-MoGe2] Socket unhealthy, restarting worker...
[16:03] [ComfyUI] [SubprocessWorker] launching cmd=['/tmp/comfytest-home/.pixi/bin/pixi', 'run', '--as-is', '--manifest-path', '/tmp/comfytest-home/.ce/pixi.toml', '-e', 'moge2-nodes', 'python', '/tmp/comfyui_pvenv_ex649j74/persistent_worker.py', 'abstract://comfy_worker_252cdf4fa006']...
[16:03] [ComfyUI] [comfy-env] Invalidated 1 stale model patchers (will be cleaned up during next unload)
[16:03] [ComfyUI] [SubprocessWorker] socket_addr=abstract://comfy_worker_252cdf4fa006 (abstract, no filesystem path)
[16:04] [ComfyUI] [worker:ComfyUI-MoGe2] ERROR: Failed to import comfy_kitchen, Error: No module named 'comfy_kitchen', fp8 and fp4 support will not be available.
[16:04] [ComfyUI] [worker:ComfyUI-MoGe2] WARNING: comfy_kitchen does not support stochastic FP8 rounding, please update comfy_kitchen.
[16:04] [ComfyUI] [SubprocessWorker] call_id=3 sending model_to_device
[16:04] [ComfyUI] [WARNING] Model 'MoGeWrapper_1' gone from worker (restarted?), treating as offloaded
[16:04] [ComfyUI] [comfy-env] [VRAM] After offload 'MoGeWrapper_1' (631 MB): 14334 / 24122 MB
[16:04] [ComfyUI] [comfy-env] [VRAM] Before offload 'RGBGaussianPredictor_1' (2679 MB) -> cpu: 14334 / 24122 MB
[16:04] [ComfyUI] [ComfyUI-Sharp] Health check: ping (timeout=5.0s)...
[16:04] [ComfyUI] [ComfyUI-Sharp] Health check: ok
[16:04] [ComfyUI] [SubprocessWorker] call_id=5 sending model_to_device
[16:05] [ComfyUI] [worker:ComfyUI-Sharp] [VRAM] -814MB (now 1874MB) reserved=7328MB peak=7062MB
[16:06] [ComfyUI] [worker:ComfyUI-Sharp] [VRAM] -1617MB (now 258MB) reserved=7328MB peak=7062MB
[16:06] [ComfyUI] [comfy-env] [VRAM] After offload 'RGBGaussianPredictor_1' (2679 MB): 7034 / 24122 MB
[16:06] [ComfyUI] [INFO] Using RAM pressure cache.
[16:09] Frame 1 saved (frame_000.jpg, t=0.0s)
[16:09] Validating workflow...
[16:09] [ComfyUI] [INFO] === /validate endpoint called ===
[16:09] [ComfyUI] [INFO] Received JSON with keys: ['prompt']
[16:09] Queuing workflow for execution...
[16:09] [ComfyUI] [INFO] Prompt has 4 nodes
[16:09] [ComfyUI] [INFO] Node 1: LoadImage
[16:09] [ComfyUI] [INFO] Inputs: {"image": "beach.jpg"}
[16:09] [ComfyUI] [INFO] Node 2: LoadSharpModel
[16:09] [ComfyUI] [INFO] Inputs: {"precision": "auto"}
[16:09] [ComfyUI] [INFO] Node 5: SharpPredict
[16:09] [ComfyUI] [INFO] Inputs: {"focal_length_mm": 30, "output_prefix": "sharp", "model": ["2", 0], "image": ["1", 0]}
[16:09] [ComfyUI] [INFO] Node 6: PreviewGaussianSharp
[16:09] [ComfyUI] [INFO] Inputs: {"preview_gaussian": "", "ply_path": ["5", 0], "extrinsics": ["5", 1], "intrinsics": ["5", 2]}
[16:09] [ComfyUI] [INFO] Generated prompt_id: cae6e76c-d568-492d-b085-7aa10b804d9e
[16:09] [ComfyUI] [INFO] Calling execution.validate_prompt()...
[16:09] [ComfyUI] [INFO] Validation result: valid=True
[16:09] [ComfyUI] [INFO] === Validation PASSED ===
[16:09] [ComfyUI] [INFO] got prompt
[16:09] [ComfyUI] [comfy-env] Running LoadSharpModel: precision: 'auto'
[16:09] [ComfyUI] [VRAM] Before LoadSharpModel: 4995 / 24122 MB
[16:09] [ComfyUI] [ComfyUI-Sharp] python: /tmp/comfytest-home/.ce/.pixi/envs/sharp-nodes/bin/python
[16:09] [ComfyUI] [ComfyUI-Sharp] sys_path sent to worker: ['/workspaces/Sharp-2211/ComfyUI', '/workspaces/Sharp-2211/ComfyUI/custom_nodes/ComfyUI-Sharp', '/tmp/comfytest-home/.ce/.pixi/envs/sharp-nodes/lib/python3.1/site-packages', '/workspaces/Sharp-2211/ComfyUI/custom_nodes/ComfyUI-Sharp']
[16:09] [ComfyUI] [SubprocessWorker] call_method: nodes.load_model.LoadSharpModel.EXECUTE_NORMALIZED
[16:09] [ComfyUI] [SubprocessWorker] acquired lock, ensuring started...
[16:09] [ComfyUI] [SubprocessWorker] is_pixi=True, python=/tmp/comfytest-home/.ce/.pixi/envs/sharp-nodes/bin/python
[16:09] [ComfyUI] [SubprocessWorker] launching cmd=['/tmp/comfytest-home/.pixi/bin/pixi', 'run', '--as-is', '--manifest-path', '/tmp/comfytest-home/.ce/pixi.toml', '-e', 'sharp-nodes', 'python', '/tmp/comfyui_pvenv_xcjd5ki2/persistent_worker.py', 'abstract://comfy_worker_398afb58be11']...
[16:09] [ComfyUI] [ComfyUI-Sharp] Health check: ping (timeout=5.0s)...
[16:09] [ComfyUI] [SubprocessWorker] socket_addr=abstract://comfy_worker_398afb58be11 (abstract, no filesystem path)
[16:09] [ComfyUI] [ComfyUI-Sharp] Health check: failed
[16:09] [ComfyUI] [ComfyUI-Sharp] Socket unhealthy, restarting worker...
[16:09] [ComfyUI] [comfy-env] Invalidated 1 stale model patchers (will be cleaned up during next unload)
[16:10] [ComfyUI] [worker:ComfyUI-Sharp] ERROR: Failed to import comfy_kitchen, Error: No module named 'comfy_kitchen', fp8 and fp4 support will not be available.
[16:10] [ComfyUI] [worker:ComfyUI-Sharp] WARNING: comfy_kitchen does not support stochastic FP8 rounding, please update comfy_kitchen.
[16:10] [ComfyUI] [SubprocessWorker] worker started/confirmed
[16:10] [ComfyUI] [SubprocessWorker] serializing kwargs to shm...
[16:10] [ComfyUI] [SubprocessWorker] created 0 shm blocks
[16:10] [ComfyUI] [SubprocessWorker] sending request via socket...
[16:10] [ComfyUI] [SubprocessWorker] call_id=6 sending call_method
[16:11] [ComfyUI] [worker:ComfyUI-Sharp] [LoadSharpModel] precision='auto' -> dtype=bf16 (device=cuda:0)
[16:11] [ComfyUI] [worker:ComfyUI-Sharp] [LoadSharpModel] checkpoint already present, reusing (no download): /workspaces/Sharp-2211/ComfyUI/models/sharp/sharp_2572gikvuh.pt (2679.6 MB)
[16:11] [ComfyUI] [worker:ComfyUI-Sharp] [LoadSharpModel] checkpoint ready: /workspaces/Sharp-2211/ComfyUI/models/sharp/sharp_2572gikvuh.pt (2679.6 MB)
[16:11] [ComfyUI] [worker:ComfyUI-Sharp] [LoadSharpModel] config: precision=auto -> dtype=bf16
[16:11] [ComfyUI] [SubprocessWorker] got response: ok
[16:11] [ComfyUI] [comfy-env] [VRAM] Before offload 'RGBGaussianPredictor_1' (2679 MB) -> cpu: 4817 / 24122 MB
[16:11] [ComfyUI] [ComfyUI-Sharp] Health check: ping (timeout=5.0s)...
[16:11] [ComfyUI] [ComfyUI-Sharp] Health check: ok
[16:11] [ComfyUI] [SubprocessWorker] call_id=7 sending model_to_device
[16:11] [ComfyUI] [WARNING] Model 'RGBGaussianPredictor_1' gone from worker (restarted?), treating as offloaded
[16:11] [ComfyUI] [comfy-env] [VRAM] After offload 'RGBGaussianPredictor_1' (2679 MB): 4817 / 24122 MB
[16:11] [ComfyUI] [comfy-env] [VRAM] Before offload 'MoGeWrapper_1' (631 MB) -> cpu: 4817 / 24122 MB
[16:11] [ComfyUI] [ComfyUI-MoGe2] Health check: ping (timeout=5.0s)...
[16:11] [ComfyUI] [ComfyUI-MoGe2] Health check: ok
[16:11] [ComfyUI] [SubprocessWorker] call_id=4 sending model_to_device
[16:11] [ComfyUI] [WARNING] Model 'MoGeWrapper_1' gone from worker (restarted?), treating as offloaded
[16:11] [ComfyUI] [comfy-env] [VRAM] After offload 'MoGeWrapper_1' (631 MB): 4817 / 24122 MB
[16:11] [ComfyUI] [comfy-env] LoadSharpModel done (2.07s): result: NodeOutput
[16:11] [ComfyUI] [VRAM] After LoadSharpModel: 4817 / 24122 MB
[16:11] [ComfyUI] [comfy-env] Running SharpPredict: focal_length_mm: 30.0, output_prefix: 'sharp', model: dict, image: torch.float32 [1,1024,1536,3] cpu
[16:11] [ComfyUI] [VRAM] Before SharpPredict: 4817 / 24122 MB
[16:11] Frame 2 saved (frame_001.jpg, t=2.2s)
[16:11] [capture-periodic] freeze=1ms shot=118ms unfreeze=1ms saved=True
[16:11] [ComfyUI] [SubprocessWorker] call_method: nodes.predict.SharpPredict.EXECUTE_NORMALIZED
[16:11] [ComfyUI] [SubprocessWorker] acquired lock, ensuring started...
[16:11] [ComfyUI] [ComfyUI-Sharp] Health check: ping (timeout=5.0s)...
[16:11] [ComfyUI] [ComfyUI-Sharp] Health check: ok
[16:11] [ComfyUI] [SubprocessWorker] worker started/confirmed
[16:11] [ComfyUI] [comfy-env] PRE-SERIALIZE 'image' shape: torch.Size([1, 1024, 1536, 3])
[16:11] [ComfyUI] [SubprocessWorker] serializing kwargs to shm...
[16:12] [ComfyUI] [SubprocessWorker] created 0 shm blocks
[16:12] [ComfyUI] [SubprocessWorker] sending request via socket...
[16:12] [ComfyUI] [SubprocessWorker] call_id=8 sending call_method
[16:12] [ComfyUI] [worker:ComfyUI-Sharp] [comfy-env] _from_shm got dict with keys: ['__type__', 'strategy', 'parent_pid', 'fd', 'storage_size']
[16:12] [ComfyUI] [worker:ComfyUI-Sharp] [comfy-env] DESERIALIZE TensorRef: tensor_size=[1, 1024, 1536, 3]
[16:12] [ComfyUI] [worker:ComfyUI-Sharp] [comfy-env] DESERIALIZED tensor shape: torch.Size([1, 1024, 1536, 3])
[16:13] Frame 3 saved (frame_002.jpg, t=4.5s)
[16:13] [capture-periodic] freeze=1ms shot=83ms unfreeze=1ms saved=True
[16:14] [ComfyUI] [worker:ComfyUI-Sharp] [LoadSharpModel] loading checkpoint from /workspaces/Sharp-2211/ComfyUI/models/sharp/sharp_2572gikvuh.pt (dtype=bf16)
[16:14] [capture-loop] iter=50 t=5.5s state={'complete': False, 'error': None, 'executedCount': 0, 'wsState': 1} eval_ms=2 ram=10.3/31.3GB (33%) swap=3.5/32.0GB (11%) cpu=34% browser_rss=0.86GB
[16:15] [ComfyUI] [worker:ComfyUI-Sharp] [LoadSharpModel] initializing model on meta device...
[16:15] [ComfyUI] [worker:ComfyUI-Sharp] [LoadSharpModel] model ready (torch.bfloat16)
[16:15] [ComfyUI] [SubprocessWorker] callback 'request_vram_budget' from call_id=8
[16:15] [ComfyUI] [comfy-env] VRAM request: 2.81GB, free before eviction: 20.24GB
[16:15] [ComfyUI] [comfy-env] VRAM after eviction: 20.24GB
[16:16] [ComfyUI] [worker:ComfyUI-Sharp] [VRAM] +475MB (now 475MB) reserved=480MB peak=475MB
[16:17] [ComfyUI] [worker:ComfyUI-Sharp] [VRAM] +2767MB (now 3242MB) reserved=3456MB peak=3287MB
[16:18] [ComfyUI] [worker:ComfyUI-Sharp] [VRAM] +359MB (now 3601MB) reserved=3744MB peak=3601MB
[16:19] [ComfyUI] [worker:ComfyUI-Sharp] [VRAM] +562MB (now 4164MB) reserved=7840MB peak=7053MB
[16:19] [capture-loop] iter=100 t=10.9s state={'complete': False, 'error': None, 'executedCount': 0, 'wsState': 1} eval_ms=1 ram=12.8/31.3GB (41%) swap=3.5/32.0GB (11%) cpu=14% browser_rss=0.74GB
[16:20] [ComfyUI] [worker:ComfyUI-Sharp] [VRAM] +234MB (now 4398MB) reserved=7360MB peak=7053MB
[16:20] [ComfyUI] [SubprocessWorker] callback 'report_progress' from call_id=8
[16:20] [ComfyUI] [SubprocessWorker] got response: ok
[16:20] [ComfyUI] [comfy-env] Created 1 model patchers: ['RGBGaussianPredictor_1']
[16:20] [ComfyUI] [comfy-env] SharpPredict done (9.78s): result: NodeOutput
[16:20] [ComfyUI] [VRAM] After SharpPredict: 12291 / 24122 MB
[16:21] [ComfyUI] [VRAM] Loaded: SubprocessModel (2679 MB)
[16:21] [ComfyUI] [comfy-env] Running PreviewGaussianSharp: ply_path: '/workspaces/Sharp-2211/ComfyUI/output/sharp_178087128086..., extrinsics: list[4], intrinsics: list[3]
[16:21] [ComfyUI] [VRAM] Before PreviewGaussianSharp: 12291 / 24122 MB
[16:21] [ComfyUI] [VRAM] Loaded: SubprocessModel (2679 MB)
[16:21] [ComfyUI] [SubprocessWorker] call_method: nodes.preview_gaussian_sharp.PreviewGaussianSharp.EXECUTE_NORMALIZED
[16:21] [ComfyUI] [SubprocessWorker] acquired lock, ensuring started...
[16:21] [ComfyUI] [ComfyUI-GaussianPack] Health check: ping (timeout=5.0s)...
[16:21] [ComfyUI] [ComfyUI-GaussianPack] Health check: ok
[16:21] [ComfyUI] [SubprocessWorker] worker started/confirmed
[16:21] [ComfyUI] [SubprocessWorker] serializing kwargs to shm...
[16:21] [ComfyUI] [SubprocessWorker] created 0 shm blocks
[16:21] [ComfyUI] [SubprocessWorker] sending request via socket...
[16:21] [ComfyUI] [SubprocessWorker] call_id=3 sending call_method
[16:21] [ComfyUI] [SubprocessWorker] got response: ok
[16:21] [ComfyUI] [comfy-env] PreviewGaussianSharp done (0.05s): result: NodeOutput
[16:21] [ComfyUI] [VRAM] After PreviewGaussianSharp: 12291 / 24122 MB
[16:21] [ComfyUI] [VRAM] Loaded: SubprocessModel (2679 MB)
[16:21] [ComfyUI] [INFO] Prompt executed in 11.96 seconds
[16:21] [ComfyUI] [comfy-env] [VRAM] Before offload 'RGBGaussianPredictor_1' (2679 MB) -> cpu: 12291 / 24122 MB
[16:21] [ComfyUI] [ComfyUI-Sharp] Health check: ping (timeout=5.0s)...
[16:21] [ComfyUI] [ComfyUI-Sharp] Health check: ok
[16:21] [ComfyUI] [SubprocessWorker] call_id=9 sending model_to_device
[16:21] Node executed (1 total), capturing...
[16:21] [ComfyUI] [worker:ComfyUI-Sharp] [VRAM] -2112MB (now 2287MB) reserved=7360MB peak=7053MB
[16:22] [ComfyUI] [worker:ComfyUI-Sharp] [VRAM] -1801MB (now 486MB) reserved=7360MB peak=7053MB
[16:22] Frame 4 saved (frame_003.jpg, t=12.4s)
[16:22] [capture-node] freeze=611ms shot=375ms unfreeze=0ms saved=True
[16:22] Execution complete (t=12.4s)
[16:22] [3d-wait] Phase 1: Waiting for 'Loading 3D Model' text to disappear...
[16:22] [3d-wait] Phase 1 done in 0.0s
[16:22] [3d-wait] Phase 2: iframes=1
[16:22] [3d-wait] iframe viewer_ready=True (matched 1 console logs)
[16:22] [3d-wait] Unfrozen in 0.001s, rendering for 5s...
[16:22] [ComfyUI] [comfy-env] [VRAM] After offload 'RGBGaussianPredictor_1' (2679 MB): 5027 / 24122 MB
[16:22] [ComfyUI] [INFO] Using RAM pressure cache.
[16:30] [3d-wait] JS halted via CDP after 7.9s
[16:53] [3d-wait] Re-frozen in 31.6s
[16:53] [3d-wait] Total 3D wait: 31.6s
[16:53] Captured 4 unique frames over 45.05s
[16:53] [debug] iframes: 1
[16:53] [debug] iframe[0]: src=http://127.0.0.1:41898/extensions/ComfyUI-GaussianPack/viewer_gaussian_sharp.htm, canvas=1536x1024, rafFrozen=True
[16:53] [timing] trigger_3d_previews: 0.0s
[16:56] Saved high-quality screenshot: sharp_basic_executed.png
[16:56] [timing] final_screenshot: 0.3s
[16:56] [ComfyUI] [INFO] Using RAM pressure cache.
[16:56] Capturing execution frames: sharp_exif.json
[16:56] [ComfyUI] [INFO] Using RAM pressure cache.
[17:01] Frame 1 saved (frame_000.jpg, t=0.0s)
[17:01] Validating workflow...
[17:01] [ComfyUI] [INFO] === /validate endpoint called ===
[17:01] Queuing workflow for execution...
[17:01] [ComfyUI] [INFO] Received JSON with keys: ['prompt']
[17:01] [ComfyUI] [INFO] Prompt has 4 nodes
[17:01] [ComfyUI] [INFO] Node 2: LoadSharpModel
[17:01] [ComfyUI] [INFO] Inputs: {"precision": "auto"}
[17:01] [ComfyUI] [ComfyUI-Sharp] python: /tmp/comfytest-home/.ce/.pixi/envs/sharp-nodes/bin/python
[17:01] [ComfyUI] [INFO] Node 7: SharpPredict
[17:01] [ComfyUI] [ComfyUI-Sharp] sys_path sent to worker: ['/workspaces/Sharp-2211/ComfyUI', '/workspaces/Sharp-2211/ComfyUI/custom_nodes/ComfyUI-Sharp', '/tmp/comfytest-home/.ce/.pixi/envs/sharp-nodes/lib/python3.1/site-packages', '/workspaces/Sharp-2211/ComfyUI/custom_nodes/ComfyUI-Sharp']
[17:01] [ComfyUI] [INFO] Inputs: {"focal_length_mm": ["9", 2], "output_prefix": "sharp", "model": ["2", 0], "image": ["9", 0]}
[17:01] [ComfyUI] [SubprocessWorker] is_pixi=True, python=/tmp/comfytest-home/.ce/.pixi/envs/sharp-nodes/bin/python
[17:01] [ComfyUI] [INFO] Node 9: LoadImageWithExif
[17:01] [ComfyUI] [SubprocessWorker] launching cmd=['/tmp/comfytest-home/.pixi/bin/pixi', 'run', '--as-is', '--manifest-path', '/tmp/comfytest-home/.ce/pixi.toml', '-e', 'sharp-nodes', 'python', '/tmp/comfyui_pvenv_xcjd5ki2/persistent_worker.py', 'abstract://comfy_worker_26bc3eeea4a5']...
[17:01] [ComfyUI] [INFO] Inputs: {"image": "eth3d.png", "default_focal_mm": 30}
[17:01] [ComfyUI] [SubprocessWorker] socket_addr=abstract://comfy_worker_26bc3eeea4a5 (abstract, no filesystem path)
[17:01] [ComfyUI] [INFO] Node 11: PreviewGaussianSharp
[17:01] [ComfyUI] [INFO] Inputs: {"preview_gaussian": "", "ply_path": ["7", 0], "extrinsics": ["7", 1], "intrinsics": ["7", 2]}
[17:01] [ComfyUI] [INFO] Generated prompt_id: 50ff2490-c0a7-4164-996f-663c5bd585b4
[17:01] [ComfyUI] [INFO] Calling execution.validate_prompt()...
[17:01] [ComfyUI] [INFO] Validation result: valid=True
[17:01] [ComfyUI] [INFO] === Validation PASSED ===
[17:01] [ComfyUI] [INFO] got prompt
[17:01] [ComfyUI] [comfy-env] Running LoadImageWithExif: image: 'eth3d.png', default_focal_mm: 30.0
[17:01] [ComfyUI] [VRAM] Before LoadImageWithExif: 5027 / 24122 MB
[17:01] [ComfyUI] [SubprocessWorker] call_method: nodes.load_image_exif.LoadImageWithExif.EXECUTE_NORMALIZED
[17:01] [ComfyUI] [SubprocessWorker] acquired lock, ensuring started...
[17:01] [ComfyUI] [ComfyUI-Sharp] Health check: ping (timeout=5.0s)...
[17:01] [ComfyUI] [ComfyUI-Sharp] Health check: failed
[17:01] [ComfyUI] [ComfyUI-Sharp] Socket unhealthy, restarting worker...
[17:01] [ComfyUI] [comfy-env] Invalidated 1 stale model patchers (will be cleaned up during next unload)
[17:03] [ComfyUI] [worker:ComfyUI-Sharp] ERROR: Failed to import comfy_kitchen, Error: No module named 'comfy_kitchen', fp8 and fp4 support will not be available.
[17:03] [ComfyUI] [worker:ComfyUI-Sharp] WARNING: comfy_kitchen does not support stochastic FP8 rounding, please update comfy_kitchen.
[17:03] [ComfyUI] [SubprocessWorker] worker started/confirmed
[17:03] [ComfyUI] [SubprocessWorker] serializing kwargs to shm...
[17:03] [ComfyUI] [SubprocessWorker] created 0 shm blocks
[17:03] [ComfyUI] [SubprocessWorker] sending request via socket...
[17:03] [ComfyUI] [SubprocessWorker] call_id=10 sending call_method
[17:03] [ComfyUI] [SubprocessWorker] got response: ok
[17:03] [ComfyUI] [comfy-env] [VRAM] Before offload 'RGBGaussianPredictor_1' (2679 MB) -> cpu: 4817 / 24122 MB
[17:03] [ComfyUI] [ComfyUI-Sharp] Health check: ping (timeout=5.0s)...
[17:03] [ComfyUI] [ComfyUI-Sharp] Health check: ok
[17:03] [ComfyUI] [SubprocessWorker] call_id=11 sending model_to_device
[17:03] [ComfyUI] [WARNING] Model 'RGBGaussianPredictor_1' gone from worker (restarted?), treating as offloaded
[17:03] [ComfyUI] [comfy-env] [VRAM] After offload 'RGBGaussianPredictor_1' (2679 MB): 4817 / 24122 MB
[17:03] [ComfyUI] [comfy-env] LoadImageWithExif done (1.68s): result: NodeOutput
[17:03] [ComfyUI] [VRAM] After LoadImageWithExif: 4817 / 24122 MB
[17:03] [ComfyUI] [comfy-env] Running LoadSharpModel: precision: 'auto'
[17:03] [ComfyUI] [VRAM] Before LoadSharpModel: 4817 / 24122 MB
[17:03] [ComfyUI] [SubprocessWorker] call_method: nodes.load_model.LoadSharpModel.EXECUTE_NORMALIZED
[17:03] [ComfyUI] [SubprocessWorker] acquired lock, ensuring started...
[17:03] [ComfyUI] [ComfyUI-Sharp] Health check: ping (timeout=5.0s)...
[17:03] [ComfyUI] [ComfyUI-Sharp] Health check: ok
[17:03] [ComfyUI] [SubprocessWorker] worker started/confirmed
[17:03] [ComfyUI] [SubprocessWorker] serializing kwargs to shm...
[17:03] [ComfyUI] [SubprocessWorker] created 0 shm blocks
[17:03] [ComfyUI] [SubprocessWorker] sending request via socket...
[17:03] [ComfyUI] [SubprocessWorker] call_id=12 sending call_method
[17:03] [ComfyUI] [worker:ComfyUI-Sharp] [LoadSharpModel] precision='auto' -> dtype=bf16 (device=cuda:0)
[17:03] [ComfyUI] [worker:ComfyUI-Sharp] [LoadSharpModel] checkpoint already present, reusing (no download): /workspaces/Sharp-2211/ComfyUI/models/sharp/sharp_2572gikvuh.pt (2679.6 MB)
[17:03] [ComfyUI] [worker:ComfyUI-Sharp] [LoadSharpModel] checkpoint ready: /workspaces/Sharp-2211/ComfyUI/models/sharp/sharp_2572gikvuh.pt (2679.6 MB)
[17:03] [ComfyUI] [worker:ComfyUI-Sharp] [LoadSharpModel] config: precision=auto -> dtype=bf16
[17:03] [ComfyUI] [SubprocessWorker] got response: ok
[17:03] [ComfyUI] [comfy-env] LoadSharpModel done (0.08s): result: NodeOutput
[17:03] [ComfyUI] [VRAM] After LoadSharpModel: 4817 / 24122 MB
[17:03] [ComfyUI] [comfy-env] Running SharpPredict: focal_length_mm: 20.0, output_prefix: 'sharp', model: dict, image: torch.float32 [1,1011,1520,3] cpu
[17:03] [ComfyUI] [VRAM] Before SharpPredict: 4817 / 24122 MB
[17:03] [ComfyUI] [SubprocessWorker] call_method: nodes.predict.SharpPredict.EXECUTE_NORMALIZED
[17:03] [ComfyUI] [SubprocessWorker] acquired lock, ensuring started...
[17:03] [ComfyUI] [ComfyUI-Sharp] Health check: ping (timeout=5.0s)...
[17:03] [ComfyUI] [ComfyUI-Sharp] Health check: ok
[17:03] [ComfyUI] [SubprocessWorker] worker started/confirmed
[17:03] [ComfyUI] [comfy-env] PRE-SERIALIZE 'image' shape: torch.Size([1, 1011, 1520, 3])
[17:03] [ComfyUI] [SubprocessWorker] serializing kwargs to shm...
[17:03] [ComfyUI] [SubprocessWorker] created 0 shm blocks
[17:03] [ComfyUI] [SubprocessWorker] sending request via socket...
[17:03] [ComfyUI] [SubprocessWorker] call_id=13 sending call_method
[17:03] [ComfyUI] [worker:ComfyUI-Sharp] [comfy-env] _from_shm got dict with keys: ['__type__', 'strategy', 'parent_pid', 'fd', 'storage_size']
[17:03] [ComfyUI] [worker:ComfyUI-Sharp] [comfy-env] DESERIALIZE TensorRef: tensor_size=[1, 1011, 1520, 3]
[17:03] [ComfyUI] [worker:ComfyUI-Sharp] [comfy-env] DESERIALIZED tensor shape: torch.Size([1, 1011, 1520, 3])
[17:04] Frame 2 saved (frame_001.jpg, t=2.3s)
[17:04] [capture-periodic] freeze=1ms shot=115ms unfreeze=1ms saved=True
[17:05] [ComfyUI] [worker:ComfyUI-Sharp] [LoadSharpModel] loading checkpoint from /workspaces/Sharp-2211/ComfyUI/models/sharp/sharp_2572gikvuh.pt (dtype=bf16)
[17:06] Frame 3 saved (frame_002.jpg, t=4.5s)
[17:06] [capture-periodic] freeze=1ms shot=110ms unfreeze=1ms saved=True
[17:07] [ComfyUI] [worker:ComfyUI-Sharp] [LoadSharpModel] initializing model on meta device...
[17:07] [ComfyUI] [worker:ComfyUI-Sharp] [LoadSharpModel] model ready (torch.bfloat16)
[17:07] [ComfyUI] [SubprocessWorker] callback 'request_vram_budget' from call_id=13
[17:07] [ComfyUI] [comfy-env] VRAM request: 2.81GB, free before eviction: 20.24GB
[17:07] [ComfyUI] [comfy-env] VRAM after eviction: 20.24GB
[17:07] [ComfyUI] [worker:ComfyUI-Sharp] [VRAM] +314MB (now 314MB) reserved=320MB peak=314MB
[17:07] [capture-loop] iter=50 t=5.8s state={'complete': False, 'error': None, 'executedCount': 0, 'wsState': 1} eval_ms=2 ram=12.8/31.3GB (41%) swap=3.5/32.0GB (11%) cpu=70% browser_rss=0.86GB
[17:08] [ComfyUI] [worker:ComfyUI-Sharp] [VRAM] +2990MB (now 3304MB) reserved=3456MB peak=3341MB
[17:09] [ComfyUI] [worker:ComfyUI-Sharp] [VRAM] +3748MB (now 7053MB) reserved=7680MB peak=7053MB
[17:10] [ComfyUI] [worker:ComfyUI-Sharp] [VRAM] -2890MB (now 4163MB) reserved=7680MB peak=7053MB
[17:11] [ComfyUI] [worker:ComfyUI-Sharp] [VRAM] +234MB (now 4397MB) reserved=7328MB peak=7053MB
[17:11] [ComfyUI] [SubprocessWorker] callback 'report_progress' from call_id=13
[17:11] [ComfyUI] [SubprocessWorker] got response: ok
[17:11] [ComfyUI] [comfy-env] Created 1 model patchers: ['RGBGaussianPredictor_1']
[17:11] [ComfyUI] [ComfyUI-GaussianPack] python: /tmp/comfytest-home/.ce/.pixi/envs/gaussianpack-nodes/bin/python
[17:11] [ComfyUI] [ComfyUI-GaussianPack] sys_path sent to worker: ['/workspaces/Sharp-2211/ComfyUI', '/workspaces/Sharp-2211/ComfyUI/custom_nodes/ComfyUI-GaussianPack', '/tmp/comfytest-home/.ce/.pixi/envs/gaussianpack-nodes/lib/python3.1/site-packages', '/workspaces/Sharp-2211/ComfyUI/custom_nodes/ComfyUI-GaussianPack']
[17:11] [ComfyUI] [comfy-env] SharpPredict done (7.99s): result: NodeOutput
[17:11] [ComfyUI] [SubprocessWorker] is_pixi=True, python=/tmp/comfytest-home/.ce/.pixi/envs/gaussianpack-nodes/bin/python
[17:11] [ComfyUI] [VRAM] After SharpPredict: 12259 / 24122 MB
[17:11] [ComfyUI] [VRAM] Loaded: SubprocessModel (2679 MB)
[17:11] [ComfyUI] [SubprocessWorker] launching cmd=['/tmp/comfytest-home/.pixi/bin/pixi', 'run', '--as-is', '--manifest-path', '/tmp/comfytest-home/.ce/pixi.toml', '-e', 'gaussianpack-nodes', 'python', '/tmp/comfyui_pvenv_wwutae6l/persistent_worker.py', 'abstract://comfy_worker_4066a9b9374a']...
[17:11] [ComfyUI] [SubprocessWorker] socket_addr=abstract://comfy_worker_4066a9b9374a (abstract, no filesystem path)
[17:11] [ComfyUI] [comfy-env] Running PreviewGaussianSharp: ply_path: '/workspaces/Sharp-2211/ComfyUI/output/sharp_178087133215..., extrinsics: list[4], intrinsics: list[3]
[17:11] [ComfyUI] [VRAM] Before PreviewGaussianSharp: 12259 / 24122 MB
[17:11] [ComfyUI] [VRAM] Loaded: SubprocessModel (2679 MB)
[17:11] [ComfyUI] [SubprocessWorker] call_method: nodes.preview_gaussian_sharp.PreviewGaussianSharp.EXECUTE_NORMALIZED
[17:11] [ComfyUI] [SubprocessWorker] acquired lock, ensuring started...
[17:11] [ComfyUI] [ComfyUI-GaussianPack] Health check: ping (timeout=5.0s)...
[17:11] [ComfyUI] [ComfyUI-GaussianPack] Health check: failed
[17:11] [ComfyUI] [ComfyUI-GaussianPack] Socket unhealthy, restarting worker...
[17:12] [capture-loop] iter=100 t=11.1s state={'complete': False, 'error': None, 'executedCount': 0, 'wsState': 1} eval_ms=2 ram=15.3/31.3GB (49%) swap=3.5/32.0GB (11%) cpu=14% browser_rss=0.81GB
[17:12] [ComfyUI] [SubprocessWorker] worker started/confirmed
[17:12] [ComfyUI] [SubprocessWorker] serializing kwargs to shm...
[17:12] [ComfyUI] [SubprocessWorker] created 0 shm blocks
[17:12] [ComfyUI] [SubprocessWorker] sending request via socket...
[17:12] [ComfyUI] [SubprocessWorker] call_id=4 sending call_method
[17:12] Frame 4 saved (frame_003.jpg, t=11.1s)
[17:12] [capture-periodic] freeze=1ms shot=127ms unfreeze=2ms saved=True
[17:13] [ComfyUI] [worker:ComfyUI-GaussianPack] WARNING: SPZ route not registered (ModuleNotFoundError: No module named 'comfy_aimdo')
[17:13] [ComfyUI] [SubprocessWorker] got response: ok
[17:13] [ComfyUI] [comfy-env] PreviewGaussianSharp done (1.42s): result: NodeOutput
[17:13] [ComfyUI] [VRAM] After PreviewGaussianSharp: 12259 / 24122 MB
[17:13] [ComfyUI] [VRAM] Loaded: SubprocessModel (2679 MB)
[17:13] [ComfyUI] [INFO] Prompt executed in 11.17 seconds
[17:13] Node executed (1 total), capturing...
[17:14] Frame 5 saved (frame_004.jpg, t=11.6s)
[17:14] [capture-node] freeze=1ms shot=858ms unfreeze=0ms saved=True
[17:14] Execution complete (t=11.6s)
[17:14] [3d-wait] Phase 1: Waiting for 'Loading 3D Model' text to disappear...
[17:14] [3d-wait] Phase 1 done in 0.0s
[17:14] [3d-wait] Phase 2: iframes=1
[17:14] [3d-wait] iframe viewer_ready=True (matched 1 console logs)
[17:14] [3d-wait] Unfrozen in 0.001s, rendering for 5s...
[17:22] [3d-wait] JS halted via CDP after 8.1s
[17:46] [3d-wait] Re-frozen in 32.5s
[17:46] [3d-wait] Total 3D wait: 32.5s
[17:46] Captured 5 unique frames over 45.15s
[17:46] [debug] iframes: 1
[17:46] [debug] iframe[0]: src=http://127.0.0.1:41898/extensions/ComfyUI-GaussianPack/viewer_gaussian_sharp.htm, canvas=1520x1011, rafFrozen=True
[17:46] [timing] trigger_3d_previews: 0.0s
[17:49] Saved high-quality screenshot: sharp_exif_executed.png
[17:49] [timing] final_screenshot: 0.3s
[17:49] [ComfyUI] [comfy-env] [VRAM] Before offload 'RGBGaussianPredictor_1' (2679 MB) -> cpu: 12259 / 24122 MB
[17:49] Capturing execution frames: vanilla_vs_image_depth_gaussians.json
[17:49] [ComfyUI] [ComfyUI-Sharp] Health check: ping (timeout=5.0s)...
[17:49] [ComfyUI] [ComfyUI-Sharp] python: /tmp/comfytest-home/.ce/.pixi/envs/sharp-nodes/bin/python
[17:49] [ComfyUI] [ComfyUI-Sharp] Health check: failed
[17:49] [ComfyUI] [ComfyUI-Sharp] sys_path sent to worker: ['/workspaces/Sharp-2211/ComfyUI', '/workspaces/Sharp-2211/ComfyUI/custom_nodes/ComfyUI-Sharp', '/tmp/comfytest-home/.ce/.pixi/envs/sharp-nodes/lib/python3.1/site-packages', '/workspaces/Sharp-2211/ComfyUI/custom_nodes/ComfyUI-Sharp']
[17:49] [ComfyUI] [ComfyUI-Sharp] Socket unhealthy, restarting worker...
[17:49] [ComfyUI] [SubprocessWorker] is_pixi=True, python=/tmp/comfytest-home/.ce/.pixi/envs/sharp-nodes/bin/python
[17:49] [ComfyUI] [SubprocessWorker] launching cmd=['/tmp/comfytest-home/.pixi/bin/pixi', 'run', '--as-is', '--manifest-path', '/tmp/comfytest-home/.ce/pixi.toml', '-e', 'sharp-nodes', 'python', '/tmp/comfyui_pvenv_xcjd5ki2/persistent_worker.py', 'abstract://comfy_worker_e03edfd0ef80']...
[17:49] [ComfyUI] [comfy-env] Invalidated 1 stale model patchers (will be cleaned up during next unload)
[17:49] [ComfyUI] [SubprocessWorker] socket_addr=abstract://comfy_worker_e03edfd0ef80 (abstract, no filesystem path)
[17:50] [ComfyUI] [worker:ComfyUI-Sharp] ERROR: Failed to import comfy_kitchen, Error: No module named 'comfy_kitchen', fp8 and fp4 support will not be available.
[17:50] [ComfyUI] [worker:ComfyUI-Sharp] WARNING: comfy_kitchen does not support stochastic FP8 rounding, please update comfy_kitchen.
[17:50] [ComfyUI] [SubprocessWorker] call_id=14 sending model_to_device
[17:50] [ComfyUI] [WARNING] Model 'RGBGaussianPredictor_1' gone from worker (restarted?), treating as offloaded
[17:50] [ComfyUI] [comfy-env] [VRAM] After offload 'RGBGaussianPredictor_1' (2679 MB): 4817 / 24122 MB
[17:50] [ComfyUI] [INFO] Using RAM pressure cache.
[17:54] Frame 1 saved (frame_000.jpg, t=0.0s)
[17:54] Validating workflow...
[17:54] [ComfyUI] [INFO] === /validate endpoint called ===
[17:54] [ComfyUI] [INFO] Received JSON with keys: ['prompt']
[17:54] Queuing workflow for execution...
[17:54] [ComfyUI] [INFO] Prompt has 8 nodes
[17:54] [ComfyUI] [INFO] Node 7: LoadImage
[17:54] [ComfyUI] [INFO] Inputs: {"image": "middlebury.jpg"}
[17:54] [ComfyUI] [INFO] Node 9: LoadSharpModel
[17:54] [ComfyUI] [INFO] Inputs: {"precision": "auto"}
[17:54] [ComfyUI] [INFO] Node 47: SharpPredictMetricDepth
[17:54] [ComfyUI] [INFO] Inputs: {"focal_length_mm": 30, "model": ["9", 0], "image": ["7", 0]}
[17:54] [ComfyUI] [INFO] Node 57: SharpPredict
[17:54] [ComfyUI] [INFO] Inputs: {"focal_length_mm": 30, "output_prefix": "sharp", "model": ["9", 0], "image": ["58", 0]}
[17:54] [ComfyUI] [INFO] Node 58: ImageFromBatch
[17:54] [ComfyUI] [INFO] Inputs: {"batch_index": 0, "length": 1, "image": ["7", 0]}
[17:54] [ComfyUI] [INFO] Node 83: SharpPredictGaussiansFromMetricDepth
[17:54] [ComfyUI] [INFO] Inputs: {"snap_to_external_depth": "none", "depth_convention": "planar_z", "focal_length_mm": 30, "output_prefix": "sharp_aligned", "save_background_layer": true, "edge_crop": 0, "model": ["9", 0], "image": [
[17:54] [ComfyUI] [INFO] Node 92: PreviewGaussianSharp
[17:54] [ComfyUI] [INFO] Inputs: {"preview_gaussian": "", "ply_path": ["83", 0], "extrinsics": ["83", 2], "intrinsics": ["83", 3]}
[17:54] [ComfyUI] [INFO] Node 93: PreviewGaussianSharp
[17:54] [ComfyUI] [INFO] Inputs: {"preview_gaussian": "", "ply_path": ["57", 0], "extrinsics": ["57", 1], "intrinsics": ["57", 2]}
[17:54] [ComfyUI] [INFO] Generated prompt_id: a31e7b61-1f7c-4616-952d-ba775f694de8
[17:54] [ComfyUI] [INFO] Calling execution.validate_prompt()...
[17:54] [ComfyUI] [INFO] Validation result: valid=True
[17:54] [ComfyUI] [INFO] === Validation PASSED ===
[17:54] [ComfyUI] [INFO] got prompt
[17:54] [ComfyUI] [comfy-env] Running LoadSharpModel: precision: 'auto'
[17:54] [ComfyUI] [VRAM] Before LoadSharpModel: 4817 / 24122 MB
[17:54] [ComfyUI] [SubprocessWorker] call_method: nodes.load_model.LoadSharpModel.EXECUTE_NORMALIZED
[17:54] [ComfyUI] [SubprocessWorker] acquired lock, ensuring started...
[17:54] [ComfyUI] [ComfyUI-Sharp] Health check: ping (timeout=5.0s)...
[17:54] [ComfyUI] [ComfyUI-Sharp] Health check: ok
[17:54] [ComfyUI] [SubprocessWorker] worker started/confirmed
[17:54] [ComfyUI] [SubprocessWorker] serializing kwargs to shm...
[17:54] [ComfyUI] [SubprocessWorker] created 0 shm blocks
[17:54] [ComfyUI] [SubprocessWorker] sending request via socket...
[17:54] [ComfyUI] [SubprocessWorker] call_id=15 sending call_method
[17:54] [ComfyUI] [worker:ComfyUI-Sharp] [LoadSharpModel] precision='auto' -> dtype=bf16 (device=cuda:0)
[17:54] [ComfyUI] [worker:ComfyUI-Sharp] [LoadSharpModel] checkpoint already present, reusing (no download): /workspaces/Sharp-2211/ComfyUI/models/sharp/sharp_2572gikvuh.pt (2679.6 MB)
[17:54] [ComfyUI] [worker:ComfyUI-Sharp] [LoadSharpModel] checkpoint ready: /workspaces/Sharp-2211/ComfyUI/models/sharp/sharp_2572gikvuh.pt (2679.6 MB)
[17:54] [ComfyUI] [worker:ComfyUI-Sharp] [LoadSharpModel] config: precision=auto -> dtype=bf16
[17:54] [ComfyUI] [SubprocessWorker] got response: ok
[17:54] [ComfyUI] [comfy-env] [VRAM] Before offload 'RGBGaussianPredictor_1' (2679 MB) -> cpu: 4817 / 24122 MB
[17:54] [ComfyUI] [ComfyUI-Sharp] Health check: ping (timeout=5.0s)...
[17:54] [ComfyUI] [ComfyUI-Sharp] Health check: ok
[17:54] [ComfyUI] [SubprocessWorker] call_id=16 sending model_to_device
[17:54] [ComfyUI] [WARNING] Model 'RGBGaussianPredictor_1' gone from worker (restarted?), treating as offloaded
[17:54] [ComfyUI] [comfy-env] [VRAM] After offload 'RGBGaussianPredictor_1' (2679 MB): 4817 / 24122 MB
[17:54] [ComfyUI] [comfy-env] LoadSharpModel done (0.30s): result: NodeOutput
[17:54] [ComfyUI] [VRAM] After LoadSharpModel: 4817 / 24122 MB
[17:54] [ComfyUI] [comfy-env] Running SharpPredictMetricDepth: focal_length_mm: 30.0, model: dict, image: torch.float32 [1,960,1416,3] cpu
[17:54] [ComfyUI] [VRAM] Before SharpPredictMetricDepth: 4817 / 24122 MB
[17:54] [ComfyUI] [SubprocessWorker] call_method: nodes.predict_metric_depth.SharpPredictMetricDepth.EXECUTE_NORMALIZED
[17:54] [ComfyUI] [SubprocessWorker] acquired lock, ensuring started...
[17:54] [ComfyUI] [ComfyUI-Sharp] Health check: ping (timeout=5.0s)...
[17:54] [ComfyUI] [ComfyUI-Sharp] Health check: ok
[17:54] [ComfyUI] [SubprocessWorker] worker started/confirmed
[17:54] [ComfyUI] [comfy-env] PRE-SERIALIZE 'image' shape: torch.Size([1, 960, 1416, 3])
[17:54] [ComfyUI] [SubprocessWorker] serializing kwargs to shm...
[17:54] [ComfyUI] [SubprocessWorker] created 0 shm blocks
[17:54] [ComfyUI] [SubprocessWorker] sending request via socket...
[17:54] [ComfyUI] [SubprocessWorker] call_id=17 sending call_method
[17:54] [ComfyUI] [worker:ComfyUI-Sharp] [comfy-env] _from_shm got dict with keys: ['__type__', 'strategy', 'parent_pid', 'fd', 'storage_size']
[17:54] [ComfyUI] [worker:ComfyUI-Sharp] [comfy-env] DESERIALIZE TensorRef: tensor_size=[1, 960, 1416, 3]
[17:54] [ComfyUI] [worker:ComfyUI-Sharp] [comfy-env] DESERIALIZED tensor shape: torch.Size([1, 960, 1416, 3])
[17:56] Frame 2 saved (frame_001.jpg, t=2.3s)
[17:56] [capture-periodic] freeze=1ms shot=109ms unfreeze=3ms saved=True
[17:57] [ComfyUI] [worker:ComfyUI-Sharp] [LoadSharpModel] loading checkpoint from /workspaces/Sharp-2211/ComfyUI/models/sharp/sharp_2572gikvuh.pt (dtype=bf16)
[17:58] Frame 3 saved (frame_002.jpg, t=4.5s)
[17:58] [capture-periodic] freeze=1ms shot=100ms unfreeze=2ms saved=True
[17:58] [ComfyUI] [worker:ComfyUI-Sharp] [LoadSharpModel] initializing model on meta device...
[17:59] [ComfyUI] [worker:ComfyUI-Sharp] [LoadSharpModel] model ready (torch.bfloat16)
[17:59] [ComfyUI] [worker:ComfyUI-Sharp] [SharpPredictMetricDepth] intrinsics not wired -> using identity-style K (focal=1186.2px @ image 1416×960, 35mm-equiv 30.0mm). Pass intrinsics from PanoramaSplit for per-face accurate K.
[17:59] [ComfyUI] [SubprocessWorker] callback 'request_vram_budget' from call_id=17
[17:59] [ComfyUI] [comfy-env] VRAM request: 2.81GB, free before eviction: 20.24GB
[17:59] [ComfyUI] [comfy-env] VRAM after eviction: 20.24GB
[17:59] [ComfyUI] [worker:ComfyUI-Sharp] [VRAM] +587MB (now 587MB) reserved=608MB peak=587MB
[17:59] [capture-loop] iter=50 t=5.6s state={'complete': False, 'error': None, 'executedCount': 0, 'wsState': 1} eval_ms=1 ram=10.8/31.3GB (34%) swap=3.5/32.0GB (11%) cpu=73% browser_rss=0.83GB
[18:00] [ComfyUI] [worker:ComfyUI-Sharp] [VRAM] +2652MB (now 3239MB) reserved=3456MB peak=3311MB
[18:01] [ComfyUI] [worker:ComfyUI-Sharp] [VRAM] -267MB (now 2973MB) reserved=3360MB peak=3311MB
[18:02] [ComfyUI] [worker:ComfyUI-Sharp] [VRAM] +1188MB (now 4161MB) reserved=7872MB peak=7051MB
[18:03] [ComfyUI] [worker:ComfyUI-Sharp] [SharpPredictMetricDepth] 1 face(s) @ 1536²; layer0/layer1 depth median=2.12/2.12m, K_1536 fx->1286.7; points_raw ||v||=1.32–3.07m; 4.1s
[18:03] [ComfyUI] [SubprocessWorker] got response: ok
[18:03] [ComfyUI] [comfy-env] Created 1 model patchers: ['RGBGaussianPredictor_1']
[18:03] [ComfyUI] [comfy-env] SharpPredictMetricDepth done (8.51s): result: NodeOutput
[18:03] [ComfyUI] [VRAM] After SharpPredictMetricDepth: 9277 / 24122 MB
[18:03] [ComfyUI] [VRAM] Loaded: SubprocessModel (2679 MB)
[18:03] [ComfyUI] [comfy-env] Running SharpPredictGaussiansFromMetricDepth: snap_to_external_depth: 'none', depth_convention: 'planar_z', focal_length_mm: 30.0, output_prefix: 'sharp_aligned', save_background_layer: True, edge_crop: 0.0, model: dict, image: torch.float32 [1,960,1416,3] cpu, metric_depth_layer0: torch.float32 [1,1536,1536,3] cpu
[18:03] [ComfyUI] [VRAM] Before SharpPredictGaussiansFromMetricDepth: 9277 / 24122 MB
[18:03] [ComfyUI] [VRAM] Loaded: SubprocessModel (2679 MB)
[18:03] [ComfyUI] [SubprocessWorker] call_method: nodes.predict_gaussians_from_depth.SharpPredictGaussiansFromMetricDepth.EXECUTE_NORMALIZED
[18:03] [ComfyUI] [SubprocessWorker] acquired lock, ensuring started...
[18:03] [ComfyUI] [ComfyUI-Sharp] Health check: ping (timeout=5.0s)...
[18:03] [ComfyUI] [ComfyUI-Sharp] Health check: ok
[18:03] [ComfyUI] [SubprocessWorker] worker started/confirmed
[18:03] [ComfyUI] [comfy-env] PRE-SERIALIZE 'image' shape: torch.Size([1, 960, 1416, 3])
[18:03] [ComfyUI] [comfy-env] PRE-SERIALIZE 'metric_depth_layer0' shape: torch.Size([1, 1536, 1536, 3])
[18:03] [ComfyUI] [SubprocessWorker] serializing kwargs to shm...
[18:03] [ComfyUI] [SubprocessWorker] created 0 shm blocks
[18:03] [ComfyUI] [SubprocessWorker] sending request via socket...
[18:03] [ComfyUI] [SubprocessWorker] call_id=18 sending call_method
[18:03] [ComfyUI] [worker:ComfyUI-Sharp] [VRAM] -1474MB (now 2688MB) reserved=4384MB peak=7051MB
[18:03] [ComfyUI] [worker:ComfyUI-Sharp] [comfy-env] _from_shm got dict with keys: ['__type__', 'strategy', 'parent_pid', 'fd', 'storage_size']
[18:03] [ComfyUI] [worker:ComfyUI-Sharp] [comfy-env] DESERIALIZE TensorRef: tensor_size=[1, 960, 1416, 3]
[18:03] [ComfyUI] [worker:ComfyUI-Sharp] [comfy-env] DESERIALIZED tensor shape: torch.Size([1, 960, 1416, 3])
[18:03] [ComfyUI] [worker:ComfyUI-Sharp] [comfy-env] _from_shm got dict with keys: ['__type__', 'strategy', 'parent_pid', 'fd', 'storage_size']
[18:03] [ComfyUI] [worker:ComfyUI-Sharp] [comfy-env] DESERIALIZE TensorRef: tensor_size=[1, 1536, 1536, 3]
[18:03] [ComfyUI] [worker:ComfyUI-Sharp] [comfy-env] DESERIALIZED tensor shape: torch.Size([1, 1536, 1536, 3])
[18:03] [ComfyUI] [worker:ComfyUI-Sharp] [SharpPredictGaussiansFromMetricDepth] metric_depth_layer1 unwired -> layer 1 will duplicate layer 0 (legacy behavior)
[18:03] [ComfyUI] [SubprocessWorker] callback 'request_vram_budget' from call_id=18
[18:03] [ComfyUI] [comfy-env] VRAM request: 2.81GB, free before eviction: 15.57GB
[18:03] [ComfyUI] [comfy-env] VRAM after eviction: 15.57GB
[18:03] [ComfyUI] [worker:ComfyUI-Sharp] [SharpPredictGaussiansFromMetricDepth] face 1/1: 1416×960, extrinsics=none, intrinsics=none, mask=no, snap=none, depth_conv=planar_z
[18:04] [ComfyUI] [worker:ComfyUI-Sharp] [VRAM] +2859MB (now 5547MB) reserved=7552MB peak=7051MB
[18:04] [ComfyUI] [SubprocessWorker] callback 'report_progress' from call_id=18
[18:04] [ComfyUI] [worker:ComfyUI-Sharp] [SharpPredictGaussiansFromMetricDepth] 1 face(s) -> 1.18M gaussians total (both layers, snap=none); saved to /workspaces/Sharp-2211/ComfyUI/output/sharp_aligned_1780871388355.ply; 1.2s
[18:04] [ComfyUI] [SubprocessWorker] got response: ok
[18:04] [ComfyUI] [comfy-env] SharpPredictGaussiansFromMetricDepth done (1.41s): result: NodeOutput
[18:04] [ComfyUI] [VRAM] After SharpPredictGaussiansFromMetricDepth: 12483 / 24122 MB
[18:04] [ComfyUI] [VRAM] Loaded: SubprocessModel (2679 MB)
[18:04] [ComfyUI] [comfy-env] Running PreviewGaussianSharp: ply_path: '/workspaces/Sharp-2211/ComfyUI/output/sharp_aligned_1780..., extrinsics: list[4], intrinsics: list[3]
[18:04] [ComfyUI] [VRAM] Before PreviewGaussianSharp: 12483 / 24122 MB
[18:04] [ComfyUI] [VRAM] Loaded: SubprocessModel (2679 MB)
[18:04] [ComfyUI] [SubprocessWorker] call_method: nodes.preview_gaussian_sharp.PreviewGaussianSharp.EXECUTE_NORMALIZED
[18:04] [ComfyUI] [SubprocessWorker] acquired lock, ensuring started...
[18:04] [ComfyUI] [ComfyUI-GaussianPack] Health check: ping (timeout=5.0s)...
[18:04] [ComfyUI] [ComfyUI-GaussianPack] Health check: ok
[18:04] [ComfyUI] [SubprocessWorker] worker started/confirmed
[18:04] [ComfyUI] [SubprocessWorker] serializing kwargs to shm...
[18:04] [ComfyUI] [SubprocessWorker] created 0 shm blocks
[18:04] [ComfyUI] [SubprocessWorker] sending request via socket...
[18:04] [ComfyUI] [SubprocessWorker] call_id=5 sending call_method
[18:04] [ComfyUI] [SubprocessWorker] got response: ok
[18:04] [ComfyUI] [comfy-env] PreviewGaussianSharp done (0.06s): result: NodeOutput
[18:04] [ComfyUI] [VRAM] After PreviewGaussianSharp: 12483 / 24122 MB
[18:04] [ComfyUI] [VRAM] Loaded: SubprocessModel (2679 MB)
[18:04] [ComfyUI] [comfy-env] Running SharpPredict: focal_length_mm: 30.0, output_prefix: 'sharp', model: dict, image: torch.float32 [1,960,1416,3] cpu
[18:04] [ComfyUI] [VRAM] Before SharpPredict: 12483 / 24122 MB
[18:04] [ComfyUI] [VRAM] Loaded: SubprocessModel (2679 MB)
[18:04] [ComfyUI] [SubprocessWorker] call_method: nodes.predict.SharpPredict.EXECUTE_NORMALIZED
[18:04] Node executed (1 total), capturing...
[18:04] [ComfyUI] [SubprocessWorker] acquired lock, ensuring started...
[18:04] [ComfyUI] [ComfyUI-Sharp] Health check: ping (timeout=5.0s)...
[18:04] [ComfyUI] [ComfyUI-Sharp] Health check: ok
[18:04] [ComfyUI] [SubprocessWorker] worker started/confirmed
[18:04] [ComfyUI] [comfy-env] PRE-SERIALIZE 'image' shape: torch.Size([1, 960, 1416, 3])
[18:04] [ComfyUI] [SubprocessWorker] serializing kwargs to shm...
[18:04] [ComfyUI] [SubprocessWorker] created 0 shm blocks
[18:04] [ComfyUI] [SubprocessWorker] sending request via socket...
[18:04] [ComfyUI] [SubprocessWorker] call_id=19 sending call_method
[18:04] [ComfyUI] [worker:ComfyUI-Sharp] [comfy-env] _from_shm got dict with keys: ['__type__', 'strategy', 'parent_pid', 'fd', 'storage_size']
[18:04] [ComfyUI] [worker:ComfyUI-Sharp] [comfy-env] DESERIALIZE TensorRef: tensor_size=[1, 960, 1416, 3]
[18:04] [ComfyUI] [worker:ComfyUI-Sharp] [comfy-env] DESERIALIZED tensor shape: torch.Size([1, 960, 1416, 3])
[18:04] [ComfyUI] [SubprocessWorker] callback 'request_vram_budget' from call_id=19
[18:04] [ComfyUI] [comfy-env] VRAM request: 2.81GB, free before eviction: 12.20GB
[18:04] [ComfyUI] [comfy-env] VRAM after eviction: 12.20GB
[18:05] [ComfyUI] [worker:ComfyUI-Sharp] [VRAM] -2291MB (now 3257MB) reserved=3456MB peak=7051MB
[18:05] Frame 4 saved (frame_003.jpg, t=10.7s)
[18:05] [capture-node] freeze=710ms shot=372ms unfreeze=2ms saved=True
[18:06] [ComfyUI] [worker:ComfyUI-Sharp] [VRAM] +336MB (now 3594MB) reserved=4064MB peak=7051MB
[18:07] [ComfyUI] [worker:ComfyUI-Sharp] [VRAM] +567MB (now 4161MB) reserved=7968MB peak=7051MB
[18:08] [ComfyUI] [worker:ComfyUI-Sharp] [VRAM] +337MB (now 4499MB) reserved=6816MB peak=7051MB
[18:09] [ComfyUI] [SubprocessWorker] callback 'report_progress' from call_id=19
[18:09] [ComfyUI] [SubprocessWorker] got response: ok
[18:09] [ComfyUI] [comfy-env] SharpPredict done (4.53s): result: NodeOutput
[18:09] [ComfyUI] [VRAM] After SharpPredict: 11747 / 24122 MB
[18:09] [ComfyUI] [VRAM] Loaded: SubprocessModel (2679 MB)
[18:09] [ComfyUI] [comfy-env] Running PreviewGaussianSharp: ply_path: '/workspaces/Sharp-2211/ComfyUI/output/sharp_178087138974..., extrinsics: list[4], intrinsics: list[3]
[18:09] [ComfyUI] [VRAM] Before PreviewGaussianSharp: 11747 / 24122 MB
[18:09] [ComfyUI] [VRAM] Loaded: SubprocessModel (2679 MB)
[18:09] [ComfyUI] [SubprocessWorker] call_method: nodes.preview_gaussian_sharp.PreviewGaussianSharp.EXECUTE_NORMALIZED
[18:09] [ComfyUI] [SubprocessWorker] acquired lock, ensuring started...
[18:09] [ComfyUI] [ComfyUI-GaussianPack] Health check: ping (timeout=5.0s)...
[18:09] [ComfyUI] [ComfyUI-GaussianPack] Health check: ok
[18:09] [ComfyUI] [SubprocessWorker] worker started/confirmed
[18:09] [ComfyUI] [SubprocessWorker] serializing kwargs to shm...
[18:09] [ComfyUI] [SubprocessWorker] created 0 shm blocks
[18:09] [ComfyUI] [SubprocessWorker] sending request via socket...
[18:09] [ComfyUI] [SubprocessWorker] call_id=6 sending call_method
[18:09] [ComfyUI] [SubprocessWorker] got response: ok
[18:09] [ComfyUI] [comfy-env] PreviewGaussianSharp done (0.06s): result: NodeOutput
[18:09] [ComfyUI] [VRAM] After PreviewGaussianSharp: 11747 / 24122 MB
[18:09] [ComfyUI] [VRAM] Loaded: SubprocessModel (2679 MB)
[18:09] [ComfyUI] [INFO] Prompt executed in 14.90 seconds
[18:09] [ComfyUI] [comfy-env] [VRAM] Before offload 'RGBGaussianPredictor_1' (2679 MB) -> cpu: 11747 / 24122 MB
[18:09] [ComfyUI] [ComfyUI-Sharp] Health check: ping (timeout=5.0s)...
[18:09] [ComfyUI] [ComfyUI-Sharp] Health check: ok
[18:09] [ComfyUI] [SubprocessWorker] call_id=20 sending model_to_device
[18:09] [ComfyUI] [worker:ComfyUI-Sharp] [VRAM] -1972MB (now 2527MB) reserved=6816MB peak=7051MB
[18:10] [ComfyUI] [worker:ComfyUI-Sharp] [VRAM] -1421MB (now 1107MB) reserved=6816MB peak=7051MB
[18:11] [ComfyUI] [comfy-env] [VRAM] After offload 'RGBGaussianPredictor_1' (2679 MB): 5027 / 24122 MB
[18:11] [ComfyUI] [INFO] Using RAM pressure cache.
[18:31] Frame 5 saved (frame_004.jpg, t=20.1s)
[18:31] [capture-periodic] freeze=8105ms shot=8990ms unfreeze=170ms saved=True
[18:39] Node executed (2 total), capturing...
[18:56] Frame 6 saved (frame_005.jpg, t=45.8s)
[18:56] [capture-node] freeze=7896ms shot=8123ms unfreeze=0ms saved=True
[18:56] Execution complete (t=45.8s)
[18:56] [3d-wait] Phase 1: Waiting for 'Loading 3D Model' text to disappear...
[18:56] [3d-wait] Phase 1 done in 0.0s
[18:56] [3d-wait] Phase 2: iframes=2
[18:56] [3d-wait] iframe viewer_ready=True (matched 2 console logs)
[18:56] [3d-wait] Unfrozen in 0.001s, rendering for 5s...
[19:12] [3d-wait] JS halted via CDP after 16.0s
[19:35] [3d-wait] Re-frozen in 39.8s
[19:35] [3d-wait] Total 3D wait: 39.9s
[19:35] Captured 6 unique frames over 101.76s
[19:35] [debug] iframes: 2
[19:35] [debug] iframe[0]: src=http://127.0.0.1:41898/extensions/ComfyUI-GaussianPack/viewer_gaussian_sharp.htm, canvas=1416x960, rafFrozen=True
[19:35] [debug] iframe[1]: src=http://127.0.0.1:41898/extensions/ComfyUI-GaussianPack/viewer_gaussian_sharp.htm, canvas=1416x960, rafFrozen=True
[19:35] [timing] trigger_3d_previews: 0.0s
[19:38] Saved high-quality screenshot: vanilla_vs_image_depth_gaussians_executed.png
[19:38] [timing] final_screenshot: 0.3s
[19:38] [ComfyUI] [INFO] Using RAM pressure cache.
[19:38] Results saved to /logs/Sharp-2211/dev/linux-gpu/results.json
[19:38] Model report: 8 files, 3.8 GB -> /logs/Sharp-2211/dev/linux-gpu/models.json
[19:38] Saved: /logs/Sharp-2211/dev/linux-gpu/index.html
[19:38] [EXECUTION] PASSED
[19:38]
linux: PASSED
[19:38] Stopping ComfyUI server...
Reference in New Issue View Git Blame Copy Permalink