2284 lines
211 KiB
Plaintext
2284 lines
211 KiB
Plaintext
[00:00] Crash dump logging enabled: /logs/Sharp-2000/dev/linux-gpu/crash_dump.log
|
||
[00:00]
|
||
[00:00] [1/5] SYNTAX
|
||
[00:00] ----------------------------------------
|
||
[00:00]
|
||
[DEBUG] server=None, api=None
|
||
[00:00] Found pyproject.toml (modern format)
|
||
[00:00] Found requirements.txt (legacy format)
|
||
[00:00] Unicode check: OK (all characters cp1252-safe)
|
||
[00:00] Forbidden patterns check: OK
|
||
[00:00] [SYNTAX] PASSED
|
||
[00:00]
|
||
[00:00] [2/5] INSTALL
|
||
[00:00] ----------------------------------------
|
||
[00:00]
|
||
[DEBUG] server=None, api=None
|
||
[00:00]
|
||
Setting up ComfyUI...
|
||
[00:00] Creating virtual environment...
|
||
[00:00] Running: uv venv /workspaces/Sharp-2000/.venv --python 3.10
|
||
[00:00] torch_version='2.10.0' -> pinning torch==2.10.0 torchvision==0.25.0 torchaudio==2.10.0
|
||
[00:00] Cloning ComfyUI (latest)...
|
||
[00:00] Running: git clone --depth 1 https://github.com/comfyanonymous/ComfyUI.git /workspaces/Sharp-2000/ComfyUI
|
||
[00:01] Pinning torch family from https://download.pytorch.org/whl/cu128: torch==2.10.0 torchvision==0.25.0 torchaudio==2.10.0
|
||
[00:01] Running: uv pip install --python /workspaces/Sharp-2000/.venv/bin/python --index-url https://download.pytorch.org/whl/cu128 --extra-index-url https://pypi.org/simple --index-strategy unsafe-best-match torch==2.10.0 torchvision==0.25.0 torchaudio==2.10.0
|
||
[01:19] Installing ComfyUI requirements...
|
||
[01:19] Running: uv pip install --python /workspaces/Sharp-2000/.venv/bin/python --index-url https://download.pytorch.org/whl/cu128 --extra-index-url https://pypi.org/simple --index-strategy unsafe-best-match -r /workspaces/Sharp-2000/ComfyUI/requirements.txt
|
||
[01:31]
|
||
Installing custom node...
|
||
[01:31] Copying ComfyUI-Sharp to custom_nodes/...
|
||
[01:31] Installing node requirements...
|
||
[01:31] Running: uv pip install --python /workspaces/Sharp-2000/.venv/bin/python --index-url https://download.pytorch.org/whl/cu128 --extra-index-url https://pypi.org/simple --index-strategy unsafe-best-match -r /workspaces/Sharp-2000/ComfyUI/custom_nodes/ComfyUI-Sharp/requirements.txt
|
||
[01:34]
|
||
Running install.py...
|
||
[01:34] Running: /workspaces/Sharp-2000/.venv/bin/python /workspaces/Sharp-2000/ComfyUI/custom_nodes/ComfyUI-Sharp/install.py
|
||
[01:34]
|
||
[01:34] Installing 2 node dependencies...
|
||
[01:34] Cloning ComfyUI-GaussianPack...
|
||
[01:39] Installing requirements for ComfyUI-GaussianPack...
|
||
[01:41] Running install.py for ComfyUI-GaussianPack...
|
||
[01:44] [comfy-env] _discover: scanning /workspaces/Sharp-2000/ComfyUI/custom_nodes
|
||
[01:44] [comfy-env] _discover: ComfyUI-GaussianPack -> gaussianpack-nodes (custom_nodes/ComfyUI-GaussianPack/nodes/comfy-env.toml)
|
||
[01:44] [comfy-env] _discover: ComfyUI-Sharp -> sharp-nodes (custom_nodes/ComfyUI-Sharp/nodes/comfy-env.toml)
|
||
[01:44] [comfy-env] Workspace: /tmp/comfytest-home/.ce
|
||
[01:44] [comfy-env] ComfyUI: /workspaces/Sharp-2000/ComfyUI
|
||
[01:44] [comfy-env] Found 2 node config(s):
|
||
[01:44] - gaussianpack-nodes <- custom_nodes/ComfyUI-GaussianPack/nodes/comfy-env.toml (python=host)
|
||
[01:44] - sharp-nodes <- custom_nodes/ComfyUI-Sharp/nodes/comfy-env.toml (python=host)
|
||
[01:44] [comfy-env] Bootstrap interpreter has python 3.10 + torch 2.10.0 (cu128). Looking for cuda-only wheels matching cu128/torch2.10/cp310.
|
||
[01:44] [comfy-env] GPU: Detection: smi
|
||
[01:44] Driver: 580.126.20
|
||
[01:44] CUDA: 13.0
|
||
[01:44] Recommended: CUDA 13.0
|
||
[01:44]
|
||
[01:44] GPU 0: NVIDIA GeForce RTX 3090 (sm_86) [Ampere] 24576MB
|
||
[01:44] [comfy-env] Comfyui feature -> torch 2.10.0 from https://download.pytorch.org/whl/cu128 (CUDA 12.8 via bootstrap torch)
|
||
[01:44] [comfy-env] cuda-wheels: 1 package(s) need a matched (cuda, torch, python) combo: ['gsplat']
|
||
[01:44] [comfy-env] cuda-wheels tier 1 (bootstrap): probing cu12.8/torch2.10/cp310
|
||
[01:44] [cuda-wheels] Looking up gsplat: cu128 torch2.10 cp310 manylinux linux
|
||
[01:44] [cuda-wheels] Found: gsplat-1.5.3+cu128torch2.10-cp310-cp310-manylinux_2_34_x86_64.manylinux_2_35_x86_64.whl
|
||
[01:44] [comfy-env] cuda-wheels combo: cu12.8/torch2.10 (bootstrap matches; per-node envs will pin to this)
|
||
[01:44] [comfy-env] Host glibc 2.35 -> system-requirements
|
||
[01:44] [cuda-wheels] Looking up gsplat: cu128 torch2.10 cp310 manylinux linux
|
||
[01:44] [cuda-wheels] Found: gsplat-1.5.3+cu128torch2.10-cp310-cp310-manylinux_2_34_x86_64.manylinux_2_35_x86_64.whl
|
||
[01:44] [comfy-env] gaussianpack-nodes: cuda-wheels deferred for post-pixi install (gsplat)
|
||
[01:44] Generated /tmp/comfytest-home/.ce/pixi.toml
|
||
[01:44] [comfy-env] Installing 2 environment(s):
|
||
[01:44] - gaussianpack-nodes (python=host, 8 pypi deps, 1 cuda wheels)
|
||
[01:44] - sharp-nodes (python=host, 15 pypi deps)
|
||
[01:44] [comfy-env] Running `pixi install -e gaussianpack-nodes -e sharp-nodes`...
|
||
[01:52] WARN Skipped running the post-link scripts because `run-post-link-scripts` = `false`
|
||
[01:52] - bin/.librsvg-pre-unlink.sh
|
||
[01:52] To enable them, run:
|
||
[01:52] pixi config set --local run-post-link-scripts insecure
|
||
[01:52] More info:
|
||
[01:52] https://pixi.sh/latest/reference/pixi_configuration/#run-post-link-scripts
|
||
[01:53] WARN Skipped running the post-link scripts because `run-post-link-scripts` = `false`
|
||
[01:53] - bin/.librsvg-pre-unlink.sh
|
||
[01:53] To enable them, run:
|
||
[01:53] pixi config set --local run-post-link-scripts insecure
|
||
[01:53] More info:
|
||
[01:53] https://pixi.sh/latest/reference/pixi_configuration/#run-post-link-scripts
|
||
[03:09] The following environments have been installed: gaussianpack-nodes, sharp-nodes.
|
||
[03:10] [comfy-env] gaussianpack-nodes: installing cuda-wheels with --no-deps (gsplat)
|
||
[03:10] Using Python 3.10.20 environment at: .pixi/envs/gaussianpack-nodes
|
||
[03:11] Resolved 1 package in 1.18s
|
||
[03:11] Downloading gsplat (33.9MiB)
|
||
[03:12] Downloaded gsplat
|
||
[03:12] Prepared 1 package in 906ms
|
||
[03:12] Installed 1 package in 54ms
|
||
[03:12] + gsplat==1.5.3+cu128torch2.10 (from https://github.com/PozzettiAndrea/cuda-wheels/releases/download/gsplat-latest/gsplat-1.5.3%2Bcu128torch2.10-cp310-cp310-manylinux_2_34_x86_64.manylinux_2_35_x86_64.whl)
|
||
[03:12] [comfy-env] Recorded install hash c13fd71e660f -> /tmp/comfytest-home/.ce/install.hash
|
||
[03:12] [comfy-env] Install log: /tmp/comfytest-home/.ce/install.log
|
||
[03:12]
|
||
[03:12] Installation complete!
|
||
[03:12] Cloning ComfyUI-PanoPack...
|
||
[03:15] Installing requirements for ComfyUI-PanoPack...
|
||
[03:15] Running install.py for ComfyUI-PanoPack...
|
||
[03:15]
|
||
[03:15] Installing 2 node dependencies...
|
||
[03:15] Cloning ComfyUI-MoGe2...
|
||
[03:16] Installing requirements for ComfyUI-MoGe2...
|
||
[03:16] Running install.py for ComfyUI-MoGe2...
|
||
[03:16] [comfy-env] _discover: scanning /workspaces/Sharp-2000/ComfyUI/custom_nodes
|
||
[03:16] [comfy-env] _discover: ComfyUI-GaussianPack -> gaussianpack-nodes (custom_nodes/ComfyUI-GaussianPack/nodes/comfy-env.toml)
|
||
[03:16] [comfy-env] _discover: ComfyUI-MoGe2 -> moge2-nodes (custom_nodes/ComfyUI-MoGe2/nodes/comfy-env.toml)
|
||
[03:16] [comfy-env] _discover: ComfyUI-PanoPack -> panopack-nodes (custom_nodes/ComfyUI-PanoPack/nodes/comfy-env.toml)
|
||
[03:16] [comfy-env] _discover: ComfyUI-Sharp -> sharp-nodes (custom_nodes/ComfyUI-Sharp/nodes/comfy-env.toml)
|
||
[03:16] [comfy-env] Workspace: /tmp/comfytest-home/.ce
|
||
[03:16] [comfy-env] ComfyUI: /workspaces/Sharp-2000/ComfyUI
|
||
[03:16] [comfy-env] Found 4 node config(s):
|
||
[03:16] - gaussianpack-nodes <- custom_nodes/ComfyUI-GaussianPack/nodes/comfy-env.toml (python=host)
|
||
[03:16] - moge2-nodes <- custom_nodes/ComfyUI-MoGe2/nodes/comfy-env.toml (python=host)
|
||
[03:16] - panopack-nodes <- custom_nodes/ComfyUI-PanoPack/nodes/comfy-env.toml (python=host)
|
||
[03:16] - sharp-nodes <- custom_nodes/ComfyUI-Sharp/nodes/comfy-env.toml (python=host)
|
||
[03:16] [comfy-env] Bootstrap interpreter has python 3.10 + torch 2.10.0 (cu128). Looking for cuda-only wheels matching cu128/torch2.10/cp310.
|
||
[03:16] [comfy-env] GPU: Detection: smi
|
||
[03:16] Driver: 580.126.20
|
||
[03:16] CUDA: 13.0
|
||
[03:16] Recommended: CUDA 13.0
|
||
[03:16]
|
||
[03:16] GPU 0: NVIDIA GeForce RTX 3090 (sm_86) [Ampere] 24576MB
|
||
[03:16] [comfy-env] Comfyui feature -> torch 2.10.0 from https://download.pytorch.org/whl/cu128 (CUDA 12.8 via bootstrap torch)
|
||
[03:16] [comfy-env] cuda-wheels: 3 package(s) need a matched (cuda, torch, python) combo: ['gsplat', 'sageattention', 'flash_attn']
|
||
[03:16] [comfy-env] cuda-wheels tier 1 (bootstrap): probing cu12.8/torch2.10/cp310
|
||
[03:16] [cuda-wheels] Looking up gsplat: cu128 torch2.10 cp310 manylinux linux
|
||
[03:16] [cuda-wheels] Found: gsplat-1.5.3+cu128torch2.10-cp310-cp310-manylinux_2_34_x86_64.manylinux_2_35_x86_64.whl
|
||
[03:16] [cuda-wheels] Looking up sageattention: cu128 torch2.10 cp310 manylinux linux
|
||
[03:16] [cuda-wheels] Found: sageattention-2.2.0+cu128torch2.10-cp310-cp310-manylinux_2_34_x86_64.manylinux_2_35_x86_64.whl
|
||
[03:16] [cuda-wheels] Looking up flash_attn: cu128 torch2.10 cp310 manylinux linux
|
||
[03:17] [cuda-wheels] Found: flash_attn-2.8.3+cu128torch2.10-cp310-cp310-manylinux_2_24_x86_64.manylinux_2_28_x86_64.whl
|
||
[03:17] [comfy-env] cuda-wheels combo: cu12.8/torch2.10 (bootstrap matches; per-node envs will pin to this)
|
||
[03:17] [comfy-env] Host glibc 2.35 -> system-requirements
|
||
[03:17] [cuda-wheels] Looking up gsplat: cu128 torch2.10 cp310 manylinux linux
|
||
[03:17] [cuda-wheels] Found: gsplat-1.5.3+cu128torch2.10-cp310-cp310-manylinux_2_34_x86_64.manylinux_2_35_x86_64.whl
|
||
[03:17] [comfy-env] gaussianpack-nodes: cuda-wheels deferred for post-pixi install (gsplat)
|
||
[03:17] [cuda-wheels] Looking up sageattention: cu128 torch2.10 cp310 manylinux linux
|
||
[03:17] [cuda-wheels] Found: sageattention-2.2.0+cu128torch2.10-cp310-cp310-manylinux_2_34_x86_64.manylinux_2_35_x86_64.whl
|
||
[03:17] [cuda-wheels] Looking up flash_attn: cu128 torch2.10 cp310 manylinux linux
|
||
[03:17] [cuda-wheels] Found: flash_attn-2.8.3+cu128torch2.10-cp310-cp310-manylinux_2_24_x86_64.manylinux_2_28_x86_64.whl
|
||
[03:17] [comfy-env] moge2-nodes: cuda-wheels deferred for post-pixi install (sageattention, flash_attn)
|
||
[03:17] Generated /tmp/comfytest-home/.ce/pixi.toml
|
||
[03:17] [comfy-env] Installing 4 environment(s):
|
||
[03:17] - gaussianpack-nodes (python=host, 8 pypi deps, 1 cuda wheels)
|
||
[03:17] - moge2-nodes (python=host, 12 pypi deps, 2 cuda wheels)
|
||
[03:17] - panopack-nodes (python=host, 21 pypi deps)
|
||
[03:17] - sharp-nodes (python=host, 15 pypi deps)
|
||
[03:17] [comfy-env] Running `pixi install -e gaussianpack-nodes -e moge2-nodes -e panopack-nodes -e sharp-nodes`...
|
||
[03:22] WARN Skipped running the post-link scripts because `run-post-link-scripts` = `false`
|
||
[03:22] - bin/.librsvg-pre-unlink.sh
|
||
[03:22] To enable them, run:
|
||
[03:22] pixi config set --local run-post-link-scripts insecure
|
||
[03:22] More info:
|
||
[03:22] https://pixi.sh/latest/reference/pixi_configuration/#run-post-link-scripts
|
||
[03:23] WARN Skipped running the post-link scripts because `run-post-link-scripts` = `false`
|
||
[03:23] - bin/.librsvg-pre-unlink.sh
|
||
[03:23] To enable them, run:
|
||
[03:23] pixi config set --local run-post-link-scripts insecure
|
||
[03:23] More info:
|
||
[03:23] https://pixi.sh/latest/reference/pixi_configuration/#run-post-link-scripts
|
||
[03:27] The following environments have been installed: gaussianpack-nodes, moge2-nodes, panopack-nodes, sharp-nodes.
|
||
[03:27] [comfy-env] gaussianpack-nodes: installing cuda-wheels with --no-deps (gsplat)
|
||
[03:27] Using Python 3.10.20 environment at: .pixi/envs/gaussianpack-nodes
|
||
[03:28] Resolved 1 package in 819ms
|
||
[03:28] Checked 1 package in 0.27ms
|
||
[03:28] [comfy-env] moge2-nodes: installing cuda-wheels with --no-deps (sageattention, flash_attn)
|
||
[03:28] Using Python 3.10.20 environment at: .pixi/envs/moge2-nodes
|
||
[03:30] Resolved 2 packages in 1.60s
|
||
[03:30] Downloading flash-attn (241.9MiB)
|
||
[03:30] Downloading sageattention (53.1MiB)
|
||
[03:32] Downloaded sageattention
|
||
[03:36] Downloaded flash-attn
|
||
[03:36] Prepared 2 packages in 5.93s
|
||
[03:36] Installed 2 packages in 4ms
|
||
[03:36] + flash-attn==2.8.3+cu128torch2.10 (from https://github.com/PozzettiAndrea/cuda-wheels/releases/download/flash_attn-latest/flash_attn-2.8.3%2Bcu128torch2.10-cp310-cp310-manylinux_2_24_x86_64.manylinux_2_28_x86_64.whl)
|
||
[03:36] + sageattention==2.2.0+cu128torch2.10 (from https://github.com/PozzettiAndrea/cuda-wheels/releases/download/sageattention-latest/sageattention-2.2.0%2Bcu128torch2.10-cp310-cp310-manylinux_2_34_x86_64.manylinux_2_35_x86_64.whl)
|
||
[03:36] [comfy-env] Recorded install hash ead5c265d7a8 -> /tmp/comfytest-home/.ce/install.hash
|
||
[03:36] [comfy-env] Install log: /tmp/comfytest-home/.ce/install.log
|
||
[03:36]
|
||
[03:36] Installation complete!
|
||
[03:36] Cloning ComfyUI-GeometryPack...
|
||
[03:39] Installing requirements for ComfyUI-GeometryPack...
|
||
[03:40] Running install.py for ComfyUI-GeometryPack...
|
||
[03:40] [comfy-env] _discover: scanning /workspaces/Sharp-2000/ComfyUI/custom_nodes
|
||
[03:40] [comfy-env] _discover: ComfyUI-GaussianPack -> gaussianpack-nodes (custom_nodes/ComfyUI-GaussianPack/nodes/comfy-env.toml)
|
||
[03:40] [comfy-env] _discover: ComfyUI-GeometryPack -> geometrypack-nodes (custom_nodes/ComfyUI-GeometryPack/nodes/comfy-env.toml)
|
||
[03:40] [comfy-env] _discover: ComfyUI-MoGe2 -> moge2-nodes (custom_nodes/ComfyUI-MoGe2/nodes/comfy-env.toml)
|
||
[03:40] [comfy-env] _discover: ComfyUI-PanoPack -> panopack-nodes (custom_nodes/ComfyUI-PanoPack/nodes/comfy-env.toml)
|
||
[03:40] [comfy-env] _discover: ComfyUI-Sharp -> sharp-nodes (custom_nodes/ComfyUI-Sharp/nodes/comfy-env.toml)
|
||
[03:40] [comfy-env] Workspace: /tmp/comfytest-home/.ce
|
||
[03:40] [comfy-env] ComfyUI: /workspaces/Sharp-2000/ComfyUI
|
||
[03:40] [comfy-env] Found 5 node config(s):
|
||
[03:40] - gaussianpack-nodes <- custom_nodes/ComfyUI-GaussianPack/nodes/comfy-env.toml (python=host)
|
||
[03:40] - geometrypack-nodes <- custom_nodes/ComfyUI-GeometryPack/nodes/comfy-env.toml (python=host)
|
||
[03:40] - moge2-nodes <- custom_nodes/ComfyUI-MoGe2/nodes/comfy-env.toml (python=host)
|
||
[03:40] - panopack-nodes <- custom_nodes/ComfyUI-PanoPack/nodes/comfy-env.toml (python=host)
|
||
[03:40] - sharp-nodes <- custom_nodes/ComfyUI-Sharp/nodes/comfy-env.toml (python=host)
|
||
[03:40] [comfy-env] Bootstrap interpreter has python 3.10 + torch 2.10.0 (cu128). Looking for cuda-only wheels matching cu128/torch2.10/cp310.
|
||
[03:40] [comfy-env] GPU: Detection: smi
|
||
[03:40] Driver: 580.126.20
|
||
[03:40] CUDA: 13.0
|
||
[03:40] Recommended: CUDA 13.0
|
||
[03:41]
|
||
[03:41] GPU 0: NVIDIA GeForce RTX 3090 (sm_86) [Ampere] 24576MB
|
||
[03:41] [comfy-env] Comfyui feature -> torch 2.10.0 from https://download.pytorch.org/whl/cu128 (CUDA 12.8 via bootstrap torch)
|
||
[03:41] [comfy-env] cuda-wheels: 4 package(s) need a matched (cuda, torch, python) combo: ['gsplat', 'cumesh', 'sageattention', 'flash_attn']
|
||
[03:41] [comfy-env] cuda-wheels tier 1 (bootstrap): probing cu12.8/torch2.10/cp310
|
||
[03:41] [cuda-wheels] Looking up gsplat: cu128 torch2.10 cp310 manylinux linux
|
||
[03:41] [cuda-wheels] Found: gsplat-1.5.3+cu128torch2.10-cp310-cp310-manylinux_2_34_x86_64.manylinux_2_35_x86_64.whl
|
||
[03:41] [cuda-wheels] Looking up cumesh: cu128 torch2.10 cp310 manylinux linux
|
||
[03:41] [cuda-wheels] Found: cumesh-0.0.1+cu128torch2.10-cp310-cp310-manylinux_2_35_x86_64.whl
|
||
[03:41] [cuda-wheels] Looking up sageattention: cu128 torch2.10 cp310 manylinux linux
|
||
[03:41] [cuda-wheels] Found: sageattention-2.2.0+cu128torch2.10-cp310-cp310-manylinux_2_34_x86_64.manylinux_2_35_x86_64.whl
|
||
[03:41] [cuda-wheels] Looking up flash_attn: cu128 torch2.10 cp310 manylinux linux
|
||
[03:41] [cuda-wheels] Found: flash_attn-2.8.3+cu128torch2.10-cp310-cp310-manylinux_2_24_x86_64.manylinux_2_28_x86_64.whl
|
||
[03:41] [comfy-env] cuda-wheels combo: cu12.8/torch2.10 (bootstrap matches; per-node envs will pin to this)
|
||
[03:41] [comfy-env] Host glibc 2.35 -> system-requirements
|
||
[03:41] [cuda-wheels] Looking up gsplat: cu128 torch2.10 cp310 manylinux linux
|
||
[03:41] [cuda-wheels] Found: gsplat-1.5.3+cu128torch2.10-cp310-cp310-manylinux_2_34_x86_64.manylinux_2_35_x86_64.whl
|
||
[03:41] [comfy-env] gaussianpack-nodes: cuda-wheels deferred for post-pixi install (gsplat)
|
||
[03:41] [cuda-wheels] Looking up cumesh: cu128 torch2.10 cp310 manylinux linux
|
||
[03:41] [cuda-wheels] Found: cumesh-0.0.1+cu128torch2.10-cp310-cp310-manylinux_2_35_x86_64.whl
|
||
[03:41] [comfy-env] geometrypack-nodes: cuda-wheels deferred for post-pixi install (cumesh)
|
||
[03:41] [cuda-wheels] Looking up sageattention: cu128 torch2.10 cp310 manylinux linux
|
||
[03:41] [cuda-wheels] Found: sageattention-2.2.0+cu128torch2.10-cp310-cp310-manylinux_2_34_x86_64.manylinux_2_35_x86_64.whl
|
||
[03:41] [cuda-wheels] Looking up flash_attn: cu128 torch2.10 cp310 manylinux linux
|
||
[03:41] [cuda-wheels] Found: flash_attn-2.8.3+cu128torch2.10-cp310-cp310-manylinux_2_24_x86_64.manylinux_2_28_x86_64.whl
|
||
[03:41] [comfy-env] moge2-nodes: cuda-wheels deferred for post-pixi install (sageattention, flash_attn)
|
||
[03:41] Generated /tmp/comfytest-home/.ce/pixi.toml
|
||
[03:41] [comfy-env] Installing 5 environment(s):
|
||
[03:41] - gaussianpack-nodes (python=host, 8 pypi deps, 1 cuda wheels)
|
||
[03:41] - geometrypack-nodes (python=host, 14 pypi deps, 1 cuda wheels)
|
||
[03:41] - moge2-nodes (python=host, 12 pypi deps, 2 cuda wheels)
|
||
[03:41] - panopack-nodes (python=host, 21 pypi deps)
|
||
[03:41] - sharp-nodes (python=host, 15 pypi deps)
|
||
[03:41] [comfy-env] Running `pixi install -e gaussianpack-nodes -e geometrypack-nodes -e moge2-nodes -e panopack-nodes -e sharp-nodes`...
|
||
[03:50] WARN Skipped running the post-link scripts because `run-post-link-scripts` = `false`
|
||
[03:50] - bin/.librsvg-pre-unlink.sh
|
||
[03:50] To enable them, run:
|
||
[03:50] pixi config set --local run-post-link-scripts insecure
|
||
[03:50] More info:
|
||
[03:50] https://pixi.sh/latest/reference/pixi_configuration/#run-post-link-scripts
|
||
[03:52] The following environments have been installed: gaussianpack-nodes, geometrypack-nodes, moge2-nodes, panopack-nodes, sharp-nodes.
|
||
[03:53] [comfy-env] gaussianpack-nodes: installing cuda-wheels with --no-deps (gsplat)
|
||
[03:53] Using Python 3.10.20 environment at: .pixi/envs/gaussianpack-nodes
|
||
[03:53] Resolved 1 package in 795ms
|
||
[03:53] Checked 1 package in 0.07ms
|
||
[03:53] [comfy-env] geometrypack-nodes: installing cuda-wheels with --no-deps (cumesh)
|
||
[03:53] Using Python 3.10.20 environment at: .pixi/envs/geometrypack-nodes
|
||
[03:54] Resolved 1 package in 842ms
|
||
[03:54] Downloading cumesh (22.7MiB)
|
||
[03:55] Downloaded cumesh
|
||
[03:55] Prepared 1 package in 438ms
|
||
[03:55] Installed 1 package in 2ms
|
||
[03:55] + cumesh==0.0.1+cu128torch2.10 (from https://github.com/PozzettiAndrea/cuda-wheels/releases/download/cumesh-latest/cumesh-0.0.1%2Bcu128torch2.10-cp310-cp310-manylinux_2_35_x86_64.whl)
|
||
[03:55] [comfy-env] moge2-nodes: installing cuda-wheels with --no-deps (sageattention, flash_attn)
|
||
[03:55] Using Python 3.10.20 environment at: .pixi/envs/moge2-nodes
|
||
[03:55] Checked 2 packages in 91ms
|
||
[03:55] [comfy-env] Recorded install hash 6a7bc6f93489 -> /tmp/comfytest-home/.ce/install.hash
|
||
[03:55] [comfy-env] Install log: /tmp/comfytest-home/.ce/install.log
|
||
[03:55]
|
||
[03:55] Installation complete!
|
||
[03:55]
|
||
[03:55] [requirements] Re-installing main package requirements...
|
||
[03:55] Installing requirements for ComfyUI-PanoPack...
|
||
[03:55] [comfy-env] _discover: scanning /workspaces/Sharp-2000/ComfyUI/custom_nodes
|
||
[03:55] [comfy-env] _discover: ComfyUI-GaussianPack -> gaussianpack-nodes (custom_nodes/ComfyUI-GaussianPack/nodes/comfy-env.toml)
|
||
[03:55] [comfy-env] _discover: ComfyUI-GeometryPack -> geometrypack-nodes (custom_nodes/ComfyUI-GeometryPack/nodes/comfy-env.toml)
|
||
[03:55] [comfy-env] _discover: ComfyUI-MoGe2 -> moge2-nodes (custom_nodes/ComfyUI-MoGe2/nodes/comfy-env.toml)
|
||
[03:55] [comfy-env] _discover: ComfyUI-PanoPack -> panopack-nodes (custom_nodes/ComfyUI-PanoPack/nodes/comfy-env.toml)
|
||
[03:55] [comfy-env] _discover: ComfyUI-Sharp -> sharp-nodes (custom_nodes/ComfyUI-Sharp/nodes/comfy-env.toml)
|
||
[03:55] [comfy-env] Workspace inputs unchanged (hash 6a7bc6f93489) -- skipping install. Delete /tmp/comfytest-home/.ce/install.hash to force.
|
||
[03:55]
|
||
[03:55] Installation complete!
|
||
[03:55] ComfyUI-MoGe2: exists
|
||
[03:55] ComfyUI-GeometryPack: exists
|
||
[03:55]
|
||
[03:55] [requirements] Re-installing main package requirements...
|
||
[03:55] Installing requirements for ComfyUI-Sharp...
|
||
[03:55] [comfy-env] _discover: scanning /workspaces/Sharp-2000/ComfyUI/custom_nodes
|
||
[03:55] [comfy-env] _discover: ComfyUI-GaussianPack -> gaussianpack-nodes (custom_nodes/ComfyUI-GaussianPack/nodes/comfy-env.toml)
|
||
[03:55] [comfy-env] _discover: ComfyUI-GeometryPack -> geometrypack-nodes (custom_nodes/ComfyUI-GeometryPack/nodes/comfy-env.toml)
|
||
[03:55] [comfy-env] _discover: ComfyUI-MoGe2 -> moge2-nodes (custom_nodes/ComfyUI-MoGe2/nodes/comfy-env.toml)
|
||
[03:55] [comfy-env] _discover: ComfyUI-PanoPack -> panopack-nodes (custom_nodes/ComfyUI-PanoPack/nodes/comfy-env.toml)
|
||
[03:55] [comfy-env] _discover: ComfyUI-Sharp -> sharp-nodes (custom_nodes/ComfyUI-Sharp/nodes/comfy-env.toml)
|
||
[03:55] [comfy-env] Workspace inputs unchanged (hash 6a7bc6f93489) -- skipping install. Delete /tmp/comfytest-home/.ce/install.hash to force.
|
||
[03:55]
|
||
[03:55] Installation complete!
|
||
[03:55] Installing 2 node dependency(ies)...
|
||
[03:55] ComfyUI-GaussianPack from PozzettiAndrea/ComfyUI-GaussianPack
|
||
[03:55] ComfyUI-GaussianPack already exists, skipping...
|
||
[03:55] ComfyUI-PanoPack from PozzettiAndrea/ComfyUI-PanoPack
|
||
[03:55] ComfyUI-PanoPack already exists, skipping...
|
||
[03:55] Installing validation endpoint...
|
||
[03:55] Cloning PozzettiAndrea/ComfyUI-validate-endpoint...
|
||
[03:55] Running: git clone --depth 1 https://x-access-token:***@github.com/PozzettiAndrea/ComfyUI-validate-endpoint.git /workspaces/Sharp-2000/ComfyUI/custom_nodes/ComfyUI-validate-endpoint
|
||
[03:56] [INSTALL] PASSED
|
||
[03:56]
|
||
[03:56] [3/5] REGISTRATION
|
||
[03:56] ----------------------------------------
|
||
[03:56]
|
||
[DEBUG] server=None, api=None
|
||
[03:56]
|
||
Starting ComfyUI server...
|
||
[03:56] Starting ComfyUI server on port 41888...
|
||
[03:56] Starting ComfyUI server on port 41888...
|
||
[03:56] Waiting for server to be ready (timeout: 600s)...
|
||
[03:56] [ComfyUI] [32m[INFO][0m setup plugin alembic.autogenerate.schemas
|
||
[03:56] [ComfyUI] [32m[INFO][0m setup plugin alembic.autogenerate.tables
|
||
[03:56] [ComfyUI] [32m[INFO][0m setup plugin alembic.autogenerate.types
|
||
[03:56] [ComfyUI] [32m[INFO][0m setup plugin alembic.autogenerate.constraints
|
||
[03:56] [ComfyUI] [32m[INFO][0m setup plugin alembic.autogenerate.defaults
|
||
[03:56] [ComfyUI] [32m[INFO][0m setup plugin alembic.autogenerate.comments
|
||
[03:57] [ComfyUI] [comfy-env] ComfyUI-PanoPack: 1 isolation env(s):
|
||
[03:57] [ComfyUI] [comfy-env] nodes -> /workspaces/Sharp-2000/ComfyUI/custom_nodes/ComfyUI-PanoPack/nodes
|
||
[03:57] [ComfyUI] [comfy-env] Workspace: /tmp/comfytest-home/.ce
|
||
[03:57] [ComfyUI] [comfy-env] env: /tmp/comfytest-home/.ce/.pixi/envs/panopack-nodes [OK]
|
||
[03:57] [ComfyUI] [comfy-env] prestartup complete
|
||
[03:57] [ComfyUI] [comfy-env] ComfyUI-MoGe2: 1 isolation env(s):
|
||
[03:57] [ComfyUI] [comfy-env] nodes -> /workspaces/Sharp-2000/ComfyUI/custom_nodes/ComfyUI-MoGe2/nodes
|
||
[03:57] [ComfyUI] [comfy-env] env: /tmp/comfytest-home/.ce/.pixi/envs/moge2-nodes [OK]
|
||
[03:57] [ComfyUI] [comfy-env] prestartup complete
|
||
[03:57] [ComfyUI] [comfy-env] ComfyUI-Sharp: 1 isolation env(s):
|
||
[03:57] [ComfyUI] [comfy-env] nodes -> /workspaces/Sharp-2000/ComfyUI/custom_nodes/ComfyUI-Sharp/nodes
|
||
[03:57] [ComfyUI] [comfy-env] env: /tmp/comfytest-home/.ce/.pixi/envs/sharp-nodes [OK]
|
||
[03:57] [ComfyUI] [comfy-env] prestartup complete
|
||
[03:57] [ComfyUI] [comfy-env] ComfyUI-GeometryPack: 1 isolation env(s):
|
||
[03:57] [ComfyUI] [comfy-env] nodes -> /workspaces/Sharp-2000/ComfyUI/custom_nodes/ComfyUI-GeometryPack/nodes
|
||
[03:57] [ComfyUI] [comfy-env] env: /tmp/comfytest-home/.ce/.pixi/envs/geometrypack-nodes [OK]
|
||
[03:57] [ComfyUI] [comfy-env] prestartup complete
|
||
[03:57] [ComfyUI] [32m[INFO][0m
|
||
[03:57] [ComfyUI] Prestartup times for custom nodes:
|
||
[03:57] [ComfyUI] [32m[INFO][0m 0.0 seconds: /workspaces/Sharp-2000/ComfyUI/custom_nodes/ComfyUI-MoGe2
|
||
[03:57] [ComfyUI] [32m[INFO][0m 0.0 seconds: /workspaces/Sharp-2000/ComfyUI/custom_nodes/ComfyUI-Sharp
|
||
[03:57] [ComfyUI] [32m[INFO][0m 0.0 seconds: /workspaces/Sharp-2000/ComfyUI/custom_nodes/ComfyUI-GaussianPack
|
||
[03:57] [ComfyUI] [32m[INFO][0m 0.1 seconds: /workspaces/Sharp-2000/ComfyUI/custom_nodes/ComfyUI-GeometryPack
|
||
[03:57] [ComfyUI] [32m[INFO][0m 0.2 seconds: /workspaces/Sharp-2000/ComfyUI/custom_nodes/ComfyUI-PanoPack
|
||
[03:57] [ComfyUI] [32m[INFO][0m
|
||
[04:01] [ComfyUI] [1m[33m[WARNING][0m WARNING: You need pytorch with cu130 or higher to use optimized CUDA operations.
|
||
[04:01] [ComfyUI] [32m[INFO][0m Found comfy_kitchen backend cuda: {'available': True, 'disabled': True, 'unavailable_reason': None, 'capabilities': ['apply_rope', 'apply_rope1', 'apply_rope_split_half', 'apply_rope_split_half1', 'dequantize_nvfp4', 'dequantize_per_tensor_fp8', 'gemv_awq_w4a16', 'quantize_mxfp8', 'quantize_nvfp4', 'quantize_per_tensor_fp8', 'quantize_svdquant_w4a4', 'scaled_mm_svdquant_w4a4', 'stochastic_rounding_fp8']}
|
||
[04:01] [ComfyUI] [32m[INFO][0m Found comfy_kitchen backend eager: {'available': True, 'disabled': False, 'unavailable_reason': None, 'capabilities': ['apply_rope', 'apply_rope1', 'apply_rope_split_half', 'apply_rope_split_half1', 'dequantize_mxfp8', 'dequantize_nvfp4', 'dequantize_per_tensor_fp8', 'gemv_awq_w4a16', 'quantize_mxfp8', 'quantize_nvfp4', 'quantize_per_tensor_fp8', 'quantize_svdquant_w4a4', 'scaled_mm_mxfp8', 'scaled_mm_nvfp4', 'scaled_mm_svdquant_w4a4', 'stochastic_rounding_fp8']}
|
||
[04:01] [ComfyUI] [32m[INFO][0m Found comfy_kitchen backend triton: {'available': True, 'disabled': True, 'unavailable_reason': None, 'capabilities': ['apply_rope', 'apply_rope1', 'apply_rope_split_half', 'apply_rope_split_half1', 'dequantize_nvfp4', 'dequantize_per_tensor_fp8', 'quantize_mxfp8', 'quantize_nvfp4', 'quantize_per_tensor_fp8']}
|
||
[04:01] [ComfyUI] [32m[INFO][0m Checkpoint files will always be loaded safely.
|
||
[04:01] [ComfyUI] [32m[INFO][0m Total VRAM 24122 MB, total RAM 32010 MB
|
||
[04:01] [ComfyUI] [32m[INFO][0m pytorch version: 2.10.0+cu128
|
||
[04:01] [ComfyUI] [32m[INFO][0m Set vram state to: NORMAL_VRAM
|
||
[04:01] [ComfyUI] [32m[INFO][0m Device: cuda:0 NVIDIA GeForce RTX 3090 : cudaMallocAsync
|
||
[04:01] [ComfyUI] [32m[INFO][0m Using async weight offloading with 2 streams
|
||
[04:01] [ComfyUI] [32m[INFO][0m Enabled pinned memory 28809.0
|
||
[04:01] [ComfyUI] [32m[INFO][0m working around nvidia conv3d memory bug.
|
||
[04:02] [ComfyUI] [32m[INFO][0m Using pytorch attention
|
||
[04:05] [ComfyUI] aimdo: /project/src-posix/cuda-funchooks.c:52:DEBUG:aimdo_setup_hooks: hooks successfully installed
|
||
[04:05] [ComfyUI] aimdo: /project/src/control.c:240:INFO:comfy-aimdo inited for GPU: NVIDIA GeForce RTX 3090 (VRAM: 24122 MB)
|
||
[04:05] [ComfyUI] [32m[INFO][0m DynamicVRAM support detected and enabled
|
||
[04:05] [ComfyUI] [32m[INFO][0m Python version: 3.10.20 (main, Jun 2 2026, 22:25:53) [Clang 22.1.3 ]
|
||
[04:05] [ComfyUI] [32m[INFO][0m ComfyUI version: 0.24.0
|
||
[04:05] [ComfyUI] [32m[INFO][0m comfy-aimdo version: 0.4.9
|
||
[04:05] [ComfyUI] [32m[INFO][0m comfy-kitchen version: 0.2.10
|
||
[04:05] [ComfyUI] [1m[33m[WARNING][0m ****** User settings have been changed to be stored on the server instead of browser storage. ******
|
||
[04:05] [ComfyUI] [1m[33m[WARNING][0m ****** For multi-user setups add the --multi-user CLI argument to enable multiple user profiles. ******
|
||
[04:05] [ComfyUI] [32m[INFO][0m comfyui-frontend-package version: 1.45.15
|
||
[04:05] [ComfyUI] [32m[INFO][0m comfyui-workflow-templates version: 0.9.98
|
||
[04:05] [ComfyUI] [32m[INFO][0m comfyui-embedded-docs version: 0.5.2
|
||
[04:05] [ComfyUI] [32m[INFO][0m comfy-kitchen version: 0.2.10
|
||
[04:05] [ComfyUI] [32m[INFO][0m comfy-aimdo version: 0.4.9
|
||
[04:05] [ComfyUI] [32m[INFO][0m [Prompt Server] web root: /workspaces/Sharp-2000/.venv/lib/python3.10/site-packages/comfyui_frontend_package/static
|
||
[04:05] [ComfyUI] [32m[INFO][0m Asset seeder disabled
|
||
[04:06] [ComfyUI] [comfy-env] Version: 0.3.89
|
||
[04:06] [ComfyUI] [comfy-env] register_nodes: ComfyUI-PanoPack
|
||
[04:06] [ComfyUI] [comfy-env] ComfyUI source dir: /workspaces/Sharp-2000/ComfyUI
|
||
[04:06] [ComfyUI] [comfy-env] Found 1 isolation env(s)
|
||
[04:06] [ComfyUI] [comfy-env] Scanning nodes metadata (isolation root)...
|
||
[04:06] [ComfyUI] [comfy-env] Metadata scan: /tmp/comfytest-home/.pixi/bin/pixi run --as-is --manifest-path /tmp/comfytest-home/.ce/pixi.toml -e panopack-nodes python /tmp/comfy_meta_1l7hnn8n.py /workspaces/Sharp-2000/ComfyUI/custom_nodes/ComfyUI-PanoPack nodes /tmp/comfy_meta_out_4g7n1uox.pkl
|
||
[04:06] [ComfyUI] [comfy-env] Scan env PATH for nodes:
|
||
[04:06] [ComfyUI] [comfy-env] [0] /tmp/comfytest-tools/bin
|
||
[04:06] [ComfyUI] [comfy-env] [1] /opt/uv/bin
|
||
[04:06] [ComfyUI] [comfy-env] [2] /usr/local/sbin
|
||
[04:06] [ComfyUI] [comfy-env] [3] /usr/local/bin
|
||
[04:06] [ComfyUI] [comfy-env] [4] /usr/sbin
|
||
[04:06] [ComfyUI] [comfy-env] [5] /usr/bin
|
||
[04:06] [ComfyUI] [comfy-env] [6] /sbin
|
||
[04:06] [ComfyUI] [comfy-env] [7] /bin
|
||
[04:09] [ComfyUI] [comfy-env] Metadata scan stderr for nodes:
|
||
[04:09] [ComfyUI] [comfy-env] [meta-scan] importing nodes from /workspaces/Sharp-2000/ComfyUI/custom_nodes/ComfyUI-PanoPack
|
||
[04:09] [ComfyUI] [comfy-env] [meta-scan] import OK
|
||
[04:09] [ComfyUI] [comfy-env] Scanned nodes: 15 nodes (2.3s)
|
||
[04:09] [ComfyUI] [comfy-env] Scanned nodes root: 15 nodes (2.3s)
|
||
[04:09] [ComfyUI] [comfy-env] Imported nodes root: 15 nodes (isolation)
|
||
[04:09] [ComfyUI] [comfy-env] Registered 15 total nodes
|
||
[04:09] [ComfyUI] [comfy-env] Version: 0.3.89
|
||
[04:09] [ComfyUI] [comfy-env] register_nodes: ComfyUI-MoGe2
|
||
[04:09] [ComfyUI] [comfy-env] ComfyUI source dir: /workspaces/Sharp-2000/ComfyUI
|
||
[04:09] [ComfyUI] [comfy-env] Found 1 isolation env(s)
|
||
[04:09] [ComfyUI] [comfy-env] Scanning nodes metadata (isolation root)...
|
||
[04:09] [ComfyUI] [comfy-env] Metadata scan: /tmp/comfytest-home/.pixi/bin/pixi run --as-is --manifest-path /tmp/comfytest-home/.ce/pixi.toml -e moge2-nodes python /tmp/comfy_meta_wv7wmph5.py /workspaces/Sharp-2000/ComfyUI/custom_nodes/ComfyUI-MoGe2 nodes /tmp/comfy_meta_out_8ykv_mbl.pkl
|
||
[04:09] [ComfyUI] [comfy-env] Scan env PATH for nodes:
|
||
[04:09] [ComfyUI] [comfy-env] [0] /tmp/comfytest-tools/bin
|
||
[04:09] [ComfyUI] [comfy-env] [1] /opt/uv/bin
|
||
[04:09] [ComfyUI] [comfy-env] [2] /usr/local/sbin
|
||
[04:09] [ComfyUI] [comfy-env] [3] /usr/local/bin
|
||
[04:09] [ComfyUI] [comfy-env] [4] /usr/sbin
|
||
[04:09] [ComfyUI] [comfy-env] [5] /usr/bin
|
||
[04:09] [ComfyUI] [comfy-env] [6] /sbin
|
||
[04:09] [ComfyUI] [comfy-env] [7] /bin
|
||
[04:11] [ComfyUI] [comfy-env] Metadata scan stderr for nodes:
|
||
[04:11] [ComfyUI] [comfy-env] [meta-scan] importing nodes from /workspaces/Sharp-2000/ComfyUI/custom_nodes/ComfyUI-MoGe2
|
||
[04:11] [ComfyUI] [comfy-env] ERROR:root:Failed to import comfy_kitchen, Error: No module named 'comfy_kitchen', fp8 and fp4 support will not be available.
|
||
[04:11] [ComfyUI] [comfy-env] WARNING:root:comfy_kitchen does not support stochastic FP8 rounding, please update comfy_kitchen.
|
||
[04:11] [ComfyUI] [comfy-env] [meta-scan] import OK
|
||
[04:11] [ComfyUI] [comfy-env] Scanned nodes: 3 nodes (2.3s)
|
||
[04:11] [ComfyUI] [comfy-env] Scanned nodes root: 3 nodes (2.3s)
|
||
[04:11] [ComfyUI] [comfy-env] Imported nodes root: 3 nodes (isolation)
|
||
[04:11] [ComfyUI] [comfy-env] Registered 3 total nodes
|
||
[04:11] [ComfyUI] [comfy-env] Version: 0.3.89
|
||
[04:11] [ComfyUI] [comfy-env] register_nodes: ComfyUI-Sharp
|
||
[04:11] [ComfyUI] [comfy-env] ComfyUI source dir: /workspaces/Sharp-2000/ComfyUI
|
||
[04:11] [ComfyUI] [comfy-env] Found 1 isolation env(s)
|
||
[04:11] [ComfyUI] [comfy-env] Scanning nodes metadata (isolation root)...
|
||
[04:11] [ComfyUI] [comfy-env] Metadata scan: /tmp/comfytest-home/.pixi/bin/pixi run --as-is --manifest-path /tmp/comfytest-home/.ce/pixi.toml -e sharp-nodes python /tmp/comfy_meta_o9fitwzw.py /workspaces/Sharp-2000/ComfyUI/custom_nodes/ComfyUI-Sharp nodes /tmp/comfy_meta_out_iv_ntczo.pkl
|
||
[04:11] [ComfyUI] [comfy-env] Scan env PATH for nodes:
|
||
[04:11] [ComfyUI] [comfy-env] [0] /tmp/comfytest-tools/bin
|
||
[04:11] [ComfyUI] [comfy-env] [1] /opt/uv/bin
|
||
[04:11] [ComfyUI] [comfy-env] [2] /usr/local/sbin
|
||
[04:11] [ComfyUI] [comfy-env] [3] /usr/local/bin
|
||
[04:11] [ComfyUI] [comfy-env] [4] /usr/sbin
|
||
[04:11] [ComfyUI] [comfy-env] [5] /usr/bin
|
||
[04:11] [ComfyUI] [comfy-env] [6] /sbin
|
||
[04:11] [ComfyUI] [comfy-env] [7] /bin
|
||
[04:14] [ComfyUI] [comfy-env] Metadata scan stderr for nodes:
|
||
[04:14] [ComfyUI] [comfy-env] [meta-scan] importing nodes from /workspaces/Sharp-2000/ComfyUI/custom_nodes/ComfyUI-Sharp
|
||
[04:14] [ComfyUI] [comfy-env] [meta-scan] import OK
|
||
[04:14] [ComfyUI] [comfy-env] Scanned nodes: 17 nodes (2.5s)
|
||
[04:14] [ComfyUI] [comfy-env] Scanned nodes root: 17 nodes (2.5s)
|
||
[04:14] [ComfyUI] [comfy-env] Imported nodes root: 17 nodes (isolation)
|
||
[04:14] [ComfyUI] [comfy-env] Registered 17 total nodes
|
||
[04:14] [ComfyUI] [comfy-env] Version: 0.3.89
|
||
[04:14] [ComfyUI] [comfy-env] register_nodes: ComfyUI-GaussianPack
|
||
[04:14] [ComfyUI] [comfy-env] ComfyUI source dir: /workspaces/Sharp-2000/ComfyUI
|
||
[04:14] [ComfyUI] [comfy-env] Found 1 isolation env(s)
|
||
[04:14] [ComfyUI] [comfy-env] Scanning nodes metadata (isolation root)...
|
||
[04:14] [ComfyUI] [comfy-env] Metadata scan: /tmp/comfytest-home/.pixi/bin/pixi run --as-is --manifest-path /tmp/comfytest-home/.ce/pixi.toml -e gaussianpack-nodes python /tmp/comfy_meta_iaa0uyt3.py /workspaces/Sharp-2000/ComfyUI/custom_nodes/ComfyUI-GaussianPack nodes /tmp/comfy_meta_out_s4lqscyd.pkl
|
||
[04:14] [ComfyUI] [comfy-env] Scan env PATH for nodes:
|
||
[04:14] [ComfyUI] [comfy-env] [0] /tmp/comfytest-tools/bin
|
||
[04:14] [ComfyUI] [comfy-env] [1] /opt/uv/bin
|
||
[04:14] [ComfyUI] [comfy-env] [2] /usr/local/sbin
|
||
[04:14] [ComfyUI] [comfy-env] [3] /usr/local/bin
|
||
[04:14] [ComfyUI] [comfy-env] [4] /usr/sbin
|
||
[04:14] [ComfyUI] [comfy-env] [5] /usr/bin
|
||
[04:14] [ComfyUI] [comfy-env] [6] /sbin
|
||
[04:14] [ComfyUI] [comfy-env] [7] /bin
|
||
[04:16] [ComfyUI] [comfy-env] Metadata scan stderr for nodes:
|
||
[04:16] [ComfyUI] [comfy-env] [meta-scan] importing nodes from /workspaces/Sharp-2000/ComfyUI/custom_nodes/ComfyUI-GaussianPack
|
||
[04:16] [ComfyUI] [comfy-env] SPZ route not registered (ModuleNotFoundError: No module named 'comfy_aimdo')
|
||
[04:16] [ComfyUI] [comfy-env] [meta-scan] import OK
|
||
[04:16] [ComfyUI] [comfy-env] Scanned nodes: 11 nodes (2.4s)
|
||
[04:16] [ComfyUI] [comfy-env] Scanned nodes root: 11 nodes (2.4s)
|
||
[04:16] [ComfyUI] [comfy-env] Imported nodes root: 11 nodes (isolation)
|
||
[04:16] [ComfyUI] [comfy-env] Registered 11 total nodes
|
||
[04:16] [ComfyUI] [32m[INFO][0m loading...
|
||
[04:16] [ComfyUI] [32m[INFO][0m calling register_nodes
|
||
[04:16] [ComfyUI] [comfy-env] Version: 0.3.89
|
||
[04:16] [ComfyUI] [comfy-env] register_nodes: ComfyUI-GeometryPack
|
||
[04:16] [ComfyUI] [comfy-env] ComfyUI source dir: /workspaces/Sharp-2000/ComfyUI
|
||
[04:16] [ComfyUI] [comfy-env] Found 1 isolation env(s)
|
||
[04:16] [ComfyUI] [comfy-env] Scanning nodes metadata (isolation root)...
|
||
[04:16] [ComfyUI] [comfy-env] Metadata scan: /tmp/comfytest-home/.pixi/bin/pixi run --as-is --manifest-path /tmp/comfytest-home/.ce/pixi.toml -e geometrypack-nodes python /tmp/comfy_meta_nbrszcrz.py /workspaces/Sharp-2000/ComfyUI/custom_nodes/ComfyUI-GeometryPack nodes /tmp/comfy_meta_out_9xcpf634.pkl
|
||
[04:16] [ComfyUI] [comfy-env] Scan env PATH for nodes:
|
||
[04:16] [ComfyUI] [comfy-env] [0] /tmp/comfytest-tools/bin
|
||
[04:16] [ComfyUI] [comfy-env] [1] /opt/uv/bin
|
||
[04:16] [ComfyUI] [comfy-env] [2] /usr/local/sbin
|
||
[04:16] [ComfyUI] [comfy-env] [3] /usr/local/bin
|
||
[04:16] [ComfyUI] [comfy-env] [4] /usr/sbin
|
||
[04:16] [ComfyUI] [comfy-env] [5] /usr/bin
|
||
[04:16] [ComfyUI] [comfy-env] [6] /sbin
|
||
[04:16] [ComfyUI] [comfy-env] [7] /bin
|
||
[04:19] [ComfyUI] [comfy-env] Metadata scan stderr for nodes:
|
||
[04:19] [ComfyUI] [comfy-env] [meta-scan] importing nodes from /workspaces/Sharp-2000/ComfyUI/custom_nodes/ComfyUI-GeometryPack
|
||
[04:19] [ComfyUI] [comfy-env] ERROR:root:Failed to import comfy_kitchen, Error: No module named 'comfy_kitchen', fp8 and fp4 support will not be available.
|
||
[04:19] [ComfyUI] [comfy-env] WARNING:root:comfy_kitchen does not support stochastic FP8 rounding, please update comfy_kitchen.
|
||
[04:19] [ComfyUI] [comfy-env] [meta-scan] import OK
|
||
[04:19] [ComfyUI] [comfy-env] Scanned nodes: 125 nodes (3.2s)
|
||
[04:19] [ComfyUI] [comfy-env] Scanned nodes root: 125 nodes (3.2s)
|
||
[04:19] [ComfyUI] [comfy-env] Imported nodes root: 125 nodes (isolation)
|
||
[04:19] [ComfyUI] [comfy-env] Registered 125 total nodes
|
||
[04:19] [ComfyUI] [32m[INFO][0m
|
||
[04:19] [ComfyUI] Import times for custom nodes:
|
||
[04:19] [ComfyUI] [32m[INFO][0m 0.0 seconds: /workspaces/Sharp-2000/ComfyUI/custom_nodes/ComfyUI-validate-endpoint
|
||
[04:19] [ComfyUI] [32m[INFO][0m 0.0 seconds: /workspaces/Sharp-2000/ComfyUI/custom_nodes/websocket_image_save.py
|
||
[04:19] [ComfyUI] [32m[INFO][0m 2.4 seconds: /workspaces/Sharp-2000/ComfyUI/custom_nodes/ComfyUI-MoGe2
|
||
[04:19] [ComfyUI] [32m[INFO][0m 2.5 seconds: /workspaces/Sharp-2000/ComfyUI/custom_nodes/ComfyUI-GaussianPack
|
||
[04:19] [ComfyUI] [32m[INFO][0m 2.5 seconds: /workspaces/Sharp-2000/ComfyUI/custom_nodes/ComfyUI-PanoPack
|
||
[04:19] [ComfyUI] [32m[INFO][0m 2.5 seconds: /workspaces/Sharp-2000/ComfyUI/custom_nodes/ComfyUI-Sharp
|
||
[04:19] [ComfyUI] [32m[INFO][0m 3.3 seconds: /workspaces/Sharp-2000/ComfyUI/custom_nodes/ComfyUI-GeometryPack
|
||
[04:19] [ComfyUI] [32m[INFO][0m
|
||
[04:19] [ComfyUI] [32m[INFO][0m Context impl SQLiteImpl.
|
||
[04:19] [ComfyUI] [32m[INFO][0m Will assume non-transactional DDL.
|
||
[04:19] [ComfyUI] [32m[INFO][0m Context impl SQLiteImpl.
|
||
[04:19] [ComfyUI] [32m[INFO][0m Will assume non-transactional DDL.
|
||
[04:20] [ComfyUI] [32m[INFO][0m Running upgrade -> 0001_assets, Initial assets schema
|
||
[04:20] [ComfyUI] Revision ID: 0001_assets
|
||
[04:20] [ComfyUI] Revises: None
|
||
[04:20] [ComfyUI] Create Date: 2025-12-10 00:00:00
|
||
[04:20] [ComfyUI] [32m[INFO][0m Running upgrade 0001_assets -> 0002_merge_to_asset_references, Merge AssetInfo and AssetCacheState into unified asset_references table.
|
||
[04:20] [ComfyUI] [32m[INFO][0m Running upgrade 0002_merge_to_asset_references -> 0003_add_metadata_job_id, Add system_metadata and job_id columns to asset_references.
|
||
[04:20] [ComfyUI] Change preview_id FK from assets.id to asset_references.id.
|
||
[04:20] [ComfyUI] [32m[INFO][0m Database upgraded from None to 0003_add_metadata_job_id
|
||
[04:20] [ComfyUI] [32m[INFO][0m Using RAM pressure cache.
|
||
[04:20] [ComfyUI] [32m[INFO][0m Starting server
|
||
[04:20] [ComfyUI]
|
||
[04:20] [ComfyUI] [32m[INFO][0m To see the GUI go to: http://127.0.0.1:41888
|
||
[04:21] Server responding, waiting for nodes to load...
|
||
[04:41] Server is ready!
|
||
[04:41] Checking for import errors in server logs...
|
||
[04:41] No import errors detected
|
||
[04:41] Found 942 registered nodes
|
||
[04:41] [REGISTRATION] PASSED
|
||
[04:41]
|
||
[04:41] [4/5] INSTANTIATION
|
||
[04:41] ----------------------------------------
|
||
[04:41]
|
||
[DEBUG] server=<comfy_test.comfyui.server.ComfyUIServer object at 0x712b5a236110>, api=<comfy_test.comfyui.api.ComfyUIAPI object at 0x712b5a1689a0>
|
||
[04:41] Testing node constructors...
|
||
[04:41] All 17 node(s) instantiated successfully!
|
||
[04:41] [INSTANTIATION] PASSED
|
||
[04:41]
|
||
[04:41] [5/5] EXECUTION
|
||
[04:41] ----------------------------------------
|
||
[04:41]
|
||
[DEBUG] server=<comfy_test.comfyui.server.ComfyUIServer object at 0x712b5a236110>, api=<comfy_test.comfyui.api.ComfyUIAPI object at 0x712b5a1689a0>
|
||
[04:41] GPU runner - will execute 4 workflow(s)
|
||
[04:41] Running 4 workflow(s) (all with videos)...
|
||
[04:41] Installing screenshot dependencies (playwright, pillow)...
|
||
[04:42] Packages installed, downloading chromium browser...
|
||
[04:58] Screenshot dependencies installed successfully
|
||
[04:58] Starting headless browser...
|
||
[04:59] Installing Vulkan stack (apt)...
|
||
[04:59] Vulkan install error: [Errno 2] No such file or directory: 'sudo'
|
||
[04:59] GPU detected (no Vulkan) -- using ANGLE/OpenGL rendering
|
||
[04:59] [ComfyUI] [32m[INFO][0m Using RAM pressure cache.
|
||
[04:59] Capturing execution frames: pano.json
|
||
[04:59] [ComfyUI] [32m[INFO][0m Using RAM pressure cache.
|
||
[05:05] Frame 1 saved (frame_000.jpg, t=0.0s)
|
||
[05:05] Validating workflow...
|
||
[05:05] [ComfyUI] [32m[INFO][0m === /validate endpoint called ===
|
||
[05:05] [ComfyUI] [32m[INFO][0m Received JSON with keys: ['prompt']
|
||
[05:05] Queuing workflow for execution...
|
||
[05:05] [ComfyUI] [32m[INFO][0m Prompt has 18 nodes
|
||
[05:05] [ComfyUI] [32m[INFO][0m Node 7: LoadImage
|
||
[05:05] [ComfyUI] [32m[INFO][0m Inputs: {"image": "pano.png"}
|
||
[05:05] [ComfyUI] [32m[INFO][0m Node 9: LoadSharpModel
|
||
[05:05] [ComfyUI] [32m[INFO][0m Inputs: {"precision": "auto"}
|
||
[05:05] [ComfyUI] [32m[INFO][0m Node 54: MergeGaussians
|
||
[05:05] [ComfyUI] [32m[INFO][0m Inputs: {"ply_folder": ["76", 0], "output_prefix": "merged", "max_depth": 0, "min_opacity": 0}
|
||
[05:05] [ComfyUI] [32m[INFO][0m Node 59: PanoramaWrap
|
||
[05:05] [ComfyUI] [32m[INFO][0m Inputs: {"image": ["7", 0]}
|
||
[05:05] [ComfyUI] [comfy-env] SubprocessWorker: /tmp/comfytest-home/.ce/.pixi/envs/sharp-nodes/bin/python
|
||
[05:05] [ComfyUI] [32m[INFO][0m Node 60: PanoramaDepthMerge
|
||
[05:05] [ComfyUI] [comfy-env] env_vars: {'COMFYUI_BASE': '/workspaces/Sharp-2000/ComfyUI'}
|
||
[05:05] [ComfyUI] [32m[INFO][0m Inputs: {"out_width": ["61", 0], "out_height": ["61", 1], "use_gpu": true, "scale_anchor": false, "chunk_size": 8, "center_weight_power": 2, "normal_edge_threshold_deg": 0, "normal_consistency_boost": false,
|
||
[05:05] [ComfyUI] [ComfyUI-Sharp] python: /tmp/comfytest-home/.ce/.pixi/envs/sharp-nodes/bin/python
|
||
[05:05] [ComfyUI] [32m[INFO][0m Node 61: GetImageSize
|
||
[05:05] [ComfyUI] [ComfyUI-Sharp] sys_path sent to worker: ['/workspaces/Sharp-2000/ComfyUI', '/workspaces/Sharp-2000/ComfyUI/custom_nodes/ComfyUI-Sharp', '/tmp/comfytest-home/.ce/.pixi/envs/sharp-nodes/lib/python3.1/site-packages', '/workspaces/Sharp-2000/ComfyUI/custom_nodes/ComfyUI-Sharp']
|
||
[05:05] [ComfyUI] [32m[INFO][0m Inputs: {"image": ["7", 0]}
|
||
[05:05] [ComfyUI] [SubprocessWorker] is_pixi=True, python=/tmp/comfytest-home/.ce/.pixi/envs/sharp-nodes/bin/python
|
||
[05:05] [ComfyUI] [32m[INFO][0m Node 62: PreviewImage
|
||
[05:05] [ComfyUI] [SubprocessWorker] launching cmd=['/tmp/comfytest-home/.pixi/bin/pixi', 'run', '--as-is', '--manifest-path', '/tmp/comfytest-home/.ce/pixi.toml', '-e', 'sharp-nodes', 'python', '/tmp/comfyui_pvenv_dtk9es_f/persistent_worker.py', 'abstract://comfy_worker_827ed4096a87']...
|
||
[05:05] [ComfyUI] [32m[INFO][0m Inputs: {"images": ["60", 2]}
|
||
[05:05] [ComfyUI] [SubprocessWorker] socket_addr=abstract://comfy_worker_827ed4096a87 (abstract, no filesystem path)
|
||
[05:05] [ComfyUI] [32m[INFO][0m Node 68: PreviewImage
|
||
[05:05] [ComfyUI] [32m[INFO][0m Inputs: {"images": ["96", 0]}
|
||
[05:05] [ComfyUI] [32m[INFO][0m Node 70: PreviewImage
|
||
[05:05] [ComfyUI] [32m[INFO][0m Inputs: {"images": ["81", 0]}
|
||
[05:05] [ComfyUI] [32m[INFO][0m Node 73: SharpRayToPlanarDepth
|
||
[05:05] [ComfyUI] [32m[INFO][0m Inputs: {"image": ["87", 1], "intrinsics": ["87", 4], "extrinsics": ["87", 3]}
|
||
[05:05] [ComfyUI] [32m[INFO][0m Node 76: SharpPredictGaussiansFromMetricDepth
|
||
[05:05] [ComfyUI] [32m[INFO][0m Inputs: {"snap_to_external_depth": "none", "depth_convention": "planar_z", "focal_length_mm": 30, "output_prefix": "sharp_aligned", "save_background_layer": true, "edge_crop": 0, "model": ["9", 0], "image": [
|
||
[05:05] [ComfyUI] [32m[INFO][0m Node 78: TransformGaussian
|
||
[05:05] [ComfyUI] [32m[INFO][0m Inputs: {"rotate_x": -90, "rotate_y": 0, "rotate_z": 0, "ply_path": ["54", 1]}
|
||
[05:05] [ComfyUI] [32m[INFO][0m Node 80: DownloadAndLoadMoGe2Model
|
||
[05:05] [ComfyUI] [32m[INFO][0m Inputs: {"model": "moge-2-vitl-normal.pt", "precision": "auto", "attention": "auto"}
|
||
[05:05] [ComfyUI] [32m[INFO][0m Node 81: MoGe2Inference
|
||
[05:05] [ComfyUI] [32m[INFO][0m Inputs: {"resolution_level": 9, "num_tokens": 0, "fov_x_deg": ["96", 3], "force_projection": true, "apply_mask": true, "moge2_model": ["80", 0], "images": ["96", 0]}
|
||
[05:05] [ComfyUI] [32m[INFO][0m Node 87: PanoramaSplitAdaptive
|
||
[05:05] [ComfyUI] [32m[INFO][0m Inputs: {"split_method": "icosahedron_42", "resolution": 1536, "fov_degrees": 90, "use_gpu": true, "create_masks": true, "mask_method": "closest_to", "panorama": ["59", 0], "depth_panorama": ["60", 0], "norma
|
||
[05:05] [ComfyUI] [32m[INFO][0m Node 89: PreviewImage
|
||
[05:05] [ComfyUI] [32m[INFO][0m Inputs: {"images": ["87", 8]}
|
||
[05:05] [ComfyUI] [32m[INFO][0m Node 95: PreviewGaussians
|
||
[05:05] [ComfyUI] [32m[INFO][0m Inputs: {"camera_mode": "orbit", "fov_degrees": 71, "renderer": "playcanvas", "transport_format": "ply", "ply_path": ["78", 0]}
|
||
[05:05] [ComfyUI] [32m[INFO][0m Node 96: PanoramaSplit
|
||
[05:05] [ComfyUI] [32m[INFO][0m Inputs: {"split_method": "icosahedron_42", "resolution": 952, "fov_degrees": 90, "use_gpu": true, "create_masks": false, "fname": "pano_bank", "panorama": ["59", 0]}
|
||
[05:05] [ComfyUI] [32m[INFO][0m Generated prompt_id: 0688af3c-4d52-404c-b720-7c303381c284
|
||
[05:05] [ComfyUI] [32m[INFO][0m Calling execution.validate_prompt()...
|
||
[05:05] [ComfyUI] [32m[INFO][0m Validation result: valid=True
|
||
[05:05] [ComfyUI] [32m[INFO][0m === Validation PASSED ===
|
||
[05:05] [ComfyUI] [32m[INFO][0m got prompt
|
||
[05:05] [ComfyUI] [comfy-env] Running LoadSharpModel: precision: 'auto'
|
||
[05:05] [ComfyUI] [VRAM] Before LoadSharpModel: 697 / 24122 MB
|
||
[05:05] [ComfyUI] [SubprocessWorker] call_method: nodes.load_model.LoadSharpModel.EXECUTE_NORMALIZED
|
||
[05:05] [ComfyUI] [SubprocessWorker] acquired lock, ensuring started...
|
||
[05:06] [ComfyUI] [worker:ComfyUI-Sharp] ERROR: Failed to import comfy_kitchen, Error: No module named 'comfy_kitchen', fp8 and fp4 support will not be available.
|
||
[05:06] [ComfyUI] [worker:ComfyUI-Sharp] WARNING: comfy_kitchen does not support stochastic FP8 rounding, please update comfy_kitchen.
|
||
[05:06] [ComfyUI] [SubprocessWorker] worker started/confirmed
|
||
[05:06] [ComfyUI] [SubprocessWorker] serializing kwargs to shm...
|
||
[05:06] [ComfyUI] [SubprocessWorker] created 0 shm blocks
|
||
[05:06] [ComfyUI] [SubprocessWorker] sending request via socket...
|
||
[05:06] [ComfyUI] [SubprocessWorker] call_id=1 sending call_method
|
||
[05:07] [ComfyUI] [worker:ComfyUI-Sharp] [LoadSharpModel] precision='auto' -> dtype=bf16 (device=cuda:0)
|
||
[05:07] [ComfyUI] [worker:ComfyUI-Sharp] [LoadSharpModel] checkpoint not found at /workspaces/Sharp-2000/ComfyUI/models/sharp/sharp_2572gikvuh.pt — downloading from HuggingFace repo 'apple/Sharp' file 'sharp_2572gikvuh.pt' -> /workspaces/Sharp-2000/ComfyUI/models/sharp
|
||
[05:07] [ComfyUI]
|
||
[05:07] Frame 2 saved (frame_001.jpg, t=2.3s)
|
||
[05:07] [capture-periodic] freeze=2ms shot=108ms unfreeze=5ms saved=True
|
||
[05:09] Frame 3 saved (frame_002.jpg, t=4.5s)
|
||
[05:09] [capture-periodic] freeze=1ms shot=107ms unfreeze=13ms saved=True
|
||
[05:10] [capture-loop] iter=50 t=5.6s state={'complete': False, 'error': None, 'executedCount': 0, 'wsState': 1} eval_ms=1 ram=4.8/31.3GB (15%) swap=2.1/32.0GB (6%) cpu=8% browser_rss=0.99GB
|
||
[05:11] [ComfyUI] sharp_2572gikvuh.pt: 0%| | 0.00/2.81G [00:00<?, ?B/s]
|
||
[05:11] [ComfyUI] sharp_2572gikvuh.pt: 6%|▌ | 158M/2.81G [00:04<01:11, 37.1MB/s][SubprocessWorker] callback 'report_progress' from call_id=1
|
||
[05:12] Frame 4 saved (frame_003.jpg, t=6.7s)
|
||
[05:12] [capture-periodic] freeze=1ms shot=95ms unfreeze=5ms saved=True
|
||
[05:12] [ComfyUI]
|
||
[05:12] [ComfyUI] sharp_2572gikvuh.pt: 10%|█ | 292M/2.81G [00:05<00:40, 61.4MB/s][SubprocessWorker] callback 'report_progress' from call_id=1
|
||
[05:14] Frame 5 saved (frame_004.jpg, t=8.9s)
|
||
[05:14] [capture-periodic] freeze=1ms shot=97ms unfreeze=7ms saved=True
|
||
[05:15] [ComfyUI]
|
||
[05:15] [ComfyUI] sharp_2572gikvuh.pt: 13%|█▎ | 359M/2.81G [00:07<00:51, 47.3MB/s][SubprocessWorker] callback 'report_progress' from call_id=1
|
||
[05:16] [ComfyUI]
|
||
[05:16] [ComfyUI] sharp_2572gikvuh.pt: 15%|█▌ | 427M/2.81G [00:08<00:46, 51.7MB/s][SubprocessWorker] callback 'report_progress' from call_id=1
|
||
[05:16] [capture-loop] iter=100 t=11.0s state={'complete': False, 'error': None, 'executedCount': 0, 'wsState': 1} eval_ms=1 ram=5.1/31.3GB (16%) swap=2.1/32.0GB (6%) cpu=8% browser_rss=0.98GB
|
||
[05:16] Frame 6 saved (frame_005.jpg, t=11.1s)
|
||
[05:16] [capture-periodic] freeze=1ms shot=88ms unfreeze=4ms saved=True
|
||
[05:20] [ComfyUI]
|
||
[05:20] [ComfyUI] sharp_2572gikvuh.pt: 20%|█▉ | 561M/2.81G [00:13<00:59, 37.6MB/s][SubprocessWorker] callback 'report_progress' from call_id=1
|
||
[05:21] [ComfyUI]
|
||
[05:21] [ComfyUI] sharp_2572gikvuh.pt: 32%|███▏ | 896M/2.81G [00:13<00:21, 90.0MB/s][SubprocessWorker] callback 'report_progress' from call_id=1
|
||
[05:21] [capture-loop] iter=150 t=16.5s state={'complete': False, 'error': None, 'executedCount': 0, 'wsState': 1} eval_ms=1 ram=5.2/31.3GB (17%) swap=2.1/32.0GB (6%) cpu=9% browser_rss=0.99GB
|
||
[05:23] Frame 7 saved (frame_006.jpg, t=17.6s)
|
||
[05:23] [capture-periodic] freeze=1ms shot=97ms unfreeze=7ms saved=True
|
||
[05:24] [ComfyUI]
|
||
[05:24] [ComfyUI] sharp_2572gikvuh.pt: 37%|███▋ | 1.03G/2.81G [00:16<00:24, 71.2MB/s][SubprocessWorker] callback 'report_progress' from call_id=1
|
||
[05:25] Frame 8 saved (frame_007.jpg, t=19.8s)
|
||
[05:25] [capture-periodic] freeze=1ms shot=96ms unfreeze=6ms saved=True
|
||
[05:26] [ComfyUI]
|
||
[05:26] [ComfyUI] sharp_2572gikvuh.pt: 41%|████▏ | 1.16G/2.81G [00:18<00:23, 70.0MB/s][SubprocessWorker] callback 'report_progress' from call_id=1
|
||
[05:27] [capture-loop] iter=200 t=21.9s state={'complete': False, 'error': None, 'executedCount': 0, 'wsState': 1} eval_ms=1 ram=5.7/31.3GB (18%) swap=2.1/32.0GB (6%) cpu=9% browser_rss=0.99GB
|
||
[05:27] Frame 9 saved (frame_008.jpg, t=22.0s)
|
||
[05:27] [capture-periodic] freeze=1ms shot=96ms unfreeze=5ms saved=True
|
||
[05:28] [ComfyUI]
|
||
[05:28] [ComfyUI] sharp_2572gikvuh.pt: 53%|█████▎ | 1.50G/2.81G [00:21<00:14, 91.6MB/s][SubprocessWorker] callback 'report_progress' from call_id=1
|
||
[05:29] [ComfyUI]
|
||
[05:29] [ComfyUI] sharp_2572gikvuh.pt: 58%|█████▊ | 1.63G/2.81G [00:22<00:11, 103MB/s] [SubprocessWorker] callback 'report_progress' from call_id=1
|
||
[05:29] Frame 10 saved (frame_009.jpg, t=24.2s)
|
||
[05:29] [capture-periodic] freeze=1ms shot=96ms unfreeze=5ms saved=True
|
||
[05:30] [ComfyUI]
|
||
[05:30] [ComfyUI] sharp_2572gikvuh.pt: 63%|██████▎ | 1.77G/2.81G [00:22<00:09, 114MB/s][SubprocessWorker] callback 'report_progress' from call_id=1
|
||
[05:31] Frame 11 saved (frame_010.jpg, t=26.4s)
|
||
[05:31] [capture-periodic] freeze=1ms shot=98ms unfreeze=6ms saved=True
|
||
[05:32] [ComfyUI]
|
||
[05:32] [ComfyUI] sharp_2572gikvuh.pt: 100%|██████████| 2.81G/2.81G [00:24<00:00, 276MB/s][SubprocessWorker] callback 'report_progress' from call_id=1
|
||
[05:32] [ComfyUI]
|
||
[05:32] [ComfyUI] sharp_2572gikvuh.pt: 100%|██████████| 2.81G/2.81G [00:25<00:00, 112MB/s]
|
||
[05:32] [ComfyUI] [worker:ComfyUI-Sharp] [LoadSharpModel] checkpoint ready: /workspaces/Sharp-2000/ComfyUI/models/sharp/sharp_2572gikvuh.pt (2679.6 MB)
|
||
[05:32] [ComfyUI] [worker:ComfyUI-Sharp] [LoadSharpModel] config: precision=auto -> dtype=bf16
|
||
[05:32] [ComfyUI] [SubprocessWorker] got response: ok
|
||
[05:32] [ComfyUI] [comfy-env] SubprocessWorker: /tmp/comfytest-home/.ce/.pixi/envs/moge2-nodes/bin/python
|
||
[05:32] [ComfyUI] [comfy-env] env_vars: {'COMFYUI_BASE': '/workspaces/Sharp-2000/ComfyUI'}
|
||
[05:32] [ComfyUI] [comfy-env] LoadSharpModel done (27.16s): result: NodeOutput
|
||
[05:32] [ComfyUI] [VRAM] After LoadSharpModel: 959 / 24122 MB
|
||
[05:32] [ComfyUI] [ComfyUI-MoGe2] python: /tmp/comfytest-home/.ce/.pixi/envs/moge2-nodes/bin/python
|
||
[05:32] [ComfyUI] [comfy-env] Running DownloadAndLoadMoGe2Model: model: 'moge-2-vitl-normal.pt', precision: 'auto', attention: 'auto'
|
||
[05:32] [ComfyUI] [ComfyUI-MoGe2] sys_path sent to worker: ['/workspaces/Sharp-2000/ComfyUI', '/workspaces/Sharp-2000/ComfyUI/custom_nodes/ComfyUI-MoGe2', '/tmp/comfytest-home/.ce/.pixi/envs/moge2-nodes/lib/python3.1/site-packages', '/workspaces/Sharp-2000/ComfyUI/custom_nodes/ComfyUI-MoGe2']
|
||
[05:32] [ComfyUI] [VRAM] Before DownloadAndLoadMoGe2Model: 959 / 24122 MB
|
||
[05:32] [ComfyUI] [SubprocessWorker] is_pixi=True, python=/tmp/comfytest-home/.ce/.pixi/envs/moge2-nodes/bin/python
|
||
[05:32] [ComfyUI] [SubprocessWorker] call_method: nodes.load_model.DownloadAndLoadMoGe2Model.EXECUTE_NORMALIZED
|
||
[05:32] [ComfyUI] [SubprocessWorker] launching cmd=['/tmp/comfytest-home/.pixi/bin/pixi', 'run', '--as-is', '--manifest-path', '/tmp/comfytest-home/.ce/pixi.toml', '-e', 'moge2-nodes', 'python', '/tmp/comfyui_pvenv_36qakloh/persistent_worker.py', 'abstract://comfy_worker_d223e87cd190']...
|
||
[05:32] [ComfyUI] [SubprocessWorker] acquired lock, ensuring started...
|
||
[05:32] [ComfyUI] [SubprocessWorker] socket_addr=abstract://comfy_worker_d223e87cd190 (abstract, no filesystem path)
|
||
[05:32] [capture-loop] iter=250 t=27.5s state={'complete': False, 'error': None, 'executedCount': 0, 'wsState': 1} eval_ms=5 ram=4.8/31.3GB (15%) swap=2.1/32.0GB (6%) cpu=12% browser_rss=0.92GB
|
||
[05:34] Frame 12 saved (frame_011.jpg, t=28.6s)
|
||
[05:34] [capture-periodic] freeze=1ms shot=90ms unfreeze=1ms saved=True
|
||
[05:34] [ComfyUI] [worker:ComfyUI-MoGe2] ERROR: Failed to import comfy_kitchen, Error: No module named 'comfy_kitchen', fp8 and fp4 support will not be available.
|
||
[05:34] [ComfyUI] [worker:ComfyUI-MoGe2] WARNING: comfy_kitchen does not support stochastic FP8 rounding, please update comfy_kitchen.
|
||
[05:34] [ComfyUI] [SubprocessWorker] worker started/confirmed
|
||
[05:34] [ComfyUI] [SubprocessWorker] serializing kwargs to shm...
|
||
[05:34] [ComfyUI] [SubprocessWorker] created 0 shm blocks
|
||
[05:34] [ComfyUI] [SubprocessWorker] sending request via socket...
|
||
[05:34] [ComfyUI] [SubprocessWorker] call_id=1 sending call_method
|
||
[05:34] [ComfyUI]
|
||
[05:38] [capture-loop] iter=300 t=32.9s state={'complete': False, 'error': None, 'executedCount': 0, 'wsState': 1} eval_ms=2 ram=5.2/31.3GB (17%) swap=2.1/32.0GB (6%) cpu=8% browser_rss=0.92GB
|
||
[05:39] [ComfyUI] model.pt: 0%| | 0.00/1.32G [00:00<?, ?B/s]
|
||
[05:39] [ComfyUI] model.pt: 5%|▌ | 67.1M/1.32G [00:04<01:29, 14.1MB/s][SubprocessWorker] callback 'report_progress' from call_id=1
|
||
[05:39] [ComfyUI]
|
||
[05:39] [ComfyUI] model.pt: 10%|█ | 134M/1.32G [00:05<00:37, 31.8MB/s] [SubprocessWorker] callback 'report_progress' from call_id=1
|
||
[05:40] Frame 13 saved (frame_012.jpg, t=35.2s)
|
||
[05:40] [capture-periodic] freeze=1ms shot=99ms unfreeze=5ms saved=True
|
||
[05:41] [ComfyUI]
|
||
[05:41] [ComfyUI] model.pt: 25%|██▌ | 335M/1.32G [00:06<00:14, 65.9MB/s][SubprocessWorker] callback 'report_progress' from call_id=1
|
||
[05:42] [ComfyUI]
|
||
[05:42] [ComfyUI] model.pt: 30%|███ | 402M/1.32G [00:07<00:12, 75.7MB/s][SubprocessWorker] callback 'report_progress' from call_id=1
|
||
[05:42] Frame 14 saved (frame_013.jpg, t=37.4s)
|
||
[05:42] [capture-periodic] freeze=1ms shot=91ms unfreeze=6ms saved=True
|
||
[05:43] [ComfyUI]
|
||
[05:43] [ComfyUI] model.pt: 35%|███▌ | 469M/1.32G [00:08<00:11, 73.2MB/s][SubprocessWorker] callback 'report_progress' from call_id=1
|
||
[05:43] [capture-loop] iter=350 t=38.4s state={'complete': False, 'error': None, 'executedCount': 0, 'wsState': 1} eval_ms=1 ram=5.5/31.3GB (18%) swap=2.1/32.0GB (6%) cpu=9% browser_rss=0.93GB
|
||
[05:45] Frame 15 saved (frame_014.jpg, t=39.6s)
|
||
[05:45] [capture-periodic] freeze=1ms shot=94ms unfreeze=5ms saved=True
|
||
[05:45] [ComfyUI]
|
||
[05:45] [ComfyUI] model.pt: 46%|████▌ | 604M/1.32G [00:11<00:11, 60.2MB/s][SubprocessWorker] callback 'report_progress' from call_id=1
|
||
[05:46] [ComfyUI]
|
||
[05:46] [ComfyUI] model.pt: 66%|██████▌ | 872M/1.32G [00:11<00:03, 118MB/s] [SubprocessWorker] callback 'report_progress' from call_id=1
|
||
[05:47] Frame 16 saved (frame_015.jpg, t=41.8s)
|
||
[05:47] [capture-periodic] freeze=1ms shot=101ms unfreeze=5ms saved=True
|
||
[05:47] [ComfyUI]
|
||
[05:47] [ComfyUI] model.pt: 100%|██████████| 1.32G/1.32G [00:12<00:00, 218MB/s][SubprocessWorker] callback 'report_progress' from call_id=1
|
||
[05:47] [ComfyUI]
|
||
[05:47] [ComfyUI] model.pt: 100%|██████████| 1.32G/1.32G [00:12<00:00, 107MB/s]
|
||
[05:47] [ComfyUI] [SubprocessWorker] got response: ok
|
||
[05:47] [ComfyUI] [comfy-env] DownloadAndLoadMoGe2Model done (14.68s): result: NodeOutput
|
||
[05:47] [ComfyUI] [VRAM] After DownloadAndLoadMoGe2Model: 1220 / 24122 MB
|
||
[05:47] [ComfyUI] [comfy-env] Running PanoramaWrap: image: torch.float32 [1,2048,4096,3] cpu
|
||
[05:47] [ComfyUI] [comfy-env] SubprocessWorker: /tmp/comfytest-home/.ce/.pixi/envs/panopack-nodes/bin/python
|
||
[05:47] [ComfyUI] [VRAM] Before PanoramaWrap: 1220 / 24122 MB
|
||
[05:47] [ComfyUI] [comfy-env] env_vars: {'COMFYUI_BASE': '/workspaces/Sharp-2000/ComfyUI'}
|
||
[05:47] [ComfyUI] [SubprocessWorker] call_method: nodes.panorama_type.PanoramaWrap.EXECUTE_NORMALIZED
|
||
[05:47] [ComfyUI] [ComfyUI-PanoPack] python: /tmp/comfytest-home/.ce/.pixi/envs/panopack-nodes/bin/python
|
||
[05:47] [ComfyUI] [SubprocessWorker] acquired lock, ensuring started...
|
||
[05:47] [ComfyUI] [ComfyUI-PanoPack] sys_path sent to worker: ['/workspaces/Sharp-2000/ComfyUI', '/workspaces/Sharp-2000/ComfyUI/custom_nodes/ComfyUI-PanoPack', '/tmp/comfytest-home/.ce/.pixi/envs/panopack-nodes/lib/python3.1/site-packages', '/workspaces/Sharp-2000/ComfyUI/custom_nodes/ComfyUI-PanoPack']
|
||
[05:47] [ComfyUI] [SubprocessWorker] is_pixi=True, python=/tmp/comfytest-home/.ce/.pixi/envs/panopack-nodes/bin/python
|
||
[05:47] [ComfyUI] [SubprocessWorker] launching cmd=['/tmp/comfytest-home/.pixi/bin/pixi', 'run', '--as-is', '--manifest-path', '/tmp/comfytest-home/.ce/pixi.toml', '-e', 'panopack-nodes', 'python', '/tmp/comfyui_pvenv_a7abe8nv/persistent_worker.py', 'abstract://comfy_worker_5d870c192663']...
|
||
[05:47] [ComfyUI] [SubprocessWorker] socket_addr=abstract://comfy_worker_5d870c192663 (abstract, no filesystem path)
|
||
[05:48] [ComfyUI] [worker:ComfyUI-PanoPack] ERROR: Failed to import comfy_kitchen, Error: No module named 'comfy_kitchen', fp8 and fp4 support will not be available.
|
||
[05:48] [ComfyUI] [worker:ComfyUI-PanoPack] WARNING: comfy_kitchen does not support stochastic FP8 rounding, please update comfy_kitchen.
|
||
[05:48] [ComfyUI] [SubprocessWorker] worker started/confirmed
|
||
[05:48] [ComfyUI] [comfy-env] PRE-SERIALIZE 'image' shape: torch.Size([1, 2048, 4096, 3])
|
||
[05:48] [ComfyUI] [SubprocessWorker] serializing kwargs to shm...
|
||
[05:48] [ComfyUI] [SubprocessWorker] created 0 shm blocks
|
||
[05:48] [ComfyUI] [SubprocessWorker] sending request via socket...
|
||
[05:48] [ComfyUI] [SubprocessWorker] call_id=1 sending call_method
|
||
[05:48] [ComfyUI] [worker:ComfyUI-PanoPack] [comfy-env] _from_shm got dict with keys: ['__type__', 'strategy', 'parent_pid', 'fd', 'storage_size']
|
||
[05:48] [ComfyUI] [worker:ComfyUI-PanoPack] [comfy-env] DESERIALIZE TensorRef: tensor_size=[1, 2048, 4096, 3]
|
||
[05:48] [ComfyUI] [worker:ComfyUI-PanoPack] [comfy-env] DESERIALIZED tensor shape: torch.Size([1, 2048, 4096, 3])
|
||
[05:49] [capture-loop] iter=400 t=43.9s state={'complete': False, 'error': None, 'executedCount': 0, 'wsState': 1} eval_ms=3 ram=5.7/31.3GB (18%) swap=2.1/32.0GB (6%) cpu=11% browser_rss=0.94GB
|
||
[05:49] [ComfyUI] [SubprocessWorker] got response: ok
|
||
[05:49] [ComfyUI] [comfy-env] PanoramaWrap done (1.60s): result: NodeOutput
|
||
[05:49] [ComfyUI] [VRAM] After PanoramaWrap: 1481 / 24122 MB
|
||
[05:49] [ComfyUI] [comfy-env] Running PanoramaSplit: split_method: dict, resolution: 952, fov_degrees: 90.0, use_gpu: True, create_masks: False, fname: 'pano_bank', panorama: dict
|
||
[05:49] [ComfyUI] [VRAM] Before PanoramaSplit: 1481 / 24122 MB
|
||
[05:49] [ComfyUI] [SubprocessWorker] call_method: nodes.panorama_split.PanoramaSplit.EXECUTE_NORMALIZED
|
||
[05:49] [ComfyUI] [SubprocessWorker] acquired lock, ensuring started...
|
||
[05:49] [ComfyUI] [ComfyUI-PanoPack] Health check: ping (timeout=5.0s)...
|
||
[05:49] [ComfyUI] [ComfyUI-PanoPack] Health check: ok
|
||
[05:49] [ComfyUI] [SubprocessWorker] worker started/confirmed
|
||
[05:49] [ComfyUI] [SubprocessWorker] serializing kwargs to shm...
|
||
[05:49] [ComfyUI] [SubprocessWorker] created 0 shm blocks
|
||
[05:49] [ComfyUI] [SubprocessWorker] sending request via socket...
|
||
[05:49] [ComfyUI] [SubprocessWorker] call_id=2 sending call_method
|
||
[05:49] [ComfyUI] [worker:ComfyUI-PanoPack] [comfy-env] _from_shm got dict with keys: ['__type__', 'strategy', 'parent_pid', 'fd', 'storage_size']
|
||
[05:49] [ComfyUI] [worker:ComfyUI-PanoPack] [comfy-env] DESERIALIZE TensorRef: tensor_size=[1, 2048, 4096, 3]
|
||
[05:49] [ComfyUI] [worker:ComfyUI-PanoPack] [comfy-env] DESERIALIZED tensor shape: torch.Size([1, 2048, 4096, 3])
|
||
[05:49] Frame 17 saved (frame_016.jpg, t=44.0s)
|
||
[05:49] [capture-periodic] freeze=1ms shot=103ms unfreeze=4ms saved=True
|
||
[05:51] [ComfyUI] [worker:ComfyUI-PanoPack] [PanoramaSplit] swapped up=[0,1,0] for 2 pole vertices
|
||
[05:51] Frame 18 saved (frame_017.jpg, t=46.2s)
|
||
[05:51] [capture-periodic] freeze=1ms shot=91ms unfreeze=5ms saved=True
|
||
[05:54] [capture-loop] iter=450 t=49.4s state={'complete': False, 'error': None, 'executedCount': 0, 'wsState': 1} eval_ms=1 ram=6.3/31.3GB (20%) swap=2.1/32.0GB (6%) cpu=13% browser_rss=0.94GB
|
||
[05:55] [ComfyUI] [worker:ComfyUI-PanoPack] [VRAM] +290MB (now 290MB) reserved=320MB peak=290MB
|
||
[05:56] [ComfyUI] [worker:ComfyUI-PanoPack] [VRAM] -291MB (now 0MB) reserved=1312MB peak=822MB
|
||
[05:56] [ComfyUI] [worker:ComfyUI-PanoPack] [PanoramaSplit] icosahedron_42: (4096x2048) -> 42 crops @ 952x952, fov=(90,90) via grid_sample (GPU); cameras 1.213s, split 4.796s, total 7.226s
|
||
[05:57] [ComfyUI] [SubprocessWorker] got response: ok
|
||
[05:57] [ComfyUI] [comfy-env] PanoramaSplit done (8.22s): result: NodeOutput
|
||
[05:57] [ComfyUI] [VRAM] After PanoramaSplit: 2855 / 24122 MB
|
||
[05:58] Frame 19 saved (frame_018.jpg, t=52.7s)
|
||
[05:58] [capture-periodic] freeze=1ms shot=90ms unfreeze=6ms saved=True
|
||
[06:00] [capture-loop] iter=500 t=54.8s state={'complete': False, 'error': None, 'executedCount': 0, 'wsState': 1} eval_ms=1 ram=6.8/31.3GB (22%) swap=2.1/32.0GB (6%) cpu=11% browser_rss=0.93GB
|
||
[06:00] [ComfyUI] [comfy-env] Running MoGe2Inference: resolution_level: 9, num_tokens: 0, fov_x_deg: 90.0, force_projection: True, apply_mask: True, moge2_model: dict, images: torch.float32 [42,952,952,3] cpu
|
||
[06:00] [ComfyUI] [VRAM] Before MoGe2Inference: 2855 / 24122 MB
|
||
[06:00] [ComfyUI] [SubprocessWorker] call_method: nodes.nodes_inference.MoGe2Inference.EXECUTE_NORMALIZED
|
||
[06:00] [ComfyUI] [SubprocessWorker] acquired lock, ensuring started...
|
||
[06:00] [ComfyUI] [ComfyUI-MoGe2] Health check: ping (timeout=5.0s)...
|
||
[06:00] [ComfyUI] [ComfyUI-MoGe2] Health check: ok
|
||
[06:00] [ComfyUI] [SubprocessWorker] worker started/confirmed
|
||
[06:00] [ComfyUI] [comfy-env] PRE-SERIALIZE 'images' shape: torch.Size([42, 952, 952, 3])
|
||
[06:00] Node executed (1 total), capturing...
|
||
[06:00] [ComfyUI] [SubprocessWorker] serializing kwargs to shm...
|
||
[06:00] [ComfyUI] [SubprocessWorker] created 0 shm blocks
|
||
[06:00] [ComfyUI] [SubprocessWorker] sending request via socket...
|
||
[06:00] [ComfyUI] [SubprocessWorker] call_id=2 sending call_method
|
||
[06:00] [ComfyUI] [worker:ComfyUI-MoGe2] [comfy-env] _from_shm got dict with keys: ['__type__', 'strategy', 'parent_pid', 'fd', 'storage_size']
|
||
[06:00] [ComfyUI] [worker:ComfyUI-MoGe2] [comfy-env] DESERIALIZE TensorRef: tensor_size=[42, 952, 952, 3]
|
||
[06:00] [ComfyUI] [worker:ComfyUI-MoGe2] [comfy-env] DESERIALIZED tensor shape: torch.Size([42, 952, 952, 3])
|
||
[06:00] Frame 20 saved (frame_019.jpg, t=55.1s)
|
||
[06:00] [capture-node] freeze=11ms shot=138ms unfreeze=9ms saved=True
|
||
[06:05] [capture-loop] iter=550 t=60.5s state={'complete': False, 'error': None, 'executedCount': 1, 'wsState': 1} eval_ms=1 ram=8.8/31.3GB (28%) swap=2.1/32.0GB (6%) cpu=16% browser_rss=1.07GB
|
||
[06:07] [ComfyUI] [SubprocessWorker] callback 'request_vram_budget' from call_id=2
|
||
[06:07] [ComfyUI] [comfy-env] VRAM request: 0.66GB, free before eviction: 22.30GB
|
||
[06:07] [ComfyUI] [comfy-env] VRAM after eviction: 22.30GB
|
||
[06:07] [ComfyUI] [worker:ComfyUI-MoGe2] [VRAM] +474MB (now 474MB) reserved=480MB peak=474MB
|
||
[06:08] [ComfyUI] [SubprocessWorker] callback 'report_progress' from call_id=2
|
||
[06:08] [ComfyUI] [SubprocessWorker] callback 'report_progress' from call_id=2
|
||
[06:08] [ComfyUI] [worker:ComfyUI-MoGe2] [VRAM] +270MB (now 744MB) reserved=1568MB peak=858MB
|
||
[06:08] [ComfyUI] [SubprocessWorker] callback 'report_progress' from call_id=2
|
||
[06:08] [ComfyUI] [SubprocessWorker] callback 'report_progress' from call_id=2
|
||
[06:08] [ComfyUI] [SubprocessWorker] callback 'report_progress' from call_id=2
|
||
[06:09] [ComfyUI] [SubprocessWorker] callback 'report_progress' from call_id=2
|
||
[06:09] Frame 21 saved (frame_020.jpg, t=63.8s)
|
||
[06:09] [capture-periodic] freeze=1ms shot=100ms unfreeze=7ms saved=True
|
||
[06:09] [ComfyUI] [SubprocessWorker] callback 'report_progress' from call_id=2
|
||
[06:09] [ComfyUI] [SubprocessWorker] callback 'report_progress' from call_id=2
|
||
[06:09] [ComfyUI] [SubprocessWorker] callback 'report_progress' from call_id=2
|
||
[06:09] [ComfyUI] [SubprocessWorker] callback 'report_progress' from call_id=2
|
||
[06:10] [ComfyUI] [SubprocessWorker] callback 'report_progress' from call_id=2
|
||
[06:10] [ComfyUI] [SubprocessWorker] callback 'report_progress' from call_id=2
|
||
[06:10] [ComfyUI] [SubprocessWorker] callback 'report_progress' from call_id=2
|
||
[06:10] [ComfyUI] [SubprocessWorker] callback 'report_progress' from call_id=2
|
||
[06:11] [ComfyUI] [SubprocessWorker] callback 'report_progress' from call_id=2
|
||
[06:11] [capture-loop] iter=600 t=65.9s state={'complete': False, 'error': None, 'executedCount': 1, 'wsState': 1} eval_ms=1 ram=9.6/31.3GB (31%) swap=2.1/32.0GB (6%) cpu=13% browser_rss=1.08GB
|
||
[06:11] [ComfyUI] [SubprocessWorker] callback 'report_progress' from call_id=2
|
||
[06:11] Frame 22 saved (frame_021.jpg, t=66.0s)
|
||
[06:11] [capture-periodic] freeze=1ms shot=91ms unfreeze=7ms saved=True
|
||
[06:11] [ComfyUI] [SubprocessWorker] callback 'report_progress' from call_id=2
|
||
[06:11] [ComfyUI] [SubprocessWorker] callback 'report_progress' from call_id=2
|
||
[06:11] [ComfyUI] [SubprocessWorker] callback 'report_progress' from call_id=2
|
||
[06:12] [ComfyUI] [SubprocessWorker] callback 'report_progress' from call_id=2
|
||
[06:12] [ComfyUI] [SubprocessWorker] callback 'report_progress' from call_id=2
|
||
[06:12] [ComfyUI] [SubprocessWorker] callback 'report_progress' from call_id=2
|
||
[06:12] [ComfyUI] [SubprocessWorker] callback 'report_progress' from call_id=2
|
||
[06:13] [ComfyUI] [SubprocessWorker] callback 'report_progress' from call_id=2
|
||
[06:13] [ComfyUI] [SubprocessWorker] callback 'report_progress' from call_id=2
|
||
[06:13] Frame 23 saved (frame_022.jpg, t=68.2s)
|
||
[06:13] [capture-periodic] freeze=1ms shot=86ms unfreeze=1ms saved=True
|
||
[06:13] [ComfyUI] [SubprocessWorker] callback 'report_progress' from call_id=2
|
||
[06:13] [ComfyUI] [SubprocessWorker] callback 'report_progress' from call_id=2
|
||
[06:14] [ComfyUI] [SubprocessWorker] callback 'report_progress' from call_id=2
|
||
[06:14] [ComfyUI] [SubprocessWorker] callback 'report_progress' from call_id=2
|
||
[06:14] [ComfyUI] [SubprocessWorker] callback 'report_progress' from call_id=2
|
||
[06:15] [ComfyUI] [SubprocessWorker] callback 'report_progress' from call_id=2
|
||
[06:15] [ComfyUI] [SubprocessWorker] callback 'report_progress' from call_id=2
|
||
[06:15] [ComfyUI] [SubprocessWorker] callback 'report_progress' from call_id=2
|
||
[06:15] Frame 24 saved (frame_023.jpg, t=70.4s)
|
||
[06:15] [capture-periodic] freeze=1ms shot=95ms unfreeze=8ms saved=True
|
||
[06:15] [ComfyUI] [SubprocessWorker] callback 'report_progress' from call_id=2
|
||
[06:16] [ComfyUI] [SubprocessWorker] callback 'report_progress' from call_id=2
|
||
[06:16] [ComfyUI] [SubprocessWorker] callback 'report_progress' from call_id=2
|
||
[06:16] [ComfyUI] [SubprocessWorker] callback 'report_progress' from call_id=2
|
||
[06:16] [capture-loop] iter=650 t=71.5s state={'complete': False, 'error': None, 'executedCount': 1, 'wsState': 1} eval_ms=1 ram=10.7/31.3GB (34%) swap=2.1/32.0GB (6%) cpu=15% browser_rss=1.11GB
|
||
[06:17] [ComfyUI] [SubprocessWorker] callback 'report_progress' from call_id=2
|
||
[06:17] [ComfyUI] [SubprocessWorker] callback 'report_progress' from call_id=2
|
||
[06:17] [ComfyUI] [SubprocessWorker] callback 'report_progress' from call_id=2
|
||
[06:17] [ComfyUI] [SubprocessWorker] callback 'report_progress' from call_id=2
|
||
[06:18] Frame 25 saved (frame_024.jpg, t=72.6s)
|
||
[06:18] [capture-periodic] freeze=1ms shot=101ms unfreeze=5ms saved=True
|
||
[06:18] [ComfyUI] [SubprocessWorker] callback 'report_progress' from call_id=2
|
||
[06:20] Frame 26 saved (frame_025.jpg, t=74.8s)
|
||
[06:20] [capture-periodic] freeze=1ms shot=95ms unfreeze=6ms saved=True
|
||
[06:21] [ComfyUI] [SubprocessWorker] got response: ok
|
||
[06:21] [ComfyUI] [comfy-env] Created 1 model patchers: ['MoGeWrapper_1']
|
||
[06:21] [ComfyUI] [comfy-env] MoGe2Inference done (21.13s): result: NodeOutput
|
||
[06:21] [ComfyUI] [VRAM] After MoGe2Inference: 4669 / 24122 MB
|
||
[06:21] [ComfyUI] [VRAM] Loaded: SubprocessModel (631 MB)
|
||
[06:22] [capture-loop] iter=700 t=76.9s state={'complete': False, 'error': None, 'executedCount': 1, 'wsState': 1} eval_ms=2 ram=12.8/31.3GB (41%) swap=2.1/32.0GB (6%) cpu=14% browser_rss=1.11GB
|
||
[06:22] [ComfyUI] [comfy-env] Running PanoramaDepthMerge: out_width: 4096, out_height: 2048, use_gpu: True, scale_anchor: False, chunk_size: 8, center_weight_power: 2.0, normal_edge_threshold_deg: 0.0, normal_consistency_boost: False, max_ray_distance_m: 0.0, face_points: torch.float32 [42,952,952,3] cpu, extrinsics: torch.float32 [42,4,4] cpu, intrinsics: torch.float32 [42,3,3] cpu, face_valid_masks: torch.float32 [42,952,952] cpu, face_normals: torch.float32 [42,952,952,3] cpu
|
||
[06:22] [ComfyUI] [VRAM] Before PanoramaDepthMerge: 4669 / 24122 MB
|
||
[06:22] [ComfyUI] [VRAM] Loaded: SubprocessModel (631 MB)
|
||
[06:22] [ComfyUI] [SubprocessWorker] call_method: nodes.depth_merge.PanoramaDepthMerge.EXECUTE_NORMALIZED
|
||
[06:22] [ComfyUI] [SubprocessWorker] acquired lock, ensuring started...
|
||
[06:22] [ComfyUI] [ComfyUI-PanoPack] Health check: ping (timeout=5.0s)...
|
||
[06:22] [ComfyUI] [ComfyUI-PanoPack] Health check: ok
|
||
[06:22] [ComfyUI] [SubprocessWorker] worker started/confirmed
|
||
[06:22] [ComfyUI] [comfy-env] PRE-SERIALIZE 'face_points' shape: torch.Size([42, 952, 952, 3])
|
||
[06:22] [ComfyUI] [comfy-env] PRE-SERIALIZE 'extrinsics' shape: torch.Size([42, 4, 4])
|
||
[06:22] [ComfyUI] [comfy-env] PRE-SERIALIZE 'intrinsics' shape: torch.Size([42, 3, 3])
|
||
[06:22] Frame 27 saved (frame_026.jpg, t=77.0s)
|
||
[06:22] [ComfyUI] [comfy-env] PRE-SERIALIZE 'face_valid_masks' shape: torch.Size([42, 952, 952])
|
||
[06:22] [capture-periodic] freeze=1ms shot=97ms unfreeze=5ms saved=True
|
||
[06:22] [ComfyUI] [comfy-env] PRE-SERIALIZE 'face_normals' shape: torch.Size([42, 952, 952, 3])
|
||
[06:22] [ComfyUI] [SubprocessWorker] serializing kwargs to shm...
|
||
[06:22] Node executed (2 total), capturing...
|
||
[06:22] Frame 28 saved (frame_027.jpg, t=77.4s)
|
||
[06:22] [capture-node] freeze=2ms shot=97ms unfreeze=11ms saved=True
|
||
[06:22] [ComfyUI] [SubprocessWorker] created 0 shm blocks
|
||
[06:22] [ComfyUI] [SubprocessWorker] sending request via socket...
|
||
[06:22] [ComfyUI] [SubprocessWorker] call_id=3 sending call_method
|
||
[06:22] [ComfyUI] [worker:ComfyUI-PanoPack] [comfy-env] _from_shm got dict with keys: ['__type__', 'strategy', 'parent_pid', 'fd', 'storage_size']
|
||
[06:22] [ComfyUI] [worker:ComfyUI-PanoPack] [comfy-env] DESERIALIZE TensorRef: tensor_size=[42, 952, 952, 3]
|
||
[06:22] [ComfyUI] [worker:ComfyUI-PanoPack] [comfy-env] DESERIALIZED tensor shape: torch.Size([42, 952, 952, 3])
|
||
[06:22] [ComfyUI] [worker:ComfyUI-PanoPack] [comfy-env] _from_shm got dict with keys: ['__type__', 'strategy', 'parent_pid', 'fd', 'storage_size']
|
||
[06:22] [ComfyUI] [worker:ComfyUI-PanoPack] [comfy-env] DESERIALIZE TensorRef: tensor_size=[42, 4, 4]
|
||
[06:22] [ComfyUI] [worker:ComfyUI-PanoPack] [comfy-env] DESERIALIZED tensor shape: torch.Size([42, 4, 4])
|
||
[06:22] [ComfyUI] [worker:ComfyUI-PanoPack] [comfy-env] _from_shm got dict with keys: ['__type__', 'strategy', 'parent_pid', 'fd', 'storage_size']
|
||
[06:22] [ComfyUI] [worker:ComfyUI-PanoPack] [comfy-env] DESERIALIZE TensorRef: tensor_size=[42, 3, 3]
|
||
[06:22] [ComfyUI] [worker:ComfyUI-PanoPack] [comfy-env] DESERIALIZED tensor shape: torch.Size([42, 3, 3])
|
||
[06:22] [ComfyUI] [worker:ComfyUI-PanoPack] [comfy-env] _from_shm got dict with keys: ['__type__', 'strategy', 'parent_pid', 'fd', 'storage_size']
|
||
[06:22] [ComfyUI] [worker:ComfyUI-PanoPack] [comfy-env] DESERIALIZE TensorRef: tensor_size=[42, 952, 952]
|
||
[06:22] [ComfyUI] [worker:ComfyUI-PanoPack] [comfy-env] DESERIALIZED tensor shape: torch.Size([42, 952, 952])
|
||
[06:22] [ComfyUI] [worker:ComfyUI-PanoPack] [comfy-env] _from_shm got dict with keys: ['__type__', 'strategy', 'parent_pid', 'fd', 'storage_size']
|
||
[06:22] [ComfyUI] [worker:ComfyUI-PanoPack] [comfy-env] DESERIALIZE TensorRef: tensor_size=[42, 952, 952, 3]
|
||
[06:22] [ComfyUI] [worker:ComfyUI-PanoPack] [comfy-env] DESERIALIZED tensor shape: torch.Size([42, 952, 952, 3])
|
||
[06:27] Frame 29 saved (frame_028.jpg, t=81.8s)
|
||
[06:27] [capture-periodic] freeze=1ms shot=94ms unfreeze=1ms saved=True
|
||
[06:28] [capture-loop] iter=750 t=82.7s state={'complete': False, 'error': None, 'executedCount': 2, 'wsState': 1} eval_ms=2 ram=15.4/31.3GB (49%) swap=2.1/32.0GB (6%) cpu=15% browser_rss=1.15GB
|
||
[06:33] [capture-loop] iter=800 t=88.1s state={'complete': False, 'error': None, 'executedCount': 2, 'wsState': 1} eval_ms=2 ram=15.6/31.3GB (50%) swap=2.1/32.0GB (6%) cpu=19% browser_rss=1.10GB
|
||
[06:38] [capture-loop] iter=850 t=93.6s state={'complete': False, 'error': None, 'executedCount': 2, 'wsState': 1} eval_ms=2 ram=15.5/31.3GB (50%) swap=2.1/32.0GB (6%) cpu=19% browser_rss=1.10GB
|
||
[06:44] [capture-loop] iter=900 t=99.0s state={'complete': False, 'error': None, 'executedCount': 2, 'wsState': 1} eval_ms=1 ram=15.6/31.3GB (50%) swap=2.1/32.0GB (6%) cpu=19% browser_rss=1.10GB
|
||
[06:47] [ComfyUI] [worker:ComfyUI-PanoPack] [PanoramaDepthMerge] normals merged: 2048x4096
|
||
[06:47] [ComfyUI] [worker:ComfyUI-PanoPack] [PanoramaDepthMerge] merging 42 faces @ 952x952 -> equirect 2048x4096 (use_gpu=True); input = points (||.|| -> ray distance)
|
||
[06:47] [ComfyUI] [SubprocessWorker] callback 'report_progress' from call_id=3
|
||
[06:47] [ComfyUI] [worker:ComfyUI-PanoPack] [PanoramaDepthMerge] top-level peak VRAM estimate: 3.46 GB (4096x2048, N=42, chunk_size=8)
|
||
[06:47] [ComfyUI] [SubprocessWorker] callback 'request_vram_budget' from call_id=3
|
||
[06:47] [ComfyUI] [comfy-env] VRAM request: 3.46GB, free before eviction: 20.40GB
|
||
[06:47] [ComfyUI] [comfy-env] VRAM after eviction: 20.40GB
|
||
[06:47] [ComfyUI] [worker:ComfyUI-PanoPack] [PanoramaDepthMerge] -> requested 3.46 GB eviction via comfy_worker.call_parent
|
||
[06:47] [ComfyUI] [worker:ComfyUI-PanoPack] [VRAM] +447MB (now 447MB) reserved=608MB peak=822MB
|
||
[06:47] [ComfyUI] /workspaces/Sharp-2000/ComfyUI/custom_nodes/ComfyUI-PanoPack/nodes/_vendor/worldgen/src/panorama_utils.py:349: UserWarning: Sparse CSR tensor support is in beta state. If you miss a functionality in the sparse tensor support, please submit a feature request to https://github.com/pytorch/pytorch/issues. (Triggered internally at /pytorch/aten/src/ATen/SparseCsrTensorImpl.cpp:49.)
|
||
[06:47] [ComfyUI] A_gpu = torch.sparse_csr_tensor(
|
||
[06:47] [ComfyUI] [worker:ComfyUI-PanoPack]
|
||
[06:47] [ComfyUI] === WATCHDOG TICK 1 ===
|
||
[06:47] [ComfyUI] [worker:ComfyUI-PanoPack] Thread 0x000072f96f9ff640 (most recent call first):
|
||
[06:47] [ComfyUI] File "/tmp/comfytest-home/.ce/.pixi/envs/panopack-nodes/lib/python3.10/socket.py", line 293 in accept
|
||
[06:47] [ComfyUI] File "/tmp/comfytest-home/.ce/.pixi/envs/panopack-nodes/lib/python3.10/multiprocessing/connection.py", line 609 in accept
|
||
[06:47] [ComfyUI] File "/tmp/comfytest-home/.ce/.pixi/envs/panopack-nodes/lib/python3.10/multiprocessing/connection.py", line 463 in accept
|
||
[06:47] [ComfyUI] File "/tmp/comfytest-home/.ce/.pixi/envs/panopack-nodes/lib/python3.10/multiprocessing/resource_sharer.py", line 138 in _serve
|
||
[06:47] [ComfyUI] File "/tmp/comfytest-home/.ce/.pixi/envs/panopack-nodes/lib/python3.10/threading.py", line 953 in run
|
||
[06:47] [ComfyUI] File "/tmp/comfytest-home/.ce/.pixi/envs/panopack-nodes/lib/python3.10/threading.py", line 1016 in _bootstrap_inner
|
||
[06:47] [ComfyUI] File "/tmp/comfytest-home/.ce/.pixi/envs/panopack-nodes/lib/python3.10/threading.py", line 973 in _bootstrap
|
||
[06:47] [ComfyUI]
|
||
[06:47] [ComfyUI] Thread 0x000072fb500e6640 (most recent call first):
|
||
[06:47] [ComfyUI] File "/tmp/comfyui_pvenv_a7abe8nv/persistent_worker.py", line 106 in _vram_poller
|
||
[06:47] [ComfyUI] File "/tmp/comfytest-home/.ce/.pixi/envs/panopack-nodes/lib/python3.10/threading.py", line 953 in run
|
||
[06:47] [ComfyUI] File "/tmp/comfytest-home/.ce/.pixi/envs/panopack-nodes/lib/python3.10/threading.py", line 1016 in _bootstrap_inner
|
||
[06:47] [ComfyUI] File "/tmp/comfytest-home/.ce/.pixi/envs/panopack-nodes/lib/python3.10/threading.py", line 973 in _bootstrap
|
||
[06:47] [ComfyUI]
|
||
[06:47] [ComfyUI] Current thread 0x000072fb508e7640 (most recent call first):
|
||
[06:47] [ComfyUI] File "/tmp/comfyui_pvenv_a7abe8nv/persistent_worker.py", line 52 in _watchdog
|
||
[06:47] [ComfyUI] File "/tmp/comfytest-home/.ce/.pixi/envs/panopack-nodes/lib/python3.10/threading.py", line 953 in run
|
||
[06:47] [ComfyUI] File "/tmp/comfytest-home/.ce/.pixi/envs/panopack-nodes/lib/python3.10/threading.py", line 1016 in _bootstrap_inner
|
||
[06:47] [ComfyUI] File "/tmp/comfytest-home/.ce/.pixi/envs/panopack-nodes/lib/python3.10/threading.py", line 973 in _bootstrap
|
||
[06:47] [ComfyUI]
|
||
[06:47] [ComfyUI] Thread 0x000072fb50ebd740 (most recent call first):
|
||
[06:47] [ComfyUI] File "/workspaces/Sharp-2000/ComfyUI/custom_nodes/ComfyUI-PanoPack/nodes/_vendor/worldgen/src/panorama_utils.py", line 500 in solve_lsmr_gpu
|
||
[06:47] [ComfyUI] File "/workspaces/Sharp-2000/ComfyUI/custom_nodes/ComfyUI-PanoPack/nodes/_vendor/worldgen/src/panorama_utils.py", line 841 in merge_panorama_depth_gpu
|
||
[06:47] [ComfyUI] File "/workspaces/Sharp-2000/ComfyUI/custom_nodes/ComfyUI-PanoPack/nodes/_vendor/worldgen/src/panorama_utils.py", line 550 in merge_panorama_depth_gpu
|
||
[06:47] [ComfyUI] File "/workspaces/Sharp-2000/ComfyUI/custom_nodes/ComfyUI-PanoPack/nodes/_vendor/worldgen/src/panorama_utils.py", line 550 in merge_panorama_depth_gpu
|
||
[06:47] [ComfyUI] File "/workspaces/Sharp-2000/ComfyUI/custom_nodes/ComfyUI-PanoPack/nodes/_vendor/worldgen/src/panorama_utils.py", line 550 in merge_panorama_depth_gpu
|
||
[06:47] [ComfyUI] File "/workspaces/Sharp-2000/ComfyUI/custom_nodes/ComfyUI-PanoPack/nodes/_vendor/worldgen/src/panorama_utils.py", line 550 in merge_panorama_depth_gpu
|
||
[06:47] [ComfyUI] File "/workspaces/Sharp-2000/ComfyUI/custom_nodes/ComfyUI-PanoPack/nodes/depth_merge.py", line 953 in execute
|
||
[06:47] [ComfyUI] File "/workspaces/Sharp-2000/ComfyUI/comfy_api/latest/_io.py", line 1892 in EXECUTE_NORMALIZED
|
||
[06:47] [ComfyUI] File "/tmp/comfyui_pvenv_a7abe8nv/persistent_worker.py", line 1762 in main
|
||
[06:47] [ComfyUI] File "/tmp/comfyui_pvenv_a7abe8nv/persistent_worker.py", line 1807 in <module>
|
||
[06:47] [ComfyUI]
|
||
[06:47] [ComfyUI] [worker:ComfyUI-PanoPack] === END ===
|
||
[06:47] [ComfyUI]
|
||
[06:47] [ComfyUI] [worker:ComfyUI-PanoPack] [merge_panorama_depth_gpu 256x128 ] done 0.51s (warp 0.29, build 0.01, LSMR 0.22); N=42 K=8 chunks=6; depth min/med/max = 0.384/0.945/3.091; valid 32768/32768
|
||
[06:48] [ComfyUI] [worker:ComfyUI-PanoPack] [merge_panorama_depth_gpu 512x256 ] done 0.70s (warp 0.08, build 0.02, LSMR 0.07); N=42 K=8 chunks=6; depth min/med/max = 0.384/0.945/3.094; valid 131072/131072
|
||
[06:48] [ComfyUI] [worker:ComfyUI-PanoPack] [merge_panorama_depth_gpu 1024x512 ] done 1.01s (warp 0.10, build 0.06, LSMR 0.13); N=42 K=8 chunks=6; depth min/med/max = 0.384/0.945/3.094; valid 524288/524288
|
||
[06:48] Frame 30 saved (frame_029.jpg, t=103.5s)
|
||
[06:48] [capture-periodic] freeze=1ms shot=105ms unfreeze=8ms saved=True
|
||
[06:49] [ComfyUI] [worker:ComfyUI-PanoPack] [VRAM] +250MB (now 698MB) reserved=768MB peak=822MB
|
||
[06:49] [ComfyUI] [worker:ComfyUI-PanoPack] [merge_panorama_depth_gpu 2048x1024] done 2.03s (warp 0.20, build 0.29, LSMR 0.48); N=42 K=8 chunks=6; depth min/med/max = 0.384/0.945/3.095; valid 2097152/2097152
|
||
[06:49] [capture-loop] iter=950 t=104.5s state={'complete': False, 'error': None, 'executedCount': 2, 'wsState': 1} eval_ms=1 ram=15.5/31.3GB (50%) swap=2.1/32.0GB (6%) cpu=16% browser_rss=1.11GB
|
||
[06:50] [ComfyUI] [worker:ComfyUI-PanoPack] [VRAM] -400MB (now 298MB) reserved=416MB peak=859MB
|
||
[06:53] [ComfyUI] [worker:ComfyUI-PanoPack] [VRAM] +383MB (now 682MB) reserved=800MB peak=859MB
|
||
[06:54] [ComfyUI] [worker:ComfyUI-PanoPack] [VRAM] +287MB (now 970MB) reserved=1088MB peak=970MB
|
||
[06:55] [capture-loop] iter=1000 t=109.9s state={'complete': False, 'error': None, 'executedCount': 2, 'wsState': 1} eval_ms=3 ram=17.7/31.3GB (56%) swap=2.1/32.0GB (6%) cpu=12% browser_rss=1.11GB
|
||
[06:55] [ComfyUI] [worker:ComfyUI-PanoPack] [VRAM] +927MB (now 1898MB) reserved=2176MB peak=1898MB
|
||
[06:56] [ComfyUI] [worker:ComfyUI-PanoPack] [merge_panorama_depth_gpu 4096x2048] done 8.63s (warp 0.61, build 3.45, LSMR 2.32); N=42 K=8 chunks=6; depth min/med/max = 0.384/0.945/3.094; valid 8388608/8388608
|
||
[06:56] [ComfyUI] [worker:ComfyUI-PanoPack] [PanoramaDepthMerge] merged depth: shape (2048, 4096), min=0.384, median=0.945, max=3.094; valid pixels: 8388608 / 8388608
|
||
[06:56] [ComfyUI] [worker:ComfyUI-PanoPack] [VRAM] -1891MB (now 8MB) reserved=2176MB peak=1898MB
|
||
[07:00] [capture-loop] iter=1050 t=115.4s state={'complete': False, 'error': None, 'executedCount': 2, 'wsState': 1} eval_ms=2 ram=16.5/31.3GB (53%) swap=2.1/32.0GB (6%) cpu=15% browser_rss=1.11GB
|
||
[07:06] [capture-loop] iter=1100 t=120.8s state={'complete': False, 'error': None, 'executedCount': 2, 'wsState': 1} eval_ms=1 ram=16.4/31.3GB (52%) swap=2.1/32.0GB (6%) cpu=17% browser_rss=1.11GB
|
||
[07:11] [ComfyUI] [worker:ComfyUI-PanoPack] [PanoramaDepthMerge] debug_image: H=2048+102, mult_disagreement (log-d, sphere-uniform): mean=11.22%, p99=24.69%, max=28.22%; overlap_pixels=8388608
|
||
[07:11] [ComfyUI] [worker:ComfyUI-PanoPack] [headless_gl] prefix=/tmp/comfytest-home/.ce/.pixi/envs/panopack-nodes
|
||
[07:11] [ComfyUI] [worker:ComfyUI-PanoPack] [headless_gl] OSMesa: ['libOSMesa.so', 'libOSMesa.so.8', 'libOSMesa.so.8.0.0']
|
||
[07:11] [ComfyUI] [worker:ComfyUI-PanoPack] [headless_gl] env: VTK_DEFAULT_OPENGL_WINDOW=vtkOSOpenGLRenderWindow PYVISTA_OFF_SCREEN=true
|
||
[07:11] [capture-loop] iter=1150 t=126.3s state={'complete': False, 'error': None, 'executedCount': 2, 'wsState': 1} eval_ms=2 ram=15.9/31.3GB (51%) swap=2.1/32.0GB (6%) cpu=16% browser_rss=1.11GB
|
||
[07:11] [ComfyUI] [worker:ComfyUI-PanoPack] [PanoramaDepthMerge] xyz_views: cloud bbox center=(-0.79, -0.31, +0.03) m, size=(4.27 x 3.57 x 1.96) m, N=80000 (subsampled)
|
||
[07:13] [ComfyUI] [worker:ComfyUI-PanoPack] [PanoramaDepthMerge] points: merged equirect point map (1, 2048, 4096, 3)
|
||
[07:13] [ComfyUI] [SubprocessWorker] callback 'report_progress' from call_id=3
|
||
[07:14] [ComfyUI] [SubprocessWorker] got response: ok
|
||
[07:14] [ComfyUI] [comfy-env] PanoramaDepthMerge done (51.74s): result: NodeOutput
|
||
[07:14] [ComfyUI] [VRAM] After PanoramaDepthMerge: 3399 / 24122 MB
|
||
[07:14] [ComfyUI] [VRAM] Loaded: SubprocessModel (631 MB)
|
||
[07:14] [ComfyUI] [comfy-env] Running PanoramaSplitAdaptive: split_method: 'icosahedron_42', resolution: 1536, fov_degrees: 90.0, use_gpu: True, create_masks: True, mask_method: 'closest_to', panorama: dict, depth_panorama: torch.float32 [1,2048,4096,3] cpu, normals_panorama: torch.float32 [1,2048,4096,3] cpu
|
||
[07:14] [ComfyUI] [VRAM] Before PanoramaSplitAdaptive: 3399 / 24122 MB
|
||
[07:14] [ComfyUI] [VRAM] Loaded: SubprocessModel (631 MB)
|
||
[07:14] [ComfyUI] [SubprocessWorker] call_method: nodes.panorama_split_adaptive.PanoramaSplitAdaptive.EXECUTE_NORMALIZED
|
||
[07:14] [ComfyUI] [SubprocessWorker] acquired lock, ensuring started...
|
||
[07:14] [ComfyUI] [ComfyUI-PanoPack] Health check: ping (timeout=5.0s)...
|
||
[07:14] [ComfyUI] [ComfyUI-PanoPack] Health check: ok
|
||
[07:14] [ComfyUI] [SubprocessWorker] worker started/confirmed
|
||
[07:14] [ComfyUI] [comfy-env] PRE-SERIALIZE 'depth_panorama' shape: torch.Size([1, 2048, 4096, 3])
|
||
[07:14] [ComfyUI] [comfy-env] PRE-SERIALIZE 'normals_panorama' shape: torch.Size([1, 2048, 4096, 3])
|
||
[07:14] [ComfyUI] [SubprocessWorker] serializing kwargs to shm...
|
||
[07:14] Node executed (3 total), capturing...
|
||
[07:14] [ComfyUI] [SubprocessWorker] created 0 shm blocks
|
||
[07:14] [ComfyUI] [SubprocessWorker] sending request via socket...
|
||
[07:14] [ComfyUI] [SubprocessWorker] call_id=4 sending call_method
|
||
[07:14] [ComfyUI] [worker:ComfyUI-PanoPack] [comfy-env] _from_shm got dict with keys: ['__type__', 'strategy', 'parent_pid', 'fd', 'storage_size']
|
||
[07:14] [ComfyUI] [worker:ComfyUI-PanoPack] [comfy-env] DESERIALIZE TensorRef: tensor_size=[1, 2048, 4096, 3]
|
||
[07:14] [ComfyUI] [worker:ComfyUI-PanoPack] [comfy-env] DESERIALIZED tensor shape: torch.Size([1, 2048, 4096, 3])
|
||
[07:14] [ComfyUI] [worker:ComfyUI-PanoPack] [comfy-env] _from_shm got dict with keys: ['__type__', 'strategy', 'parent_pid', 'fd', 'storage_size']
|
||
[07:14] [ComfyUI] [worker:ComfyUI-PanoPack] [comfy-env] DESERIALIZE TensorRef: tensor_size=[1, 2048, 4096, 3]
|
||
[07:14] [ComfyUI] [worker:ComfyUI-PanoPack] [comfy-env] DESERIALIZED tensor shape: torch.Size([1, 2048, 4096, 3])
|
||
[07:14] [ComfyUI] [worker:ComfyUI-PanoPack] [comfy-env] _from_shm got dict with keys: ['__type__', 'strategy', 'parent_pid', 'fd', 'storage_size']
|
||
[07:14] [ComfyUI] [worker:ComfyUI-PanoPack] [comfy-env] DESERIALIZE TensorRef: tensor_size=[1, 2048, 4096, 3]
|
||
[07:14] [ComfyUI] [worker:ComfyUI-PanoPack] [comfy-env] DESERIALIZED tensor shape: torch.Size([1, 2048, 4096, 3])
|
||
[07:14] Frame 31 saved (frame_030.jpg, t=129.3s)
|
||
[07:14] [capture-node] freeze=2ms shot=103ms unfreeze=10ms saved=True
|
||
[07:14] [ComfyUI] [worker:ComfyUI-PanoPack] [PanoramaSplitAdaptive] computing area weights from depth (2048x4096) + normals...
|
||
[07:15] [ComfyUI] [worker:ComfyUI-PanoPack] [PanoramaSplitAdaptive] weight range: [1.06, 131], mean=11.7
|
||
[07:15] [ComfyUI] [worker:ComfyUI-PanoPack] [PanoramaSplitAdaptive] adaptive relax: icosahedron_42 (42 cameras), weighted Lloyd...
|
||
[07:17] [capture-loop] iter=1200 t=132.0s state={'complete': False, 'error': None, 'executedCount': 3, 'wsState': 1} eval_ms=2 ram=16.3/31.3GB (52%) swap=2.1/32.0GB (6%) cpu=12% browser_rss=1.12GB
|
||
[07:22] [capture-loop] iter=1250 t=137.3s state={'complete': False, 'error': None, 'executedCount': 3, 'wsState': 1} eval_ms=2 ram=17.0/31.3GB (54%) swap=2.1/32.0GB (6%) cpu=11% browser_rss=1.12GB
|
||
[07:28] [capture-loop] iter=1300 t=142.8s state={'complete': False, 'error': None, 'executedCount': 3, 'wsState': 1} eval_ms=1 ram=16.2/31.3GB (52%) swap=2.1/32.0GB (6%) cpu=11% browser_rss=1.12GB
|
||
[07:33] [capture-loop] iter=1350 t=148.2s state={'complete': False, 'error': None, 'executedCount': 3, 'wsState': 1} eval_ms=2 ram=16.3/31.3GB (52%) swap=2.1/32.0GB (6%) cpu=13% browser_rss=1.12GB
|
||
[07:39] [capture-loop] iter=1400 t=153.7s state={'complete': False, 'error': None, 'executedCount': 3, 'wsState': 1} eval_ms=2 ram=16.2/31.3GB (52%) swap=2.1/32.0GB (6%) cpu=11% browser_rss=1.12GB
|
||
[07:40] [ComfyUI] [worker:ComfyUI-PanoPack] [PanoramaSplitAdaptive] Lloyd ran 24 iters (max move 1.42e-02)
|
||
[07:40] [ComfyUI] [worker:ComfyUI-PanoPack] [PanoramaSplitAdaptive] Lloyd relaxation done: 42 camera directions in 25.304s
|
||
[07:40] [ComfyUI] [worker:ComfyUI-PanoPack] [PanoramaSplitAdaptive] rasterizing 42 faces @ 1536x1536...
|
||
[07:44] [capture-loop] iter=1450 t=159.1s state={'complete': False, 'error': None, 'executedCount': 3, 'wsState': 1} eval_ms=2 ram=16.0/31.3GB (51%) swap=2.1/32.0GB (6%) cpu=11% browser_rss=1.12GB
|
||
[07:47] [ComfyUI] [worker:ComfyUI-PanoPack]
|
||
[07:47] [ComfyUI] === WATCHDOG TICK 2 ===
|
||
[07:47] [ComfyUI] [worker:ComfyUI-PanoPack] Thread 0x000072f96f9ff640 (most recent call first):
|
||
[07:47] [ComfyUI] File "/tmp/comfytest-home/.ce/.pixi/envs/panopack-nodes/lib/python3.10/socket.py", line 293 in accept
|
||
[07:47] [ComfyUI] File "/tmp/comfytest-home/.ce/.pixi/envs/panopack-nodes/lib/python3.10/multiprocessing/connection.py", line 609 in accept
|
||
[07:47] [ComfyUI] File "/tmp/comfytest-home/.ce/.pixi/envs/panopack-nodes/lib/python3.10/multiprocessing/connection.py", line 463 in accept
|
||
[07:47] [ComfyUI] File "/tmp/comfytest-home/.ce/.pixi/envs/panopack-nodes/lib/python3.10/multiprocessing/resource_sharer.py", line 138 in _serve
|
||
[07:47] [ComfyUI] File "/tmp/comfytest-home/.ce/.pixi/envs/panopack-nodes/lib/python3.10/threading.py", line 953 in run
|
||
[07:47] [ComfyUI] File "/tmp/comfytest-home/.ce/.pixi/envs/panopack-nodes/lib/python3.10/threading.py", line 1016 in _bootstrap_inner
|
||
[07:47] [ComfyUI] File "/tmp/comfytest-home/.ce/.pixi/envs/panopack-nodes/lib/python3.10/threading.py", line 973 in _bootstrap
|
||
[07:47] [ComfyUI]
|
||
[07:47] [ComfyUI] Thread 0x000072fb500e6640 (most recent call first):
|
||
[07:47] [ComfyUI] File "/tmp/comfyui_pvenv_a7abe8nv/persistent_worker.py", line 106 in _vram_poller
|
||
[07:47] [ComfyUI] File "/tmp/comfytest-home/.ce/.pixi/envs/panopack-nodes/lib/python3.10/threading.py", line 953 in run
|
||
[07:47] [ComfyUI] File "/tmp/comfytest-home/.ce/.pixi/envs/panopack-nodes/lib/python3.10/threading.py", line 1016 in _bootstrap_inner
|
||
[07:47] [ComfyUI] File "/tmp/comfytest-home/.ce/.pixi/envs/panopack-nodes/lib/python3.10/threading.py", line 973 in _bootstrap
|
||
[07:47] [ComfyUI]
|
||
[07:47] [ComfyUI] Current thread 0x000072fb508e7640 (most recent call first):
|
||
[07:47] [ComfyUI] File "/tmp/comfyui_pvenv_a7abe8nv/persistent_worker.py", line 52 in _watchdog
|
||
[07:47] [ComfyUI] File "/tmp/comfytest-home/.ce/.pixi/envs/panopack-nodes/lib/python3.10/threading.py", line 953 in run
|
||
[07:47] [ComfyUI] File "/tmp/comfytest-home/.ce/.pixi/envs/panopack-nodes/lib/python3.10/threading.py", line 1016 in _bootstrap_inner
|
||
[07:47] [ComfyUI] File "/tmp/comfytest-home/.ce/.pixi/envs/panopack-nodes/lib/python3.10/threading.py", line 973 in _bootstrap
|
||
[07:47] [ComfyUI]
|
||
[07:47] [ComfyUI] Thread 0x000072fb50ebd740 (most recent call first):
|
||
[07:47] [ComfyUI] File "/tmp/comfytest-home/.ce/.pixi/envs/panopack-nodes/lib/python3.10/site-packages/numpy/linalg/_linalg.py", line 2780 in norm
|
||
[07:47] [ComfyUI] File "/workspaces/Sharp-2000/ComfyUI/custom_nodes/ComfyUI-PanoPack/nodes/_vendor/moge_panorama.py", line 35 in directions_to_spherical_uv
|
||
[07:47] [ComfyUI] File "/workspaces/Sharp-2000/ComfyUI/custom_nodes/ComfyUI-PanoPack/nodes/_vendor/moge_panorama.py", line 92 in split_panorama_image_gpu
|
||
[07:47] [ComfyUI] File "/workspaces/Sharp-2000/ComfyUI/custom_nodes/ComfyUI-PanoPack/nodes/panorama_split_adaptive.py", line 434 in execute
|
||
[07:47] [ComfyUI] File "/workspaces/Sharp-2000/ComfyUI/comfy_api/latest/_io.py", line 1892 in EXECUTE_NORMALIZED
|
||
[07:47] [ComfyUI] File "/tmp/comfyui_pvenv_a7abe8nv/persistent_worker.py", line 1762 in main
|
||
[07:47] [ComfyUI] File "/tmp/comfyui_pvenv_a7abe8nv/persistent_worker.py", line 1807 in <module>
|
||
[07:47] [ComfyUI]
|
||
[07:47] [ComfyUI] [worker:ComfyUI-PanoPack] === END ===
|
||
[07:47] [ComfyUI]
|
||
[07:48] [ComfyUI] [worker:ComfyUI-PanoPack] [VRAM] +756MB (now 764MB) reserved=800MB peak=1898MB
|
||
[07:49] [ComfyUI] [worker:ComfyUI-PanoPack] [VRAM] +1230MB (now 1994MB) reserved=3168MB peak=1994MB
|
||
[07:49] [capture-loop] iter=1500 t=164.5s state={'complete': False, 'error': None, 'executedCount': 3, 'wsState': 1} eval_ms=2 ram=17.9/31.3GB (57%) swap=2.1/32.0GB (6%) cpu=12% browser_rss=1.12GB
|
||
[07:50] [ComfyUI] [worker:ComfyUI-PanoPack] [VRAM] -1986MB (now 8MB) reserved=3168MB peak=1994MB
|
||
[07:50] [ComfyUI] [worker:ComfyUI-PanoPack] [PanoramaSplitAdaptive] rasterized RGB in 10.286s (GPU)
|
||
[07:50] [ComfyUI] [worker:ComfyUI-PanoPack] [PanoramaSplitAdaptive] rasterizing depth crops...
|
||
[07:55] [capture-loop] iter=1550 t=169.9s state={'complete': False, 'error': None, 'executedCount': 3, 'wsState': 1} eval_ms=2 ram=18.3/31.3GB (58%) swap=2.1/32.0GB (6%) cpu=11% browser_rss=1.12GB
|
||
[08:00] [capture-loop] iter=1600 t=175.4s state={'complete': False, 'error': None, 'executedCount': 3, 'wsState': 1} eval_ms=2 ram=19.8/31.3GB (63%) swap=2.1/32.0GB (6%) cpu=11% browser_rss=1.12GB
|
||
[08:00] [ComfyUI] [worker:ComfyUI-PanoPack] [VRAM] +756MB (now 764MB) reserved=3168MB peak=1994MB
|
||
[08:01] [ComfyUI] [worker:ComfyUI-PanoPack] [VRAM] +1230MB (now 1994MB) reserved=3264MB peak=1994MB
|
||
[08:02] [ComfyUI] [worker:ComfyUI-PanoPack] [VRAM] -1986MB (now 8MB) reserved=3264MB peak=1994MB
|
||
[08:03] [ComfyUI] [worker:ComfyUI-PanoPack] [PanoramaSplitAdaptive] rasterizing normals crops...
|
||
[08:06] [capture-loop] iter=1650 t=180.7s state={'complete': False, 'error': None, 'executedCount': 3, 'wsState': 1} eval_ms=1 ram=20.3/31.3GB (65%) swap=2.1/32.0GB (6%) cpu=12% browser_rss=1.12GB
|
||
[08:11] [capture-loop] iter=1700 t=186.2s state={'complete': False, 'error': None, 'executedCount': 3, 'wsState': 1} eval_ms=2 ram=21.2/31.3GB (68%) swap=2.1/32.0GB (6%) cpu=11% browser_rss=1.12GB
|
||
[08:15] [ComfyUI] [worker:ComfyUI-PanoPack] [VRAM] +756MB (now 764MB) reserved=3264MB peak=1994MB
|
||
[08:16] [capture-loop] iter=1750 t=191.5s state={'complete': False, 'error': None, 'executedCount': 3, 'wsState': 1} eval_ms=1 ram=22.8/31.3GB (73%) swap=2.1/32.0GB (6%) cpu=11% browser_rss=1.12GB
|
||
[08:16] [ComfyUI] [worker:ComfyUI-PanoPack] [VRAM] +1230MB (now 1994MB) reserved=3264MB peak=1994MB
|
||
[08:18] [ComfyUI] [worker:ComfyUI-PanoPack] [VRAM] -1986MB (now 8MB) reserved=3264MB peak=1994MB
|
||
[08:20] [ComfyUI] [worker:ComfyUI-PanoPack] [PanoramaSplitAdaptive] generating closest_to masks...
|
||
[08:22] [capture-loop] iter=1800 t=197.0s state={'complete': False, 'error': None, 'executedCount': 3, 'wsState': 1} eval_ms=1 ram=23.0/31.3GB (73%) swap=2.2/32.0GB (7%) cpu=12% browser_rss=1.12GB
|
||
[08:27] [capture-loop] iter=1850 t=202.3s state={'complete': False, 'error': None, 'executedCount': 3, 'wsState': 1} eval_ms=1 ram=23.0/31.3GB (74%) swap=2.2/32.0GB (7%) cpu=11% browser_rss=1.12GB
|
||
[08:33] [capture-loop] iter=1900 t=207.8s state={'complete': False, 'error': None, 'executedCount': 3, 'wsState': 1} eval_ms=1 ram=22.8/31.3GB (73%) swap=2.2/32.0GB (7%) cpu=11% browser_rss=1.12GB
|
||
[08:38] [capture-loop] iter=1950 t=213.1s state={'complete': False, 'error': None, 'executedCount': 3, 'wsState': 1} eval_ms=1 ram=23.1/31.3GB (74%) swap=2.2/32.0GB (7%) cpu=11% browser_rss=1.12GB
|
||
[08:43] [capture-loop] iter=2000 t=218.6s state={'complete': False, 'error': None, 'executedCount': 3, 'wsState': 1} eval_ms=2 ram=23.0/31.3GB (74%) swap=2.2/32.0GB (7%) cpu=12% browser_rss=1.12GB
|
||
[08:45] [ComfyUI] [worker:ComfyUI-PanoPack] [PanoramaSplitAdaptive] generating debug_masks equirect image...
|
||
[08:47] [ComfyUI] [worker:ComfyUI-PanoPack]
|
||
[08:47] [ComfyUI] === WATCHDOG TICK 3 ===
|
||
[08:47] [ComfyUI] [worker:ComfyUI-PanoPack] Thread 0x000072f96f9ff640 (most recent call first):
|
||
[08:47] [ComfyUI] File "/tmp/comfytest-home/.ce/.pixi/envs/panopack-nodes/lib/python3.10/socket.py", line 293 in accept
|
||
[08:47] [ComfyUI] File "/tmp/comfytest-home/.ce/.pixi/envs/panopack-nodes/lib/python3.10/multiprocessing/connection.py", line 609 in accept
|
||
[08:47] [ComfyUI] File "/tmp/comfytest-home/.ce/.pixi/envs/panopack-nodes/lib/python3.10/multiprocessing/connection.py", line 463 in accept
|
||
[08:47] [ComfyUI] File "/tmp/comfytest-home/.ce/.pixi/envs/panopack-nodes/lib/python3.10/multiprocessing/resource_sharer.py", line 138 in _serve
|
||
[08:47] [ComfyUI] File "/tmp/comfytest-home/.ce/.pixi/envs/panopack-nodes/lib/python3.10/threading.py", line 953 in run
|
||
[08:47] [ComfyUI] File "/tmp/comfytest-home/.ce/.pixi/envs/panopack-nodes/lib/python3.10/threading.py", line 1016 in _bootstrap_inner
|
||
[08:47] [ComfyUI] File "/tmp/comfytest-home/.ce/.pixi/envs/panopack-nodes/lib/python3.10/threading.py", line 973 in _bootstrap
|
||
[08:47] [ComfyUI]
|
||
[08:47] [ComfyUI] Thread 0x000072fb500e6640 (most recent call first):
|
||
[08:47] [ComfyUI] File "/tmp/comfyui_pvenv_a7abe8nv/persistent_worker.py", line 106 in _vram_poller
|
||
[08:47] [ComfyUI] File "/tmp/comfytest-home/.ce/.pixi/envs/panopack-nodes/lib/python3.10/threading.py", line 953 in run
|
||
[08:47] [ComfyUI] File "/tmp/comfytest-home/.ce/.pixi/envs/panopack-nodes/lib/python3.10/threading.py", line 1016 in _bootstrap_inner
|
||
[08:47] [ComfyUI] File "/tmp/comfytest-home/.ce/.pixi/envs/panopack-nodes/lib/python3.10/threading.py", line 973 in _bootstrap
|
||
[08:47] [ComfyUI]
|
||
[08:47] [ComfyUI] Current thread 0x000072fb508e7640 (most recent call first):
|
||
[08:47] [ComfyUI] File "/tmp/comfyui_pvenv_a7abe8nv/persistent_worker.py", line 52 in _watchdog
|
||
[08:47] [ComfyUI] File "/tmp/comfytest-home/.ce/.pixi/envs/panopack-nodes/lib/python3.10/threading.py", line 953 in run
|
||
[08:47] [ComfyUI] File "/tmp/comfytest-home/.ce/.pixi/envs/panopack-nodes/lib/python3.10/threading.py", line 1016 in _bootstrap_inner
|
||
[08:47] [ComfyUI] File "/tmp/comfytest-home/.ce/.pixi/envs/panopack-nodes/lib/python3.10/threading.py", line 973 in _bootstrap
|
||
[08:47] [ComfyUI]
|
||
[08:47] [ComfyUI] Thread 0x000072fb50ebd740 (most recent call first):
|
||
[08:47] [ComfyUI] File "/workspaces/Sharp-2000/ComfyUI/custom_nodes/ComfyUI-PanoPack/nodes/panorama_split_adaptive.py", line 502 in execute
|
||
[08:47] [ComfyUI] File "/workspaces/Sharp-2000/ComfyUI/comfy_api/latest/_io.py", line 1892 in EXECUTE_NORMALIZED
|
||
[08:47] [ComfyUI] File "/tmp/comfyui_pvenv_a7abe8nv/persistent_worker.py", line 1762 in main
|
||
[08:47] [ComfyUI] File "/tmp/comfyui_pvenv_a7abe8nv/persistent_worker.py", line 1807 in <module>
|
||
[08:47] [ComfyUI]
|
||
[08:47] [ComfyUI] [worker:ComfyUI-PanoPack] === END ===
|
||
[08:47] [ComfyUI]
|
||
[08:49] [capture-loop] iter=2050 t=223.9s state={'complete': False, 'error': None, 'executedCount': 3, 'wsState': 1} eval_ms=2 ram=25.1/31.3GB (80%) swap=2.2/32.0GB (7%) cpu=11% browser_rss=1.12GB
|
||
[08:53] [ComfyUI] [worker:ComfyUI-PanoPack] [PanoramaSplitAdaptive] pixels/area: lowest 0.243 -> 0.336 (+38% on the worst-sampled cell), highest 6.44 -> 2.85; spread max/min 26.5x -> 8.5x
|
||
[08:53] [ComfyUI] [worker:ComfyUI-PanoPack] [PanoramaSplitAdaptive] done: 42 adaptive faces, 98.543s total
|
||
[08:54] [capture-loop] iter=2100 t=229.4s state={'complete': False, 'error': None, 'executedCount': 3, 'wsState': 1} eval_ms=2 ram=20.4/31.3GB (65%) swap=2.2/32.0GB (7%) cpu=12% browser_rss=1.12GB
|
||
[08:56] [ComfyUI] [SubprocessWorker] got response: ok
|
||
[08:56] [ComfyUI] [comfy-env] PanoramaSplitAdaptive done (101.91s): result: NodeOutput
|
||
[08:56] [ComfyUI] [VRAM] After PanoramaSplitAdaptive: 6631 / 24122 MB
|
||
[08:56] [ComfyUI] [VRAM] Loaded: SubprocessModel (631 MB)
|
||
[08:56] Frame 32 saved (frame_031.jpg, t=231.1s)
|
||
[08:56] [capture-periodic] freeze=1ms shot=96ms unfreeze=5ms saved=True
|
||
[08:56] [ComfyUI] [comfy-env] Running SharpRayToPlanarDepth: image: torch.float32 [42,1536,1536,3] cpu, intrinsics: torch.float32 [42,3,3] cpu, extrinsics: torch.float32 [42,4,4] cpu
|
||
[08:56] [ComfyUI] [VRAM] Before SharpRayToPlanarDepth: 6631 / 24122 MB
|
||
[08:56] [ComfyUI] [ComfyUI-Sharp] python: /tmp/comfytest-home/.ce/.pixi/envs/sharp-nodes/bin/python
|
||
[08:56] [ComfyUI] [VRAM] Loaded: SubprocessModel (631 MB)
|
||
[08:56] [ComfyUI] [ComfyUI-Sharp] sys_path sent to worker: ['/workspaces/Sharp-2000/ComfyUI', '/workspaces/Sharp-2000/ComfyUI/custom_nodes/ComfyUI-Sharp', '/tmp/comfytest-home/.ce/.pixi/envs/sharp-nodes/lib/python3.1/site-packages', '/workspaces/Sharp-2000/ComfyUI/custom_nodes/ComfyUI-Sharp']
|
||
[08:56] [ComfyUI] [SubprocessWorker] call_method: nodes.ray_to_planar_depth.SharpRayToPlanarDepth.EXECUTE_NORMALIZED
|
||
[08:56] [ComfyUI] [SubprocessWorker] is_pixi=True, python=/tmp/comfytest-home/.ce/.pixi/envs/sharp-nodes/bin/python
|
||
[08:56] [ComfyUI] [SubprocessWorker] acquired lock, ensuring started...
|
||
[08:56] [ComfyUI] [SubprocessWorker] launching cmd=['/tmp/comfytest-home/.pixi/bin/pixi', 'run', '--as-is', '--manifest-path', '/tmp/comfytest-home/.ce/pixi.toml', '-e', 'sharp-nodes', 'python', '/tmp/comfyui_pvenv_dtk9es_f/persistent_worker.py', 'abstract://comfy_worker_1e0d1b19a342']...
|
||
[08:56] [ComfyUI] [ComfyUI-Sharp] Health check: ping (timeout=5.0s)...
|
||
[08:56] [ComfyUI] [SubprocessWorker] socket_addr=abstract://comfy_worker_1e0d1b19a342 (abstract, no filesystem path)
|
||
[08:56] [ComfyUI] [ComfyUI-Sharp] Health check: failed
|
||
[08:56] [ComfyUI] [ComfyUI-Sharp] Socket unhealthy, restarting worker...
|
||
[08:56] Node executed (4 total), capturing...
|
||
[08:57] Frame 33 saved (frame_032.jpg, t=231.8s)
|
||
[08:57] [capture-node] freeze=12ms shot=112ms unfreeze=5ms saved=True
|
||
[08:58] [ComfyUI] [worker:ComfyUI-Sharp] ERROR: Failed to import comfy_kitchen, Error: No module named 'comfy_kitchen', fp8 and fp4 support will not be available.
|
||
[08:58] [ComfyUI] [worker:ComfyUI-Sharp] WARNING: comfy_kitchen does not support stochastic FP8 rounding, please update comfy_kitchen.
|
||
[08:58] [ComfyUI] [SubprocessWorker] worker started/confirmed
|
||
[08:58] [ComfyUI] [comfy-env] PRE-SERIALIZE 'image' shape: torch.Size([42, 1536, 1536, 3])
|
||
[08:58] [ComfyUI] [comfy-env] PRE-SERIALIZE 'intrinsics' shape: torch.Size([42, 3, 3])
|
||
[08:58] [ComfyUI] [comfy-env] PRE-SERIALIZE 'extrinsics' shape: torch.Size([42, 4, 4])
|
||
[08:58] [ComfyUI] [SubprocessWorker] serializing kwargs to shm...
|
||
[08:58] [ComfyUI] [SubprocessWorker] created 0 shm blocks
|
||
[08:58] [ComfyUI] [SubprocessWorker] sending request via socket...
|
||
[08:58] [ComfyUI] [SubprocessWorker] call_id=2 sending call_method
|
||
[08:58] [ComfyUI] [worker:ComfyUI-Sharp] [comfy-env] _from_shm got dict with keys: ['__type__', 'strategy', 'parent_pid', 'fd', 'storage_size']
|
||
[08:58] [ComfyUI] [worker:ComfyUI-Sharp] [comfy-env] DESERIALIZE TensorRef: tensor_size=[42, 1536, 1536, 3]
|
||
[08:58] [ComfyUI] [worker:ComfyUI-Sharp] [comfy-env] DESERIALIZED tensor shape: torch.Size([42, 1536, 1536, 3])
|
||
[08:58] [ComfyUI] [worker:ComfyUI-Sharp] [comfy-env] _from_shm got dict with keys: ['__type__', 'strategy', 'parent_pid', 'fd', 'storage_size']
|
||
[08:58] [ComfyUI] [worker:ComfyUI-Sharp] [comfy-env] DESERIALIZE TensorRef: tensor_size=[42, 3, 3]
|
||
[08:58] [ComfyUI] [worker:ComfyUI-Sharp] [comfy-env] DESERIALIZED tensor shape: torch.Size([42, 3, 3])
|
||
[08:58] [ComfyUI] [worker:ComfyUI-Sharp] [comfy-env] _from_shm got dict with keys: ['__type__', 'strategy', 'parent_pid', 'fd', 'storage_size']
|
||
[08:58] [ComfyUI] [worker:ComfyUI-Sharp] [comfy-env] DESERIALIZE TensorRef: tensor_size=[42, 4, 4]
|
||
[08:58] [ComfyUI] [worker:ComfyUI-Sharp] [comfy-env] DESERIALIZED tensor shape: torch.Size([42, 4, 4])
|
||
[08:59] [ComfyUI] [worker:ComfyUI-Sharp] [SharpRayToPlanarDepth] detected normalized intrinsics (fx<2); rescaled to pixel-K for 1536×1536: fx=768.0
|
||
[09:00] [ComfyUI] [worker:ComfyUI-Sharp] [SharpRayToPlanarDepth] ray->planar: B=42 1536×1536, cos_map per-face (3D K), intrinsics_rescaled fx=768.0 cx=768.0
|
||
[09:00] [capture-loop] iter=2150 t=235.1s state={'complete': False, 'error': None, 'executedCount': 4, 'wsState': 1} eval_ms=2 ram=21.7/31.3GB (70%) swap=2.2/32.0GB (7%) cpu=13% browser_rss=1.20GB
|
||
[09:01] [ComfyUI] [SubprocessWorker] got response: ok
|
||
[09:01] [ComfyUI] [comfy-env] SharpRayToPlanarDepth done (4.86s): result: NodeOutput
|
||
[09:01] [ComfyUI] [VRAM] After SharpRayToPlanarDepth: 6631 / 24122 MB
|
||
[09:01] [ComfyUI] [VRAM] Loaded: SubprocessModel (631 MB)
|
||
[09:01] [ComfyUI] [comfy-env] Running SharpPredictGaussiansFromMetricDepth: snap_to_external_depth: 'none', depth_convention: 'planar_z', focal_length_mm: 30.0, output_prefix: 'sharp_aligned', save_background_layer: True, edge_crop: 0.0, model: dict, image: torch.float32 [42,1536,1536,3] cpu, metric_depth_layer0: torch.float32 [42,1536,1536,3] cpu, extrinsics: torch.float32 [42,4,4] cpu, intrinsics: torch.float32 [42,3,3] cpu, mask: torch.float32 [42,1536,1536] cpu
|
||
[09:01] [ComfyUI] [VRAM] Before SharpPredictGaussiansFromMetricDepth: 6631 / 24122 MB
|
||
[09:01] [ComfyUI] [VRAM] Loaded: SubprocessModel (631 MB)
|
||
[09:01] [ComfyUI] [SubprocessWorker] call_method: nodes.predict_gaussians_from_depth.SharpPredictGaussiansFromMetricDepth.EXECUTE_NORMALIZED
|
||
[09:01] [ComfyUI] [SubprocessWorker] acquired lock, ensuring started...
|
||
[09:01] [ComfyUI] [ComfyUI-Sharp] Health check: ping (timeout=5.0s)...
|
||
[09:01] [ComfyUI] [ComfyUI-Sharp] Health check: ok
|
||
[09:01] [ComfyUI] [SubprocessWorker] worker started/confirmed
|
||
[09:01] [ComfyUI] [comfy-env] PRE-SERIALIZE 'image' shape: torch.Size([42, 1536, 1536, 3])
|
||
[09:01] [ComfyUI] [comfy-env] PRE-SERIALIZE 'metric_depth_layer0' shape: torch.Size([42, 1536, 1536, 3])
|
||
[09:01] [ComfyUI] [comfy-env] PRE-SERIALIZE 'extrinsics' shape: torch.Size([42, 4, 4])
|
||
[09:01] [ComfyUI] [comfy-env] PRE-SERIALIZE 'intrinsics' shape: torch.Size([42, 3, 3])
|
||
[09:01] [ComfyUI] [comfy-env] PRE-SERIALIZE 'mask' shape: torch.Size([42, 1536, 1536])
|
||
[09:01] [ComfyUI] [SubprocessWorker] serializing kwargs to shm...
|
||
[09:02] [ComfyUI] [SubprocessWorker] created 0 shm blocks
|
||
[09:02] [ComfyUI] [SubprocessWorker] sending request via socket...
|
||
[09:02] [ComfyUI] [SubprocessWorker] call_id=3 sending call_method
|
||
[09:02] [ComfyUI] [worker:ComfyUI-Sharp] [comfy-env] _from_shm got dict with keys: ['__type__', 'strategy', 'parent_pid', 'fd', 'storage_size']
|
||
[09:02] [ComfyUI] [worker:ComfyUI-Sharp] [comfy-env] DESERIALIZE TensorRef: tensor_size=[42, 1536, 1536, 3]
|
||
[09:02] [ComfyUI] [worker:ComfyUI-Sharp] [comfy-env] DESERIALIZED tensor shape: torch.Size([42, 1536, 1536, 3])
|
||
[09:02] [ComfyUI] [worker:ComfyUI-Sharp] [comfy-env] _from_shm got dict with keys: ['__type__', 'strategy', 'parent_pid', 'fd', 'storage_size']
|
||
[09:02] [ComfyUI] [worker:ComfyUI-Sharp] [comfy-env] DESERIALIZE TensorRef: tensor_size=[42, 1536, 1536, 3]
|
||
[09:02] [ComfyUI] [worker:ComfyUI-Sharp] [comfy-env] DESERIALIZED tensor shape: torch.Size([42, 1536, 1536, 3])
|
||
[09:02] [ComfyUI] [worker:ComfyUI-Sharp] [comfy-env] _from_shm got dict with keys: ['__type__', 'strategy', 'parent_pid', 'fd', 'storage_size']
|
||
[09:02] [ComfyUI] [worker:ComfyUI-Sharp] [comfy-env] DESERIALIZE TensorRef: tensor_size=[42, 4, 4]
|
||
[09:02] [ComfyUI] [worker:ComfyUI-Sharp] [comfy-env] DESERIALIZED tensor shape: torch.Size([42, 4, 4])
|
||
[09:02] [ComfyUI] [worker:ComfyUI-Sharp] [comfy-env] _from_shm got dict with keys: ['__type__', 'strategy', 'parent_pid', 'fd', 'storage_size']
|
||
[09:02] [ComfyUI] [worker:ComfyUI-Sharp] [comfy-env] DESERIALIZE TensorRef: tensor_size=[42, 3, 3]
|
||
[09:02] [ComfyUI] [worker:ComfyUI-Sharp] [comfy-env] DESERIALIZED tensor shape: torch.Size([42, 3, 3])
|
||
[09:02] [ComfyUI] [worker:ComfyUI-Sharp] [comfy-env] _from_shm got dict with keys: ['__type__', 'strategy', 'parent_pid', 'fd', 'storage_size']
|
||
[09:02] [ComfyUI] [worker:ComfyUI-Sharp] [comfy-env] DESERIALIZE TensorRef: tensor_size=[42, 1536, 1536]
|
||
[09:02] [ComfyUI] [worker:ComfyUI-Sharp] [comfy-env] DESERIALIZED tensor shape: torch.Size([42, 1536, 1536])
|
||
[09:03] Frame 34 saved (frame_033.jpg, t=238.4s)
|
||
[09:03] [capture-periodic] freeze=1ms shot=107ms unfreeze=7ms saved=True
|
||
[09:05] [capture-loop] iter=2200 t=240.5s state={'complete': False, 'error': None, 'executedCount': 4, 'wsState': 1} eval_ms=1 ram=24.6/31.3GB (79%) swap=2.2/32.0GB (7%) cpu=14% browser_rss=1.19GB
|
||
[09:06] [ComfyUI] [worker:ComfyUI-Sharp] [LoadSharpModel] loading checkpoint from /workspaces/Sharp-2000/ComfyUI/models/sharp/sharp_2572gikvuh.pt (dtype=bf16)
|
||
[09:09] [ComfyUI] [worker:ComfyUI-Sharp] [LoadSharpModel] initializing model on meta device...
|
||
[09:09] [ComfyUI] [worker:ComfyUI-Sharp] [LoadSharpModel] model ready (torch.bfloat16)
|
||
[09:10] [ComfyUI] [worker:ComfyUI-Sharp] [SharpPredictGaussiansFromMetricDepth] metric_depth_layer1 unwired -> layer 1 will duplicate layer 0 (legacy behavior)
|
||
[09:10] [ComfyUI] [SubprocessWorker] callback 'request_vram_budget' from call_id=3
|
||
[09:10] [ComfyUI] [comfy-env] VRAM request: 2.81GB, free before eviction: 18.34GB
|
||
[09:10] [ComfyUI] [comfy-env] VRAM after eviction: 18.34GB
|
||
[09:10] [ComfyUI] [worker:ComfyUI-Sharp] [VRAM] +539MB (now 539MB) reserved=544MB peak=539MB
|
||
[09:10] [ComfyUI] [worker:ComfyUI-Sharp] [SharpPredictGaussiansFromMetricDepth] face 1/42: 1536×1536, extrinsics=[-0.00, -0.00, -0.00], intrinsics=fx=0.5000 cx=0.5000, mask=yes, snap=none, depth_conv=planar_z
|
||
[09:11] [ComfyUI] [worker:ComfyUI-Sharp] [VRAM] +2739MB (now 3278MB) reserved=3424MB peak=3359MB
|
||
[09:11] [capture-loop] iter=2250 t=245.9s state={'complete': False, 'error': None, 'executedCount': 4, 'wsState': 1} eval_ms=2 ram=22.3/31.3GB (71%) swap=4.2/32.0GB (13%) cpu=16% browser_rss=1.05GB
|
||
[09:12] [ComfyUI] [worker:ComfyUI-Sharp] [VRAM] +332MB (now 3610MB) reserved=3744MB peak=3610MB
|
||
[09:13] [ComfyUI] [worker:ComfyUI-Sharp] [VRAM] +562MB (now 4173MB) reserved=8864MB peak=7062MB
|
||
[09:13] [ComfyUI] [worker:ComfyUI-Sharp] [SharpPredictGaussiansFromMetricDepth] detected normalized intrinsics (fx<2); rescaled to pixel-K for 1536x1536: fx=768.0 cx=768.0
|
||
[09:14] [ComfyUI] [worker:ComfyUI-Sharp] [VRAM] +564MB (now 4737MB) reserved=6784MB peak=7062MB
|
||
[09:15] [ComfyUI] [worker:ComfyUI-Sharp] [SharpPredictGaussiansFromMetricDepth] mask -> kept 89266/1179648 gaussians (7.6%)
|
||
[09:15] [ComfyUI] [SubprocessWorker] callback 'report_progress' from call_id=3
|
||
[09:15] [ComfyUI] [worker:ComfyUI-Sharp] [SharpPredictGaussiansFromMetricDepth] face 2/42: 1536×1536, extrinsics=[-0.00, -0.00, -0.00], intrinsics=fx=0.5000 cx=0.5000, mask=yes, snap=none, depth_conv=planar_z
|
||
[09:15] [ComfyUI] [worker:ComfyUI-Sharp] [VRAM] +461MB (now 5199MB) reserved=6784MB peak=7062MB
|
||
[09:16] [capture-loop] iter=2300 t=251.3s state={'complete': False, 'error': None, 'executedCount': 4, 'wsState': 1} eval_ms=1 ram=24.7/31.3GB (79%) swap=4.5/32.0GB (14%) cpu=12% browser_rss=1.05GB
|
||
[09:16] Frame 35 saved (frame_034.jpg, t=251.4s)
|
||
[09:16] [capture-periodic] freeze=1ms shot=98ms unfreeze=4ms saved=True
|
||
[09:16] [ComfyUI] [worker:ComfyUI-Sharp] [VRAM] +345MB (now 5544MB) reserved=5984MB peak=7062MB
|
||
[09:17] [ComfyUI] [worker:ComfyUI-Sharp] [VRAM] -954MB (now 4590MB) reserved=11296MB peak=7062MB
|
||
[09:20] [ComfyUI] [SubprocessWorker] callback 'report_progress' from call_id=3
|
||
[09:20] [ComfyUI] [worker:ComfyUI-Sharp] [SharpPredictGaussiansFromMetricDepth] face 3/42: 1536×1536, extrinsics=[-0.00, -0.00, -0.00], intrinsics=fx=0.5000 cx=0.5000, mask=yes, snap=none, depth_conv=planar_z
|
||
[09:20] [ComfyUI] [worker:ComfyUI-Sharp] [VRAM] +520MB (now 5110MB) reserved=7520MB peak=7062MB
|
||
[09:21] Frame 36 saved (frame_035.jpg, t=255.8s)
|
||
[09:21] [capture-periodic] freeze=1ms shot=100ms unfreeze=1ms saved=True
|
||
[09:21] [ComfyUI] [worker:ComfyUI-Sharp] [VRAM] +345MB (now 5456MB) reserved=6016MB peak=7062MB
|
||
[09:22] [capture-loop] iter=2350 t=256.8s state={'complete': False, 'error': None, 'executedCount': 4, 'wsState': 1} eval_ms=2 ram=22.9/31.3GB (73%) swap=6.8/32.0GB (21%) cpu=16% browser_rss=0.99GB
|
||
[09:22] [ComfyUI] [worker:ComfyUI-Sharp] [VRAM] -864MB (now 4592MB) reserved=11936MB peak=7062MB
|
||
[09:24] [ComfyUI] [SubprocessWorker] callback 'report_progress' from call_id=3
|
||
[09:24] [ComfyUI] [worker:ComfyUI-Sharp] [SharpPredictGaussiansFromMetricDepth] face 4/42: 1536×1536, extrinsics=[-0.00, -0.00, -0.00], intrinsics=fx=0.5000 cx=0.5000, mask=yes, snap=none, depth_conv=planar_z
|
||
[09:24] [ComfyUI] [worker:ComfyUI-Sharp] [VRAM] +514MB (now 5107MB) reserved=7584MB peak=7062MB
|
||
[09:25] Frame 37 saved (frame_036.jpg, t=260.1s)
|
||
[09:25] [capture-periodic] freeze=1ms shot=108ms unfreeze=4ms saved=True
|
||
[09:25] [ComfyUI] [worker:ComfyUI-Sharp] [VRAM] +345MB (now 5453MB) reserved=6208MB peak=7062MB
|
||
[09:26] [ComfyUI] [worker:ComfyUI-Sharp] [VRAM] -864MB (now 4589MB) reserved=11616MB peak=7062MB
|
||
[09:27] [capture-loop] iter=2400 t=262.2s state={'complete': False, 'error': None, 'executedCount': 4, 'wsState': 1} eval_ms=1 ram=22.7/31.3GB (72%) swap=7.0/32.0GB (22%) cpu=13% browser_rss=0.98GB
|
||
[09:28] [ComfyUI] [SubprocessWorker] callback 'report_progress' from call_id=3
|
||
[09:28] [ComfyUI] [worker:ComfyUI-Sharp] [SharpPredictGaussiansFromMetricDepth] face 5/42: 1536×1536, extrinsics=[-0.00, -0.00, -0.00], intrinsics=fx=0.5000 cx=0.5000, mask=yes, snap=none, depth_conv=planar_z
|
||
[09:28] [ComfyUI] [worker:ComfyUI-Sharp] [VRAM] +531MB (now 5121MB) reserved=7936MB peak=7062MB
|
||
[09:29] Frame 38 saved (frame_037.jpg, t=264.5s)
|
||
[09:29] [capture-periodic] freeze=1ms shot=103ms unfreeze=1ms saved=True
|
||
[09:29] [ComfyUI] [worker:ComfyUI-Sharp] [VRAM] -528MB (now 4593MB) reserved=11616MB peak=7062MB
|
||
[09:32] [ComfyUI] [SubprocessWorker] callback 'report_progress' from call_id=3
|
||
[09:32] [ComfyUI] [worker:ComfyUI-Sharp] [SharpPredictGaussiansFromMetricDepth] face 6/42: 1536×1536, extrinsics=[-0.00, -0.00, -0.00], intrinsics=fx=0.5000 cx=0.5000, mask=yes, snap=none, depth_conv=planar_z
|
||
[09:32] [ComfyUI] [worker:ComfyUI-Sharp] [VRAM] +559MB (now 5153MB) reserved=7680MB peak=7062MB
|
||
[09:33] [capture-loop] iter=2450 t=267.7s state={'complete': False, 'error': None, 'executedCount': 4, 'wsState': 1} eval_ms=1 ram=22.4/31.3GB (72%) swap=7.2/32.0GB (22%) cpu=13% browser_rss=0.97GB
|
||
[09:33] [ComfyUI] [worker:ComfyUI-Sharp] [VRAM] -564MB (now 4590MB) reserved=11552MB peak=7062MB
|
||
[09:34] Frame 39 saved (frame_038.jpg, t=268.8s)
|
||
[09:34] [capture-periodic] freeze=1ms shot=93ms unfreeze=3ms saved=True
|
||
[09:36] [ComfyUI] [SubprocessWorker] callback 'report_progress' from call_id=3
|
||
[09:36] [ComfyUI] [worker:ComfyUI-Sharp] [SharpPredictGaussiansFromMetricDepth] face 7/42: 1536×1536, extrinsics=[-0.00, -0.00, -0.00], intrinsics=fx=0.5000 cx=0.5000, mask=yes, snap=none, depth_conv=planar_z
|
||
[09:36] [ComfyUI] [worker:ComfyUI-Sharp] [VRAM] +507MB (now 5097MB) reserved=7584MB peak=7062MB
|
||
[09:38] [ComfyUI] [worker:ComfyUI-Sharp] [VRAM] -510MB (now 4588MB) reserved=11488MB peak=7062MB
|
||
[09:38] [capture-loop] iter=2500 t=273.1s state={'complete': False, 'error': None, 'executedCount': 4, 'wsState': 1} eval_ms=1 ram=22.7/31.3GB (73%) swap=7.2/32.0GB (22%) cpu=11% browser_rss=0.97GB
|
||
[09:38] Frame 40 saved (frame_039.jpg, t=273.2s)
|
||
[09:38] [capture-periodic] freeze=1ms shot=109ms unfreeze=1ms saved=True
|
||
[09:40] [ComfyUI] [SubprocessWorker] callback 'report_progress' from call_id=3
|
||
[09:40] [ComfyUI] [worker:ComfyUI-Sharp] [SharpPredictGaussiansFromMetricDepth] face 8/42: 1536×1536, extrinsics=[-0.00, -0.00, -0.00], intrinsics=fx=0.5000 cx=0.5000, mask=yes, snap=none, depth_conv=planar_z
|
||
[09:40] [ComfyUI] [worker:ComfyUI-Sharp] [VRAM] +538MB (now 5127MB) reserved=7680MB peak=7062MB
|
||
[09:40] Frame 41 saved (frame_040.jpg, t=275.4s)
|
||
[09:40] [capture-periodic] freeze=1ms shot=109ms unfreeze=3ms saved=True
|
||
[09:42] [ComfyUI] [worker:ComfyUI-Sharp] [VRAM] -537MB (now 4591MB) reserved=10080MB peak=7062MB
|
||
[09:43] [capture-loop] iter=2550 t=278.6s state={'complete': False, 'error': None, 'executedCount': 4, 'wsState': 1} eval_ms=1 ram=22.3/31.3GB (71%) swap=7.3/32.0GB (23%) cpu=12% browser_rss=0.97GB
|
||
[09:44] [ComfyUI] [SubprocessWorker] callback 'report_progress' from call_id=3
|
||
[09:44] [ComfyUI] [worker:ComfyUI-Sharp] [SharpPredictGaussiansFromMetricDepth] face 9/42: 1536×1536, extrinsics=[-0.00, -0.00, -0.00], intrinsics=fx=0.5000 cx=0.5000, mask=yes, snap=none, depth_conv=planar_z
|
||
[09:44] [ComfyUI] [worker:ComfyUI-Sharp] [VRAM] +511MB (now 5102MB) reserved=7392MB peak=7062MB
|
||
[09:45] Frame 42 saved (frame_041.jpg, t=279.7s)
|
||
[09:45] [capture-periodic] freeze=1ms shot=104ms unfreeze=5ms saved=True
|
||
[09:46] [ComfyUI] [worker:ComfyUI-Sharp] [VRAM] -510MB (now 4593MB) reserved=12192MB peak=7062MB
|
||
[09:48] [ComfyUI] [SubprocessWorker] callback 'report_progress' from call_id=3
|
||
[09:48] [ComfyUI] [worker:ComfyUI-Sharp] [SharpPredictGaussiansFromMetricDepth] face 10/42: 1536×1536, extrinsics=[-0.00, -0.00, -0.00], intrinsics=fx=0.5000 cx=0.5000, mask=yes, snap=none, depth_conv=planar_z
|
||
[09:48] [ComfyUI] [worker:ComfyUI-Sharp] [VRAM] +580MB (now 5173MB) reserved=7712MB peak=7062MB
|
||
[09:49] [capture-loop] iter=2600 t=283.9s state={'complete': False, 'error': None, 'executedCount': 4, 'wsState': 1} eval_ms=1 ram=22.6/31.3GB (72%) swap=7.3/32.0GB (23%) cpu=11% browser_rss=0.98GB
|
||
[09:49] Frame 43 saved (frame_042.jpg, t=284.1s)
|
||
[09:49] [capture-periodic] freeze=1ms shot=97ms unfreeze=1ms saved=True
|
||
[09:50] [ComfyUI] [worker:ComfyUI-Sharp] [VRAM] -582MB (now 4592MB) reserved=12224MB peak=7062MB
|
||
[09:52] [ComfyUI] [SubprocessWorker] callback 'report_progress' from call_id=3
|
||
[09:52] [ComfyUI] [worker:ComfyUI-Sharp] [SharpPredictGaussiansFromMetricDepth] face 11/42: 1536×1536, extrinsics=[-0.00, -0.00, -0.00], intrinsics=fx=0.5000 cx=0.5000, mask=yes, snap=none, depth_conv=planar_z
|
||
[09:52] [ComfyUI] [worker:ComfyUI-Sharp] [VRAM] +578MB (now 5170MB) reserved=7872MB peak=7062MB
|
||
[09:53] Frame 44 saved (frame_043.jpg, t=288.4s)
|
||
[09:53] [capture-periodic] freeze=1ms shot=108ms unfreeze=1ms saved=True
|
||
[09:54] [ComfyUI] [worker:ComfyUI-Sharp] [VRAM] -582MB (now 4589MB) reserved=11552MB peak=7062MB
|
||
[09:54] [capture-loop] iter=2650 t=289.5s state={'complete': False, 'error': None, 'executedCount': 4, 'wsState': 1} eval_ms=1 ram=23.0/31.3GB (74%) swap=7.3/32.0GB (23%) cpu=13% browser_rss=0.98GB
|
||
[09:56] [ComfyUI] [SubprocessWorker] callback 'report_progress' from call_id=3
|
||
[09:56] [ComfyUI] [worker:ComfyUI-Sharp] [SharpPredictGaussiansFromMetricDepth] face 12/42: 1536×1536, extrinsics=[-0.00, -0.00, -0.00], intrinsics=fx=0.5000 cx=0.5000, mask=yes, snap=none, depth_conv=planar_z
|
||
[09:57] [ComfyUI] [worker:ComfyUI-Sharp] [VRAM] +582MB (now 5171MB) reserved=7744MB peak=7062MB
|
||
[09:57] [ComfyUI] [worker:ComfyUI-Sharp]
|
||
[09:57] [ComfyUI] === WATCHDOG TICK 1 ===
|
||
[09:57] [ComfyUI] [worker:ComfyUI-Sharp] Thread 0x0000715eed1ff640 (most recent call first):
|
||
[09:57] [ComfyUI] File "/tmp/comfytest-home/.ce/.pixi/envs/sharp-nodes/lib/python3.10/socket.py", line 293 in accept
|
||
[09:57] [ComfyUI] File "/tmp/comfytest-home/.ce/.pixi/envs/sharp-nodes/lib/python3.10/multiprocessing/connection.py", line 609 in accept
|
||
[09:57] [ComfyUI] File "/tmp/comfytest-home/.ce/.pixi/envs/sharp-nodes/lib/python3.10/multiprocessing/connection.py", line 463 in accept
|
||
[09:57] [ComfyUI] File "/tmp/comfytest-home/.ce/.pixi/envs/sharp-nodes/lib/python3.10/multiprocessing/resource_sharer.py", line 138 in _serve
|
||
[09:57] [ComfyUI] File "/tmp/comfytest-home/.ce/.pixi/envs/sharp-nodes/lib/python3.10/threading.py", line 953 in run
|
||
[09:57] [ComfyUI] File "/tmp/comfytest-home/.ce/.pixi/envs/sharp-nodes/lib/python3.10/threading.py", line 1016 in _bootstrap_inner
|
||
[09:57] [ComfyUI] File "/tmp/comfytest-home/.ce/.pixi/envs/sharp-nodes/lib/python3.10/threading.py", line 973 in _bootstrap
|
||
[09:57] [ComfyUI]
|
||
[09:57] [ComfyUI] Thread 0x00007160a0cb5640 (most recent call first):
|
||
[09:57] [ComfyUI] File "/tmp/comfyui_pvenv_dtk9es_f/persistent_worker.py", line 106 in _vram_poller
|
||
[09:57] [ComfyUI] File "/tmp/comfytest-home/.ce/.pixi/envs/sharp-nodes/lib/python3.10/threading.py", line 953 in run
|
||
[09:57] [ComfyUI] File "/tmp/comfytest-home/.ce/.pixi/envs/sharp-nodes/lib/python3.10/threading.py", line 1016 in _bootstrap_inner
|
||
[09:57] [ComfyUI] File "/tmp/comfytest-home/.ce/.pixi/envs/sharp-nodes/lib/python3.10/threading.py", line 973 in _bootstrap
|
||
[09:57] [ComfyUI]
|
||
[09:57] [ComfyUI] Current thread 0x00007160a14b6640 (most recent call first):
|
||
[09:57] [ComfyUI] File "/tmp/comfyui_pvenv_dtk9es_f/persistent_worker.py", line 52 in _watchdog
|
||
[09:57] [ComfyUI] File "/tmp/comfytest-home/.ce/.pixi/envs/sharp-nodes/lib/python3.10/threading.py", line 953 in run
|
||
[09:57] [ComfyUI] File "/tmp/comfytest-home/.ce/.pixi/envs/sharp-nodes/lib/python3.10/threading.py", line 1016 in _bootstrap_inner
|
||
[09:57] [ComfyUI] File "/tmp/comfytest-home/.ce/.pixi/envs/sharp-nodes/lib/python3.10/threading.py", line 973 in _bootstrap
|
||
[09:57] [ComfyUI]
|
||
[09:57] [ComfyUI] Thread 0x00007160a1a8c740 (most recent call first):
|
||
[09:57] [ComfyUI] File "/tmp/comfytest-home/.ce/.pixi/envs/sharp-nodes/lib/python3.10/site-packages/torch/nn/modules/linear.py", line 134 in forward
|
||
[09:57] [ComfyUI] File "/workspaces/Sharp-2000/ComfyUI/comfy/ops.py", line 503 in forward
|
||
[09:57] [ComfyUI] File "/tmp/comfytest-home/.ce/.pixi/envs/sharp-nodes/lib/python3.10/site-packages/torch/nn/modules/module.py", line 1787 in _call_impl
|
||
[09:57] [ComfyUI] File "/tmp/comfytest-home/.ce/.pixi/envs/sharp-nodes/lib/python3.10/site-packages/torch/nn/modules/module.py", line 1776 in _wrapped_call_impl
|
||
[09:57] [ComfyUI] File "/workspaces/Sharp-2000/ComfyUI/custom_nodes/ComfyUI-Sharp/nodes/sharp/model.py", line 268 in forward
|
||
[09:57] [ComfyUI] File "/tmp/comfytest-home/.ce/.pixi/envs/sharp-nodes/lib/python3.10/site-packages/torch/nn/modules/module.py", line 1787 in _call_impl
|
||
[09:57] [ComfyUI] File "/tmp/comfytest-home/.ce/.pixi/envs/sharp-nodes/lib/python3.10/site-packages/torch/nn/modules/module.py", line 1776 in _wrapped_call_impl
|
||
[09:57] [ComfyUI] File "/workspaces/Sharp-2000/ComfyUI/custom_nodes/ComfyUI-Sharp/nodes/sharp/model.py", line 310 in forward
|
||
[09:57] [ComfyUI] File "/tmp/comfytest-home/.ce/.pixi/envs/sharp-nodes/lib/python3.10/site-packages/torch/nn/modules/module.py", line 1787 in _call_impl
|
||
[09:57] [ComfyUI] File "/tmp/comfytest-home/.ce/.pixi/envs/sharp-nodes/lib/python3.10/site-packages/torch/nn/modules/module.py", line 1776 in _wrapped_call_impl
|
||
[09:57] [ComfyUI] File "/workspaces/Sharp-2000/ComfyUI/custom_nodes/ComfyUI-Sharp/nodes/sharp/model.py", line 412 in forward
|
||
[09:57] [ComfyUI] File "/tmp/comfytest-home/.ce/.pixi/envs/sharp-nodes/lib/python3.10/site-packages/torch/nn/modules/module.py", line 1787 in _call_impl
|
||
[09:57] [ComfyUI] File "/tmp/comfytest-home/.ce/.pixi/envs/sharp-nodes/lib/python3.10/site-packages/torch/nn/modules/module.py", line 1776 in _wrapped_call_impl
|
||
[09:57] [ComfyUI] File "/workspaces/Sharp-2000/ComfyUI/custom_nodes/ComfyUI-Sharp/nodes/sharp/model.py", line 685 in forward
|
||
[09:57] [ComfyUI] File "/tmp/comfytest-home/.ce/.pixi/envs/sharp-nodes/lib/python3.10/site-packages/torch/nn/modules/module.py", line 1787 in _call_impl
|
||
[09:57] [ComfyUI] File "/tmp/comfytest-home/.ce/.pixi/envs/sharp-nodes/lib/python3.10/site-packages/torch/nn/modules/module.py", line 1776 in _wrapped_call_impl
|
||
[09:57] [ComfyUI] File "/workspaces/Sharp-2000/ComfyUI/custom_nodes/ComfyUI-Sharp/nodes/sharp/model.py", line 1109 in forward
|
||
[09:57] [ComfyUI] File "/tmp/comfytest-home/.ce/.pixi/envs/sharp-nodes/lib/python3.10/site-packages/torch/nn/modules/module.py", line 1787 in _call_impl
|
||
[09:57] [ComfyUI] File "/tmp/comfytest-home/.ce/.pixi/envs/sharp-nodes/lib/python3.10/site-packages/torch/nn/modules/module.py", line 1776 in _wrapped_call_impl
|
||
[09:57] [ComfyUI] File "/workspaces/Sharp-2000/ComfyUI/custom_nodes/ComfyUI-Sharp/nodes/sharp/model.py", line 2006 in encode
|
||
[09:57] [ComfyUI] File "/workspaces/Sharp-2000/ComfyUI/custom_nodes/ComfyUI-Sharp/nodes/predict_gaussians_from_depth.py", line 392 in execute
|
||
[09:57] [ComfyUI] File "/tmp/comfytest-home/.ce/.pixi/envs/sharp-nodes/lib/python3.10/site-packages/torch/utils/_contextlib.py", line 124 in decorate_context
|
||
[09:57] [ComfyUI] File "/workspaces/Sharp-2000/ComfyUI/comfy_api/latest/_io.py", line 1892 in EXECUTE_NORMALIZED
|
||
[09:57] [ComfyUI] File "/tmp/comfyui_pvenv_dtk9es_f/persistent_worker.py", line 1762 in main
|
||
[09:57] [ComfyUI] File "/tmp/comfyui_pvenv_dtk9es_f/persistent_worker.py", line 1807 in <module>
|
||
[09:57] [ComfyUI]
|
||
[09:57] [ComfyUI] [worker:ComfyUI-Sharp] === END ===
|
||
[09:57] [ComfyUI]
|
||
[09:58] Frame 45 saved (frame_044.jpg, t=292.7s)
|
||
[09:58] [capture-periodic] freeze=1ms shot=103ms unfreeze=5ms saved=True
|
||
[09:58] [ComfyUI] [worker:ComfyUI-Sharp] [VRAM] -582MB (now 4590MB) reserved=10144MB peak=7062MB
|
||
[10:00] [capture-loop] iter=2700 t=294.8s state={'complete': False, 'error': None, 'executedCount': 4, 'wsState': 1} eval_ms=1 ram=22.7/31.3GB (73%) swap=7.3/32.0GB (23%) cpu=11% browser_rss=0.98GB
|
||
[10:01] [ComfyUI] [SubprocessWorker] callback 'report_progress' from call_id=3
|
||
[10:01] [ComfyUI] [worker:ComfyUI-Sharp] [SharpPredictGaussiansFromMetricDepth] face 13/42: 1536×1536, extrinsics=[-0.00, -0.00, -0.00], intrinsics=fx=0.5000 cx=0.5000, mask=yes, snap=none, depth_conv=planar_z
|
||
[10:01] [ComfyUI] [worker:ComfyUI-Sharp] [VRAM] +618MB (now 5209MB) reserved=7648MB peak=7062MB
|
||
[10:02] Frame 46 saved (frame_045.jpg, t=297.1s)
|
||
[10:02] [capture-periodic] freeze=1ms shot=101ms unfreeze=5ms saved=True
|
||
[10:02] [ComfyUI] [worker:ComfyUI-Sharp] [VRAM] -618MB (now 4592MB) reserved=11648MB peak=7062MB
|
||
[10:05] [ComfyUI] [SubprocessWorker] callback 'report_progress' from call_id=3
|
||
[10:05] [ComfyUI] [worker:ComfyUI-Sharp] [SharpPredictGaussiansFromMetricDepth] face 14/42: 1536×1536, extrinsics=[-0.00, -0.00, -0.00], intrinsics=fx=0.5000 cx=0.5000, mask=yes, snap=none, depth_conv=planar_z
|
||
[10:05] [ComfyUI] [worker:ComfyUI-Sharp] [VRAM] +574MB (now 5166MB) reserved=7872MB peak=7062MB
|
||
[10:05] [capture-loop] iter=2750 t=300.3s state={'complete': False, 'error': None, 'executedCount': 4, 'wsState': 1} eval_ms=1 ram=22.2/31.3GB (71%) swap=7.5/32.0GB (23%) cpu=12% browser_rss=0.98GB
|
||
[10:06] [ComfyUI] [worker:ComfyUI-Sharp] [VRAM] -573MB (now 4594MB) reserved=10688MB peak=7062MB
|
||
[10:06] Frame 47 saved (frame_046.jpg, t=301.4s)
|
||
[10:06] [capture-periodic] freeze=1ms shot=95ms unfreeze=5ms saved=True
|
||
[10:09] [ComfyUI] [SubprocessWorker] callback 'report_progress' from call_id=3
|
||
[10:09] [ComfyUI] [worker:ComfyUI-Sharp] [SharpPredictGaussiansFromMetricDepth] face 15/42: 1536×1536, extrinsics=[-0.00, -0.00, -0.00], intrinsics=fx=0.5000 cx=0.5000, mask=yes, snap=none, depth_conv=planar_z
|
||
[10:09] [ComfyUI] [worker:ComfyUI-Sharp] [VRAM] +554MB (now 5149MB) reserved=7296MB peak=7062MB
|
||
[10:10] [ComfyUI] [worker:ComfyUI-Sharp] [VRAM] -555MB (now 4595MB) reserved=11584MB peak=7062MB
|
||
[10:10] [capture-loop] iter=2800 t=305.6s state={'complete': False, 'error': None, 'executedCount': 4, 'wsState': 1} eval_ms=1 ram=22.4/31.3GB (72%) swap=7.5/32.0GB (23%) cpu=11% browser_rss=0.99GB
|
||
[10:11] Frame 48 saved (frame_047.jpg, t=305.8s)
|
||
[10:11] [capture-periodic] freeze=1ms shot=97ms unfreeze=6ms saved=True
|
||
[10:13] [ComfyUI] [SubprocessWorker] callback 'report_progress' from call_id=3
|
||
[10:13] [ComfyUI] [worker:ComfyUI-Sharp] [SharpPredictGaussiansFromMetricDepth] face 16/42: 1536×1536, extrinsics=[-0.00, -0.00, -0.00], intrinsics=fx=0.5000 cx=0.5000, mask=yes, snap=none, depth_conv=planar_z
|
||
[10:13] [ComfyUI] [worker:ComfyUI-Sharp] [VRAM] +508MB (now 5104MB) reserved=7616MB peak=7062MB
|
||
[10:15] [ComfyUI] [worker:ComfyUI-Sharp] [VRAM] -510MB (now 4595MB) reserved=11584MB peak=7062MB
|
||
[10:15] Frame 49 saved (frame_048.jpg, t=310.1s)
|
||
[10:15] [capture-periodic] freeze=1ms shot=102ms unfreeze=6ms saved=True
|
||
[10:16] [capture-loop] iter=2850 t=311.2s state={'complete': False, 'error': None, 'executedCount': 4, 'wsState': 1} eval_ms=1 ram=24.7/31.3GB (79%) swap=7.5/32.0GB (23%) cpu=12% browser_rss=0.98GB
|
||
[10:17] [ComfyUI] [SubprocessWorker] callback 'report_progress' from call_id=3
|
||
[10:17] [ComfyUI] [worker:ComfyUI-Sharp] [SharpPredictGaussiansFromMetricDepth] face 17/42: 1536×1536, extrinsics=[-0.00, -0.00, -0.00], intrinsics=fx=0.5000 cx=0.5000, mask=yes, snap=none, depth_conv=planar_z
|
||
[10:17] [ComfyUI] [worker:ComfyUI-Sharp] [VRAM] +549MB (now 5144MB) reserved=7360MB peak=7062MB
|
||
[10:17] Frame 50 saved (frame_049.jpg, t=312.3s)
|
||
[10:17] [capture-periodic] freeze=1ms shot=103ms unfreeze=3ms saved=True
|
||
[10:19] [ComfyUI] [worker:ComfyUI-Sharp] [VRAM] +309MB (now 5453MB) reserved=6176MB peak=7062MB
|
||
[10:20] [ComfyUI] [worker:ComfyUI-Sharp] [VRAM] -864MB (now 4589MB) reserved=11616MB peak=7062MB
|
||
[10:21] [ComfyUI] [SubprocessWorker] callback 'report_progress' from call_id=3
|
||
[10:21] [ComfyUI] [worker:ComfyUI-Sharp] [SharpPredictGaussiansFromMetricDepth] face 18/42: 1536×1536, extrinsics=[-0.00, -0.00, -0.00], intrinsics=fx=0.5000 cx=0.5000, mask=yes, snap=none, depth_conv=planar_z
|
||
[10:21] [ComfyUI] [worker:ComfyUI-Sharp] [VRAM] +526MB (now 5116MB) reserved=7392MB peak=7062MB
|
||
[10:21] [capture-loop] iter=2900 t=316.5s state={'complete': False, 'error': None, 'executedCount': 4, 'wsState': 1} eval_ms=1 ram=22.3/31.3GB (71%) swap=7.7/32.0GB (24%) cpu=11% browser_rss=0.98GB
|
||
[10:22] Frame 51 saved (frame_050.jpg, t=316.6s)
|
||
[10:22] [capture-periodic] freeze=1ms shot=103ms unfreeze=3ms saved=True
|
||
[10:23] [ComfyUI] [worker:ComfyUI-Sharp] [VRAM] +336MB (now 5453MB) reserved=6080MB peak=7062MB
|
||
[10:24] [ComfyUI] [worker:ComfyUI-Sharp] [VRAM] -864MB (now 4589MB) reserved=10080MB peak=7062MB
|
||
[10:25] [ComfyUI] [SubprocessWorker] callback 'report_progress' from call_id=3
|
||
[10:25] [ComfyUI] [worker:ComfyUI-Sharp] [SharpPredictGaussiansFromMetricDepth] face 19/42: 1536×1536, extrinsics=[-0.00, -0.00, -0.00], intrinsics=fx=0.5000 cx=0.5000, mask=yes, snap=none, depth_conv=planar_z
|
||
[10:25] [ComfyUI] [worker:ComfyUI-Sharp] [VRAM] +562MB (now 5152MB) reserved=7680MB peak=7062MB
|
||
[10:26] Frame 52 saved (frame_051.jpg, t=321.0s)
|
||
[10:26] [capture-periodic] freeze=1ms shot=102ms unfreeze=1ms saved=True
|
||
[10:27] [ComfyUI] [worker:ComfyUI-Sharp] [VRAM] +300MB (now 5453MB) reserved=6144MB peak=7062MB
|
||
[10:27] [capture-loop] iter=2950 t=322.0s state={'complete': False, 'error': None, 'executedCount': 4, 'wsState': 1} eval_ms=1 ram=22.5/31.3GB (72%) swap=7.7/32.0GB (24%) cpu=11% browser_rss=0.99GB
|
||
[10:28] [ComfyUI] [worker:ComfyUI-Sharp] [VRAM] -864MB (now 4589MB) reserved=10176MB peak=7062MB
|
||
[10:29] [ComfyUI] [SubprocessWorker] callback 'report_progress' from call_id=3
|
||
[10:29] [ComfyUI] [worker:ComfyUI-Sharp] [SharpPredictGaussiansFromMetricDepth] face 20/42: 1536×1536, extrinsics=[-0.00, -0.00, -0.00], intrinsics=fx=0.5000 cx=0.5000, mask=yes, snap=none, depth_conv=planar_z
|
||
[10:29] [ComfyUI] [worker:ComfyUI-Sharp] [VRAM] +527MB (now 5116MB) reserved=7872MB peak=7062MB
|
||
[10:30] Frame 53 saved (frame_052.jpg, t=325.3s)
|
||
[10:30] [capture-periodic] freeze=1ms shot=101ms unfreeze=1ms saved=True
|
||
[10:31] [ComfyUI] [worker:ComfyUI-Sharp] [VRAM] -285MB (now 4831MB) reserved=5440MB peak=7062MB
|
||
[10:32] [ComfyUI] [worker:ComfyUI-Sharp] [VRAM] -243MB (now 4589MB) reserved=10528MB peak=7062MB
|
||
[10:32] [capture-loop] iter=3000 t=327.4s state={'complete': False, 'error': None, 'executedCount': 4, 'wsState': 1} eval_ms=1 ram=24.3/31.3GB (78%) swap=7.7/32.0GB (24%) cpu=12% browser_rss=0.99GB
|
||
[10:33] [ComfyUI] [SubprocessWorker] callback 'report_progress' from call_id=3
|
||
[10:33] [ComfyUI] [worker:ComfyUI-Sharp] [SharpPredictGaussiansFromMetricDepth] face 21/42: 1536×1536, extrinsics=[-0.00, -0.00, -0.00], intrinsics=fx=0.5000 cx=0.5000, mask=yes, snap=none, depth_conv=planar_z
|
||
[10:33] [ComfyUI] [worker:ComfyUI-Sharp] [VRAM] +617MB (now 5206MB) reserved=7392MB peak=7062MB
|
||
[10:35] Frame 54 saved (frame_053.jpg, t=329.7s)
|
||
[10:35] [capture-periodic] freeze=1ms shot=99ms unfreeze=1ms saved=True
|
||
[10:35] [ComfyUI] [worker:ComfyUI-Sharp] [VRAM] +246MB (now 5453MB) reserved=5824MB peak=7062MB
|
||
[10:36] [ComfyUI] [worker:ComfyUI-Sharp] [VRAM] -864MB (now 4589MB) reserved=11616MB peak=7062MB
|
||
[10:38] [ComfyUI] [SubprocessWorker] callback 'report_progress' from call_id=3
|
||
[10:38] [ComfyUI] [worker:ComfyUI-Sharp] [SharpPredictGaussiansFromMetricDepth] face 22/42: 1536×1536, extrinsics=[-0.00, -0.00, -0.00], intrinsics=fx=0.5000 cx=0.5000, mask=yes, snap=none, depth_conv=planar_z
|
||
[10:38] [ComfyUI] [worker:ComfyUI-Sharp] [VRAM] +582MB (now 5171MB) reserved=7648MB peak=7062MB
|
||
[10:38] [capture-loop] iter=3050 t=332.9s state={'complete': False, 'error': None, 'executedCount': 4, 'wsState': 1} eval_ms=2 ram=22.5/31.3GB (72%) swap=7.7/32.0GB (24%) cpu=12% browser_rss=0.99GB
|
||
[10:39] Frame 55 saved (frame_054.jpg, t=334.0s)
|
||
[10:39] [capture-periodic] freeze=1ms shot=94ms unfreeze=4ms saved=True
|
||
[10:39] [ComfyUI] [worker:ComfyUI-Sharp] [VRAM] -582MB (now 4590MB) reserved=10112MB peak=7062MB
|
||
[10:42] [ComfyUI] [SubprocessWorker] callback 'report_progress' from call_id=3
|
||
[10:42] [ComfyUI] [worker:ComfyUI-Sharp] [SharpPredictGaussiansFromMetricDepth] face 23/42: 1536×1536, extrinsics=[-0.00, -0.00, -0.00], intrinsics=fx=0.5000 cx=0.5000, mask=yes, snap=none, depth_conv=planar_z
|
||
[10:42] [ComfyUI] [worker:ComfyUI-Sharp] [VRAM] +581MB (now 5171MB) reserved=7872MB peak=7062MB
|
||
[10:43] [capture-loop] iter=3100 t=338.3s state={'complete': False, 'error': None, 'executedCount': 4, 'wsState': 1} eval_ms=1 ram=22.4/31.3GB (72%) swap=7.7/32.0GB (24%) cpu=12% browser_rss=0.99GB
|
||
[10:43] Frame 56 saved (frame_055.jpg, t=338.4s)
|
||
[10:43] [capture-periodic] freeze=1ms shot=107ms unfreeze=3ms saved=True
|
||
[10:43] [ComfyUI] [worker:ComfyUI-Sharp] [VRAM] -582MB (now 4590MB) reserved=10080MB peak=7062MB
|
||
[10:46] [ComfyUI] [SubprocessWorker] callback 'report_progress' from call_id=3
|
||
[10:46] [ComfyUI] [worker:ComfyUI-Sharp] [SharpPredictGaussiansFromMetricDepth] face 24/42: 1536×1536, extrinsics=[-0.00, -0.00, -0.00], intrinsics=fx=0.5000 cx=0.5000, mask=yes, snap=none, depth_conv=planar_z
|
||
[10:46] [ComfyUI] [worker:ComfyUI-Sharp] [VRAM] +562MB (now 5153MB) reserved=7616MB peak=7062MB
|
||
[10:47] [ComfyUI] [worker:ComfyUI-Sharp] [VRAM] -564MB (now 4590MB) reserved=11584MB peak=7062MB
|
||
[10:48] Frame 57 saved (frame_056.jpg, t=342.7s)
|
||
[10:48] [capture-periodic] freeze=1ms shot=102ms unfreeze=6ms saved=True
|
||
[10:49] [capture-loop] iter=3150 t=343.8s state={'complete': False, 'error': None, 'executedCount': 4, 'wsState': 1} eval_ms=1 ram=24.0/31.3GB (77%) swap=7.7/32.0GB (24%) cpu=11% browser_rss=0.99GB
|
||
[10:50] [ComfyUI] [SubprocessWorker] callback 'report_progress' from call_id=3
|
||
[10:50] [ComfyUI] [worker:ComfyUI-Sharp] [SharpPredictGaussiansFromMetricDepth] face 25/42: 1536×1536, extrinsics=[-0.00, -0.00, -0.00], intrinsics=fx=0.5000 cx=0.5000, mask=yes, snap=none, depth_conv=planar_z
|
||
[10:50] [ComfyUI] [worker:ComfyUI-Sharp] [VRAM] +553MB (now 5143MB) reserved=7424MB peak=7062MB
|
||
[10:52] [ComfyUI] [worker:ComfyUI-Sharp] [VRAM] -555MB (now 4589MB) reserved=12192MB peak=7062MB
|
||
[10:52] Frame 58 saved (frame_057.jpg, t=347.1s)
|
||
[10:52] [capture-periodic] freeze=1ms shot=95ms unfreeze=7ms saved=True
|
||
[10:54] [capture-loop] iter=3200 t=349.2s state={'complete': False, 'error': None, 'executedCount': 4, 'wsState': 1} eval_ms=2 ram=22.6/31.3GB (72%) swap=7.7/32.0GB (24%) cpu=12% browser_rss=0.99GB
|
||
[10:54] [ComfyUI] [SubprocessWorker] callback 'report_progress' from call_id=3
|
||
[10:54] [ComfyUI] [worker:ComfyUI-Sharp] [SharpPredictGaussiansFromMetricDepth] face 26/42: 1536×1536, extrinsics=[-0.00, -0.00, -0.00], intrinsics=fx=0.5000 cx=0.5000, mask=yes, snap=none, depth_conv=planar_z
|
||
[10:54] [ComfyUI] [worker:ComfyUI-Sharp] [VRAM] +557MB (now 5147MB) reserved=8000MB peak=7062MB
|
||
[10:56] [ComfyUI] [worker:ComfyUI-Sharp] [VRAM] +309MB (now 5457MB) reserved=6272MB peak=7062MB
|
||
[10:56] Frame 59 saved (frame_058.jpg, t=351.4s)
|
||
[10:56] [capture-periodic] freeze=1ms shot=106ms unfreeze=1ms saved=True
|
||
[10:57] [ComfyUI] [worker:ComfyUI-Sharp]
|
||
[10:57] [ComfyUI] === WATCHDOG TICK 2 ===
|
||
[10:57] [ComfyUI] [worker:ComfyUI-Sharp] Thread 0x0000715eed1ff640 (most recent call first):
|
||
[10:57] [ComfyUI] File "/tmp/comfytest-home/.ce/.pixi/envs/sharp-nodes/lib/python3.10/socket.py", line 293 in accept
|
||
[10:57] [ComfyUI] File "/tmp/comfytest-home/.ce/.pixi/envs/sharp-nodes/lib/python3.10/multiprocessing/connection.py", line 609 in accept
|
||
[10:57] [ComfyUI] File "/tmp/comfytest-home/.ce/.pixi/envs/sharp-nodes/lib/python3.10/multiprocessing/connection.py", line 463 in accept
|
||
[10:57] [ComfyUI] File "/tmp/comfytest-home/.ce/.pixi/envs/sharp-nodes/lib/python3.10/multiprocessing/resource_sharer.py", line 138 in _serve
|
||
[10:57] [ComfyUI] File "/tmp/comfytest-home/.ce/.pixi/envs/sharp-nodes/lib/python3.10/threading.py", line 953 in run
|
||
[10:57] [ComfyUI] File "/tmp/comfytest-home/.ce/.pixi/envs/sharp-nodes/lib/python3.10/threading.py", line 1016 in _bootstrap_inner
|
||
[10:57] [ComfyUI] File "/tmp/comfytest-home/.ce/.pixi/envs/sharp-nodes/lib/python3.10/threading.py", line 973 in _bootstrap
|
||
[10:57] [ComfyUI]
|
||
[10:57] [ComfyUI] Thread 0x00007160a0cb5640 (most recent call first):
|
||
[10:57] [ComfyUI] File "/tmp/comfyui_pvenv_dtk9es_f/persistent_worker.py", line 106 in _vram_poller
|
||
[10:57] [ComfyUI] File "/tmp/comfytest-home/.ce/.pixi/envs/sharp-nodes/lib/python3.10/threading.py", line 953 in run
|
||
[10:57] [ComfyUI] File "/tmp/comfytest-home/.ce/.pixi/envs/sharp-nodes/lib/python3.10/threading.py", line 1016 in _bootstrap_inner
|
||
[10:57] [ComfyUI] File "/tmp/comfytest-home/.ce/.pixi/envs/sharp-nodes/lib/python3.10/threading.py", line 973 in _bootstrap
|
||
[10:57] [ComfyUI]
|
||
[10:57] [ComfyUI] Current thread 0x00007160a14b6640 (most recent call first):
|
||
[10:57] [ComfyUI] File "/tmp/comfyui_pvenv_dtk9es_f/persistent_worker.py", line 52 in _watchdog
|
||
[10:57] [ComfyUI] File "/tmp/comfytest-home/.ce/.pixi/envs/sharp-nodes/lib/python3.10/threading.py", line 953 in run
|
||
[10:57] [ComfyUI] File "/tmp/comfytest-home/.ce/.pixi/envs/sharp-nodes/lib/python3.10/threading.py", line 1016 in _bootstrap_inner
|
||
[10:57] [ComfyUI] File "/tmp/comfytest-home/.ce/.pixi/envs/sharp-nodes/lib/python3.10/threading.py", line 973 in _bootstrap
|
||
[10:57] [ComfyUI]
|
||
[10:57] [ComfyUI] Thread 0x00007160a1a8c740 (most recent call first):
|
||
[10:57] [ComfyUI] File "/workspaces/Sharp-2000/ComfyUI/custom_nodes/ComfyUI-Sharp/nodes/predict_gaussian_attrs.py", line 111 in _monodepth_to
|
||
[10:57] [ComfyUI] File "/workspaces/Sharp-2000/ComfyUI/custom_nodes/ComfyUI-Sharp/nodes/predict_gaussians_from_depth.py", line 394 in execute
|
||
[10:57] [ComfyUI] File "/tmp/comfytest-home/.ce/.pixi/envs/sharp-nodes/lib/python3.10/site-packages/torch/utils/_contextlib.py", line 124 in decorate_context
|
||
[10:57] [ComfyUI] File "/workspaces/Sharp-2000/ComfyUI/comfy_api/latest/_io.py", line 1892 in EXECUTE_NORMALIZED
|
||
[10:57] [ComfyUI] File "/tmp/comfyui_pvenv_dtk9es_f/persistent_worker.py", line 1762 in main
|
||
[10:57] [ComfyUI] File "/tmp/comfyui_pvenv_dtk9es_f/persistent_worker.py", line 1807 in <module>
|
||
[10:57] [ComfyUI]
|
||
[10:57] [ComfyUI] [worker:ComfyUI-Sharp] === END ===
|
||
[10:57] [ComfyUI]
|
||
[10:57] [ComfyUI] [worker:ComfyUI-Sharp] [VRAM] -864MB (now 4593MB) reserved=10688MB peak=7062MB
|
||
[10:58] [ComfyUI] [SubprocessWorker] callback 'report_progress' from call_id=3
|
||
[10:58] [ComfyUI] [worker:ComfyUI-Sharp] [SharpPredictGaussiansFromMetricDepth] face 27/42: 1536×1536, extrinsics=[-0.00, -0.00, -0.00], intrinsics=fx=0.5000 cx=0.5000, mask=yes, snap=none, depth_conv=planar_z
|
||
[10:58] [ComfyUI] [worker:ComfyUI-Sharp] [VRAM] +516MB (now 5109MB) reserved=7840MB peak=7062MB
|
||
[10:59] Frame 60 saved (frame_059.jpg, t=353.6s)
|
||
[10:59] [capture-periodic] freeze=1ms shot=93ms unfreeze=1ms saved=True
|
||
[10:59] [capture-loop] iter=3250 t=354.7s state={'complete': False, 'error': None, 'executedCount': 4, 'wsState': 1} eval_ms=1 ram=22.5/31.3GB (72%) swap=7.7/32.0GB (24%) cpu=13% browser_rss=0.99GB
|
||
[11:00] [ComfyUI] [worker:ComfyUI-Sharp] [VRAM] -519MB (now 4591MB) reserved=12160MB peak=7062MB
|
||
[11:02] [ComfyUI] [SubprocessWorker] callback 'report_progress' from call_id=3
|
||
[11:02] [ComfyUI] [worker:ComfyUI-Sharp] [SharpPredictGaussiansFromMetricDepth] face 28/42: 1536×1536, extrinsics=[-0.00, -0.00, -0.00], intrinsics=fx=0.5000 cx=0.5000, mask=yes, snap=none, depth_conv=planar_z
|
||
[11:02] [ComfyUI] [worker:ComfyUI-Sharp] [VRAM] +557MB (now 5148MB) reserved=8000MB peak=7062MB
|
||
[11:03] Frame 61 saved (frame_060.jpg, t=357.9s)
|
||
[11:03] [capture-periodic] freeze=1ms shot=94ms unfreeze=1ms saved=True
|
||
[11:04] [ComfyUI] [worker:ComfyUI-Sharp] [VRAM] -555MB (now 4594MB) reserved=10048MB peak=7062MB
|
||
[11:05] [capture-loop] iter=3300 t=360.0s state={'complete': False, 'error': None, 'executedCount': 4, 'wsState': 1} eval_ms=1 ram=23.7/31.3GB (76%) swap=7.7/32.0GB (24%) cpu=12% browser_rss=0.87GB
|
||
[11:06] [ComfyUI] [SubprocessWorker] callback 'report_progress' from call_id=3
|
||
[11:06] [ComfyUI] [worker:ComfyUI-Sharp] [SharpPredictGaussiansFromMetricDepth] face 29/42: 1536×1536, extrinsics=[-0.00, -0.00, -0.00], intrinsics=fx=0.5000 cx=0.5000, mask=yes, snap=none, depth_conv=planar_z
|
||
[11:06] [ComfyUI] [worker:ComfyUI-Sharp] [VRAM] +544MB (now 5138MB) reserved=7552MB peak=7062MB
|
||
[11:07] Frame 62 saved (frame_061.jpg, t=362.3s)
|
||
[11:07] [capture-periodic] freeze=1ms shot=101ms unfreeze=5ms saved=True
|
||
[11:08] [ComfyUI] [worker:ComfyUI-Sharp] [VRAM] -303MB (now 4835MB) reserved=5472MB peak=7062MB
|
||
[11:09] [ComfyUI] [worker:ComfyUI-Sharp] [VRAM] -243MB (now 4593MB) reserved=10720MB peak=7062MB
|
||
[11:10] [capture-loop] iter=3350 t=365.5s state={'complete': False, 'error': None, 'executedCount': 4, 'wsState': 1} eval_ms=1 ram=22.6/31.3GB (72%) swap=7.7/32.0GB (24%) cpu=12% browser_rss=0.87GB
|
||
[11:10] [ComfyUI] [SubprocessWorker] callback 'report_progress' from call_id=3
|
||
[11:10] [ComfyUI] [worker:ComfyUI-Sharp] [SharpPredictGaussiansFromMetricDepth] face 30/42: 1536×1536, extrinsics=[-0.00, -0.00, -0.00], intrinsics=fx=0.5000 cx=0.5000, mask=yes, snap=none, depth_conv=planar_z
|
||
[11:11] [ComfyUI] [worker:ComfyUI-Sharp] [VRAM] +521MB (now 5115MB) reserved=7680MB peak=7062MB
|
||
[11:12] Frame 63 saved (frame_062.jpg, t=366.6s)
|
||
[11:12] [capture-periodic] freeze=1ms shot=97ms unfreeze=5ms saved=True
|
||
[11:12] [ComfyUI] [worker:ComfyUI-Sharp] [VRAM] -519MB (now 4597MB) reserved=11616MB peak=7062MB
|
||
[11:14] [ComfyUI] [SubprocessWorker] callback 'report_progress' from call_id=3
|
||
[11:14] [ComfyUI] [worker:ComfyUI-Sharp] [SharpPredictGaussiansFromMetricDepth] face 31/42: 1536×1536, extrinsics=[-0.00, -0.00, -0.00], intrinsics=fx=0.5000 cx=0.5000, mask=yes, snap=none, depth_conv=planar_z
|
||
[11:15] [ComfyUI] [worker:ComfyUI-Sharp] [VRAM] +531MB (now 5128MB) reserved=7456MB peak=7062MB
|
||
[11:16] [capture-loop] iter=3400 t=370.9s state={'complete': False, 'error': None, 'executedCount': 4, 'wsState': 1} eval_ms=1 ram=22.6/31.3GB (72%) swap=7.7/32.0GB (24%) cpu=11% browser_rss=0.87GB
|
||
[11:16] Frame 64 saved (frame_063.jpg, t=371.0s)
|
||
[11:16] [capture-periodic] freeze=1ms shot=100ms unfreeze=10ms saved=True
|
||
[11:16] [ComfyUI] [worker:ComfyUI-Sharp] [VRAM] +327MB (now 5456MB) reserved=6144MB peak=7062MB
|
||
[11:17] [ComfyUI] [worker:ComfyUI-Sharp] [VRAM] -864MB (now 4592MB) reserved=10176MB peak=7062MB
|
||
[11:19] [ComfyUI] [SubprocessWorker] callback 'report_progress' from call_id=3
|
||
[11:19] [ComfyUI] [worker:ComfyUI-Sharp] [SharpPredictGaussiansFromMetricDepth] face 32/42: 1536×1536, extrinsics=[-0.00, -0.00, -0.00], intrinsics=fx=0.5000 cx=0.5000, mask=yes, snap=none, depth_conv=planar_z
|
||
[11:19] [ComfyUI] [worker:ComfyUI-Sharp] [VRAM] +563MB (now 5155MB) reserved=7648MB peak=7062MB
|
||
[11:20] Frame 65 saved (frame_064.jpg, t=375.3s)
|
||
[11:20] [capture-periodic] freeze=1ms shot=93ms unfreeze=5ms saved=True
|
||
[11:20] [ComfyUI] [worker:ComfyUI-Sharp] [VRAM] -564MB (now 4592MB) reserved=10720MB peak=7062MB
|
||
[11:21] [capture-loop] iter=3450 t=376.3s state={'complete': False, 'error': None, 'executedCount': 4, 'wsState': 1} eval_ms=1 ram=23.5/31.3GB (75%) swap=7.8/32.0GB (24%) cpu=13% browser_rss=0.87GB
|
||
[11:23] [ComfyUI] [SubprocessWorker] callback 'report_progress' from call_id=3
|
||
[11:23] [ComfyUI] [worker:ComfyUI-Sharp] [SharpPredictGaussiansFromMetricDepth] face 33/42: 1536×1536, extrinsics=[-0.00, -0.00, -0.00], intrinsics=fx=0.5000 cx=0.5000, mask=yes, snap=none, depth_conv=planar_z
|
||
[11:23] [ComfyUI] [worker:ComfyUI-Sharp] [VRAM] +578MB (now 5171MB) reserved=7680MB peak=7062MB
|
||
[11:24] [ComfyUI] [worker:ComfyUI-Sharp] [VRAM] -582MB (now 4589MB) reserved=11552MB peak=7062MB
|
||
[11:25] Frame 66 saved (frame_065.jpg, t=379.6s)
|
||
[11:25] [capture-periodic] freeze=1ms shot=99ms unfreeze=5ms saved=True
|
||
[11:26] [capture-loop] iter=3500 t=381.7s state={'complete': False, 'error': None, 'executedCount': 4, 'wsState': 1} eval_ms=1 ram=22.6/31.3GB (72%) swap=7.8/32.0GB (24%) cpu=11% browser_rss=0.87GB
|
||
[11:27] [ComfyUI] [SubprocessWorker] callback 'report_progress' from call_id=3
|
||
[11:27] [ComfyUI] [worker:ComfyUI-Sharp] [SharpPredictGaussiansFromMetricDepth] face 34/42: 1536×1536, extrinsics=[-0.00, -0.00, -0.00], intrinsics=fx=0.5000 cx=0.5000, mask=yes, snap=none, depth_conv=planar_z
|
||
[11:27] [ComfyUI] [worker:ComfyUI-Sharp] [VRAM] +518MB (now 5108MB) reserved=7808MB peak=7062MB
|
||
[11:28] [ComfyUI] [worker:ComfyUI-Sharp] [VRAM] -519MB (now 4590MB) reserved=10080MB peak=7062MB
|
||
[11:29] Frame 67 saved (frame_066.jpg, t=383.9s)
|
||
[11:29] [capture-periodic] freeze=1ms shot=105ms unfreeze=5ms saved=True
|
||
[11:31] [ComfyUI] [SubprocessWorker] callback 'report_progress' from call_id=3
|
||
[11:31] [ComfyUI] [worker:ComfyUI-Sharp] [SharpPredictGaussiansFromMetricDepth] face 35/42: 1536×1536, extrinsics=[-0.00, -0.00, -0.00], intrinsics=fx=0.5000 cx=0.5000, mask=yes, snap=none, depth_conv=planar_z
|
||
[11:31] [ComfyUI] [worker:ComfyUI-Sharp] [VRAM] +519MB (now 5109MB) reserved=7616MB peak=7062MB
|
||
[11:31] Frame 68 saved (frame_067.jpg, t=386.1s)
|
||
[11:31] [capture-periodic] freeze=1ms shot=99ms unfreeze=1ms saved=True
|
||
[11:32] [capture-loop] iter=3550 t=387.2s state={'complete': False, 'error': None, 'executedCount': 4, 'wsState': 1} eval_ms=1 ram=22.7/31.3GB (72%) swap=7.8/32.0GB (24%) cpu=11% browser_rss=0.87GB
|
||
[11:32] [ComfyUI] [worker:ComfyUI-Sharp] [VRAM] -269MB (now 4840MB) reserved=5408MB peak=7062MB
|
||
[11:33] [ComfyUI] [worker:ComfyUI-Sharp] [VRAM] -250MB (now 4591MB) reserved=10080MB peak=7062MB
|
||
[11:35] [ComfyUI] [SubprocessWorker] callback 'report_progress' from call_id=3
|
||
[11:35] [ComfyUI] [worker:ComfyUI-Sharp] [SharpPredictGaussiansFromMetricDepth] face 36/42: 1536×1536, extrinsics=[-0.00, -0.00, -0.00], intrinsics=fx=0.5000 cx=0.5000, mask=yes, snap=none, depth_conv=planar_z
|
||
[11:35] [ComfyUI] [worker:ComfyUI-Sharp] [VRAM] +552MB (now 5144MB) reserved=7968MB peak=7062MB
|
||
[11:35] Frame 69 saved (frame_068.jpg, t=390.5s)
|
||
[11:35] [capture-periodic] freeze=1ms shot=96ms unfreeze=5ms saved=True
|
||
[11:37] [ComfyUI] [worker:ComfyUI-Sharp] [VRAM] -555MB (now 4589MB) reserved=10176MB peak=7062MB
|
||
[11:37] [capture-loop] iter=3600 t=392.6s state={'complete': False, 'error': None, 'executedCount': 4, 'wsState': 1} eval_ms=1 ram=23.6/31.3GB (75%) swap=7.8/32.0GB (24%) cpu=11% browser_rss=0.87GB
|
||
[11:39] [ComfyUI] [SubprocessWorker] callback 'report_progress' from call_id=3
|
||
[11:39] [ComfyUI] [worker:ComfyUI-Sharp] [SharpPredictGaussiansFromMetricDepth] face 37/42: 1536×1536, extrinsics=[-0.00, -0.00, -0.00], intrinsics=fx=0.5000 cx=0.5000, mask=yes, snap=none, depth_conv=planar_z
|
||
[11:39] [ComfyUI] [worker:ComfyUI-Sharp] [VRAM] +517MB (now 5106MB) reserved=7328MB peak=7062MB
|
||
[11:40] Frame 70 saved (frame_069.jpg, t=394.8s)
|
||
[11:40] [capture-periodic] freeze=1ms shot=97ms unfreeze=1ms saved=True
|
||
[11:41] [ComfyUI] [worker:ComfyUI-Sharp] [VRAM] -519MB (now 4588MB) reserved=10144MB peak=7062MB
|
||
[11:43] [capture-loop] iter=3650 t=398.0s state={'complete': False, 'error': None, 'executedCount': 4, 'wsState': 1} eval_ms=1 ram=22.3/31.3GB (71%) swap=8.0/32.0GB (25%) cpu=13% browser_rss=0.87GB
|
||
[11:43] [ComfyUI] [SubprocessWorker] callback 'report_progress' from call_id=3
|
||
[11:43] [ComfyUI] [worker:ComfyUI-Sharp] [SharpPredictGaussiansFromMetricDepth] face 38/42: 1536×1536, extrinsics=[-0.00, -0.00, -0.00], intrinsics=fx=0.5000 cx=0.5000, mask=yes, snap=none, depth_conv=planar_z
|
||
[11:43] [ComfyUI] [worker:ComfyUI-Sharp] [VRAM] +518MB (now 5107MB) reserved=7904MB peak=7062MB
|
||
[11:44] Frame 71 saved (frame_070.jpg, t=399.1s)
|
||
[11:44] [capture-periodic] freeze=1ms shot=104ms unfreeze=5ms saved=True
|
||
[11:45] [ComfyUI] [worker:ComfyUI-Sharp] [VRAM] -519MB (now 4589MB) reserved=10144MB peak=7062MB
|
||
[11:47] [ComfyUI] [SubprocessWorker] callback 'report_progress' from call_id=3
|
||
[11:47] [ComfyUI] [worker:ComfyUI-Sharp] [SharpPredictGaussiansFromMetricDepth] face 39/42: 1536×1536, extrinsics=[-0.00, -0.00, -0.00], intrinsics=fx=0.5000 cx=0.5000, mask=yes, snap=none, depth_conv=planar_z
|
||
[11:47] [ComfyUI] [worker:ComfyUI-Sharp] [VRAM] +517MB (now 5107MB) reserved=7936MB peak=7062MB
|
||
[11:48] [capture-loop] iter=3700 t=403.4s state={'complete': False, 'error': None, 'executedCount': 4, 'wsState': 1} eval_ms=1 ram=22.5/31.3GB (72%) swap=8.0/32.0GB (25%) cpu=11% browser_rss=0.87GB
|
||
[11:48] Frame 72 saved (frame_071.jpg, t=403.5s)
|
||
[11:48] [capture-periodic] freeze=1ms shot=95ms unfreeze=5ms saved=True
|
||
[11:49] [ComfyUI] [worker:ComfyUI-Sharp] [VRAM] -519MB (now 4589MB) reserved=10112MB peak=7062MB
|
||
[11:51] [ComfyUI] [SubprocessWorker] callback 'report_progress' from call_id=3
|
||
[11:51] [ComfyUI] [worker:ComfyUI-Sharp] [SharpPredictGaussiansFromMetricDepth] face 40/42: 1536×1536, extrinsics=[-0.00, -0.00, -0.00], intrinsics=fx=0.5000 cx=0.5000, mask=yes, snap=none, depth_conv=planar_z
|
||
[11:52] [ComfyUI] [worker:ComfyUI-Sharp] [VRAM] +509MB (now 5098MB) reserved=7712MB peak=7062MB
|
||
[11:53] Frame 73 saved (frame_072.jpg, t=407.8s)
|
||
[11:53] [capture-periodic] freeze=1ms shot=102ms unfreeze=5ms saved=True
|
||
[11:53] [ComfyUI] [worker:ComfyUI-Sharp] [VRAM] -510MB (now 4589MB) reserved=10144MB peak=7062MB
|
||
[11:54] [capture-loop] iter=3750 t=408.9s state={'complete': False, 'error': None, 'executedCount': 4, 'wsState': 1} eval_ms=1 ram=23.4/31.3GB (75%) swap=8.0/32.0GB (25%) cpu=12% browser_rss=0.87GB
|
||
[11:56] [ComfyUI] [SubprocessWorker] callback 'report_progress' from call_id=3
|
||
[11:56] [ComfyUI] [worker:ComfyUI-Sharp] [SharpPredictGaussiansFromMetricDepth] face 41/42: 1536×1536, extrinsics=[-0.00, -0.00, -0.00], intrinsics=fx=0.5000 cx=0.5000, mask=yes, snap=none, depth_conv=planar_z
|
||
[11:56] [ComfyUI] [worker:ComfyUI-Sharp] [VRAM] +537MB (now 5126MB) reserved=7680MB peak=7062MB
|
||
[11:57] [ComfyUI] [worker:ComfyUI-Sharp]
|
||
[11:57] [ComfyUI] === WATCHDOG TICK 3 ===
|
||
[11:57] [ComfyUI] [worker:ComfyUI-Sharp] Thread 0x0000715eed1ff640 (most recent call first):
|
||
[11:57] [ComfyUI] File "/tmp/comfytest-home/.ce/.pixi/envs/sharp-nodes/lib/python3.10/socket.py", line 293 in accept
|
||
[11:57] [ComfyUI] File "/tmp/comfytest-home/.ce/.pixi/envs/sharp-nodes/lib/python3.10/multiprocessing/connection.py", line 609 in accept
|
||
[11:57] [ComfyUI] File "/tmp/comfytest-home/.ce/.pixi/envs/sharp-nodes/lib/python3.10/multiprocessing/connection.py", line 463 in accept
|
||
[11:57] [ComfyUI] File "/tmp/comfytest-home/.ce/.pixi/envs/sharp-nodes/lib/python3.10/multiprocessing/resource_sharer.py", line 138 in _serve
|
||
[11:57] [ComfyUI] File "/tmp/comfytest-home/.ce/.pixi/envs/sharp-nodes/lib/python3.10/threading.py", line 953 in run
|
||
[11:57] [ComfyUI] File "/tmp/comfytest-home/.ce/.pixi/envs/sharp-nodes/lib/python3.10/threading.py", line 1016 in _bootstrap_inner
|
||
[11:57] [ComfyUI] File "/tmp/comfytest-home/.ce/.pixi/envs/sharp-nodes/lib/python3.10/threading.py", line 973 in _bootstrap
|
||
[11:57] [ComfyUI]
|
||
[11:57] [ComfyUI] Thread 0x00007160a0cb5640 (most recent call first):
|
||
[11:57] [ComfyUI] File "/tmp/comfyui_pvenv_dtk9es_f/persistent_worker.py", line 106 in _vram_poller
|
||
[11:57] [ComfyUI] File "/tmp/comfytest-home/.ce/.pixi/envs/sharp-nodes/lib/python3.10/threading.py", line 953 in run
|
||
[11:57] [ComfyUI] File "/tmp/comfytest-home/.ce/.pixi/envs/sharp-nodes/lib/python3.10/threading.py", line 1016 in _bootstrap_inner
|
||
[11:57] [ComfyUI] File "/tmp/comfytest-home/.ce/.pixi/envs/sharp-nodes/lib/python3.10/threading.py", line 973 in _bootstrap
|
||
[11:57] [ComfyUI]
|
||
[11:57] [ComfyUI] Current thread 0x00007160a14b6640 (most recent call first):
|
||
[11:57] [ComfyUI] File "/tmp/comfyui_pvenv_dtk9es_f/persistent_worker.py", line 52 in _watchdog
|
||
[11:57] [ComfyUI] File "/tmp/comfytest-home/.ce/.pixi/envs/sharp-nodes/lib/python3.10/threading.py", line 953 in run
|
||
[11:57] [ComfyUI] File "/tmp/comfytest-home/.ce/.pixi/envs/sharp-nodes/lib/python3.10/threading.py", line 1016 in _bootstrap_inner
|
||
[11:57] [ComfyUI] File "/tmp/comfytest-home/.ce/.pixi/envs/sharp-nodes/lib/python3.10/threading.py", line 973 in _bootstrap
|
||
[11:57] [ComfyUI]
|
||
[11:57] [ComfyUI] Thread 0x00007160a1a8c740 (most recent call first):
|
||
[11:57] [ComfyUI] File "/tmp/comfytest-home/.ce/.pixi/envs/sharp-nodes/lib/python3.10/site-packages/torch/nn/functional.py", line 2935 in layer_norm
|
||
[11:57] [ComfyUI] File "/tmp/comfytest-home/.ce/.pixi/envs/sharp-nodes/lib/python3.10/site-packages/torch/nn/modules/normalization.py", line 229 in forward
|
||
[11:57] [ComfyUI] File "/workspaces/Sharp-2000/ComfyUI/comfy/ops.py", line 623 in forward
|
||
[11:57] [ComfyUI] File "/tmp/comfytest-home/.ce/.pixi/envs/sharp-nodes/lib/python3.10/site-packages/torch/nn/modules/module.py", line 1787 in _call_impl
|
||
[11:57] [ComfyUI] File "/tmp/comfytest-home/.ce/.pixi/envs/sharp-nodes/lib/python3.10/site-packages/torch/nn/modules/module.py", line 1776 in _wrapped_call_impl
|
||
[11:57] [ComfyUI] File "/workspaces/Sharp-2000/ComfyUI/custom_nodes/ComfyUI-Sharp/nodes/sharp/model.py", line 309 in forward
|
||
[11:57] [ComfyUI] File "/tmp/comfytest-home/.ce/.pixi/envs/sharp-nodes/lib/python3.10/site-packages/torch/nn/modules/module.py", line 1787 in _call_impl
|
||
[11:57] [ComfyUI] File "/tmp/comfytest-home/.ce/.pixi/envs/sharp-nodes/lib/python3.10/site-packages/torch/nn/modules/module.py", line 1776 in _wrapped_call_impl
|
||
[11:57] [ComfyUI] File "/workspaces/Sharp-2000/ComfyUI/custom_nodes/ComfyUI-Sharp/nodes/sharp/model.py", line 412 in forward
|
||
[11:57] [ComfyUI] File "/tmp/comfytest-home/.ce/.pixi/envs/sharp-nodes/lib/python3.10/site-packages/torch/nn/modules/module.py", line 1787 in _call_impl
|
||
[11:57] [ComfyUI] File "/tmp/comfytest-home/.ce/.pixi/envs/sharp-nodes/lib/python3.10/site-packages/torch/nn/modules/module.py", line 1776 in _wrapped_call_impl
|
||
[11:57] [ComfyUI] File "/workspaces/Sharp-2000/ComfyUI/custom_nodes/ComfyUI-Sharp/nodes/sharp/model.py", line 685 in forward
|
||
[11:57] [ComfyUI] File "/tmp/comfytest-home/.ce/.pixi/envs/sharp-nodes/lib/python3.10/site-packages/torch/nn/modules/module.py", line 1787 in _call_impl
|
||
[11:57] [ComfyUI] File "/tmp/comfytest-home/.ce/.pixi/envs/sharp-nodes/lib/python3.10/site-packages/torch/nn/modules/module.py", line 1776 in _wrapped_call_impl
|
||
[11:57] [ComfyUI] File "/workspaces/Sharp-2000/ComfyUI/custom_nodes/ComfyUI-Sharp/nodes/sharp/model.py", line 1109 in forward
|
||
[11:57] [ComfyUI] File "/tmp/comfytest-home/.ce/.pixi/envs/sharp-nodes/lib/python3.10/site-packages/torch/nn/modules/module.py", line 1787 in _call_impl
|
||
[11:57] [ComfyUI] File "/tmp/comfytest-home/.ce/.pixi/envs/sharp-nodes/lib/python3.10/site-packages/torch/nn/modules/module.py", line 1776 in _wrapped_call_impl
|
||
[11:57] [ComfyUI] File "/workspaces/Sharp-2000/ComfyUI/custom_nodes/ComfyUI-Sharp/nodes/sharp/model.py", line 2006 in encode
|
||
[11:57] [ComfyUI] File "/workspaces/Sharp-2000/ComfyUI/custom_nodes/ComfyUI-Sharp/nodes/predict_gaussians_from_depth.py", line 392 in execute
|
||
[11:57] [ComfyUI] File "/tmp/comfytest-home/.ce/.pixi/envs/sharp-nodes/lib/python3.10/site-packages/torch/utils/_contextlib.py", line 124 in decorate_context
|
||
[11:57] [ComfyUI] File "/workspaces/Sharp-2000/ComfyUI/comfy_api/latest/_io.py", line 1892 in EXECUTE_NORMALIZED
|
||
[11:57] [ComfyUI] File "/tmp/comfyui_pvenv_dtk9es_f/persistent_worker.py", line 1762 in main
|
||
[11:57] [ComfyUI] File "/tmp/comfyui_pvenv_dtk9es_f/persistent_worker.py", line 1807 in <module>
|
||
[11:57] [ComfyUI]
|
||
[11:57] [ComfyUI] [worker:ComfyUI-Sharp] === END ===
|
||
[11:57] [ComfyUI]
|
||
[11:57] Frame 74 saved (frame_073.jpg, t=412.2s)
|
||
[11:57] [capture-periodic] freeze=1ms shot=91ms unfreeze=4ms saved=True
|
||
[11:57] [ComfyUI] [worker:ComfyUI-Sharp] [VRAM] -537MB (now 4590MB) reserved=10144MB peak=7062MB
|
||
[11:59] [capture-loop] iter=3800 t=414.2s state={'complete': False, 'error': None, 'executedCount': 4, 'wsState': 1} eval_ms=1 ram=22.3/31.3GB (71%) swap=8.2/32.0GB (26%) cpu=11% browser_rss=0.86GB
|
||
[12:00] [ComfyUI] [SubprocessWorker] callback 'report_progress' from call_id=3
|
||
[12:00] [ComfyUI] [worker:ComfyUI-Sharp] [SharpPredictGaussiansFromMetricDepth] face 42/42: 1536×1536, extrinsics=[-0.00, -0.00, -0.00], intrinsics=fx=0.5000 cx=0.5000, mask=yes, snap=none, depth_conv=planar_z
|
||
[12:00] [ComfyUI] [worker:ComfyUI-Sharp] [VRAM] +580MB (now 5171MB) reserved=7936MB peak=7062MB
|
||
[12:01] [ComfyUI] [worker:ComfyUI-Sharp] [VRAM] -582MB (now 4590MB) reserved=10208MB peak=7062MB
|
||
[12:01] Frame 75 saved (frame_074.jpg, t=416.5s)
|
||
[12:01] [capture-periodic] freeze=1ms shot=98ms unfreeze=5ms saved=True
|
||
[12:04] [ComfyUI] [SubprocessWorker] callback 'report_progress' from call_id=3
|
||
[12:04] [ComfyUI] [worker:ComfyUI-Sharp] [SharpPredictGaussiansFromMetricDepth] 42 face(s) -> 4.07M gaussians total (both layers, snap=none); saved to /workspaces/Sharp-2000/ComfyUI/output/sharp_aligned_1780863002766; 173.8s
|
||
[12:04] [ComfyUI] [worker:ComfyUI-Sharp] [VRAM] -1903MB (now 2688MB) reserved=7584MB peak=7062MB
|
||
[12:04] [ComfyUI] [SubprocessWorker] got response: ok
|
||
[12:04] [ComfyUI] [comfy-env] Created 1 model patchers: ['RGBGaussianPredictor_1']
|
||
[12:04] [ComfyUI] [comfy-env] SharpPredictGaussiansFromMetricDepth done (182.64s): result: NodeOutput
|
||
[12:04] [ComfyUI] [VRAM] After SharpPredictGaussiansFromMetricDepth: 14329 / 24122 MB
|
||
[12:04] [ComfyUI] [VRAM] Loaded: SubprocessModel (2679 MB), SubprocessModel (631 MB)
|
||
[12:04] [ComfyUI] [comfy-env] Running MergeGaussians: ply_folder: '/workspaces/Sharp-2000/ComfyUI/output/sharp_aligned_1780..., output_prefix: 'merged', max_depth: 0.0, min_opacity: 0.0
|
||
[12:04] [ComfyUI] [VRAM] Before MergeGaussians: 14329 / 24122 MB
|
||
[12:04] [ComfyUI] [VRAM] Loaded: SubprocessModel (2679 MB), SubprocessModel (631 MB)
|
||
[12:04] [ComfyUI] [SubprocessWorker] call_method: nodes.merge_gaussians.MergeGaussians.EXECUTE_NORMALIZED
|
||
[12:04] [ComfyUI] [SubprocessWorker] acquired lock, ensuring started...
|
||
[12:04] [ComfyUI] [ComfyUI-Sharp] Health check: ping (timeout=5.0s)...
|
||
[12:04] [ComfyUI] [ComfyUI-Sharp] Health check: ok
|
||
[12:04] [ComfyUI] [SubprocessWorker] worker started/confirmed
|
||
[12:04] [ComfyUI] [SubprocessWorker] serializing kwargs to shm...
|
||
[12:04] [ComfyUI] [SubprocessWorker] created 0 shm blocks
|
||
[12:04] [ComfyUI] [SubprocessWorker] sending request via socket...
|
||
[12:04] [ComfyUI] [SubprocessWorker] call_id=4 sending call_method
|
||
[12:04] [ComfyUI] [worker:ComfyUI-Sharp] [MergeGaussians] merging 42 PLY file(s) from /workspaces/Sharp-2000/ComfyUI/output/sharp_aligned_1780863002766 (no filters)
|
||
[12:04] [ComfyUI] [SubprocessWorker] callback 'report_progress' from call_id=4
|
||
[12:04] [ComfyUI] [SubprocessWorker] callback 'report_progress' from call_id=4
|
||
[12:04] [ComfyUI] [SubprocessWorker] callback 'report_progress' from call_id=4
|
||
[12:04] [ComfyUI] [SubprocessWorker] callback 'report_progress' from call_id=4
|
||
[12:04] [ComfyUI] [SubprocessWorker] callback 'report_progress' from call_id=4
|
||
[12:05] [capture-loop] iter=3850 t=419.7s state={'complete': False, 'error': None, 'executedCount': 4, 'wsState': 1} eval_ms=2 ram=22.4/31.3GB (72%) swap=8.2/32.0GB (26%) cpu=12% browser_rss=0.83GB
|
||
[12:05] [ComfyUI] [worker:ComfyUI-Sharp] [MergeGaussians] merged 42 file(s) -> 4.07M gaussians -> /workspaces/Sharp-2000/ComfyUI/output/merged_1780863177142.ply, 217.5 MB; save 0.5s, total 0.9s
|
||
[12:05] [ComfyUI] [worker:ComfyUI-Sharp] [MergeGaussians] field PLY (positions + face_id only) -> /workspaces/Sharp-2000/ComfyUI/output/merged_1780863177142_fields.ply
|
||
[12:05] [ComfyUI] [SubprocessWorker] got response: ok
|
||
[12:05] [ComfyUI] [comfy-env] MergeGaussians done (0.99s): result: NodeOutput
|
||
[12:05] [ComfyUI] [comfy-env] SubprocessWorker: /tmp/comfytest-home/.ce/.pixi/envs/gaussianpack-nodes/bin/python
|
||
[12:05] [ComfyUI] [VRAM] After MergeGaussians: 14329 / 24122 MB
|
||
[12:05] [ComfyUI] [comfy-env] env_vars: {'COMFYUI_BASE': '/workspaces/Sharp-2000/ComfyUI'}
|
||
[12:05] [ComfyUI] [VRAM] Loaded: SubprocessModel (2679 MB), SubprocessModel (631 MB)
|
||
[12:05] [ComfyUI] [comfy-env] Running TransformGaussian: rotate_x: -90.0, rotate_y: 0.0, rotate_z: 0.0, ply_path: '/workspaces/Sharp-2000/ComfyUI/output/merged_17808631771...
|
||
[12:05] [ComfyUI] [VRAM] Before TransformGaussian: 14329 / 24122 MB
|
||
[12:05] [ComfyUI] [VRAM] Loaded: SubprocessModel (2679 MB), SubprocessModel (631 MB)
|
||
[12:05] [ComfyUI] [SubprocessWorker] call_method: nodes.transform_gaussian.TransformGaussian.transform
|
||
[12:05] [ComfyUI] [ComfyUI-GaussianPack] python: /tmp/comfytest-home/.ce/.pixi/envs/gaussianpack-nodes/bin/python
|
||
[12:05] [ComfyUI] [SubprocessWorker] acquired lock, ensuring started...
|
||
[12:05] [ComfyUI] [ComfyUI-GaussianPack] sys_path sent to worker: ['/workspaces/Sharp-2000/ComfyUI', '/workspaces/Sharp-2000/ComfyUI/custom_nodes/ComfyUI-GaussianPack', '/tmp/comfytest-home/.ce/.pixi/envs/gaussianpack-nodes/lib/python3.1/site-packages', '/workspaces/Sharp-2000/ComfyUI/custom_nodes/ComfyUI-GaussianPack']
|
||
[12:05] [ComfyUI] [SubprocessWorker] is_pixi=True, python=/tmp/comfytest-home/.ce/.pixi/envs/gaussianpack-nodes/bin/python
|
||
[12:05] [ComfyUI] [SubprocessWorker] launching cmd=['/tmp/comfytest-home/.pixi/bin/pixi', 'run', '--as-is', '--manifest-path', '/tmp/comfytest-home/.ce/pixi.toml', '-e', 'gaussianpack-nodes', 'python', '/tmp/comfyui_pvenv_pzbmli8e/persistent_worker.py', 'abstract://comfy_worker_f5806092d873']...
|
||
[12:05] [ComfyUI] [SubprocessWorker] socket_addr=abstract://comfy_worker_f5806092d873 (abstract, no filesystem path)
|
||
[12:06] Frame 76 saved (frame_075.jpg, t=420.9s)
|
||
[12:06] [capture-periodic] freeze=2ms shot=102ms unfreeze=4ms saved=True
|
||
[12:06] [ComfyUI] [SubprocessWorker] worker started/confirmed
|
||
[12:06] [ComfyUI] [SubprocessWorker] serializing kwargs to shm...
|
||
[12:06] [ComfyUI] [SubprocessWorker] created 0 shm blocks
|
||
[12:06] [ComfyUI] [SubprocessWorker] sending request via socket...
|
||
[12:06] [ComfyUI] [SubprocessWorker] call_id=1 sending call_method
|
||
[12:07] [ComfyUI] [worker:ComfyUI-GaussianPack] WARNING: SPZ route not registered (ModuleNotFoundError: No module named 'comfy_aimdo')
|
||
[12:07] [ComfyUI] [SubprocessWorker] got response: ok
|
||
[12:07] [ComfyUI] [comfy-env] TransformGaussian done (2.49s): result: list[1]
|
||
[12:07] [ComfyUI] [VRAM] After TransformGaussian: 14329 / 24122 MB
|
||
[12:07] [ComfyUI] [VRAM] Loaded: SubprocessModel (2679 MB), SubprocessModel (631 MB)
|
||
[12:07] [ComfyUI] [comfy-env] Running PreviewGaussians: camera_mode: 'orbit', fov_degrees: 71.0, renderer: 'playcanvas', transport_format: 'ply', ply_path: '/workspaces/Sharp-2000/ComfyUI/output/merged_17808631771...
|
||
[12:07] [ComfyUI] [VRAM] Before PreviewGaussians: 14329 / 24122 MB
|
||
[12:07] [ComfyUI] [VRAM] Loaded: SubprocessModel (2679 MB), SubprocessModel (631 MB)
|
||
[12:07] [ComfyUI] [SubprocessWorker] call_method: nodes.preview_gaussian.PreviewGaussians.preview
|
||
[12:07] [ComfyUI] [SubprocessWorker] acquired lock, ensuring started...
|
||
[12:07] [ComfyUI] [ComfyUI-GaussianPack] Health check: ping (timeout=5.0s)...
|
||
[12:07] [ComfyUI] [ComfyUI-GaussianPack] Health check: ok
|
||
[12:07] [ComfyUI] [SubprocessWorker] worker started/confirmed
|
||
[12:07] [ComfyUI] [SubprocessWorker] serializing kwargs to shm...
|
||
[12:07] [ComfyUI] [SubprocessWorker] created 0 shm blocks
|
||
[12:07] [ComfyUI] [SubprocessWorker] sending request via socket...
|
||
[12:07] [ComfyUI] [SubprocessWorker] call_id=2 sending call_method
|
||
[12:07] [ComfyUI] [SubprocessWorker] got response: ok
|
||
[12:08] [ComfyUI] [comfy-env] PreviewGaussians done (0.05s): result: dict
|
||
[12:08] [ComfyUI] [VRAM] After PreviewGaussians: 14329 / 24122 MB
|
||
[12:08] [ComfyUI] [VRAM] Loaded: SubprocessModel (2679 MB), SubprocessModel (631 MB)
|
||
[12:08] [ComfyUI] [32m[INFO][0m [32mPrompt executed in 422.49 seconds[0m
|
||
[12:08] Node executed (5 total), capturing...
|
||
[12:08] Frame 77 saved (frame_076.jpg, t=422.9s)
|
||
[12:08] [capture-node] freeze=1ms shot=94ms unfreeze=1ms saved=True
|
||
[12:10] Execution complete (t=424.9s)
|
||
[12:10] [3d-wait] Phase 1: Waiting for 'Loading 3D Model' text to disappear...
|
||
[12:10] [3d-wait] Phase 1 done in 0.4s
|
||
[12:10] [3d-wait] Phase 2: iframes=1
|
||
[12:10] [3d-wait] iframe viewer_ready=False (matched 0 console logs)
|
||
[12:10] [3d-wait] Waiting for 'Loaded successfully' console message (timeout=60s)...
|
||
[12:14] [3d-wait] Got 'Loaded successfully' after 3.4s
|
||
[12:14] [3d-wait] Unfrozen in 0.075s, rendering for 5s...
|
||
[12:19] [3d-wait] JS halted via CDP after 5.8s
|
||
[12:20] [3d-wait] Re-frozen in 6.8s
|
||
[12:20] [3d-wait] Total 3D wait: 10.6s
|
||
[12:20] Captured 77 unique frames over 435.58s
|
||
[12:20] [debug] iframes: 1
|
||
[12:20] [debug] iframe[0]: src=http://127.0.0.1:41888/extensions/ComfyUI-GaussianPack/viewer_gaussian.html?v=17, canvas=486x403, rafFrozen=True
|
||
[12:20] [timing] trigger_3d_previews: 0.0s
|
||
[12:23] Saved high-quality screenshot: pano_executed.png
|
||
[12:23] [timing] final_screenshot: 0.3s
|
||
[12:23] [ComfyUI] [comfy-env] [VRAM] Before offload 'MoGeWrapper_1' (631 MB) -> cpu: 14329 / 24122 MB
|
||
[12:23] [ComfyUI] [ComfyUI-MoGe2] Health check: ping (timeout=5.0s)...
|
||
[12:23] [ComfyUI] [ComfyUI-MoGe2] python: /tmp/comfytest-home/.ce/.pixi/envs/moge2-nodes/bin/python
|
||
[12:23] Capturing execution frames: sharp_basic.json
|
||
[12:23] [ComfyUI] [ComfyUI-MoGe2] sys_path sent to worker: ['/workspaces/Sharp-2000/ComfyUI', '/workspaces/Sharp-2000/ComfyUI/custom_nodes/ComfyUI-MoGe2', '/tmp/comfytest-home/.ce/.pixi/envs/moge2-nodes/lib/python3.1/site-packages', '/workspaces/Sharp-2000/ComfyUI/custom_nodes/ComfyUI-MoGe2']
|
||
[12:23] [ComfyUI] [ComfyUI-MoGe2] Health check: failed
|
||
[12:23] [ComfyUI] [ComfyUI-MoGe2] Socket unhealthy, restarting worker...
|
||
[12:23] [ComfyUI] [SubprocessWorker] is_pixi=True, python=/tmp/comfytest-home/.ce/.pixi/envs/moge2-nodes/bin/python
|
||
[12:23] [ComfyUI] [SubprocessWorker] launching cmd=['/tmp/comfytest-home/.pixi/bin/pixi', 'run', '--as-is', '--manifest-path', '/tmp/comfytest-home/.ce/pixi.toml', '-e', 'moge2-nodes', 'python', '/tmp/comfyui_pvenv_36qakloh/persistent_worker.py', 'abstract://comfy_worker_f89eee543b23']...
|
||
[12:23] [ComfyUI] [comfy-env] Invalidated 1 stale model patchers (will be cleaned up during next unload)
|
||
[12:23] [ComfyUI] [SubprocessWorker] socket_addr=abstract://comfy_worker_f89eee543b23 (abstract, no filesystem path)
|
||
[12:24] [ComfyUI] [worker:ComfyUI-MoGe2] ERROR: Failed to import comfy_kitchen, Error: No module named 'comfy_kitchen', fp8 and fp4 support will not be available.
|
||
[12:24] [ComfyUI] [worker:ComfyUI-MoGe2] WARNING: comfy_kitchen does not support stochastic FP8 rounding, please update comfy_kitchen.
|
||
[12:25] [ComfyUI] [SubprocessWorker] call_id=3 sending model_to_device
|
||
[12:25] [ComfyUI] [1m[33m[WARNING][0m Model 'MoGeWrapper_1' gone from worker (restarted?), treating as offloaded
|
||
[12:25] [ComfyUI] [comfy-env] [VRAM] After offload 'MoGeWrapper_1' (631 MB): 14554 / 24122 MB
|
||
[12:25] [ComfyUI] [comfy-env] [VRAM] Before offload 'RGBGaussianPredictor_1' (2679 MB) -> cpu: 14554 / 24122 MB
|
||
[12:25] [ComfyUI] [ComfyUI-Sharp] Health check: ping (timeout=5.0s)...
|
||
[12:25] [ComfyUI] [ComfyUI-Sharp] Health check: ok
|
||
[12:25] [ComfyUI] [SubprocessWorker] call_id=5 sending model_to_device
|
||
[12:25] [ComfyUI] [worker:ComfyUI-Sharp] [VRAM] -290MB (now 2399MB) reserved=7584MB peak=7062MB
|
||
[12:26] [ComfyUI] [worker:ComfyUI-Sharp] [VRAM] -2046MB (now 354MB) reserved=7584MB peak=7062MB
|
||
[12:26] [ComfyUI] [comfy-env] [VRAM] After offload 'RGBGaussianPredictor_1' (2679 MB): 7034 / 24122 MB
|
||
[12:26] [ComfyUI] [32m[INFO][0m Using RAM pressure cache.
|
||
[12:29] Frame 1 saved (frame_000.jpg, t=0.0s)
|
||
[12:29] Validating workflow...
|
||
[12:29] [ComfyUI] [32m[INFO][0m === /validate endpoint called ===
|
||
[12:29] [ComfyUI] [32m[INFO][0m Received JSON with keys: ['prompt']
|
||
[12:29] Queuing workflow for execution...
|
||
[12:29] [ComfyUI] [32m[INFO][0m Prompt has 4 nodes
|
||
[12:29] [ComfyUI] [32m[INFO][0m Node 1: LoadImage
|
||
[12:29] [ComfyUI] [32m[INFO][0m Inputs: {"image": "beach.jpg"}
|
||
[12:29] [ComfyUI] [32m[INFO][0m Node 2: LoadSharpModel
|
||
[12:29] [ComfyUI] [32m[INFO][0m Inputs: {"precision": "auto"}
|
||
[12:29] [ComfyUI] [32m[INFO][0m Node 5: SharpPredict
|
||
[12:29] [ComfyUI] [32m[INFO][0m Inputs: {"focal_length_mm": 30, "output_prefix": "sharp", "model": ["2", 0], "image": ["1", 0]}
|
||
[12:29] [ComfyUI] [32m[INFO][0m Node 6: PreviewGaussianSharp
|
||
[12:29] [ComfyUI] [32m[INFO][0m Inputs: {"preview_gaussian": "", "ply_path": ["5", 0], "extrinsics": ["5", 1], "intrinsics": ["5", 2]}
|
||
[12:29] [ComfyUI] [32m[INFO][0m Generated prompt_id: 7f47feca-b4c5-483f-b48c-98e080fa267e
|
||
[12:29] [ComfyUI] [32m[INFO][0m Calling execution.validate_prompt()...
|
||
[12:29] [ComfyUI] [32m[INFO][0m Validation result: valid=True
|
||
[12:29] [ComfyUI] [32m[INFO][0m === Validation PASSED ===
|
||
[12:29] [ComfyUI] [32m[INFO][0m got prompt
|
||
[12:29] [ComfyUI] [comfy-env] Running LoadSharpModel: precision: 'auto'
|
||
[12:29] [ComfyUI] [VRAM] Before LoadSharpModel: 4995 / 24122 MB
|
||
[12:29] [ComfyUI] [ComfyUI-Sharp] python: /tmp/comfytest-home/.ce/.pixi/envs/sharp-nodes/bin/python
|
||
[12:29] [ComfyUI] [ComfyUI-Sharp] sys_path sent to worker: ['/workspaces/Sharp-2000/ComfyUI', '/workspaces/Sharp-2000/ComfyUI/custom_nodes/ComfyUI-Sharp', '/tmp/comfytest-home/.ce/.pixi/envs/sharp-nodes/lib/python3.1/site-packages', '/workspaces/Sharp-2000/ComfyUI/custom_nodes/ComfyUI-Sharp']
|
||
[12:29] [ComfyUI] [SubprocessWorker] call_method: nodes.load_model.LoadSharpModel.EXECUTE_NORMALIZED
|
||
[12:29] [ComfyUI] [SubprocessWorker] acquired lock, ensuring started...
|
||
[12:29] [ComfyUI] [SubprocessWorker] is_pixi=True, python=/tmp/comfytest-home/.ce/.pixi/envs/sharp-nodes/bin/python
|
||
[12:29] [ComfyUI] [SubprocessWorker] launching cmd=['/tmp/comfytest-home/.pixi/bin/pixi', 'run', '--as-is', '--manifest-path', '/tmp/comfytest-home/.ce/pixi.toml', '-e', 'sharp-nodes', 'python', '/tmp/comfyui_pvenv_dtk9es_f/persistent_worker.py', 'abstract://comfy_worker_946dd8d4bf7a']...
|
||
[12:29] [ComfyUI] [ComfyUI-Sharp] Health check: ping (timeout=5.0s)...
|
||
[12:29] [ComfyUI] [SubprocessWorker] socket_addr=abstract://comfy_worker_946dd8d4bf7a (abstract, no filesystem path)
|
||
[12:29] [ComfyUI] [ComfyUI-Sharp] Health check: failed
|
||
[12:29] [ComfyUI] [ComfyUI-Sharp] Socket unhealthy, restarting worker...
|
||
[12:29] [ComfyUI] [comfy-env] Invalidated 1 stale model patchers (will be cleaned up during next unload)
|
||
[12:30] [ComfyUI] [worker:ComfyUI-Sharp] ERROR: Failed to import comfy_kitchen, Error: No module named 'comfy_kitchen', fp8 and fp4 support will not be available.
|
||
[12:30] [ComfyUI] [worker:ComfyUI-Sharp] WARNING: comfy_kitchen does not support stochastic FP8 rounding, please update comfy_kitchen.
|
||
[12:30] [ComfyUI] [SubprocessWorker] worker started/confirmed
|
||
[12:30] [ComfyUI] [SubprocessWorker] serializing kwargs to shm...
|
||
[12:30] [ComfyUI] [SubprocessWorker] created 0 shm blocks
|
||
[12:30] [ComfyUI] [SubprocessWorker] sending request via socket...
|
||
[12:30] [ComfyUI] [SubprocessWorker] call_id=6 sending call_method
|
||
[12:31] [ComfyUI] [worker:ComfyUI-Sharp] [LoadSharpModel] precision='auto' -> dtype=bf16 (device=cuda:0)
|
||
[12:31] [ComfyUI] [worker:ComfyUI-Sharp] [LoadSharpModel] checkpoint already present, reusing (no download): /workspaces/Sharp-2000/ComfyUI/models/sharp/sharp_2572gikvuh.pt (2679.6 MB)
|
||
[12:31] [ComfyUI] [worker:ComfyUI-Sharp] [LoadSharpModel] checkpoint ready: /workspaces/Sharp-2000/ComfyUI/models/sharp/sharp_2572gikvuh.pt (2679.6 MB)
|
||
[12:31] [ComfyUI] [worker:ComfyUI-Sharp] [LoadSharpModel] config: precision=auto -> dtype=bf16
|
||
[12:31] [ComfyUI] [SubprocessWorker] got response: ok
|
||
[12:31] [ComfyUI] [comfy-env] [VRAM] Before offload 'RGBGaussianPredictor_1' (2679 MB) -> cpu: 4817 / 24122 MB
|
||
[12:31] [ComfyUI] [ComfyUI-Sharp] Health check: ping (timeout=5.0s)...
|
||
[12:31] [ComfyUI] [ComfyUI-Sharp] Health check: ok
|
||
[12:31] [ComfyUI] [SubprocessWorker] call_id=7 sending model_to_device
|
||
[12:31] [ComfyUI] [1m[33m[WARNING][0m Model 'RGBGaussianPredictor_1' gone from worker (restarted?), treating as offloaded
|
||
[12:31] [ComfyUI] [comfy-env] [VRAM] After offload 'RGBGaussianPredictor_1' (2679 MB): 4817 / 24122 MB
|
||
[12:31] [ComfyUI] [comfy-env] [VRAM] Before offload 'MoGeWrapper_1' (631 MB) -> cpu: 4817 / 24122 MB
|
||
[12:31] [ComfyUI] [ComfyUI-MoGe2] Health check: ping (timeout=5.0s)...
|
||
[12:31] [ComfyUI] [ComfyUI-MoGe2] Health check: ok
|
||
[12:31] [ComfyUI] [SubprocessWorker] call_id=4 sending model_to_device
|
||
[12:31] [ComfyUI] [1m[33m[WARNING][0m Model 'MoGeWrapper_1' gone from worker (restarted?), treating as offloaded
|
||
[12:31] [ComfyUI] [comfy-env] [VRAM] After offload 'MoGeWrapper_1' (631 MB): 4817 / 24122 MB
|
||
[12:31] [ComfyUI] [comfy-env] LoadSharpModel done (1.93s): result: NodeOutput
|
||
[12:31] [ComfyUI] [VRAM] After LoadSharpModel: 4817 / 24122 MB
|
||
[12:31] [ComfyUI] [comfy-env] Running SharpPredict: focal_length_mm: 30.0, output_prefix: 'sharp', model: dict, image: torch.float32 [1,1024,1536,3] cpu
|
||
[12:31] [ComfyUI] [VRAM] Before SharpPredict: 4817 / 24122 MB
|
||
[12:31] [ComfyUI] [SubprocessWorker] call_method: nodes.predict.SharpPredict.EXECUTE_NORMALIZED
|
||
[12:31] Frame 2 saved (frame_001.jpg, t=2.3s)
|
||
[12:31] [ComfyUI] [SubprocessWorker] acquired lock, ensuring started...
|
||
[12:31] [capture-periodic] freeze=1ms shot=123ms unfreeze=1ms saved=True
|
||
[12:31] [ComfyUI] [ComfyUI-Sharp] Health check: ping (timeout=5.0s)...
|
||
[12:31] [ComfyUI] [ComfyUI-Sharp] Health check: ok
|
||
[12:31] [ComfyUI] [SubprocessWorker] worker started/confirmed
|
||
[12:31] [ComfyUI] [comfy-env] PRE-SERIALIZE 'image' shape: torch.Size([1, 1024, 1536, 3])
|
||
[12:31] [ComfyUI] [SubprocessWorker] serializing kwargs to shm...
|
||
[12:32] [ComfyUI] [SubprocessWorker] created 0 shm blocks
|
||
[12:32] [ComfyUI] [SubprocessWorker] sending request via socket...
|
||
[12:32] [ComfyUI] [SubprocessWorker] call_id=8 sending call_method
|
||
[12:32] [ComfyUI] [worker:ComfyUI-Sharp] [comfy-env] _from_shm got dict with keys: ['__type__', 'strategy', 'parent_pid', 'fd', 'storage_size']
|
||
[12:32] [ComfyUI] [worker:ComfyUI-Sharp] [comfy-env] DESERIALIZE TensorRef: tensor_size=[1, 1024, 1536, 3]
|
||
[12:32] [ComfyUI] [worker:ComfyUI-Sharp] [comfy-env] DESERIALIZED tensor shape: torch.Size([1, 1024, 1536, 3])
|
||
[12:33] Frame 3 saved (frame_002.jpg, t=4.5s)
|
||
[12:33] [capture-periodic] freeze=1ms shot=107ms unfreeze=1ms saved=True
|
||
[12:33] [ComfyUI] [worker:ComfyUI-Sharp] [LoadSharpModel] loading checkpoint from /workspaces/Sharp-2000/ComfyUI/models/sharp/sharp_2572gikvuh.pt (dtype=bf16)
|
||
[12:34] [capture-loop] iter=50 t=5.6s state={'complete': False, 'error': None, 'executedCount': 0, 'wsState': 1} eval_ms=4 ram=11.1/31.3GB (36%) swap=3.5/32.0GB (11%) cpu=32% browser_rss=0.97GB
|
||
[12:35] [ComfyUI] [worker:ComfyUI-Sharp] [LoadSharpModel] initializing model on meta device...
|
||
[12:35] [ComfyUI] [worker:ComfyUI-Sharp] [LoadSharpModel] model ready (torch.bfloat16)
|
||
[12:35] [ComfyUI] [SubprocessWorker] callback 'request_vram_budget' from call_id=8
|
||
[12:35] [ComfyUI] [comfy-env] VRAM request: 2.81GB, free before eviction: 20.24GB
|
||
[12:35] [ComfyUI] [comfy-env] VRAM after eviction: 20.24GB
|
||
[12:35] [ComfyUI] [worker:ComfyUI-Sharp] [VRAM] +539MB (now 539MB) reserved=544MB peak=539MB
|
||
[12:36] [ComfyUI] [worker:ComfyUI-Sharp] [VRAM] +2757MB (now 3296MB) reserved=3456MB peak=3314MB
|
||
[12:37] [ComfyUI] [worker:ComfyUI-Sharp] [VRAM] -321MB (now 2975MB) reserved=3328MB peak=3314MB
|
||
[12:38] [ComfyUI] [worker:ComfyUI-Sharp] [VRAM] +1188MB (now 4164MB) reserved=7840MB peak=7053MB
|
||
[12:39] [ComfyUI] [worker:ComfyUI-Sharp] [VRAM] +234MB (now 4398MB) reserved=7360MB peak=7053MB
|
||
[12:39] [capture-loop] iter=100 t=11.0s state={'complete': False, 'error': None, 'executedCount': 0, 'wsState': 1} eval_ms=1 ram=12.7/31.3GB (41%) swap=3.5/32.0GB (11%) cpu=14% browser_rss=0.76GB
|
||
[12:40] [ComfyUI] [SubprocessWorker] callback 'report_progress' from call_id=8
|
||
[12:40] [ComfyUI] [SubprocessWorker] got response: ok
|
||
[12:40] [ComfyUI] [comfy-env] Created 1 model patchers: ['RGBGaussianPredictor_1']
|
||
[12:40] [ComfyUI] [comfy-env] SharpPredict done (9.44s): result: NodeOutput
|
||
[12:40] [ComfyUI] [VRAM] After SharpPredict: 12291 / 24122 MB
|
||
[12:40] [ComfyUI] [VRAM] Loaded: SubprocessModel (2679 MB)
|
||
[12:40] [ComfyUI] [comfy-env] Running PreviewGaussianSharp: ply_path: '/workspaces/Sharp-2000/ComfyUI/output/sharp_178086320783..., extrinsics: list[4], intrinsics: list[3]
|
||
[12:40] [ComfyUI] [VRAM] Before PreviewGaussianSharp: 12291 / 24122 MB
|
||
[12:40] [ComfyUI] [VRAM] Loaded: SubprocessModel (2679 MB)
|
||
[12:40] [ComfyUI] [SubprocessWorker] call_method: nodes.preview_gaussian_sharp.PreviewGaussianSharp.EXECUTE_NORMALIZED
|
||
[12:40] [ComfyUI] [SubprocessWorker] acquired lock, ensuring started...
|
||
[12:40] [ComfyUI] [ComfyUI-GaussianPack] Health check: ping (timeout=5.0s)...
|
||
[12:40] [ComfyUI] [ComfyUI-GaussianPack] Health check: ok
|
||
[12:40] [ComfyUI] [SubprocessWorker] worker started/confirmed
|
||
[12:40] [ComfyUI] [SubprocessWorker] serializing kwargs to shm...
|
||
[12:40] [ComfyUI] [SubprocessWorker] created 0 shm blocks
|
||
[12:40] [ComfyUI] [SubprocessWorker] sending request via socket...
|
||
[12:40] [ComfyUI] [SubprocessWorker] call_id=3 sending call_method
|
||
[12:40] [ComfyUI] [SubprocessWorker] got response: ok
|
||
[12:40] Node executed (1 total), capturing...
|
||
[12:40] [ComfyUI] [comfy-env] PreviewGaussianSharp done (0.06s): result: NodeOutput
|
||
[12:40] [ComfyUI] [VRAM] After PreviewGaussianSharp: 12291 / 24122 MB
|
||
[12:40] [ComfyUI] [VRAM] Loaded: SubprocessModel (2679 MB)
|
||
[12:40] [ComfyUI] [32m[INFO][0m [32mPrompt executed in 11.49 seconds[0m
|
||
[12:40] [ComfyUI] [comfy-env] [VRAM] Before offload 'RGBGaussianPredictor_1' (2679 MB) -> cpu: 12291 / 24122 MB
|
||
[12:40] [ComfyUI] [ComfyUI-Sharp] Health check: ping (timeout=5.0s)...
|
||
[12:40] [ComfyUI] [ComfyUI-Sharp] Health check: ok
|
||
[12:40] [ComfyUI] [SubprocessWorker] call_id=9 sending model_to_device
|
||
[12:40] [ComfyUI] [worker:ComfyUI-Sharp] [VRAM] -2128MB (now 2271MB) reserved=7360MB peak=7053MB
|
||
[12:41] [ComfyUI] [worker:ComfyUI-Sharp] [VRAM] -1773MB (now 498MB) reserved=7360MB peak=7053MB
|
||
[12:41] Frame 4 saved (frame_003.jpg, t=11.9s)
|
||
[12:41] [capture-node] freeze=701ms shot=415ms unfreeze=0ms saved=True
|
||
[12:42] Execution complete (t=11.9s)
|
||
[12:42] [3d-wait] Phase 1: Waiting for 'Loading 3D Model' text to disappear...
|
||
[12:42] [3d-wait] Phase 1 done in 0.0s
|
||
[12:42] [3d-wait] Phase 2: iframes=1
|
||
[12:42] [3d-wait] iframe viewer_ready=True (matched 1 console logs)
|
||
[12:42] [3d-wait] Unfrozen in 0.001s, rendering for 5s...
|
||
[12:42] [ComfyUI] [comfy-env] [VRAM] After offload 'RGBGaussianPredictor_1' (2679 MB): 5027 / 24122 MB
|
||
[12:42] [ComfyUI] [32m[INFO][0m Using RAM pressure cache.
|
||
[12:49] [3d-wait] JS halted via CDP after 7.9s
|
||
[13:13] [3d-wait] Re-frozen in 31.8s
|
||
[13:13] [3d-wait] Total 3D wait: 31.8s
|
||
[13:13] Captured 4 unique frames over 44.85s
|
||
[13:13] [debug] iframes: 1
|
||
[13:13] [debug] iframe[0]: src=http://127.0.0.1:41888/extensions/ComfyUI-GaussianPack/viewer_gaussian_sharp.htm, canvas=1536x1024, rafFrozen=True
|
||
[13:13] [timing] trigger_3d_previews: 0.0s
|
||
[13:16] Saved high-quality screenshot: sharp_basic_executed.png
|
||
[13:16] [timing] final_screenshot: 0.3s
|
||
[13:16] [ComfyUI] [32m[INFO][0m Using RAM pressure cache.
|
||
[13:16] Capturing execution frames: sharp_exif.json
|
||
[13:16] [ComfyUI] [32m[INFO][0m Using RAM pressure cache.
|
||
[13:21] Frame 1 saved (frame_000.jpg, t=0.0s)
|
||
[13:21] Validating workflow...
|
||
[13:21] [ComfyUI] [32m[INFO][0m === /validate endpoint called ===
|
||
[13:21] Queuing workflow for execution...
|
||
[13:21] [ComfyUI] [32m[INFO][0m Received JSON with keys: ['prompt']
|
||
[13:21] [ComfyUI] [32m[INFO][0m Prompt has 4 nodes
|
||
[13:21] [ComfyUI] [32m[INFO][0m Node 2: LoadSharpModel
|
||
[13:21] [ComfyUI] [32m[INFO][0m Inputs: {"precision": "auto"}
|
||
[13:21] [ComfyUI] [32m[INFO][0m Node 7: SharpPredict
|
||
[13:21] [ComfyUI] [32m[INFO][0m Inputs: {"focal_length_mm": ["9", 2], "output_prefix": "sharp", "model": ["2", 0], "image": ["9", 0]}
|
||
[13:21] [ComfyUI] [ComfyUI-Sharp] python: /tmp/comfytest-home/.ce/.pixi/envs/sharp-nodes/bin/python
|
||
[13:21] [ComfyUI] [ComfyUI-Sharp] sys_path sent to worker: ['/workspaces/Sharp-2000/ComfyUI', '/workspaces/Sharp-2000/ComfyUI/custom_nodes/ComfyUI-Sharp', '/tmp/comfytest-home/.ce/.pixi/envs/sharp-nodes/lib/python3.1/site-packages', '/workspaces/Sharp-2000/ComfyUI/custom_nodes/ComfyUI-Sharp']
|
||
[13:21] [ComfyUI] [32m[INFO][0m Node 9: LoadImageWithExif
|
||
[13:21] [ComfyUI] [32m[INFO][0m Inputs: {"image": "eth3d.png", "default_focal_mm": 30}
|
||
[13:21] [ComfyUI] [SubprocessWorker] is_pixi=True, python=/tmp/comfytest-home/.ce/.pixi/envs/sharp-nodes/bin/python
|
||
[13:21] [ComfyUI] [32m[INFO][0m Node 11: PreviewGaussianSharp
|
||
[13:21] [ComfyUI] [SubprocessWorker] launching cmd=['/tmp/comfytest-home/.pixi/bin/pixi', 'run', '--as-is', '--manifest-path', '/tmp/comfytest-home/.ce/pixi.toml', '-e', 'sharp-nodes', 'python', '/tmp/comfyui_pvenv_dtk9es_f/persistent_worker.py', 'abstract://comfy_worker_cf1b3b477ca6']...
|
||
[13:21] [ComfyUI] [32m[INFO][0m Inputs: {"preview_gaussian": "", "ply_path": ["7", 0], "extrinsics": ["7", 1], "intrinsics": ["7", 2]}
|
||
[13:21] [ComfyUI] [SubprocessWorker] socket_addr=abstract://comfy_worker_cf1b3b477ca6 (abstract, no filesystem path)
|
||
[13:21] [ComfyUI] [32m[INFO][0m Generated prompt_id: 891aa0c0-2308-4c2f-8512-c5e3736a0440
|
||
[13:21] [ComfyUI] [32m[INFO][0m Calling execution.validate_prompt()...
|
||
[13:21] [ComfyUI] [32m[INFO][0m Validation result: valid=True
|
||
[13:21] [ComfyUI] [32m[INFO][0m === Validation PASSED ===
|
||
[13:21] [ComfyUI] [32m[INFO][0m got prompt
|
||
[13:21] [ComfyUI] [comfy-env] Running LoadImageWithExif: image: 'eth3d.png', default_focal_mm: 30.0
|
||
[13:21] [ComfyUI] [VRAM] Before LoadImageWithExif: 5027 / 24122 MB
|
||
[13:21] [ComfyUI] [SubprocessWorker] call_method: nodes.load_image_exif.LoadImageWithExif.EXECUTE_NORMALIZED
|
||
[13:21] [ComfyUI] [SubprocessWorker] acquired lock, ensuring started...
|
||
[13:21] [ComfyUI] [ComfyUI-Sharp] Health check: ping (timeout=5.0s)...
|
||
[13:21] [ComfyUI] [ComfyUI-Sharp] Health check: failed
|
||
[13:21] [ComfyUI] [ComfyUI-Sharp] Socket unhealthy, restarting worker...
|
||
[13:21] [ComfyUI] [comfy-env] Invalidated 1 stale model patchers (will be cleaned up during next unload)
|
||
[13:23] [ComfyUI] [worker:ComfyUI-Sharp] ERROR: Failed to import comfy_kitchen, Error: No module named 'comfy_kitchen', fp8 and fp4 support will not be available.
|
||
[13:23] [ComfyUI] [worker:ComfyUI-Sharp] WARNING: comfy_kitchen does not support stochastic FP8 rounding, please update comfy_kitchen.
|
||
[13:23] [ComfyUI] [SubprocessWorker] worker started/confirmed
|
||
[13:23] [ComfyUI] [SubprocessWorker] serializing kwargs to shm...
|
||
[13:23] [ComfyUI] [SubprocessWorker] created 0 shm blocks
|
||
[13:23] [ComfyUI] [SubprocessWorker] sending request via socket...
|
||
[13:23] [ComfyUI] [SubprocessWorker] call_id=10 sending call_method
|
||
[13:23] [ComfyUI] [SubprocessWorker] got response: ok
|
||
[13:23] [ComfyUI] [comfy-env] [VRAM] Before offload 'RGBGaussianPredictor_1' (2679 MB) -> cpu: 4817 / 24122 MB
|
||
[13:23] [ComfyUI] [ComfyUI-Sharp] Health check: ping (timeout=5.0s)...
|
||
[13:23] [ComfyUI] [ComfyUI-Sharp] Health check: ok
|
||
[13:23] [ComfyUI] [SubprocessWorker] call_id=11 sending model_to_device
|
||
[13:23] [ComfyUI] [1m[33m[WARNING][0m Model 'RGBGaussianPredictor_1' gone from worker (restarted?), treating as offloaded
|
||
[13:23] [ComfyUI] [comfy-env] [VRAM] After offload 'RGBGaussianPredictor_1' (2679 MB): 4817 / 24122 MB
|
||
[13:23] [ComfyUI] [comfy-env] LoadImageWithExif done (1.75s): result: NodeOutput
|
||
[13:23] [ComfyUI] [VRAM] After LoadImageWithExif: 4817 / 24122 MB
|
||
[13:23] [ComfyUI] [comfy-env] Running LoadSharpModel: precision: 'auto'
|
||
[13:23] [ComfyUI] [VRAM] Before LoadSharpModel: 4817 / 24122 MB
|
||
[13:23] [ComfyUI] [SubprocessWorker] call_method: nodes.load_model.LoadSharpModel.EXECUTE_NORMALIZED
|
||
[13:23] [ComfyUI] [SubprocessWorker] acquired lock, ensuring started...
|
||
[13:23] [ComfyUI] [ComfyUI-Sharp] Health check: ping (timeout=5.0s)...
|
||
[13:23] [ComfyUI] [ComfyUI-Sharp] Health check: ok
|
||
[13:23] [ComfyUI] [SubprocessWorker] worker started/confirmed
|
||
[13:23] [ComfyUI] [SubprocessWorker] serializing kwargs to shm...
|
||
[13:23] [ComfyUI] [SubprocessWorker] created 0 shm blocks
|
||
[13:23] [ComfyUI] [SubprocessWorker] sending request via socket...
|
||
[13:23] [ComfyUI] [SubprocessWorker] call_id=12 sending call_method
|
||
[13:23] [ComfyUI] [worker:ComfyUI-Sharp] [LoadSharpModel] precision='auto' -> dtype=bf16 (device=cuda:0)
|
||
[13:23] [ComfyUI] [worker:ComfyUI-Sharp] [LoadSharpModel] checkpoint already present, reusing (no download): /workspaces/Sharp-2000/ComfyUI/models/sharp/sharp_2572gikvuh.pt (2679.6 MB)
|
||
[13:23] [ComfyUI] [worker:ComfyUI-Sharp] [LoadSharpModel] checkpoint ready: /workspaces/Sharp-2000/ComfyUI/models/sharp/sharp_2572gikvuh.pt (2679.6 MB)
|
||
[13:23] [ComfyUI] [worker:ComfyUI-Sharp] [LoadSharpModel] config: precision=auto -> dtype=bf16
|
||
[13:23] [ComfyUI] [SubprocessWorker] got response: ok
|
||
[13:23] [ComfyUI] [comfy-env] LoadSharpModel done (0.07s): result: NodeOutput
|
||
[13:23] [ComfyUI] [VRAM] After LoadSharpModel: 4817 / 24122 MB
|
||
[13:23] [ComfyUI] [comfy-env] Running SharpPredict: focal_length_mm: 20.0, output_prefix: 'sharp', model: dict, image: torch.float32 [1,1011,1520,3] cpu
|
||
[13:23] [ComfyUI] [VRAM] Before SharpPredict: 4817 / 24122 MB
|
||
[13:23] [ComfyUI] [SubprocessWorker] call_method: nodes.predict.SharpPredict.EXECUTE_NORMALIZED
|
||
[13:23] [ComfyUI] [SubprocessWorker] acquired lock, ensuring started...
|
||
[13:23] [ComfyUI] [ComfyUI-Sharp] Health check: ping (timeout=5.0s)...
|
||
[13:23] [ComfyUI] [ComfyUI-Sharp] Health check: ok
|
||
[13:23] [ComfyUI] [SubprocessWorker] worker started/confirmed
|
||
[13:23] [ComfyUI] [comfy-env] PRE-SERIALIZE 'image' shape: torch.Size([1, 1011, 1520, 3])
|
||
[13:23] [ComfyUI] [SubprocessWorker] serializing kwargs to shm...
|
||
[13:23] [ComfyUI] [SubprocessWorker] created 0 shm blocks
|
||
[13:23] [ComfyUI] [SubprocessWorker] sending request via socket...
|
||
[13:23] [ComfyUI] [SubprocessWorker] call_id=13 sending call_method
|
||
[13:23] [ComfyUI] [worker:ComfyUI-Sharp] [comfy-env] _from_shm got dict with keys: ['__type__', 'strategy', 'parent_pid', 'fd', 'storage_size']
|
||
[13:23] [ComfyUI] [worker:ComfyUI-Sharp] [comfy-env] DESERIALIZE TensorRef: tensor_size=[1, 1011, 1520, 3]
|
||
[13:23] [ComfyUI] [worker:ComfyUI-Sharp] [comfy-env] DESERIALIZED tensor shape: torch.Size([1, 1011, 1520, 3])
|
||
[13:24] Frame 2 saved (frame_001.jpg, t=2.3s)
|
||
[13:24] [capture-periodic] freeze=9ms shot=105ms unfreeze=1ms saved=True
|
||
[13:25] [ComfyUI] [worker:ComfyUI-Sharp] [LoadSharpModel] loading checkpoint from /workspaces/Sharp-2000/ComfyUI/models/sharp/sharp_2572gikvuh.pt (dtype=bf16)
|
||
[13:26] Frame 3 saved (frame_002.jpg, t=4.5s)
|
||
[13:26] [capture-periodic] freeze=1ms shot=101ms unfreeze=2ms saved=True
|
||
[13:26] [ComfyUI] [worker:ComfyUI-Sharp] [LoadSharpModel] initializing model on meta device...
|
||
[13:26] [ComfyUI] [worker:ComfyUI-Sharp] [LoadSharpModel] model ready (torch.bfloat16)
|
||
[13:26] [ComfyUI] [SubprocessWorker] callback 'request_vram_budget' from call_id=13
|
||
[13:26] [ComfyUI] [comfy-env] VRAM request: 2.81GB, free before eviction: 20.24GB
|
||
[13:26] [ComfyUI] [comfy-env] VRAM after eviction: 20.24GB
|
||
[13:27] [ComfyUI] [worker:ComfyUI-Sharp] [VRAM] +715MB (now 715MB) reserved=736MB peak=715MB
|
||
[13:27] [capture-loop] iter=50 t=5.6s state={'complete': False, 'error': None, 'executedCount': 0, 'wsState': 1} eval_ms=2 ram=12.6/31.3GB (40%) swap=3.5/32.0GB (11%) cpu=71% browser_rss=0.88GB
|
||
[13:28] [ComfyUI] [worker:ComfyUI-Sharp] [VRAM] +2589MB (now 3304MB) reserved=3456MB peak=3314MB
|
||
[13:29] [ComfyUI] [worker:ComfyUI-Sharp] [VRAM] +3748MB (now 7053MB) reserved=7744MB peak=7053MB
|
||
[13:30] [ComfyUI] [worker:ComfyUI-Sharp] [VRAM] -2890MB (now 4163MB) reserved=7744MB peak=7053MB
|
||
[13:31] [ComfyUI] [worker:ComfyUI-Sharp] [VRAM] +234MB (now 4397MB) reserved=7424MB peak=7053MB
|
||
[13:31] [ComfyUI] [SubprocessWorker] callback 'report_progress' from call_id=13
|
||
[13:31] [ComfyUI] [SubprocessWorker] got response: ok
|
||
[13:31] [ComfyUI] [comfy-env] Created 1 model patchers: ['RGBGaussianPredictor_1']
|
||
[13:31] [ComfyUI] [ComfyUI-GaussianPack] python: /tmp/comfytest-home/.ce/.pixi/envs/gaussianpack-nodes/bin/python
|
||
[13:31] [ComfyUI] [comfy-env] SharpPredict done (7.76s): result: NodeOutput
|
||
[13:31] [ComfyUI] [ComfyUI-GaussianPack] sys_path sent to worker: ['/workspaces/Sharp-2000/ComfyUI', '/workspaces/Sharp-2000/ComfyUI/custom_nodes/ComfyUI-GaussianPack', '/tmp/comfytest-home/.ce/.pixi/envs/gaussianpack-nodes/lib/python3.1/site-packages', '/workspaces/Sharp-2000/ComfyUI/custom_nodes/ComfyUI-GaussianPack']
|
||
[13:31] [ComfyUI] [SubprocessWorker] is_pixi=True, python=/tmp/comfytest-home/.ce/.pixi/envs/gaussianpack-nodes/bin/python
|
||
[13:31] [ComfyUI] [VRAM] After SharpPredict: 12355 / 24122 MB
|
||
[13:31] [ComfyUI] [SubprocessWorker] launching cmd=['/tmp/comfytest-home/.pixi/bin/pixi', 'run', '--as-is', '--manifest-path', '/tmp/comfytest-home/.ce/pixi.toml', '-e', 'gaussianpack-nodes', 'python', '/tmp/comfyui_pvenv_pzbmli8e/persistent_worker.py', 'abstract://comfy_worker_50a848f354a1']...
|
||
[13:31] [ComfyUI] [VRAM] Loaded: SubprocessModel (2679 MB)
|
||
[13:31] [ComfyUI] [SubprocessWorker] socket_addr=abstract://comfy_worker_50a848f354a1 (abstract, no filesystem path)
|
||
[13:31] [ComfyUI] [comfy-env] Running PreviewGaussianSharp: ply_path: '/workspaces/Sharp-2000/ComfyUI/output/sharp_178086325915..., extrinsics: list[4], intrinsics: list[3]
|
||
[13:31] [ComfyUI] [VRAM] Before PreviewGaussianSharp: 12355 / 24122 MB
|
||
[13:31] [ComfyUI] [VRAM] Loaded: SubprocessModel (2679 MB)
|
||
[13:31] [ComfyUI] [SubprocessWorker] call_method: nodes.preview_gaussian_sharp.PreviewGaussianSharp.EXECUTE_NORMALIZED
|
||
[13:31] [ComfyUI] [SubprocessWorker] acquired lock, ensuring started...
|
||
[13:31] [ComfyUI] [ComfyUI-GaussianPack] Health check: ping (timeout=5.0s)...
|
||
[13:31] [ComfyUI] [ComfyUI-GaussianPack] Health check: failed
|
||
[13:31] [ComfyUI] [ComfyUI-GaussianPack] Socket unhealthy, restarting worker...
|
||
[13:32] [capture-loop] iter=100 t=10.9s state={'complete': False, 'error': None, 'executedCount': 0, 'wsState': 1} eval_ms=1 ram=14.9/31.3GB (48%) swap=3.5/32.0GB (11%) cpu=14% browser_rss=0.88GB
|
||
[13:32] [ComfyUI] [SubprocessWorker] worker started/confirmed
|
||
[13:32] [ComfyUI] [SubprocessWorker] serializing kwargs to shm...
|
||
[13:32] [ComfyUI] [SubprocessWorker] created 0 shm blocks
|
||
[13:32] [ComfyUI] [SubprocessWorker] sending request via socket...
|
||
[13:32] [ComfyUI] [SubprocessWorker] call_id=4 sending call_method
|
||
[13:32] Frame 4 saved (frame_003.jpg, t=11.1s)
|
||
[13:32] [capture-periodic] freeze=1ms shot=105ms unfreeze=1ms saved=True
|
||
[13:32] [ComfyUI] [worker:ComfyUI-GaussianPack] WARNING: SPZ route not registered (ModuleNotFoundError: No module named 'comfy_aimdo')
|
||
[13:32] [ComfyUI] [SubprocessWorker] got response: ok
|
||
[13:32] [ComfyUI] [comfy-env] PreviewGaussianSharp done (1.43s): result: NodeOutput
|
||
[13:32] [ComfyUI] [VRAM] After PreviewGaussianSharp: 12355 / 24122 MB
|
||
[13:32] [ComfyUI] [VRAM] Loaded: SubprocessModel (2679 MB)
|
||
[13:32] [ComfyUI] [32m[INFO][0m [32mPrompt executed in 11.02 seconds[0m
|
||
[13:32] Node executed (1 total), capturing...
|
||
[13:33] Frame 5 saved (frame_004.jpg, t=11.5s)
|
||
[13:33] [capture-node] freeze=1ms shot=187ms unfreeze=0ms saved=True
|
||
[13:33] Execution complete (t=11.5s)
|
||
[13:34] [3d-wait] Phase 1: Waiting for 'Loading 3D Model' text to disappear...
|
||
[13:34] [3d-wait] Phase 1 done in 0.2s
|
||
[13:34] [3d-wait] Phase 2: iframes=1
|
||
[13:34] [3d-wait] iframe viewer_ready=True (matched 1 console logs)
|
||
[13:34] [3d-wait] Unfrozen in 0.001s, rendering for 5s...
|
||
[13:42] [3d-wait] JS halted via CDP after 8.5s
|
||
[14:06] [3d-wait] Re-frozen in 32.5s
|
||
[14:06] [3d-wait] Total 3D wait: 32.7s
|
||
[14:06] Captured 5 unique frames over 45.09s
|
||
[14:06] [debug] iframes: 1
|
||
[14:06] [debug] iframe[0]: src=http://127.0.0.1:41888/extensions/ComfyUI-GaussianPack/viewer_gaussian_sharp.htm, canvas=1520x1011, rafFrozen=True
|
||
[14:06] [timing] trigger_3d_previews: 0.0s
|
||
[14:09] Saved high-quality screenshot: sharp_exif_executed.png
|
||
[14:09] [timing] final_screenshot: 0.3s
|
||
[14:09] [ComfyUI] [comfy-env] [VRAM] Before offload 'RGBGaussianPredictor_1' (2679 MB) -> cpu: 12355 / 24122 MB
|
||
[14:09] Capturing execution frames: vanilla_vs_image_depth_gaussians.json
|
||
[14:09] [ComfyUI] [ComfyUI-Sharp] Health check: ping (timeout=5.0s)...
|
||
[14:09] [ComfyUI] [ComfyUI-Sharp] python: /tmp/comfytest-home/.ce/.pixi/envs/sharp-nodes/bin/python
|
||
[14:09] [ComfyUI] [ComfyUI-Sharp] Health check: failed
|
||
[14:09] [ComfyUI] [ComfyUI-Sharp] sys_path sent to worker: ['/workspaces/Sharp-2000/ComfyUI', '/workspaces/Sharp-2000/ComfyUI/custom_nodes/ComfyUI-Sharp', '/tmp/comfytest-home/.ce/.pixi/envs/sharp-nodes/lib/python3.1/site-packages', '/workspaces/Sharp-2000/ComfyUI/custom_nodes/ComfyUI-Sharp']
|
||
[14:09] [ComfyUI] [SubprocessWorker] is_pixi=True, python=/tmp/comfytest-home/.ce/.pixi/envs/sharp-nodes/bin/python
|
||
[14:09] [ComfyUI] [ComfyUI-Sharp] Socket unhealthy, restarting worker...
|
||
[14:09] [ComfyUI] [comfy-env] Invalidated 1 stale model patchers (will be cleaned up during next unload)
|
||
[14:09] [ComfyUI] [SubprocessWorker] launching cmd=['/tmp/comfytest-home/.pixi/bin/pixi', 'run', '--as-is', '--manifest-path', '/tmp/comfytest-home/.ce/pixi.toml', '-e', 'sharp-nodes', 'python', '/tmp/comfyui_pvenv_dtk9es_f/persistent_worker.py', 'abstract://comfy_worker_b9bd9414002b']...
|
||
[14:09] [ComfyUI] [SubprocessWorker] socket_addr=abstract://comfy_worker_b9bd9414002b (abstract, no filesystem path)
|
||
[14:10] [ComfyUI] [worker:ComfyUI-Sharp] ERROR: Failed to import comfy_kitchen, Error: No module named 'comfy_kitchen', fp8 and fp4 support will not be available.
|
||
[14:10] [ComfyUI] [worker:ComfyUI-Sharp] WARNING: comfy_kitchen does not support stochastic FP8 rounding, please update comfy_kitchen.
|
||
[14:10] [ComfyUI] [SubprocessWorker] call_id=14 sending model_to_device
|
||
[14:10] [ComfyUI] [1m[33m[WARNING][0m Model 'RGBGaussianPredictor_1' gone from worker (restarted?), treating as offloaded
|
||
[14:10] [ComfyUI] [comfy-env] [VRAM] After offload 'RGBGaussianPredictor_1' (2679 MB): 4817 / 24122 MB
|
||
[14:10] [ComfyUI] [32m[INFO][0m Using RAM pressure cache.
|
||
[14:14] Frame 1 saved (frame_000.jpg, t=0.0s)
|
||
[14:14] Validating workflow...
|
||
[14:14] [ComfyUI] [32m[INFO][0m === /validate endpoint called ===
|
||
[14:14] [ComfyUI] [32m[INFO][0m Received JSON with keys: ['prompt']
|
||
[14:14] Queuing workflow for execution...
|
||
[14:14] [ComfyUI] [32m[INFO][0m Prompt has 8 nodes
|
||
[14:14] [ComfyUI] [32m[INFO][0m Node 7: LoadImage
|
||
[14:14] [ComfyUI] [32m[INFO][0m Inputs: {"image": "middlebury.jpg"}
|
||
[14:14] [ComfyUI] [32m[INFO][0m Node 9: LoadSharpModel
|
||
[14:14] [ComfyUI] [32m[INFO][0m Inputs: {"precision": "auto"}
|
||
[14:14] [ComfyUI] [32m[INFO][0m Node 47: SharpPredictMetricDepth
|
||
[14:14] [ComfyUI] [32m[INFO][0m Inputs: {"focal_length_mm": 30, "model": ["9", 0], "image": ["7", 0]}
|
||
[14:14] [ComfyUI] [32m[INFO][0m Node 57: SharpPredict
|
||
[14:14] [ComfyUI] [32m[INFO][0m Inputs: {"focal_length_mm": 30, "output_prefix": "sharp", "model": ["9", 0], "image": ["58", 0]}
|
||
[14:14] [ComfyUI] [32m[INFO][0m Node 58: ImageFromBatch
|
||
[14:14] [ComfyUI] [32m[INFO][0m Inputs: {"batch_index": 0, "length": 1, "image": ["7", 0]}
|
||
[14:14] [ComfyUI] [32m[INFO][0m Node 83: SharpPredictGaussiansFromMetricDepth
|
||
[14:14] [ComfyUI] [32m[INFO][0m Inputs: {"snap_to_external_depth": "none", "depth_convention": "planar_z", "focal_length_mm": 30, "output_prefix": "sharp_aligned", "save_background_layer": true, "edge_crop": 0, "model": ["9", 0], "image": [
|
||
[14:14] [ComfyUI] [32m[INFO][0m Node 92: PreviewGaussianSharp
|
||
[14:14] [ComfyUI] [32m[INFO][0m Inputs: {"preview_gaussian": "", "ply_path": ["83", 0], "extrinsics": ["83", 2], "intrinsics": ["83", 3]}
|
||
[14:14] [ComfyUI] [32m[INFO][0m Node 93: PreviewGaussianSharp
|
||
[14:14] [ComfyUI] [32m[INFO][0m Inputs: {"preview_gaussian": "", "ply_path": ["57", 0], "extrinsics": ["57", 1], "intrinsics": ["57", 2]}
|
||
[14:14] [ComfyUI] [32m[INFO][0m Generated prompt_id: 10a95d73-8465-40ed-a51e-7279dce138cd
|
||
[14:14] [ComfyUI] [32m[INFO][0m Calling execution.validate_prompt()...
|
||
[14:14] [ComfyUI] [32m[INFO][0m Validation result: valid=True
|
||
[14:14] [ComfyUI] [32m[INFO][0m === Validation PASSED ===
|
||
[14:14] [ComfyUI] [32m[INFO][0m got prompt
|
||
[14:14] [ComfyUI] [comfy-env] Running LoadSharpModel: precision: 'auto'
|
||
[14:14] [ComfyUI] [VRAM] Before LoadSharpModel: 4817 / 24122 MB
|
||
[14:14] [ComfyUI] [SubprocessWorker] call_method: nodes.load_model.LoadSharpModel.EXECUTE_NORMALIZED
|
||
[14:14] [ComfyUI] [SubprocessWorker] acquired lock, ensuring started...
|
||
[14:14] [ComfyUI] [ComfyUI-Sharp] Health check: ping (timeout=5.0s)...
|
||
[14:14] [ComfyUI] [ComfyUI-Sharp] Health check: ok
|
||
[14:14] [ComfyUI] [SubprocessWorker] worker started/confirmed
|
||
[14:14] [ComfyUI] [SubprocessWorker] serializing kwargs to shm...
|
||
[14:14] [ComfyUI] [SubprocessWorker] created 0 shm blocks
|
||
[14:14] [ComfyUI] [SubprocessWorker] sending request via socket...
|
||
[14:14] [ComfyUI] [SubprocessWorker] call_id=15 sending call_method
|
||
[14:14] [ComfyUI] [worker:ComfyUI-Sharp] [LoadSharpModel] precision='auto' -> dtype=bf16 (device=cuda:0)
|
||
[14:14] [ComfyUI] [worker:ComfyUI-Sharp] [LoadSharpModel] checkpoint already present, reusing (no download): /workspaces/Sharp-2000/ComfyUI/models/sharp/sharp_2572gikvuh.pt (2679.6 MB)
|
||
[14:14] [ComfyUI] [worker:ComfyUI-Sharp] [LoadSharpModel] checkpoint ready: /workspaces/Sharp-2000/ComfyUI/models/sharp/sharp_2572gikvuh.pt (2679.6 MB)
|
||
[14:14] [ComfyUI] [worker:ComfyUI-Sharp] [LoadSharpModel] config: precision=auto -> dtype=bf16
|
||
[14:14] [ComfyUI] [SubprocessWorker] got response: ok
|
||
[14:14] [ComfyUI] [comfy-env] [VRAM] Before offload 'RGBGaussianPredictor_1' (2679 MB) -> cpu: 4817 / 24122 MB
|
||
[14:14] [ComfyUI] [ComfyUI-Sharp] Health check: ping (timeout=5.0s)...
|
||
[14:14] [ComfyUI] [ComfyUI-Sharp] Health check: ok
|
||
[14:14] [ComfyUI] [SubprocessWorker] call_id=16 sending model_to_device
|
||
[14:14] [ComfyUI] [1m[33m[WARNING][0m Model 'RGBGaussianPredictor_1' gone from worker (restarted?), treating as offloaded
|
||
[14:14] [ComfyUI] [comfy-env] [VRAM] After offload 'RGBGaussianPredictor_1' (2679 MB): 4817 / 24122 MB
|
||
[14:14] [ComfyUI] [comfy-env] LoadSharpModel done (0.26s): result: NodeOutput
|
||
[14:14] [ComfyUI] [VRAM] After LoadSharpModel: 4817 / 24122 MB
|
||
[14:14] [ComfyUI] [comfy-env] Running SharpPredictMetricDepth: focal_length_mm: 30.0, model: dict, image: torch.float32 [1,960,1416,3] cpu
|
||
[14:14] [ComfyUI] [VRAM] Before SharpPredictMetricDepth: 4817 / 24122 MB
|
||
[14:14] [ComfyUI] [SubprocessWorker] call_method: nodes.predict_metric_depth.SharpPredictMetricDepth.EXECUTE_NORMALIZED
|
||
[14:14] [ComfyUI] [SubprocessWorker] acquired lock, ensuring started...
|
||
[14:14] [ComfyUI] [ComfyUI-Sharp] Health check: ping (timeout=5.0s)...
|
||
[14:14] [ComfyUI] [ComfyUI-Sharp] Health check: ok
|
||
[14:14] [ComfyUI] [SubprocessWorker] worker started/confirmed
|
||
[14:14] [ComfyUI] [comfy-env] PRE-SERIALIZE 'image' shape: torch.Size([1, 960, 1416, 3])
|
||
[14:14] [ComfyUI] [SubprocessWorker] serializing kwargs to shm...
|
||
[14:14] [ComfyUI] [SubprocessWorker] created 0 shm blocks
|
||
[14:14] [ComfyUI] [SubprocessWorker] sending request via socket...
|
||
[14:14] [ComfyUI] [SubprocessWorker] call_id=17 sending call_method
|
||
[14:14] [ComfyUI] [worker:ComfyUI-Sharp] [comfy-env] _from_shm got dict with keys: ['__type__', 'strategy', 'parent_pid', 'fd', 'storage_size']
|
||
[14:14] [ComfyUI] [worker:ComfyUI-Sharp] [comfy-env] DESERIALIZE TensorRef: tensor_size=[1, 960, 1416, 3]
|
||
[14:14] [ComfyUI] [worker:ComfyUI-Sharp] [comfy-env] DESERIALIZED tensor shape: torch.Size([1, 960, 1416, 3])
|
||
[14:16] [ComfyUI] [worker:ComfyUI-Sharp] [LoadSharpModel] loading checkpoint from /workspaces/Sharp-2000/ComfyUI/models/sharp/sharp_2572gikvuh.pt (dtype=bf16)
|
||
[14:16] Frame 2 saved (frame_001.jpg, t=2.3s)
|
||
[14:16] [capture-periodic] freeze=1ms shot=108ms unfreeze=3ms saved=True
|
||
[14:18] [ComfyUI] [worker:ComfyUI-Sharp] [LoadSharpModel] initializing model on meta device...
|
||
[14:18] [ComfyUI] [worker:ComfyUI-Sharp] [LoadSharpModel] model ready (torch.bfloat16)
|
||
[14:18] [ComfyUI] [worker:ComfyUI-Sharp] [SharpPredictMetricDepth] intrinsics not wired -> using identity-style K (focal=1186.2px @ image 1416×960, 35mm-equiv 30.0mm). Pass intrinsics from PanoramaSplit for per-face accurate K.
|
||
[14:18] [ComfyUI] [SubprocessWorker] callback 'request_vram_budget' from call_id=17
|
||
[14:18] [ComfyUI] [comfy-env] VRAM request: 2.81GB, free before eviction: 20.24GB
|
||
[14:18] [ComfyUI] [comfy-env] VRAM after eviction: 20.24GB
|
||
[14:18] [ComfyUI] [worker:ComfyUI-Sharp] [VRAM] +282MB (now 282MB) reserved=288MB peak=282MB
|
||
[14:18] Frame 3 saved (frame_002.jpg, t=4.5s)
|
||
[14:18] [capture-periodic] freeze=1ms shot=111ms unfreeze=1ms saved=True
|
||
[14:19] [ComfyUI] [worker:ComfyUI-Sharp] [VRAM] +2965MB (now 3248MB) reserved=3456MB peak=3284MB
|
||
[14:19] [capture-loop] iter=50 t=5.6s state={'complete': False, 'error': None, 'executedCount': 0, 'wsState': 1} eval_ms=1 ram=10.6/31.3GB (34%) swap=3.5/32.0GB (11%) cpu=72% browser_rss=0.86GB
|
||
[14:20] [ComfyUI] [worker:ComfyUI-Sharp] [VRAM] -276MB (now 2973MB) reserved=3360MB peak=3339MB
|
||
[14:21] [ComfyUI] [worker:ComfyUI-Sharp] [VRAM] +1188MB (now 4161MB) reserved=7712MB peak=7051MB
|
||
[14:22] [ComfyUI] [worker:ComfyUI-Sharp] [SharpPredictMetricDepth] 1 face(s) @ 1536²; layer0/layer1 depth median=2.12/2.12m, K_1536 fx->1286.7; points_raw ||v||=1.32–3.07m; 4.0s
|
||
[14:22] [ComfyUI] [SubprocessWorker] got response: ok
|
||
[14:22] [ComfyUI] [comfy-env] Created 1 model patchers: ['RGBGaussianPredictor_1']
|
||
[14:22] [ComfyUI] [comfy-env] SharpPredictMetricDepth done (7.52s): result: NodeOutput
|
||
[14:22] [ComfyUI] [VRAM] After SharpPredictMetricDepth: 9277 / 24122 MB
|
||
[14:22] [ComfyUI] [VRAM] Loaded: SubprocessModel (2679 MB)
|
||
[14:22] [ComfyUI] [comfy-env] Running SharpPredictGaussiansFromMetricDepth: snap_to_external_depth: 'none', depth_convention: 'planar_z', focal_length_mm: 30.0, output_prefix: 'sharp_aligned', save_background_layer: True, edge_crop: 0.0, model: dict, image: torch.float32 [1,960,1416,3] cpu, metric_depth_layer0: torch.float32 [1,1536,1536,3] cpu
|
||
[14:22] [ComfyUI] [VRAM] Before SharpPredictGaussiansFromMetricDepth: 9277 / 24122 MB
|
||
[14:22] [ComfyUI] [VRAM] Loaded: SubprocessModel (2679 MB)
|
||
[14:22] [ComfyUI] [SubprocessWorker] call_method: nodes.predict_gaussians_from_depth.SharpPredictGaussiansFromMetricDepth.EXECUTE_NORMALIZED
|
||
[14:22] [ComfyUI] [SubprocessWorker] acquired lock, ensuring started...
|
||
[14:22] [ComfyUI] [ComfyUI-Sharp] Health check: ping (timeout=5.0s)...
|
||
[14:22] [ComfyUI] [ComfyUI-Sharp] Health check: ok
|
||
[14:22] [ComfyUI] [SubprocessWorker] worker started/confirmed
|
||
[14:22] [ComfyUI] [comfy-env] PRE-SERIALIZE 'image' shape: torch.Size([1, 960, 1416, 3])
|
||
[14:22] [ComfyUI] [comfy-env] PRE-SERIALIZE 'metric_depth_layer0' shape: torch.Size([1, 1536, 1536, 3])
|
||
[14:22] [ComfyUI] [SubprocessWorker] serializing kwargs to shm...
|
||
[14:22] [ComfyUI] [SubprocessWorker] created 0 shm blocks
|
||
[14:22] [ComfyUI] [SubprocessWorker] sending request via socket...
|
||
[14:22] [ComfyUI] [SubprocessWorker] call_id=18 sending call_method
|
||
[14:22] [ComfyUI] [worker:ComfyUI-Sharp] [VRAM] -1474MB (now 2688MB) reserved=4384MB peak=7051MB
|
||
[14:22] [ComfyUI] [worker:ComfyUI-Sharp] [comfy-env] _from_shm got dict with keys: ['__type__', 'strategy', 'parent_pid', 'fd', 'storage_size']
|
||
[14:22] [ComfyUI] [worker:ComfyUI-Sharp] [comfy-env] DESERIALIZE TensorRef: tensor_size=[1, 960, 1416, 3]
|
||
[14:22] [ComfyUI] [worker:ComfyUI-Sharp] [comfy-env] DESERIALIZED tensor shape: torch.Size([1, 960, 1416, 3])
|
||
[14:22] [ComfyUI] [worker:ComfyUI-Sharp] [comfy-env] _from_shm got dict with keys: ['__type__', 'strategy', 'parent_pid', 'fd', 'storage_size']
|
||
[14:22] [ComfyUI] [worker:ComfyUI-Sharp] [comfy-env] DESERIALIZE TensorRef: tensor_size=[1, 1536, 1536, 3]
|
||
[14:22] [ComfyUI] [worker:ComfyUI-Sharp] [comfy-env] DESERIALIZED tensor shape: torch.Size([1, 1536, 1536, 3])
|
||
[14:22] [ComfyUI] [worker:ComfyUI-Sharp] [SharpPredictGaussiansFromMetricDepth] metric_depth_layer1 unwired -> layer 1 will duplicate layer 0 (legacy behavior)
|
||
[14:22] [ComfyUI] [SubprocessWorker] callback 'request_vram_budget' from call_id=18
|
||
[14:22] [ComfyUI] [comfy-env] VRAM request: 2.81GB, free before eviction: 15.57GB
|
||
[14:22] [ComfyUI] [comfy-env] VRAM after eviction: 15.57GB
|
||
[14:22] [ComfyUI] [worker:ComfyUI-Sharp] [SharpPredictGaussiansFromMetricDepth] face 1/1: 1416×960, extrinsics=none, intrinsics=none, mask=no, snap=none, depth_conv=planar_z
|
||
[14:23] [ComfyUI] [worker:ComfyUI-Sharp] [VRAM] +2859MB (now 5547MB) reserved=7456MB peak=7051MB
|
||
[14:23] Frame 4 saved (frame_003.jpg, t=8.9s)
|
||
[14:23] [capture-periodic] freeze=1ms shot=114ms unfreeze=2ms saved=True
|
||
[14:23] [ComfyUI] [SubprocessWorker] callback 'report_progress' from call_id=18
|
||
[14:23] [ComfyUI] [worker:ComfyUI-Sharp] [SharpPredictGaussiansFromMetricDepth] 1 face(s) -> 1.18M gaussians total (both layers, snap=none); saved to /workspaces/Sharp-2000/ComfyUI/output/sharp_aligned_1780863314728.ply; 1.2s
|
||
[14:23] [ComfyUI] [SubprocessWorker] got response: ok
|
||
[14:23] [ComfyUI] [comfy-env] SharpPredictGaussiansFromMetricDepth done (1.44s): result: NodeOutput
|
||
[14:23] [ComfyUI] [VRAM] After SharpPredictGaussiansFromMetricDepth: 12387 / 24122 MB
|
||
[14:23] [ComfyUI] [VRAM] Loaded: SubprocessModel (2679 MB)
|
||
[14:23] [ComfyUI] [comfy-env] Running PreviewGaussianSharp: ply_path: '/workspaces/Sharp-2000/ComfyUI/output/sharp_aligned_1780..., extrinsics: list[4], intrinsics: list[3]
|
||
[14:23] [ComfyUI] [VRAM] Before PreviewGaussianSharp: 12387 / 24122 MB
|
||
[14:23] [ComfyUI] [VRAM] Loaded: SubprocessModel (2679 MB)
|
||
[14:23] [ComfyUI] [SubprocessWorker] call_method: nodes.preview_gaussian_sharp.PreviewGaussianSharp.EXECUTE_NORMALIZED
|
||
[14:23] [ComfyUI] [SubprocessWorker] acquired lock, ensuring started...
|
||
[14:23] [ComfyUI] [ComfyUI-GaussianPack] Health check: ping (timeout=5.0s)...
|
||
[14:23] [ComfyUI] [ComfyUI-GaussianPack] Health check: ok
|
||
[14:23] [ComfyUI] [SubprocessWorker] worker started/confirmed
|
||
[14:23] [ComfyUI] [SubprocessWorker] serializing kwargs to shm...
|
||
[14:23] [ComfyUI] [SubprocessWorker] created 0 shm blocks
|
||
[14:23] [ComfyUI] [SubprocessWorker] sending request via socket...
|
||
[14:23] [ComfyUI] [SubprocessWorker] call_id=5 sending call_method
|
||
[14:23] [ComfyUI] [SubprocessWorker] got response: ok
|
||
[14:23] [ComfyUI] [comfy-env] PreviewGaussianSharp done (0.06s): result: NodeOutput
|
||
[14:23] [ComfyUI] [VRAM] After PreviewGaussianSharp: 12387 / 24122 MB
|
||
[14:23] [ComfyUI] [VRAM] Loaded: SubprocessModel (2679 MB)
|
||
[14:23] [ComfyUI] [comfy-env] Running SharpPredict: focal_length_mm: 30.0, output_prefix: 'sharp', model: dict, image: torch.float32 [1,960,1416,3] cpu
|
||
[14:23] [ComfyUI] [VRAM] Before SharpPredict: 12387 / 24122 MB
|
||
[14:23] [ComfyUI] [VRAM] Loaded: SubprocessModel (2679 MB)
|
||
[14:23] [ComfyUI] [SubprocessWorker] call_method: nodes.predict.SharpPredict.EXECUTE_NORMALIZED
|
||
[14:23] [ComfyUI] [SubprocessWorker] acquired lock, ensuring started...
|
||
[14:23] [ComfyUI] [ComfyUI-Sharp] Health check: ping (timeout=5.0s)...
|
||
[14:23] [ComfyUI] [ComfyUI-Sharp] Health check: ok
|
||
[14:23] [ComfyUI] [SubprocessWorker] worker started/confirmed
|
||
[14:23] [ComfyUI] [comfy-env] PRE-SERIALIZE 'image' shape: torch.Size([1, 960, 1416, 3])
|
||
[14:23] [ComfyUI] [SubprocessWorker] serializing kwargs to shm...
|
||
[14:23] [ComfyUI] [SubprocessWorker] created 0 shm blocks
|
||
[14:23] [ComfyUI] [SubprocessWorker] sending request via socket...
|
||
[14:23] [ComfyUI] [SubprocessWorker] call_id=19 sending call_method
|
||
[14:23] [ComfyUI] [worker:ComfyUI-Sharp] [comfy-env] _from_shm got dict with keys: ['__type__', 'strategy', 'parent_pid', 'fd', 'storage_size']
|
||
[14:23] [ComfyUI] [worker:ComfyUI-Sharp] [comfy-env] DESERIALIZE TensorRef: tensor_size=[1, 960, 1416, 3]
|
||
[14:23] [ComfyUI] [worker:ComfyUI-Sharp] [comfy-env] DESERIALIZED tensor shape: torch.Size([1, 960, 1416, 3])
|
||
[14:23] [ComfyUI] [SubprocessWorker] callback 'request_vram_budget' from call_id=19
|
||
[14:23] Node executed (1 total), capturing...
|
||
[14:23] [ComfyUI] [comfy-env] VRAM request: 2.81GB, free before eviction: 12.31GB
|
||
[14:23] [ComfyUI] [comfy-env] VRAM after eviction: 12.31GB
|
||
[14:24] [ComfyUI] [worker:ComfyUI-Sharp] [VRAM] -2245MB (now 3302MB) reserved=3456MB peak=7051MB
|
||
[14:25] Frame 5 saved (frame_004.jpg, t=9.8s)
|
||
[14:25] [capture-node] freeze=657ms shot=372ms unfreeze=3ms saved=True
|
||
[14:25] [ComfyUI] [worker:ComfyUI-Sharp] [VRAM] +291MB (now 3594MB) reserved=4064MB peak=7051MB
|
||
[14:26] [ComfyUI] [worker:ComfyUI-Sharp] [VRAM] +567MB (now 4161MB) reserved=7968MB peak=7051MB
|
||
[14:27] [ComfyUI] [worker:ComfyUI-Sharp] [VRAM] +337MB (now 4499MB) reserved=6816MB peak=7051MB
|
||
[14:28] [ComfyUI] [SubprocessWorker] callback 'report_progress' from call_id=19
|
||
[14:28] [ComfyUI] [SubprocessWorker] got response: ok
|
||
[14:28] [ComfyUI] [comfy-env] SharpPredict done (4.48s): result: NodeOutput
|
||
[14:28] [ComfyUI] [VRAM] After SharpPredict: 11747 / 24122 MB
|
||
[14:28] [ComfyUI] [VRAM] Loaded: SubprocessModel (2679 MB)
|
||
[14:28] [ComfyUI] [comfy-env] Running PreviewGaussianSharp: ply_path: '/workspaces/Sharp-2000/ComfyUI/output/sharp_178086331613..., extrinsics: list[4], intrinsics: list[3]
|
||
[14:28] [ComfyUI] [VRAM] Before PreviewGaussianSharp: 11747 / 24122 MB
|
||
[14:28] [ComfyUI] [VRAM] Loaded: SubprocessModel (2679 MB)
|
||
[14:28] [ComfyUI] [SubprocessWorker] call_method: nodes.preview_gaussian_sharp.PreviewGaussianSharp.EXECUTE_NORMALIZED
|
||
[14:28] [ComfyUI] [SubprocessWorker] acquired lock, ensuring started...
|
||
[14:28] [ComfyUI] [ComfyUI-GaussianPack] Health check: ping (timeout=5.0s)...
|
||
[14:28] [ComfyUI] [ComfyUI-GaussianPack] Health check: ok
|
||
[14:28] [ComfyUI] [SubprocessWorker] worker started/confirmed
|
||
[14:28] [ComfyUI] [SubprocessWorker] serializing kwargs to shm...
|
||
[14:28] [ComfyUI] [SubprocessWorker] created 0 shm blocks
|
||
[14:28] [ComfyUI] [SubprocessWorker] sending request via socket...
|
||
[14:28] [ComfyUI] [SubprocessWorker] call_id=6 sending call_method
|
||
[14:28] [ComfyUI] [SubprocessWorker] got response: ok
|
||
[14:28] [ComfyUI] [comfy-env] PreviewGaussianSharp done (0.07s): result: NodeOutput
|
||
[14:28] [ComfyUI] [VRAM] After PreviewGaussianSharp: 11747 / 24122 MB
|
||
[14:28] [ComfyUI] [VRAM] Loaded: SubprocessModel (2679 MB)
|
||
[14:28] [ComfyUI] [32m[INFO][0m [32mPrompt executed in 13.86 seconds[0m
|
||
[14:28] [ComfyUI] [comfy-env] [VRAM] Before offload 'RGBGaussianPredictor_1' (2679 MB) -> cpu: 11747 / 24122 MB
|
||
[14:28] [ComfyUI] [ComfyUI-Sharp] Health check: ping (timeout=5.0s)...
|
||
[14:28] [ComfyUI] [ComfyUI-Sharp] Health check: ok
|
||
[14:28] [ComfyUI] [SubprocessWorker] call_id=20 sending model_to_device
|
||
[14:28] [ComfyUI] [worker:ComfyUI-Sharp] [VRAM] -1972MB (now 2527MB) reserved=6816MB peak=7051MB
|
||
[14:29] [ComfyUI] [worker:ComfyUI-Sharp] [VRAM] -1293MB (now 1235MB) reserved=6816MB peak=7051MB
|
||
[14:30] [ComfyUI] [comfy-env] [VRAM] After offload 'RGBGaussianPredictor_1' (2679 MB): 5027 / 24122 MB
|
||
[14:30] [ComfyUI] [32m[INFO][0m Using RAM pressure cache.
|
||
[14:50] Frame 6 saved (frame_005.jpg, t=19.3s)
|
||
[14:50] [capture-periodic] freeze=8087ms shot=9009ms unfreeze=167ms saved=True
|
||
[14:59] Node executed (2 total), capturing...
|
||
[15:15] Frame 7 saved (frame_006.jpg, t=44.9s)
|
||
[15:15] [capture-node] freeze=7692ms shot=8241ms unfreeze=0ms saved=True
|
||
[15:15] Execution complete (t=44.9s)
|
||
[15:15] [3d-wait] Phase 1: Waiting for 'Loading 3D Model' text to disappear...
|
||
[15:15] [3d-wait] Phase 1 done in 0.0s
|
||
[15:15] [3d-wait] Phase 2: iframes=2
|
||
[15:15] [3d-wait] iframe viewer_ready=True (matched 2 console logs)
|
||
[15:15] [3d-wait] Unfrozen in 0.001s, rendering for 5s...
|
||
[15:31] [3d-wait] JS halted via CDP after 16.3s
|
||
[15:55] [3d-wait] Re-frozen in 40.6s
|
||
[15:55] [3d-wait] Total 3D wait: 40.6s
|
||
[15:55] Captured 7 unique frames over 101.53s
|
||
[15:55] [debug] iframes: 2
|
||
[15:55] [debug] iframe[0]: src=http://127.0.0.1:41888/extensions/ComfyUI-GaussianPack/viewer_gaussian_sharp.htm, canvas=1416x960, rafFrozen=True
|
||
[15:55] [debug] iframe[1]: src=http://127.0.0.1:41888/extensions/ComfyUI-GaussianPack/viewer_gaussian_sharp.htm, canvas=1416x960, rafFrozen=True
|
||
[15:55] [timing] trigger_3d_previews: 0.0s
|
||
[15:58] Saved high-quality screenshot: vanilla_vs_image_depth_gaussians_executed.png
|
||
[15:58] [timing] final_screenshot: 0.3s
|
||
[15:58] [ComfyUI] [32m[INFO][0m Using RAM pressure cache.
|
||
[15:58] Results saved to /logs/Sharp-2000/dev/linux-gpu/results.json
|
||
[15:58] Model report: 8 files, 3.8 GB -> /logs/Sharp-2000/dev/linux-gpu/models.json
|
||
[15:58] Saved: /logs/Sharp-2000/dev/linux-gpu/index.html
|
||
[15:58] [EXECUTION] PASSED
|
||
[15:58]
|
||
linux: PASSED
|
||
[15:58] Stopping ComfyUI server...
|