[00:00] Crash dump logging enabled: /logs/Sharp-2045/dev/linux-gpu/crash_dump.log [00:00] [00:00] [1/5] SYNTAX [00:00] ---------------------------------------- [00:00] [DEBUG] server=None, api=None [00:00] Found pyproject.toml (modern format) [00:00] Found requirements.txt (legacy format) [00:00] Unicode check: OK (all characters cp1252-safe) [00:00] Forbidden patterns check: OK [00:00] [SYNTAX] PASSED [00:00] [00:00] [2/5] INSTALL [00:00] ---------------------------------------- [00:00] [DEBUG] server=None, api=None [00:00] Setting up ComfyUI... [00:00] Creating virtual environment... [00:00] Running: uv venv /workspaces/Sharp-2045/.venv --python 3.11 [00:00] torch_version='2.10.0' -> pinning torch==2.10.0 torchvision==0.25.0 torchaudio==2.10.0 [00:00] Cloning ComfyUI (latest)... [00:00] Running: git clone --depth 1 https://github.com/comfyanonymous/ComfyUI.git /workspaces/Sharp-2045/ComfyUI [00:01] Pinning torch family from https://download.pytorch.org/whl/cu128: torch==2.10.0 torchvision==0.25.0 torchaudio==2.10.0 [00:01] Running: uv pip install --python /workspaces/Sharp-2045/.venv/bin/python --index-url https://download.pytorch.org/whl/cu128 --extra-index-url https://pypi.org/simple --index-strategy unsafe-best-match torch==2.10.0 torchvision==0.25.0 torchaudio==2.10.0 [00:40] Installing ComfyUI requirements... [00:40] Running: uv pip install --python /workspaces/Sharp-2045/.venv/bin/python --index-url https://download.pytorch.org/whl/cu128 --extra-index-url https://pypi.org/simple --index-strategy unsafe-best-match -r /workspaces/Sharp-2045/ComfyUI/requirements.txt [00:48] Installing custom node... [00:48] Copying ComfyUI-Sharp to custom_nodes/... [00:48] Installing node requirements... [00:48] Running: uv pip install --python /workspaces/Sharp-2045/.venv/bin/python --index-url https://download.pytorch.org/whl/cu128 --extra-index-url https://pypi.org/simple --index-strategy unsafe-best-match -r /workspaces/Sharp-2045/ComfyUI/custom_nodes/ComfyUI-Sharp/requirements.txt [00:51] Running install.py... [00:51] Running: /workspaces/Sharp-2045/.venv/bin/python /workspaces/Sharp-2045/ComfyUI/custom_nodes/ComfyUI-Sharp/install.py [00:51] [00:51] Installing 1 node dependencies... [00:51] Cloning ComfyUI-GeometryPack... [00:54] Installing requirements for ComfyUI-GeometryPack... [00:54] Running install.py for ComfyUI-GeometryPack... [00:56] [comfy-env] _discover: scanning /workspaces/Sharp-2045/ComfyUI/custom_nodes [00:56] [comfy-env] _discover: ComfyUI-GeometryPack -> geometrypack-nodes (custom_nodes/ComfyUI-GeometryPack/nodes/comfy-env.toml) [00:56] [comfy-env] _discover: ComfyUI-Sharp -> sharp-nodes (custom_nodes/ComfyUI-Sharp/nodes/comfy-env.toml) [00:56] [comfy-env] Workspace: /root/.ce [00:56] [comfy-env] ComfyUI: /workspaces/Sharp-2045/ComfyUI [00:56] [comfy-env] Found 2 node config(s): [00:56] - geometrypack-nodes <- custom_nodes/ComfyUI-GeometryPack/nodes/comfy-env.toml (python=host) [00:56] - sharp-nodes <- custom_nodes/ComfyUI-Sharp/nodes/comfy-env.toml (python=host) [00:56] [comfy-env] Bootstrap interpreter has python 3.11 + torch 2.10.0 (cu128). Looking for cuda-only wheels matching cu128/torch2.10/cp311. [00:56] [comfy-env] GPU: Detection: smi [00:56] Driver: 580.126.20 [00:56] CUDA: 13.0 [00:56] Recommended: CUDA 13.0 [00:56] [00:56] GPU 0: NVIDIA GeForce RTX 3090 (sm_86) [Ampere] 24576MB [00:56] [comfy-env] Comfyui feature -> torch 2.10.0 from https://download.pytorch.org/whl/cu128 (CUDA 12.8 via bootstrap torch) [00:56] [comfy-env] cuda-wheels: 1 package(s) need a matched (cuda, torch, python) combo: ['cumesh'] [00:56] [comfy-env] cuda-wheels tier 1 (bootstrap): probing cu12.8/torch2.10/cp311 [00:56] [cuda-wheels] Looking up cumesh: cu128 torch2.10 cp311 manylinux linux [00:56] [cuda-wheels] Found: cumesh-0.0.1+cu128torch2.10-cp311-cp311-manylinux_2_35_x86_64.whl [00:56] [comfy-env] cuda-wheels combo: cu12.8/torch2.10 (bootstrap matches; per-node envs will pin to this) [00:56] [comfy-env] Host glibc 2.35 -> system-requirements [00:56] [cuda-wheels] Looking up cumesh: cu128 torch2.10 cp311 manylinux linux [00:56] [cuda-wheels] Found: cumesh-0.0.1+cu128torch2.10-cp311-cp311-manylinux_2_35_x86_64.whl [00:56] [comfy-env] geometrypack-nodes: cuda-wheels deferred for post-pixi install (cumesh) [00:56] Generated /root/.ce/pixi.toml [00:56] [comfy-env] Installing 2 environment(s): [00:56] - geometrypack-nodes (python=host, 14 pypi deps, 1 cuda wheels) [00:56] - sharp-nodes (python=host, 10 pypi deps) [00:56] [comfy-env] Running `pixi install -e geometrypack-nodes -e sharp-nodes`... [01:07] WARN Skipped running the post-link scripts because `run-post-link-scripts` = `false` [01:07] - bin/.librsvg-pre-unlink.sh [01:07] To enable them, run: [01:07] pixi config set --local run-post-link-scripts insecure [01:07] More info: [01:07] https://pixi.sh/latest/reference/pixi_configuration/#run-post-link-scripts [01:27] WARN Skipped running the post-link scripts because `run-post-link-scripts` = `false` [01:27] - bin/.librsvg-pre-unlink.sh [01:27] To enable them, run: [01:27] pixi config set --local run-post-link-scripts insecure [01:27] More info: [01:27] https://pixi.sh/latest/reference/pixi_configuration/#run-post-link-scripts [01:56] The following environments have been installed: geometrypack-nodes, sharp-nodes. [01:56] [comfy-env] geometrypack-nodes: installing cuda-wheels with --no-deps (cumesh) [01:57] Using Python 3.11.15 environment at: .pixi/envs/geometrypack-nodes [01:58] Resolved 1 package in 993ms [01:58] Downloading cumesh (22.8MiB) [01:58] Downloaded cumesh [01:58] Prepared 1 package in 257ms [01:58] Installed 1 package in 6ms [01:58] + cumesh==0.0.1+cu128torch2.10 (from https://github.com/PozzettiAndrea/cuda-wheels/releases/download/cumesh-latest/cumesh-0.0.1%2Bcu128torch2.10-cp311-cp311-manylinux_2_35_x86_64.whl) [01:58] [comfy-env] Recorded install hash 3b917f844871 -> /root/.ce/install.hash [01:58] [comfy-env] Install log: /root/.ce/install.log [01:58] [01:58] Installation complete! [01:58] [01:58] [requirements] Re-installing main package requirements... [01:58] Installing requirements for ComfyUI-Sharp... [01:58] [comfy-env] _discover: scanning /workspaces/Sharp-2045/ComfyUI/custom_nodes [01:58] [comfy-env] _discover: ComfyUI-GeometryPack -> geometrypack-nodes (custom_nodes/ComfyUI-GeometryPack/nodes/comfy-env.toml) [01:58] [comfy-env] _discover: ComfyUI-Sharp -> sharp-nodes (custom_nodes/ComfyUI-Sharp/nodes/comfy-env.toml) [01:58] [comfy-env] Workspace inputs unchanged (hash 3b917f844871) -- skipping install. Delete /root/.ce/install.hash to force. [01:58] [01:58] Installation complete! [01:58] Installing 1 node dependency(ies)... [01:58] ComfyUI-GeometryPack from PozzettiAndrea/ComfyUI-GeometryPack [01:58] ComfyUI-GeometryPack already exists, skipping... [01:58] Installing validation endpoint... [01:58] Cloning PozzettiAndrea/ComfyUI-validate-endpoint... [01:58] Running: git clone --depth 1 https://x-access-token:***@github.com/PozzettiAndrea/ComfyUI-validate-endpoint.git /workspaces/Sharp-2045/ComfyUI/custom_nodes/ComfyUI-validate-endpoint [01:58] [INSTALL] PASSED [01:58] [01:58] [3/5] REGISTRATION [01:58] ---------------------------------------- [01:58] [DEBUG] server=None, api=None [01:58] Starting ComfyUI server... [01:58] Starting ComfyUI server on port 41886... [01:58] Starting ComfyUI server on port 41886... [01:58] Waiting for server to be ready (timeout: 600s)... [02:00] [ComfyUI] setup plugin alembic.autogenerate.schemas [02:00] [ComfyUI] setup plugin alembic.autogenerate.tables [02:00] [ComfyUI] setup plugin alembic.autogenerate.types [02:00] [ComfyUI] setup plugin alembic.autogenerate.constraints [02:00] [ComfyUI] setup plugin alembic.autogenerate.defaults [02:00] [ComfyUI] setup plugin alembic.autogenerate.comments [02:00] [ComfyUI] [comfy-env] ComfyUI-GeometryPack: 1 isolation env(s): [02:00] [ComfyUI] [comfy-env] nodes -> /workspaces/Sharp-2045/ComfyUI/custom_nodes/ComfyUI-GeometryPack/nodes [02:00] [ComfyUI] [comfy-env] Workspace: /root/.ce [02:00] [ComfyUI] [comfy-env] env: /root/.ce/.pixi/envs/geometrypack-nodes [OK] [02:00] [ComfyUI] [comfy-env] prestartup complete [02:00] [ComfyUI] [comfy-env] ComfyUI-Sharp: 1 isolation env(s): [02:00] [ComfyUI] [comfy-env] nodes -> /workspaces/Sharp-2045/ComfyUI/custom_nodes/ComfyUI-Sharp/nodes [02:00] [ComfyUI] [comfy-env] env: /root/.ce/.pixi/envs/sharp-nodes [OK] [02:00] [ComfyUI] [comfy-env] prestartup complete [02:00] [ComfyUI] [02:00] [ComfyUI] Prestartup times for custom nodes: [02:00] [ComfyUI] 0.0 seconds: /workspaces/Sharp-2045/ComfyUI/custom_nodes/ComfyUI-Sharp [02:00] [ComfyUI] 0.3 seconds: /workspaces/Sharp-2045/ComfyUI/custom_nodes/ComfyUI-GeometryPack [02:00] [ComfyUI] [02:07] [ComfyUI] WARNING: You need pytorch with cu130 or higher to use optimized CUDA operations. [02:07] [ComfyUI] Found comfy_kitchen backend eager: {'available': True, 'disabled': False, 'unavailable_reason': None, 'capabilities': ['apply_rope', 'apply_rope1', 'dequantize_mxfp8', 'dequantize_nvfp4', 'dequantize_per_tensor_fp8', 'quantize_mxfp8', 'quantize_nvfp4', 'quantize_per_tensor_fp8', 'scaled_mm_mxfp8', 'scaled_mm_nvfp4']} [02:07] [ComfyUI] Found comfy_kitchen backend triton: {'available': True, 'disabled': True, 'unavailable_reason': None, 'capabilities': ['apply_rope', 'apply_rope1', 'dequantize_nvfp4', 'dequantize_per_tensor_fp8', 'quantize_mxfp8', 'quantize_nvfp4', 'quantize_per_tensor_fp8']} [02:07] [ComfyUI] Found comfy_kitchen backend cuda: {'available': True, 'disabled': True, 'unavailable_reason': None, 'capabilities': ['apply_rope', 'apply_rope1', 'dequantize_nvfp4', 'dequantize_per_tensor_fp8', 'quantize_mxfp8', 'quantize_nvfp4', 'quantize_per_tensor_fp8']} [02:07] [ComfyUI] Checkpoint files will always be loaded safely. [02:07] [ComfyUI] Total VRAM 24124 MB, total RAM 31924 MB [02:07] [ComfyUI] pytorch version: 2.10.0+cu128 [02:07] [ComfyUI] Set vram state to: NORMAL_VRAM [02:07] [ComfyUI] Device: cuda:0 NVIDIA GeForce RTX 3090 : cudaMallocAsync [02:07] [ComfyUI] Using async weight offloading with 2 streams [02:07] [ComfyUI] Enabled pinned memory 28731.0 [02:07] [ComfyUI] working around nvidia conv3d memory bug. [02:07] [ComfyUI] Using pytorch attention [02:12] [ComfyUI] aimdo: /project/src-posix/cuda-funchooks.c:52:DEBUG:aimdo_setup_hooks: hooks successfully installed [02:12] [ComfyUI] aimdo: /project/src/control.c:151:INFO:comfy-aimdo inited for GPU: NVIDIA GeForce RTX 3090 (VRAM: 24124 MB) [02:12] [ComfyUI] DynamicVRAM support detected and enabled [02:12] [ComfyUI] Python version: 3.11.15 (main, May 8 2026, 18:33:10) [Clang 22.1.3 ] [02:12] [ComfyUI] ComfyUI version: 0.21.1 [02:12] [ComfyUI] comfy-aimdo version: 0.3.0 [02:12] [ComfyUI] comfy-kitchen version: 0.2.8 [02:12] [ComfyUI] ****** User settings have been changed to be stored on the server instead of browser storage. ****** [02:12] [ComfyUI] ****** For multi-user setups add the --multi-user CLI argument to enable multiple user profiles. ****** [02:12] [ComfyUI] comfyui-frontend-package version: 1.43.18 [02:12] [ComfyUI] comfyui-workflow-templates version: 0.9.77 [02:12] [ComfyUI] comfyui-embedded-docs version: 0.5.0 [02:12] [ComfyUI] comfy-kitchen version: 0.2.8 [02:12] [ComfyUI] comfy-aimdo version: 0.3.0 [02:13] [ComfyUI] [Prompt Server] web root: /workspaces/Sharp-2045/.venv/lib/python3.11/site-packages/comfyui_frontend_package/static [02:13] [ComfyUI] Asset seeder disabled [02:15] [ComfyUI] loading... [02:15] [ComfyUI] calling register_nodes [02:15] [ComfyUI] [comfy-env] Version: 0.3.89 [02:15] [ComfyUI] [comfy-env] register_nodes: ComfyUI-GeometryPack [02:15] [ComfyUI] [comfy-env] ComfyUI source dir: /workspaces/Sharp-2045/ComfyUI [02:15] [ComfyUI] [comfy-env] Found 1 isolation env(s) [02:15] [ComfyUI] [comfy-env] Scanning nodes metadata (isolation root)... [02:15] [ComfyUI] [comfy-env] Metadata scan: /root/.pixi/bin/pixi run --as-is --manifest-path /root/.ce/pixi.toml -e geometrypack-nodes python /tmp/comfy_meta__pe887ay.py /workspaces/Sharp-2045/ComfyUI/custom_nodes/ComfyUI-GeometryPack nodes /tmp/comfy_meta_out_wlt8bhuw.pkl [02:15] [ComfyUI] [comfy-env] Scan env PATH for nodes: [02:15] [ComfyUI] [comfy-env] [0] /root/.local/bin [02:15] [ComfyUI] [comfy-env] [1] /usr/local/nvidia/bin [02:15] [ComfyUI] [comfy-env] [2] /usr/local/cuda/bin [02:15] [ComfyUI] [comfy-env] [3] /usr/local/sbin [02:15] [ComfyUI] [comfy-env] [4] /usr/local/bin [02:15] [ComfyUI] [comfy-env] [5] /usr/sbin [02:15] [ComfyUI] [comfy-env] [6] /usr/bin [02:15] [ComfyUI] [comfy-env] [7] /sbin [02:15] [ComfyUI] [comfy-env] [8] /bin [02:21] [ComfyUI] [comfy-env] Metadata scan stderr for nodes: [02:21] [ComfyUI] [comfy-env] [meta-scan] importing nodes from /workspaces/Sharp-2045/ComfyUI/custom_nodes/ComfyUI-GeometryPack [02:21] [ComfyUI] [comfy-env] ERROR:root:Failed to import comfy_kitchen, Error: No module named 'comfy_kitchen', fp8 and fp4 support will not be available. [02:21] [ComfyUI] [comfy-env] [meta-scan] import OK [02:21] [ComfyUI] [comfy-env] Scanned nodes: 125 nodes (6.0s) [02:21] [ComfyUI] [comfy-env] Scanned nodes root: 125 nodes (6.0s) [02:21] [ComfyUI] [comfy-env] Imported nodes root: 125 nodes (isolation) [02:21] [ComfyUI] [comfy-env] Registered 125 total nodes [02:21] [ComfyUI] [comfy-env] Version: 0.3.89 [02:21] [ComfyUI] [comfy-env] register_nodes: ComfyUI-Sharp [02:21] [ComfyUI] [comfy-env] ComfyUI source dir: /workspaces/Sharp-2045/ComfyUI [02:21] [ComfyUI] [comfy-env] Found 1 isolation env(s) [02:21] [ComfyUI] [comfy-env] Scanning nodes metadata (isolation root)... [02:21] [ComfyUI] [comfy-env] Metadata scan: /root/.pixi/bin/pixi run --as-is --manifest-path /root/.ce/pixi.toml -e sharp-nodes python /tmp/comfy_meta_q6rdk108.py /workspaces/Sharp-2045/ComfyUI/custom_nodes/ComfyUI-Sharp nodes /tmp/comfy_meta_out_2uabivyf.pkl [02:21] [ComfyUI] [comfy-env] Scan env PATH for nodes: [02:21] [ComfyUI] [comfy-env] [0] /root/.local/bin [02:21] [ComfyUI] [comfy-env] [1] /usr/local/nvidia/bin [02:21] [ComfyUI] [comfy-env] [2] /usr/local/cuda/bin [02:21] [ComfyUI] [comfy-env] [3] /usr/local/sbin [02:21] [ComfyUI] [comfy-env] [4] /usr/local/bin [02:21] [ComfyUI] [comfy-env] [5] /usr/sbin [02:21] [ComfyUI] [comfy-env] [6] /usr/bin [02:21] [ComfyUI] [comfy-env] [7] /sbin [02:21] [ComfyUI] [comfy-env] [8] /bin [02:25] [ComfyUI] [comfy-env] Metadata scan stderr for nodes: [02:25] [ComfyUI] [comfy-env] [meta-scan] importing nodes from /workspaces/Sharp-2045/ComfyUI/custom_nodes/ComfyUI-Sharp [02:25] [ComfyUI] [comfy-env] [meta-scan] import OK [02:25] [ComfyUI] [comfy-env] Scanned nodes: 8 nodes (4.2s) [02:26] [ComfyUI] [comfy-env] Scanned nodes root: 8 nodes (4.2s) [02:26] [ComfyUI] [comfy-env] Imported nodes root: 8 nodes (isolation) [02:26] [ComfyUI] [comfy-env] Registered 8 total nodes [02:26] [ComfyUI] [02:26] [ComfyUI] Import times for custom nodes: [02:26] [ComfyUI] 0.0 seconds: /workspaces/Sharp-2045/ComfyUI/custom_nodes/ComfyUI-validate-endpoint [02:26] [ComfyUI] 0.0 seconds: /workspaces/Sharp-2045/ComfyUI/custom_nodes/websocket_image_save.py [02:26] [ComfyUI] 4.3 seconds: /workspaces/Sharp-2045/ComfyUI/custom_nodes/ComfyUI-Sharp [02:26] [ComfyUI] 6.2 seconds: /workspaces/Sharp-2045/ComfyUI/custom_nodes/ComfyUI-GeometryPack [02:26] [ComfyUI] [02:26] [ComfyUI] Context impl SQLiteImpl. [02:26] [ComfyUI] Will assume non-transactional DDL. [02:26] [ComfyUI] Context impl SQLiteImpl. [02:26] [ComfyUI] Will assume non-transactional DDL. [02:26] [ComfyUI] Running upgrade -> 0001_assets, Initial assets schema [02:26] [ComfyUI] Revision ID: 0001_assets [02:26] [ComfyUI] Revises: None [02:26] [ComfyUI] Create Date: 2025-12-10 00:00:00 [02:26] [ComfyUI] Running upgrade 0001_assets -> 0002_merge_to_asset_references, Merge AssetInfo and AssetCacheState into unified asset_references table. [02:26] [ComfyUI] Running upgrade 0002_merge_to_asset_references -> 0003_add_metadata_job_id, Add system_metadata and job_id columns to asset_references. [02:26] [ComfyUI] Change preview_id FK from assets.id to asset_references.id. [02:26] [ComfyUI] Database upgraded from None to 0003_add_metadata_job_id [02:26] [ComfyUI] Starting server [02:26] [ComfyUI] [02:26] [ComfyUI] To see the GUI go to: http://127.0.0.1:41886 [02:27] Server responding, waiting for nodes to load... [02:47] Server is ready! [02:47] Checking for import errors in server logs... [02:47] No import errors detected [02:47] Found 854 registered nodes [02:47] [REGISTRATION] PASSED [02:47] [02:47] [4/5] INSTANTIATION [02:47] ---------------------------------------- [02:47] [DEBUG] server=, api= [02:47] Testing node constructors... [02:47] All 8 node(s) instantiated successfully! [02:47] [INSTANTIATION] PASSED [02:47] [02:47] [5/5] EXECUTION [02:47] ---------------------------------------- [02:47] [DEBUG] server=, api= [02:47] GPU runner - will execute 2 workflow(s) [02:47] Running 3 workflow(s) (all with videos)... [02:47] Installing screenshot dependencies (playwright, pillow)... [02:48] Packages installed, downloading chromium browser... [03:10] Screenshot dependencies installed successfully [03:11] Starting headless browser... [03:11] Installing Vulkan stack (apt)... [03:11] Vulkan install error: [Errno 2] No such file or directory: 'sudo' [03:11] GPU detected (no Vulkan) -- using ANGLE/OpenGL rendering [03:11] [1/3] SKIPPED (not in gpu list) pano.json [03:12] Capturing execution frames: sharp_basic.json [03:19] Frame 1 saved (frame_000.jpg, t=0.0s) [03:19] Validating workflow... [03:19] [ComfyUI] === /validate endpoint called === [03:19] [ComfyUI] Received JSON with keys: ['prompt'] [03:19] [ComfyUI] Prompt has 4 nodes [03:19] Queuing workflow for execution... [03:19] [ComfyUI] Node 1: LoadImage [03:19] [ComfyUI] Inputs: {"image": "beach.jpg"} [03:19] [ComfyUI] Node 2: LoadSharpModel [03:19] [ComfyUI] Inputs: {"precision": "auto"} [03:19] [ComfyUI] Node 4: GeomPackPreviewGaussian [03:19] [ComfyUI] Inputs: {"preview_gaussian": "", "ply_path": ["5", 0], "extrinsics": ["5", 1], "intrinsics": ["5", 2]} [03:19] [ComfyUI] Node 5: SharpPredict [03:19] [ComfyUI] Inputs: {"focal_length_mm": 30, "output_prefix": "sharp", "model": ["2", 0], "image": ["1", 0]} [03:19] [ComfyUI] Generated prompt_id: c14dce88-2f0f-4d12-b4d5-b171e9d7036d [03:19] [ComfyUI] Calling execution.validate_prompt()... [03:19] [ComfyUI] Validation result: valid=True [03:19] [ComfyUI] === Validation PASSED === [03:19] [ComfyUI] got prompt [03:19] [ComfyUI] [comfy-env] Running LoadSharpModel: precision: 'auto' [03:19] [ComfyUI] [comfy-env] SubprocessWorker: /root/.ce/.pixi/envs/sharp-nodes/bin/python [03:19] [ComfyUI] [VRAM] Before LoadSharpModel: 302 / 24124 MB [03:19] [ComfyUI] [comfy-env] env_vars: {'COMFYUI_BASE': '/workspaces/Sharp-2045/ComfyUI'} [03:19] [ComfyUI] [SubprocessWorker] call_method: nodes.load_model.LoadSharpModel.EXECUTE_NORMALIZED [03:19] [ComfyUI] [ComfyUI-Sharp] python: /root/.ce/.pixi/envs/sharp-nodes/bin/python [03:19] [ComfyUI] [SubprocessWorker] acquired lock, ensuring started... [03:19] [ComfyUI] [ComfyUI-Sharp] sys_path sent to worker: ['/workspaces/Sharp-2045/ComfyUI', '/workspaces/Sharp-2045/ComfyUI/custom_nodes/ComfyUI-Sharp', '/root/.ce/.pixi/envs/sharp-nodes/lib/python3.1/site-packages', '/workspaces/Sharp-2045/ComfyUI/custom_nodes/ComfyUI-Sharp'] [03:19] [ComfyUI] [SubprocessWorker] is_pixi=True, python=/root/.ce/.pixi/envs/sharp-nodes/bin/python [03:19] [ComfyUI] [SubprocessWorker] launching cmd=['/root/.pixi/bin/pixi', 'run', '--as-is', '--manifest-path', '/root/.ce/pixi.toml', '-e', 'sharp-nodes', 'python', '/tmp/comfyui_pvenv_aczth4f3/persistent_worker.py', 'abstract://comfy_worker_5082c1389dd0']... [03:19] [ComfyUI] [SubprocessWorker] socket_addr=abstract://comfy_worker_5082c1389dd0 (abstract, no filesystem path) [03:21] [ComfyUI] [worker:ComfyUI-Sharp] ERROR: Failed to import comfy_kitchen, Error: No module named 'comfy_kitchen', fp8 and fp4 support will not be available. [03:21] [ComfyUI] [SubprocessWorker] worker started/confirmed [03:21] [ComfyUI] [SubprocessWorker] serializing kwargs to shm... [03:21] [ComfyUI] [SubprocessWorker] created 0 shm blocks [03:21] [ComfyUI] [SubprocessWorker] sending request via socket... [03:21] [ComfyUI] [SubprocessWorker] call_id=1 sending call_method [03:22] Frame 2 saved (frame_001.jpg, t=2.6s) [03:22] [capture-periodic] freeze=4ms shot=206ms unfreeze=4ms saved=True [03:22] [ComfyUI] [03:24] Frame 3 saved (frame_002.jpg, t=4.9s) [03:24] [capture-periodic] freeze=3ms shot=214ms unfreeze=3ms saved=True [03:25] [capture-loop] iter=50 t=6.4s state={'complete': False, 'error': None, 'executedCount': 0, 'wsState': 1} eval_ms=7 ram=4.6/31.2GB (15%) swap=0.6/32.0GB (2%) cpu=4% browser_rss=0.86GB [03:31] [capture-loop] iter=100 t=12.5s state={'complete': False, 'error': None, 'executedCount': 0, 'wsState': 1} eval_ms=4 ram=5.1/31.2GB (16%) swap=0.6/32.0GB (2%) cpu=7% browser_rss=0.87GB [03:37] [capture-loop] iter=150 t=18.3s state={'complete': False, 'error': None, 'executedCount': 0, 'wsState': 1} eval_ms=3 ram=5.8/31.2GB (18%) swap=0.6/32.0GB (2%) cpu=7% browser_rss=0.87GB [03:43] [ComfyUI] sharp_2572gikvuh.pt: 0%| | 0.00/2.81G [00:00 cpu: 7723 / 24124 MB [06:05] Capturing execution frames: sharp_exif.json [06:05] [ComfyUI] [ComfyUI-Sharp] Health check: ping (timeout=5.0s)... [06:05] [ComfyUI] [ComfyUI-Sharp] python: /root/.ce/.pixi/envs/sharp-nodes/bin/python [06:05] [ComfyUI] [ComfyUI-Sharp] sys_path sent to worker: ['/workspaces/Sharp-2045/ComfyUI', '/workspaces/Sharp-2045/ComfyUI/custom_nodes/ComfyUI-Sharp', '/root/.ce/.pixi/envs/sharp-nodes/lib/python3.1/site-packages', '/workspaces/Sharp-2045/ComfyUI/custom_nodes/ComfyUI-Sharp'] [06:05] [ComfyUI] [ComfyUI-Sharp] Health check: failed [06:05] [ComfyUI] [ComfyUI-Sharp] Socket unhealthy, restarting worker... [06:05] [ComfyUI] [SubprocessWorker] is_pixi=True, python=/root/.ce/.pixi/envs/sharp-nodes/bin/python [06:05] [ComfyUI] [comfy-env] Invalidated 1 stale model patchers (will be cleaned up during next unload) [06:05] [ComfyUI] [SubprocessWorker] launching cmd=['/root/.pixi/bin/pixi', 'run', '--as-is', '--manifest-path', '/root/.ce/pixi.toml', '-e', 'sharp-nodes', 'python', '/tmp/comfyui_pvenv_aczth4f3/persistent_worker.py', 'abstract://comfy_worker_5813b1357b30']... [06:05] [ComfyUI] [SubprocessWorker] socket_addr=abstract://comfy_worker_5813b1357b30 (abstract, no filesystem path) [06:07] [ComfyUI] [worker:ComfyUI-Sharp] ERROR: Failed to import comfy_kitchen, Error: No module named 'comfy_kitchen', fp8 and fp4 support will not be available. [06:07] [ComfyUI] [SubprocessWorker] call_id=3 sending model_to_device [06:07] [ComfyUI] Model 'RGBGaussianPredictor_1' gone from worker (restarted?), treating as offloaded [06:07] [ComfyUI] [comfy-env] [VRAM] After offload 'RGBGaussianPredictor_1' (2679 MB): 825 / 24124 MB [06:12] Frame 1 saved (frame_000.jpg, t=0.0s) [06:12] Validating workflow... [06:12] [ComfyUI] === /validate endpoint called === [06:12] [ComfyUI] Received JSON with keys: ['prompt'] [06:12] [ComfyUI] Prompt has 4 nodes [06:12] Queuing workflow for execution... [06:12] [ComfyUI] Node 2: LoadSharpModel [06:12] [ComfyUI] Inputs: {"precision": "auto"} [06:12] [ComfyUI] Node 7: SharpPredict [06:12] [ComfyUI] Inputs: {"focal_length_mm": ["9", 2], "output_prefix": "sharp", "model": ["2", 0], "image": ["9", 0]} [06:12] [ComfyUI] Node 8: GeomPackPreviewGaussian [06:12] [ComfyUI] Inputs: {"preview_gaussian": "", "ply_path": ["7", 0], "extrinsics": ["7", 1], "intrinsics": ["7", 2]} [06:12] [ComfyUI] Node 9: LoadImageWithExif [06:12] [ComfyUI] Inputs: {"image": "eth3d.png", "default_focal_mm": 30} [06:12] [ComfyUI] Generated prompt_id: b21caaeb-9cac-44ae-8a52-b5b5864219fd [06:12] [ComfyUI] Calling execution.validate_prompt()... [06:12] [ComfyUI] Validation result: valid=True [06:12] [ComfyUI] === Validation PASSED === [06:12] [ComfyUI] got prompt [06:12] [ComfyUI] [comfy-env] Running LoadImageWithExif: image: 'eth3d.png', default_focal_mm: 30.0 [06:12] [ComfyUI] [VRAM] Before LoadImageWithExif: 825 / 24124 MB [06:12] [ComfyUI] [SubprocessWorker] call_method: nodes.load_image_exif.LoadImageWithExif.EXECUTE_NORMALIZED [06:12] [ComfyUI] [SubprocessWorker] acquired lock, ensuring started... [06:12] [ComfyUI] [ComfyUI-Sharp] Health check: ping (timeout=5.0s)... [06:12] [ComfyUI] [ComfyUI-Sharp] Health check: ok [06:12] [ComfyUI] [SubprocessWorker] worker started/confirmed [06:12] [ComfyUI] [SubprocessWorker] serializing kwargs to shm... [06:12] [ComfyUI] [SubprocessWorker] created 0 shm blocks [06:12] [ComfyUI] [SubprocessWorker] sending request via socket... [06:12] [ComfyUI] [SubprocessWorker] call_id=4 sending call_method [06:13] [ComfyUI] [SubprocessWorker] got response: ok [06:13] [ComfyUI] [comfy-env] [VRAM] Before offload 'RGBGaussianPredictor_1' (2679 MB) -> cpu: 825 / 24124 MB [06:13] [ComfyUI] [ComfyUI-Sharp] Health check: ping (timeout=5.0s)... [06:13] [ComfyUI] [ComfyUI-Sharp] Health check: ok [06:13] [ComfyUI] [SubprocessWorker] call_id=5 sending model_to_device [06:13] [ComfyUI] Model 'RGBGaussianPredictor_1' gone from worker (restarted?), treating as offloaded [06:13] [ComfyUI] [comfy-env] [VRAM] After offload 'RGBGaussianPredictor_1' (2679 MB): 825 / 24124 MB [06:13] [ComfyUI] [comfy-env] LoadImageWithExif done (0.87s): result: NodeOutput [06:13] [ComfyUI] [VRAM] After LoadImageWithExif: 825 / 24124 MB [06:13] [ComfyUI] [comfy-env] Running LoadSharpModel: precision: 'auto' [06:13] [ComfyUI] [VRAM] Before LoadSharpModel: 825 / 24124 MB [06:13] [ComfyUI] [SubprocessWorker] call_method: nodes.load_model.LoadSharpModel.EXECUTE_NORMALIZED [06:13] [ComfyUI] [SubprocessWorker] acquired lock, ensuring started... [06:13] [ComfyUI] [ComfyUI-Sharp] Health check: ping (timeout=5.0s)... [06:13] [ComfyUI] [ComfyUI-Sharp] Health check: ok [06:13] [ComfyUI] [SubprocessWorker] worker started/confirmed [06:13] [ComfyUI] [SubprocessWorker] serializing kwargs to shm... [06:13] [ComfyUI] [SubprocessWorker] created 0 shm blocks [06:13] [ComfyUI] [SubprocessWorker] sending request via socket... [06:13] [ComfyUI] [SubprocessWorker] call_id=6 sending call_method [06:14] [ComfyUI] [SubprocessWorker] got response: ok [06:14] [ComfyUI] [comfy-env] LoadSharpModel done (0.28s): result: NodeOutput [06:14] [ComfyUI] [VRAM] After LoadSharpModel: 825 / 24124 MB [06:14] [ComfyUI] [comfy-env] Running SharpPredict: focal_length_mm: 20.0, output_prefix: 'sharp', model: dict, image: torch.float32 [1,2022,3040,3] cpu [06:14] [ComfyUI] [VRAM] Before SharpPredict: 825 / 24124 MB [06:14] [ComfyUI] [SubprocessWorker] call_method: nodes.predict.SharpPredict.EXECUTE_NORMALIZED [06:14] [ComfyUI] [SubprocessWorker] acquired lock, ensuring started... [06:14] [ComfyUI] [ComfyUI-Sharp] Health check: ping (timeout=5.0s)... [06:14] [ComfyUI] [ComfyUI-Sharp] Health check: ok [06:14] [ComfyUI] [SubprocessWorker] worker started/confirmed [06:14] [ComfyUI] [comfy-env] PRE-SERIALIZE 'image' shape: torch.Size([1, 2022, 3040, 3]) [06:14] [ComfyUI] [SubprocessWorker] serializing kwargs to shm... [06:14] [ComfyUI] [SubprocessWorker] created 0 shm blocks [06:14] [ComfyUI] [SubprocessWorker] sending request via socket... [06:14] [ComfyUI] [SubprocessWorker] call_id=7 sending call_method [06:14] [ComfyUI] [worker:ComfyUI-Sharp] [comfy-env] _from_shm got dict with keys: ['__type__', 'strategy', 'parent_pid', 'fd', 'storage_size'] [06:14] [ComfyUI] [worker:ComfyUI-Sharp] [comfy-env] DESERIALIZE TensorRef: tensor_size=[1, 2022, 3040, 3] [06:14] [ComfyUI] [worker:ComfyUI-Sharp] [comfy-env] DESERIALIZED tensor shape: torch.Size([1, 2022, 3040, 3]) [06:14] [ComfyUI] [worker:ComfyUI-Sharp] WARNING: No comfy kitchen, using old apply_rope functions. [06:15] Frame 2 saved (frame_001.jpg, t=2.5s) [06:15] [capture-periodic] freeze=3ms shot=211ms unfreeze=5ms saved=True [06:17] Frame 3 saved (frame_002.jpg, t=4.9s) [06:17] [capture-periodic] freeze=3ms shot=227ms unfreeze=4ms saved=True [06:18] [ComfyUI] [SubprocessWorker] callback 'request_vram_budget' from call_id=7 [06:18] [ComfyUI] [comfy-env] VRAM request: 2.81GB, free before eviction: 24.43GB [06:18] [ComfyUI] [comfy-env] VRAM after eviction: 24.43GB [06:18] [ComfyUI] [worker:ComfyUI-Sharp] [VRAM] +282MB (now 282MB) reserved=288MB peak=282MB [06:18] [capture-loop] iter=50 t=6.4s state={'complete': False, 'error': None, 'executedCount': 0, 'wsState': 1} eval_ms=9 ram=7.7/31.2GB (25%) swap=0.6/32.0GB (2%) cpu=33% browser_rss=0.95GB [06:19] [ComfyUI] [worker:ComfyUI-Sharp] WARNING: [SPN] start: 2.74 GB, input=[1, 3, 1536, 1536] [06:19] [ComfyUI] [worker:ComfyUI-Sharp] WARNING: [SPN] patches: 2.80 GB, x0=25 x1=9 x2=1 total=35 [06:19] [ComfyUI] [worker:ComfyUI-Sharp] WARNING: [SPN] after first chunk (4/35): 3.20 GB, chunk_size=4 [06:19] [ComfyUI] [worker:ComfyUI-Sharp] [VRAM] +3110MB (now 3393MB) reserved=3520MB peak=3393MB [06:20] [ComfyUI] [worker:ComfyUI-Sharp] WARNING: [SPN] after all chunks + cache clear: 3.14 GB [06:20] [ComfyUI] [worker:ComfyUI-Sharp] WARNING: [SPN] after merge intermediates: 2.90 GB [06:21] [ComfyUI] [worker:ComfyUI-Sharp] WARNING: [SPN] after merge all: 2.95 GB [06:21] [ComfyUI] [worker:ComfyUI-Sharp] [VRAM] -362MB (now 3032MB) reserved=3392MB peak=3402MB [06:21] [ComfyUI] [worker:ComfyUI-Sharp] WARNING: [SPN] after image_encoder: 2.95 GB [06:21] [ComfyUI] [worker:ComfyUI-Sharp] WARNING: [SPN] after upsample: 3.66 GB [06:21] [ComfyUI] [worker:ComfyUI-Sharp] WARNING: [Monodepth] after SPN encoder + cache clear: 3.56 GB [06:21] [ComfyUI] [worker:ComfyUI-Sharp] WARNING: [Monodepth] after decoder: 4.13 GB [06:22] [ComfyUI] [worker:ComfyUI-Sharp] [VRAM] +1184MB (now 4216MB) reserved=7808MB peak=7105MB [06:22] [ComfyUI] [worker:ComfyUI-Sharp] WARNING: [Decode] start: 4.12 GB [06:22] [ComfyUI] [worker:ComfyUI-Sharp] WARNING: [Decode] after depth_alignment: 4.15 GB [06:22] [ComfyUI] [worker:ComfyUI-Sharp] WARNING: [Decode] after init_model: 4.23 GB [06:23] [ComfyUI] [worker:ComfyUI-Sharp] WARNING: [Decode] after feature_model: 4.37 GB [06:23] [ComfyUI] [worker:ComfyUI-Sharp] [VRAM] +270MB (now 4486MB) reserved=6624MB peak=7105MB [06:23] [ComfyUI] [worker:ComfyUI-Sharp] WARNING: [Decode] after prediction_head: 4.43 GB [06:23] [ComfyUI] [SubprocessWorker] callback 'report_progress' from call_id=7 [06:23] [ComfyUI] [SubprocessWorker] got response: ok [06:23] [ComfyUI] [comfy-env] Created 1 model patchers: ['RGBGaussianPredictor_1'] [06:23] [ComfyUI] [comfy-env] SharpPredict done (9.73s): result: NodeOutput [06:23] [ComfyUI] [ComfyUI-GeometryPack] python: /root/.ce/.pixi/envs/geometrypack-nodes/bin/python [06:23] [ComfyUI] [VRAM] After SharpPredict: 7563 / 24124 MB [06:23] [ComfyUI] [ComfyUI-GeometryPack] sys_path sent to worker: ['/workspaces/Sharp-2045/ComfyUI', '/workspaces/Sharp-2045/ComfyUI/custom_nodes/ComfyUI-GeometryPack', '/root/.ce/.pixi/envs/geometrypack-nodes/lib/python3.1/site-packages', '/workspaces/Sharp-2045/ComfyUI/custom_nodes/ComfyUI-GeometryPack'] [06:23] [ComfyUI] [VRAM] Loaded: SubprocessModel (2679 MB) [06:23] [ComfyUI] [SubprocessWorker] is_pixi=True, python=/root/.ce/.pixi/envs/geometrypack-nodes/bin/python [06:23] [ComfyUI] [comfy-env] Running GeomPackPreviewGaussian: ply_path: '/workspaces/Sharp-2045/ComfyUI/output/sharp_177896467901..., extrinsics: list[4], intrinsics: list[3] [06:23] [ComfyUI] [SubprocessWorker] launching cmd=['/root/.pixi/bin/pixi', 'run', '--as-is', '--manifest-path', '/root/.ce/pixi.toml', '-e', 'geometrypack-nodes', 'python', '/tmp/comfyui_pvenv_28ynije3/persistent_worker.py', 'abstract://comfy_worker_dacbf7bcf2ba']... [06:23] [ComfyUI] [VRAM] Before GeomPackPreviewGaussian: 7563 / 24124 MB [06:23] [ComfyUI] [SubprocessWorker] socket_addr=abstract://comfy_worker_dacbf7bcf2ba (abstract, no filesystem path) [06:23] [ComfyUI] [VRAM] Loaded: SubprocessModel (2679 MB) [06:23] [ComfyUI] [SubprocessWorker] call_method: nodes.visualization.preview_gaussian.PreviewGaussianNode.EXECUTE_NORMALIZED [06:23] [ComfyUI] [SubprocessWorker] acquired lock, ensuring started... [06:23] [ComfyUI] [ComfyUI-GeometryPack] Health check: ping (timeout=5.0s)... [06:23] [ComfyUI] [ComfyUI-GeometryPack] Health check: failed [06:23] [ComfyUI] [ComfyUI-GeometryPack] Socket unhealthy, restarting worker... [06:24] Frame 4 saved (frame_003.jpg, t=11.9s) [06:24] [capture-periodic] freeze=3ms shot=219ms unfreeze=7ms saved=True [06:25] [capture-loop] iter=100 t=12.6s state={'complete': False, 'error': None, 'executedCount': 0, 'wsState': 1} eval_ms=4 ram=9.5/31.2GB (31%) swap=0.6/32.0GB (2%) cpu=8% browser_rss=0.89GB [06:25] [ComfyUI] [worker:ComfyUI-GeometryPack] ERROR: Failed to import comfy_kitchen, Error: No module named 'comfy_kitchen', fp8 and fp4 support will not be available. [06:25] [ComfyUI] [SubprocessWorker] worker started/confirmed [06:25] [ComfyUI] [SubprocessWorker] serializing kwargs to shm... [06:25] [ComfyUI] [SubprocessWorker] created 0 shm blocks [06:25] [ComfyUI] [SubprocessWorker] sending request via socket... [06:25] [ComfyUI] [SubprocessWorker] call_id=2 sending call_method [06:27] [ComfyUI] [worker:ComfyUI-GeometryPack] INFO: Loading PLY: sharp_1778964679013.ply (63.00 MB) [06:27] [ComfyUI] [SubprocessWorker] got response: ok [06:27] [ComfyUI] [comfy-env] GeomPackPreviewGaussian done (3.27s): result: NodeOutput [06:27] [ComfyUI] [ComfyUI-Sharp] python: /root/.ce/.pixi/envs/sharp-nodes/bin/python [06:27] [ComfyUI] [VRAM] After GeomPackPreviewGaussian: 7563 / 24124 MB [06:27] [ComfyUI] [ComfyUI-Sharp] sys_path sent to worker: ['/workspaces/Sharp-2045/ComfyUI', '/workspaces/Sharp-2045/ComfyUI/custom_nodes/ComfyUI-Sharp', '/root/.ce/.pixi/envs/sharp-nodes/lib/python3.1/site-packages', '/workspaces/Sharp-2045/ComfyUI/custom_nodes/ComfyUI-Sharp'] [06:27] [ComfyUI] [VRAM] Loaded: SubprocessModel (2679 MB) [06:27] [ComfyUI] [SubprocessWorker] is_pixi=True, python=/root/.ce/.pixi/envs/sharp-nodes/bin/python [06:27] [ComfyUI] Prompt executed in 14.17 seconds [06:27] [ComfyUI] [SubprocessWorker] launching cmd=['/root/.pixi/bin/pixi', 'run', '--as-is', '--manifest-path', '/root/.ce/pixi.toml', '-e', 'sharp-nodes', 'python', '/tmp/comfyui_pvenv_aczth4f3/persistent_worker.py', 'abstract://comfy_worker_e00f41e206d2']... [06:27] [ComfyUI] [comfy-env] [VRAM] Before offload 'RGBGaussianPredictor_1' (2679 MB) -> cpu: 7563 / 24124 MB [06:27] [ComfyUI] [SubprocessWorker] socket_addr=abstract://comfy_worker_e00f41e206d2 (abstract, no filesystem path) [06:27] [ComfyUI] [ComfyUI-Sharp] Health check: ping (timeout=5.0s)... [06:27] [ComfyUI] [ComfyUI-Sharp] Health check: failed [06:27] [ComfyUI] [ComfyUI-Sharp] Socket unhealthy, restarting worker... [06:27] [ComfyUI] [comfy-env] Invalidated 1 stale model patchers (will be cleaned up during next unload) [06:27] Node executed (1 total), capturing... [06:29] [ComfyUI] [worker:ComfyUI-Sharp] ERROR: Failed to import comfy_kitchen, Error: No module named 'comfy_kitchen', fp8 and fp4 support will not be available. [06:29] [ComfyUI] [SubprocessWorker] call_id=8 sending model_to_device [06:29] [ComfyUI] Model 'RGBGaussianPredictor_1' gone from worker (restarted?), treating as offloaded [06:29] [ComfyUI] [comfy-env] [VRAM] After offload 'RGBGaussianPredictor_1' (2679 MB): 825 / 24124 MB [06:29] Frame 5 saved (frame_004.jpg, t=14.8s) [06:29] [capture-node] freeze=1568ms shot=656ms unfreeze=0ms saved=True [06:29] Execution complete (t=14.8s) [06:29] [3d-wait] Phase 1: Waiting for 'Loading 3D Model' text to disappear... [06:29] [3d-wait] Phase 1 done in 0.0s [06:29] [3d-wait] Phase 2: iframes=1 [06:29] [3d-wait] iframe viewer_ready=True (matched 1 console logs) [06:29] [3d-wait] Unfrozen in 0.003s, rendering for 5s... [06:45] [3d-wait] JS halted via CDP after 16.1s [07:34] [3d-wait] Re-frozen in 64.4s [07:34] [3d-wait] Total 3D wait: 64.4s [07:34] Captured 5 unique frames over 81.51s [07:34] [debug] iframes: 1 [07:34] [debug] iframe[0]: src=http://127.0.0.1:41886/extensions/ComfyUI-GeometryPack/viewer_gaussian.html?v=17, canvas=3040x2022, rafFrozen=True [07:34] [timing] trigger_3d_previews: 0.0s [07:36] Saved high-quality screenshot: sharp_exif_executed.png [07:36] [timing] final_screenshot: 0.6s [07:36] Results saved to /logs/Sharp-2045/dev/linux-gpu/results.json [07:36] Model report: 4 files, 2.6 GB -> /logs/Sharp-2045/dev/linux-gpu/models.json [07:36] Saved: /logs/Sharp-2045/dev/linux-gpu/index.html [07:36] [EXECUTION] PASSED [07:36] linux: PASSED [07:36] Stopping ComfyUI server...