Capturing execution frames: sharp_basic.json [ComfyUI] [ComfyUI-MoGe2] python: /tmp/comfytest-home/.ce/.pixi/envs/moge2-nodes/bin/python [ComfyUI] [comfy-env] [VRAM] Before offload 'MoGeWrapper_1' (631 MB) -> cpu: 14649 / 24122 MB [ComfyUI] [ComfyUI-MoGe2] sys_path sent to worker: ['/workspaces/Sharp-2132/ComfyUI', '/workspaces/Sharp-2132/ComfyUI/custom_nodes/ComfyUI-MoGe2', '/tmp/comfytest-home/.ce/.pixi/envs/moge2-nodes/lib/python3.1/site-packages', '/workspaces/Sharp-2132/ComfyUI/custom_nodes/ComfyUI-MoGe2'] [ComfyUI] [ComfyUI-MoGe2] Health check: ping (timeout=5.0s)... [ComfyUI] [SubprocessWorker] is_pixi=True, python=/tmp/comfytest-home/.ce/.pixi/envs/moge2-nodes/bin/python [ComfyUI] [ComfyUI-MoGe2] Health check: failed [ComfyUI] [SubprocessWorker] launching cmd=['/tmp/comfytest-home/.pixi/bin/pixi', 'run', '--as-is', '--manifest-path', '/tmp/comfytest-home/.ce/pixi.toml', '-e', 'moge2-nodes', 'python', '/tmp/comfyui_pvenv_gi4mg5cv/persistent_worker.py', 'abstract://comfy_worker_420d26a3e422']... [ComfyUI] [ComfyUI-MoGe2] Socket unhealthy, restarting worker... [ComfyUI] [SubprocessWorker] socket_addr=abstract://comfy_worker_420d26a3e422 (abstract, no filesystem path) [ComfyUI] [comfy-env] Invalidated 1 stale model patchers (will be cleaned up during next unload) [ComfyUI] Traceback (most recent call last): [ComfyUI] File "/tmp/comfyui_pvenv_gi4mg5cv/persistent_worker.py", line 1807, in [ComfyUI] main() [ComfyUI] File "/tmp/comfyui_pvenv_gi4mg5cv/persistent_worker.py", line 1667, in main [ComfyUI] transport.send({"status": "pong", "call_id": _current_call_id}) [ComfyUI] File "/tmp/comfyui_pvenv_gi4mg5cv/persistent_worker.py", line 1075, in send [ComfyUI] self._sock.sendall(msg) [ComfyUI] BrokenPipeError: [Errno 32] Broken pipe [ComfyUI] [worker:ComfyUI-MoGe2] ERROR: Failed to import comfy_kitchen, Error: No module named 'comfy_kitchen', fp8 and fp4 support will not be available. [ComfyUI] [worker:ComfyUI-MoGe2] WARNING: comfy_kitchen does not support stochastic FP8 rounding, please update comfy_kitchen. [ComfyUI] [SubprocessWorker] call_id=3 sending model_to_device [ComfyUI] [WARNING] Model 'MoGeWrapper_1' gone from worker (restarted?), treating as offloaded [ComfyUI] [ComfyUI-Sharp] python: /tmp/comfytest-home/.ce/.pixi/envs/sharp-nodes/bin/python [ComfyUI] [comfy-env] [VRAM] After offload 'MoGeWrapper_1' (631 MB): 14910 / 24122 MB [ComfyUI] [ComfyUI-Sharp] sys_path sent to worker: ['/workspaces/Sharp-2132/ComfyUI', '/workspaces/Sharp-2132/ComfyUI/custom_nodes/ComfyUI-Sharp', '/tmp/comfytest-home/.ce/.pixi/envs/sharp-nodes/lib/python3.1/site-packages', '/workspaces/Sharp-2132/ComfyUI/custom_nodes/ComfyUI-Sharp'] [ComfyUI] [comfy-env] [VRAM] Before offload 'RGBGaussianPredictor_1' (2679 MB) -> cpu: 14910 / 24122 MB [ComfyUI] [SubprocessWorker] is_pixi=True, python=/tmp/comfytest-home/.ce/.pixi/envs/sharp-nodes/bin/python [ComfyUI] [ComfyUI-Sharp] Health check: ping (timeout=5.0s)... [ComfyUI] [SubprocessWorker] launching cmd=['/tmp/comfytest-home/.pixi/bin/pixi', 'run', '--as-is', '--manifest-path', '/tmp/comfytest-home/.ce/pixi.toml', '-e', 'sharp-nodes', 'python', '/tmp/comfyui_pvenv_fah6gilt/persistent_worker.py', 'abstract://comfy_worker_5bce12dd0906']... [ComfyUI] [ComfyUI-Sharp] Health check: failed [ComfyUI] [SubprocessWorker] socket_addr=abstract://comfy_worker_5bce12dd0906 (abstract, no filesystem path) [ComfyUI] [ComfyUI-Sharp] Socket unhealthy, restarting worker... [ComfyUI] [comfy-env] Invalidated 1 stale model patchers (will be cleaned up during next unload) Frame 1 saved (frame_000.jpg, t=0.0s) Validating workflow... Queuing workflow for execution... [ComfyUI] [worker:ComfyUI-Sharp] ERROR: Failed to import comfy_kitchen, Error: No module named 'comfy_kitchen', fp8 and fp4 support will not be available. [ComfyUI] [INFO] === /validate endpoint called === [ComfyUI] [INFO] Received JSON with keys: ['prompt'] [ComfyUI] [INFO] Prompt has 4 nodes [ComfyUI] [INFO] Node 1: LoadImage [ComfyUI] [INFO] Inputs: {"image": "beach.jpg"} [ComfyUI] [INFO] Node 2: LoadSharpModel [ComfyUI] [INFO] Inputs: {"precision": "auto"} [ComfyUI] [INFO] Node 5: SharpPredict Frame 2 saved (frame_001.jpg, t=3.5s) [ComfyUI] [INFO] Inputs: {"focal_length_mm": 30, "output_prefix": "sharp", "model": ["2", 0], "image": ["1", 0]} [capture-periodic] freeze=5ms shot=241ms unfreeze=2ms saved=True [ComfyUI] [INFO] Node 6: PreviewGaussianSharp [ComfyUI] [INFO] Inputs: {"preview_gaussian": "", "ply_path": ["5", 0], "extrinsics": ["5", 1], "intrinsics": ["5", 2]} [ComfyUI] [INFO] Generated prompt_id: 552ecabd-d454-4e26-9c18-e0c7ba5dc872 [ComfyUI] [INFO] Calling execution.validate_prompt()... [ComfyUI] [INFO] Validation result: valid=True [ComfyUI] [INFO] === Validation PASSED === [ComfyUI] [worker:ComfyUI-Sharp] WARNING: comfy_kitchen does not support stochastic FP8 rounding, please update comfy_kitchen. [ComfyUI] [INFO] got prompt [ComfyUI] [SubprocessWorker] call_id=5 sending model_to_device [ComfyUI] [WARNING] Model 'RGBGaussianPredictor_1' gone from worker (restarted?), treating as offloaded Frame 3 saved (frame_002.jpg, t=6.1s) [ComfyUI] [comfy-env] [VRAM] After offload 'RGBGaussianPredictor_1' (2679 MB): 6892 / 24122 MB [capture-periodic] freeze=1ms shot=398ms unfreeze=4ms saved=True [ComfyUI] [INFO] Using RAM pressure cache. [ComfyUI] [comfy-env] Running LoadSharpModel: precision: 'auto' [ComfyUI] [VRAM] Before LoadSharpModel: 6892 / 24122 MB [ComfyUI] [SubprocessWorker] call_method: nodes.load_model.LoadSharpModel.EXECUTE_NORMALIZED [ComfyUI] [SubprocessWorker] acquired lock, ensuring started... [ComfyUI] [ComfyUI-Sharp] Health check: ping (timeout=5.0s)... [ComfyUI] [ComfyUI-Sharp] Health check: ok [ComfyUI] [SubprocessWorker] worker started/confirmed [ComfyUI] [SubprocessWorker] serializing kwargs to shm... [ComfyUI] [SubprocessWorker] created 0 shm blocks [ComfyUI] [SubprocessWorker] sending request via socket... [ComfyUI] [SubprocessWorker] call_id=6 sending call_method [capture-loop] iter=50 t=9.5s state={'complete': False, 'error': None, 'executedCount': 0, 'wsState': 1} eval_ms=1 ram=17.4/31.3GB (56%) swap=10.6/32.0GB (33%) cpu=23% browser_rss=0.72GB [ComfyUI] [worker:ComfyUI-Sharp] [LoadSharpModel] precision='auto' -> dtype=bf16 (device=cuda:0) [ComfyUI] [worker:ComfyUI-Sharp] [LoadSharpModel] checkpoint already present, reusing (no download): /workspaces/Sharp-2132/ComfyUI/models/sharp/sharp_2572gikvuh.pt (2679.6 MB) [ComfyUI] [worker:ComfyUI-Sharp] [LoadSharpModel] checkpoint ready: /workspaces/Sharp-2132/ComfyUI/models/sharp/sharp_2572gikvuh.pt (2679.6 MB) [ComfyUI] [worker:ComfyUI-Sharp] [LoadSharpModel] config: precision=auto -> dtype=bf16 [ComfyUI] [SubprocessWorker] got response: ok [ComfyUI] [comfy-env] [VRAM] Before offload 'RGBGaussianPredictor_1' (2679 MB) -> cpu: 6856 / 24122 MB [ComfyUI] [ComfyUI-Sharp] Health check: ping (timeout=5.0s)... [ComfyUI] [ComfyUI-Sharp] Health check: ok [ComfyUI] [SubprocessWorker] call_id=7 sending model_to_device Frame 4 saved (frame_003.jpg, t=11.5s) [capture-periodic] freeze=2ms shot=157ms unfreeze=3ms saved=True [ComfyUI] [WARNING] Model 'RGBGaussianPredictor_1' gone from worker (restarted?), treating as offloaded [ComfyUI] [comfy-env] [VRAM] After offload 'RGBGaussianPredictor_1' (2679 MB): 6856 / 24122 MB [ComfyUI] [comfy-env] [VRAM] Before offload 'MoGeWrapper_1' (631 MB) -> cpu: 6856 / 24122 MB [ComfyUI] [ComfyUI-MoGe2] Health check: ping (timeout=5.0s)... [ComfyUI] [ComfyUI-MoGe2] Health check: ok [ComfyUI] [SubprocessWorker] call_id=4 sending model_to_device [ComfyUI] [WARNING] Model 'MoGeWrapper_1' gone from worker (restarted?), treating as offloaded [ComfyUI] [comfy-env] [VRAM] After offload 'MoGeWrapper_1' (631 MB): 6856 / 24122 MB [ComfyUI] [comfy-env] LoadSharpModel done (5.54s): result: NodeOutput [ComfyUI] [VRAM] After LoadSharpModel: 6856 / 24122 MB [ComfyUI] [comfy-env] Running SharpPredict: focal_length_mm: 30.0, output_prefix: 'sharp', model: dict, image: torch.float32 [1,1024,1536,3] cpu [ComfyUI] [VRAM] Before SharpPredict: 6856 / 24122 MB [ComfyUI] [SubprocessWorker] call_method: nodes.predict.SharpPredict.EXECUTE_NORMALIZED [ComfyUI] [SubprocessWorker] acquired lock, ensuring started... [ComfyUI] [ComfyUI-Sharp] Health check: ping (timeout=5.0s)... [ComfyUI] [ComfyUI-Sharp] Health check: ok [ComfyUI] [SubprocessWorker] worker started/confirmed [ComfyUI] [comfy-env] PRE-SERIALIZE 'image' shape: torch.Size([1, 1024, 1536, 3]) [ComfyUI] [SubprocessWorker] serializing kwargs to shm... [ComfyUI] [SubprocessWorker] created 0 shm blocks [ComfyUI] [SubprocessWorker] sending request via socket... [ComfyUI] [SubprocessWorker] call_id=8 sending call_method [ComfyUI] [worker:ComfyUI-Sharp] [comfy-env] _from_shm got dict with keys: ['__type__', 'strategy', 'parent_pid', 'fd', 'storage_size'] [ComfyUI] [worker:ComfyUI-Sharp] [comfy-env] DESERIALIZE TensorRef: tensor_size=[1, 1024, 1536, 3] [ComfyUI] [worker:ComfyUI-Sharp] [comfy-env] DESERIALIZED tensor shape: torch.Size([1, 1024, 1536, 3]) [capture-loop] iter=100 t=15.8s state={'complete': False, 'error': None, 'executedCount': 0, 'wsState': 1} eval_ms=1 ram=11.4/31.3GB (37%) swap=5.0/32.0GB (16%) cpu=22% browser_rss=0.72GB [ComfyUI] [worker:ComfyUI-Sharp] [LoadSharpModel] loading checkpoint from /workspaces/Sharp-2132/ComfyUI/models/sharp/sharp_2572gikvuh.pt (dtype=bf16) [capture-loop] iter=150 t=21.3s state={'complete': False, 'error': None, 'executedCount': 0, 'wsState': 1} eval_ms=2 ram=13.4/31.3GB (43%) swap=4.4/32.0GB (14%) cpu=20% browser_rss=0.71GB [capture-loop] iter=200 t=27.1s state={'complete': False, 'error': None, 'executedCount': 0, 'wsState': 1} eval_ms=2 ram=14.8/31.3GB (48%) swap=4.4/32.0GB (14%) cpu=17% browser_rss=0.71GB [ComfyUI] [worker:ComfyUI-Sharp] [LoadSharpModel] initializing model on meta device... [ComfyUI] [worker:ComfyUI-Sharp] [LoadSharpModel] model ready (torch.bfloat16) [ComfyUI] [SubprocessWorker] callback 'request_vram_budget' from call_id=8 [ComfyUI] [comfy-env] VRAM request: 2.81GB, free before eviction: 20.24GB [ComfyUI] [comfy-env] VRAM after eviction: 20.24GB [ComfyUI] [worker:ComfyUI-Sharp] [VRAM] +282MB (now 282MB) reserved=288MB peak=282MB [ComfyUI] [worker:ComfyUI-Sharp] [VRAM] +2583MB (now 2866MB) reserved=2912MB peak=2866MB [ComfyUI] [worker:ComfyUI-Sharp] [VRAM] +296MB (now 3162MB) reserved=3456MB peak=3314MB [ComfyUI] [worker:ComfyUI-Sharp] [VRAM] +1001MB (now 4164MB) reserved=7840MB peak=7053MB [capture-loop] iter=250 t=33.2s state={'complete': False, 'error': None, 'executedCount': 0, 'wsState': 1} eval_ms=2 ram=13.5/31.3GB (43%) swap=4.4/32.0GB (14%) cpu=24% browser_rss=0.72GB [ComfyUI] [worker:ComfyUI-Sharp] [VRAM] +994MB (now 5158MB) reserved=7360MB peak=7053MB [ComfyUI] [SubprocessWorker] callback 'report_progress' from call_id=8 [ComfyUI] [SubprocessWorker] got response: ok [ComfyUI] [ComfyUI-GaussianPack] python: /tmp/comfytest-home/.ce/.pixi/envs/gaussianpack-nodes/bin/python [ComfyUI] [comfy-env] Created 1 model patchers: ['RGBGaussianPredictor_1'] [ComfyUI] [ComfyUI-GaussianPack] sys_path sent to worker: ['/workspaces/Sharp-2132/ComfyUI', '/workspaces/Sharp-2132/ComfyUI/custom_nodes/ComfyUI-GaussianPack', '/tmp/comfytest-home/.ce/.pixi/envs/gaussianpack-nodes/lib/python3.1/site-packages', '/workspaces/Sharp-2132/ComfyUI/custom_nodes/ComfyUI-GaussianPack'] [ComfyUI] [comfy-env] SharpPredict done (24.49s): result: NodeOutput [ComfyUI] [SubprocessWorker] is_pixi=True, python=/tmp/comfytest-home/.ce/.pixi/envs/gaussianpack-nodes/bin/python [ComfyUI] [VRAM] After SharpPredict: 12291 / 24122 MB [ComfyUI] [SubprocessWorker] launching cmd=['/tmp/comfytest-home/.pixi/bin/pixi', 'run', '--as-is', '--manifest-path', '/tmp/comfytest-home/.ce/pixi.toml', '-e', 'gaussianpack-nodes', 'python', '/tmp/comfyui_pvenv_3vhbt_t_/persistent_worker.py', 'abstract://comfy_worker_5e78ab42e5a3']... [ComfyUI] [VRAM] Loaded: SubprocessModel (2679 MB) [ComfyUI] [SubprocessWorker] socket_addr=abstract://comfy_worker_5e78ab42e5a3 (abstract, no filesystem path) [ComfyUI] [comfy-env] Running PreviewGaussianSharp: ply_path: '/workspaces/Sharp-2132/ComfyUI/output/sharp_178086886593..., extrinsics: list[4], intrinsics: list[3] [ComfyUI] [VRAM] Before PreviewGaussianSharp: 12291 / 24122 MB [ComfyUI] [VRAM] Loaded: SubprocessModel (2679 MB) [ComfyUI] [SubprocessWorker] call_method: nodes.preview_gaussian_sharp.PreviewGaussianSharp.EXECUTE_NORMALIZED [ComfyUI] [SubprocessWorker] acquired lock, ensuring started... [ComfyUI] [ComfyUI-GaussianPack] Health check: ping (timeout=5.0s)... [ComfyUI] [ComfyUI-GaussianPack] Health check: failed [ComfyUI] [ComfyUI-GaussianPack] Socket unhealthy, restarting worker... Frame 5 saved (frame_004.jpg, t=36.4s) [capture-periodic] freeze=1ms shot=149ms unfreeze=2ms saved=True [ComfyUI] [SubprocessWorker] worker started/confirmed [ComfyUI] [SubprocessWorker] serializing kwargs to shm... [ComfyUI] [SubprocessWorker] created 0 shm blocks [ComfyUI] [SubprocessWorker] sending request via socket... [ComfyUI] [SubprocessWorker] call_id=3 sending call_method [capture-loop] iter=300 t=52.5s state={'complete': False, 'error': None, 'executedCount': 0, 'wsState': 1} eval_ms=2 ram=13.3/31.3GB (42%) swap=4.4/32.0GB (14%) cpu=12% browser_rss=0.72GB [ComfyUI] [worker:ComfyUI-GaussianPack] WARNING: SPZ route not registered (ModuleNotFoundError: No module named 'comfy_aimdo') Node executed (1 total), capturing... [ComfyUI] [SubprocessWorker] got response: ok [ComfyUI] [ComfyUI-Sharp] python: /tmp/comfytest-home/.ce/.pixi/envs/sharp-nodes/bin/python [ComfyUI] [comfy-env] PreviewGaussianSharp done (25.53s): result: NodeOutput [ComfyUI] [ComfyUI-Sharp] sys_path sent to worker: ['/workspaces/Sharp-2132/ComfyUI', '/workspaces/Sharp-2132/ComfyUI/custom_nodes/ComfyUI-Sharp', '/tmp/comfytest-home/.ce/.pixi/envs/sharp-nodes/lib/python3.1/site-packages', '/workspaces/Sharp-2132/ComfyUI/custom_nodes/ComfyUI-Sharp'] Frame 6 saved (frame_005.jpg, t=61.0s) [capture-node] freeze=392ms shot=958ms unfreeze=2ms saved=True [ComfyUI] [VRAM] After PreviewGaussianSharp: 13986 / 24122 MB [ComfyUI] [SubprocessWorker] is_pixi=True, python=/tmp/comfytest-home/.ce/.pixi/envs/sharp-nodes/bin/python [ComfyUI] [SubprocessWorker] launching cmd=['/tmp/comfytest-home/.pixi/bin/pixi', 'run', '--as-is', '--manifest-path', '/tmp/comfytest-home/.ce/pixi.toml', '-e', 'sharp-nodes', 'python', '/tmp/comfyui_pvenv_fah6gilt/persistent_worker.py', 'abstract://comfy_worker_541f8f5771bf']... [ComfyUI] [VRAM] Loaded: SubprocessModel (2679 MB) [ComfyUI] [INFO] Prompt executed in 55.96 seconds [ComfyUI] [SubprocessWorker] socket_addr=abstract://comfy_worker_541f8f5771bf (abstract, no filesystem path) [ComfyUI] [comfy-env] [VRAM] Before offload 'RGBGaussianPredictor_1' (2679 MB) -> cpu: 13986 / 24122 MB [ComfyUI] [ComfyUI-Sharp] Health check: ping (timeout=5.0s)... [ComfyUI] [ComfyUI-Sharp] Health check: failed [ComfyUI] [ComfyUI-Sharp] Socket unhealthy, restarting worker... [ComfyUI] [comfy-env] Invalidated 1 stale model patchers (will be cleaned up during next unload) [ComfyUI] [worker:ComfyUI-Sharp] ERROR: Failed to import comfy_kitchen, Error: No module named 'comfy_kitchen', fp8 and fp4 support will not be available. [ComfyUI] [worker:ComfyUI-Sharp] WARNING: comfy_kitchen does not support stochastic FP8 rounding, please update comfy_kitchen. [ComfyUI] [SubprocessWorker] call_id=9 sending model_to_device [ComfyUI] [WARNING] Model 'RGBGaussianPredictor_1' gone from worker (restarted?), treating as offloaded [ComfyUI] [comfy-env] [VRAM] After offload 'RGBGaussianPredictor_1' (2679 MB): 6512 / 24122 MB [ComfyUI] [INFO] Using RAM pressure cache. Frame 7 saved (frame_006.jpg, t=71.4s) [capture-periodic] freeze=8038ms shot=8278ms unfreeze=1ms saved=True Execution complete (t=71.4s) [3d-wait] Phase 1: Waiting for 'Loading 3D Model' text to disappear... [3d-wait] Phase 1 done in 18.0s [3d-wait] Phase 2: iframes=1 [3d-wait] iframe viewer_ready=True (matched 1 console logs) [3d-wait] Unfrozen in 8.839s, rendering for 5s... [3d-wait] JS halted via CDP after 18.8s [3d-wait] Re-frozen in 44.6s [3d-wait] Total 3D wait: 83.5s Captured 7 unique frames over 180.98s [debug] iframes: 1 [debug] iframe[0]: src=http://127.0.0.1:41883/extensions/ComfyUI-GaussianPack/viewer_gaussian_sharp.htm, canvas=1536x1024, rafFrozen=True [timing] trigger_3d_previews: 0.0s Saved high-quality screenshot: sharp_basic_executed.png [timing] final_screenshot: 1.2s Captured 8 video frames