78 KiB
78 KiB
Capturing execution frames: pano.json
[ComfyUI] [INFO] Using RAM pressure cache.
[ComfyUI] [INFO] Using RAM pressure cache.
Frame 1 saved (frame_000.jpg, t=0.0s)
Validating workflow...
[ComfyUI] [INFO] === /validate endpoint called ===
Queuing workflow for execution...
[ComfyUI] [INFO] Received JSON with keys: ['prompt']
[ComfyUI] [INFO] Prompt has 18 nodes
[ComfyUI] [INFO] Node 7: LoadImage
[ComfyUI] [INFO] Inputs: {"image": "pano.png"}
[ComfyUI] [INFO] Node 9: LoadSharpModel
[ComfyUI] [INFO] Inputs: {"precision": "auto"}
[ComfyUI] [INFO] Node 54: MergeGaussians
[ComfyUI] [INFO] Inputs: {"ply_folder": ["76", 0], "output_prefix": "merged", "max_depth": 0, "min_opacity": 0}
[ComfyUI] [INFO] Node 59: PanoramaWrap
[ComfyUI] [INFO] Inputs: {"image": ["7", 0]}
[ComfyUI] [INFO] Node 60: PanoramaDepthMerge
[ComfyUI] [INFO] Inputs: {"out_width": ["61", 0], "out_height": ["61", 1], "use_gpu": true, "scale_anchor": false, "chunk_size": 8, "center_weight_power": 2, "normal_edge_threshold_deg": 0, "normal_consistency_boost": false,
[ComfyUI] [INFO] Node 61: GetImageSize
[ComfyUI] [comfy-env] SubprocessWorker: /tmp/comfytest-home/.ce/.pixi/envs/sharp-nodes/bin/python
[ComfyUI] [INFO] Inputs: {"image": ["7", 0]}
[ComfyUI] [comfy-env] env_vars: {'COMFYUI_BASE': '/workspaces/Sharp-1914/ComfyUI'}
[ComfyUI] [INFO] Node 62: PreviewImage
[ComfyUI] [ComfyUI-Sharp] python: /tmp/comfytest-home/.ce/.pixi/envs/sharp-nodes/bin/python
[ComfyUI] [INFO] Inputs: {"images": ["60", 2]}
[ComfyUI] [ComfyUI-Sharp] sys_path sent to worker: ['/workspaces/Sharp-1914/ComfyUI', '/workspaces/Sharp-1914/ComfyUI/custom_nodes/ComfyUI-Sharp', '/tmp/comfytest-home/.ce/.pixi/envs/sharp-nodes/lib/python3.1/site-packages', '/workspaces/Sharp-1914/ComfyUI/custom_nodes/ComfyUI-Sharp']
[ComfyUI] [INFO] Node 68: PreviewImage
[ComfyUI] [SubprocessWorker] is_pixi=True, python=/tmp/comfytest-home/.ce/.pixi/envs/sharp-nodes/bin/python
[ComfyUI] [INFO] Inputs: {"images": ["96", 0]}
[ComfyUI] [SubprocessWorker] launching cmd=['/tmp/comfytest-home/.pixi/bin/pixi', 'run', '--as-is', '--manifest-path', '/tmp/comfytest-home/.ce/pixi.toml', '-e', 'sharp-nodes', 'python', '/tmp/comfyui_pvenv_qlpb5zhh/persistent_worker.py', 'abstract://comfy_worker_375e4707e383']...
[ComfyUI] [INFO] Node 70: PreviewImage
[ComfyUI] [SubprocessWorker] socket_addr=abstract://comfy_worker_375e4707e383 (abstract, no filesystem path)
[ComfyUI] [INFO] Inputs: {"images": ["81", 0]}
[ComfyUI] [INFO] Node 73: SharpRayToPlanarDepth
[ComfyUI] [INFO] Inputs: {"image": ["87", 1], "intrinsics": ["87", 4], "extrinsics": ["87", 3]}
[ComfyUI] [INFO] Node 76: SharpPredictGaussiansFromMetricDepth
[ComfyUI] [INFO] Inputs: {"snap_to_external_depth": "none", "depth_convention": "planar_z", "focal_length_mm": 30, "output_prefix": "sharp_aligned", "save_background_layer": true, "edge_crop": 0, "model": ["9", 0], "image": [
[ComfyUI] [INFO] Node 78: TransformGaussian
[ComfyUI] [INFO] Inputs: {"rotate_x": -90, "rotate_y": 0, "rotate_z": 0, "ply_path": ["54", 1]}
[ComfyUI] [INFO] Node 80: DownloadAndLoadMoGe2Model
[ComfyUI] [INFO] Inputs: {"model": "moge-2-vitl-normal.pt", "precision": "auto", "attention": "auto"}
[ComfyUI] [INFO] Node 81: MoGe2Inference
[ComfyUI] [INFO] Inputs: {"resolution_level": 9, "num_tokens": 0, "fov_x_deg": ["96", 3], "force_projection": true, "apply_mask": true, "moge2_model": ["80", 0], "images": ["96", 0]}
[ComfyUI] [INFO] Node 87: PanoramaSplitAdaptive
[ComfyUI] [INFO] Inputs: {"split_method": "icosahedron_42", "resolution": 1536, "fov_degrees": 90, "use_gpu": true, "create_masks": true, "mask_method": "closest_to", "panorama": ["59", 0], "depth_panorama": ["60", 0], "norma
[ComfyUI] [INFO] Node 89: PreviewImage
[ComfyUI] [INFO] Inputs: {"images": ["87", 8]}
[ComfyUI] [INFO] Node 95: PreviewGaussians
[ComfyUI] [INFO] Inputs: {"camera_mode": "orbit", "fov_degrees": 71, "renderer": "playcanvas", "transport_format": "ply", "ply_path": ["78", 0]}
[ComfyUI] [INFO] Node 96: PanoramaSplit
[ComfyUI] [INFO] Inputs: {"split_method": "icosahedron_42", "resolution": 952, "fov_degrees": 90, "use_gpu": true, "create_masks": false, "fname": "pano_bank", "panorama": ["59", 0]}
[ComfyUI] [INFO] Generated prompt_id: 31085ed5-c99f-4caa-adc5-5d3b2d8a0840
[ComfyUI] [INFO] Calling execution.validate_prompt()...
[ComfyUI] [INFO] Validation result: valid=True
[ComfyUI] [INFO] === Validation PASSED ===
[ComfyUI] [INFO] got prompt
[ComfyUI] [comfy-env] Running LoadSharpModel: precision: 'auto'
[ComfyUI] [VRAM] Before LoadSharpModel: 697 / 24122 MB
[ComfyUI] [SubprocessWorker] call_method: nodes.load_model.LoadSharpModel.EXECUTE_NORMALIZED
[ComfyUI] [SubprocessWorker] acquired lock, ensuring started...
[ComfyUI] [worker:ComfyUI-Sharp] ERROR: Failed to import comfy_kitchen, Error: No module named 'comfy_kitchen', fp8 and fp4 support will not be available.
[ComfyUI] [worker:ComfyUI-Sharp] WARNING: comfy_kitchen does not support stochastic FP8 rounding, please update comfy_kitchen.
[ComfyUI] [SubprocessWorker] worker started/confirmed
[ComfyUI] [SubprocessWorker] serializing kwargs to shm...
[ComfyUI] [SubprocessWorker] created 0 shm blocks
[ComfyUI] [SubprocessWorker] sending request via socket...
[ComfyUI] [SubprocessWorker] call_id=1 sending call_method
[ComfyUI] [worker:ComfyUI-Sharp] [LoadSharpModel] precision='auto' -> dtype=bf16 (device=cuda:0)
[ComfyUI] [worker:ComfyUI-Sharp] [LoadSharpModel] checkpoint not found at /workspaces/Sharp-1914/ComfyUI/models/sharp/sharp_2572gikvuh.pt — downloading from HuggingFace repo 'apple/Sharp' file 'sharp_2572gikvuh.pt' -> /workspaces/Sharp-1914/ComfyUI/models/sharp
[ComfyUI]
Frame 2 saved (frame_001.jpg, t=2.3s)
[capture-periodic] freeze=1ms shot=91ms unfreeze=7ms saved=True
Frame 3 saved (frame_002.jpg, t=4.5s)
[capture-periodic] freeze=1ms shot=121ms unfreeze=5ms saved=True
[capture-loop] iter=50 t=5.7s state={'complete': False, 'error': None, 'executedCount': 0, 'wsState': 1} eval_ms=2 ram=4.7/31.3GB (15%) swap=1.7/32.0GB (5%) cpu=9% browser_rss=1.01GB
[ComfyUI] sharp_2572gikvuh.pt: 0%| | 0.00/2.81G [00:00<?, ?B/s]
[ComfyUI] sharp_2572gikvuh.pt: 6%|▌ | 158M/2.81G [00:06<01:40, 26.3MB/s][SubprocessWorker] callback 'report_progress' from call_id=1
[ComfyUI]
[ComfyUI] sharp_2572gikvuh.pt: 10%|█ | 292M/2.81G [00:06<00:45, 54.9MB/s][SubprocessWorker] callback 'report_progress' from call_id=1
Frame 4 saved (frame_003.jpg, t=8.9s)
[capture-periodic] freeze=1ms shot=90ms unfreeze=7ms saved=True
[ComfyUI]
[ComfyUI] sharp_2572gikvuh.pt: 13%|█▎ | 359M/2.81G [00:07<00:47, 51.6MB/s][SubprocessWorker] callback 'report_progress' from call_id=1
[ComfyUI]
[ComfyUI] sharp_2572gikvuh.pt: 15%|█▌ | 427M/2.81G [00:08<00:35, 67.1MB/s][SubprocessWorker] callback 'report_progress' from call_id=1
[capture-loop] iter=100 t=11.0s state={'complete': False, 'error': None, 'executedCount': 0, 'wsState': 1} eval_ms=2 ram=5.0/31.3GB (16%) swap=1.7/32.0GB (5%) cpu=8% browser_rss=1.01GB
Frame 5 saved (frame_004.jpg, t=11.2s)
[capture-periodic] freeze=1ms shot=93ms unfreeze=7ms saved=True
[capture-loop] iter=150 t=16.5s state={'complete': False, 'error': None, 'executedCount': 0, 'wsState': 1} eval_ms=1 ram=5.5/31.3GB (18%) swap=1.7/32.0GB (5%) cpu=8% browser_rss=1.01GB
[ComfyUI]
[ComfyUI] sharp_2572gikvuh.pt: 30%|██▉ | 829M/2.81G [00:14<00:31, 63.3MB/s][SubprocessWorker] callback 'report_progress' from call_id=1
Frame 6 saved (frame_005.jpg, t=17.6s)
[capture-periodic] freeze=1ms shot=91ms unfreeze=6ms saved=True
[ComfyUI]
[ComfyUI] sharp_2572gikvuh.pt: 34%|███▍ | 963M/2.81G [00:17<00:33, 55.8MB/s][SubprocessWorker] callback 'report_progress' from call_id=1
[ComfyUI]
[ComfyUI] sharp_2572gikvuh.pt: 37%|███▋ | 1.03G/2.81G [00:18<00:28, 63.5MB/s][SubprocessWorker] callback 'report_progress' from call_id=1
[ComfyUI]
[ComfyUI] sharp_2572gikvuh.pt: 46%|████▌ | 1.30G/2.81G [00:19<00:15, 98.6MB/s][SubprocessWorker] callback 'report_progress' from call_id=1
[capture-loop] iter=200 t=21.9s state={'complete': False, 'error': None, 'executedCount': 0, 'wsState': 1} eval_ms=1 ram=5.5/31.3GB (18%) swap=1.7/32.0GB (5%) cpu=10% browser_rss=1.02GB
Frame 7 saved (frame_006.jpg, t=22.0s)
[capture-periodic] freeze=1ms shot=103ms unfreeze=5ms saved=True
[ComfyUI]
[ComfyUI] sharp_2572gikvuh.pt: 51%|█████ | 1.43G/2.81G [00:21<00:15, 88.2MB/s][SubprocessWorker] callback 'report_progress' from call_id=1
Frame 8 saved (frame_007.jpg, t=24.2s)
[capture-periodic] freeze=1ms shot=102ms unfreeze=5ms saved=True
[ComfyUI]
[ComfyUI] sharp_2572gikvuh.pt: 56%|█████▌ | 1.57G/2.81G [00:22<00:12, 96.9MB/s][SubprocessWorker] callback 'report_progress' from call_id=1
[ComfyUI]
[ComfyUI] sharp_2572gikvuh.pt: 61%|██████ | 1.70G/2.81G [00:22<00:08, 125MB/s] [SubprocessWorker] callback 'report_progress' from call_id=1
[ComfyUI]
[ComfyUI] sharp_2572gikvuh.pt: 70%|███████ | 1.97G/2.81G [00:22<00:04, 188MB/s][SubprocessWorker] callback 'report_progress' from call_id=1
[ComfyUI]
[ComfyUI] sharp_2572gikvuh.pt: 72%|███████▏ | 2.04G/2.81G [00:23<00:03, 196MB/s][SubprocessWorker] callback 'report_progress' from call_id=1
[ComfyUI]
[ComfyUI] sharp_2572gikvuh.pt: 80%|███████▉ | 2.24G/2.81G [00:23<00:02, 218MB/s][SubprocessWorker] callback 'report_progress' from call_id=1
[ComfyUI]
[ComfyUI] sharp_2572gikvuh.pt: 87%|████████▋ | 2.44G/2.81G [00:24<00:01, 291MB/s][SubprocessWorker] callback 'report_progress' from call_id=1
Frame 9 saved (frame_008.jpg, t=26.4s)
[capture-periodic] freeze=14ms shot=121ms unfreeze=8ms saved=True
[ComfyUI]
[ComfyUI] sharp_2572gikvuh.pt: 100%|██████████| 2.81G/2.81G [00:24<00:00, 470MB/s][SubprocessWorker] callback 'report_progress' from call_id=1
[ComfyUI]
[ComfyUI] sharp_2572gikvuh.pt: 100%|██████████| 2.81G/2.81G [00:24<00:00, 114MB/s]
[ComfyUI] [worker:ComfyUI-Sharp] [LoadSharpModel] checkpoint ready: /workspaces/Sharp-1914/ComfyUI/models/sharp/sharp_2572gikvuh.pt (2679.6 MB)
[ComfyUI] [worker:ComfyUI-Sharp] [LoadSharpModel] config: precision=auto -> dtype=bf16
[ComfyUI] [SubprocessWorker] got response: ok
[ComfyUI] [comfy-env] SubprocessWorker: /tmp/comfytest-home/.ce/.pixi/envs/moge2-nodes/bin/python
[ComfyUI] [comfy-env] LoadSharpModel done (26.77s): result: NodeOutput
[ComfyUI] [comfy-env] env_vars: {'COMFYUI_BASE': '/workspaces/Sharp-1914/ComfyUI'}
[ComfyUI] [VRAM] After LoadSharpModel: 959 / 24122 MB
[ComfyUI] [ComfyUI-MoGe2] python: /tmp/comfytest-home/.ce/.pixi/envs/moge2-nodes/bin/python
[ComfyUI] [comfy-env] Running DownloadAndLoadMoGe2Model: model: 'moge-2-vitl-normal.pt', precision: 'auto', attention: 'auto'
[ComfyUI] [ComfyUI-MoGe2] sys_path sent to worker: ['/workspaces/Sharp-1914/ComfyUI', '/workspaces/Sharp-1914/ComfyUI/custom_nodes/ComfyUI-MoGe2', '/tmp/comfytest-home/.ce/.pixi/envs/moge2-nodes/lib/python3.1/site-packages', '/workspaces/Sharp-1914/ComfyUI/custom_nodes/ComfyUI-MoGe2']
[ComfyUI] [VRAM] Before DownloadAndLoadMoGe2Model: 959 / 24122 MB
[ComfyUI] [SubprocessWorker] is_pixi=True, python=/tmp/comfytest-home/.ce/.pixi/envs/moge2-nodes/bin/python
[ComfyUI] [SubprocessWorker] call_method: nodes.load_model.DownloadAndLoadMoGe2Model.EXECUTE_NORMALIZED
[ComfyUI] [SubprocessWorker] launching cmd=['/tmp/comfytest-home/.pixi/bin/pixi', 'run', '--as-is', '--manifest-path', '/tmp/comfytest-home/.ce/pixi.toml', '-e', 'moge2-nodes', 'python', '/tmp/comfyui_pvenv_bmmahm2z/persistent_worker.py', 'abstract://comfy_worker_b1be181c7b7c']...
[ComfyUI] [SubprocessWorker] acquired lock, ensuring started...
[ComfyUI] [SubprocessWorker] socket_addr=abstract://comfy_worker_b1be181c7b7c (abstract, no filesystem path)
[capture-loop] iter=250 t=27.5s state={'complete': False, 'error': None, 'executedCount': 0, 'wsState': 1} eval_ms=2 ram=4.6/31.3GB (15%) swap=1.7/32.0GB (5%) cpu=12% browser_rss=0.94GB
[ComfyUI] [worker:ComfyUI-MoGe2] ERROR: Failed to import comfy_kitchen, Error: No module named 'comfy_kitchen', fp8 and fp4 support will not be available.
[ComfyUI] [worker:ComfyUI-MoGe2] WARNING: comfy_kitchen does not support stochastic FP8 rounding, please update comfy_kitchen.
[ComfyUI] [SubprocessWorker] worker started/confirmed
[ComfyUI] [SubprocessWorker] serializing kwargs to shm...
[ComfyUI] [SubprocessWorker] created 0 shm blocks
[ComfyUI] [SubprocessWorker] sending request via socket...
[ComfyUI] [SubprocessWorker] call_id=1 sending call_method
Frame 10 saved (frame_009.jpg, t=28.6s)
[capture-periodic] freeze=1ms shot=88ms unfreeze=6ms saved=True
[ComfyUI]
[ComfyUI] model.pt: 0%| | 0.00/1.32G [00:00<?, ?B/s]
[ComfyUI] model.pt: 5%|▌ | 67.1M/1.32G [00:03<00:56, 22.2MB/s][SubprocessWorker] callback 'report_progress' from call_id=1
[capture-loop] iter=300 t=32.9s state={'complete': False, 'error': None, 'executedCount': 0, 'wsState': 1} eval_ms=1 ram=5.0/31.3GB (16%) swap=1.7/32.0GB (5%) cpu=10% browser_rss=0.94GB
Frame 11 saved (frame_010.jpg, t=33.0s)
[capture-periodic] freeze=1ms shot=89ms unfreeze=7ms saved=True
[ComfyUI]
[ComfyUI] model.pt: 10%|█ | 134M/1.32G [00:04<00:40, 29.5MB/s] [SubprocessWorker] callback 'report_progress' from call_id=1
Frame 12 saved (frame_011.jpg, t=35.2s)
[capture-periodic] freeze=1ms shot=90ms unfreeze=7ms saved=True
[ComfyUI]
[ComfyUI] model.pt: 20%|██ | 268M/1.32G [00:09<00:34, 30.8MB/s][SubprocessWorker] callback 'report_progress' from call_id=1
[capture-loop] iter=350 t=38.4s state={'complete': False, 'error': None, 'executedCount': 0, 'wsState': 1} eval_ms=1 ram=5.5/31.3GB (18%) swap=1.7/32.0GB (5%) cpu=8% browser_rss=0.92GB
[ComfyUI]
[ComfyUI] model.pt: 61%|██████ | 805M/1.32G [00:10<00:04, 112MB/s] [SubprocessWorker] callback 'report_progress' from call_id=1
Frame 13 saved (frame_012.jpg, t=39.5s)
[capture-periodic] freeze=1ms shot=98ms unfreeze=1ms saved=True
[ComfyUI]
[ComfyUI] model.pt: 71%|███████ | 939M/1.32G [00:11<00:03, 111MB/s][SubprocessWorker] callback 'report_progress' from call_id=1
[ComfyUI]
[ComfyUI] model.pt: 91%|█████████ | 1.21G/1.32G [00:11<00:00, 169MB/s][SubprocessWorker] callback 'report_progress' from call_id=1
[ComfyUI]
[ComfyUI] model.pt: 100%|██████████| 1.32G/1.32G [00:12<00:00, 193MB/s][SubprocessWorker] callback 'report_progress' from call_id=1
[ComfyUI]
[ComfyUI] model.pt: 100%|██████████| 1.32G/1.32G [00:12<00:00, 109MB/s]
[ComfyUI] [SubprocessWorker] got response: ok
[ComfyUI] [comfy-env] DownloadAndLoadMoGe2Model done (14.46s): result: NodeOutput
[ComfyUI] [VRAM] After DownloadAndLoadMoGe2Model: 1220 / 24122 MB
[ComfyUI] [comfy-env] Running PanoramaWrap: image: torch.float32 [1,2048,4096,3] cpu
[ComfyUI] [comfy-env] SubprocessWorker: /tmp/comfytest-home/.ce/.pixi/envs/panopack-nodes/bin/python
[ComfyUI] [VRAM] Before PanoramaWrap: 1220 / 24122 MB
[ComfyUI] [comfy-env] env_vars: {'COMFYUI_BASE': '/workspaces/Sharp-1914/ComfyUI'}
[ComfyUI] [SubprocessWorker] call_method: nodes.panorama_type.PanoramaWrap.EXECUTE_NORMALIZED
[ComfyUI] [ComfyUI-PanoPack] python: /tmp/comfytest-home/.ce/.pixi/envs/panopack-nodes/bin/python
[ComfyUI] [SubprocessWorker] acquired lock, ensuring started...
[ComfyUI] [ComfyUI-PanoPack] sys_path sent to worker: ['/workspaces/Sharp-1914/ComfyUI', '/workspaces/Sharp-1914/ComfyUI/custom_nodes/ComfyUI-PanoPack', '/tmp/comfytest-home/.ce/.pixi/envs/panopack-nodes/lib/python3.1/site-packages', '/workspaces/Sharp-1914/ComfyUI/custom_nodes/ComfyUI-PanoPack']
[ComfyUI] [SubprocessWorker] is_pixi=True, python=/tmp/comfytest-home/.ce/.pixi/envs/panopack-nodes/bin/python
[ComfyUI] [SubprocessWorker] launching cmd=['/tmp/comfytest-home/.pixi/bin/pixi', 'run', '--as-is', '--manifest-path', '/tmp/comfytest-home/.ce/pixi.toml', '-e', 'panopack-nodes', 'python', '/tmp/comfyui_pvenv_0kgugsfd/persistent_worker.py', 'abstract://comfy_worker_2b8028f966fa']...
[ComfyUI] [SubprocessWorker] socket_addr=abstract://comfy_worker_2b8028f966fa (abstract, no filesystem path)
Frame 14 saved (frame_013.jpg, t=41.8s)
[capture-periodic] freeze=1ms shot=104ms unfreeze=1ms saved=True
[ComfyUI] [worker:ComfyUI-PanoPack] ERROR: Failed to import comfy_kitchen, Error: No module named 'comfy_kitchen', fp8 and fp4 support will not be available.
[ComfyUI] [worker:ComfyUI-PanoPack] WARNING: comfy_kitchen does not support stochastic FP8 rounding, please update comfy_kitchen.
[ComfyUI] [SubprocessWorker] worker started/confirmed
[ComfyUI] [comfy-env] PRE-SERIALIZE 'image' shape: torch.Size([1, 2048, 4096, 3])
[ComfyUI] [SubprocessWorker] serializing kwargs to shm...
[ComfyUI] [SubprocessWorker] created 0 shm blocks
[ComfyUI] [SubprocessWorker] sending request via socket...
[ComfyUI] [SubprocessWorker] call_id=1 sending call_method
[ComfyUI] [worker:ComfyUI-PanoPack] [comfy-env] _from_shm got dict with keys: ['__type__', 'strategy', 'parent_pid', 'fd', 'storage_size']
[ComfyUI] [worker:ComfyUI-PanoPack] [comfy-env] DESERIALIZE TensorRef: tensor_size=[1, 2048, 4096, 3]
[ComfyUI] [worker:ComfyUI-PanoPack] [comfy-env] DESERIALIZED tensor shape: torch.Size([1, 2048, 4096, 3])
[ComfyUI] [SubprocessWorker] got response: ok
[ComfyUI] [comfy-env] PanoramaWrap done (1.64s): result: NodeOutput
[ComfyUI] [VRAM] After PanoramaWrap: 1481 / 24122 MB
[ComfyUI] [comfy-env] Running PanoramaSplit: split_method: dict, resolution: 952, fov_degrees: 90.0, use_gpu: True, create_masks: False, fname: 'pano_bank', panorama: dict
[ComfyUI] [VRAM] Before PanoramaSplit: 1481 / 24122 MB
[ComfyUI] [SubprocessWorker] call_method: nodes.panorama_split.PanoramaSplit.EXECUTE_NORMALIZED
[ComfyUI] [SubprocessWorker] acquired lock, ensuring started...
[ComfyUI] [ComfyUI-PanoPack] Health check: ping (timeout=5.0s)...
[ComfyUI] [ComfyUI-PanoPack] Health check: ok
[ComfyUI] [SubprocessWorker] worker started/confirmed
[ComfyUI] [SubprocessWorker] serializing kwargs to shm...
[ComfyUI] [SubprocessWorker] created 0 shm blocks
[ComfyUI] [SubprocessWorker] sending request via socket...
[ComfyUI] [SubprocessWorker] call_id=2 sending call_method
[ComfyUI] [worker:ComfyUI-PanoPack] [comfy-env] _from_shm got dict with keys: ['__type__', 'strategy', 'parent_pid', 'fd', 'storage_size']
[ComfyUI] [worker:ComfyUI-PanoPack] [comfy-env] DESERIALIZE TensorRef: tensor_size=[1, 2048, 4096, 3]
[ComfyUI] [worker:ComfyUI-PanoPack] [comfy-env] DESERIALIZED tensor shape: torch.Size([1, 2048, 4096, 3])
[capture-loop] iter=400 t=43.8s state={'complete': False, 'error': None, 'executedCount': 0, 'wsState': 1} eval_ms=1 ram=5.5/31.3GB (18%) swap=1.7/32.0GB (5%) cpu=14% browser_rss=0.93GB
Frame 15 saved (frame_014.jpg, t=44.0s)
[capture-periodic] freeze=1ms shot=98ms unfreeze=5ms saved=True
[ComfyUI] [worker:ComfyUI-PanoPack] [PanoramaSplit] swapped up=[0,1,0] for 2 pole vertices
Frame 16 saved (frame_015.jpg, t=46.1s)
[capture-periodic] freeze=1ms shot=97ms unfreeze=5ms saved=True
[capture-loop] iter=450 t=49.4s state={'complete': False, 'error': None, 'executedCount': 0, 'wsState': 1} eval_ms=2 ram=6.5/31.3GB (21%) swap=1.7/32.0GB (5%) cpu=11% browser_rss=0.93GB
[ComfyUI] [worker:ComfyUI-PanoPack] [VRAM] +290MB (now 290MB) reserved=320MB peak=290MB
[ComfyUI] [worker:ComfyUI-PanoPack] [VRAM] -291MB (now 0MB) reserved=1312MB peak=822MB
[ComfyUI] [worker:ComfyUI-PanoPack] [PanoramaSplit] icosahedron_42: (4096x2048) -> 42 crops @ 952x952, fov=(90,90) via grid_sample (GPU); cameras 1.199s, split 5.180s, total 7.251s
[ComfyUI] [SubprocessWorker] got response: ok
[ComfyUI] [comfy-env] PanoramaSplit done (8.29s): result: NodeOutput
[ComfyUI] [VRAM] After PanoramaSplit: 2855 / 24122 MB
Frame 17 saved (frame_016.jpg, t=52.6s)
[capture-periodic] freeze=1ms shot=88ms unfreeze=6ms saved=True
[ComfyUI] [comfy-env] Running MoGe2Inference: resolution_level: 9, num_tokens: 0, fov_x_deg: 90.0, force_projection: True, apply_mask: True, moge2_model: dict, images: torch.float32 [42,952,952,3] cpu
[ComfyUI] [VRAM] Before MoGe2Inference: 2855 / 24122 MB
[ComfyUI] [SubprocessWorker] call_method: nodes.nodes_inference.MoGe2Inference.EXECUTE_NORMALIZED
[ComfyUI] [SubprocessWorker] acquired lock, ensuring started...
[ComfyUI] [ComfyUI-MoGe2] Health check: ping (timeout=5.0s)...
[ComfyUI] [ComfyUI-MoGe2] Health check: ok
[ComfyUI] [SubprocessWorker] worker started/confirmed
[ComfyUI] [comfy-env] PRE-SERIALIZE 'images' shape: torch.Size([42, 952, 952, 3])
[ComfyUI] [SubprocessWorker] serializing kwargs to shm...
Node executed (1 total), capturing...
[ComfyUI] [SubprocessWorker] created 0 shm blocks
[ComfyUI] [SubprocessWorker] sending request via socket...
[ComfyUI] [SubprocessWorker] call_id=2 sending call_method
[ComfyUI] [worker:ComfyUI-MoGe2] [comfy-env] _from_shm got dict with keys: ['__type__', 'strategy', 'parent_pid', 'fd', 'storage_size']
[ComfyUI] [worker:ComfyUI-MoGe2] [comfy-env] DESERIALIZE TensorRef: tensor_size=[42, 952, 952, 3]
[ComfyUI] [worker:ComfyUI-MoGe2] [comfy-env] DESERIALIZED tensor shape: torch.Size([42, 952, 952, 3])
Frame 18 saved (frame_017.jpg, t=54.6s)
[capture-node] freeze=13ms shot=126ms unfreeze=1ms saved=True
[capture-loop] iter=500 t=55.1s state={'complete': False, 'error': None, 'executedCount': 1, 'wsState': 1} eval_ms=1 ram=7.0/31.3GB (22%) swap=1.7/32.0GB (5%) cpu=14% browser_rss=1.10GB
[capture-loop] iter=550 t=60.4s state={'complete': False, 'error': None, 'executedCount': 1, 'wsState': 1} eval_ms=1 ram=9.0/31.3GB (29%) swap=1.7/32.0GB (5%) cpu=14% browser_rss=1.08GB
[ComfyUI] [SubprocessWorker] callback 'request_vram_budget' from call_id=2
[ComfyUI] [comfy-env] VRAM request: 0.66GB, free before eviction: 22.30GB
[ComfyUI] [comfy-env] VRAM after eviction: 22.30GB
[ComfyUI] [worker:ComfyUI-MoGe2] [VRAM] +216MB (now 216MB) reserved=224MB peak=216MB
[ComfyUI] [SubprocessWorker] callback 'report_progress' from call_id=2
[ComfyUI] [worker:ComfyUI-MoGe2] [VRAM] +455MB (now 671MB) reserved=1600MB peak=782MB
[ComfyUI] [SubprocessWorker] callback 'report_progress' from call_id=2
[ComfyUI] [SubprocessWorker] callback 'report_progress' from call_id=2
[ComfyUI] [SubprocessWorker] callback 'report_progress' from call_id=2
[ComfyUI] [SubprocessWorker] callback 'report_progress' from call_id=2
Frame 19 saved (frame_018.jpg, t=63.3s)
[capture-periodic] freeze=1ms shot=112ms unfreeze=1ms saved=True
[ComfyUI] [SubprocessWorker] callback 'report_progress' from call_id=2
[ComfyUI] [SubprocessWorker] callback 'report_progress' from call_id=2
[ComfyUI] [SubprocessWorker] callback 'report_progress' from call_id=2
[ComfyUI] [SubprocessWorker] callback 'report_progress' from call_id=2
[ComfyUI] [SubprocessWorker] callback 'report_progress' from call_id=2
[ComfyUI] [SubprocessWorker] callback 'report_progress' from call_id=2
[ComfyUI] [SubprocessWorker] callback 'report_progress' from call_id=2
[ComfyUI] [SubprocessWorker] callback 'report_progress' from call_id=2
[ComfyUI] [SubprocessWorker] callback 'report_progress' from call_id=2
[ComfyUI] [SubprocessWorker] callback 'report_progress' from call_id=2
Frame 20 saved (frame_019.jpg, t=65.5s)
[capture-periodic] freeze=1ms shot=96ms unfreeze=10ms saved=True
[ComfyUI] [SubprocessWorker] callback 'report_progress' from call_id=2
[ComfyUI] [SubprocessWorker] callback 'report_progress' from call_id=2
[capture-loop] iter=600 t=66.0s state={'complete': False, 'error': None, 'executedCount': 1, 'wsState': 1} eval_ms=1 ram=9.6/31.3GB (31%) swap=1.7/32.0GB (5%) cpu=14% browser_rss=1.09GB
[ComfyUI] [SubprocessWorker] callback 'report_progress' from call_id=2
[ComfyUI] [SubprocessWorker] callback 'report_progress' from call_id=2
[ComfyUI] [SubprocessWorker] callback 'report_progress' from call_id=2
[ComfyUI] [SubprocessWorker] callback 'report_progress' from call_id=2
[ComfyUI] [SubprocessWorker] callback 'report_progress' from call_id=2
[ComfyUI] [SubprocessWorker] callback 'report_progress' from call_id=2
[ComfyUI] [SubprocessWorker] callback 'report_progress' from call_id=2
Frame 21 saved (frame_020.jpg, t=67.8s)
[capture-periodic] freeze=1ms shot=86ms unfreeze=1ms saved=True
[ComfyUI] [SubprocessWorker] callback 'report_progress' from call_id=2
[ComfyUI] [SubprocessWorker] callback 'report_progress' from call_id=2
[ComfyUI] [SubprocessWorker] callback 'report_progress' from call_id=2
[ComfyUI] [worker:ComfyUI-MoGe2] [VRAM] +239MB (now 911MB) reserved=1632MB peak=911MB
[ComfyUI] [SubprocessWorker] callback 'report_progress' from call_id=2
[ComfyUI] [SubprocessWorker] callback 'report_progress' from call_id=2
[ComfyUI] [SubprocessWorker] callback 'report_progress' from call_id=2
[ComfyUI] [worker:ComfyUI-MoGe2] [VRAM] -240MB (now 671MB) reserved=1632MB peak=911MB
[ComfyUI] [SubprocessWorker] callback 'report_progress' from call_id=2
[ComfyUI] [SubprocessWorker] callback 'report_progress' from call_id=2
Frame 22 saved (frame_021.jpg, t=69.9s)
[capture-periodic] freeze=1ms shot=89ms unfreeze=6ms saved=True
[ComfyUI] [SubprocessWorker] callback 'report_progress' from call_id=2
[ComfyUI] [SubprocessWorker] callback 'report_progress' from call_id=2
[ComfyUI] [SubprocessWorker] callback 'report_progress' from call_id=2
[ComfyUI] [SubprocessWorker] callback 'report_progress' from call_id=2
[ComfyUI] [SubprocessWorker] callback 'report_progress' from call_id=2
[capture-loop] iter=650 t=71.4s state={'complete': False, 'error': None, 'executedCount': 1, 'wsState': 1} eval_ms=2 ram=10.6/31.3GB (34%) swap=1.7/32.0GB (5%) cpu=13% browser_rss=1.13GB
[ComfyUI] [SubprocessWorker] callback 'report_progress' from call_id=2
[ComfyUI] [SubprocessWorker] callback 'report_progress' from call_id=2
[ComfyUI] [SubprocessWorker] callback 'report_progress' from call_id=2
Frame 23 saved (frame_022.jpg, t=72.2s)
[capture-periodic] freeze=1ms shot=97ms unfreeze=7ms saved=True
[ComfyUI] [SubprocessWorker] callback 'report_progress' from call_id=2
[ComfyUI] [SubprocessWorker] callback 'report_progress' from call_id=2
Frame 24 saved (frame_023.jpg, t=74.3s)
[capture-periodic] freeze=1ms shot=93ms unfreeze=6ms saved=True
[ComfyUI] [SubprocessWorker] got response: ok
[ComfyUI] [comfy-env] Created 1 model patchers: ['MoGeWrapper_1']
[ComfyUI] [comfy-env] MoGe2Inference done (21.24s): result: NodeOutput
[ComfyUI] [VRAM] After MoGe2Inference: 4605 / 24122 MB
[ComfyUI] [VRAM] Loaded: SubprocessModel (631 MB)
Frame 25 saved (frame_024.jpg, t=76.5s)
[capture-periodic] freeze=1ms shot=102ms unfreeze=5ms saved=True
[ComfyUI] [comfy-env] Running PanoramaDepthMerge: out_width: 4096, out_height: 2048, use_gpu: True, scale_anchor: False, chunk_size: 8, center_weight_power: 2.0, normal_edge_threshold_deg: 0.0, normal_consistency_boost: False, max_ray_distance_m: 0.0, face_points: torch.float32 [42,952,952,3] cpu, extrinsics: torch.float32 [42,4,4] cpu, intrinsics: torch.float32 [42,3,3] cpu, face_valid_masks: torch.float32 [42,952,952] cpu, face_normals: torch.float32 [42,952,952,3] cpu
[ComfyUI] [VRAM] Before PanoramaDepthMerge: 4605 / 24122 MB
[ComfyUI] [VRAM] Loaded: SubprocessModel (631 MB)
[ComfyUI] [SubprocessWorker] call_method: nodes.depth_merge.PanoramaDepthMerge.EXECUTE_NORMALIZED
[ComfyUI] [SubprocessWorker] acquired lock, ensuring started...
[ComfyUI] [ComfyUI-PanoPack] Health check: ping (timeout=5.0s)...
[ComfyUI] [ComfyUI-PanoPack] Health check: ok
[ComfyUI] [SubprocessWorker] worker started/confirmed
[ComfyUI] [comfy-env] PRE-SERIALIZE 'face_points' shape: torch.Size([42, 952, 952, 3])
[ComfyUI] [comfy-env] PRE-SERIALIZE 'extrinsics' shape: torch.Size([42, 4, 4])
[ComfyUI] [comfy-env] PRE-SERIALIZE 'intrinsics' shape: torch.Size([42, 3, 3])
[ComfyUI] [comfy-env] PRE-SERIALIZE 'face_valid_masks' shape: torch.Size([42, 952, 952])
[ComfyUI] [comfy-env] PRE-SERIALIZE 'face_normals' shape: torch.Size([42, 952, 952, 3])
[ComfyUI] [SubprocessWorker] serializing kwargs to shm...
Node executed (2 total), capturing...
Frame 26 saved (frame_025.jpg, t=76.9s)
[capture-node] freeze=1ms shot=104ms unfreeze=1ms saved=True
[ComfyUI] [SubprocessWorker] created 0 shm blocks
[ComfyUI] [SubprocessWorker] sending request via socket...
[ComfyUI] [SubprocessWorker] call_id=3 sending call_method
[ComfyUI] [worker:ComfyUI-PanoPack] [comfy-env] _from_shm got dict with keys: ['__type__', 'strategy', 'parent_pid', 'fd', 'storage_size']
[ComfyUI] [worker:ComfyUI-PanoPack] [comfy-env] DESERIALIZE TensorRef: tensor_size=[42, 952, 952, 3]
[ComfyUI] [worker:ComfyUI-PanoPack] [comfy-env] DESERIALIZED tensor shape: torch.Size([42, 952, 952, 3])
[ComfyUI] [worker:ComfyUI-PanoPack] [comfy-env] _from_shm got dict with keys: ['__type__', 'strategy', 'parent_pid', 'fd', 'storage_size']
[ComfyUI] [worker:ComfyUI-PanoPack] [comfy-env] DESERIALIZE TensorRef: tensor_size=[42, 4, 4]
[ComfyUI] [worker:ComfyUI-PanoPack] [comfy-env] DESERIALIZED tensor shape: torch.Size([42, 4, 4])
[ComfyUI] [worker:ComfyUI-PanoPack] [comfy-env] _from_shm got dict with keys: ['__type__', 'strategy', 'parent_pid', 'fd', 'storage_size']
[ComfyUI] [worker:ComfyUI-PanoPack] [comfy-env] DESERIALIZE TensorRef: tensor_size=[42, 3, 3]
[ComfyUI] [worker:ComfyUI-PanoPack] [comfy-env] DESERIALIZED tensor shape: torch.Size([42, 3, 3])
[ComfyUI] [worker:ComfyUI-PanoPack] [comfy-env] _from_shm got dict with keys: ['__type__', 'strategy', 'parent_pid', 'fd', 'storage_size']
[ComfyUI] [worker:ComfyUI-PanoPack] [comfy-env] DESERIALIZE TensorRef: tensor_size=[42, 952, 952]
[ComfyUI] [worker:ComfyUI-PanoPack] [comfy-env] DESERIALIZED tensor shape: torch.Size([42, 952, 952])
[ComfyUI] [worker:ComfyUI-PanoPack] [comfy-env] _from_shm got dict with keys: ['__type__', 'strategy', 'parent_pid', 'fd', 'storage_size']
[capture-loop] iter=700 t=77.3s state={'complete': False, 'error': None, 'executedCount': 2, 'wsState': 1} eval_ms=2 ram=13.6/31.3GB (44%) swap=1.7/32.0GB (5%) cpu=15% browser_rss=1.19GB
[ComfyUI] [worker:ComfyUI-PanoPack] [comfy-env] DESERIALIZE TensorRef: tensor_size=[42, 952, 952, 3]
[ComfyUI] [worker:ComfyUI-PanoPack] [comfy-env] DESERIALIZED tensor shape: torch.Size([42, 952, 952, 3])
Frame 27 saved (frame_026.jpg, t=79.1s)
[capture-periodic] freeze=1ms shot=100ms unfreeze=5ms saved=True
[capture-loop] iter=750 t=82.7s state={'complete': False, 'error': None, 'executedCount': 2, 'wsState': 1} eval_ms=2 ram=15.4/31.3GB (49%) swap=1.7/32.0GB (5%) cpu=14% browser_rss=1.18GB
[capture-loop] iter=800 t=88.2s state={'complete': False, 'error': None, 'executedCount': 2, 'wsState': 1} eval_ms=1 ram=15.5/31.3GB (50%) swap=1.7/32.0GB (5%) cpu=20% browser_rss=1.10GB
[capture-loop] iter=850 t=93.6s state={'complete': False, 'error': None, 'executedCount': 2, 'wsState': 1} eval_ms=2 ram=15.3/31.3GB (49%) swap=1.7/32.0GB (5%) cpu=21% browser_rss=1.10GB
[capture-loop] iter=900 t=99.2s state={'complete': False, 'error': None, 'executedCount': 2, 'wsState': 1} eval_ms=3 ram=15.5/31.3GB (50%) swap=1.7/32.0GB (5%) cpu=20% browser_rss=1.10GB
[ComfyUI] [worker:ComfyUI-PanoPack] [PanoramaDepthMerge] normals merged: 2048x4096
[ComfyUI] [worker:ComfyUI-PanoPack] [PanoramaDepthMerge] merging 42 faces @ 952x952 -> equirect 2048x4096 (use_gpu=True); input = points (||.|| -> ray distance)
[ComfyUI] [SubprocessWorker] callback 'report_progress' from call_id=3
[ComfyUI] [worker:ComfyUI-PanoPack] [PanoramaDepthMerge] top-level peak VRAM estimate: 3.46 GB (4096x2048, N=42, chunk_size=8)
[ComfyUI] [SubprocessWorker] callback 'request_vram_budget' from call_id=3
[ComfyUI] [comfy-env] VRAM request: 3.46GB, free before eviction: 20.47GB
[ComfyUI] [comfy-env] VRAM after eviction: 20.47GB
[ComfyUI] [worker:ComfyUI-PanoPack] [PanoramaDepthMerge] -> requested 3.46 GB eviction via comfy_worker.call_parent
[ComfyUI] [worker:ComfyUI-PanoPack] [VRAM] +436MB (now 436MB) reserved=608MB peak=822MB
[ComfyUI] /workspaces/Sharp-1914/ComfyUI/custom_nodes/ComfyUI-PanoPack/nodes/_vendor/worldgen/src/panorama_utils.py:349: UserWarning: Sparse CSR tensor support is in beta state. If you miss a functionality in the sparse tensor support, please submit a feature request to https://github.com/pytorch/pytorch/issues. (Triggered internally at /pytorch/aten/src/ATen/SparseCsrTensorImpl.cpp:49.)
[ComfyUI] A_gpu = torch.sparse_csr_tensor(
[ComfyUI] [worker:ComfyUI-PanoPack] [merge_panorama_depth_gpu 256x128 ] done 0.52s (warp 0.29, build 0.01, LSMR 0.22); N=42 K=8 chunks=6; depth min/med/max = 0.384/0.945/3.091; valid 32768/32768
[ComfyUI] [worker:ComfyUI-PanoPack] [merge_panorama_depth_gpu 512x256 ] done 0.71s (warp 0.08, build 0.02, LSMR 0.07); N=42 K=8 chunks=6; depth min/med/max = 0.384/0.945/3.094; valid 131072/131072
Frame 28 saved (frame_027.jpg, t=101.0s)
[capture-periodic] freeze=1ms shot=101ms unfreeze=6ms saved=True
[ComfyUI] [worker:ComfyUI-PanoPack] [merge_panorama_depth_gpu 1024x512 ] done 1.04s (warp 0.10, build 0.06, LSMR 0.14); N=42 K=8 chunks=6; depth min/med/max = 0.384/0.945/3.094; valid 524288/524288
[ComfyUI] [worker:ComfyUI-PanoPack] [VRAM] -259MB (now 177MB) reserved=224MB peak=822MB
[ComfyUI] [worker:ComfyUI-PanoPack]
[ComfyUI] === WATCHDOG TICK 1 ===
[ComfyUI] [worker:ComfyUI-PanoPack] Thread 0x0000757e127ff640 (most recent call first):
[ComfyUI] File "/tmp/comfytest-home/.ce/.pixi/envs/panopack-nodes/lib/python3.10/socket.py", line 293 in accept
[ComfyUI] File "/tmp/comfytest-home/.ce/.pixi/envs/panopack-nodes/lib/python3.10/multiprocessing/connection.py", line 609 in accept
[ComfyUI] File "/tmp/comfytest-home/.ce/.pixi/envs/panopack-nodes/lib/python3.10/multiprocessing/connection.py", line 463 in accept
[ComfyUI] File "/tmp/comfytest-home/.ce/.pixi/envs/panopack-nodes/lib/python3.10/multiprocessing/resource_sharer.py", line 138 in _serve
[ComfyUI] File "/tmp/comfytest-home/.ce/.pixi/envs/panopack-nodes/lib/python3.10/threading.py", line 953 in run
[ComfyUI] File "/tmp/comfytest-home/.ce/.pixi/envs/panopack-nodes/lib/python3.10/threading.py", line 1016 in _bootstrap_inner
[ComfyUI] File "/tmp/comfytest-home/.ce/.pixi/envs/panopack-nodes/lib/python3.10/threading.py", line 973 in _bootstrap
[ComfyUI]
[ComfyUI] Thread 0x0000757ff35a0640 (most recent call first):
[ComfyUI] File "/tmp/comfyui_pvenv_0kgugsfd/persistent_worker.py", line 106 in _vram_poller
[ComfyUI] File "/tmp/comfytest-home/.ce/.pixi/envs/panopack-nodes/lib/python3.10/threading.py", line 953 in run
[ComfyUI] File "/tmp/comfytest-home/.ce/.pixi/envs/panopack-nodes/lib/python3.10/threading.py", line 1016 in _bootstrap_inner
[ComfyUI] File "/tmp/comfytest-home/.ce/.pixi/envs/panopack-nodes/lib/python3.10/threading.py", line 973 in _bootstrap
[ComfyUI]
[ComfyUI] Current thread 0x0000757ff3da1640 (most recent call first):
[ComfyUI] File "/tmp/comfyui_pvenv_0kgugsfd/persistent_worker.py", line 52 in _watchdog
[ComfyUI] File "/tmp/comfytest-home/.ce/.pixi/envs/panopack-nodes/lib/python3.10/threading.py", line 953 in run
[ComfyUI] File "/tmp/comfytest-home/.ce/.pixi/envs/panopack-nodes/lib/python3.10/threading.py", line 1016 in _bootstrap_inner
[ComfyUI] File "/tmp/comfytest-home/.ce/.pixi/envs/panopack-nodes/lib/python3.10/threading.py", line 973 in _bootstrap
[ComfyUI]
[ComfyUI] Thread 0x0000757ff4377740 (most recent call first):
[ComfyUI] File "/workspaces/Sharp-1914/ComfyUI/custom_nodes/ComfyUI-PanoPack/nodes/_vendor/worldgen/src/panorama_utils.py", line 834 in merge_panorama_depth_gpu
[ComfyUI] File "/workspaces/Sharp-1914/ComfyUI/custom_nodes/ComfyUI-PanoPack/nodes/_vendor/worldgen/src/panorama_utils.py", line 550 in merge_panorama_depth_gpu
[ComfyUI] File "/workspaces/Sharp-1914/ComfyUI/custom_nodes/ComfyUI-PanoPack/nodes/depth_merge.py", line 953 in execute
[ComfyUI] File "/workspaces/Sharp-1914/ComfyUI/comfy_api/latest/_io.py", line 1892 in EXECUTE_NORMALIZED
[ComfyUI] File "/tmp/comfyui_pvenv_0kgugsfd/persistent_worker.py", line 1762 in main
[ComfyUI] File "/tmp/comfyui_pvenv_0kgugsfd/persistent_worker.py", line 1807 in <module>
[ComfyUI]
[ComfyUI] [worker:ComfyUI-PanoPack] === END ===
[ComfyUI]
[ComfyUI] [worker:ComfyUI-PanoPack] [merge_panorama_depth_gpu 2048x1024] done 2.05s (warp 0.20, build 0.25, LSMR 0.51); N=42 K=8 chunks=6; depth min/med/max = 0.384/0.945/3.095; valid 2097152/2097152
[ComfyUI] [worker:ComfyUI-PanoPack] [VRAM] +682MB (now 859MB) reserved=4960MB peak=859MB
[ComfyUI] [worker:ComfyUI-PanoPack] [VRAM] -562MB (now 298MB) reserved=416MB peak=859MB
[capture-loop] iter=950 t=104.6s state={'complete': False, 'error': None, 'executedCount': 2, 'wsState': 1} eval_ms=1 ram=16.7/31.3GB (53%) swap=1.7/32.0GB (5%) cpu=13% browser_rss=1.11GB
[ComfyUI] [worker:ComfyUI-PanoPack] [VRAM] +671MB (now 970MB) reserved=1088MB peak=970MB
[ComfyUI] [worker:ComfyUI-PanoPack] [VRAM] +319MB (now 1290MB) reserved=1376MB peak=1290MB
[ComfyUI] [worker:ComfyUI-PanoPack] [merge_panorama_depth_gpu 4096x2048] done 8.27s (warp 0.58, build 3.18, LSMR 2.26); N=42 K=8 chunks=6; depth min/med/max = 0.384/0.945/3.094; valid 8388608/8388608
[ComfyUI] [worker:ComfyUI-PanoPack] [VRAM] -1283MB (now 8MB) reserved=2176MB peak=1898MB
[ComfyUI] [worker:ComfyUI-PanoPack] [PanoramaDepthMerge] merged depth: shape (2048, 4096), min=0.384, median=0.945, max=3.094; valid pixels: 8388608 / 8388608
[capture-loop] iter=1000 t=110.1s state={'complete': False, 'error': None, 'executedCount': 2, 'wsState': 1} eval_ms=2 ram=16.1/31.3GB (51%) swap=1.7/32.0GB (5%) cpu=12% browser_rss=1.11GB
[capture-loop] iter=1050 t=115.5s state={'complete': False, 'error': None, 'executedCount': 2, 'wsState': 1} eval_ms=2 ram=16.2/31.3GB (52%) swap=1.7/32.0GB (5%) cpu=17% browser_rss=1.11GB
[capture-loop] iter=1100 t=121.0s state={'complete': False, 'error': None, 'executedCount': 2, 'wsState': 1} eval_ms=2 ram=16.1/31.3GB (52%) swap=1.7/32.0GB (5%) cpu=17% browser_rss=1.11GB
[ComfyUI] [worker:ComfyUI-PanoPack] [PanoramaDepthMerge] debug_image: H=2048+102, mult_disagreement (log-d, sphere-uniform): mean=11.22%, p99=24.69%, max=28.22%; overlap_pixels=8388608
[ComfyUI] [worker:ComfyUI-PanoPack] [headless_gl] prefix=/tmp/comfytest-home/.ce/.pixi/envs/panopack-nodes
[ComfyUI] [worker:ComfyUI-PanoPack] [headless_gl] OSMesa: ['libOSMesa.so', 'libOSMesa.so.8', 'libOSMesa.so.8.0.0']
[ComfyUI] [worker:ComfyUI-PanoPack] [headless_gl] env: VTK_DEFAULT_OPENGL_WINDOW=vtkOSOpenGLRenderWindow PYVISTA_OFF_SCREEN=true
[ComfyUI] [worker:ComfyUI-PanoPack] [PanoramaDepthMerge] xyz_views: cloud bbox center=(-0.79, -0.31, +0.03) m, size=(4.27 x 3.57 x 1.96) m, N=80000 (subsampled)
[ComfyUI] [worker:ComfyUI-PanoPack] [PanoramaDepthMerge] points: merged equirect point map (1, 2048, 4096, 3)
[ComfyUI] [SubprocessWorker] callback 'report_progress' from call_id=3
[capture-loop] iter=1150 t=126.4s state={'complete': False, 'error': None, 'executedCount': 2, 'wsState': 1} eval_ms=2 ram=15.3/31.3GB (49%) swap=1.7/32.0GB (5%) cpu=14% browser_rss=1.11GB
[ComfyUI] [SubprocessWorker] got response: ok
[ComfyUI] [comfy-env] PanoramaDepthMerge done (49.81s): result: NodeOutput
[ComfyUI] [VRAM] After PanoramaDepthMerge: 3335 / 24122 MB
[ComfyUI] [VRAM] Loaded: SubprocessModel (631 MB)
[ComfyUI] [comfy-env] Running PanoramaSplitAdaptive: split_method: 'icosahedron_42', resolution: 1536, fov_degrees: 90.0, use_gpu: True, create_masks: True, mask_method: 'closest_to', panorama: dict, depth_panorama: torch.float32 [1,2048,4096,3] cpu, normals_panorama: torch.float32 [1,2048,4096,3] cpu
[ComfyUI] [VRAM] Before PanoramaSplitAdaptive: 3335 / 24122 MB
[ComfyUI] [VRAM] Loaded: SubprocessModel (631 MB)
[ComfyUI] [SubprocessWorker] call_method: nodes.panorama_split_adaptive.PanoramaSplitAdaptive.EXECUTE_NORMALIZED
[ComfyUI] [SubprocessWorker] acquired lock, ensuring started...
[ComfyUI] [ComfyUI-PanoPack] Health check: ping (timeout=5.0s)...
[ComfyUI] [ComfyUI-PanoPack] Health check: ok
[ComfyUI] [SubprocessWorker] worker started/confirmed
[ComfyUI] [comfy-env] PRE-SERIALIZE 'depth_panorama' shape: torch.Size([1, 2048, 4096, 3])
[ComfyUI] [comfy-env] PRE-SERIALIZE 'normals_panorama' shape: torch.Size([1, 2048, 4096, 3])
[ComfyUI] [SubprocessWorker] serializing kwargs to shm...
Node executed (3 total), capturing...
[ComfyUI] [SubprocessWorker] created 0 shm blocks
[ComfyUI] [SubprocessWorker] sending request via socket...
[ComfyUI] [SubprocessWorker] call_id=4 sending call_method
[ComfyUI] [worker:ComfyUI-PanoPack] [comfy-env] _from_shm got dict with keys: ['__type__', 'strategy', 'parent_pid', 'fd', 'storage_size']
[ComfyUI] [worker:ComfyUI-PanoPack] [comfy-env] DESERIALIZE TensorRef: tensor_size=[1, 2048, 4096, 3]
[ComfyUI] [worker:ComfyUI-PanoPack] [comfy-env] DESERIALIZED tensor shape: torch.Size([1, 2048, 4096, 3])
[ComfyUI] [worker:ComfyUI-PanoPack] [comfy-env] _from_shm got dict with keys: ['__type__', 'strategy', 'parent_pid', 'fd', 'storage_size']
[ComfyUI] [worker:ComfyUI-PanoPack] [comfy-env] DESERIALIZE TensorRef: tensor_size=[1, 2048, 4096, 3]
[ComfyUI] [worker:ComfyUI-PanoPack] [comfy-env] DESERIALIZED tensor shape: torch.Size([1, 2048, 4096, 3])
[ComfyUI] [worker:ComfyUI-PanoPack] [comfy-env] _from_shm got dict with keys: ['__type__', 'strategy', 'parent_pid', 'fd', 'storage_size']
[ComfyUI] [worker:ComfyUI-PanoPack] [comfy-env] DESERIALIZE TensorRef: tensor_size=[1, 2048, 4096, 3]
[ComfyUI] [worker:ComfyUI-PanoPack] [comfy-env] DESERIALIZED tensor shape: torch.Size([1, 2048, 4096, 3])
Frame 29 saved (frame_028.jpg, t=127.0s)
[capture-node] freeze=2ms shot=105ms unfreeze=5ms saved=True
[ComfyUI] [worker:ComfyUI-PanoPack] [PanoramaSplitAdaptive] computing area weights from depth (2048x4096) + normals...
[ComfyUI] [worker:ComfyUI-PanoPack] [PanoramaSplitAdaptive] weight range: [1.06, 131], mean=11.7
[ComfyUI] [worker:ComfyUI-PanoPack] [PanoramaSplitAdaptive] adaptive relax: icosahedron_42 (42 cameras), weighted Lloyd...
[capture-loop] iter=1200 t=132.1s state={'complete': False, 'error': None, 'executedCount': 3, 'wsState': 1} eval_ms=2 ram=16.2/31.3GB (52%) swap=1.7/32.0GB (5%) cpu=12% browser_rss=1.12GB
[capture-loop] iter=1250 t=137.4s state={'complete': False, 'error': None, 'executedCount': 3, 'wsState': 1} eval_ms=2 ram=16.1/31.3GB (52%) swap=1.7/32.0GB (5%) cpu=11% browser_rss=1.12GB
[capture-loop] iter=1300 t=142.9s state={'complete': False, 'error': None, 'executedCount': 3, 'wsState': 1} eval_ms=2 ram=16.3/31.3GB (52%) swap=1.7/32.0GB (5%) cpu=12% browser_rss=1.12GB
[capture-loop] iter=1350 t=148.3s state={'complete': False, 'error': None, 'executedCount': 3, 'wsState': 1} eval_ms=1 ram=16.5/31.3GB (53%) swap=1.7/32.0GB (5%) cpu=11% browser_rss=1.12GB
[ComfyUI] [worker:ComfyUI-PanoPack] [PanoramaSplitAdaptive] Lloyd ran 24 iters (max move 1.42e-02)
[ComfyUI] [worker:ComfyUI-PanoPack] [PanoramaSplitAdaptive] Lloyd relaxation done: 42 camera directions in 25.326s
[ComfyUI] [worker:ComfyUI-PanoPack] [PanoramaSplitAdaptive] rasterizing 42 faces @ 1536x1536...
[capture-loop] iter=1400 t=153.8s state={'complete': False, 'error': None, 'executedCount': 3, 'wsState': 1} eval_ms=2 ram=16.0/31.3GB (51%) swap=1.7/32.0GB (5%) cpu=13% browser_rss=1.12GB
[capture-loop] iter=1450 t=159.2s state={'complete': False, 'error': None, 'executedCount': 3, 'wsState': 1} eval_ms=2 ram=16.3/31.3GB (52%) swap=1.7/32.0GB (5%) cpu=11% browser_rss=1.12GB
[ComfyUI] [worker:ComfyUI-PanoPack] [VRAM] +756MB (now 764MB) reserved=800MB peak=1898MB
[ComfyUI] [worker:ComfyUI-PanoPack] [VRAM] +1230MB (now 1994MB) reserved=3168MB peak=1994MB
[ComfyUI] [worker:ComfyUI-PanoPack]
[ComfyUI] === WATCHDOG TICK 2 ===
[ComfyUI] [worker:ComfyUI-PanoPack] Thread 0x0000757e127ff640 (most recent call first):
[ComfyUI] File "/tmp/comfytest-home/.ce/.pixi/envs/panopack-nodes/lib/python3.10/socket.py", line 293 in accept
[ComfyUI] File "/tmp/comfytest-home/.ce/.pixi/envs/panopack-nodes/lib/python3.10/multiprocessing/connection.py", line 609 in accept
[ComfyUI] File "/tmp/comfytest-home/.ce/.pixi/envs/panopack-nodes/lib/python3.10/multiprocessing/connection.py", line 463 in accept
[ComfyUI] File "/tmp/comfytest-home/.ce/.pixi/envs/panopack-nodes/lib/python3.10/multiprocessing/resource_sharer.py", line 138 in _serve
[ComfyUI] File "/tmp/comfytest-home/.ce/.pixi/envs/panopack-nodes/lib/python3.10/threading.py", line 953 in run
[ComfyUI] File "/tmp/comfytest-home/.ce/.pixi/envs/panopack-nodes/lib/python3.10/threading.py", line 1016 in _bootstrap_inner
[ComfyUI] File "/tmp/comfytest-home/.ce/.pixi/envs/panopack-nodes/lib/python3.10/threading.py", line 973 in _bootstrap
[ComfyUI]
[ComfyUI] Thread 0x0000757ff35a0640 (most recent call first):
[ComfyUI] File "/tmp/comfyui_pvenv_0kgugsfd/persistent_worker.py", line 106 in _vram_poller
[ComfyUI] File "/tmp/comfytest-home/.ce/.pixi/envs/panopack-nodes/lib/python3.10/threading.py", line 953 in run
[ComfyUI] File "/tmp/comfytest-home/.ce/.pixi/envs/panopack-nodes/lib/python3.10/threading.py", line 1016 in _bootstrap_inner
[ComfyUI] File "/tmp/comfytest-home/.ce/.pixi/envs/panopack-nodes/lib/python3.10/threading.py", line 973 in _bootstrap
[ComfyUI]
[ComfyUI] Current thread 0x0000757ff3da1640 (most recent call first):
[ComfyUI] File "/tmp/comfyui_pvenv_0kgugsfd/persistent_worker.py", line 52 in _watchdog
[ComfyUI] File "/tmp/comfytest-home/.ce/.pixi/envs/panopack-nodes/lib/python3.10/threading.py", line 953 in run
[ComfyUI] File "/tmp/comfytest-home/.ce/.pixi/envs/panopack-nodes/lib/python3.10/threading.py", line 1016 in _bootstrap_inner
[ComfyUI] File "/tmp/comfytest-home/.ce/.pixi/envs/panopack-nodes/lib/python3.10/threading.py", line 973 in _bootstrap
[ComfyUI]
[ComfyUI] Thread 0x0000757ff4377740 (most recent call first):
[ComfyUI] File "/workspaces/Sharp-1914/ComfyUI/custom_nodes/ComfyUI-PanoPack/nodes/panorama_split_adaptive.py", line 439 in execute
[ComfyUI] File "/workspaces/Sharp-1914/ComfyUI/comfy_api/latest/_io.py", line 1892 in EXECUTE_NORMALIZED
[ComfyUI] File "/tmp/comfyui_pvenv_0kgugsfd/persistent_worker.py", line 1762 in main
[ComfyUI] File "/tmp/comfyui_pvenv_0kgugsfd/persistent_worker.py", line 1807 in <module>
[ComfyUI]
[ComfyUI] [worker:ComfyUI-PanoPack] === END ===
[ComfyUI]
[ComfyUI] [worker:ComfyUI-PanoPack] [VRAM] -1986MB (now 8MB) reserved=3168MB peak=1994MB
[ComfyUI] [worker:ComfyUI-PanoPack] [PanoramaSplitAdaptive] rasterized RGB in 10.315s (GPU)
[ComfyUI] [worker:ComfyUI-PanoPack] [PanoramaSplitAdaptive] rasterizing depth crops...
[capture-loop] iter=1500 t=164.6s state={'complete': False, 'error': None, 'executedCount': 3, 'wsState': 1} eval_ms=1 ram=17.8/31.3GB (57%) swap=1.7/32.0GB (5%) cpu=12% browser_rss=1.12GB
[capture-loop] iter=1550 t=170.0s state={'complete': False, 'error': None, 'executedCount': 3, 'wsState': 1} eval_ms=1 ram=18.3/31.3GB (59%) swap=1.7/32.0GB (5%) cpu=11% browser_rss=1.12GB
[ComfyUI] [worker:ComfyUI-PanoPack] [VRAM] +756MB (now 764MB) reserved=3168MB peak=1994MB
[ComfyUI] [worker:ComfyUI-PanoPack] [VRAM] +1230MB (now 1994MB) reserved=3264MB peak=1994MB
[ComfyUI] [worker:ComfyUI-PanoPack] [VRAM] -1986MB (now 8MB) reserved=3264MB peak=1994MB
[capture-loop] iter=1600 t=175.5s state={'complete': False, 'error': None, 'executedCount': 3, 'wsState': 1} eval_ms=2 ram=20.8/31.3GB (67%) swap=1.7/32.0GB (5%) cpu=12% browser_rss=1.13GB
[ComfyUI] [worker:ComfyUI-PanoPack] [PanoramaSplitAdaptive] rasterizing normals crops...
[capture-loop] iter=1650 t=180.8s state={'complete': False, 'error': None, 'executedCount': 3, 'wsState': 1} eval_ms=2 ram=20.4/31.3GB (65%) swap=1.7/32.0GB (5%) cpu=11% browser_rss=1.13GB
[ComfyUI] [worker:ComfyUI-PanoPack] [VRAM] +756MB (now 764MB) reserved=3264MB peak=1994MB
[capture-loop] iter=1700 t=186.3s state={'complete': False, 'error': None, 'executedCount': 3, 'wsState': 1} eval_ms=1 ram=23.0/31.3GB (74%) swap=1.7/32.0GB (5%) cpu=12% browser_rss=1.13GB
[ComfyUI] [worker:ComfyUI-PanoPack] [VRAM] +1230MB (now 1994MB) reserved=3264MB peak=1994MB
[ComfyUI] [worker:ComfyUI-PanoPack] [VRAM] -1986MB (now 8MB) reserved=3264MB peak=1994MB
[ComfyUI] [worker:ComfyUI-PanoPack] [PanoramaSplitAdaptive] generating closest_to masks...
[capture-loop] iter=1750 t=191.6s state={'complete': False, 'error': None, 'executedCount': 3, 'wsState': 1} eval_ms=1 ram=23.0/31.3GB (74%) swap=1.7/32.0GB (5%) cpu=11% browser_rss=1.13GB
[capture-loop] iter=1800 t=197.1s state={'complete': False, 'error': None, 'executedCount': 3, 'wsState': 1} eval_ms=2 ram=23.1/31.3GB (74%) swap=1.7/32.0GB (5%) cpu=11% browser_rss=1.13GB
[capture-loop] iter=1850 t=202.4s state={'complete': False, 'error': None, 'executedCount': 3, 'wsState': 1} eval_ms=1 ram=22.9/31.3GB (73%) swap=1.7/32.0GB (5%) cpu=11% browser_rss=1.13GB
[capture-loop] iter=1900 t=207.9s state={'complete': False, 'error': None, 'executedCount': 3, 'wsState': 1} eval_ms=1 ram=23.2/31.3GB (74%) swap=1.7/32.0GB (5%) cpu=11% browser_rss=1.13GB
[capture-loop] iter=1950 t=213.2s state={'complete': False, 'error': None, 'executedCount': 3, 'wsState': 1} eval_ms=1 ram=22.9/31.3GB (73%) swap=1.7/32.0GB (5%) cpu=12% browser_rss=1.12GB
[ComfyUI] [worker:ComfyUI-PanoPack] [PanoramaSplitAdaptive] generating debug_masks equirect image...
[capture-loop] iter=2000 t=218.7s state={'complete': False, 'error': None, 'executedCount': 3, 'wsState': 1} eval_ms=2 ram=24.5/31.3GB (78%) swap=1.8/32.0GB (6%) cpu=13% browser_rss=1.12GB
[ComfyUI] [worker:ComfyUI-PanoPack] [PanoramaSplitAdaptive] pixels/area: lowest 0.243 -> 0.336 (+38% on the worst-sampled cell), highest 6.44 -> 2.85; spread max/min 26.5x -> 8.5x
[ComfyUI] [worker:ComfyUI-PanoPack] [PanoramaSplitAdaptive] done: 42 adaptive faces, 94.124s total
[ComfyUI] [worker:ComfyUI-PanoPack]
[ComfyUI] === WATCHDOG TICK 3 ===
[ComfyUI] [worker:ComfyUI-PanoPack] Thread 0x0000757e127ff640 (most recent call first):
[ComfyUI] File "/tmp/comfytest-home/.ce/.pixi/envs/panopack-nodes/lib/python3.10/socket.py", line 293 in accept
[ComfyUI] File "/tmp/comfytest-home/.ce/.pixi/envs/panopack-nodes/lib/python3.10/multiprocessing/connection.py", line 609 in accept
[ComfyUI] File "/tmp/comfytest-home/.ce/.pixi/envs/panopack-nodes/lib/python3.10/multiprocessing/connection.py", line 463 in accept
[ComfyUI] File "/tmp/comfytest-home/.ce/.pixi/envs/panopack-nodes/lib/python3.10/multiprocessing/resource_sharer.py", line 138 in _serve
[ComfyUI] File "/tmp/comfytest-home/.ce/.pixi/envs/panopack-nodes/lib/python3.10/threading.py", line 953 in run
[ComfyUI] File "/tmp/comfytest-home/.ce/.pixi/envs/panopack-nodes/lib/python3.10/threading.py", line 1016 in _bootstrap_inner
[ComfyUI] File "/tmp/comfytest-home/.ce/.pixi/envs/panopack-nodes/lib/python3.10/threading.py", line 973 in _bootstrap
[ComfyUI]
[ComfyUI] Thread 0x0000757ff35a0640 (most recent call first):
[ComfyUI] File "/tmp/comfyui_pvenv_0kgugsfd/persistent_worker.py", line 106 in _vram_poller
[ComfyUI] File "/tmp/comfytest-home/.ce/.pixi/envs/panopack-nodes/lib/python3.10/threading.py", line 953 in run
[ComfyUI] File "/tmp/comfytest-home/.ce/.pixi/envs/panopack-nodes/lib/python3.10/threading.py", line 1016 in _bootstrap_inner
[ComfyUI] File "/tmp/comfytest-home/.ce/.pixi/envs/panopack-nodes/lib/python3.10/threading.py", line 973 in _bootstrap
[ComfyUI]
[ComfyUI] Current thread 0x0000757ff3da1640 (most recent call first):
[ComfyUI] File "/tmp/comfyui_pvenv_0kgugsfd/persistent_worker.py", line 52 in _watchdog
[ComfyUI] File "/tmp/comfytest-home/.ce/.pixi/envs/panopack-nodes/lib/python3.10/threading.py", line 953 in run
[ComfyUI] File "/tmp/comfytest-home/.ce/.pixi/envs/panopack-nodes/lib/python3.10/threading.py", line 1016 in _bootstrap_inner
[ComfyUI] File "/tmp/comfytest-home/.ce/.pixi/envs/panopack-nodes/lib/python3.10/threading.py", line 973 in _bootstrap
[ComfyUI]
[ComfyUI] Thread 0x0000757ff4377740 (most recent call first):
[ComfyUI] File "/tmp/comfytest-home/.ce/.pixi/envs/panopack-nodes/lib/python3.10/site-packages/torch/storage.py", line 524 in _share_fd_cpu_
[ComfyUI] File "/tmp/comfytest-home/.ce/.pixi/envs/panopack-nodes/lib/python3.10/site-packages/torch/storage.py", line 449 in wrapper
[ComfyUI] File "/tmp/comfytest-home/.ce/.pixi/envs/panopack-nodes/lib/python3.10/site-packages/torch/storage.py", line 400 in share_memory_
[ComfyUI] File "/tmp/comfytest-home/.ce/.pixi/envs/panopack-nodes/lib/python3.10/site-packages/torch/storage.py", line 520 in share_memory_
[ComfyUI] File "/tmp/comfytest-home/.ce/.pixi/envs/panopack-nodes/lib/python3.10/site-packages/torch/storage.py", line 449 in wrapper
[ComfyUI] File "/tmp/comfytest-home/.ce/.pixi/envs/panopack-nodes/lib/python3.10/site-packages/torch/storage.py", line 1193 in _share_memory_
[ComfyUI] File "/tmp/comfytest-home/.ce/.pixi/envs/panopack-nodes/lib/python3.10/site-packages/torch/_tensor.py", line 853 in share_memory_
[ComfyUI] File "/tmp/comfyui_pvenv_0kgugsfd/persistent_worker.py", line 563 in _serialize_tensor_native
[ComfyUI] File "/tmp/comfyui_pvenv_0kgugsfd/persistent_worker.py", line 628 in _to_shm
[ComfyUI] File "/tmp/comfyui_pvenv_0kgugsfd/persistent_worker.py", line 705 in <listcomp>
[ComfyUI] File "/tmp/comfyui_pvenv_0kgugsfd/persistent_worker.py", line 705 in _to_shm
[ComfyUI] File "/tmp/comfyui_pvenv_0kgugsfd/persistent_worker.py", line 692 in _to_shm
[ComfyUI] File "/tmp/comfyui_pvenv_0kgugsfd/persistent_worker.py", line 1772 in main
[ComfyUI] File "/tmp/comfyui_pvenv_0kgugsfd/persistent_worker.py", line 1807 in <module>
[ComfyUI]
[ComfyUI] [worker:ComfyUI-PanoPack] === END ===
[ComfyUI]
[ComfyUI] [SubprocessWorker] got response: error
[ComfyUI] [ERROR] !!! Exception during processing !!! unable to allocate shared memory(shm) for file </torch_2560_118963202_16>: Success (0)
[ComfyUI]
[ComfyUI] Worker traceback:
[ComfyUI] Traceback (most recent call last):
[ComfyUI] File "/tmp/comfyui_pvenv_0kgugsfd/persistent_worker.py", line 1772, in main
[ComfyUI] result_meta = _to_shm(result, shm_registry)
[ComfyUI] File "/tmp/comfyui_pvenv_0kgugsfd/persistent_worker.py", line 692, in _to_shm
[ComfyUI] "args": _to_shm(list(obj.args), registry, visited),
[ComfyUI] File "/tmp/comfyui_pvenv_0kgugsfd/persistent_worker.py", line 705, in _to_shm
[ComfyUI] result = [_to_shm(v, registry, visited) for v in obj]
[ComfyUI] File "/tmp/comfyui_pvenv_0kgugsfd/persistent_worker.py", line 705, in <listcomp>
[ComfyUI] result = [_to_shm(v, registry, visited) for v in obj]
[ComfyUI] File "/tmp/comfyui_pvenv_0kgugsfd/persistent_worker.py", line 628, in _to_shm
[ComfyUI] result = _serialize_tensor_native(tensor, registry)
[ComfyUI] File "/tmp/comfyui_pvenv_0kgugsfd/persistent_worker.py", line 563, in _serialize_tensor_native
[ComfyUI] t.share_memory_()
[ComfyUI] File "/tmp/comfytest-home/.ce/.pixi/envs/panopack-nodes/lib/python3.10/site-packages/torch/_tensor.py", line 853, in share_memory_
[ComfyUI] self._typed_storage()._share_memory_()
[ComfyUI] File "/tmp/comfytest-home/.ce/.pixi/envs/panopack-nodes/lib/python3.10/site-packages/torch/storage.py", line 1193, in _share_memory_
[ComfyUI] self._untyped_storage.share_memory_()
[ComfyUI] File "/tmp/comfytest-home/.ce/.pixi/envs/panopack-nodes/lib/python3.10/site-packages/torch/storage.py", line 449, in wrapper
[ComfyUI] return fn(self, *args, **kwargs)
[ComfyUI] File "/tmp/comfytest-home/.ce/.pixi/envs/panopack-nodes/lib/python3.10/site-packages/torch/storage.py", line 520, in share_memory_
[ComfyUI] return super().share_memory_(*args, **kwargs)
[ComfyUI] File "/tmp/comfytest-home/.ce/.pixi/envs/panopack-nodes/lib/python3.10/site-packages/torch/storage.py", line 400, in share_memory_
[ComfyUI] self._share_fd_cpu_()
[ComfyUI] File "/tmp/comfytest-home/.ce/.pixi/envs/panopack-nodes/lib/python3.10/site-packages/torch/storage.py", line 449, in wrapper
[ComfyUI] return fn(self, *args, **kwargs)
[ComfyUI] File "/tmp/comfytest-home/.ce/.pixi/envs/panopack-nodes/lib/python3.10/site-packages/torch/storage.py", line 524, in _share_fd_cpu_
[ComfyUI] return super()._share_fd_cpu_(*args, **kwargs)
[ComfyUI] RuntimeError: unable to allocate shared memory(shm) for file </torch_2560_118963202_16>: Success (0)
[ComfyUI]
[ComfyUI] [ERROR] Traceback (most recent call last):
[ComfyUI] File "/workspaces/Sharp-1914/ComfyUI/execution.py", line 536, in execute
[ComfyUI] output_data, output_ui, has_subgraph, has_pending_tasks = await get_output_data(prompt_id, unique_id, obj, input_data_all, execution_block_cb=execution_block_cb, pre_execute_cb=pre_execute_cb, v3_data=v3_data)
[ComfyUI] File "/workspaces/Sharp-1914/ComfyUI/execution.py", line 336, in get_output_data
[ComfyUI] return_values = await _async_map_node_over_list(prompt_id, unique_id, obj, input_data_all, obj.FUNCTION, allow_interrupt=True, execution_block_cb=execution_block_cb, pre_execute_cb=pre_execute_cb, v3_data=v3_data)
[ComfyUI] File "/workspaces/Sharp-1914/ComfyUI/execution.py", line 310, in _async_map_node_over_list
[ComfyUI] await process_inputs(input_dict, i)
[ComfyUI] File "/workspaces/Sharp-1914/ComfyUI/execution.py", line 298, in process_inputs
[ComfyUI] result = f(**inputs)
[ComfyUI] File "/workspaces/Sharp-1914/.venv/lib/python3.10/site-packages/comfy_env/isolation/metadata.py", line 556, in proxy
[ComfyUI] result = worker.call_method(
[ComfyUI] File "/workspaces/Sharp-1914/.venv/lib/python3.10/site-packages/comfy_env/isolation/workers/subprocess.py", line 674, in call_method
[ComfyUI] raise WorkerError(
[ComfyUI] comfy_env.isolation.workers.base.WorkerError: unable to allocate shared memory(shm) for file </torch_2560_118963202_16>: Success (0)
[ComfyUI]
[ComfyUI] Worker traceback:
[ComfyUI] Traceback (most recent call last):
[ComfyUI] File "/tmp/comfyui_pvenv_0kgugsfd/persistent_worker.py", line 1772, in main
[ComfyUI] result_meta = _to_shm(result, shm_registry)
[ComfyUI] File "/tmp/comfyui_pvenv_0kgugsfd/persistent_worker.py", line 692, in _to_shm
[ComfyUI] "args": _to_shm(list(obj.args), registry, visited),
[ComfyUI] File "/tmp/comfyui_pvenv_0kgugsfd/persistent_worker.py", line 705, in _to_shm
[ComfyUI] result = [_to_shm(v, registry, visited) for v in obj]
[ComfyUI] File "/tmp/comfyui_pvenv_0kgugsfd/persistent_worker.py", line 705, in <listcomp>
[ComfyUI] result = [_to_shm(v, registry, visited) for v in obj]
[ComfyUI] File "/tmp/comfyui_pvenv_0kgugsfd/persistent_worker.py", line 628, in _to_shm
[ComfyUI] result = _serialize_tensor_native(tensor, registry)
[ComfyUI] File "/tmp/comfyui_pvenv_0kgugsfd/persistent_worker.py", line 563, in _serialize_tensor_native
[ComfyUI] t.share_memory_()
[ComfyUI] File "/tmp/comfytest-home/.ce/.pixi/envs/panopack-nodes/lib/python3.10/site-packages/torch/_tensor.py", line 853, in share_memory_
[ComfyUI] self._typed_storage()._share_memory_()
[ComfyUI] File "/tmp/comfytest-home/.ce/.pixi/envs/panopack-nodes/lib/python3.10/site-packages/torch/storage.py", line 1193, in _share_memory_
[ComfyUI] self._untyped_storage.share_memory_()
[ComfyUI] File "/tmp/comfytest-home/.ce/.pixi/envs/panopack-nodes/lib/python3.10/site-packages/torch/storage.py", line 449, in wrapper
[ComfyUI] return fn(self, *args, **kwargs)
[ComfyUI] File "/tmp/comfytest-home/.ce/.pixi/envs/panopack-nodes/lib/python3.10/site-packages/torch/storage.py", line 520, in share_memory_
[ComfyUI] return super().share_memory_(*args, **kwargs)
[ComfyUI] File "/tmp/comfytest-home/.ce/.pixi/envs/panopack-nodes/lib/python3.10/site-packages/torch/storage.py", line 400, in share_memory_
[ComfyUI] self._share_fd_cpu_()
[ComfyUI] File "/tmp/comfytest-home/.ce/.pixi/envs/panopack-nodes/lib/python3.10/site-packages/torch/storage.py", line 449, in wrapper
[ComfyUI] return fn(self, *args, **kwargs)
[ComfyUI] File "/tmp/comfytest-home/.ce/.pixi/envs/panopack-nodes/lib/python3.10/site-packages/torch/storage.py", line 524, in _share_fd_cpu_
[ComfyUI] return super()._share_fd_cpu_(*args, **kwargs)
[ComfyUI] RuntimeError: unable to allocate shared memory(shm) for file </torch_2560_118963202_16>: Success (0)
[ComfyUI]
[ComfyUI]
[ComfyUI] [INFO] Prompt executed in 223.04 seconds
Execution complete (t=223.6s)
Execution error: {'prompt_id': '16f9d308-d076-4c5d-9a60-1719bd41817a', 'node_id': '87', 'node_type': 'PanoramaSplitAdaptive', 'executed': ['7', '81', '61', '96', '9', '70', '62', '59', '80', '60', '68'], 'exception_message': 'unable to allocate shared memory(shm) for file </torch_2560_118963202_16>: Success (0)\n\nWorker traceback:\nTraceback (most recent call last):\n File "/tmp/comfyui_pvenv_0kgugsfd/persistent_worker.py", line 1772, in main\n result_meta = _to_shm(result, shm_registry)\n File "/tmp/comfyui_pvenv_0kgugsfd/persistent_worker.py", line 692, in _to_shm\n "args": _to_shm(list(obj.args), registry, visited),\n File "/tmp/comfyui_pvenv_0kgugsfd/persistent_worker.py", line 705, in _to_shm\n result = [_to_shm(v, registry, visited) for v in obj]\n File "/tmp/comfyui_pvenv_0kgugsfd/persistent_worker.py", line 705, in <listcomp>\n result = [_to_shm(v, registry, visited) for v in obj]\n File "/tmp/comfyui_pvenv_0kgugsfd/persistent_worker.py", line 628, in _to_shm\n result = _serialize_tensor_native(tensor, registry)\n File "/tmp/comfyui_pvenv_0kgugsfd/persistent_worker.py", line 563, in _serialize_tensor_native\n t.share_memory_()\n File "/tmp/comfytest-home/.ce/.pixi/envs/panopack-nodes/lib/python3.10/site-packages/torch/_tensor.py", line 853, in share_memory_\n self._typed_storage()._share_memory_()\n File "/tmp/comfytest-home/.ce/.pixi/envs/panopack-nodes/lib/python3.10/site-packages/torch/storage.py", line 1193, in _share_memory_\n self._untyped_storage.share_memory_()\n File "/tmp/comfytest-home/.ce/.pixi/envs/panopack-nodes/lib/python3.10/site-packages/torch/storage.py", line 449, in wrapper\n return fn(self, *args, **kwargs)\n File "/tmp/comfytest-home/.ce/.pixi/envs/panopack-nodes/lib/python3.10/site-packages/torch/storage.py", line 520, in share_memory_\n return super().share_memory_(*args, **kwargs)\n File "/tmp/comfytest-home/.ce/.pixi/envs/panopack-nodes/lib/python3.10/site-packages/torch/storage.py", line 400, in share_memory_\n self._share_fd_cpu_()\n File "/tmp/comfytest-home/.ce/.pixi/envs/panopack-nodes/lib/python3.10/site-packages/torch/storage.py", line 449, in wrapper\n return fn(self, *args, **kwargs)\n File "/tmp/comfytest-home/.ce/.pixi/envs/panopack-nodes/lib/python3.10/site-packages/torch/storage.py", line 524, in _share_fd_cpu_\n return super()._share_fd_cpu_(*args, **kwargs)\nRuntimeError: unable to allocate shared memory(shm) for file </torch_2560_118963202_16>: Success (0)\n\n', 'exception_type': 'comfy_env.isolation.workers.base.WorkerError', 'traceback': [' File "/workspaces/Sharp-1914/ComfyUI/execution.py", line 536, in execute\n output_data, output_ui, has_subgraph, has_pending_tasks = await get_output_data(prompt_id, unique_id, obj, input_data_all, execution_block_cb=execution_block_cb, pre_execute_cb=pre_execute_cb, v3_data=v3_data)\n', ' File "/workspaces/Sharp-1914/ComfyUI/execution.py", line 336, in get_output_data\n return_values = await _async_map_node_over_list(prompt_id, unique_id, obj, input_data_all, obj.FUNCTION, allow_interrupt=True, execution_block_cb=execution_block_cb, pre_execute_cb=pre_execute_cb, v3_data=v3_data)\n', ' File "/workspaces/Sharp-1914/ComfyUI/execution.py", line 310, in _async_map_node_over_list\n await process_inputs(input_dict, i)\n', ' File "/workspaces/Sharp-1914/ComfyUI/execution.py", line 298, in process_inputs\n result = f(**inputs)\n', ' File "/workspaces/Sharp-1914/.venv/lib/python3.10/site-packages/comfy_env/isolation/metadata.py", line 556, in proxy\n result = worker.call_method(\n', ' File "/workspaces/Sharp-1914/.venv/lib/python3.10/site-packages/comfy_env/isolation/workers/subprocess.py", line 674, in call_method\n raise WorkerError(\n'], 'current_inputs': {'split_method': ['icosahedron_42'], 'resolution': [1536], 'fov_degrees': [90], 'use_gpu': [True], 'create_masks': [True], 'mask_method': ['closest_to'], 'panorama': ["{'image': tensor([[[[0.1647, 0.1020, 0.0745],\n [0.1765, 0.1098, 0.0863],\n [0.1765, 0.1137, 0.0941],\n ...,\n [0.1647, 0.1137, 0.0941],\n [0.1647, 0.1098, 0.0902],\n [0.1333, 0.0784, 0.0667]],\n\n [[0.1922, 0.1255, 0.0902],\n [0.1843, 0.1216, 0.0902],\n [0.1922, 0.1255, 0.0980],\n ...,\n [0.1765, 0.1255, 0.0980],\n [0.1725, 0.1255, 0.1020],\n [0.1647, 0.1059, 0.0824]],\n\n [[0.1882, 0.1216, 0.0980],\n [0.1843, 0.1216, 0.0980],\n [0.1882, 0.1216, 0.0980],\n ...,\n [0.1804, 0.1333, 0.1020],\n [0.1804, 0.1373, 0.1098],\n [0.1569, 0.1059, 0.0863]],\n\n ...,\n\n [[0.1882, 0.1255, 0.1176],\n [0.1922, 0.1255, 0.1176],\n [0.1922, 0.1255, 0.1176],\n ...,\n [0.1176, 0.1333, 0.1412],\n [0.1686, 0.1529, 0.1451],\n [0.1843, 0.1569, 0.1333]],\n\n [[0.1882, 0.1255, 0.1176],\n [0.1882, 0.1255, 0.1137],\n [0.1922, 0.1255, 0.1176],\n ...,\n [0.1647, 0.1412, 0.1098],\n [0.1922, 0.1529, 0.1176],\n [0.2039, 0.1490, 0.1294]],\n\n [[0.1765, 0.1137, 0.1137],\n [0.1804, 0.1255, 0.1216],\n [0.1765, 0.1216, 0.1137],\n ...,\n [0.1961, 0.1725, 0.1412],\n [0.1647, 0.1451, 0.1333],\n [0.1843, 0.1137, 0.1373]]]]), 'meta': {}}"], 'depth_panorama': ['tensor([[[[0.7430, 0.7430, 0.7430],\n [0.7430, 0.7430, 0.7430],\n [0.7430, 0.7430, 0.7430],\n ...,\n [0.7430, 0.7430, 0.7430],\n [0.7430, 0.7430, 0.7430],\n [0.7430, 0.7430, 0.7430]],\n\n [[0.7429, 0.7429, 0.7429],\n [0.7429, 0.7429, 0.7429],\n [0.7429, 0.7429, 0.7429],\n ...,\n [0.7429, 0.7429, 0.7429],\n [0.7429, 0.7429, 0.7429],\n [0.7429, 0.7429, 0.7429]],\n\n [[0.7430, 0.7430, 0.7430],\n [0.7430, 0.7430, 0.7430],\n [0.7430, 0.7430, 0.7430],\n ...,\n [0.7430, 0.7430, 0.7430],\n [0.7430, 0.7430, 0.7430],\n [0.7430, 0.7430, 0.7430]],\n\n ...,\n\n [[0.8810, 0.8810, 0.8810],\n [0.8810, 0.8810, 0.8810],\n [0.8810, 0.8810, 0.8810],\n ...,\n [0.8810, 0.8810, 0.8810],\n [0.8810, 0.8810, 0.8810],\n [0.8810, 0.8810, 0.8810]],\n\n [[0.8811, 0.8811, 0.8811],\n [0.8811, 0.8811, 0.8811],\n [0.8811, 0.8811, 0.8811],\n ...,\n [0.8811, 0.8811, 0.8811],\n [0.8811, 0.8811, 0.8811],\n [0.8811, 0.8811, 0.8811]],\n\n [[0.8813, 0.8813, 0.8813],\n [0.8813, 0.8813, 0.8813],\n [0.8813, 0.8813, 0.8813],\n ...,\n [0.8813, 0.8813, 0.8813],\n [0.8813, 0.8813, 0.8813],\n [0.8813, 0.8813, 0.8813]]]])'], 'normals_panorama': ['tensor([[[[4.8400e-01, 5.0399e-01, 2.7195e-04],\n [4.8401e-01, 5.0400e-01, 2.7180e-04],\n [4.8401e-01, 5.0400e-01, 2.7180e-04],\n ...,\n [4.8401e-01, 5.0399e-01, 2.7168e-04],\n [4.8401e-01, 5.0399e-01, 2.7168e-04],\n [4.8400e-01, 5.0399e-01, 2.7195e-04]],\n\n [[4.8384e-01, 5.0488e-01, 2.8512e-04],\n [4.8384e-01, 5.0488e-01, 2.8512e-04],\n [4.8384e-01, 5.0488e-01, 2.8512e-04],\n ...,\n [4.8384e-01, 5.0488e-01, 2.8512e-04],\n [4.8384e-01, 5.0488e-01, 2.8512e-04],\n [4.8384e-01, 5.0488e-01, 2.8512e-04]],\n\n [[4.8386e-01, 5.0571e-01, 2.9308e-04],\n [4.8386e-01, 5.0571e-01, 2.9308e-04],\n [4.8386e-01, 5.0571e-01, 2.9308e-04],\n ...,\n [4.8386e-01, 5.0571e-01, 2.9308e-04],\n [4.8386e-01, 5.0571e-01, 2.9308e-04],\n [4.8386e-01, 5.0571e-01, 2.9308e-04]],\n\n ...,\n\n [[4.9929e-01, 5.1112e-01, 9.9988e-01],\n [4.9929e-01, 5.1112e-01, 9.9988e-01],\n [4.9929e-01, 5.1112e-01, 9.9988e-01],\n ...,\n [4.9929e-01, 5.1112e-01, 9.9988e-01],\n [4.9929e-01, 5.1112e-01, 9.9988e-01],\n [4.9929e-01, 5.1112e-01, 9.9988e-01]],\n\n [[4.9880e-01, 5.1144e-01, 9.9987e-01],\n [4.9880e-01, 5.1144e-01, 9.9987e-01],\n [4.9880e-01, 5.1144e-01, 9.9987e-01],\n ...,\n [4.9880e-01, 5.1144e-01, 9.9987e-01],\n [4.9880e-01, 5.1144e-01, 9.9987e-01],\n [4.9880e-01, 5.1144e-01, 9.9987e-01]],\n\n [[4.9943e-01, 5.1242e-01, 9.9985e-01],\n [4.9943e-01, 5.1242e-01, 9.9985e-01],\n [4.9943e-01, 5.1242e-01, 9.9985e-01],\n ...,\n [4.9943e-01, 5.1242e-01, 9.9985e-01],\n [4.9943e-01, 5.1242e-01, 9.9985e-01],\n [4.9943e-01, 5.1242e-01, 9.9985e-01]]]])']}, 'current_outputs': ['7', '61', '81', '54', '96', '87', '9', '62', '70', '59', '76', '73', '80', '89', '95', '68', '78', '60'], 'timestamp': 1780860292737}
Status: FAILED
Error: Workflow execution failed: {'prompt_id': '16f9d308-d076-4c5d-9a60-1719bd41817a', 'node_id': '87', 'node_type': 'PanoramaSplitAdaptive', 'executed': ['7', '81', '61', '96', '9', '70', '62', '59', '80', '60', '68'], 'exception_message': 'unable to allocate shared memory(shm) for file </torch_2560_118963202_16>: Success (0)\n\nWorker traceback:\nTraceback (most recent call last):\n File "/tmp/comfyui_pvenv_0kgugsfd/persistent_worker.py", line 1772, in main\n result_meta = _to_shm(result, shm_registry)\n File "/tmp/comfyui_pvenv_0kgugsfd/persistent_worker.py", line 692, in _to_shm\n "args": _to_shm(list(obj.args), registry, visited),\n File "/tmp/comfyui_pvenv_0kgugsfd/persistent_worker.py", line 705, in _to_shm\n result = [_to_shm(v, registry, visited) for v in obj]\n File "/tmp/comfyui_pvenv_0kgugsfd/persistent_worker.py", line 705, in <listcomp>\n result = [_to_shm(v, registry, visited) for v in obj]\n File "/tmp/comfyui_pvenv_0kgugsfd/persistent_worker.py", line 628, in _to_shm\n result = _serialize_tensor_native(tensor, registry)\n File "/tmp/comfyui_pvenv_0kgugsfd/persistent_worker.py", line 563, in _serialize_tensor_native\n t.share_memory_()\n File "/tmp/comfytest-home/.ce/.pixi/envs/panopack-nodes/lib/python3.10/site-packages/torch/_tensor.py", line 853, in share_memory_\n self._typed_storage()._share_memory_()\n File "/tmp/comfytest-home/.ce/.pixi/envs/panopack-nodes/lib/python3.10/site-packages/torch/storage.py", line 1193, in _share_memory_\n self._untyped_storage.share_memory_()\n File "/tmp/comfytest-home/.ce/.pixi/envs/panopack-nodes/lib/python3.10/site-packages/torch/storage.py", line 449, in wrapper\n return fn(self, *args, **kwargs)\n File "/tmp/comfytest-home/.ce/.pixi/envs/panopack-nodes/lib/python3.10/site-packages/torch/storage.py", line 520, in share_memory_\n return super().share_memory_(*args, **kwargs)\n File "/tmp/comfytest-home/.ce/.pixi/envs/panopack-nodes/lib/python3.10/site-packages/torch/storage.py", line 400, in share_memory_\n self._share_fd_cpu_()\n File "/tmp/comfytest-home/.ce/.pixi/envs/panopack-nodes/lib/python3.10/site-packages/torch/storage.py", line 449, in wrapper\n return fn(self, *args, **kwargs)\n File "/tmp/comfytest-home/.ce/.pixi/envs/panopack-nodes/lib/python3.10/site-packages/torch/storage.py", line 524, in _share_fd_cpu_\n return super()._share_fd_cpu_(*args, **kwargs)\nRuntimeError: unable to allocate shared memory(shm) for file </torch_2560_118963202_16>: Success (0)\n\n', 'exception_type': 'comfy_env.isolation.workers.base.WorkerError', 'traceback': [' File "/workspaces/Sharp-1914/ComfyUI/execution.py", line 536, in execute\n output_data, output_ui, has_subgraph, has_pending_tasks = await get_output_data(prompt_id, unique_id, obj, input_data_all, execution_block_cb=execution_block_cb, pre_execute_cb=pre_execute_cb, v3_data=v3_data)\n', ' File "/workspaces/Sharp-1914/ComfyUI/execution.py", line 336, in get_output_data\n return_values = await _async_map_node_over_list(prompt_id, unique_id, obj, input_data_all, obj.FUNCTION, allow_interrupt=True, execution_block_cb=execution_block_cb, pre_execute_cb=pre_execute_cb, v3_data=v3_data)\n', ' File "/workspaces/Sharp-1914/ComfyUI/execution.py", line 310, in _async_map_node_over_list\n await process_inputs(input_dict, i)\n', ' File "/workspaces/Sharp-1914/ComfyUI/execution.py", line 298, in process_inputs\n result = f(**inputs)\n', ' File "/workspaces/Sharp-1914/.venv/lib/python3.10/site-packages/comfy_env/isolation/metadata.py", line 556, in proxy\n result = worker.call_method(\n', ' File "/workspaces/Sharp-1914/.venv/lib/python3.10/site-packages/comfy_env/isolation/workers/subprocess.py", line 674, in call_method\n raise WorkerError(\n'], 'current_inputs': {'split_method': ['icosahedron_42'], 'resolution': [1536], 'fov_degrees': [90], 'use_gpu': [True], 'create_masks': [True], 'mask_method': ['closest_to'], 'panorama': ["{'image': tensor([[[[0.1647, 0.1020, 0.0745],\n [0.1765, 0.1098, 0.0863],\n [0.1765, 0.1137, 0.0941],\n ...,\n [0.1647, 0.1137, 0.0941],\n [0.1647, 0.1098, 0.0902],\n [0.1333, 0.0784, 0.0667]],\n\n [[0.1922, 0.1255, 0.0902],\n [0.1843, 0.1216, 0.0902],\n [0.1922, 0.1255, 0.0980],\n ...,\n [0.1765, 0.1255, 0.0980],\n [0.1725, 0.1255, 0.1020],\n [0.1647, 0.1059, 0.0824]],\n\n [[0.1882, 0.1216, 0.0980],\n [0.1843, 0.1216, 0.0980],\n [0.1882, 0.1216, 0.0980],\n ...,\n [0.1804, 0.1333, 0.1020],\n [0.1804, 0.1373, 0.1098],\n [0.1569, 0.1059, 0.0863]],\n\n ...,\n\n [[0.1882, 0.1255, 0.1176],\n [0.1922, 0.1255, 0.1176],\n [0.1922, 0.1255, 0.1176],\n ...,\n [0.1176, 0.1333, 0.1412],\n [0.1686, 0.1529, 0.1451],\n [0.1843, 0.1569, 0.1333]],\n\n [[0.1882, 0.1255, 0.1176],\n [0.1882, 0.1255, 0.1137],\n [0.1922, 0.1255, 0.1176],\n ...,\n [0.1647, 0.1412, 0.1098],\n [0.1922, 0.1529, 0.1176],\n [0.2039, 0.1490, 0.1294]],\n\n [[0.1765, 0.1137, 0.1137],\n [0.1804, 0.1255, 0.1216],\n [0.1765, 0.1216, 0.1137],\n ...,\n [0.1961, 0.1725, 0.1412],\n [0.1647, 0.1451, 0.1333],\n [0.1843, 0.1137, 0.1373]]]]), 'meta': {}}"], 'depth_panorama': ['tensor([[[[0.7430, 0.7430, 0.7430],\n [0.7430, 0.7430, 0.7430],\n [0.7430, 0.7430, 0.7430],\n ...,\n [0.7430, 0.7430, 0.7430],\n [0.7430, 0.7430, 0.7430],\n [0.7430, 0.7430, 0.7430]],\n\n [[0.7429, 0.7429, 0.7429],\n [0.7429, 0.7429, 0.7429],\n [0.7429, 0.7429, 0.7429],\n ...,\n [0.7429, 0.7429, 0.7429],\n [0.7429, 0.7429, 0.7429],\n [0.7429, 0.7429, 0.7429]],\n\n [[0.7430, 0.7430, 0.7430],\n [0.7430, 0.7430, 0.7430],\n [0.7430, 0.7430, 0.7430],\n ...,\n [0.7430, 0.7430, 0.7430],\n [0.7430, 0.7430, 0.7430],\n [0.7430, 0.7430, 0.7430]],\n\n ...,\n\n [[0.8810, 0.8810, 0.8810],\n [0.8810, 0.8810, 0.8810],\n [0.8810, 0.8810, 0.8810],\n ...,\n [0.8810, 0.8810, 0.8810],\n [0.8810, 0.8810, 0.8810],\n [0.8810, 0.8810, 0.8810]],\n\n [[0.8811, 0.8811, 0.8811],\n [0.8811, 0.8811, 0.8811],\n [0.8811, 0.8811, 0.8811],\n ...,\n [0.8811, 0.8811, 0.8811],\n [0.8811, 0.8811, 0.8811],\n [0.8811, 0.8811, 0.8811]],\n\n [[0.8813, 0.8813, 0.8813],\n [0.8813, 0.8813, 0.8813],\n [0.8813, 0.8813, 0.8813],\n ...,\n [0.8813, 0.8813, 0.8813],\n [0.8813, 0.8813, 0.8813],\n [0.8813, 0.8813, 0.8813]]]])'], 'normals_panorama': ['tensor([[[[4.8400e-01, 5.0399e-01, 2.7195e-04],\n [4.8401e-01, 5.0400e-01, 2.7180e-04],\n [4.8401e-01, 5.0400e-01, 2.7180e-04],\n ...,\n [4.8401e-01, 5.0399e-01, 2.7168e-04],\n [4.8401e-01, 5.0399e-01, 2.7168e-04],\n [4.8400e-01, 5.0399e-01, 2.7195e-04]],\n\n [[4.8384e-01, 5.0488e-01, 2.8512e-04],\n [4.8384e-01, 5.0488e-01, 2.8512e-04],\n [4.8384e-01, 5.0488e-01, 2.8512e-04],\n ...,\n [4.8384e-01, 5.0488e-01, 2.8512e-04],\n [4.8384e-01, 5.0488e-01, 2.8512e-04],\n [4.8384e-01, 5.0488e-01, 2.8512e-04]],\n\n [[4.8386e-01, 5.0571e-01, 2.9308e-04],\n [4.8386e-01, 5.0571e-01, 2.9308e-04],\n [4.8386e-01, 5.0571e-01, 2.9308e-04],\n ...,\n [4.8386e-01, 5.0571e-01, 2.9308e-04],\n [4.8386e-01, 5.0571e-01, 2.9308e-04],\n [4.8386e-01, 5.0571e-01, 2.9308e-04]],\n\n ...,\n\n [[4.9929e-01, 5.1112e-01, 9.9988e-01],\n [4.9929e-01, 5.1112e-01, 9.9988e-01],\n [4.9929e-01, 5.1112e-01, 9.9988e-01],\n ...,\n [4.9929e-01, 5.1112e-01, 9.9988e-01],\n [4.9929e-01, 5.1112e-01, 9.9988e-01],\n [4.9929e-01, 5.1112e-01, 9.9988e-01]],\n\n [[4.9880e-01, 5.1144e-01, 9.9987e-01],\n [4.9880e-01, 5.1144e-01, 9.9987e-01],\n [4.9880e-01, 5.1144e-01, 9.9987e-01],\n ...,\n [4.9880e-01, 5.1144e-01, 9.9987e-01],\n [4.9880e-01, 5.1144e-01, 9.9987e-01],\n [4.9880e-01, 5.1144e-01, 9.9987e-01]],\n\n [[4.9943e-01, 5.1242e-01, 9.9985e-01],\n [4.9943e-01, 5.1242e-01, 9.9985e-01],\n [4.9943e-01, 5.1242e-01, 9.9985e-01],\n ...,\n [4.9943e-01, 5.1242e-01, 9.9985e-01],\n [4.9943e-01, 5.1242e-01, 9.9985e-01],\n [4.9943e-01, 5.1242e-01, 9.9985e-01]]]])']}, 'current_outputs': ['7', '61', '81', '54', '96', '87', '9', '62', '70', '59', '76', '73', '80', '89', '95', '68', '78', '60'], 'timestamp': 1780860292737}
Details: Workflow: /node/ComfyUI-Sharp/workflows/pano.json
Node error: PanoramaSplitAdaptive
[ComfyUI] [INFO] Using RAM pressure cache.
[ComfyUI] [INFO] Using RAM pressure cache.
Frame 1 saved (frame_000.jpg, t=0.0s)
Validating workflow...
[ComfyUI] [INFO] === /validate endpoint called ===
Queuing workflow for execution...
[ComfyUI] [INFO] Received JSON with keys: ['prompt']
[ComfyUI] [INFO] Prompt has 18 nodes
[ComfyUI] [INFO] Node 7: LoadImage
[ComfyUI] [INFO] Inputs: {"image": "pano.png"}
[ComfyUI] [INFO] Node 9: LoadSharpModel
[ComfyUI] [INFO] Inputs: {"precision": "auto"}
[ComfyUI] [INFO] Node 54: MergeGaussians
[ComfyUI] [INFO] Inputs: {"ply_folder": ["76", 0], "output_prefix": "merged", "max_depth": 0, "min_opacity": 0}
[ComfyUI] [INFO] Node 59: PanoramaWrap
[ComfyUI] [INFO] Inputs: {"image": ["7", 0]}
[ComfyUI] [INFO] Node 60: PanoramaDepthMerge
[ComfyUI] [INFO] Inputs: {"out_width": ["61", 0], "out_height": ["61", 1], "use_gpu": true, "scale_anchor": false, "chunk_size": 8, "center_weight_power": 2, "normal_edge_threshold_deg": 0, "normal_consistency_boost": false,
[ComfyUI] [INFO] Node 61: GetImageSize
[ComfyUI] [comfy-env] SubprocessWorker: /tmp/comfytest-home/.ce/.pixi/envs/sharp-nodes/bin/python
[ComfyUI] [INFO] Inputs: {"image": ["7", 0]}
[ComfyUI] [comfy-env] env_vars: {'COMFYUI_BASE': '/workspaces/Sharp-1914/ComfyUI'}
[ComfyUI] [INFO] Node 62: PreviewImage
[ComfyUI] [ComfyUI-Sharp] python: /tmp/comfytest-home/.ce/.pixi/envs/sharp-nodes/bin/python
[ComfyUI] [INFO] Inputs: {"images": ["60", 2]}
[ComfyUI] [ComfyUI-Sharp] sys_path sent to worker: ['/workspaces/Sharp-1914/ComfyUI', '/workspaces/Sharp-1914/ComfyUI/custom_nodes/ComfyUI-Sharp', '/tmp/comfytest-home/.ce/.pixi/envs/sharp-nodes/lib/python3.1/site-packages', '/workspaces/Sharp-1914/ComfyUI/custom_nodes/ComfyUI-Sharp']
[ComfyUI] [INFO] Node 68: PreviewImage
[ComfyUI] [SubprocessWorker] is_pixi=True, python=/tmp/comfytest-home/.ce/.pixi/envs/sharp-nodes/bin/python
[ComfyUI] [INFO] Inputs: {"images": ["96", 0]}
[ComfyUI] [SubprocessWorker] launching cmd=['/tmp/comfytest-home/.pixi/bin/pixi', 'run', '--as-is', '--manifest-path', '/tmp/comfytest-home/.ce/pixi.toml', '-e', 'sharp-nodes', 'python', '/tmp/comfyui_pvenv_qlpb5zhh/persistent_worker.py', 'abstract://comfy_worker_375e4707e383']...
[ComfyUI] [INFO] Node 70: PreviewImage
[ComfyUI] [SubprocessWorker] socket_addr=abstract://comfy_worker_375e4707e383 (abstract, no filesystem path)
[ComfyUI] [INFO] Inputs: {"images": ["81", 0]}
[ComfyUI] [INFO] Node 73: SharpRayToPlanarDepth
[ComfyUI] [INFO] Inputs: {"image": ["87", 1], "intrinsics": ["87", 4], "extrinsics": ["87", 3]}
[ComfyUI] [INFO] Node 76: SharpPredictGaussiansFromMetricDepth
[ComfyUI] [INFO] Inputs: {"snap_to_external_depth": "none", "depth_convention": "planar_z", "focal_length_mm": 30, "output_prefix": "sharp_aligned", "save_background_layer": true, "edge_crop": 0, "model": ["9", 0], "image": [
[ComfyUI] [INFO] Node 78: TransformGaussian
[ComfyUI] [INFO] Inputs: {"rotate_x": -90, "rotate_y": 0, "rotate_z": 0, "ply_path": ["54", 1]}
[ComfyUI] [INFO] Node 80: DownloadAndLoadMoGe2Model
[ComfyUI] [INFO] Inputs: {"model": "moge-2-vitl-normal.pt", "precision": "auto", "attention": "auto"}
[ComfyUI] [INFO] Node 81: MoGe2Inference
[ComfyUI] [INFO] Inputs: {"resolution_level": 9, "num_tokens": 0, "fov_x_deg": ["96", 3], "force_projection": true, "apply_mask": true, "moge2_model": ["80", 0], "images": ["96", 0]}
[ComfyUI] [INFO] Node 87: PanoramaSplitAdaptive
[ComfyUI] [INFO] Inputs: {"split_method": "icosahedron_42", "resolution": 1536, "fov_degrees": 90, "use_gpu": true, "create_masks": true, "mask_method": "closest_to", "panorama": ["59", 0], "depth_panorama": ["60", 0], "norma
[ComfyUI] [INFO] Node 89: PreviewImage
[ComfyUI] [INFO] Inputs: {"images": ["87", 8]}
[ComfyUI] [INFO] Node 95: PreviewGaussians
[ComfyUI] [INFO] Inputs: {"camera_mode": "orbit", "fov_degrees": 71, "renderer": "playcanvas", "transport_format": "ply", "ply_path": ["78", 0]}
[ComfyUI] [INFO] Node 96: PanoramaSplit
[ComfyUI] [INFO] Inputs: {"split_method": "icosahedron_42", "resolution": 952, "fov_degrees": 90, "use_gpu": true, "create_masks": false, "fname": "pano_bank", "panorama": ["59", 0]}
[ComfyUI] [INFO] Generated prompt_id: 31085ed5-c99f-4caa-adc5-5d3b2d8a0840
[ComfyUI] [INFO] Calling execution.validate_prompt()...
[ComfyUI] [INFO] Validation result: valid=True
[ComfyUI] [INFO] === Validation PASSED ===
[ComfyUI] [INFO] got prompt
[ComfyUI] [comfy-env] Running LoadSharpModel: precision: 'auto'
[ComfyUI] [VRAM] Before LoadSharpModel: 697 / 24122 MB
[ComfyUI] [SubprocessWorker] call_method: nodes.load_model.LoadSharpModel.EXECUTE_NORMALIZED
[ComfyUI] [SubprocessWorker] acquired lock, ensuring started...
[ComfyUI] [worker:ComfyUI-Sharp] ERROR: Failed to import comfy_kitchen, Error: No module named 'comfy_kitchen', fp8 and fp4 support will not be available.
[ComfyUI] [worker:ComfyUI-Sharp] WARNING: comfy_kitchen does not support stochastic FP8 rounding, please update comfy_kitchen.
[ComfyUI] [SubprocessWorker] worker started/confirmed
[ComfyUI] [SubprocessWorker] serializing kwargs to shm...
[ComfyUI] [SubprocessWorker] created 0 shm blocks
[ComfyUI] [SubprocessWorker] sending request via socket...
[ComfyUI] [SubprocessWorker] call_id=1 sending call_method
[ComfyUI] [worker:ComfyUI-Sharp] [LoadSharpModel] precision='auto' -> dtype=bf16 (device=cuda:0)
[ComfyUI] [worker:ComfyUI-Sharp] [LoadSharpModel] checkpoint not found at /workspaces/Sharp-1914/ComfyUI/models/sharp/sharp_2572gikvuh.pt — downloading from HuggingFace repo 'apple/Sharp' file 'sharp_2572gikvuh.pt' -> /workspaces/Sharp-1914/ComfyUI/models/sharp
[ComfyUI]
Frame 2 saved (frame_001.jpg, t=2.3s)
[capture-periodic] freeze=1ms shot=91ms unfreeze=7ms saved=True
Frame 3 saved (frame_002.jpg, t=4.5s)
[capture-periodic] freeze=1ms shot=121ms unfreeze=5ms saved=True
[capture-loop] iter=50 t=5.7s state={'complete': False, 'error': None, 'executedCount': 0, 'wsState': 1} eval_ms=2 ram=4.7/31.3GB (15%) swap=1.7/32.0GB (5%) cpu=9% browser_rss=1.01GB
[ComfyUI] sharp_2572gikvuh.pt: 0%| | 0.00/2.81G [00:00<?, ?B/s]
[ComfyUI] sharp_2572gikvuh.pt: 6%|▌ | 158M/2.81G [00:06<01:40, 26.3MB/s][SubprocessWorker] callback 'report_progress' from call_id=1
[ComfyUI]
[ComfyUI] sharp_2572gikvuh.pt: 10%|█ | 292M/2.81G [00:06<00:45, 54.9MB/s][SubprocessWorker] callback 'report_progress' from call_id=1
Frame 4 saved (frame_003.jpg, t=8.9s)
[capture-periodic] freeze=1ms shot=90ms unfreeze=7ms saved=True
[ComfyUI]
[ComfyUI] sharp_2572gikvuh.pt: 13%|█▎ | 359M/2.81G [00:07<00:47, 51.6MB/s][SubprocessWorker] callback 'report_progress' from call_id=1
[ComfyUI]
[ComfyUI] sharp_2572gikvuh.pt: 15%|█▌ | 427M/2.81G [00:08<00:35, 67.1MB/s][SubprocessWorker] callback 'report_progress' from call_id=1
[capture-loop] iter=100 t=11.0s state={'complete': False, 'error': None, 'executedCount': 0, 'wsState': 1} eval_ms=2 ram=5.0/31.3GB (16%) swap=1.7/32.0GB (5%) cpu=8% browser_rss=1.01GB
Frame 5 saved (frame_004.jpg, t=11.2s)
[capture-periodic] freeze=1ms shot=93ms unfreeze=7ms saved=True
[capture-loop] iter=150 t=16.5s state={'complete': False, 'error': None, 'executedCount': 0, 'wsState': 1} eval_ms=1 ram=5.5/31.3GB (18%) swap=1.7/32.0GB (5%) cpu=8% browser_rss=1.01GB
[ComfyUI]
[ComfyUI] sharp_2572gikvuh.pt: 30%|██▉ | 829M/2.81G [00:14<00:31, 63.3MB/s][SubprocessWorker] callback 'report_progress' from call_id=1
Frame 6 saved (frame_005.jpg, t=17.6s)
[capture-periodic] freeze=1ms shot=91ms unfreeze=6ms saved=True
[ComfyUI]
[ComfyUI] sharp_2572gikvuh.pt: 34%|███▍ | 963M/2.81G [00:17<00:33, 55.8MB/s][SubprocessWorker] callback 'report_progress' from call_id=1
[ComfyUI]
[ComfyUI] sharp_2572gikvuh.pt: 37%|███▋ | 1.03G/2.81G [00:18<00:28, 63.5MB/s][SubprocessWorker] callback 'report_progress' from call_id=1
[ComfyUI]
[ComfyUI] sharp_2572gikvuh.pt: 46%|████▌ | 1.30G/2.81G [00:19<00:15, 98.6MB/s][SubprocessWorker] callback 'report_progress' from call_id=1
[capture-loop] iter=200 t=21.9s state={'complete': False, 'error': None, 'executedCount': 0, 'wsState': 1} eval_ms=1 ram=5.5/31.3GB (18%) swap=1.7/32.0GB (5%) cpu=10% browser_rss=1.02GB
Frame 7 saved (frame_006.jpg, t=22.0s)
[capture-periodic] freeze=1ms shot=103ms unfreeze=5ms saved=True
[ComfyUI]
[ComfyUI] sharp_2572gikvuh.pt: 51%|█████ | 1.43G/2.81G [00:21<00:15, 88.2MB/s][SubprocessWorker] callback 'report_progress' from call_id=1
Frame 8 saved (frame_007.jpg, t=24.2s)
[capture-periodic] freeze=1ms shot=102ms unfreeze=5ms saved=True
[ComfyUI]
[ComfyUI] sharp_2572gikvuh.pt: 56%|█████▌ | 1.57G/2.81G [00:22<00:12, 96.9MB/s][SubprocessWorker] callback 'report_progress' from call_id=1
[ComfyUI]
[ComfyUI] sharp_2572gikvuh.pt: 61%|██████ | 1.70G/2.81G [00:22<00:08, 125MB/s] [SubprocessWorker] callback 'report_progress' from call_id=1
[ComfyUI]
[ComfyUI] sharp_2572gikvuh.pt: 70%|███████ | 1.97G/2.81G [00:22<00:04, 188MB/s][SubprocessWorker] callback 'report_progress' from call_id=1
[ComfyUI]
[ComfyUI] sharp_2572gikvuh.pt: 72%|███████▏ | 2.04G/2.81G [00:23<00:03, 196MB/s][SubprocessWorker] callback 'report_progress' from call_id=1
[ComfyUI]
[ComfyUI] sharp_2572gikvuh.pt: 80%|███████▉ | 2.24G/2.81G [00:23<00:02, 218MB/s][SubprocessWorker] callback 'report_progress' from call_id=1
[ComfyUI]
[ComfyUI] sharp_2572gikvuh.pt: 87%|████████▋ | 2.44G/2.81G [00:24<00:01, 291MB/s][SubprocessWorker] callback 'report_progress' from call_id=1
Frame 9 saved (frame_008.jpg, t=26.4s)
[capture-periodic] freeze=14ms shot=121ms unfreeze=8ms saved=True
[ComfyUI]
[ComfyUI] sharp_2572gikvuh.pt: 100%|██████████| 2.81G/2.81G [00:24<00:00, 470MB/s][SubprocessWorker] callback 'report_progress' from call_id=1
[ComfyUI]
[ComfyUI] sharp_2572gikvuh.pt: 100%|██████████| 2.81G/2.81G [00:24<00:00, 114MB/s]
[ComfyUI] [worker:ComfyUI-Sharp] [LoadSharpModel] checkpoint ready: /workspaces/Sharp-1914/ComfyUI/models/sharp/sharp_2572gikvuh.pt (2679.6 MB)
[ComfyUI] [worker:ComfyUI-Sharp] [LoadSharpModel] config: precision=auto -> dtype=bf16
[ComfyUI] [SubprocessWorker] got response: ok
[ComfyUI] [comfy-env] SubprocessWorker: /tmp/comfytest-home/.ce/.pixi/envs/moge2-nodes/bin/python
[ComfyUI] [comfy-env] LoadSharpModel done (26.77s): result: NodeOutput
[ComfyUI] [comfy-env] env_vars: {'COMFYUI_BASE': '/workspaces/Sharp-1914/ComfyUI'}
[ComfyUI] [VRAM] After LoadSharpModel: 959 / 24122 MB
[ComfyUI] [ComfyUI-MoGe2] python: /tmp/comfytest-home/.ce/.pixi/envs/moge2-nodes/bin/python
[ComfyUI] [comfy-env] Running DownloadAndLoadMoGe2Model: model: 'moge-2-vitl-normal.pt', precision: 'auto', attention: 'auto'
[ComfyUI] [ComfyUI-MoGe2] sys_path sent to worker: ['/workspaces/Sharp-1914/ComfyUI', '/workspaces/Sharp-1914/ComfyUI/custom_nodes/ComfyUI-MoGe2', '/tmp/comfytest-home/.ce/.pixi/envs/moge2-nodes/lib/python3.1/site-packages', '/workspaces/Sharp-1914/ComfyUI/custom_nodes/ComfyUI-MoGe2']
[ComfyUI] [VRAM] Before DownloadAndLoadMoGe2Model: 959 / 24122 MB
[ComfyUI] [SubprocessWorker] is_pixi=True, python=/tmp/comfytest-home/.ce/.pixi/envs/moge2-nodes/bin/python
[ComfyUI] [SubprocessWorker] call_method: nodes.load_model.DownloadAndLoadMoGe2Model.EXECUTE_NORMALIZED
[ComfyUI] [SubprocessWorker] launching cmd=['/tmp/comfytest-home/.pixi/bin/pixi', 'run', '--as-is', '--manifest-path', '/tmp/comfytest-home/.ce/pixi.toml', '-e', 'moge2-nodes', 'python', '/tmp/comfyui_pvenv_bmmahm2z/persistent_worker.py', 'abstract://comfy_worker_b1be181c7b7c']...
[ComfyUI] [SubprocessWorker] acquired lock, ensuring started...
[ComfyUI] [SubprocessWorker] socket_addr=abstract://comfy_worker_b1be181c7b7c (abstract, no filesystem path)
[capture-loop] iter=250 t=27.5s state={'complete': False, 'error': None, 'executedCount': 0, 'wsState': 1} eval_ms=2 ram=4.6/31.3GB (15%) swap=1.7/32.0GB (5%) cpu=12% browser_rss=0.94GB
[ComfyUI] [worker:ComfyUI-MoGe2] ERROR: Failed to import comfy_kitchen, Error: No module named 'comfy_kitchen', fp8 and fp4 support will not be available.
[ComfyUI] [worker:ComfyUI-MoGe2] WARNING: comfy_kitchen does not support stochastic FP8 rounding, please update comfy_kitchen.
[ComfyUI] [SubprocessWorker] worker started/confirmed
[ComfyUI] [SubprocessWorker] serializing kwargs to shm...
[ComfyUI] [SubprocessWorker] created 0 shm blocks
[ComfyUI] [SubprocessWorker] sending request via socket...
[ComfyUI] [SubprocessWorker] call_id=1 sending call_method
Frame 10 saved (frame_009.jpg, t=28.6s)
[capture-periodic] freeze=1ms shot=88ms unfreeze=6ms saved=True
[ComfyUI]
[ComfyUI] model.pt: 0%| | 0.00/1.32G [00:00<?, ?B/s]
[ComfyUI] model.pt: 5%|▌ | 67.1M/1.32G [00:03<00:56, 22.2MB/s][SubprocessWorker] callback 'report_progress' from call_id=1
[capture-loop] iter=300 t=32.9s state={'complete': False, 'error': None, 'executedCount': 0, 'wsState': 1} eval_ms=1 ram=5.0/31.3GB (16%) swap=1.7/32.0GB (5%) cpu=10% browser_rss=0.94GB
Frame 11 saved (frame_010.jpg, t=33.0s)
[capture-periodic] freeze=1ms shot=89ms unfreeze=7ms saved=True
[ComfyUI]
[ComfyUI] model.pt: 10%|█ | 134M/1.32G [00:04<00:40, 29.5MB/s] [SubprocessWorker] callback 'report_progress' from call_id=1
Frame 12 saved (frame_011.jpg, t=35.2s)
[capture-periodic] freeze=1ms shot=90ms unfreeze=7ms saved=True
[ComfyUI]
[ComfyUI] model.pt: 20%|██ | 268M/1.32G [00:09<00:34, 30.8MB/s][SubprocessWorker] callback 'report_progress' from call_id=1
[capture-loop] iter=350 t=38.4s state={'complete': False, 'error': None, 'executedCount': 0, 'wsState': 1} eval_ms=1 ram=5.5/31.3GB (18%) swap=1.7/32.0GB (5%) cpu=8% browser_rss=0.92GB
[ComfyUI]
[ComfyUI] model.pt: 61%|██████ | 805M/1.32G [00:10<00:04, 112MB/s] [SubprocessWorker] callback 'report_progress' from call_id=1
Frame 13 saved (frame_012.jpg, t=39.5s)
[capture-periodic] freeze=1ms shot=98ms unfreeze=1ms saved=True
[ComfyUI]
[ComfyUI] model.pt: 71%|███████ | 939M/1.32G [00:11<00:03, 111MB/s][SubprocessWorker] callback 'report_progress' from call_id=1
[ComfyUI]
[ComfyUI] model.pt: 91%|█████████ | 1.21G/1.32G [00:11<00:00, 169MB/s][SubprocessWorker] callback 'report_progress' from call_id=1
[ComfyUI]
[ComfyUI] model.pt: 100%|██████████| 1.32G/1.32G [00:12<00:00, 193MB/s][SubprocessWorker] callback 'report_progress' from call_id=1
[ComfyUI]
[ComfyUI] model.pt: 100%|██████████| 1.32G/1.32G [00:12<00:00, 109MB/s]
[ComfyUI] [SubprocessWorker] got response: ok
[ComfyUI] [comfy-env] DownloadAndLoadMoGe2Model done (14.46s): result: NodeOutput
[ComfyUI] [VRAM] After DownloadAndLoadMoGe2Model: 1220 / 24122 MB
[ComfyUI] [comfy-env] Running PanoramaWrap: image: torch.float32 [1,2048,4096,3] cpu
[ComfyUI] [comfy-env] SubprocessWorker: /tmp/comfytest-home/.ce/.pixi/envs/panopack-nodes/bin/python
[ComfyUI] [VRAM] Before PanoramaWrap: 1220 / 24122 MB
[ComfyUI] [comfy-env] env_vars: {'COMFYUI_BASE': '/workspaces/Sharp-1914/ComfyUI'}
[ComfyUI] [SubprocessWorker] call_method: nodes.panorama_type.PanoramaWrap.EXECUTE_NORMALIZED
[ComfyUI] [ComfyUI-PanoPack] python: /tmp/comfytest-home/.ce/.pixi/envs/panopack-nodes/bin/python
[ComfyUI] [SubprocessWorker] acquired lock, ensuring started...
[ComfyUI] [ComfyUI-PanoPack] sys_path sent to worker: ['/workspaces/Sharp-1914/ComfyUI', '/workspaces/Sharp-1914/ComfyUI/custom_nodes/ComfyUI-PanoPack', '/tmp/comfytest-home/.ce/.pixi/envs/panopack-nodes/lib/python3.1/site-packages', '/workspaces/Sharp-1914/ComfyUI/custom_nodes/ComfyUI-PanoPack']
[ComfyUI] [SubprocessWorker] is_pixi=True, python=/tmp/comfytest-home/.ce/.pixi/envs/panopack-nodes/bin/python
[ComfyUI] [SubprocessWorker] launching cmd=['/tmp/comfytest-home/.pixi/bin/pixi', 'run', '--as-is', '--manifest-path', '/tmp/comfytest-home/.ce/pixi.toml', '-e', 'panopack-nodes', 'python', '/tmp/comfyui_pvenv_0kgugsfd/persistent_worker.py', 'abstract://comfy_worker_2b8028f966fa']...
[ComfyUI] [SubprocessWorker] socket_addr=abstract://comfy_worker_2b8028f966fa (abstract, no filesystem path)
Frame 14 saved (frame_013.jpg, t=41.8s)
[capture-periodic] freeze=1ms shot=104ms unfreeze=1ms saved=True
[ComfyUI] [worker:ComfyUI-PanoPack] ERROR: Failed to import comfy_kitchen, Error: No module named 'comfy_kitchen', fp8 and fp4 support will not be available.
[ComfyUI] [worker:ComfyUI-PanoPack] WARNING: comfy_kitchen does not support stochastic FP8 rounding, please update comfy_kitchen.
[ComfyUI] [SubprocessWorker] worker started/confirmed
[ComfyUI] [comfy-env] PRE-SERIALIZE 'image' shape: torch.Size([1, 2048, 4096, 3])
[ComfyUI] [SubprocessWorker] serializing kwargs to shm...
[ComfyUI] [SubprocessWorker] created 0 shm blocks
[ComfyUI] [SubprocessWorker] sending request via socket...
[ComfyUI] [SubprocessWorker] call_id=1 sending call_method
[ComfyUI] [worker:ComfyUI-PanoPack] [comfy-env] _from_shm got dict with keys: ['__type__', 'strategy', 'parent_pid', 'fd', 'storage_size']
[ComfyUI] [worker:ComfyUI-PanoPack] [comfy-env] DESERIALIZE TensorRef: tensor_size=[1, 2048, 4096, 3]
[ComfyUI] [worker:ComfyUI-PanoPack] [comfy-env] DESERIALIZED tensor shape: torch.Size([1, 2048, 4096, 3])
[ComfyUI] [SubprocessWorker] got response: ok
[ComfyUI] [comfy-env] PanoramaWrap done (1.64s): result: NodeOutput
[ComfyUI] [VRAM] After PanoramaWrap: 1481 / 24122 MB
[ComfyUI] [comfy-env] Running PanoramaSplit: split_method: dict, resolution: 952, fov_degrees: 90.0, use_gpu: True, create_masks: False, fname: 'pano_bank', panorama: dict
[ComfyUI] [VRAM] Before PanoramaSplit: 1481 / 24122 MB
[ComfyUI] [SubprocessWorker] call_method: nodes.panorama_split.PanoramaSplit.EXECUTE_NORMALIZED
[ComfyUI] [SubprocessWorker] acquired lock, ensuring started...
[ComfyUI] [ComfyUI-PanoPack] Health check: ping (timeout=5.0s)...
[ComfyUI] [ComfyUI-PanoPack] Health check: ok
[ComfyUI] [SubprocessWorker] worker started/confirmed
[ComfyUI] [SubprocessWorker] serializing kwargs to shm...
[ComfyUI] [SubprocessWorker] created 0 shm blocks
[ComfyUI] [SubprocessWorker] sending request via socket...
[ComfyUI] [SubprocessWorker] call_id=2 sending call_method
[ComfyUI] [worker:ComfyUI-PanoPack] [comfy-env] _from_shm got dict with keys: ['__type__', 'strategy', 'parent_pid', 'fd', 'storage_size']
[ComfyUI] [worker:ComfyUI-PanoPack] [comfy-env] DESERIALIZE TensorRef: tensor_size=[1, 2048, 4096, 3]
[ComfyUI] [worker:ComfyUI-PanoPack] [comfy-env] DESERIALIZED tensor shape: torch.Size([1, 2048, 4096, 3])
[capture-loop] iter=400 t=43.8s state={'complete': False, 'error': None, 'executedCount': 0, 'wsState': 1} eval_ms=1 ram=5.5/31.3GB (18%) swap=1.7/32.0GB (5%) cpu=14% browser_rss=0.93GB
Frame 15 saved (frame_014.jpg, t=44.0s)
[capture-periodic] freeze=1ms shot=98ms unfreeze=5ms saved=True
[ComfyUI] [worker:ComfyUI-PanoPack] [PanoramaSplit] swapped up=[0,1,0] for 2 pole vertices
Frame 16 saved (frame_015.jpg, t=46.1s)
[capture-periodic] freeze=1ms shot=97ms unfreeze=5ms saved=True
[capture-loop] iter=450 t=49.4s state={'complete': False, 'error': None, 'executedCount': 0, 'wsState': 1} eval_ms=2 ram=6.5/31.3GB (21%) swap=1.7/32.0GB (5%) cpu=11% browser_rss=0.93GB
[ComfyUI] [worker:ComfyUI-PanoPack] [VRAM] +290MB (now 290MB) reserved=320MB peak=290MB
[ComfyUI] [worker:ComfyUI-PanoPack] [VRAM] -291MB (now 0MB) reserved=1312MB peak=822MB
[ComfyUI] [worker:ComfyUI-PanoPack] [PanoramaSplit] icosahedron_42: (4096x2048) -> 42 crops @ 952x952, fov=(90,90) via grid_sample (GPU); cameras 1.199s, split 5.180s, total 7.251s
[ComfyUI] [SubprocessWorker] got response: ok
[ComfyUI] [comfy-env] PanoramaSplit done (8.29s): result: NodeOutput
[ComfyUI] [VRAM] After PanoramaSplit: 2855 / 24122 MB
Frame 17 saved (frame_016.jpg, t=52.6s)
[capture-periodic] freeze=1ms shot=88ms unfreeze=6ms saved=True
[ComfyUI] [comfy-env] Running MoGe2Inference: resolution_level: 9, num_tokens: 0, fov_x_deg: 90.0, force_projection: True, apply_mask: True, moge2_model: dict, images: torch.float32 [42,952,952,3] cpu
[ComfyUI] [VRAM] Before MoGe2Inference: 2855 / 24122 MB
[ComfyUI] [SubprocessWorker] call_method: nodes.nodes_inference.MoGe2Inference.EXECUTE_NORMALIZED
[ComfyUI] [SubprocessWorker] acquired lock, ensuring started...
[ComfyUI] [ComfyUI-MoGe2] Health check: ping (timeout=5.0s)...
[ComfyUI] [ComfyUI-MoGe2] Health check: ok
[ComfyUI] [SubprocessWorker] worker started/confirmed
[ComfyUI] [comfy-env] PRE-SERIALIZE 'images' shape: torch.Size([42, 952, 952, 3])
[ComfyUI] [SubprocessWorker] serializing kwargs to shm...
Node executed (1 total), capturing...
[ComfyUI] [SubprocessWorker] created 0 shm blocks
[ComfyUI] [SubprocessWorker] sending request via socket...
[ComfyUI] [SubprocessWorker] call_id=2 sending call_method
[ComfyUI] [worker:ComfyUI-MoGe2] [comfy-env] _from_shm got dict with keys: ['__type__', 'strategy', 'parent_pid', 'fd', 'storage_size']
[ComfyUI] [worker:ComfyUI-MoGe2] [comfy-env] DESERIALIZE TensorRef: tensor_size=[42, 952, 952, 3]
[ComfyUI] [worker:ComfyUI-MoGe2] [comfy-env] DESERIALIZED tensor shape: torch.Size([42, 952, 952, 3])
Frame 18 saved (frame_017.jpg, t=54.6s)
[capture-node] freeze=13ms shot=126ms unfreeze=1ms saved=True
[capture-loop] iter=500 t=55.1s state={'complete': False, 'error': None, 'executedCount': 1, 'wsState': 1} eval_ms=1 ram=7.0/31.3GB (22%) swap=1.7/32.0GB (5%) cpu=14% browser_rss=1.10GB
[capture-loop] iter=550 t=60.4s state={'complete': False, 'error': None, 'executedCount': 1, 'wsState': 1} eval_ms=1 ram=9.0/31.3GB (29%) swap=1.7/32.0GB (5%) cpu=14% browser_rss=1.08GB
[ComfyUI] [SubprocessWorker] callback 'request_vram_budget' from call_id=2
[ComfyUI] [comfy-env] VRAM request: 0.66GB, free before eviction: 22.30GB
[ComfyUI] [comfy-env] VRAM after eviction: 22.30GB
[ComfyUI] [worker:ComfyUI-MoGe2] [VRAM] +216MB (now 216MB) reserved=224MB peak=216MB
[ComfyUI] [SubprocessWorker] callback 'report_progress' from call_id=2
[ComfyUI] [worker:ComfyUI-MoGe2] [VRAM] +455MB (now 671MB) reserved=1600MB peak=782MB
[ComfyUI] [SubprocessWorker] callback 'report_progress' from call_id=2
[ComfyUI] [SubprocessWorker] callback 'report_progress' from call_id=2
[ComfyUI] [SubprocessWorker] callback 'report_progress' from call_id=2
[ComfyUI] [SubprocessWorker] callback 'report_progress' from call_id=2
Frame 19 saved (frame_018.jpg, t=63.3s)
[capture-periodic] freeze=1ms shot=112ms unfreeze=1ms saved=True
[ComfyUI] [SubprocessWorker] callback 'report_progress' from call_id=2
[ComfyUI] [SubprocessWorker] callback 'report_progress' from call_id=2
[ComfyUI] [SubprocessWorker] callback 'report_progress' from call_id=2
[ComfyUI] [SubprocessWorker] callback 'report_progress' from call_id=2
[ComfyUI] [SubprocessWorker] callback 'report_progress' from call_id=2
[ComfyUI] [SubprocessWorker] callback 'report_progress' from call_id=2
[ComfyUI] [SubprocessWorker] callback 'report_progress' from call_id=2
[ComfyUI] [SubprocessWorker] callback 'report_progress' from call_id=2
[ComfyUI] [SubprocessWorker] callback 'report_progress' from call_id=2
[ComfyUI] [SubprocessWorker] callback 'report_progress' from call_id=2
Frame 20 saved (frame_019.jpg, t=65.5s)
[capture-periodic] freeze=1ms shot=96ms unfreeze=10ms saved=True
[ComfyUI] [SubprocessWorker] callback 'report_progress' from call_id=2
[ComfyUI] [SubprocessWorker] callback 'report_progress' from call_id=2
[capture-loop] iter=600 t=66.0s state={'complete': False, 'error': None, 'executedCount': 1, 'wsState': 1} eval_ms=1 ram=9.6/31.3GB (31%) swap=1.7/32.0GB (5%) cpu=14% browser_rss=1.09GB
[ComfyUI] [SubprocessWorker] callback 'report_progress' from call_id=2
[ComfyUI] [SubprocessWorker] callback 'report_progress' from call_id=2
[ComfyUI] [SubprocessWorker] callback 'report_progress' from call_id=2
[ComfyUI] [SubprocessWorker] callback 'report_progress' from call_id=2
[ComfyUI] [SubprocessWorker] callback 'report_progress' from call_id=2
[ComfyUI] [SubprocessWorker] callback 'report_progress' from call_id=2
[ComfyUI] [SubprocessWorker] callback 'report_progress' from call_id=2
Frame 21 saved (frame_020.jpg, t=67.8s)
[capture-periodic] freeze=1ms shot=86ms unfreeze=1ms saved=True
[ComfyUI] [SubprocessWorker] callback 'report_progress' from call_id=2
[ComfyUI] [SubprocessWorker] callback 'report_progress' from call_id=2
[ComfyUI] [SubprocessWorker] callback 'report_progress' from call_id=2
[ComfyUI] [worker:ComfyUI-MoGe2] [VRAM] +239MB (now 911MB) reserved=1632MB peak=911MB
[ComfyUI] [SubprocessWorker] callback 'report_progress' from call_id=2
[ComfyUI] [SubprocessWorker] callback 'report_progress' from call_id=2
[ComfyUI] [SubprocessWorker] callback 'report_progress' from call_id=2
[ComfyUI] [worker:ComfyUI-MoGe2] [VRAM] -240MB (now 671MB) reserved=1632MB peak=911MB
[ComfyUI] [SubprocessWorker] callback 'report_progress' from call_id=2
[ComfyUI] [SubprocessWorker] callback 'report_progress' from call_id=2
Frame 22 saved (frame_021.jpg, t=69.9s)
[capture-periodic] freeze=1ms shot=89ms unfreeze=6ms saved=True
[ComfyUI] [SubprocessWorker] callback 'report_progress' from call_id=2
[ComfyUI] [SubprocessWorker] callback 'report_progress' from call_id=2
[ComfyUI] [SubprocessWorker] callback 'report_progress' from call_id=2
[ComfyUI] [SubprocessWorker] callback 'report_progress' from call_id=2
[ComfyUI] [SubprocessWorker] callback 'report_progress' from call_id=2
[capture-loop] iter=650 t=71.4s state={'complete': False, 'error': None, 'executedCount': 1, 'wsState': 1} eval_ms=2 ram=10.6/31.3GB (34%) swap=1.7/32.0GB (5%) cpu=13% browser_rss=1.13GB
[ComfyUI] [SubprocessWorker] callback 'report_progress' from call_id=2
[ComfyUI] [SubprocessWorker] callback 'report_progress' from call_id=2
[ComfyUI] [SubprocessWorker] callback 'report_progress' from call_id=2
Frame 23 saved (frame_022.jpg, t=72.2s)
[capture-periodic] freeze=1ms shot=97ms unfreeze=7ms saved=True
[ComfyUI] [SubprocessWorker] callback 'report_progress' from call_id=2
[ComfyUI] [SubprocessWorker] callback 'report_progress' from call_id=2
Frame 24 saved (frame_023.jpg, t=74.3s)
[capture-periodic] freeze=1ms shot=93ms unfreeze=6ms saved=True
[ComfyUI] [SubprocessWorker] got response: ok
[ComfyUI] [comfy-env] Created 1 model patchers: ['MoGeWrapper_1']
[ComfyUI] [comfy-env] MoGe2Inference done (21.24s): result: NodeOutput
[ComfyUI] [VRAM] After MoGe2Inference: 4605 / 24122 MB
[ComfyUI] [VRAM] Loaded: SubprocessModel (631 MB)
Frame 25 saved (frame_024.jpg, t=76.5s)
[capture-periodic] freeze=1ms shot=102ms unfreeze=5ms saved=True
[ComfyUI] [comfy-env] Running PanoramaDepthMerge: out_width: 4096, out_height: 2048, use_gpu: True, scale_anchor: False, chunk_size: 8, center_weight_power: 2.0, normal_edge_threshold_deg: 0.0, normal_consistency_boost: False, max_ray_distance_m: 0.0, face_points: torch.float32 [42,952,952,3] cpu, extrinsics: torch.float32 [42,4,4] cpu, intrinsics: torch.float32 [42,3,3] cpu, face_valid_masks: torch.float32 [42,952,952] cpu, face_normals: torch.float32 [42,952,952,3] cpu
[ComfyUI] [VRAM] Before PanoramaDepthMerge: 4605 / 24122 MB
[ComfyUI] [VRAM] Loaded: SubprocessModel (631 MB)
[ComfyUI] [SubprocessWorker] call_method: nodes.depth_merge.PanoramaDepthMerge.EXECUTE_NORMALIZED
[ComfyUI] [SubprocessWorker] acquired lock, ensuring started...
[ComfyUI] [ComfyUI-PanoPack] Health check: ping (timeout=5.0s)...
[ComfyUI] [ComfyUI-PanoPack] Health check: ok
[ComfyUI] [SubprocessWorker] worker started/confirmed
[ComfyUI] [comfy-env] PRE-SERIALIZE 'face_points' shape: torch.Size([42, 952, 952, 3])
[ComfyUI] [comfy-env] PRE-SERIALIZE 'extrinsics' shape: torch.Size([42, 4, 4])
[ComfyUI] [comfy-env] PRE-SERIALIZE 'intrinsics' shape: torch.Size([42, 3, 3])
[ComfyUI] [comfy-env] PRE-SERIALIZE 'face_valid_masks' shape: torch.Size([42, 952, 952])
[ComfyUI] [comfy-env] PRE-SERIALIZE 'face_normals' shape: torch.Size([42, 952, 952, 3])
[ComfyUI] [SubprocessWorker] serializing kwargs to shm...
Node executed (2 total), capturing...
Frame 26 saved (frame_025.jpg, t=76.9s)
[capture-node] freeze=1ms shot=104ms unfreeze=1ms saved=True
[ComfyUI] [SubprocessWorker] created 0 shm blocks
[ComfyUI] [SubprocessWorker] sending request via socket...
[ComfyUI] [SubprocessWorker] call_id=3 sending call_method
[ComfyUI] [worker:ComfyUI-PanoPack] [comfy-env] _from_shm got dict with keys: ['__type__', 'strategy', 'parent_pid', 'fd', 'storage_size']
[ComfyUI] [worker:ComfyUI-PanoPack] [comfy-env] DESERIALIZE TensorRef: tensor_size=[42, 952, 952, 3]
[ComfyUI] [worker:ComfyUI-PanoPack] [comfy-env] DESERIALIZED tensor shape: torch.Size([42, 952, 952, 3])
[ComfyUI] [worker:ComfyUI-PanoPack] [comfy-env] _from_shm got dict with keys: ['__type__', 'strategy', 'parent_pid', 'fd', 'storage_size']
[ComfyUI] [worker:ComfyUI-PanoPack] [comfy-env] DESERIALIZE TensorRef: tensor_size=[42, 4, 4]
[ComfyUI] [worker:ComfyUI-PanoPack] [comfy-env] DESERIALIZED tensor shape: torch.Size([42, 4, 4])
[ComfyUI] [worker:ComfyUI-PanoPack] [comfy-env] _from_shm got dict with keys: ['__type__', 'strategy', 'parent_pid', 'fd', 'storage_size']
[ComfyUI] [worker:ComfyUI-PanoPack] [comfy-env] DESERIALIZE TensorRef: tensor_size=[42, 3, 3]
[ComfyUI] [worker:ComfyUI-PanoPack] [comfy-env] DESERIALIZED tensor shape: torch.Size([42, 3, 3])
[ComfyUI] [worker:ComfyUI-PanoPack] [comfy-env] _from_shm got dict with keys: ['__type__', 'strategy', 'parent_pid', 'fd', 'storage_size']
[ComfyUI] [worker:ComfyUI-PanoPack] [comfy-env] DESERIALIZE TensorRef: tensor_size=[42, 952, 952]
[ComfyUI] [worker:ComfyUI-PanoPack] [comfy-env] DESERIALIZED tensor shape: torch.Size([42, 952, 952])
[ComfyUI] [worker:ComfyUI-PanoPack] [comfy-env] _from_shm got dict with keys: ['__type__', 'strategy', 'parent_pid', 'fd', 'storage_size']
[capture-loop] iter=700 t=77.3s state={'complete': False, 'error': None, 'executedCount': 2, 'wsState': 1} eval_ms=2 ram=13.6/31.3GB (44%) swap=1.7/32.0GB (5%) cpu=15% browser_rss=1.19GB
[ComfyUI] [worker:ComfyUI-PanoPack] [comfy-env] DESERIALIZE TensorRef: tensor_size=[42, 952, 952, 3]
[ComfyUI] [worker:ComfyUI-PanoPack] [comfy-env] DESERIALIZED tensor shape: torch.Size([42, 952, 952, 3])
Frame 27 saved (frame_026.jpg, t=79.1s)
[capture-periodic] freeze=1ms shot=100ms unfreeze=5ms saved=True
[capture-loop] iter=750 t=82.7s state={'complete': False, 'error': None, 'executedCount': 2, 'wsState': 1} eval_ms=2 ram=15.4/31.3GB (49%) swap=1.7/32.0GB (5%) cpu=14% browser_rss=1.18GB
[capture-loop] iter=800 t=88.2s state={'complete': False, 'error': None, 'executedCount': 2, 'wsState': 1} eval_ms=1 ram=15.5/31.3GB (50%) swap=1.7/32.0GB (5%) cpu=20% browser_rss=1.10GB
[capture-loop] iter=850 t=93.6s state={'complete': False, 'error': None, 'executedCount': 2, 'wsState': 1} eval_ms=2 ram=15.3/31.3GB (49%) swap=1.7/32.0GB (5%) cpu=21% browser_rss=1.10GB
[capture-loop] iter=900 t=99.2s state={'complete': False, 'error': None, 'executedCount': 2, 'wsState': 1} eval_ms=3 ram=15.5/31.3GB (50%) swap=1.7/32.0GB (5%) cpu=20% browser_rss=1.10GB
[ComfyUI] [worker:ComfyUI-PanoPack] [PanoramaDepthMerge] normals merged: 2048x4096
[ComfyUI] [worker:ComfyUI-PanoPack] [PanoramaDepthMerge] merging 42 faces @ 952x952 -> equirect 2048x4096 (use_gpu=True); input = points (||.|| -> ray distance)
[ComfyUI] [SubprocessWorker] callback 'report_progress' from call_id=3
[ComfyUI] [worker:ComfyUI-PanoPack] [PanoramaDepthMerge] top-level peak VRAM estimate: 3.46 GB (4096x2048, N=42, chunk_size=8)
[ComfyUI] [SubprocessWorker] callback 'request_vram_budget' from call_id=3
[ComfyUI] [comfy-env] VRAM request: 3.46GB, free before eviction: 20.47GB
[ComfyUI] [comfy-env] VRAM after eviction: 20.47GB
[ComfyUI] [worker:ComfyUI-PanoPack] [PanoramaDepthMerge] -> requested 3.46 GB eviction via comfy_worker.call_parent
[ComfyUI] [worker:ComfyUI-PanoPack] [VRAM] +436MB (now 436MB) reserved=608MB peak=822MB
[ComfyUI] /workspaces/Sharp-1914/ComfyUI/custom_nodes/ComfyUI-PanoPack/nodes/_vendor/worldgen/src/panorama_utils.py:349: UserWarning: Sparse CSR tensor support is in beta state. If you miss a functionality in the sparse tensor support, please submit a feature request to https://github.com/pytorch/pytorch/issues. (Triggered internally at /pytorch/aten/src/ATen/SparseCsrTensorImpl.cpp:49.)
[ComfyUI] A_gpu = torch.sparse_csr_tensor(
[ComfyUI] [worker:ComfyUI-PanoPack] [merge_panorama_depth_gpu 256x128 ] done 0.52s (warp 0.29, build 0.01, LSMR 0.22); N=42 K=8 chunks=6; depth min/med/max = 0.384/0.945/3.091; valid 32768/32768
[ComfyUI] [worker:ComfyUI-PanoPack] [merge_panorama_depth_gpu 512x256 ] done 0.71s (warp 0.08, build 0.02, LSMR 0.07); N=42 K=8 chunks=6; depth min/med/max = 0.384/0.945/3.094; valid 131072/131072
Frame 28 saved (frame_027.jpg, t=101.0s)
[capture-periodic] freeze=1ms shot=101ms unfreeze=6ms saved=True
[ComfyUI] [worker:ComfyUI-PanoPack] [merge_panorama_depth_gpu 1024x512 ] done 1.04s (warp 0.10, build 0.06, LSMR 0.14); N=42 K=8 chunks=6; depth min/med/max = 0.384/0.945/3.094; valid 524288/524288
[ComfyUI] [worker:ComfyUI-PanoPack] [VRAM] -259MB (now 177MB) reserved=224MB peak=822MB
[ComfyUI] [worker:ComfyUI-PanoPack]
[ComfyUI] === WATCHDOG TICK 1 ===
[ComfyUI] [worker:ComfyUI-PanoPack] Thread 0x0000757e127ff640 (most recent call first):
[ComfyUI] File "/tmp/comfytest-home/.ce/.pixi/envs/panopack-nodes/lib/python3.10/socket.py", line 293 in accept
[ComfyUI] File "/tmp/comfytest-home/.ce/.pixi/envs/panopack-nodes/lib/python3.10/multiprocessing/connection.py", line 609 in accept
[ComfyUI] File "/tmp/comfytest-home/.ce/.pixi/envs/panopack-nodes/lib/python3.10/multiprocessing/connection.py", line 463 in accept
[ComfyUI] File "/tmp/comfytest-home/.ce/.pixi/envs/panopack-nodes/lib/python3.10/multiprocessing/resource_sharer.py", line 138 in _serve
[ComfyUI] File "/tmp/comfytest-home/.ce/.pixi/envs/panopack-nodes/lib/python3.10/threading.py", line 953 in run
[ComfyUI] File "/tmp/comfytest-home/.ce/.pixi/envs/panopack-nodes/lib/python3.10/threading.py", line 1016 in _bootstrap_inner
[ComfyUI] File "/tmp/comfytest-home/.ce/.pixi/envs/panopack-nodes/lib/python3.10/threading.py", line 973 in _bootstrap
[ComfyUI]
[ComfyUI] Thread 0x0000757ff35a0640 (most recent call first):
[ComfyUI] File "/tmp/comfyui_pvenv_0kgugsfd/persistent_worker.py", line 106 in _vram_poller
[ComfyUI] File "/tmp/comfytest-home/.ce/.pixi/envs/panopack-nodes/lib/python3.10/threading.py", line 953 in run
[ComfyUI] File "/tmp/comfytest-home/.ce/.pixi/envs/panopack-nodes/lib/python3.10/threading.py", line 1016 in _bootstrap_inner
[ComfyUI] File "/tmp/comfytest-home/.ce/.pixi/envs/panopack-nodes/lib/python3.10/threading.py", line 973 in _bootstrap
[ComfyUI]
[ComfyUI] Current thread 0x0000757ff3da1640 (most recent call first):
[ComfyUI] File "/tmp/comfyui_pvenv_0kgugsfd/persistent_worker.py", line 52 in _watchdog
[ComfyUI] File "/tmp/comfytest-home/.ce/.pixi/envs/panopack-nodes/lib/python3.10/threading.py", line 953 in run
[ComfyUI] File "/tmp/comfytest-home/.ce/.pixi/envs/panopack-nodes/lib/python3.10/threading.py", line 1016 in _bootstrap_inner
[ComfyUI] File "/tmp/comfytest-home/.ce/.pixi/envs/panopack-nodes/lib/python3.10/threading.py", line 973 in _bootstrap
[ComfyUI]
[ComfyUI] Thread 0x0000757ff4377740 (most recent call first):
[ComfyUI] File "/workspaces/Sharp-1914/ComfyUI/custom_nodes/ComfyUI-PanoPack/nodes/_vendor/worldgen/src/panorama_utils.py", line 834 in merge_panorama_depth_gpu
[ComfyUI] File "/workspaces/Sharp-1914/ComfyUI/custom_nodes/ComfyUI-PanoPack/nodes/_vendor/worldgen/src/panorama_utils.py", line 550 in merge_panorama_depth_gpu
[ComfyUI] File "/workspaces/Sharp-1914/ComfyUI/custom_nodes/ComfyUI-PanoPack/nodes/depth_merge.py", line 953 in execute
[ComfyUI] File "/workspaces/Sharp-1914/ComfyUI/comfy_api/latest/_io.py", line 1892 in EXECUTE_NORMALIZED
[ComfyUI] File "/tmp/comfyui_pvenv_0kgugsfd/persistent_worker.py", line 1762 in main
[ComfyUI] File "/tmp/comfyui_pvenv_0kgugsfd/persistent_worker.py", line 1807 in <module>
[ComfyUI]
[ComfyUI] [worker:ComfyUI-PanoPack] === END ===
[ComfyUI]
[ComfyUI] [worker:ComfyUI-PanoPack] [merge_panorama_depth_gpu 2048x1024] done 2.05s (warp 0.20, build 0.25, LSMR 0.51); N=42 K=8 chunks=6; depth min/med/max = 0.384/0.945/3.095; valid 2097152/2097152
[ComfyUI] [worker:ComfyUI-PanoPack] [VRAM] +682MB (now 859MB) reserved=4960MB peak=859MB
[ComfyUI] [worker:ComfyUI-PanoPack] [VRAM] -562MB (now 298MB) reserved=416MB peak=859MB
[capture-loop] iter=950 t=104.6s state={'complete': False, 'error': None, 'executedCount': 2, 'wsState': 1} eval_ms=1 ram=16.7/31.3GB (53%) swap=1.7/32.0GB (5%) cpu=13% browser_rss=1.11GB
[ComfyUI] [worker:ComfyUI-PanoPack] [VRAM] +671MB (now 970MB) reserved=1088MB peak=970MB
[ComfyUI] [worker:ComfyUI-PanoPack] [VRAM] +319MB (now 1290MB) reserved=1376MB peak=1290MB
[ComfyUI] [worker:ComfyUI-PanoPack] [merge_panorama_depth_gpu 4096x2048] done 8.27s (warp 0.58, build 3.18, LSMR 2.26); N=42 K=8 chunks=6; depth min/med/max = 0.384/0.945/3.094; valid 8388608/8388608
[ComfyUI] [worker:ComfyUI-PanoPack] [VRAM] -1283MB (now 8MB) reserved=2176MB peak=1898MB
[ComfyUI] [worker:ComfyUI-PanoPack] [PanoramaDepthMerge] merged depth: shape (2048, 4096), min=0.384, median=0.945, max=3.094; valid pixels: 8388608 / 8388608
[capture-loop] iter=1000 t=110.1s state={'complete': False, 'error': None, 'executedCount': 2, 'wsState': 1} eval_ms=2 ram=16.1/31.3GB (51%) swap=1.7/32.0GB (5%) cpu=12% browser_rss=1.11GB
[capture-loop] iter=1050 t=115.5s state={'complete': False, 'error': None, 'executedCount': 2, 'wsState': 1} eval_ms=2 ram=16.2/31.3GB (52%) swap=1.7/32.0GB (5%) cpu=17% browser_rss=1.11GB
[capture-loop] iter=1100 t=121.0s state={'complete': False, 'error': None, 'executedCount': 2, 'wsState': 1} eval_ms=2 ram=16.1/31.3GB (52%) swap=1.7/32.0GB (5%) cpu=17% browser_rss=1.11GB
[ComfyUI] [worker:ComfyUI-PanoPack] [PanoramaDepthMerge] debug_image: H=2048+102, mult_disagreement (log-d, sphere-uniform): mean=11.22%, p99=24.69%, max=28.22%; overlap_pixels=8388608
[ComfyUI] [worker:ComfyUI-PanoPack] [headless_gl] prefix=/tmp/comfytest-home/.ce/.pixi/envs/panopack-nodes
[ComfyUI] [worker:ComfyUI-PanoPack] [headless_gl] OSMesa: ['libOSMesa.so', 'libOSMesa.so.8', 'libOSMesa.so.8.0.0']
[ComfyUI] [worker:ComfyUI-PanoPack] [headless_gl] env: VTK_DEFAULT_OPENGL_WINDOW=vtkOSOpenGLRenderWindow PYVISTA_OFF_SCREEN=true
[ComfyUI] [worker:ComfyUI-PanoPack] [PanoramaDepthMerge] xyz_views: cloud bbox center=(-0.79, -0.31, +0.03) m, size=(4.27 x 3.57 x 1.96) m, N=80000 (subsampled)
[ComfyUI] [worker:ComfyUI-PanoPack] [PanoramaDepthMerge] points: merged equirect point map (1, 2048, 4096, 3)
[ComfyUI] [SubprocessWorker] callback 'report_progress' from call_id=3
[capture-loop] iter=1150 t=126.4s state={'complete': False, 'error': None, 'executedCount': 2, 'wsState': 1} eval_ms=2 ram=15.3/31.3GB (49%) swap=1.7/32.0GB (5%) cpu=14% browser_rss=1.11GB
[ComfyUI] [SubprocessWorker] got response: ok
[ComfyUI] [comfy-env] PanoramaDepthMerge done (49.81s): result: NodeOutput
[ComfyUI] [VRAM] After PanoramaDepthMerge: 3335 / 24122 MB
[ComfyUI] [VRAM] Loaded: SubprocessModel (631 MB)
[ComfyUI] [comfy-env] Running PanoramaSplitAdaptive: split_method: 'icosahedron_42', resolution: 1536, fov_degrees: 90.0, use_gpu: True, create_masks: True, mask_method: 'closest_to', panorama: dict, depth_panorama: torch.float32 [1,2048,4096,3] cpu, normals_panorama: torch.float32 [1,2048,4096,3] cpu
[ComfyUI] [VRAM] Before PanoramaSplitAdaptive: 3335 / 24122 MB
[ComfyUI] [VRAM] Loaded: SubprocessModel (631 MB)
[ComfyUI] [SubprocessWorker] call_method: nodes.panorama_split_adaptive.PanoramaSplitAdaptive.EXECUTE_NORMALIZED
[ComfyUI] [SubprocessWorker] acquired lock, ensuring started...
[ComfyUI] [ComfyUI-PanoPack] Health check: ping (timeout=5.0s)...
[ComfyUI] [ComfyUI-PanoPack] Health check: ok
[ComfyUI] [SubprocessWorker] worker started/confirmed
[ComfyUI] [comfy-env] PRE-SERIALIZE 'depth_panorama' shape: torch.Size([1, 2048, 4096, 3])
[ComfyUI] [comfy-env] PRE-SERIALIZE 'normals_panorama' shape: torch.Size([1, 2048, 4096, 3])
[ComfyUI] [SubprocessWorker] serializing kwargs to shm...
Node executed (3 total), capturing...
[ComfyUI] [SubprocessWorker] created 0 shm blocks
[ComfyUI] [SubprocessWorker] sending request via socket...
[ComfyUI] [SubprocessWorker] call_id=4 sending call_method
[ComfyUI] [worker:ComfyUI-PanoPack] [comfy-env] _from_shm got dict with keys: ['__type__', 'strategy', 'parent_pid', 'fd', 'storage_size']
[ComfyUI] [worker:ComfyUI-PanoPack] [comfy-env] DESERIALIZE TensorRef: tensor_size=[1, 2048, 4096, 3]
[ComfyUI] [worker:ComfyUI-PanoPack] [comfy-env] DESERIALIZED tensor shape: torch.Size([1, 2048, 4096, 3])
[ComfyUI] [worker:ComfyUI-PanoPack] [comfy-env] _from_shm got dict with keys: ['__type__', 'strategy', 'parent_pid', 'fd', 'storage_size']
[ComfyUI] [worker:ComfyUI-PanoPack] [comfy-env] DESERIALIZE TensorRef: tensor_size=[1, 2048, 4096, 3]
[ComfyUI] [worker:ComfyUI-PanoPack] [comfy-env] DESERIALIZED tensor shape: torch.Size([1, 2048, 4096, 3])
[ComfyUI] [worker:ComfyUI-PanoPack] [comfy-env] _from_shm got dict with keys: ['__type__', 'strategy', 'parent_pid', 'fd', 'storage_size']
[ComfyUI] [worker:ComfyUI-PanoPack] [comfy-env] DESERIALIZE TensorRef: tensor_size=[1, 2048, 4096, 3]
[ComfyUI] [worker:ComfyUI-PanoPack] [comfy-env] DESERIALIZED tensor shape: torch.Size([1, 2048, 4096, 3])
Frame 29 saved (frame_028.jpg, t=127.0s)
[capture-node] freeze=2ms shot=105ms unfreeze=5ms saved=True
[ComfyUI] [worker:ComfyUI-PanoPack] [PanoramaSplitAdaptive] computing area weights from depth (2048x4096) + normals...
[ComfyUI] [worker:ComfyUI-PanoPack] [PanoramaSplitAdaptive] weight range: [1.06, 131], mean=11.7
[ComfyUI] [worker:ComfyUI-PanoPack] [PanoramaSplitAdaptive] adaptive relax: icosahedron_42 (42 cameras), weighted Lloyd...
[capture-loop] iter=1200 t=132.1s state={'complete': False, 'error': None, 'executedCount': 3, 'wsState': 1} eval_ms=2 ram=16.2/31.3GB (52%) swap=1.7/32.0GB (5%) cpu=12% browser_rss=1.12GB
[capture-loop] iter=1250 t=137.4s state={'complete': False, 'error': None, 'executedCount': 3, 'wsState': 1} eval_ms=2 ram=16.1/31.3GB (52%) swap=1.7/32.0GB (5%) cpu=11% browser_rss=1.12GB
[capture-loop] iter=1300 t=142.9s state={'complete': False, 'error': None, 'executedCount': 3, 'wsState': 1} eval_ms=2 ram=16.3/31.3GB (52%) swap=1.7/32.0GB (5%) cpu=12% browser_rss=1.12GB
[capture-loop] iter=1350 t=148.3s state={'complete': False, 'error': None, 'executedCount': 3, 'wsState': 1} eval_ms=1 ram=16.5/31.3GB (53%) swap=1.7/32.0GB (5%) cpu=11% browser_rss=1.12GB
[ComfyUI] [worker:ComfyUI-PanoPack] [PanoramaSplitAdaptive] Lloyd ran 24 iters (max move 1.42e-02)
[ComfyUI] [worker:ComfyUI-PanoPack] [PanoramaSplitAdaptive] Lloyd relaxation done: 42 camera directions in 25.326s
[ComfyUI] [worker:ComfyUI-PanoPack] [PanoramaSplitAdaptive] rasterizing 42 faces @ 1536x1536...
[capture-loop] iter=1400 t=153.8s state={'complete': False, 'error': None, 'executedCount': 3, 'wsState': 1} eval_ms=2 ram=16.0/31.3GB (51%) swap=1.7/32.0GB (5%) cpu=13% browser_rss=1.12GB
[capture-loop] iter=1450 t=159.2s state={'complete': False, 'error': None, 'executedCount': 3, 'wsState': 1} eval_ms=2 ram=16.3/31.3GB (52%) swap=1.7/32.0GB (5%) cpu=11% browser_rss=1.12GB
[ComfyUI] [worker:ComfyUI-PanoPack] [VRAM] +756MB (now 764MB) reserved=800MB peak=1898MB
[ComfyUI] [worker:ComfyUI-PanoPack] [VRAM] +1230MB (now 1994MB) reserved=3168MB peak=1994MB
[ComfyUI] [worker:ComfyUI-PanoPack]
[ComfyUI] === WATCHDOG TICK 2 ===
[ComfyUI] [worker:ComfyUI-PanoPack] Thread 0x0000757e127ff640 (most recent call first):
[ComfyUI] File "/tmp/comfytest-home/.ce/.pixi/envs/panopack-nodes/lib/python3.10/socket.py", line 293 in accept
[ComfyUI] File "/tmp/comfytest-home/.ce/.pixi/envs/panopack-nodes/lib/python3.10/multiprocessing/connection.py", line 609 in accept
[ComfyUI] File "/tmp/comfytest-home/.ce/.pixi/envs/panopack-nodes/lib/python3.10/multiprocessing/connection.py", line 463 in accept
[ComfyUI] File "/tmp/comfytest-home/.ce/.pixi/envs/panopack-nodes/lib/python3.10/multiprocessing/resource_sharer.py", line 138 in _serve
[ComfyUI] File "/tmp/comfytest-home/.ce/.pixi/envs/panopack-nodes/lib/python3.10/threading.py", line 953 in run
[ComfyUI] File "/tmp/comfytest-home/.ce/.pixi/envs/panopack-nodes/lib/python3.10/threading.py", line 1016 in _bootstrap_inner
[ComfyUI] File "/tmp/comfytest-home/.ce/.pixi/envs/panopack-nodes/lib/python3.10/threading.py", line 973 in _bootstrap
[ComfyUI]
[ComfyUI] Thread 0x0000757ff35a0640 (most recent call first):
[ComfyUI] File "/tmp/comfyui_pvenv_0kgugsfd/persistent_worker.py", line 106 in _vram_poller
[ComfyUI] File "/tmp/comfytest-home/.ce/.pixi/envs/panopack-nodes/lib/python3.10/threading.py", line 953 in run
[ComfyUI] File "/tmp/comfytest-home/.ce/.pixi/envs/panopack-nodes/lib/python3.10/threading.py", line 1016 in _bootstrap_inner
[ComfyUI] File "/tmp/comfytest-home/.ce/.pixi/envs/panopack-nodes/lib/python3.10/threading.py", line 973 in _bootstrap
[ComfyUI]
[ComfyUI] Current thread 0x0000757ff3da1640 (most recent call first):
[ComfyUI] File "/tmp/comfyui_pvenv_0kgugsfd/persistent_worker.py", line 52 in _watchdog
[ComfyUI] File "/tmp/comfytest-home/.ce/.pixi/envs/panopack-nodes/lib/python3.10/threading.py", line 953 in run
[ComfyUI] File "/tmp/comfytest-home/.ce/.pixi/envs/panopack-nodes/lib/python3.10/threading.py", line 1016 in _bootstrap_inner
[ComfyUI] File "/tmp/comfytest-home/.ce/.pixi/envs/panopack-nodes/lib/python3.10/threading.py", line 973 in _bootstrap
[ComfyUI]
[ComfyUI] Thread 0x0000757ff4377740 (most recent call first):
[ComfyUI] File "/workspaces/Sharp-1914/ComfyUI/custom_nodes/ComfyUI-PanoPack/nodes/panorama_split_adaptive.py", line 439 in execute
[ComfyUI] File "/workspaces/Sharp-1914/ComfyUI/comfy_api/latest/_io.py", line 1892 in EXECUTE_NORMALIZED
[ComfyUI] File "/tmp/comfyui_pvenv_0kgugsfd/persistent_worker.py", line 1762 in main
[ComfyUI] File "/tmp/comfyui_pvenv_0kgugsfd/persistent_worker.py", line 1807 in <module>
[ComfyUI]
[ComfyUI] [worker:ComfyUI-PanoPack] === END ===
[ComfyUI]
[ComfyUI] [worker:ComfyUI-PanoPack] [VRAM] -1986MB (now 8MB) reserved=3168MB peak=1994MB
[ComfyUI] [worker:ComfyUI-PanoPack] [PanoramaSplitAdaptive] rasterized RGB in 10.315s (GPU)
[ComfyUI] [worker:ComfyUI-PanoPack] [PanoramaSplitAdaptive] rasterizing depth crops...
[capture-loop] iter=1500 t=164.6s state={'complete': False, 'error': None, 'executedCount': 3, 'wsState': 1} eval_ms=1 ram=17.8/31.3GB (57%) swap=1.7/32.0GB (5%) cpu=12% browser_rss=1.12GB
[capture-loop] iter=1550 t=170.0s state={'complete': False, 'error': None, 'executedCount': 3, 'wsState': 1} eval_ms=1 ram=18.3/31.3GB (59%) swap=1.7/32.0GB (5%) cpu=11% browser_rss=1.12GB
[ComfyUI] [worker:ComfyUI-PanoPack] [VRAM] +756MB (now 764MB) reserved=3168MB peak=1994MB
[ComfyUI] [worker:ComfyUI-PanoPack] [VRAM] +1230MB (now 1994MB) reserved=3264MB peak=1994MB
[ComfyUI] [worker:ComfyUI-PanoPack] [VRAM] -1986MB (now 8MB) reserved=3264MB peak=1994MB
[capture-loop] iter=1600 t=175.5s state={'complete': False, 'error': None, 'executedCount': 3, 'wsState': 1} eval_ms=2 ram=20.8/31.3GB (67%) swap=1.7/32.0GB (5%) cpu=12% browser_rss=1.13GB
[ComfyUI] [worker:ComfyUI-PanoPack] [PanoramaSplitAdaptive] rasterizing normals crops...
[capture-loop] iter=1650 t=180.8s state={'complete': False, 'error': None, 'executedCount': 3, 'wsState': 1} eval_ms=2 ram=20.4/31.3GB (65%) swap=1.7/32.0GB (5%) cpu=11% browser_rss=1.13GB
[ComfyUI] [worker:ComfyUI-PanoPack] [VRAM] +756MB (now 764MB) reserved=3264MB peak=1994MB
[capture-loop] iter=1700 t=186.3s state={'complete': False, 'error': None, 'executedCount': 3, 'wsState': 1} eval_ms=1 ram=23.0/31.3GB (74%) swap=1.7/32.0GB (5%) cpu=12% browser_rss=1.13GB
[ComfyUI] [worker:ComfyUI-PanoPack] [VRAM] +1230MB (now 1994MB) reserved=3264MB peak=1994MB
[ComfyUI] [worker:ComfyUI-PanoPack] [VRAM] -1986MB (now 8MB) reserved=3264MB peak=1994MB
[ComfyUI] [worker:ComfyUI-PanoPack] [PanoramaSplitAdaptive] generating closest_to masks...
[capture-loop] iter=1750 t=191.6s state={'complete': False, 'error': None, 'executedCount': 3, 'wsState': 1} eval_ms=1 ram=23.0/31.3GB (74%) swap=1.7/32.0GB (5%) cpu=11% browser_rss=1.13GB
[capture-loop] iter=1800 t=197.1s state={'complete': False, 'error': None, 'executedCount': 3, 'wsState': 1} eval_ms=2 ram=23.1/31.3GB (74%) swap=1.7/32.0GB (5%) cpu=11% browser_rss=1.13GB
[capture-loop] iter=1850 t=202.4s state={'complete': False, 'error': None, 'executedCount': 3, 'wsState': 1} eval_ms=1 ram=22.9/31.3GB (73%) swap=1.7/32.0GB (5%) cpu=11% browser_rss=1.13GB
[capture-loop] iter=1900 t=207.9s state={'complete': False, 'error': None, 'executedCount': 3, 'wsState': 1} eval_ms=1 ram=23.2/31.3GB (74%) swap=1.7/32.0GB (5%) cpu=11% browser_rss=1.13GB
[capture-loop] iter=1950 t=213.2s state={'complete': False, 'error': None, 'executedCount': 3, 'wsState': 1} eval_ms=1 ram=22.9/31.3GB (73%) swap=1.7/32.0GB (5%) cpu=12% browser_rss=1.12GB
[ComfyUI] [worker:ComfyUI-PanoPack] [PanoramaSplitAdaptive] generating debug_masks equirect image...
[capture-loop] iter=2000 t=218.7s state={'complete': False, 'error': None, 'executedCount': 3, 'wsState': 1} eval_ms=2 ram=24.5/31.3GB (78%) swap=1.8/32.0GB (6%) cpu=13% browser_rss=1.12GB
[ComfyUI] [worker:ComfyUI-PanoPack] [PanoramaSplitAdaptive] pixels/area: lowest 0.243 -> 0.336 (+38% on the worst-sampled cell), highest 6.44 -> 2.85; spread max/min 26.5x -> 8.5x
[ComfyUI] [worker:ComfyUI-PanoPack] [PanoramaSplitAdaptive] done: 42 adaptive faces, 94.124s total
[ComfyUI] [worker:ComfyUI-PanoPack]
[ComfyUI] === WATCHDOG TICK 3 ===
[ComfyUI] [worker:ComfyUI-PanoPack] Thread 0x0000757e127ff640 (most recent call first):
[ComfyUI] File "/tmp/comfytest-home/.ce/.pixi/envs/panopack-nodes/lib/python3.10/socket.py", line 293 in accept
[ComfyUI] File "/tmp/comfytest-home/.ce/.pixi/envs/panopack-nodes/lib/python3.10/multiprocessing/connection.py", line 609 in accept
[ComfyUI] File "/tmp/comfytest-home/.ce/.pixi/envs/panopack-nodes/lib/python3.10/multiprocessing/connection.py", line 463 in accept
[ComfyUI] File "/tmp/comfytest-home/.ce/.pixi/envs/panopack-nodes/lib/python3.10/multiprocessing/resource_sharer.py", line 138 in _serve
[ComfyUI] File "/tmp/comfytest-home/.ce/.pixi/envs/panopack-nodes/lib/python3.10/threading.py", line 953 in run
[ComfyUI] File "/tmp/comfytest-home/.ce/.pixi/envs/panopack-nodes/lib/python3.10/threading.py", line 1016 in _bootstrap_inner
[ComfyUI] File "/tmp/comfytest-home/.ce/.pixi/envs/panopack-nodes/lib/python3.10/threading.py", line 973 in _bootstrap
[ComfyUI]
[ComfyUI] Thread 0x0000757ff35a0640 (most recent call first):
[ComfyUI] File "/tmp/comfyui_pvenv_0kgugsfd/persistent_worker.py", line 106 in _vram_poller
[ComfyUI] File "/tmp/comfytest-home/.ce/.pixi/envs/panopack-nodes/lib/python3.10/threading.py", line 953 in run
[ComfyUI] File "/tmp/comfytest-home/.ce/.pixi/envs/panopack-nodes/lib/python3.10/threading.py", line 1016 in _bootstrap_inner
[ComfyUI] File "/tmp/comfytest-home/.ce/.pixi/envs/panopack-nodes/lib/python3.10/threading.py", line 973 in _bootstrap
[ComfyUI]
[ComfyUI] Current thread 0x0000757ff3da1640 (most recent call first):
[ComfyUI] File "/tmp/comfyui_pvenv_0kgugsfd/persistent_worker.py", line 52 in _watchdog
[ComfyUI] File "/tmp/comfytest-home/.ce/.pixi/envs/panopack-nodes/lib/python3.10/threading.py", line 953 in run
[ComfyUI] File "/tmp/comfytest-home/.ce/.pixi/envs/panopack-nodes/lib/python3.10/threading.py", line 1016 in _bootstrap_inner
[ComfyUI] File "/tmp/comfytest-home/.ce/.pixi/envs/panopack-nodes/lib/python3.10/threading.py", line 973 in _bootstrap
[ComfyUI]
[ComfyUI] Thread 0x0000757ff4377740 (most recent call first):
[ComfyUI] File "/tmp/comfytest-home/.ce/.pixi/envs/panopack-nodes/lib/python3.10/site-packages/torch/storage.py", line 524 in _share_fd_cpu_
[ComfyUI] File "/tmp/comfytest-home/.ce/.pixi/envs/panopack-nodes/lib/python3.10/site-packages/torch/storage.py", line 449 in wrapper
[ComfyUI] File "/tmp/comfytest-home/.ce/.pixi/envs/panopack-nodes/lib/python3.10/site-packages/torch/storage.py", line 400 in share_memory_
[ComfyUI] File "/tmp/comfytest-home/.ce/.pixi/envs/panopack-nodes/lib/python3.10/site-packages/torch/storage.py", line 520 in share_memory_
[ComfyUI] File "/tmp/comfytest-home/.ce/.pixi/envs/panopack-nodes/lib/python3.10/site-packages/torch/storage.py", line 449 in wrapper
[ComfyUI] File "/tmp/comfytest-home/.ce/.pixi/envs/panopack-nodes/lib/python3.10/site-packages/torch/storage.py", line 1193 in _share_memory_
[ComfyUI] File "/tmp/comfytest-home/.ce/.pixi/envs/panopack-nodes/lib/python3.10/site-packages/torch/_tensor.py", line 853 in share_memory_
[ComfyUI] File "/tmp/comfyui_pvenv_0kgugsfd/persistent_worker.py", line 563 in _serialize_tensor_native
[ComfyUI] File "/tmp/comfyui_pvenv_0kgugsfd/persistent_worker.py", line 628 in _to_shm
[ComfyUI] File "/tmp/comfyui_pvenv_0kgugsfd/persistent_worker.py", line 705 in <listcomp>
[ComfyUI] File "/tmp/comfyui_pvenv_0kgugsfd/persistent_worker.py", line 705 in _to_shm
[ComfyUI] File "/tmp/comfyui_pvenv_0kgugsfd/persistent_worker.py", line 692 in _to_shm
[ComfyUI] File "/tmp/comfyui_pvenv_0kgugsfd/persistent_worker.py", line 1772 in main
[ComfyUI] File "/tmp/comfyui_pvenv_0kgugsfd/persistent_worker.py", line 1807 in <module>
[ComfyUI]
[ComfyUI] [worker:ComfyUI-PanoPack] === END ===
[ComfyUI]
[ComfyUI] [SubprocessWorker] got response: error
[ComfyUI] [ERROR] !!! Exception during processing !!! unable to allocate shared memory(shm) for file </torch_2560_118963202_16>: Success (0)
[ComfyUI]
[ComfyUI] Worker traceback:
[ComfyUI] Traceback (most recent call last):
[ComfyUI] File "/tmp/comfyui_pvenv_0kgugsfd/persistent_worker.py", line 1772, in main
[ComfyUI] result_meta = _to_shm(result, shm_registry)
[ComfyUI] File "/tmp/comfyui_pvenv_0kgugsfd/persistent_worker.py", line 692, in _to_shm
[ComfyUI] "args": _to_shm(list(obj.args), registry, visited),
[ComfyUI] File "/tmp/comfyui_pvenv_0kgugsfd/persistent_worker.py", line 705, in _to_shm
[ComfyUI] result = [_to_shm(v, registry, visited) for v in obj]
[ComfyUI] File "/tmp/comfyui_pvenv_0kgugsfd/persistent_worker.py", line 705, in <listcomp>
[ComfyUI] result = [_to_shm(v, registry, visited) for v in obj]
[ComfyUI] File "/tmp/comfyui_pvenv_0kgugsfd/persistent_worker.py", line 628, in _to_shm
[ComfyUI] result = _serialize_tensor_native(tensor, registry)
[ComfyUI] File "/tmp/comfyui_pvenv_0kgugsfd/persistent_worker.py", line 563, in _serialize_tensor_native
[ComfyUI] t.share_memory_()
[ComfyUI] File "/tmp/comfytest-home/.ce/.pixi/envs/panopack-nodes/lib/python3.10/site-packages/torch/_tensor.py", line 853, in share_memory_
[ComfyUI] self._typed_storage()._share_memory_()
[ComfyUI] File "/tmp/comfytest-home/.ce/.pixi/envs/panopack-nodes/lib/python3.10/site-packages/torch/storage.py", line 1193, in _share_memory_
[ComfyUI] self._untyped_storage.share_memory_()
[ComfyUI] File "/tmp/comfytest-home/.ce/.pixi/envs/panopack-nodes/lib/python3.10/site-packages/torch/storage.py", line 449, in wrapper
[ComfyUI] return fn(self, *args, **kwargs)
[ComfyUI] File "/tmp/comfytest-home/.ce/.pixi/envs/panopack-nodes/lib/python3.10/site-packages/torch/storage.py", line 520, in share_memory_
[ComfyUI] return super().share_memory_(*args, **kwargs)
[ComfyUI] File "/tmp/comfytest-home/.ce/.pixi/envs/panopack-nodes/lib/python3.10/site-packages/torch/storage.py", line 400, in share_memory_
[ComfyUI] self._share_fd_cpu_()
[ComfyUI] File "/tmp/comfytest-home/.ce/.pixi/envs/panopack-nodes/lib/python3.10/site-packages/torch/storage.py", line 449, in wrapper
[ComfyUI] return fn(self, *args, **kwargs)
[ComfyUI] File "/tmp/comfytest-home/.ce/.pixi/envs/panopack-nodes/lib/python3.10/site-packages/torch/storage.py", line 524, in _share_fd_cpu_
[ComfyUI] return super()._share_fd_cpu_(*args, **kwargs)
[ComfyUI] RuntimeError: unable to allocate shared memory(shm) for file </torch_2560_118963202_16>: Success (0)
[ComfyUI]
[ComfyUI] [ERROR] Traceback (most recent call last):
[ComfyUI] File "/workspaces/Sharp-1914/ComfyUI/execution.py", line 536, in execute
[ComfyUI] output_data, output_ui, has_subgraph, has_pending_tasks = await get_output_data(prompt_id, unique_id, obj, input_data_all, execution_block_cb=execution_block_cb, pre_execute_cb=pre_execute_cb, v3_data=v3_data)
[ComfyUI] File "/workspaces/Sharp-1914/ComfyUI/execution.py", line 336, in get_output_data
[ComfyUI] return_values = await _async_map_node_over_list(prompt_id, unique_id, obj, input_data_all, obj.FUNCTION, allow_interrupt=True, execution_block_cb=execution_block_cb, pre_execute_cb=pre_execute_cb, v3_data=v3_data)
[ComfyUI] File "/workspaces/Sharp-1914/ComfyUI/execution.py", line 310, in _async_map_node_over_list
[ComfyUI] await process_inputs(input_dict, i)
[ComfyUI] File "/workspaces/Sharp-1914/ComfyUI/execution.py", line 298, in process_inputs
[ComfyUI] result = f(**inputs)
[ComfyUI] File "/workspaces/Sharp-1914/.venv/lib/python3.10/site-packages/comfy_env/isolation/metadata.py", line 556, in proxy
[ComfyUI] result = worker.call_method(
[ComfyUI] File "/workspaces/Sharp-1914/.venv/lib/python3.10/site-packages/comfy_env/isolation/workers/subprocess.py", line 674, in call_method
[ComfyUI] raise WorkerError(
[ComfyUI] comfy_env.isolation.workers.base.WorkerError: unable to allocate shared memory(shm) for file </torch_2560_118963202_16>: Success (0)
[ComfyUI]
[ComfyUI] Worker traceback:
[ComfyUI] Traceback (most recent call last):
[ComfyUI] File "/tmp/comfyui_pvenv_0kgugsfd/persistent_worker.py", line 1772, in main
[ComfyUI] result_meta = _to_shm(result, shm_registry)
[ComfyUI] File "/tmp/comfyui_pvenv_0kgugsfd/persistent_worker.py", line 692, in _to_shm
[ComfyUI] "args": _to_shm(list(obj.args), registry, visited),
[ComfyUI] File "/tmp/comfyui_pvenv_0kgugsfd/persistent_worker.py", line 705, in _to_shm
[ComfyUI] result = [_to_shm(v, registry, visited) for v in obj]
[ComfyUI] File "/tmp/comfyui_pvenv_0kgugsfd/persistent_worker.py", line 705, in <listcomp>
[ComfyUI] result = [_to_shm(v, registry, visited) for v in obj]
[ComfyUI] File "/tmp/comfyui_pvenv_0kgugsfd/persistent_worker.py", line 628, in _to_shm
[ComfyUI] result = _serialize_tensor_native(tensor, registry)
[ComfyUI] File "/tmp/comfyui_pvenv_0kgugsfd/persistent_worker.py", line 563, in _serialize_tensor_native
[ComfyUI] t.share_memory_()
[ComfyUI] File "/tmp/comfytest-home/.ce/.pixi/envs/panopack-nodes/lib/python3.10/site-packages/torch/_tensor.py", line 853, in share_memory_
[ComfyUI] self._typed_storage()._share_memory_()
[ComfyUI] File "/tmp/comfytest-home/.ce/.pixi/envs/panopack-nodes/lib/python3.10/site-packages/torch/storage.py", line 1193, in _share_memory_
[ComfyUI] self._untyped_storage.share_memory_()
[ComfyUI] File "/tmp/comfytest-home/.ce/.pixi/envs/panopack-nodes/lib/python3.10/site-packages/torch/storage.py", line 449, in wrapper
[ComfyUI] return fn(self, *args, **kwargs)
[ComfyUI] File "/tmp/comfytest-home/.ce/.pixi/envs/panopack-nodes/lib/python3.10/site-packages/torch/storage.py", line 520, in share_memory_
[ComfyUI] return super().share_memory_(*args, **kwargs)
[ComfyUI] File "/tmp/comfytest-home/.ce/.pixi/envs/panopack-nodes/lib/python3.10/site-packages/torch/storage.py", line 400, in share_memory_
[ComfyUI] self._share_fd_cpu_()
[ComfyUI] File "/tmp/comfytest-home/.ce/.pixi/envs/panopack-nodes/lib/python3.10/site-packages/torch/storage.py", line 449, in wrapper
[ComfyUI] return fn(self, *args, **kwargs)
[ComfyUI] File "/tmp/comfytest-home/.ce/.pixi/envs/panopack-nodes/lib/python3.10/site-packages/torch/storage.py", line 524, in _share_fd_cpu_
[ComfyUI] return super()._share_fd_cpu_(*args, **kwargs)
[ComfyUI] RuntimeError: unable to allocate shared memory(shm) for file </torch_2560_118963202_16>: Success (0)
[ComfyUI]
[ComfyUI]
[ComfyUI] [INFO] Prompt executed in 223.04 seconds
Execution complete (t=223.6s)
Execution error: {'prompt_id': '16f9d308-d076-4c5d-9a60-1719bd41817a', 'node_id': '87', 'node_type': 'PanoramaSplitAdaptive', 'executed': ['7', '81', '61', '96', '9', '70', '62', '59', '80', '60', '68'], 'exception_message': 'unable to allocate shared memory(shm) for file </torch_2560_118963202_16>: Success (0)\n\nWorker traceback:\nTraceback (most recent call last):\n File "/tmp/comfyui_pvenv_0kgugsfd/persistent_worker.py", line 1772, in main\n result_meta = _to_shm(result, shm_registry)\n File "/tmp/comfyui_pvenv_0kgugsfd/persistent_worker.py", line 692, in _to_shm\n "args": _to_shm(list(obj.args), registry, visited),\n File "/tmp/comfyui_pvenv_0kgugsfd/persistent_worker.py", line 705, in _to_shm\n result = [_to_shm(v, registry, visited) for v in obj]\n File "/tmp/comfyui_pvenv_0kgugsfd/persistent_worker.py", line 705, in <listcomp>\n result = [_to_shm(v, registry, visited) for v in obj]\n File "/tmp/comfyui_pvenv_0kgugsfd/persistent_worker.py", line 628, in _to_shm\n result = _serialize_tensor_native(tensor, registry)\n File "/tmp/comfyui_pvenv_0kgugsfd/persistent_worker.py", line 563, in _serialize_tensor_native\n t.share_memory_()\n File "/tmp/comfytest-home/.ce/.pixi/envs/panopack-nodes/lib/python3.10/site-packages/torch/_tensor.py", line 853, in share_memory_\n self._typed_storage()._share_memory_()\n File "/tmp/comfytest-home/.ce/.pixi/envs/panopack-nodes/lib/python3.10/site-packages/torch/storage.py", line 1193, in _share_memory_\n self._untyped_storage.share_memory_()\n File "/tmp/comfytest-home/.ce/.pixi/envs/panopack-nodes/lib/python3.10/site-packages/torch/storage.py", line 449, in wrapper\n return fn(self, *args, **kwargs)\n File "/tmp/comfytest-home/.ce/.pixi/envs/panopack-nodes/lib/python3.10/site-packages/torch/storage.py", line 520, in share_memory_\n return super().share_memory_(*args, **kwargs)\n File "/tmp/comfytest-home/.ce/.pixi/envs/panopack-nodes/lib/python3.10/site-packages/torch/storage.py", line 400, in share_memory_\n self._share_fd_cpu_()\n File "/tmp/comfytest-home/.ce/.pixi/envs/panopack-nodes/lib/python3.10/site-packages/torch/storage.py", line 449, in wrapper\n return fn(self, *args, **kwargs)\n File "/tmp/comfytest-home/.ce/.pixi/envs/panopack-nodes/lib/python3.10/site-packages/torch/storage.py", line 524, in _share_fd_cpu_\n return super()._share_fd_cpu_(*args, **kwargs)\nRuntimeError: unable to allocate shared memory(shm) for file </torch_2560_118963202_16>: Success (0)\n\n', 'exception_type': 'comfy_env.isolation.workers.base.WorkerError', 'traceback': [' File "/workspaces/Sharp-1914/ComfyUI/execution.py", line 536, in execute\n output_data, output_ui, has_subgraph, has_pending_tasks = await get_output_data(prompt_id, unique_id, obj, input_data_all, execution_block_cb=execution_block_cb, pre_execute_cb=pre_execute_cb, v3_data=v3_data)\n', ' File "/workspaces/Sharp-1914/ComfyUI/execution.py", line 336, in get_output_data\n return_values = await _async_map_node_over_list(prompt_id, unique_id, obj, input_data_all, obj.FUNCTION, allow_interrupt=True, execution_block_cb=execution_block_cb, pre_execute_cb=pre_execute_cb, v3_data=v3_data)\n', ' File "/workspaces/Sharp-1914/ComfyUI/execution.py", line 310, in _async_map_node_over_list\n await process_inputs(input_dict, i)\n', ' File "/workspaces/Sharp-1914/ComfyUI/execution.py", line 298, in process_inputs\n result = f(**inputs)\n', ' File "/workspaces/Sharp-1914/.venv/lib/python3.10/site-packages/comfy_env/isolation/metadata.py", line 556, in proxy\n result = worker.call_method(\n', ' File "/workspaces/Sharp-1914/.venv/lib/python3.10/site-packages/comfy_env/isolation/workers/subprocess.py", line 674, in call_method\n raise WorkerError(\n'], 'current_inputs': {'split_method': ['icosahedron_42'], 'resolution': [1536], 'fov_degrees': [90], 'use_gpu': [True], 'create_masks': [True], 'mask_method': ['closest_to'], 'panorama': ["{'image': tensor([[[[0.1647, 0.1020, 0.0745],\n [0.1765, 0.1098, 0.0863],\n [0.1765, 0.1137, 0.0941],\n ...,\n [0.1647, 0.1137, 0.0941],\n [0.1647, 0.1098, 0.0902],\n [0.1333, 0.0784, 0.0667]],\n\n [[0.1922, 0.1255, 0.0902],\n [0.1843, 0.1216, 0.0902],\n [0.1922, 0.1255, 0.0980],\n ...,\n [0.1765, 0.1255, 0.0980],\n [0.1725, 0.1255, 0.1020],\n [0.1647, 0.1059, 0.0824]],\n\n [[0.1882, 0.1216, 0.0980],\n [0.1843, 0.1216, 0.0980],\n [0.1882, 0.1216, 0.0980],\n ...,\n [0.1804, 0.1333, 0.1020],\n [0.1804, 0.1373, 0.1098],\n [0.1569, 0.1059, 0.0863]],\n\n ...,\n\n [[0.1882, 0.1255, 0.1176],\n [0.1922, 0.1255, 0.1176],\n [0.1922, 0.1255, 0.1176],\n ...,\n [0.1176, 0.1333, 0.1412],\n [0.1686, 0.1529, 0.1451],\n [0.1843, 0.1569, 0.1333]],\n\n [[0.1882, 0.1255, 0.1176],\n [0.1882, 0.1255, 0.1137],\n [0.1922, 0.1255, 0.1176],\n ...,\n [0.1647, 0.1412, 0.1098],\n [0.1922, 0.1529, 0.1176],\n [0.2039, 0.1490, 0.1294]],\n\n [[0.1765, 0.1137, 0.1137],\n [0.1804, 0.1255, 0.1216],\n [0.1765, 0.1216, 0.1137],\n ...,\n [0.1961, 0.1725, 0.1412],\n [0.1647, 0.1451, 0.1333],\n [0.1843, 0.1137, 0.1373]]]]), 'meta': {}}"], 'depth_panorama': ['tensor([[[[0.7430, 0.7430, 0.7430],\n [0.7430, 0.7430, 0.7430],\n [0.7430, 0.7430, 0.7430],\n ...,\n [0.7430, 0.7430, 0.7430],\n [0.7430, 0.7430, 0.7430],\n [0.7430, 0.7430, 0.7430]],\n\n [[0.7429, 0.7429, 0.7429],\n [0.7429, 0.7429, 0.7429],\n [0.7429, 0.7429, 0.7429],\n ...,\n [0.7429, 0.7429, 0.7429],\n [0.7429, 0.7429, 0.7429],\n [0.7429, 0.7429, 0.7429]],\n\n [[0.7430, 0.7430, 0.7430],\n [0.7430, 0.7430, 0.7430],\n [0.7430, 0.7430, 0.7430],\n ...,\n [0.7430, 0.7430, 0.7430],\n [0.7430, 0.7430, 0.7430],\n [0.7430, 0.7430, 0.7430]],\n\n ...,\n\n [[0.8810, 0.8810, 0.8810],\n [0.8810, 0.8810, 0.8810],\n [0.8810, 0.8810, 0.8810],\n ...,\n [0.8810, 0.8810, 0.8810],\n [0.8810, 0.8810, 0.8810],\n [0.8810, 0.8810, 0.8810]],\n\n [[0.8811, 0.8811, 0.8811],\n [0.8811, 0.8811, 0.8811],\n [0.8811, 0.8811, 0.8811],\n ...,\n [0.8811, 0.8811, 0.8811],\n [0.8811, 0.8811, 0.8811],\n [0.8811, 0.8811, 0.8811]],\n\n [[0.8813, 0.8813, 0.8813],\n [0.8813, 0.8813, 0.8813],\n [0.8813, 0.8813, 0.8813],\n ...,\n [0.8813, 0.8813, 0.8813],\n [0.8813, 0.8813, 0.8813],\n [0.8813, 0.8813, 0.8813]]]])'], 'normals_panorama': ['tensor([[[[4.8400e-01, 5.0399e-01, 2.7195e-04],\n [4.8401e-01, 5.0400e-01, 2.7180e-04],\n [4.8401e-01, 5.0400e-01, 2.7180e-04],\n ...,\n [4.8401e-01, 5.0399e-01, 2.7168e-04],\n [4.8401e-01, 5.0399e-01, 2.7168e-04],\n [4.8400e-01, 5.0399e-01, 2.7195e-04]],\n\n [[4.8384e-01, 5.0488e-01, 2.8512e-04],\n [4.8384e-01, 5.0488e-01, 2.8512e-04],\n [4.8384e-01, 5.0488e-01, 2.8512e-04],\n ...,\n [4.8384e-01, 5.0488e-01, 2.8512e-04],\n [4.8384e-01, 5.0488e-01, 2.8512e-04],\n [4.8384e-01, 5.0488e-01, 2.8512e-04]],\n\n [[4.8386e-01, 5.0571e-01, 2.9308e-04],\n [4.8386e-01, 5.0571e-01, 2.9308e-04],\n [4.8386e-01, 5.0571e-01, 2.9308e-04],\n ...,\n [4.8386e-01, 5.0571e-01, 2.9308e-04],\n [4.8386e-01, 5.0571e-01, 2.9308e-04],\n [4.8386e-01, 5.0571e-01, 2.9308e-04]],\n\n ...,\n\n [[4.9929e-01, 5.1112e-01, 9.9988e-01],\n [4.9929e-01, 5.1112e-01, 9.9988e-01],\n [4.9929e-01, 5.1112e-01, 9.9988e-01],\n ...,\n [4.9929e-01, 5.1112e-01, 9.9988e-01],\n [4.9929e-01, 5.1112e-01, 9.9988e-01],\n [4.9929e-01, 5.1112e-01, 9.9988e-01]],\n\n [[4.9880e-01, 5.1144e-01, 9.9987e-01],\n [4.9880e-01, 5.1144e-01, 9.9987e-01],\n [4.9880e-01, 5.1144e-01, 9.9987e-01],\n ...,\n [4.9880e-01, 5.1144e-01, 9.9987e-01],\n [4.9880e-01, 5.1144e-01, 9.9987e-01],\n [4.9880e-01, 5.1144e-01, 9.9987e-01]],\n\n [[4.9943e-01, 5.1242e-01, 9.9985e-01],\n [4.9943e-01, 5.1242e-01, 9.9985e-01],\n [4.9943e-01, 5.1242e-01, 9.9985e-01],\n ...,\n [4.9943e-01, 5.1242e-01, 9.9985e-01],\n [4.9943e-01, 5.1242e-01, 9.9985e-01],\n [4.9943e-01, 5.1242e-01, 9.9985e-01]]]])']}, 'current_outputs': ['7', '61', '81', '54', '96', '87', '9', '62', '70', '59', '76', '73', '80', '89', '95', '68', '78', '60'], 'timestamp': 1780860292737}
Status: FAILED
Error: Workflow execution failed: {'prompt_id': '16f9d308-d076-4c5d-9a60-1719bd41817a', 'node_id': '87', 'node_type': 'PanoramaSplitAdaptive', 'executed': ['7', '81', '61', '96', '9', '70', '62', '59', '80', '60', '68'], 'exception_message': 'unable to allocate shared memory(shm) for file </torch_2560_118963202_16>: Success (0)\n\nWorker traceback:\nTraceback (most recent call last):\n File "/tmp/comfyui_pvenv_0kgugsfd/persistent_worker.py", line 1772, in main\n result_meta = _to_shm(result, shm_registry)\n File "/tmp/comfyui_pvenv_0kgugsfd/persistent_worker.py", line 692, in _to_shm\n "args": _to_shm(list(obj.args), registry, visited),\n File "/tmp/comfyui_pvenv_0kgugsfd/persistent_worker.py", line 705, in _to_shm\n result = [_to_shm(v, registry, visited) for v in obj]\n File "/tmp/comfyui_pvenv_0kgugsfd/persistent_worker.py", line 705, in <listcomp>\n result = [_to_shm(v, registry, visited) for v in obj]\n File "/tmp/comfyui_pvenv_0kgugsfd/persistent_worker.py", line 628, in _to_shm\n result = _serialize_tensor_native(tensor, registry)\n File "/tmp/comfyui_pvenv_0kgugsfd/persistent_worker.py", line 563, in _serialize_tensor_native\n t.share_memory_()\n File "/tmp/comfytest-home/.ce/.pixi/envs/panopack-nodes/lib/python3.10/site-packages/torch/_tensor.py", line 853, in share_memory_\n self._typed_storage()._share_memory_()\n File "/tmp/comfytest-home/.ce/.pixi/envs/panopack-nodes/lib/python3.10/site-packages/torch/storage.py", line 1193, in _share_memory_\n self._untyped_storage.share_memory_()\n File "/tmp/comfytest-home/.ce/.pixi/envs/panopack-nodes/lib/python3.10/site-packages/torch/storage.py", line 449, in wrapper\n return fn(self, *args, **kwargs)\n File "/tmp/comfytest-home/.ce/.pixi/envs/panopack-nodes/lib/python3.10/site-packages/torch/storage.py", line 520, in share_memory_\n return super().share_memory_(*args, **kwargs)\n File "/tmp/comfytest-home/.ce/.pixi/envs/panopack-nodes/lib/python3.10/site-packages/torch/storage.py", line 400, in share_memory_\n self._share_fd_cpu_()\n File "/tmp/comfytest-home/.ce/.pixi/envs/panopack-nodes/lib/python3.10/site-packages/torch/storage.py", line 449, in wrapper\n return fn(self, *args, **kwargs)\n File "/tmp/comfytest-home/.ce/.pixi/envs/panopack-nodes/lib/python3.10/site-packages/torch/storage.py", line 524, in _share_fd_cpu_\n return super()._share_fd_cpu_(*args, **kwargs)\nRuntimeError: unable to allocate shared memory(shm) for file </torch_2560_118963202_16>: Success (0)\n\n', 'exception_type': 'comfy_env.isolation.workers.base.WorkerError', 'traceback': [' File "/workspaces/Sharp-1914/ComfyUI/execution.py", line 536, in execute\n output_data, output_ui, has_subgraph, has_pending_tasks = await get_output_data(prompt_id, unique_id, obj, input_data_all, execution_block_cb=execution_block_cb, pre_execute_cb=pre_execute_cb, v3_data=v3_data)\n', ' File "/workspaces/Sharp-1914/ComfyUI/execution.py", line 336, in get_output_data\n return_values = await _async_map_node_over_list(prompt_id, unique_id, obj, input_data_all, obj.FUNCTION, allow_interrupt=True, execution_block_cb=execution_block_cb, pre_execute_cb=pre_execute_cb, v3_data=v3_data)\n', ' File "/workspaces/Sharp-1914/ComfyUI/execution.py", line 310, in _async_map_node_over_list\n await process_inputs(input_dict, i)\n', ' File "/workspaces/Sharp-1914/ComfyUI/execution.py", line 298, in process_inputs\n result = f(**inputs)\n', ' File "/workspaces/Sharp-1914/.venv/lib/python3.10/site-packages/comfy_env/isolation/metadata.py", line 556, in proxy\n result = worker.call_method(\n', ' File "/workspaces/Sharp-1914/.venv/lib/python3.10/site-packages/comfy_env/isolation/workers/subprocess.py", line 674, in call_method\n raise WorkerError(\n'], 'current_inputs': {'split_method': ['icosahedron_42'], 'resolution': [1536], 'fov_degrees': [90], 'use_gpu': [True], 'create_masks': [True], 'mask_method': ['closest_to'], 'panorama': ["{'image': tensor([[[[0.1647, 0.1020, 0.0745],\n [0.1765, 0.1098, 0.0863],\n [0.1765, 0.1137, 0.0941],\n ...,\n [0.1647, 0.1137, 0.0941],\n [0.1647, 0.1098, 0.0902],\n [0.1333, 0.0784, 0.0667]],\n\n [[0.1922, 0.1255, 0.0902],\n [0.1843, 0.1216, 0.0902],\n [0.1922, 0.1255, 0.0980],\n ...,\n [0.1765, 0.1255, 0.0980],\n [0.1725, 0.1255, 0.1020],\n [0.1647, 0.1059, 0.0824]],\n\n [[0.1882, 0.1216, 0.0980],\n [0.1843, 0.1216, 0.0980],\n [0.1882, 0.1216, 0.0980],\n ...,\n [0.1804, 0.1333, 0.1020],\n [0.1804, 0.1373, 0.1098],\n [0.1569, 0.1059, 0.0863]],\n\n ...,\n\n [[0.1882, 0.1255, 0.1176],\n [0.1922, 0.1255, 0.1176],\n [0.1922, 0.1255, 0.1176],\n ...,\n [0.1176, 0.1333, 0.1412],\n [0.1686, 0.1529, 0.1451],\n [0.1843, 0.1569, 0.1333]],\n\n [[0.1882, 0.1255, 0.1176],\n [0.1882, 0.1255, 0.1137],\n [0.1922, 0.1255, 0.1176],\n ...,\n [0.1647, 0.1412, 0.1098],\n [0.1922, 0.1529, 0.1176],\n [0.2039, 0.1490, 0.1294]],\n\n [[0.1765, 0.1137, 0.1137],\n [0.1804, 0.1255, 0.1216],\n [0.1765, 0.1216, 0.1137],\n ...,\n [0.1961, 0.1725, 0.1412],\n [0.1647, 0.1451, 0.1333],\n [0.1843, 0.1137, 0.1373]]]]), 'meta': {}}"], 'depth_panorama': ['tensor([[[[0.7430, 0.7430, 0.7430],\n [0.7430, 0.7430, 0.7430],\n [0.7430, 0.7430, 0.7430],\n ...,\n [0.7430, 0.7430, 0.7430],\n [0.7430, 0.7430, 0.7430],\n [0.7430, 0.7430, 0.7430]],\n\n [[0.7429, 0.7429, 0.7429],\n [0.7429, 0.7429, 0.7429],\n [0.7429, 0.7429, 0.7429],\n ...,\n [0.7429, 0.7429, 0.7429],\n [0.7429, 0.7429, 0.7429],\n [0.7429, 0.7429, 0.7429]],\n\n [[0.7430, 0.7430, 0.7430],\n [0.7430, 0.7430, 0.7430],\n [0.7430, 0.7430, 0.7430],\n ...,\n [0.7430, 0.7430, 0.7430],\n [0.7430, 0.7430, 0.7430],\n [0.7430, 0.7430, 0.7430]],\n\n ...,\n\n [[0.8810, 0.8810, 0.8810],\n [0.8810, 0.8810, 0.8810],\n [0.8810, 0.8810, 0.8810],\n ...,\n [0.8810, 0.8810, 0.8810],\n [0.8810, 0.8810, 0.8810],\n [0.8810, 0.8810, 0.8810]],\n\n [[0.8811, 0.8811, 0.8811],\n [0.8811, 0.8811, 0.8811],\n [0.8811, 0.8811, 0.8811],\n ...,\n [0.8811, 0.8811, 0.8811],\n [0.8811, 0.8811, 0.8811],\n [0.8811, 0.8811, 0.8811]],\n\n [[0.8813, 0.8813, 0.8813],\n [0.8813, 0.8813, 0.8813],\n [0.8813, 0.8813, 0.8813],\n ...,\n [0.8813, 0.8813, 0.8813],\n [0.8813, 0.8813, 0.8813],\n [0.8813, 0.8813, 0.8813]]]])'], 'normals_panorama': ['tensor([[[[4.8400e-01, 5.0399e-01, 2.7195e-04],\n [4.8401e-01, 5.0400e-01, 2.7180e-04],\n [4.8401e-01, 5.0400e-01, 2.7180e-04],\n ...,\n [4.8401e-01, 5.0399e-01, 2.7168e-04],\n [4.8401e-01, 5.0399e-01, 2.7168e-04],\n [4.8400e-01, 5.0399e-01, 2.7195e-04]],\n\n [[4.8384e-01, 5.0488e-01, 2.8512e-04],\n [4.8384e-01, 5.0488e-01, 2.8512e-04],\n [4.8384e-01, 5.0488e-01, 2.8512e-04],\n ...,\n [4.8384e-01, 5.0488e-01, 2.8512e-04],\n [4.8384e-01, 5.0488e-01, 2.8512e-04],\n [4.8384e-01, 5.0488e-01, 2.8512e-04]],\n\n [[4.8386e-01, 5.0571e-01, 2.9308e-04],\n [4.8386e-01, 5.0571e-01, 2.9308e-04],\n [4.8386e-01, 5.0571e-01, 2.9308e-04],\n ...,\n [4.8386e-01, 5.0571e-01, 2.9308e-04],\n [4.8386e-01, 5.0571e-01, 2.9308e-04],\n [4.8386e-01, 5.0571e-01, 2.9308e-04]],\n\n ...,\n\n [[4.9929e-01, 5.1112e-01, 9.9988e-01],\n [4.9929e-01, 5.1112e-01, 9.9988e-01],\n [4.9929e-01, 5.1112e-01, 9.9988e-01],\n ...,\n [4.9929e-01, 5.1112e-01, 9.9988e-01],\n [4.9929e-01, 5.1112e-01, 9.9988e-01],\n [4.9929e-01, 5.1112e-01, 9.9988e-01]],\n\n [[4.9880e-01, 5.1144e-01, 9.9987e-01],\n [4.9880e-01, 5.1144e-01, 9.9987e-01],\n [4.9880e-01, 5.1144e-01, 9.9987e-01],\n ...,\n [4.9880e-01, 5.1144e-01, 9.9987e-01],\n [4.9880e-01, 5.1144e-01, 9.9987e-01],\n [4.9880e-01, 5.1144e-01, 9.9987e-01]],\n\n [[4.9943e-01, 5.1242e-01, 9.9985e-01],\n [4.9943e-01, 5.1242e-01, 9.9985e-01],\n [4.9943e-01, 5.1242e-01, 9.9985e-01],\n ...,\n [4.9943e-01, 5.1242e-01, 9.9985e-01],\n [4.9943e-01, 5.1242e-01, 9.9985e-01],\n [4.9943e-01, 5.1242e-01, 9.9985e-01]]]])']}, 'current_outputs': ['7', '61', '81', '54', '96', '87', '9', '62', '70', '59', '76', '73', '80', '89', '95', '68', '78', '60'], 'timestamp': 1780860292737}
Details: Workflow: /node/ComfyUI-Sharp/workflows/pano.json
Node error: PanoramaSplitAdaptive