Capturing execution frames: pano.json [ComfyUI] [INFO] Using RAM pressure cache. [ComfyUI] [INFO] Using RAM pressure cache. Frame 1 saved (frame_000.jpg, t=0.0s) Validating workflow... [ComfyUI] [INFO] === /validate endpoint called === Queuing workflow for execution... [ComfyUI] [INFO] Received JSON with keys: ['prompt'] [ComfyUI] [INFO] Prompt has 18 nodes [ComfyUI] [INFO] Node 7: LoadImage [ComfyUI] [INFO] Inputs: {"image": "pano.png"} [ComfyUI] [INFO] Node 9: LoadSharpModel [ComfyUI] [INFO] Inputs: {"precision": "auto"} [ComfyUI] [INFO] Node 54: MergeGaussians [ComfyUI] [INFO] Inputs: {"ply_folder": ["76", 0], "output_prefix": "merged", "max_depth": 0, "min_opacity": 0} [ComfyUI] [INFO] Node 59: PanoramaWrap [ComfyUI] [INFO] Inputs: {"image": ["7", 0]} [ComfyUI] [INFO] Node 60: PanoramaDepthMerge [ComfyUI] [INFO] Inputs: {"out_width": ["61", 0], "out_height": ["61", 1], "use_gpu": true, "scale_anchor": false, "chunk_size": 8, "center_weight_power": 2, "normal_edge_threshold_deg": 0, "normal_consistency_boost": false, [ComfyUI] [INFO] Node 61: GetImageSize [ComfyUI] [comfy-env] SubprocessWorker: /tmp/comfytest-home/.ce/.pixi/envs/sharp-nodes/bin/python [ComfyUI] [INFO] Inputs: {"image": ["7", 0]} [ComfyUI] [comfy-env] env_vars: {'COMFYUI_BASE': '/workspaces/Sharp-1914/ComfyUI'} [ComfyUI] [INFO] Node 62: PreviewImage [ComfyUI] [ComfyUI-Sharp] python: /tmp/comfytest-home/.ce/.pixi/envs/sharp-nodes/bin/python [ComfyUI] [INFO] Inputs: {"images": ["60", 2]} [ComfyUI] [ComfyUI-Sharp] sys_path sent to worker: ['/workspaces/Sharp-1914/ComfyUI', '/workspaces/Sharp-1914/ComfyUI/custom_nodes/ComfyUI-Sharp', '/tmp/comfytest-home/.ce/.pixi/envs/sharp-nodes/lib/python3.1/site-packages', '/workspaces/Sharp-1914/ComfyUI/custom_nodes/ComfyUI-Sharp'] [ComfyUI] [INFO] Node 68: PreviewImage [ComfyUI] [SubprocessWorker] is_pixi=True, python=/tmp/comfytest-home/.ce/.pixi/envs/sharp-nodes/bin/python [ComfyUI] [INFO] Inputs: {"images": ["96", 0]} [ComfyUI] [SubprocessWorker] launching cmd=['/tmp/comfytest-home/.pixi/bin/pixi', 'run', '--as-is', '--manifest-path', '/tmp/comfytest-home/.ce/pixi.toml', '-e', 'sharp-nodes', 'python', '/tmp/comfyui_pvenv_qlpb5zhh/persistent_worker.py', 'abstract://comfy_worker_375e4707e383']... [ComfyUI] [INFO] Node 70: PreviewImage [ComfyUI] [SubprocessWorker] socket_addr=abstract://comfy_worker_375e4707e383 (abstract, no filesystem path) [ComfyUI] [INFO] Inputs: {"images": ["81", 0]} [ComfyUI] [INFO] Node 73: SharpRayToPlanarDepth [ComfyUI] [INFO] Inputs: {"image": ["87", 1], "intrinsics": ["87", 4], "extrinsics": ["87", 3]} [ComfyUI] [INFO] Node 76: SharpPredictGaussiansFromMetricDepth [ComfyUI] [INFO] Inputs: {"snap_to_external_depth": "none", "depth_convention": "planar_z", "focal_length_mm": 30, "output_prefix": "sharp_aligned", "save_background_layer": true, "edge_crop": 0, "model": ["9", 0], "image": [ [ComfyUI] [INFO] Node 78: TransformGaussian [ComfyUI] [INFO] Inputs: {"rotate_x": -90, "rotate_y": 0, "rotate_z": 0, "ply_path": ["54", 1]} [ComfyUI] [INFO] Node 80: DownloadAndLoadMoGe2Model [ComfyUI] [INFO] Inputs: {"model": "moge-2-vitl-normal.pt", "precision": "auto", "attention": "auto"} [ComfyUI] [INFO] Node 81: MoGe2Inference [ComfyUI] [INFO] Inputs: {"resolution_level": 9, "num_tokens": 0, "fov_x_deg": ["96", 3], "force_projection": true, "apply_mask": true, "moge2_model": ["80", 0], "images": ["96", 0]} [ComfyUI] [INFO] Node 87: PanoramaSplitAdaptive [ComfyUI] [INFO] Inputs: {"split_method": "icosahedron_42", "resolution": 1536, "fov_degrees": 90, "use_gpu": true, "create_masks": true, "mask_method": "closest_to", "panorama": ["59", 0], "depth_panorama": ["60", 0], "norma [ComfyUI] [INFO] Node 89: PreviewImage [ComfyUI] [INFO] Inputs: {"images": ["87", 8]} [ComfyUI] [INFO] Node 95: PreviewGaussians [ComfyUI] [INFO] Inputs: {"camera_mode": "orbit", "fov_degrees": 71, "renderer": "playcanvas", "transport_format": "ply", "ply_path": ["78", 0]} [ComfyUI] [INFO] Node 96: PanoramaSplit [ComfyUI] [INFO] Inputs: {"split_method": "icosahedron_42", "resolution": 952, "fov_degrees": 90, "use_gpu": true, "create_masks": false, "fname": "pano_bank", "panorama": ["59", 0]} [ComfyUI] [INFO] Generated prompt_id: 31085ed5-c99f-4caa-adc5-5d3b2d8a0840 [ComfyUI] [INFO] Calling execution.validate_prompt()... [ComfyUI] [INFO] Validation result: valid=True [ComfyUI] [INFO] === Validation PASSED === [ComfyUI] [INFO] got prompt [ComfyUI] [comfy-env] Running LoadSharpModel: precision: 'auto' [ComfyUI] [VRAM] Before LoadSharpModel: 697 / 24122 MB [ComfyUI] [SubprocessWorker] call_method: nodes.load_model.LoadSharpModel.EXECUTE_NORMALIZED [ComfyUI] [SubprocessWorker] acquired lock, ensuring started... [ComfyUI] [worker:ComfyUI-Sharp] ERROR: Failed to import comfy_kitchen, Error: No module named 'comfy_kitchen', fp8 and fp4 support will not be available. [ComfyUI] [worker:ComfyUI-Sharp] WARNING: comfy_kitchen does not support stochastic FP8 rounding, please update comfy_kitchen. [ComfyUI] [SubprocessWorker] worker started/confirmed [ComfyUI] [SubprocessWorker] serializing kwargs to shm... [ComfyUI] [SubprocessWorker] created 0 shm blocks [ComfyUI] [SubprocessWorker] sending request via socket... [ComfyUI] [SubprocessWorker] call_id=1 sending call_method [ComfyUI] [worker:ComfyUI-Sharp] [LoadSharpModel] precision='auto' -> dtype=bf16 (device=cuda:0) [ComfyUI] [worker:ComfyUI-Sharp] [LoadSharpModel] checkpoint not found at /workspaces/Sharp-1914/ComfyUI/models/sharp/sharp_2572gikvuh.pt — downloading from HuggingFace repo 'apple/Sharp' file 'sharp_2572gikvuh.pt' -> /workspaces/Sharp-1914/ComfyUI/models/sharp [ComfyUI] Frame 2 saved (frame_001.jpg, t=2.3s) [capture-periodic] freeze=1ms shot=91ms unfreeze=7ms saved=True Frame 3 saved (frame_002.jpg, t=4.5s) [capture-periodic] freeze=1ms shot=121ms unfreeze=5ms saved=True [capture-loop] iter=50 t=5.7s state={'complete': False, 'error': None, 'executedCount': 0, 'wsState': 1} eval_ms=2 ram=4.7/31.3GB (15%) swap=1.7/32.0GB (5%) cpu=9% browser_rss=1.01GB [ComfyUI] sharp_2572gikvuh.pt: 0%| | 0.00/2.81G [00:00 dtype=bf16 [ComfyUI] [SubprocessWorker] got response: ok [ComfyUI] [comfy-env] SubprocessWorker: /tmp/comfytest-home/.ce/.pixi/envs/moge2-nodes/bin/python [ComfyUI] [comfy-env] LoadSharpModel done (26.77s): result: NodeOutput [ComfyUI] [comfy-env] env_vars: {'COMFYUI_BASE': '/workspaces/Sharp-1914/ComfyUI'} [ComfyUI] [VRAM] After LoadSharpModel: 959 / 24122 MB [ComfyUI] [ComfyUI-MoGe2] python: /tmp/comfytest-home/.ce/.pixi/envs/moge2-nodes/bin/python [ComfyUI] [comfy-env] Running DownloadAndLoadMoGe2Model: model: 'moge-2-vitl-normal.pt', precision: 'auto', attention: 'auto' [ComfyUI] [ComfyUI-MoGe2] sys_path sent to worker: ['/workspaces/Sharp-1914/ComfyUI', '/workspaces/Sharp-1914/ComfyUI/custom_nodes/ComfyUI-MoGe2', '/tmp/comfytest-home/.ce/.pixi/envs/moge2-nodes/lib/python3.1/site-packages', '/workspaces/Sharp-1914/ComfyUI/custom_nodes/ComfyUI-MoGe2'] [ComfyUI] [VRAM] Before DownloadAndLoadMoGe2Model: 959 / 24122 MB [ComfyUI] [SubprocessWorker] is_pixi=True, python=/tmp/comfytest-home/.ce/.pixi/envs/moge2-nodes/bin/python [ComfyUI] [SubprocessWorker] call_method: nodes.load_model.DownloadAndLoadMoGe2Model.EXECUTE_NORMALIZED [ComfyUI] [SubprocessWorker] launching cmd=['/tmp/comfytest-home/.pixi/bin/pixi', 'run', '--as-is', '--manifest-path', '/tmp/comfytest-home/.ce/pixi.toml', '-e', 'moge2-nodes', 'python', '/tmp/comfyui_pvenv_bmmahm2z/persistent_worker.py', 'abstract://comfy_worker_b1be181c7b7c']... [ComfyUI] [SubprocessWorker] acquired lock, ensuring started... [ComfyUI] [SubprocessWorker] socket_addr=abstract://comfy_worker_b1be181c7b7c (abstract, no filesystem path) [capture-loop] iter=250 t=27.5s state={'complete': False, 'error': None, 'executedCount': 0, 'wsState': 1} eval_ms=2 ram=4.6/31.3GB (15%) swap=1.7/32.0GB (5%) cpu=12% browser_rss=0.94GB [ComfyUI] [worker:ComfyUI-MoGe2] ERROR: Failed to import comfy_kitchen, Error: No module named 'comfy_kitchen', fp8 and fp4 support will not be available. [ComfyUI] [worker:ComfyUI-MoGe2] WARNING: comfy_kitchen does not support stochastic FP8 rounding, please update comfy_kitchen. [ComfyUI] [SubprocessWorker] worker started/confirmed [ComfyUI] [SubprocessWorker] serializing kwargs to shm... [ComfyUI] [SubprocessWorker] created 0 shm blocks [ComfyUI] [SubprocessWorker] sending request via socket... [ComfyUI] [SubprocessWorker] call_id=1 sending call_method Frame 10 saved (frame_009.jpg, t=28.6s) [capture-periodic] freeze=1ms shot=88ms unfreeze=6ms saved=True [ComfyUI] [ComfyUI] model.pt: 0%| | 0.00/1.32G [00:00 42 crops @ 952x952, fov=(90,90) via grid_sample (GPU); cameras 1.199s, split 5.180s, total 7.251s [ComfyUI] [SubprocessWorker] got response: ok [ComfyUI] [comfy-env] PanoramaSplit done (8.29s): result: NodeOutput [ComfyUI] [VRAM] After PanoramaSplit: 2855 / 24122 MB Frame 17 saved (frame_016.jpg, t=52.6s) [capture-periodic] freeze=1ms shot=88ms unfreeze=6ms saved=True [ComfyUI] [comfy-env] Running MoGe2Inference: resolution_level: 9, num_tokens: 0, fov_x_deg: 90.0, force_projection: True, apply_mask: True, moge2_model: dict, images: torch.float32 [42,952,952,3] cpu [ComfyUI] [VRAM] Before MoGe2Inference: 2855 / 24122 MB [ComfyUI] [SubprocessWorker] call_method: nodes.nodes_inference.MoGe2Inference.EXECUTE_NORMALIZED [ComfyUI] [SubprocessWorker] acquired lock, ensuring started... [ComfyUI] [ComfyUI-MoGe2] Health check: ping (timeout=5.0s)... [ComfyUI] [ComfyUI-MoGe2] Health check: ok [ComfyUI] [SubprocessWorker] worker started/confirmed [ComfyUI] [comfy-env] PRE-SERIALIZE 'images' shape: torch.Size([42, 952, 952, 3]) [ComfyUI] [SubprocessWorker] serializing kwargs to shm... Node executed (1 total), capturing... [ComfyUI] [SubprocessWorker] created 0 shm blocks [ComfyUI] [SubprocessWorker] sending request via socket... [ComfyUI] [SubprocessWorker] call_id=2 sending call_method [ComfyUI] [worker:ComfyUI-MoGe2] [comfy-env] _from_shm got dict with keys: ['__type__', 'strategy', 'parent_pid', 'fd', 'storage_size'] [ComfyUI] [worker:ComfyUI-MoGe2] [comfy-env] DESERIALIZE TensorRef: tensor_size=[42, 952, 952, 3] [ComfyUI] [worker:ComfyUI-MoGe2] [comfy-env] DESERIALIZED tensor shape: torch.Size([42, 952, 952, 3]) Frame 18 saved (frame_017.jpg, t=54.6s) [capture-node] freeze=13ms shot=126ms unfreeze=1ms saved=True [capture-loop] iter=500 t=55.1s state={'complete': False, 'error': None, 'executedCount': 1, 'wsState': 1} eval_ms=1 ram=7.0/31.3GB (22%) swap=1.7/32.0GB (5%) cpu=14% browser_rss=1.10GB [capture-loop] iter=550 t=60.4s state={'complete': False, 'error': None, 'executedCount': 1, 'wsState': 1} eval_ms=1 ram=9.0/31.3GB (29%) swap=1.7/32.0GB (5%) cpu=14% browser_rss=1.08GB [ComfyUI] [SubprocessWorker] callback 'request_vram_budget' from call_id=2 [ComfyUI] [comfy-env] VRAM request: 0.66GB, free before eviction: 22.30GB [ComfyUI] [comfy-env] VRAM after eviction: 22.30GB [ComfyUI] [worker:ComfyUI-MoGe2] [VRAM] +216MB (now 216MB) reserved=224MB peak=216MB [ComfyUI] [SubprocessWorker] callback 'report_progress' from call_id=2 [ComfyUI] [worker:ComfyUI-MoGe2] [VRAM] +455MB (now 671MB) reserved=1600MB peak=782MB [ComfyUI] [SubprocessWorker] callback 'report_progress' from call_id=2 [ComfyUI] [SubprocessWorker] callback 'report_progress' from call_id=2 [ComfyUI] [SubprocessWorker] callback 'report_progress' from call_id=2 [ComfyUI] [SubprocessWorker] callback 'report_progress' from call_id=2 Frame 19 saved (frame_018.jpg, t=63.3s) [capture-periodic] freeze=1ms shot=112ms unfreeze=1ms saved=True [ComfyUI] [SubprocessWorker] callback 'report_progress' from call_id=2 [ComfyUI] [SubprocessWorker] callback 'report_progress' from call_id=2 [ComfyUI] [SubprocessWorker] callback 'report_progress' from call_id=2 [ComfyUI] [SubprocessWorker] callback 'report_progress' from call_id=2 [ComfyUI] [SubprocessWorker] callback 'report_progress' from call_id=2 [ComfyUI] [SubprocessWorker] callback 'report_progress' from call_id=2 [ComfyUI] [SubprocessWorker] callback 'report_progress' from call_id=2 [ComfyUI] [SubprocessWorker] callback 'report_progress' from call_id=2 [ComfyUI] [SubprocessWorker] callback 'report_progress' from call_id=2 [ComfyUI] [SubprocessWorker] callback 'report_progress' from call_id=2 Frame 20 saved (frame_019.jpg, t=65.5s) [capture-periodic] freeze=1ms shot=96ms unfreeze=10ms saved=True [ComfyUI] [SubprocessWorker] callback 'report_progress' from call_id=2 [ComfyUI] [SubprocessWorker] callback 'report_progress' from call_id=2 [capture-loop] iter=600 t=66.0s state={'complete': False, 'error': None, 'executedCount': 1, 'wsState': 1} eval_ms=1 ram=9.6/31.3GB (31%) swap=1.7/32.0GB (5%) cpu=14% browser_rss=1.09GB [ComfyUI] [SubprocessWorker] callback 'report_progress' from call_id=2 [ComfyUI] [SubprocessWorker] callback 'report_progress' from call_id=2 [ComfyUI] [SubprocessWorker] callback 'report_progress' from call_id=2 [ComfyUI] [SubprocessWorker] callback 'report_progress' from call_id=2 [ComfyUI] [SubprocessWorker] callback 'report_progress' from call_id=2 [ComfyUI] [SubprocessWorker] callback 'report_progress' from call_id=2 [ComfyUI] [SubprocessWorker] callback 'report_progress' from call_id=2 Frame 21 saved (frame_020.jpg, t=67.8s) [capture-periodic] freeze=1ms shot=86ms unfreeze=1ms saved=True [ComfyUI] [SubprocessWorker] callback 'report_progress' from call_id=2 [ComfyUI] [SubprocessWorker] callback 'report_progress' from call_id=2 [ComfyUI] [SubprocessWorker] callback 'report_progress' from call_id=2 [ComfyUI] [worker:ComfyUI-MoGe2] [VRAM] +239MB (now 911MB) reserved=1632MB peak=911MB [ComfyUI] [SubprocessWorker] callback 'report_progress' from call_id=2 [ComfyUI] [SubprocessWorker] callback 'report_progress' from call_id=2 [ComfyUI] [SubprocessWorker] callback 'report_progress' from call_id=2 [ComfyUI] [worker:ComfyUI-MoGe2] [VRAM] -240MB (now 671MB) reserved=1632MB peak=911MB [ComfyUI] [SubprocessWorker] callback 'report_progress' from call_id=2 [ComfyUI] [SubprocessWorker] callback 'report_progress' from call_id=2 Frame 22 saved (frame_021.jpg, t=69.9s) [capture-periodic] freeze=1ms shot=89ms unfreeze=6ms saved=True [ComfyUI] [SubprocessWorker] callback 'report_progress' from call_id=2 [ComfyUI] [SubprocessWorker] callback 'report_progress' from call_id=2 [ComfyUI] [SubprocessWorker] callback 'report_progress' from call_id=2 [ComfyUI] [SubprocessWorker] callback 'report_progress' from call_id=2 [ComfyUI] [SubprocessWorker] callback 'report_progress' from call_id=2 [capture-loop] iter=650 t=71.4s state={'complete': False, 'error': None, 'executedCount': 1, 'wsState': 1} eval_ms=2 ram=10.6/31.3GB (34%) swap=1.7/32.0GB (5%) cpu=13% browser_rss=1.13GB [ComfyUI] [SubprocessWorker] callback 'report_progress' from call_id=2 [ComfyUI] [SubprocessWorker] callback 'report_progress' from call_id=2 [ComfyUI] [SubprocessWorker] callback 'report_progress' from call_id=2 Frame 23 saved (frame_022.jpg, t=72.2s) [capture-periodic] freeze=1ms shot=97ms unfreeze=7ms saved=True [ComfyUI] [SubprocessWorker] callback 'report_progress' from call_id=2 [ComfyUI] [SubprocessWorker] callback 'report_progress' from call_id=2 Frame 24 saved (frame_023.jpg, t=74.3s) [capture-periodic] freeze=1ms shot=93ms unfreeze=6ms saved=True [ComfyUI] [SubprocessWorker] got response: ok [ComfyUI] [comfy-env] Created 1 model patchers: ['MoGeWrapper_1'] [ComfyUI] [comfy-env] MoGe2Inference done (21.24s): result: NodeOutput [ComfyUI] [VRAM] After MoGe2Inference: 4605 / 24122 MB [ComfyUI] [VRAM] Loaded: SubprocessModel (631 MB) Frame 25 saved (frame_024.jpg, t=76.5s) [capture-periodic] freeze=1ms shot=102ms unfreeze=5ms saved=True [ComfyUI] [comfy-env] Running PanoramaDepthMerge: out_width: 4096, out_height: 2048, use_gpu: True, scale_anchor: False, chunk_size: 8, center_weight_power: 2.0, normal_edge_threshold_deg: 0.0, normal_consistency_boost: False, max_ray_distance_m: 0.0, face_points: torch.float32 [42,952,952,3] cpu, extrinsics: torch.float32 [42,4,4] cpu, intrinsics: torch.float32 [42,3,3] cpu, face_valid_masks: torch.float32 [42,952,952] cpu, face_normals: torch.float32 [42,952,952,3] cpu [ComfyUI] [VRAM] Before PanoramaDepthMerge: 4605 / 24122 MB [ComfyUI] [VRAM] Loaded: SubprocessModel (631 MB) [ComfyUI] [SubprocessWorker] call_method: nodes.depth_merge.PanoramaDepthMerge.EXECUTE_NORMALIZED [ComfyUI] [SubprocessWorker] acquired lock, ensuring started... [ComfyUI] [ComfyUI-PanoPack] Health check: ping (timeout=5.0s)... [ComfyUI] [ComfyUI-PanoPack] Health check: ok [ComfyUI] [SubprocessWorker] worker started/confirmed [ComfyUI] [comfy-env] PRE-SERIALIZE 'face_points' shape: torch.Size([42, 952, 952, 3]) [ComfyUI] [comfy-env] PRE-SERIALIZE 'extrinsics' shape: torch.Size([42, 4, 4]) [ComfyUI] [comfy-env] PRE-SERIALIZE 'intrinsics' shape: torch.Size([42, 3, 3]) [ComfyUI] [comfy-env] PRE-SERIALIZE 'face_valid_masks' shape: torch.Size([42, 952, 952]) [ComfyUI] [comfy-env] PRE-SERIALIZE 'face_normals' shape: torch.Size([42, 952, 952, 3]) [ComfyUI] [SubprocessWorker] serializing kwargs to shm... Node executed (2 total), capturing... Frame 26 saved (frame_025.jpg, t=76.9s) [capture-node] freeze=1ms shot=104ms unfreeze=1ms saved=True [ComfyUI] [SubprocessWorker] created 0 shm blocks [ComfyUI] [SubprocessWorker] sending request via socket... [ComfyUI] [SubprocessWorker] call_id=3 sending call_method [ComfyUI] [worker:ComfyUI-PanoPack] [comfy-env] _from_shm got dict with keys: ['__type__', 'strategy', 'parent_pid', 'fd', 'storage_size'] [ComfyUI] [worker:ComfyUI-PanoPack] [comfy-env] DESERIALIZE TensorRef: tensor_size=[42, 952, 952, 3] [ComfyUI] [worker:ComfyUI-PanoPack] [comfy-env] DESERIALIZED tensor shape: torch.Size([42, 952, 952, 3]) [ComfyUI] [worker:ComfyUI-PanoPack] [comfy-env] _from_shm got dict with keys: ['__type__', 'strategy', 'parent_pid', 'fd', 'storage_size'] [ComfyUI] [worker:ComfyUI-PanoPack] [comfy-env] DESERIALIZE TensorRef: tensor_size=[42, 4, 4] [ComfyUI] [worker:ComfyUI-PanoPack] [comfy-env] DESERIALIZED tensor shape: torch.Size([42, 4, 4]) [ComfyUI] [worker:ComfyUI-PanoPack] [comfy-env] _from_shm got dict with keys: ['__type__', 'strategy', 'parent_pid', 'fd', 'storage_size'] [ComfyUI] [worker:ComfyUI-PanoPack] [comfy-env] DESERIALIZE TensorRef: tensor_size=[42, 3, 3] [ComfyUI] [worker:ComfyUI-PanoPack] [comfy-env] DESERIALIZED tensor shape: torch.Size([42, 3, 3]) [ComfyUI] [worker:ComfyUI-PanoPack] [comfy-env] _from_shm got dict with keys: ['__type__', 'strategy', 'parent_pid', 'fd', 'storage_size'] [ComfyUI] [worker:ComfyUI-PanoPack] [comfy-env] DESERIALIZE TensorRef: tensor_size=[42, 952, 952] [ComfyUI] [worker:ComfyUI-PanoPack] [comfy-env] DESERIALIZED tensor shape: torch.Size([42, 952, 952]) [ComfyUI] [worker:ComfyUI-PanoPack] [comfy-env] _from_shm got dict with keys: ['__type__', 'strategy', 'parent_pid', 'fd', 'storage_size'] [capture-loop] iter=700 t=77.3s state={'complete': False, 'error': None, 'executedCount': 2, 'wsState': 1} eval_ms=2 ram=13.6/31.3GB (44%) swap=1.7/32.0GB (5%) cpu=15% browser_rss=1.19GB [ComfyUI] [worker:ComfyUI-PanoPack] [comfy-env] DESERIALIZE TensorRef: tensor_size=[42, 952, 952, 3] [ComfyUI] [worker:ComfyUI-PanoPack] [comfy-env] DESERIALIZED tensor shape: torch.Size([42, 952, 952, 3]) Frame 27 saved (frame_026.jpg, t=79.1s) [capture-periodic] freeze=1ms shot=100ms unfreeze=5ms saved=True [capture-loop] iter=750 t=82.7s state={'complete': False, 'error': None, 'executedCount': 2, 'wsState': 1} eval_ms=2 ram=15.4/31.3GB (49%) swap=1.7/32.0GB (5%) cpu=14% browser_rss=1.18GB [capture-loop] iter=800 t=88.2s state={'complete': False, 'error': None, 'executedCount': 2, 'wsState': 1} eval_ms=1 ram=15.5/31.3GB (50%) swap=1.7/32.0GB (5%) cpu=20% browser_rss=1.10GB [capture-loop] iter=850 t=93.6s state={'complete': False, 'error': None, 'executedCount': 2, 'wsState': 1} eval_ms=2 ram=15.3/31.3GB (49%) swap=1.7/32.0GB (5%) cpu=21% browser_rss=1.10GB [capture-loop] iter=900 t=99.2s state={'complete': False, 'error': None, 'executedCount': 2, 'wsState': 1} eval_ms=3 ram=15.5/31.3GB (50%) swap=1.7/32.0GB (5%) cpu=20% browser_rss=1.10GB [ComfyUI] [worker:ComfyUI-PanoPack] [PanoramaDepthMerge] normals merged: 2048x4096 [ComfyUI] [worker:ComfyUI-PanoPack] [PanoramaDepthMerge] merging 42 faces @ 952x952 -> equirect 2048x4096 (use_gpu=True); input = points (||.|| -> ray distance) [ComfyUI] [SubprocessWorker] callback 'report_progress' from call_id=3 [ComfyUI] [worker:ComfyUI-PanoPack] [PanoramaDepthMerge] top-level peak VRAM estimate: 3.46 GB (4096x2048, N=42, chunk_size=8) [ComfyUI] [SubprocessWorker] callback 'request_vram_budget' from call_id=3 [ComfyUI] [comfy-env] VRAM request: 3.46GB, free before eviction: 20.47GB [ComfyUI] [comfy-env] VRAM after eviction: 20.47GB [ComfyUI] [worker:ComfyUI-PanoPack] [PanoramaDepthMerge] -> requested 3.46 GB eviction via comfy_worker.call_parent [ComfyUI] [worker:ComfyUI-PanoPack] [VRAM] +436MB (now 436MB) reserved=608MB peak=822MB [ComfyUI] /workspaces/Sharp-1914/ComfyUI/custom_nodes/ComfyUI-PanoPack/nodes/_vendor/worldgen/src/panorama_utils.py:349: UserWarning: Sparse CSR tensor support is in beta state. If you miss a functionality in the sparse tensor support, please submit a feature request to https://github.com/pytorch/pytorch/issues. (Triggered internally at /pytorch/aten/src/ATen/SparseCsrTensorImpl.cpp:49.) [ComfyUI] A_gpu = torch.sparse_csr_tensor( [ComfyUI] [worker:ComfyUI-PanoPack] [merge_panorama_depth_gpu 256x128 ] done 0.52s (warp 0.29, build 0.01, LSMR 0.22); N=42 K=8 chunks=6; depth min/med/max = 0.384/0.945/3.091; valid 32768/32768 [ComfyUI] [worker:ComfyUI-PanoPack] [merge_panorama_depth_gpu 512x256 ] done 0.71s (warp 0.08, build 0.02, LSMR 0.07); N=42 K=8 chunks=6; depth min/med/max = 0.384/0.945/3.094; valid 131072/131072 Frame 28 saved (frame_027.jpg, t=101.0s) [capture-periodic] freeze=1ms shot=101ms unfreeze=6ms saved=True [ComfyUI] [worker:ComfyUI-PanoPack] [merge_panorama_depth_gpu 1024x512 ] done 1.04s (warp 0.10, build 0.06, LSMR 0.14); N=42 K=8 chunks=6; depth min/med/max = 0.384/0.945/3.094; valid 524288/524288 [ComfyUI] [worker:ComfyUI-PanoPack] [VRAM] -259MB (now 177MB) reserved=224MB peak=822MB [ComfyUI] [worker:ComfyUI-PanoPack] [ComfyUI] === WATCHDOG TICK 1 === [ComfyUI] [worker:ComfyUI-PanoPack] Thread 0x0000757e127ff640 (most recent call first): [ComfyUI] File "/tmp/comfytest-home/.ce/.pixi/envs/panopack-nodes/lib/python3.10/socket.py", line 293 in accept [ComfyUI] File "/tmp/comfytest-home/.ce/.pixi/envs/panopack-nodes/lib/python3.10/multiprocessing/connection.py", line 609 in accept [ComfyUI] File "/tmp/comfytest-home/.ce/.pixi/envs/panopack-nodes/lib/python3.10/multiprocessing/connection.py", line 463 in accept [ComfyUI] File "/tmp/comfytest-home/.ce/.pixi/envs/panopack-nodes/lib/python3.10/multiprocessing/resource_sharer.py", line 138 in _serve [ComfyUI] File "/tmp/comfytest-home/.ce/.pixi/envs/panopack-nodes/lib/python3.10/threading.py", line 953 in run [ComfyUI] File "/tmp/comfytest-home/.ce/.pixi/envs/panopack-nodes/lib/python3.10/threading.py", line 1016 in _bootstrap_inner [ComfyUI] File "/tmp/comfytest-home/.ce/.pixi/envs/panopack-nodes/lib/python3.10/threading.py", line 973 in _bootstrap [ComfyUI] [ComfyUI] Thread 0x0000757ff35a0640 (most recent call first): [ComfyUI] File "/tmp/comfyui_pvenv_0kgugsfd/persistent_worker.py", line 106 in _vram_poller [ComfyUI] File "/tmp/comfytest-home/.ce/.pixi/envs/panopack-nodes/lib/python3.10/threading.py", line 953 in run [ComfyUI] File "/tmp/comfytest-home/.ce/.pixi/envs/panopack-nodes/lib/python3.10/threading.py", line 1016 in _bootstrap_inner [ComfyUI] File "/tmp/comfytest-home/.ce/.pixi/envs/panopack-nodes/lib/python3.10/threading.py", line 973 in _bootstrap [ComfyUI] [ComfyUI] Current thread 0x0000757ff3da1640 (most recent call first): [ComfyUI] File "/tmp/comfyui_pvenv_0kgugsfd/persistent_worker.py", line 52 in _watchdog [ComfyUI] File "/tmp/comfytest-home/.ce/.pixi/envs/panopack-nodes/lib/python3.10/threading.py", line 953 in run [ComfyUI] File "/tmp/comfytest-home/.ce/.pixi/envs/panopack-nodes/lib/python3.10/threading.py", line 1016 in _bootstrap_inner [ComfyUI] File "/tmp/comfytest-home/.ce/.pixi/envs/panopack-nodes/lib/python3.10/threading.py", line 973 in _bootstrap [ComfyUI] [ComfyUI] Thread 0x0000757ff4377740 (most recent call first): [ComfyUI] File "/workspaces/Sharp-1914/ComfyUI/custom_nodes/ComfyUI-PanoPack/nodes/_vendor/worldgen/src/panorama_utils.py", line 834 in merge_panorama_depth_gpu [ComfyUI] File "/workspaces/Sharp-1914/ComfyUI/custom_nodes/ComfyUI-PanoPack/nodes/_vendor/worldgen/src/panorama_utils.py", line 550 in merge_panorama_depth_gpu [ComfyUI] File "/workspaces/Sharp-1914/ComfyUI/custom_nodes/ComfyUI-PanoPack/nodes/depth_merge.py", line 953 in execute [ComfyUI] File "/workspaces/Sharp-1914/ComfyUI/comfy_api/latest/_io.py", line 1892 in EXECUTE_NORMALIZED [ComfyUI] File "/tmp/comfyui_pvenv_0kgugsfd/persistent_worker.py", line 1762 in main [ComfyUI] File "/tmp/comfyui_pvenv_0kgugsfd/persistent_worker.py", line 1807 in [ComfyUI] [ComfyUI] [worker:ComfyUI-PanoPack] === END === [ComfyUI] [ComfyUI] [worker:ComfyUI-PanoPack] [merge_panorama_depth_gpu 2048x1024] done 2.05s (warp 0.20, build 0.25, LSMR 0.51); N=42 K=8 chunks=6; depth min/med/max = 0.384/0.945/3.095; valid 2097152/2097152 [ComfyUI] [worker:ComfyUI-PanoPack] [VRAM] +682MB (now 859MB) reserved=4960MB peak=859MB [ComfyUI] [worker:ComfyUI-PanoPack] [VRAM] -562MB (now 298MB) reserved=416MB peak=859MB [capture-loop] iter=950 t=104.6s state={'complete': False, 'error': None, 'executedCount': 2, 'wsState': 1} eval_ms=1 ram=16.7/31.3GB (53%) swap=1.7/32.0GB (5%) cpu=13% browser_rss=1.11GB [ComfyUI] [worker:ComfyUI-PanoPack] [VRAM] +671MB (now 970MB) reserved=1088MB peak=970MB [ComfyUI] [worker:ComfyUI-PanoPack] [VRAM] +319MB (now 1290MB) reserved=1376MB peak=1290MB [ComfyUI] [worker:ComfyUI-PanoPack] [merge_panorama_depth_gpu 4096x2048] done 8.27s (warp 0.58, build 3.18, LSMR 2.26); N=42 K=8 chunks=6; depth min/med/max = 0.384/0.945/3.094; valid 8388608/8388608 [ComfyUI] [worker:ComfyUI-PanoPack] [VRAM] -1283MB (now 8MB) reserved=2176MB peak=1898MB [ComfyUI] [worker:ComfyUI-PanoPack] [PanoramaDepthMerge] merged depth: shape (2048, 4096), min=0.384, median=0.945, max=3.094; valid pixels: 8388608 / 8388608 [capture-loop] iter=1000 t=110.1s state={'complete': False, 'error': None, 'executedCount': 2, 'wsState': 1} eval_ms=2 ram=16.1/31.3GB (51%) swap=1.7/32.0GB (5%) cpu=12% browser_rss=1.11GB [capture-loop] iter=1050 t=115.5s state={'complete': False, 'error': None, 'executedCount': 2, 'wsState': 1} eval_ms=2 ram=16.2/31.3GB (52%) swap=1.7/32.0GB (5%) cpu=17% browser_rss=1.11GB [capture-loop] iter=1100 t=121.0s state={'complete': False, 'error': None, 'executedCount': 2, 'wsState': 1} eval_ms=2 ram=16.1/31.3GB (52%) swap=1.7/32.0GB (5%) cpu=17% browser_rss=1.11GB [ComfyUI] [worker:ComfyUI-PanoPack] [PanoramaDepthMerge] debug_image: H=2048+102, mult_disagreement (log-d, sphere-uniform): mean=11.22%, p99=24.69%, max=28.22%; overlap_pixels=8388608 [ComfyUI] [worker:ComfyUI-PanoPack] [headless_gl] prefix=/tmp/comfytest-home/.ce/.pixi/envs/panopack-nodes [ComfyUI] [worker:ComfyUI-PanoPack] [headless_gl] OSMesa: ['libOSMesa.so', 'libOSMesa.so.8', 'libOSMesa.so.8.0.0'] [ComfyUI] [worker:ComfyUI-PanoPack] [headless_gl] env: VTK_DEFAULT_OPENGL_WINDOW=vtkOSOpenGLRenderWindow PYVISTA_OFF_SCREEN=true [ComfyUI] [worker:ComfyUI-PanoPack] [PanoramaDepthMerge] xyz_views: cloud bbox center=(-0.79, -0.31, +0.03) m, size=(4.27 x 3.57 x 1.96) m, N=80000 (subsampled) [ComfyUI] [worker:ComfyUI-PanoPack] [PanoramaDepthMerge] points: merged equirect point map (1, 2048, 4096, 3) [ComfyUI] [SubprocessWorker] callback 'report_progress' from call_id=3 [capture-loop] iter=1150 t=126.4s state={'complete': False, 'error': None, 'executedCount': 2, 'wsState': 1} eval_ms=2 ram=15.3/31.3GB (49%) swap=1.7/32.0GB (5%) cpu=14% browser_rss=1.11GB [ComfyUI] [SubprocessWorker] got response: ok [ComfyUI] [comfy-env] PanoramaDepthMerge done (49.81s): result: NodeOutput [ComfyUI] [VRAM] After PanoramaDepthMerge: 3335 / 24122 MB [ComfyUI] [VRAM] Loaded: SubprocessModel (631 MB) [ComfyUI] [comfy-env] Running PanoramaSplitAdaptive: split_method: 'icosahedron_42', resolution: 1536, fov_degrees: 90.0, use_gpu: True, create_masks: True, mask_method: 'closest_to', panorama: dict, depth_panorama: torch.float32 [1,2048,4096,3] cpu, normals_panorama: torch.float32 [1,2048,4096,3] cpu [ComfyUI] [VRAM] Before PanoramaSplitAdaptive: 3335 / 24122 MB [ComfyUI] [VRAM] Loaded: SubprocessModel (631 MB) [ComfyUI] [SubprocessWorker] call_method: nodes.panorama_split_adaptive.PanoramaSplitAdaptive.EXECUTE_NORMALIZED [ComfyUI] [SubprocessWorker] acquired lock, ensuring started... [ComfyUI] [ComfyUI-PanoPack] Health check: ping (timeout=5.0s)... [ComfyUI] [ComfyUI-PanoPack] Health check: ok [ComfyUI] [SubprocessWorker] worker started/confirmed [ComfyUI] [comfy-env] PRE-SERIALIZE 'depth_panorama' shape: torch.Size([1, 2048, 4096, 3]) [ComfyUI] [comfy-env] PRE-SERIALIZE 'normals_panorama' shape: torch.Size([1, 2048, 4096, 3]) [ComfyUI] [SubprocessWorker] serializing kwargs to shm... Node executed (3 total), capturing... [ComfyUI] [SubprocessWorker] created 0 shm blocks [ComfyUI] [SubprocessWorker] sending request via socket... [ComfyUI] [SubprocessWorker] call_id=4 sending call_method [ComfyUI] [worker:ComfyUI-PanoPack] [comfy-env] _from_shm got dict with keys: ['__type__', 'strategy', 'parent_pid', 'fd', 'storage_size'] [ComfyUI] [worker:ComfyUI-PanoPack] [comfy-env] DESERIALIZE TensorRef: tensor_size=[1, 2048, 4096, 3] [ComfyUI] [worker:ComfyUI-PanoPack] [comfy-env] DESERIALIZED tensor shape: torch.Size([1, 2048, 4096, 3]) [ComfyUI] [worker:ComfyUI-PanoPack] [comfy-env] _from_shm got dict with keys: ['__type__', 'strategy', 'parent_pid', 'fd', 'storage_size'] [ComfyUI] [worker:ComfyUI-PanoPack] [comfy-env] DESERIALIZE TensorRef: tensor_size=[1, 2048, 4096, 3] [ComfyUI] [worker:ComfyUI-PanoPack] [comfy-env] DESERIALIZED tensor shape: torch.Size([1, 2048, 4096, 3]) [ComfyUI] [worker:ComfyUI-PanoPack] [comfy-env] _from_shm got dict with keys: ['__type__', 'strategy', 'parent_pid', 'fd', 'storage_size'] [ComfyUI] [worker:ComfyUI-PanoPack] [comfy-env] DESERIALIZE TensorRef: tensor_size=[1, 2048, 4096, 3] [ComfyUI] [worker:ComfyUI-PanoPack] [comfy-env] DESERIALIZED tensor shape: torch.Size([1, 2048, 4096, 3]) Frame 29 saved (frame_028.jpg, t=127.0s) [capture-node] freeze=2ms shot=105ms unfreeze=5ms saved=True [ComfyUI] [worker:ComfyUI-PanoPack] [PanoramaSplitAdaptive] computing area weights from depth (2048x4096) + normals... [ComfyUI] [worker:ComfyUI-PanoPack] [PanoramaSplitAdaptive] weight range: [1.06, 131], mean=11.7 [ComfyUI] [worker:ComfyUI-PanoPack] [PanoramaSplitAdaptive] adaptive relax: icosahedron_42 (42 cameras), weighted Lloyd... [capture-loop] iter=1200 t=132.1s state={'complete': False, 'error': None, 'executedCount': 3, 'wsState': 1} eval_ms=2 ram=16.2/31.3GB (52%) swap=1.7/32.0GB (5%) cpu=12% browser_rss=1.12GB [capture-loop] iter=1250 t=137.4s state={'complete': False, 'error': None, 'executedCount': 3, 'wsState': 1} eval_ms=2 ram=16.1/31.3GB (52%) swap=1.7/32.0GB (5%) cpu=11% browser_rss=1.12GB [capture-loop] iter=1300 t=142.9s state={'complete': False, 'error': None, 'executedCount': 3, 'wsState': 1} eval_ms=2 ram=16.3/31.3GB (52%) swap=1.7/32.0GB (5%) cpu=12% browser_rss=1.12GB [capture-loop] iter=1350 t=148.3s state={'complete': False, 'error': None, 'executedCount': 3, 'wsState': 1} eval_ms=1 ram=16.5/31.3GB (53%) swap=1.7/32.0GB (5%) cpu=11% browser_rss=1.12GB [ComfyUI] [worker:ComfyUI-PanoPack] [PanoramaSplitAdaptive] Lloyd ran 24 iters (max move 1.42e-02) [ComfyUI] [worker:ComfyUI-PanoPack] [PanoramaSplitAdaptive] Lloyd relaxation done: 42 camera directions in 25.326s [ComfyUI] [worker:ComfyUI-PanoPack] [PanoramaSplitAdaptive] rasterizing 42 faces @ 1536x1536... [capture-loop] iter=1400 t=153.8s state={'complete': False, 'error': None, 'executedCount': 3, 'wsState': 1} eval_ms=2 ram=16.0/31.3GB (51%) swap=1.7/32.0GB (5%) cpu=13% browser_rss=1.12GB [capture-loop] iter=1450 t=159.2s state={'complete': False, 'error': None, 'executedCount': 3, 'wsState': 1} eval_ms=2 ram=16.3/31.3GB (52%) swap=1.7/32.0GB (5%) cpu=11% browser_rss=1.12GB [ComfyUI] [worker:ComfyUI-PanoPack] [VRAM] +756MB (now 764MB) reserved=800MB peak=1898MB [ComfyUI] [worker:ComfyUI-PanoPack] [VRAM] +1230MB (now 1994MB) reserved=3168MB peak=1994MB [ComfyUI] [worker:ComfyUI-PanoPack] [ComfyUI] === WATCHDOG TICK 2 === [ComfyUI] [worker:ComfyUI-PanoPack] Thread 0x0000757e127ff640 (most recent call first): [ComfyUI] File "/tmp/comfytest-home/.ce/.pixi/envs/panopack-nodes/lib/python3.10/socket.py", line 293 in accept [ComfyUI] File "/tmp/comfytest-home/.ce/.pixi/envs/panopack-nodes/lib/python3.10/multiprocessing/connection.py", line 609 in accept [ComfyUI] File "/tmp/comfytest-home/.ce/.pixi/envs/panopack-nodes/lib/python3.10/multiprocessing/connection.py", line 463 in accept [ComfyUI] File "/tmp/comfytest-home/.ce/.pixi/envs/panopack-nodes/lib/python3.10/multiprocessing/resource_sharer.py", line 138 in _serve [ComfyUI] File "/tmp/comfytest-home/.ce/.pixi/envs/panopack-nodes/lib/python3.10/threading.py", line 953 in run [ComfyUI] File "/tmp/comfytest-home/.ce/.pixi/envs/panopack-nodes/lib/python3.10/threading.py", line 1016 in _bootstrap_inner [ComfyUI] File "/tmp/comfytest-home/.ce/.pixi/envs/panopack-nodes/lib/python3.10/threading.py", line 973 in _bootstrap [ComfyUI] [ComfyUI] Thread 0x0000757ff35a0640 (most recent call first): [ComfyUI] File "/tmp/comfyui_pvenv_0kgugsfd/persistent_worker.py", line 106 in _vram_poller [ComfyUI] File "/tmp/comfytest-home/.ce/.pixi/envs/panopack-nodes/lib/python3.10/threading.py", line 953 in run [ComfyUI] File "/tmp/comfytest-home/.ce/.pixi/envs/panopack-nodes/lib/python3.10/threading.py", line 1016 in _bootstrap_inner [ComfyUI] File "/tmp/comfytest-home/.ce/.pixi/envs/panopack-nodes/lib/python3.10/threading.py", line 973 in _bootstrap [ComfyUI] [ComfyUI] Current thread 0x0000757ff3da1640 (most recent call first): [ComfyUI] File "/tmp/comfyui_pvenv_0kgugsfd/persistent_worker.py", line 52 in _watchdog [ComfyUI] File "/tmp/comfytest-home/.ce/.pixi/envs/panopack-nodes/lib/python3.10/threading.py", line 953 in run [ComfyUI] File "/tmp/comfytest-home/.ce/.pixi/envs/panopack-nodes/lib/python3.10/threading.py", line 1016 in _bootstrap_inner [ComfyUI] File "/tmp/comfytest-home/.ce/.pixi/envs/panopack-nodes/lib/python3.10/threading.py", line 973 in _bootstrap [ComfyUI] [ComfyUI] Thread 0x0000757ff4377740 (most recent call first): [ComfyUI] File "/workspaces/Sharp-1914/ComfyUI/custom_nodes/ComfyUI-PanoPack/nodes/panorama_split_adaptive.py", line 439 in execute [ComfyUI] File "/workspaces/Sharp-1914/ComfyUI/comfy_api/latest/_io.py", line 1892 in EXECUTE_NORMALIZED [ComfyUI] File "/tmp/comfyui_pvenv_0kgugsfd/persistent_worker.py", line 1762 in main [ComfyUI] File "/tmp/comfyui_pvenv_0kgugsfd/persistent_worker.py", line 1807 in [ComfyUI] [ComfyUI] [worker:ComfyUI-PanoPack] === END === [ComfyUI] [ComfyUI] [worker:ComfyUI-PanoPack] [VRAM] -1986MB (now 8MB) reserved=3168MB peak=1994MB [ComfyUI] [worker:ComfyUI-PanoPack] [PanoramaSplitAdaptive] rasterized RGB in 10.315s (GPU) [ComfyUI] [worker:ComfyUI-PanoPack] [PanoramaSplitAdaptive] rasterizing depth crops... [capture-loop] iter=1500 t=164.6s state={'complete': False, 'error': None, 'executedCount': 3, 'wsState': 1} eval_ms=1 ram=17.8/31.3GB (57%) swap=1.7/32.0GB (5%) cpu=12% browser_rss=1.12GB [capture-loop] iter=1550 t=170.0s state={'complete': False, 'error': None, 'executedCount': 3, 'wsState': 1} eval_ms=1 ram=18.3/31.3GB (59%) swap=1.7/32.0GB (5%) cpu=11% browser_rss=1.12GB [ComfyUI] [worker:ComfyUI-PanoPack] [VRAM] +756MB (now 764MB) reserved=3168MB peak=1994MB [ComfyUI] [worker:ComfyUI-PanoPack] [VRAM] +1230MB (now 1994MB) reserved=3264MB peak=1994MB [ComfyUI] [worker:ComfyUI-PanoPack] [VRAM] -1986MB (now 8MB) reserved=3264MB peak=1994MB [capture-loop] iter=1600 t=175.5s state={'complete': False, 'error': None, 'executedCount': 3, 'wsState': 1} eval_ms=2 ram=20.8/31.3GB (67%) swap=1.7/32.0GB (5%) cpu=12% browser_rss=1.13GB [ComfyUI] [worker:ComfyUI-PanoPack] [PanoramaSplitAdaptive] rasterizing normals crops... [capture-loop] iter=1650 t=180.8s state={'complete': False, 'error': None, 'executedCount': 3, 'wsState': 1} eval_ms=2 ram=20.4/31.3GB (65%) swap=1.7/32.0GB (5%) cpu=11% browser_rss=1.13GB [ComfyUI] [worker:ComfyUI-PanoPack] [VRAM] +756MB (now 764MB) reserved=3264MB peak=1994MB [capture-loop] iter=1700 t=186.3s state={'complete': False, 'error': None, 'executedCount': 3, 'wsState': 1} eval_ms=1 ram=23.0/31.3GB (74%) swap=1.7/32.0GB (5%) cpu=12% browser_rss=1.13GB [ComfyUI] [worker:ComfyUI-PanoPack] [VRAM] +1230MB (now 1994MB) reserved=3264MB peak=1994MB [ComfyUI] [worker:ComfyUI-PanoPack] [VRAM] -1986MB (now 8MB) reserved=3264MB peak=1994MB [ComfyUI] [worker:ComfyUI-PanoPack] [PanoramaSplitAdaptive] generating closest_to masks... [capture-loop] iter=1750 t=191.6s state={'complete': False, 'error': None, 'executedCount': 3, 'wsState': 1} eval_ms=1 ram=23.0/31.3GB (74%) swap=1.7/32.0GB (5%) cpu=11% browser_rss=1.13GB [capture-loop] iter=1800 t=197.1s state={'complete': False, 'error': None, 'executedCount': 3, 'wsState': 1} eval_ms=2 ram=23.1/31.3GB (74%) swap=1.7/32.0GB (5%) cpu=11% browser_rss=1.13GB [capture-loop] iter=1850 t=202.4s state={'complete': False, 'error': None, 'executedCount': 3, 'wsState': 1} eval_ms=1 ram=22.9/31.3GB (73%) swap=1.7/32.0GB (5%) cpu=11% browser_rss=1.13GB [capture-loop] iter=1900 t=207.9s state={'complete': False, 'error': None, 'executedCount': 3, 'wsState': 1} eval_ms=1 ram=23.2/31.3GB (74%) swap=1.7/32.0GB (5%) cpu=11% browser_rss=1.13GB [capture-loop] iter=1950 t=213.2s state={'complete': False, 'error': None, 'executedCount': 3, 'wsState': 1} eval_ms=1 ram=22.9/31.3GB (73%) swap=1.7/32.0GB (5%) cpu=12% browser_rss=1.12GB [ComfyUI] [worker:ComfyUI-PanoPack] [PanoramaSplitAdaptive] generating debug_masks equirect image... [capture-loop] iter=2000 t=218.7s state={'complete': False, 'error': None, 'executedCount': 3, 'wsState': 1} eval_ms=2 ram=24.5/31.3GB (78%) swap=1.8/32.0GB (6%) cpu=13% browser_rss=1.12GB [ComfyUI] [worker:ComfyUI-PanoPack] [PanoramaSplitAdaptive] pixels/area: lowest 0.243 -> 0.336 (+38% on the worst-sampled cell), highest 6.44 -> 2.85; spread max/min 26.5x -> 8.5x [ComfyUI] [worker:ComfyUI-PanoPack] [PanoramaSplitAdaptive] done: 42 adaptive faces, 94.124s total [ComfyUI] [worker:ComfyUI-PanoPack] [ComfyUI] === WATCHDOG TICK 3 === [ComfyUI] [worker:ComfyUI-PanoPack] Thread 0x0000757e127ff640 (most recent call first): [ComfyUI] File "/tmp/comfytest-home/.ce/.pixi/envs/panopack-nodes/lib/python3.10/socket.py", line 293 in accept [ComfyUI] File "/tmp/comfytest-home/.ce/.pixi/envs/panopack-nodes/lib/python3.10/multiprocessing/connection.py", line 609 in accept [ComfyUI] File "/tmp/comfytest-home/.ce/.pixi/envs/panopack-nodes/lib/python3.10/multiprocessing/connection.py", line 463 in accept [ComfyUI] File "/tmp/comfytest-home/.ce/.pixi/envs/panopack-nodes/lib/python3.10/multiprocessing/resource_sharer.py", line 138 in _serve [ComfyUI] File "/tmp/comfytest-home/.ce/.pixi/envs/panopack-nodes/lib/python3.10/threading.py", line 953 in run [ComfyUI] File "/tmp/comfytest-home/.ce/.pixi/envs/panopack-nodes/lib/python3.10/threading.py", line 1016 in _bootstrap_inner [ComfyUI] File "/tmp/comfytest-home/.ce/.pixi/envs/panopack-nodes/lib/python3.10/threading.py", line 973 in _bootstrap [ComfyUI] [ComfyUI] Thread 0x0000757ff35a0640 (most recent call first): [ComfyUI] File "/tmp/comfyui_pvenv_0kgugsfd/persistent_worker.py", line 106 in _vram_poller [ComfyUI] File "/tmp/comfytest-home/.ce/.pixi/envs/panopack-nodes/lib/python3.10/threading.py", line 953 in run [ComfyUI] File "/tmp/comfytest-home/.ce/.pixi/envs/panopack-nodes/lib/python3.10/threading.py", line 1016 in _bootstrap_inner [ComfyUI] File "/tmp/comfytest-home/.ce/.pixi/envs/panopack-nodes/lib/python3.10/threading.py", line 973 in _bootstrap [ComfyUI] [ComfyUI] Current thread 0x0000757ff3da1640 (most recent call first): [ComfyUI] File "/tmp/comfyui_pvenv_0kgugsfd/persistent_worker.py", line 52 in _watchdog [ComfyUI] File "/tmp/comfytest-home/.ce/.pixi/envs/panopack-nodes/lib/python3.10/threading.py", line 953 in run [ComfyUI] File "/tmp/comfytest-home/.ce/.pixi/envs/panopack-nodes/lib/python3.10/threading.py", line 1016 in _bootstrap_inner [ComfyUI] File "/tmp/comfytest-home/.ce/.pixi/envs/panopack-nodes/lib/python3.10/threading.py", line 973 in _bootstrap [ComfyUI] [ComfyUI] Thread 0x0000757ff4377740 (most recent call first): [ComfyUI] File "/tmp/comfytest-home/.ce/.pixi/envs/panopack-nodes/lib/python3.10/site-packages/torch/storage.py", line 524 in _share_fd_cpu_ [ComfyUI] File "/tmp/comfytest-home/.ce/.pixi/envs/panopack-nodes/lib/python3.10/site-packages/torch/storage.py", line 449 in wrapper [ComfyUI] File "/tmp/comfytest-home/.ce/.pixi/envs/panopack-nodes/lib/python3.10/site-packages/torch/storage.py", line 400 in share_memory_ [ComfyUI] File "/tmp/comfytest-home/.ce/.pixi/envs/panopack-nodes/lib/python3.10/site-packages/torch/storage.py", line 520 in share_memory_ [ComfyUI] File "/tmp/comfytest-home/.ce/.pixi/envs/panopack-nodes/lib/python3.10/site-packages/torch/storage.py", line 449 in wrapper [ComfyUI] File "/tmp/comfytest-home/.ce/.pixi/envs/panopack-nodes/lib/python3.10/site-packages/torch/storage.py", line 1193 in _share_memory_ [ComfyUI] File "/tmp/comfytest-home/.ce/.pixi/envs/panopack-nodes/lib/python3.10/site-packages/torch/_tensor.py", line 853 in share_memory_ [ComfyUI] File "/tmp/comfyui_pvenv_0kgugsfd/persistent_worker.py", line 563 in _serialize_tensor_native [ComfyUI] File "/tmp/comfyui_pvenv_0kgugsfd/persistent_worker.py", line 628 in _to_shm [ComfyUI] File "/tmp/comfyui_pvenv_0kgugsfd/persistent_worker.py", line 705 in [ComfyUI] File "/tmp/comfyui_pvenv_0kgugsfd/persistent_worker.py", line 705 in _to_shm [ComfyUI] File "/tmp/comfyui_pvenv_0kgugsfd/persistent_worker.py", line 692 in _to_shm [ComfyUI] File "/tmp/comfyui_pvenv_0kgugsfd/persistent_worker.py", line 1772 in main [ComfyUI] File "/tmp/comfyui_pvenv_0kgugsfd/persistent_worker.py", line 1807 in [ComfyUI] [ComfyUI] [worker:ComfyUI-PanoPack] === END === [ComfyUI] [ComfyUI] [SubprocessWorker] got response: error [ComfyUI] [ERROR] !!! Exception during processing !!! unable to allocate shared memory(shm) for file : Success (0) [ComfyUI] [ComfyUI] Worker traceback: [ComfyUI] Traceback (most recent call last): [ComfyUI] File "/tmp/comfyui_pvenv_0kgugsfd/persistent_worker.py", line 1772, in main [ComfyUI] result_meta = _to_shm(result, shm_registry) [ComfyUI] File "/tmp/comfyui_pvenv_0kgugsfd/persistent_worker.py", line 692, in _to_shm [ComfyUI] "args": _to_shm(list(obj.args), registry, visited), [ComfyUI] File "/tmp/comfyui_pvenv_0kgugsfd/persistent_worker.py", line 705, in _to_shm [ComfyUI] result = [_to_shm(v, registry, visited) for v in obj] [ComfyUI] File "/tmp/comfyui_pvenv_0kgugsfd/persistent_worker.py", line 705, in [ComfyUI] result = [_to_shm(v, registry, visited) for v in obj] [ComfyUI] File "/tmp/comfyui_pvenv_0kgugsfd/persistent_worker.py", line 628, in _to_shm [ComfyUI] result = _serialize_tensor_native(tensor, registry) [ComfyUI] File "/tmp/comfyui_pvenv_0kgugsfd/persistent_worker.py", line 563, in _serialize_tensor_native [ComfyUI] t.share_memory_() [ComfyUI] File "/tmp/comfytest-home/.ce/.pixi/envs/panopack-nodes/lib/python3.10/site-packages/torch/_tensor.py", line 853, in share_memory_ [ComfyUI] self._typed_storage()._share_memory_() [ComfyUI] File "/tmp/comfytest-home/.ce/.pixi/envs/panopack-nodes/lib/python3.10/site-packages/torch/storage.py", line 1193, in _share_memory_ [ComfyUI] self._untyped_storage.share_memory_() [ComfyUI] File "/tmp/comfytest-home/.ce/.pixi/envs/panopack-nodes/lib/python3.10/site-packages/torch/storage.py", line 449, in wrapper [ComfyUI] return fn(self, *args, **kwargs) [ComfyUI] File "/tmp/comfytest-home/.ce/.pixi/envs/panopack-nodes/lib/python3.10/site-packages/torch/storage.py", line 520, in share_memory_ [ComfyUI] return super().share_memory_(*args, **kwargs) [ComfyUI] File "/tmp/comfytest-home/.ce/.pixi/envs/panopack-nodes/lib/python3.10/site-packages/torch/storage.py", line 400, in share_memory_ [ComfyUI] self._share_fd_cpu_() [ComfyUI] File "/tmp/comfytest-home/.ce/.pixi/envs/panopack-nodes/lib/python3.10/site-packages/torch/storage.py", line 449, in wrapper [ComfyUI] return fn(self, *args, **kwargs) [ComfyUI] File "/tmp/comfytest-home/.ce/.pixi/envs/panopack-nodes/lib/python3.10/site-packages/torch/storage.py", line 524, in _share_fd_cpu_ [ComfyUI] return super()._share_fd_cpu_(*args, **kwargs) [ComfyUI] RuntimeError: unable to allocate shared memory(shm) for file : Success (0) [ComfyUI] [ComfyUI] [ERROR] Traceback (most recent call last): [ComfyUI] File "/workspaces/Sharp-1914/ComfyUI/execution.py", line 536, in execute [ComfyUI] output_data, output_ui, has_subgraph, has_pending_tasks = await get_output_data(prompt_id, unique_id, obj, input_data_all, execution_block_cb=execution_block_cb, pre_execute_cb=pre_execute_cb, v3_data=v3_data) [ComfyUI] File "/workspaces/Sharp-1914/ComfyUI/execution.py", line 336, in get_output_data [ComfyUI] return_values = await _async_map_node_over_list(prompt_id, unique_id, obj, input_data_all, obj.FUNCTION, allow_interrupt=True, execution_block_cb=execution_block_cb, pre_execute_cb=pre_execute_cb, v3_data=v3_data) [ComfyUI] File "/workspaces/Sharp-1914/ComfyUI/execution.py", line 310, in _async_map_node_over_list [ComfyUI] await process_inputs(input_dict, i) [ComfyUI] File "/workspaces/Sharp-1914/ComfyUI/execution.py", line 298, in process_inputs [ComfyUI] result = f(**inputs) [ComfyUI] File "/workspaces/Sharp-1914/.venv/lib/python3.10/site-packages/comfy_env/isolation/metadata.py", line 556, in proxy [ComfyUI] result = worker.call_method( [ComfyUI] File "/workspaces/Sharp-1914/.venv/lib/python3.10/site-packages/comfy_env/isolation/workers/subprocess.py", line 674, in call_method [ComfyUI] raise WorkerError( [ComfyUI] comfy_env.isolation.workers.base.WorkerError: unable to allocate shared memory(shm) for file : Success (0) [ComfyUI] [ComfyUI] Worker traceback: [ComfyUI] Traceback (most recent call last): [ComfyUI] File "/tmp/comfyui_pvenv_0kgugsfd/persistent_worker.py", line 1772, in main [ComfyUI] result_meta = _to_shm(result, shm_registry) [ComfyUI] File "/tmp/comfyui_pvenv_0kgugsfd/persistent_worker.py", line 692, in _to_shm [ComfyUI] "args": _to_shm(list(obj.args), registry, visited), [ComfyUI] File "/tmp/comfyui_pvenv_0kgugsfd/persistent_worker.py", line 705, in _to_shm [ComfyUI] result = [_to_shm(v, registry, visited) for v in obj] [ComfyUI] File "/tmp/comfyui_pvenv_0kgugsfd/persistent_worker.py", line 705, in [ComfyUI] result = [_to_shm(v, registry, visited) for v in obj] [ComfyUI] File "/tmp/comfyui_pvenv_0kgugsfd/persistent_worker.py", line 628, in _to_shm [ComfyUI] result = _serialize_tensor_native(tensor, registry) [ComfyUI] File "/tmp/comfyui_pvenv_0kgugsfd/persistent_worker.py", line 563, in _serialize_tensor_native [ComfyUI] t.share_memory_() [ComfyUI] File "/tmp/comfytest-home/.ce/.pixi/envs/panopack-nodes/lib/python3.10/site-packages/torch/_tensor.py", line 853, in share_memory_ [ComfyUI] self._typed_storage()._share_memory_() [ComfyUI] File "/tmp/comfytest-home/.ce/.pixi/envs/panopack-nodes/lib/python3.10/site-packages/torch/storage.py", line 1193, in _share_memory_ [ComfyUI] self._untyped_storage.share_memory_() [ComfyUI] File "/tmp/comfytest-home/.ce/.pixi/envs/panopack-nodes/lib/python3.10/site-packages/torch/storage.py", line 449, in wrapper [ComfyUI] return fn(self, *args, **kwargs) [ComfyUI] File "/tmp/comfytest-home/.ce/.pixi/envs/panopack-nodes/lib/python3.10/site-packages/torch/storage.py", line 520, in share_memory_ [ComfyUI] return super().share_memory_(*args, **kwargs) [ComfyUI] File "/tmp/comfytest-home/.ce/.pixi/envs/panopack-nodes/lib/python3.10/site-packages/torch/storage.py", line 400, in share_memory_ [ComfyUI] self._share_fd_cpu_() [ComfyUI] File "/tmp/comfytest-home/.ce/.pixi/envs/panopack-nodes/lib/python3.10/site-packages/torch/storage.py", line 449, in wrapper [ComfyUI] return fn(self, *args, **kwargs) [ComfyUI] File "/tmp/comfytest-home/.ce/.pixi/envs/panopack-nodes/lib/python3.10/site-packages/torch/storage.py", line 524, in _share_fd_cpu_ [ComfyUI] return super()._share_fd_cpu_(*args, **kwargs) [ComfyUI] RuntimeError: unable to allocate shared memory(shm) for file : Success (0) [ComfyUI] [ComfyUI] [ComfyUI] [INFO] Prompt executed in 223.04 seconds Execution complete (t=223.6s) Execution error: {'prompt_id': '16f9d308-d076-4c5d-9a60-1719bd41817a', 'node_id': '87', 'node_type': 'PanoramaSplitAdaptive', 'executed': ['7', '81', '61', '96', '9', '70', '62', '59', '80', '60', '68'], 'exception_message': 'unable to allocate shared memory(shm) for file : Success (0)\n\nWorker traceback:\nTraceback (most recent call last):\n File "/tmp/comfyui_pvenv_0kgugsfd/persistent_worker.py", line 1772, in main\n result_meta = _to_shm(result, shm_registry)\n File "/tmp/comfyui_pvenv_0kgugsfd/persistent_worker.py", line 692, in _to_shm\n "args": _to_shm(list(obj.args), registry, visited),\n File "/tmp/comfyui_pvenv_0kgugsfd/persistent_worker.py", line 705, in _to_shm\n result = [_to_shm(v, registry, visited) for v in obj]\n File "/tmp/comfyui_pvenv_0kgugsfd/persistent_worker.py", line 705, in \n result = [_to_shm(v, registry, visited) for v in obj]\n File "/tmp/comfyui_pvenv_0kgugsfd/persistent_worker.py", line 628, in _to_shm\n result = _serialize_tensor_native(tensor, registry)\n File "/tmp/comfyui_pvenv_0kgugsfd/persistent_worker.py", line 563, in _serialize_tensor_native\n t.share_memory_()\n File "/tmp/comfytest-home/.ce/.pixi/envs/panopack-nodes/lib/python3.10/site-packages/torch/_tensor.py", line 853, in share_memory_\n self._typed_storage()._share_memory_()\n File "/tmp/comfytest-home/.ce/.pixi/envs/panopack-nodes/lib/python3.10/site-packages/torch/storage.py", line 1193, in _share_memory_\n self._untyped_storage.share_memory_()\n File "/tmp/comfytest-home/.ce/.pixi/envs/panopack-nodes/lib/python3.10/site-packages/torch/storage.py", line 449, in wrapper\n return fn(self, *args, **kwargs)\n File "/tmp/comfytest-home/.ce/.pixi/envs/panopack-nodes/lib/python3.10/site-packages/torch/storage.py", line 520, in share_memory_\n return super().share_memory_(*args, **kwargs)\n File "/tmp/comfytest-home/.ce/.pixi/envs/panopack-nodes/lib/python3.10/site-packages/torch/storage.py", line 400, in share_memory_\n self._share_fd_cpu_()\n File "/tmp/comfytest-home/.ce/.pixi/envs/panopack-nodes/lib/python3.10/site-packages/torch/storage.py", line 449, in wrapper\n return fn(self, *args, **kwargs)\n File "/tmp/comfytest-home/.ce/.pixi/envs/panopack-nodes/lib/python3.10/site-packages/torch/storage.py", line 524, in _share_fd_cpu_\n return super()._share_fd_cpu_(*args, **kwargs)\nRuntimeError: unable to allocate shared memory(shm) for file : Success (0)\n\n', 'exception_type': 'comfy_env.isolation.workers.base.WorkerError', 'traceback': [' File "/workspaces/Sharp-1914/ComfyUI/execution.py", line 536, in execute\n output_data, output_ui, has_subgraph, has_pending_tasks = await get_output_data(prompt_id, unique_id, obj, input_data_all, execution_block_cb=execution_block_cb, pre_execute_cb=pre_execute_cb, v3_data=v3_data)\n', ' File "/workspaces/Sharp-1914/ComfyUI/execution.py", line 336, in get_output_data\n return_values = await _async_map_node_over_list(prompt_id, unique_id, obj, input_data_all, obj.FUNCTION, allow_interrupt=True, execution_block_cb=execution_block_cb, pre_execute_cb=pre_execute_cb, v3_data=v3_data)\n', ' File "/workspaces/Sharp-1914/ComfyUI/execution.py", line 310, in _async_map_node_over_list\n await process_inputs(input_dict, i)\n', ' File "/workspaces/Sharp-1914/ComfyUI/execution.py", line 298, in process_inputs\n result = f(**inputs)\n', ' File "/workspaces/Sharp-1914/.venv/lib/python3.10/site-packages/comfy_env/isolation/metadata.py", line 556, in proxy\n result = worker.call_method(\n', ' File "/workspaces/Sharp-1914/.venv/lib/python3.10/site-packages/comfy_env/isolation/workers/subprocess.py", line 674, in call_method\n raise WorkerError(\n'], 'current_inputs': {'split_method': ['icosahedron_42'], 'resolution': [1536], 'fov_degrees': [90], 'use_gpu': [True], 'create_masks': [True], 'mask_method': ['closest_to'], 'panorama': ["{'image': tensor([[[[0.1647, 0.1020, 0.0745],\n [0.1765, 0.1098, 0.0863],\n [0.1765, 0.1137, 0.0941],\n ...,\n [0.1647, 0.1137, 0.0941],\n [0.1647, 0.1098, 0.0902],\n [0.1333, 0.0784, 0.0667]],\n\n [[0.1922, 0.1255, 0.0902],\n [0.1843, 0.1216, 0.0902],\n [0.1922, 0.1255, 0.0980],\n ...,\n [0.1765, 0.1255, 0.0980],\n [0.1725, 0.1255, 0.1020],\n [0.1647, 0.1059, 0.0824]],\n\n [[0.1882, 0.1216, 0.0980],\n [0.1843, 0.1216, 0.0980],\n [0.1882, 0.1216, 0.0980],\n ...,\n [0.1804, 0.1333, 0.1020],\n [0.1804, 0.1373, 0.1098],\n [0.1569, 0.1059, 0.0863]],\n\n ...,\n\n [[0.1882, 0.1255, 0.1176],\n [0.1922, 0.1255, 0.1176],\n [0.1922, 0.1255, 0.1176],\n ...,\n [0.1176, 0.1333, 0.1412],\n [0.1686, 0.1529, 0.1451],\n [0.1843, 0.1569, 0.1333]],\n\n [[0.1882, 0.1255, 0.1176],\n [0.1882, 0.1255, 0.1137],\n [0.1922, 0.1255, 0.1176],\n ...,\n [0.1647, 0.1412, 0.1098],\n [0.1922, 0.1529, 0.1176],\n [0.2039, 0.1490, 0.1294]],\n\n [[0.1765, 0.1137, 0.1137],\n [0.1804, 0.1255, 0.1216],\n [0.1765, 0.1216, 0.1137],\n ...,\n [0.1961, 0.1725, 0.1412],\n [0.1647, 0.1451, 0.1333],\n [0.1843, 0.1137, 0.1373]]]]), 'meta': {}}"], 'depth_panorama': ['tensor([[[[0.7430, 0.7430, 0.7430],\n [0.7430, 0.7430, 0.7430],\n [0.7430, 0.7430, 0.7430],\n ...,\n [0.7430, 0.7430, 0.7430],\n [0.7430, 0.7430, 0.7430],\n [0.7430, 0.7430, 0.7430]],\n\n [[0.7429, 0.7429, 0.7429],\n [0.7429, 0.7429, 0.7429],\n [0.7429, 0.7429, 0.7429],\n ...,\n [0.7429, 0.7429, 0.7429],\n [0.7429, 0.7429, 0.7429],\n [0.7429, 0.7429, 0.7429]],\n\n [[0.7430, 0.7430, 0.7430],\n [0.7430, 0.7430, 0.7430],\n [0.7430, 0.7430, 0.7430],\n ...,\n [0.7430, 0.7430, 0.7430],\n [0.7430, 0.7430, 0.7430],\n [0.7430, 0.7430, 0.7430]],\n\n ...,\n\n [[0.8810, 0.8810, 0.8810],\n [0.8810, 0.8810, 0.8810],\n [0.8810, 0.8810, 0.8810],\n ...,\n [0.8810, 0.8810, 0.8810],\n [0.8810, 0.8810, 0.8810],\n [0.8810, 0.8810, 0.8810]],\n\n [[0.8811, 0.8811, 0.8811],\n [0.8811, 0.8811, 0.8811],\n [0.8811, 0.8811, 0.8811],\n ...,\n [0.8811, 0.8811, 0.8811],\n [0.8811, 0.8811, 0.8811],\n [0.8811, 0.8811, 0.8811]],\n\n [[0.8813, 0.8813, 0.8813],\n [0.8813, 0.8813, 0.8813],\n [0.8813, 0.8813, 0.8813],\n ...,\n [0.8813, 0.8813, 0.8813],\n [0.8813, 0.8813, 0.8813],\n [0.8813, 0.8813, 0.8813]]]])'], 'normals_panorama': ['tensor([[[[4.8400e-01, 5.0399e-01, 2.7195e-04],\n [4.8401e-01, 5.0400e-01, 2.7180e-04],\n [4.8401e-01, 5.0400e-01, 2.7180e-04],\n ...,\n [4.8401e-01, 5.0399e-01, 2.7168e-04],\n [4.8401e-01, 5.0399e-01, 2.7168e-04],\n [4.8400e-01, 5.0399e-01, 2.7195e-04]],\n\n [[4.8384e-01, 5.0488e-01, 2.8512e-04],\n [4.8384e-01, 5.0488e-01, 2.8512e-04],\n [4.8384e-01, 5.0488e-01, 2.8512e-04],\n ...,\n [4.8384e-01, 5.0488e-01, 2.8512e-04],\n [4.8384e-01, 5.0488e-01, 2.8512e-04],\n [4.8384e-01, 5.0488e-01, 2.8512e-04]],\n\n [[4.8386e-01, 5.0571e-01, 2.9308e-04],\n [4.8386e-01, 5.0571e-01, 2.9308e-04],\n [4.8386e-01, 5.0571e-01, 2.9308e-04],\n ...,\n [4.8386e-01, 5.0571e-01, 2.9308e-04],\n [4.8386e-01, 5.0571e-01, 2.9308e-04],\n [4.8386e-01, 5.0571e-01, 2.9308e-04]],\n\n ...,\n\n [[4.9929e-01, 5.1112e-01, 9.9988e-01],\n [4.9929e-01, 5.1112e-01, 9.9988e-01],\n [4.9929e-01, 5.1112e-01, 9.9988e-01],\n ...,\n [4.9929e-01, 5.1112e-01, 9.9988e-01],\n [4.9929e-01, 5.1112e-01, 9.9988e-01],\n [4.9929e-01, 5.1112e-01, 9.9988e-01]],\n\n [[4.9880e-01, 5.1144e-01, 9.9987e-01],\n [4.9880e-01, 5.1144e-01, 9.9987e-01],\n [4.9880e-01, 5.1144e-01, 9.9987e-01],\n ...,\n [4.9880e-01, 5.1144e-01, 9.9987e-01],\n [4.9880e-01, 5.1144e-01, 9.9987e-01],\n [4.9880e-01, 5.1144e-01, 9.9987e-01]],\n\n [[4.9943e-01, 5.1242e-01, 9.9985e-01],\n [4.9943e-01, 5.1242e-01, 9.9985e-01],\n [4.9943e-01, 5.1242e-01, 9.9985e-01],\n ...,\n [4.9943e-01, 5.1242e-01, 9.9985e-01],\n [4.9943e-01, 5.1242e-01, 9.9985e-01],\n [4.9943e-01, 5.1242e-01, 9.9985e-01]]]])']}, 'current_outputs': ['7', '61', '81', '54', '96', '87', '9', '62', '70', '59', '76', '73', '80', '89', '95', '68', '78', '60'], 'timestamp': 1780860292737} Status: FAILED Error: Workflow execution failed: {'prompt_id': '16f9d308-d076-4c5d-9a60-1719bd41817a', 'node_id': '87', 'node_type': 'PanoramaSplitAdaptive', 'executed': ['7', '81', '61', '96', '9', '70', '62', '59', '80', '60', '68'], 'exception_message': 'unable to allocate shared memory(shm) for file : Success (0)\n\nWorker traceback:\nTraceback (most recent call last):\n File "/tmp/comfyui_pvenv_0kgugsfd/persistent_worker.py", line 1772, in main\n result_meta = _to_shm(result, shm_registry)\n File "/tmp/comfyui_pvenv_0kgugsfd/persistent_worker.py", line 692, in _to_shm\n "args": _to_shm(list(obj.args), registry, visited),\n File "/tmp/comfyui_pvenv_0kgugsfd/persistent_worker.py", line 705, in _to_shm\n result = [_to_shm(v, registry, visited) for v in obj]\n File "/tmp/comfyui_pvenv_0kgugsfd/persistent_worker.py", line 705, in \n result = [_to_shm(v, registry, visited) for v in obj]\n File "/tmp/comfyui_pvenv_0kgugsfd/persistent_worker.py", line 628, in _to_shm\n result = _serialize_tensor_native(tensor, registry)\n File "/tmp/comfyui_pvenv_0kgugsfd/persistent_worker.py", line 563, in _serialize_tensor_native\n t.share_memory_()\n File "/tmp/comfytest-home/.ce/.pixi/envs/panopack-nodes/lib/python3.10/site-packages/torch/_tensor.py", line 853, in share_memory_\n self._typed_storage()._share_memory_()\n File "/tmp/comfytest-home/.ce/.pixi/envs/panopack-nodes/lib/python3.10/site-packages/torch/storage.py", line 1193, in _share_memory_\n self._untyped_storage.share_memory_()\n File "/tmp/comfytest-home/.ce/.pixi/envs/panopack-nodes/lib/python3.10/site-packages/torch/storage.py", line 449, in wrapper\n return fn(self, *args, **kwargs)\n File "/tmp/comfytest-home/.ce/.pixi/envs/panopack-nodes/lib/python3.10/site-packages/torch/storage.py", line 520, in share_memory_\n return super().share_memory_(*args, **kwargs)\n File "/tmp/comfytest-home/.ce/.pixi/envs/panopack-nodes/lib/python3.10/site-packages/torch/storage.py", line 400, in share_memory_\n self._share_fd_cpu_()\n File "/tmp/comfytest-home/.ce/.pixi/envs/panopack-nodes/lib/python3.10/site-packages/torch/storage.py", line 449, in wrapper\n return fn(self, *args, **kwargs)\n File "/tmp/comfytest-home/.ce/.pixi/envs/panopack-nodes/lib/python3.10/site-packages/torch/storage.py", line 524, in _share_fd_cpu_\n return super()._share_fd_cpu_(*args, **kwargs)\nRuntimeError: unable to allocate shared memory(shm) for file : Success (0)\n\n', 'exception_type': 'comfy_env.isolation.workers.base.WorkerError', 'traceback': [' File "/workspaces/Sharp-1914/ComfyUI/execution.py", line 536, in execute\n output_data, output_ui, has_subgraph, has_pending_tasks = await get_output_data(prompt_id, unique_id, obj, input_data_all, execution_block_cb=execution_block_cb, pre_execute_cb=pre_execute_cb, v3_data=v3_data)\n', ' File "/workspaces/Sharp-1914/ComfyUI/execution.py", line 336, in get_output_data\n return_values = await _async_map_node_over_list(prompt_id, unique_id, obj, input_data_all, obj.FUNCTION, allow_interrupt=True, execution_block_cb=execution_block_cb, pre_execute_cb=pre_execute_cb, v3_data=v3_data)\n', ' File "/workspaces/Sharp-1914/ComfyUI/execution.py", line 310, in _async_map_node_over_list\n await process_inputs(input_dict, i)\n', ' File "/workspaces/Sharp-1914/ComfyUI/execution.py", line 298, in process_inputs\n result = f(**inputs)\n', ' File "/workspaces/Sharp-1914/.venv/lib/python3.10/site-packages/comfy_env/isolation/metadata.py", line 556, in proxy\n result = worker.call_method(\n', ' File "/workspaces/Sharp-1914/.venv/lib/python3.10/site-packages/comfy_env/isolation/workers/subprocess.py", line 674, in call_method\n raise WorkerError(\n'], 'current_inputs': {'split_method': ['icosahedron_42'], 'resolution': [1536], 'fov_degrees': [90], 'use_gpu': [True], 'create_masks': [True], 'mask_method': ['closest_to'], 'panorama': ["{'image': tensor([[[[0.1647, 0.1020, 0.0745],\n [0.1765, 0.1098, 0.0863],\n [0.1765, 0.1137, 0.0941],\n ...,\n [0.1647, 0.1137, 0.0941],\n [0.1647, 0.1098, 0.0902],\n [0.1333, 0.0784, 0.0667]],\n\n [[0.1922, 0.1255, 0.0902],\n [0.1843, 0.1216, 0.0902],\n [0.1922, 0.1255, 0.0980],\n ...,\n [0.1765, 0.1255, 0.0980],\n [0.1725, 0.1255, 0.1020],\n [0.1647, 0.1059, 0.0824]],\n\n [[0.1882, 0.1216, 0.0980],\n [0.1843, 0.1216, 0.0980],\n [0.1882, 0.1216, 0.0980],\n ...,\n [0.1804, 0.1333, 0.1020],\n [0.1804, 0.1373, 0.1098],\n [0.1569, 0.1059, 0.0863]],\n\n ...,\n\n [[0.1882, 0.1255, 0.1176],\n [0.1922, 0.1255, 0.1176],\n [0.1922, 0.1255, 0.1176],\n ...,\n [0.1176, 0.1333, 0.1412],\n [0.1686, 0.1529, 0.1451],\n [0.1843, 0.1569, 0.1333]],\n\n [[0.1882, 0.1255, 0.1176],\n [0.1882, 0.1255, 0.1137],\n [0.1922, 0.1255, 0.1176],\n ...,\n [0.1647, 0.1412, 0.1098],\n [0.1922, 0.1529, 0.1176],\n [0.2039, 0.1490, 0.1294]],\n\n [[0.1765, 0.1137, 0.1137],\n [0.1804, 0.1255, 0.1216],\n [0.1765, 0.1216, 0.1137],\n ...,\n [0.1961, 0.1725, 0.1412],\n [0.1647, 0.1451, 0.1333],\n [0.1843, 0.1137, 0.1373]]]]), 'meta': {}}"], 'depth_panorama': ['tensor([[[[0.7430, 0.7430, 0.7430],\n [0.7430, 0.7430, 0.7430],\n [0.7430, 0.7430, 0.7430],\n ...,\n [0.7430, 0.7430, 0.7430],\n [0.7430, 0.7430, 0.7430],\n [0.7430, 0.7430, 0.7430]],\n\n [[0.7429, 0.7429, 0.7429],\n [0.7429, 0.7429, 0.7429],\n [0.7429, 0.7429, 0.7429],\n ...,\n [0.7429, 0.7429, 0.7429],\n [0.7429, 0.7429, 0.7429],\n [0.7429, 0.7429, 0.7429]],\n\n [[0.7430, 0.7430, 0.7430],\n [0.7430, 0.7430, 0.7430],\n [0.7430, 0.7430, 0.7430],\n ...,\n [0.7430, 0.7430, 0.7430],\n [0.7430, 0.7430, 0.7430],\n [0.7430, 0.7430, 0.7430]],\n\n ...,\n\n [[0.8810, 0.8810, 0.8810],\n [0.8810, 0.8810, 0.8810],\n [0.8810, 0.8810, 0.8810],\n ...,\n [0.8810, 0.8810, 0.8810],\n [0.8810, 0.8810, 0.8810],\n [0.8810, 0.8810, 0.8810]],\n\n [[0.8811, 0.8811, 0.8811],\n [0.8811, 0.8811, 0.8811],\n [0.8811, 0.8811, 0.8811],\n ...,\n [0.8811, 0.8811, 0.8811],\n [0.8811, 0.8811, 0.8811],\n [0.8811, 0.8811, 0.8811]],\n\n [[0.8813, 0.8813, 0.8813],\n [0.8813, 0.8813, 0.8813],\n [0.8813, 0.8813, 0.8813],\n ...,\n [0.8813, 0.8813, 0.8813],\n [0.8813, 0.8813, 0.8813],\n [0.8813, 0.8813, 0.8813]]]])'], 'normals_panorama': ['tensor([[[[4.8400e-01, 5.0399e-01, 2.7195e-04],\n [4.8401e-01, 5.0400e-01, 2.7180e-04],\n [4.8401e-01, 5.0400e-01, 2.7180e-04],\n ...,\n [4.8401e-01, 5.0399e-01, 2.7168e-04],\n [4.8401e-01, 5.0399e-01, 2.7168e-04],\n [4.8400e-01, 5.0399e-01, 2.7195e-04]],\n\n [[4.8384e-01, 5.0488e-01, 2.8512e-04],\n [4.8384e-01, 5.0488e-01, 2.8512e-04],\n [4.8384e-01, 5.0488e-01, 2.8512e-04],\n ...,\n [4.8384e-01, 5.0488e-01, 2.8512e-04],\n [4.8384e-01, 5.0488e-01, 2.8512e-04],\n [4.8384e-01, 5.0488e-01, 2.8512e-04]],\n\n [[4.8386e-01, 5.0571e-01, 2.9308e-04],\n [4.8386e-01, 5.0571e-01, 2.9308e-04],\n [4.8386e-01, 5.0571e-01, 2.9308e-04],\n ...,\n [4.8386e-01, 5.0571e-01, 2.9308e-04],\n [4.8386e-01, 5.0571e-01, 2.9308e-04],\n [4.8386e-01, 5.0571e-01, 2.9308e-04]],\n\n ...,\n\n [[4.9929e-01, 5.1112e-01, 9.9988e-01],\n [4.9929e-01, 5.1112e-01, 9.9988e-01],\n [4.9929e-01, 5.1112e-01, 9.9988e-01],\n ...,\n [4.9929e-01, 5.1112e-01, 9.9988e-01],\n [4.9929e-01, 5.1112e-01, 9.9988e-01],\n [4.9929e-01, 5.1112e-01, 9.9988e-01]],\n\n [[4.9880e-01, 5.1144e-01, 9.9987e-01],\n [4.9880e-01, 5.1144e-01, 9.9987e-01],\n [4.9880e-01, 5.1144e-01, 9.9987e-01],\n ...,\n [4.9880e-01, 5.1144e-01, 9.9987e-01],\n [4.9880e-01, 5.1144e-01, 9.9987e-01],\n [4.9880e-01, 5.1144e-01, 9.9987e-01]],\n\n [[4.9943e-01, 5.1242e-01, 9.9985e-01],\n [4.9943e-01, 5.1242e-01, 9.9985e-01],\n [4.9943e-01, 5.1242e-01, 9.9985e-01],\n ...,\n [4.9943e-01, 5.1242e-01, 9.9985e-01],\n [4.9943e-01, 5.1242e-01, 9.9985e-01],\n [4.9943e-01, 5.1242e-01, 9.9985e-01]]]])']}, 'current_outputs': ['7', '61', '81', '54', '96', '87', '9', '62', '70', '59', '76', '73', '80', '89', '95', '68', '78', '60'], 'timestamp': 1780860292737} Details: Workflow: /node/ComfyUI-Sharp/workflows/pano.json Node error: PanoramaSplitAdaptive