1200 lines
112 KiB
Plaintext
1200 lines
112 KiB
Plaintext
Capturing execution frames: pano.json
|
||
[ComfyUI] [32m[INFO][0m Using RAM pressure cache.
|
||
[ComfyUI] [32m[INFO][0m Using RAM pressure cache.
|
||
Frame 1 saved (frame_000.jpg, t=0.0s)
|
||
Validating workflow...
|
||
[ComfyUI] [32m[INFO][0m === /validate endpoint called ===
|
||
Queuing workflow for execution...
|
||
[ComfyUI] [32m[INFO][0m Received JSON with keys: ['prompt']
|
||
[ComfyUI] [32m[INFO][0m Prompt has 18 nodes
|
||
[ComfyUI] [32m[INFO][0m Node 7: LoadImage
|
||
[ComfyUI] [32m[INFO][0m Inputs: {"image": "pano.png"}
|
||
[ComfyUI] [32m[INFO][0m Node 9: LoadSharpModel
|
||
[ComfyUI] [32m[INFO][0m Inputs: {"precision": "auto"}
|
||
[ComfyUI] [32m[INFO][0m Node 54: MergeGaussians
|
||
[ComfyUI] [32m[INFO][0m Inputs: {"ply_folder": ["76", 0], "output_prefix": "merged", "max_depth": 0, "min_opacity": 0}
|
||
[ComfyUI] [32m[INFO][0m Node 59: PanoramaWrap
|
||
[ComfyUI] [32m[INFO][0m Inputs: {"image": ["7", 0]}
|
||
[ComfyUI] [32m[INFO][0m Node 60: PanoramaDepthMerge
|
||
[ComfyUI] [comfy-env] SubprocessWorker: /tmp/comfytest-home/.ce/.pixi/envs/sharp-nodes/bin/python
|
||
[ComfyUI] [32m[INFO][0m Inputs: {"out_width": ["61", 0], "out_height": ["61", 1], "use_gpu": true, "scale_anchor": false, "chunk_size": 8, "center_weight_power": 2, "normal_edge_threshold_deg": 0, "normal_consistency_boost": false,
|
||
[ComfyUI] [comfy-env] env_vars: {'COMFYUI_BASE': '/workspaces/Sharp-2132/ComfyUI'}
|
||
[ComfyUI] [32m[INFO][0m Node 61: GetImageSize
|
||
[ComfyUI] [ComfyUI-Sharp] python: /tmp/comfytest-home/.ce/.pixi/envs/sharp-nodes/bin/python
|
||
[ComfyUI] [32m[INFO][0m Inputs: {"image": ["7", 0]}
|
||
[ComfyUI] [ComfyUI-Sharp] sys_path sent to worker: ['/workspaces/Sharp-2132/ComfyUI', '/workspaces/Sharp-2132/ComfyUI/custom_nodes/ComfyUI-Sharp', '/tmp/comfytest-home/.ce/.pixi/envs/sharp-nodes/lib/python3.1/site-packages', '/workspaces/Sharp-2132/ComfyUI/custom_nodes/ComfyUI-Sharp']
|
||
[ComfyUI] [32m[INFO][0m Node 62: PreviewImage
|
||
[ComfyUI] [SubprocessWorker] is_pixi=True, python=/tmp/comfytest-home/.ce/.pixi/envs/sharp-nodes/bin/python
|
||
[ComfyUI] [32m[INFO][0m Inputs: {"images": ["60", 2]}
|
||
[ComfyUI] [SubprocessWorker] launching cmd=['/tmp/comfytest-home/.pixi/bin/pixi', 'run', '--as-is', '--manifest-path', '/tmp/comfytest-home/.ce/pixi.toml', '-e', 'sharp-nodes', 'python', '/tmp/comfyui_pvenv_fah6gilt/persistent_worker.py', 'abstract://comfy_worker_d1c3a525a3d8']...
|
||
[ComfyUI] [32m[INFO][0m Node 68: PreviewImage
|
||
[ComfyUI] [SubprocessWorker] socket_addr=abstract://comfy_worker_d1c3a525a3d8 (abstract, no filesystem path)
|
||
[ComfyUI] [32m[INFO][0m Inputs: {"images": ["96", 0]}
|
||
[ComfyUI] [32m[INFO][0m Node 70: PreviewImage
|
||
[ComfyUI] [32m[INFO][0m Inputs: {"images": ["81", 0]}
|
||
[ComfyUI] [32m[INFO][0m Node 73: SharpRayToPlanarDepth
|
||
[ComfyUI] [32m[INFO][0m Inputs: {"image": ["87", 1], "intrinsics": ["87", 4], "extrinsics": ["87", 3]}
|
||
[ComfyUI] [32m[INFO][0m Node 76: SharpPredictGaussiansFromMetricDepth
|
||
[ComfyUI] [32m[INFO][0m Inputs: {"snap_to_external_depth": "none", "depth_convention": "planar_z", "focal_length_mm": 30, "output_prefix": "sharp_aligned", "save_background_layer": true, "edge_crop": 0, "model": ["9", 0], "image": [
|
||
[ComfyUI] [32m[INFO][0m Node 78: TransformGaussian
|
||
[ComfyUI] [32m[INFO][0m Inputs: {"rotate_x": -90, "rotate_y": 0, "rotate_z": 0, "ply_path": ["54", 1]}
|
||
[ComfyUI] [32m[INFO][0m Node 80: DownloadAndLoadMoGe2Model
|
||
[ComfyUI] [32m[INFO][0m Inputs: {"model": "moge-2-vitl-normal.pt", "precision": "auto", "attention": "auto"}
|
||
[ComfyUI] [32m[INFO][0m Node 81: MoGe2Inference
|
||
[ComfyUI] [32m[INFO][0m Inputs: {"resolution_level": 9, "num_tokens": 0, "fov_x_deg": ["96", 3], "force_projection": true, "apply_mask": true, "moge2_model": ["80", 0], "images": ["96", 0]}
|
||
[ComfyUI] [32m[INFO][0m Node 87: PanoramaSplitAdaptive
|
||
[ComfyUI] [32m[INFO][0m Inputs: {"split_method": "icosahedron_42", "resolution": 1536, "fov_degrees": 90, "use_gpu": true, "create_masks": true, "mask_method": "closest_to", "panorama": ["59", 0], "depth_panorama": ["60", 0], "norma
|
||
[ComfyUI] [32m[INFO][0m Node 89: PreviewImage
|
||
[ComfyUI] [32m[INFO][0m Inputs: {"images": ["87", 8]}
|
||
[ComfyUI] [32m[INFO][0m Node 95: PreviewGaussians
|
||
[ComfyUI] [32m[INFO][0m Inputs: {"camera_mode": "orbit", "fov_degrees": 71, "renderer": "playcanvas", "transport_format": "ply", "ply_path": ["78", 0]}
|
||
[ComfyUI] [32m[INFO][0m Node 96: PanoramaSplit
|
||
[ComfyUI] [32m[INFO][0m Inputs: {"split_method": "icosahedron_42", "resolution": 952, "fov_degrees": 90, "use_gpu": true, "create_masks": false, "fname": "pano_bank", "panorama": ["59", 0]}
|
||
[ComfyUI] [32m[INFO][0m Generated prompt_id: 78ae069e-4f1b-4eb9-812a-2625a4d31d71
|
||
[ComfyUI] [32m[INFO][0m Calling execution.validate_prompt()...
|
||
[ComfyUI] [32m[INFO][0m Validation result: valid=True
|
||
[ComfyUI] [32m[INFO][0m === Validation PASSED ===
|
||
[ComfyUI] [32m[INFO][0m got prompt
|
||
[ComfyUI] [comfy-env] Running LoadSharpModel: precision: 'auto'
|
||
[ComfyUI] [VRAM] Before LoadSharpModel: 697 / 24122 MB
|
||
[ComfyUI] [SubprocessWorker] call_method: nodes.load_model.LoadSharpModel.EXECUTE_NORMALIZED
|
||
[ComfyUI] [SubprocessWorker] acquired lock, ensuring started...
|
||
[ComfyUI] [worker:ComfyUI-Sharp] ERROR: Failed to import comfy_kitchen, Error: No module named 'comfy_kitchen', fp8 and fp4 support will not be available.
|
||
[ComfyUI] [worker:ComfyUI-Sharp] WARNING: comfy_kitchen does not support stochastic FP8 rounding, please update comfy_kitchen.
|
||
[ComfyUI] [SubprocessWorker] worker started/confirmed
|
||
[ComfyUI] [SubprocessWorker] serializing kwargs to shm...
|
||
[ComfyUI] [SubprocessWorker] created 0 shm blocks
|
||
[ComfyUI] [SubprocessWorker] sending request via socket...
|
||
[ComfyUI] [SubprocessWorker] call_id=1 sending call_method
|
||
[ComfyUI] [worker:ComfyUI-Sharp] [LoadSharpModel] precision='auto' -> dtype=bf16 (device=cuda:0)
|
||
[ComfyUI] [worker:ComfyUI-Sharp] [LoadSharpModel] checkpoint not found — downloading from HuggingFace repo 'apple/Sharp' file 'sharp_2572gikvuh.pt' -> /workspaces/Sharp-2132/ComfyUI/models/sharp
|
||
[ComfyUI]
|
||
Frame 2 saved (frame_001.jpg, t=2.3s)
|
||
[capture-periodic] freeze=1ms shot=91ms unfreeze=5ms saved=True
|
||
Frame 3 saved (frame_002.jpg, t=4.5s)
|
||
[capture-periodic] freeze=1ms shot=95ms unfreeze=6ms saved=True
|
||
[capture-loop] iter=50 t=5.6s state={'complete': False, 'error': None, 'executedCount': 0, 'wsState': 1} eval_ms=1 ram=4.8/31.3GB (15%) swap=2.3/32.0GB (7%) cpu=10% browser_rss=0.99GB
|
||
[ComfyUI] sharp_2572gikvuh.pt: 0%| | 0.00/2.81G [00:00<?, ?B/s]
|
||
[ComfyUI] sharp_2572gikvuh.pt: 3%|▎ | 91.2M/2.81G [00:03<01:37, 27.9MB/s][SubprocessWorker] callback 'report_progress' from call_id=1
|
||
Frame 4 saved (frame_003.jpg, t=6.7s)
|
||
[capture-periodic] freeze=1ms shot=90ms unfreeze=1ms saved=True
|
||
[ComfyUI]
|
||
[ComfyUI] sharp_2572gikvuh.pt: 6%|▌ | 158M/2.81G [00:07<02:12, 20.0MB/s] [SubprocessWorker] callback 'report_progress' from call_id=1
|
||
[capture-loop] iter=100 t=10.9s state={'complete': False, 'error': None, 'executedCount': 0, 'wsState': 1} eval_ms=1 ram=5.3/31.3GB (17%) swap=2.3/32.0GB (7%) cpu=9% browser_rss=0.99GB
|
||
Frame 5 saved (frame_004.jpg, t=11.1s)
|
||
[capture-periodic] freeze=1ms shot=92ms unfreeze=1ms saved=True
|
||
[ComfyUI]
|
||
[ComfyUI] sharp_2572gikvuh.pt: 8%|▊ | 225M/2.81G [00:09<01:51, 23.2MB/s][SubprocessWorker] callback 'report_progress' from call_id=1
|
||
[ComfyUI]
|
||
[ComfyUI] sharp_2572gikvuh.pt: 10%|█ | 292M/2.81G [00:10<01:21, 30.8MB/s][SubprocessWorker] callback 'report_progress' from call_id=1
|
||
Frame 6 saved (frame_005.jpg, t=13.2s)
|
||
[capture-periodic] freeze=5ms shot=95ms unfreeze=6ms saved=True
|
||
[ComfyUI]
|
||
[ComfyUI] sharp_2572gikvuh.pt: 30%|██▉ | 829M/2.81G [00:14<00:21, 90.6MB/s][SubprocessWorker] callback 'report_progress' from call_id=1
|
||
[capture-loop] iter=150 t=16.4s state={'complete': False, 'error': None, 'executedCount': 0, 'wsState': 1} eval_ms=1 ram=5.5/31.3GB (18%) swap=2.3/32.0GB (7%) cpu=14% browser_rss=0.99GB
|
||
[ComfyUI]
|
||
[ComfyUI] sharp_2572gikvuh.pt: 32%|███▏ | 896M/2.81G [00:14<00:20, 94.5MB/s][SubprocessWorker] callback 'report_progress' from call_id=1
|
||
Frame 7 saved (frame_006.jpg, t=17.6s)
|
||
[capture-periodic] freeze=1ms shot=103ms unfreeze=5ms saved=True
|
||
[ComfyUI]
|
||
[ComfyUI] sharp_2572gikvuh.pt: 39%|███▉ | 1.10G/2.81G [00:17<00:19, 89.1MB/s][SubprocessWorker] callback 'report_progress' from call_id=1
|
||
Frame 8 saved (frame_007.jpg, t=19.8s)
|
||
[capture-periodic] freeze=1ms shot=119ms unfreeze=5ms saved=True
|
||
[capture-loop] iter=200 t=21.9s state={'complete': False, 'error': None, 'executedCount': 0, 'wsState': 1} eval_ms=1 ram=6.2/31.3GB (20%) swap=2.3/32.0GB (7%) cpu=17% browser_rss=0.99GB
|
||
[ComfyUI]
|
||
[ComfyUI] sharp_2572gikvuh.pt: 41%|████▏ | 1.16G/2.81G [00:19<00:25, 64.5MB/s][SubprocessWorker] callback 'report_progress' from call_id=1
|
||
[ComfyUI]
|
||
[ComfyUI] sharp_2572gikvuh.pt: 44%|████▍ | 1.23G/2.81G [00:20<00:23, 67.7MB/s][SubprocessWorker] callback 'report_progress' from call_id=1
|
||
[ComfyUI]
|
||
[ComfyUI] sharp_2572gikvuh.pt: 46%|████▌ | 1.30G/2.81G [00:20<00:19, 79.3MB/s][SubprocessWorker] callback 'report_progress' from call_id=1
|
||
Frame 9 saved (frame_008.jpg, t=24.2s)
|
||
[capture-periodic] freeze=1ms shot=95ms unfreeze=4ms saved=True
|
||
[ComfyUI]
|
||
[ComfyUI] sharp_2572gikvuh.pt: 58%|█████▊ | 1.63G/2.81G [00:22<00:09, 127MB/s] [SubprocessWorker] callback 'report_progress' from call_id=1
|
||
[ComfyUI]
|
||
[ComfyUI] sharp_2572gikvuh.pt: 65%|██████▌ | 1.83G/2.81G [00:22<00:05, 177MB/s][SubprocessWorker] callback 'report_progress' from call_id=1
|
||
[ComfyUI]
|
||
[ComfyUI] sharp_2572gikvuh.pt: 68%|██████▊ | 1.90G/2.81G [00:23<00:05, 169MB/s][SubprocessWorker] callback 'report_progress' from call_id=1
|
||
[ComfyUI]
|
||
[ComfyUI] sharp_2572gikvuh.pt: 72%|███████▏ | 2.04G/2.81G [00:23<00:03, 210MB/s][SubprocessWorker] callback 'report_progress' from call_id=1
|
||
[ComfyUI]
|
||
[ComfyUI] sharp_2572gikvuh.pt: 77%|███████▋ | 2.17G/2.81G [00:23<00:02, 254MB/s][SubprocessWorker] callback 'report_progress' from call_id=1
|
||
[ComfyUI]
|
||
[ComfyUI] sharp_2572gikvuh.pt: 100%|██████████| 2.81G/2.81G [00:24<00:00, 540MB/s][SubprocessWorker] callback 'report_progress' from call_id=1
|
||
Frame 10 saved (frame_009.jpg, t=26.4s)
|
||
[capture-periodic] freeze=1ms shot=95ms unfreeze=1ms saved=True
|
||
[ComfyUI]
|
||
[ComfyUI] sharp_2572gikvuh.pt: 100%|██████████| 2.81G/2.81G [00:24<00:00, 114MB/s]
|
||
[ComfyUI] [worker:ComfyUI-Sharp] [LoadSharpModel] checkpoint ready: /workspaces/Sharp-2132/ComfyUI/models/sharp/sharp_2572gikvuh.pt (2679.6 MB)
|
||
[ComfyUI] [worker:ComfyUI-Sharp] [LoadSharpModel] config: precision=auto -> dtype=bf16
|
||
[ComfyUI] [SubprocessWorker] got response: ok
|
||
[ComfyUI] [comfy-env] SubprocessWorker: /tmp/comfytest-home/.ce/.pixi/envs/moge2-nodes/bin/python
|
||
[ComfyUI] [comfy-env] LoadSharpModel done (26.84s): result: NodeOutput
|
||
[ComfyUI] [comfy-env] env_vars: {'COMFYUI_BASE': '/workspaces/Sharp-2132/ComfyUI'}
|
||
[ComfyUI] [VRAM] After LoadSharpModel: 1220 / 24122 MB
|
||
[ComfyUI] [ComfyUI-MoGe2] python: /tmp/comfytest-home/.ce/.pixi/envs/moge2-nodes/bin/python
|
||
[ComfyUI] [comfy-env] Running DownloadAndLoadMoGe2Model: model: 'moge-2-vitl-normal.pt', precision: 'auto', attention: 'auto'
|
||
[ComfyUI] [ComfyUI-MoGe2] sys_path sent to worker: ['/workspaces/Sharp-2132/ComfyUI', '/workspaces/Sharp-2132/ComfyUI/custom_nodes/ComfyUI-MoGe2', '/tmp/comfytest-home/.ce/.pixi/envs/moge2-nodes/lib/python3.1/site-packages', '/workspaces/Sharp-2132/ComfyUI/custom_nodes/ComfyUI-MoGe2']
|
||
[ComfyUI] [VRAM] Before DownloadAndLoadMoGe2Model: 1220 / 24122 MB
|
||
[ComfyUI] [SubprocessWorker] is_pixi=True, python=/tmp/comfytest-home/.ce/.pixi/envs/moge2-nodes/bin/python
|
||
[ComfyUI] [SubprocessWorker] call_method: nodes.load_model.DownloadAndLoadMoGe2Model.EXECUTE_NORMALIZED
|
||
[ComfyUI] [SubprocessWorker] launching cmd=['/tmp/comfytest-home/.pixi/bin/pixi', 'run', '--as-is', '--manifest-path', '/tmp/comfytest-home/.ce/pixi.toml', '-e', 'moge2-nodes', 'python', '/tmp/comfyui_pvenv_gi4mg5cv/persistent_worker.py', 'abstract://comfy_worker_cc5924e05eb3']...
|
||
[ComfyUI] [SubprocessWorker] acquired lock, ensuring started...
|
||
[ComfyUI] [SubprocessWorker] socket_addr=abstract://comfy_worker_cc5924e05eb3 (abstract, no filesystem path)
|
||
[capture-loop] iter=250 t=27.5s state={'complete': False, 'error': None, 'executedCount': 0, 'wsState': 1} eval_ms=2 ram=5.6/31.3GB (18%) swap=2.3/32.0GB (7%) cpu=22% browser_rss=0.93GB
|
||
[ComfyUI] [worker:ComfyUI-MoGe2] ERROR: Failed to import comfy_kitchen, Error: No module named 'comfy_kitchen', fp8 and fp4 support will not be available.
|
||
[ComfyUI] [worker:ComfyUI-MoGe2] WARNING: comfy_kitchen does not support stochastic FP8 rounding, please update comfy_kitchen.
|
||
[ComfyUI] [SubprocessWorker] worker started/confirmed
|
||
[ComfyUI] [SubprocessWorker] serializing kwargs to shm...
|
||
[ComfyUI] [SubprocessWorker] created 0 shm blocks
|
||
[ComfyUI] [SubprocessWorker] sending request via socket...
|
||
[ComfyUI] [SubprocessWorker] call_id=1 sending call_method
|
||
Frame 11 saved (frame_010.jpg, t=28.6s)
|
||
[capture-periodic] freeze=1ms shot=106ms unfreeze=5ms saved=True
|
||
[ComfyUI]
|
||
[ComfyUI] model.pt: 0%| | 0.00/1.32G [00:00<?, ?B/s]
|
||
[ComfyUI] model.pt: 5%|▌ | 67.1M/1.32G [00:02<00:47, 26.7MB/s][SubprocessWorker] callback 'report_progress' from call_id=1
|
||
[capture-loop] iter=300 t=32.8s state={'complete': False, 'error': None, 'executedCount': 0, 'wsState': 1} eval_ms=2 ram=5.8/31.3GB (18%) swap=2.3/32.0GB (7%) cpu=19% browser_rss=0.94GB
|
||
Frame 12 saved (frame_011.jpg, t=33.0s)
|
||
[capture-periodic] freeze=1ms shot=103ms unfreeze=5ms saved=True
|
||
[ComfyUI]
|
||
[ComfyUI] model.pt: 20%|██ | 268M/1.32G [00:04<00:13, 76.1MB/s] [SubprocessWorker] callback 'report_progress' from call_id=1
|
||
Frame 13 saved (frame_012.jpg, t=35.1s)
|
||
[capture-periodic] freeze=1ms shot=96ms unfreeze=1ms saved=True
|
||
[ComfyUI]
|
||
[ComfyUI] model.pt: 25%|██▌ | 335M/1.32G [00:06<00:17, 56.2MB/s][SubprocessWorker] callback 'report_progress' from call_id=1
|
||
Frame 14 saved (frame_013.jpg, t=37.3s)
|
||
[capture-periodic] freeze=1ms shot=98ms unfreeze=5ms saved=True
|
||
[capture-loop] iter=350 t=38.4s state={'complete': False, 'error': None, 'executedCount': 0, 'wsState': 1} eval_ms=1 ram=6.2/31.3GB (20%) swap=2.3/32.0GB (7%) cpu=10% browser_rss=0.92GB
|
||
[ComfyUI]
|
||
[ComfyUI] model.pt: 51%|█████ | 671M/1.32G [00:09<00:08, 74.6MB/s][SubprocessWorker] callback 'report_progress' from call_id=1
|
||
[ComfyUI]
|
||
[ComfyUI] model.pt: 61%|██████ | 805M/1.32G [00:10<00:05, 97.9MB/s][SubprocessWorker] callback 'report_progress' from call_id=1
|
||
Frame 15 saved (frame_014.jpg, t=39.5s)
|
||
[capture-periodic] freeze=1ms shot=100ms unfreeze=1ms saved=True
|
||
[ComfyUI]
|
||
[ComfyUI] model.pt: 66%|██████▌ | 872M/1.32G [00:11<00:04, 91.0MB/s][SubprocessWorker] callback 'report_progress' from call_id=1
|
||
[ComfyUI]
|
||
[ComfyUI] model.pt: 71%|███████ | 939M/1.32G [00:11<00:03, 104MB/s] [SubprocessWorker] callback 'report_progress' from call_id=1
|
||
[ComfyUI]
|
||
[ComfyUI] model.pt: 86%|████████▌ | 1.14G/1.32G [00:11<00:01, 171MB/s][SubprocessWorker] callback 'report_progress' from call_id=1
|
||
[ComfyUI]
|
||
[ComfyUI] model.pt: 100%|██████████| 1.32G/1.32G [00:11<00:00, 238MB/s][SubprocessWorker] callback 'report_progress' from call_id=1
|
||
[ComfyUI]
|
||
[ComfyUI] model.pt: 100%|██████████| 1.32G/1.32G [00:12<00:00, 110MB/s]
|
||
[ComfyUI] [SubprocessWorker] got response: ok
|
||
[ComfyUI] [comfy-env] DownloadAndLoadMoGe2Model done (14.52s): result: NodeOutput
|
||
[ComfyUI] [VRAM] After DownloadAndLoadMoGe2Model: 1481 / 24122 MB
|
||
Frame 16 saved (frame_015.jpg, t=41.7s)
|
||
[capture-periodic] freeze=1ms shot=89ms unfreeze=7ms saved=True
|
||
[ComfyUI] [comfy-env] Running PanoramaWrap: image: torch.float32 [1,2048,4096,3] cpu
|
||
[ComfyUI] [comfy-env] SubprocessWorker: /tmp/comfytest-home/.ce/.pixi/envs/panopack-nodes/bin/python
|
||
[ComfyUI] [VRAM] Before PanoramaWrap: 1481 / 24122 MB
|
||
[ComfyUI] [comfy-env] env_vars: {'COMFYUI_BASE': '/workspaces/Sharp-2132/ComfyUI'}
|
||
[ComfyUI] [SubprocessWorker] call_method: nodes.panorama_type.PanoramaWrap.EXECUTE_NORMALIZED
|
||
[ComfyUI] [ComfyUI-PanoPack] python: /tmp/comfytest-home/.ce/.pixi/envs/panopack-nodes/bin/python
|
||
[ComfyUI] [SubprocessWorker] acquired lock, ensuring started...
|
||
[ComfyUI] [ComfyUI-PanoPack] sys_path sent to worker: ['/workspaces/Sharp-2132/ComfyUI', '/workspaces/Sharp-2132/ComfyUI/custom_nodes/ComfyUI-PanoPack', '/tmp/comfytest-home/.ce/.pixi/envs/panopack-nodes/lib/python3.1/site-packages', '/workspaces/Sharp-2132/ComfyUI/custom_nodes/ComfyUI-PanoPack']
|
||
[ComfyUI] [SubprocessWorker] is_pixi=True, python=/tmp/comfytest-home/.ce/.pixi/envs/panopack-nodes/bin/python
|
||
[ComfyUI] [SubprocessWorker] launching cmd=['/tmp/comfytest-home/.pixi/bin/pixi', 'run', '--as-is', '--manifest-path', '/tmp/comfytest-home/.ce/pixi.toml', '-e', 'panopack-nodes', 'python', '/tmp/comfyui_pvenv_aouilws_/persistent_worker.py', 'abstract://comfy_worker_7b4ba4418d05']...
|
||
[ComfyUI] [SubprocessWorker] socket_addr=abstract://comfy_worker_7b4ba4418d05 (abstract, no filesystem path)
|
||
[ComfyUI] [worker:ComfyUI-PanoPack] ERROR: Failed to import comfy_kitchen, Error: No module named 'comfy_kitchen', fp8 and fp4 support will not be available.
|
||
[ComfyUI] [worker:ComfyUI-PanoPack] WARNING: comfy_kitchen does not support stochastic FP8 rounding, please update comfy_kitchen.
|
||
[ComfyUI] [SubprocessWorker] worker started/confirmed
|
||
[ComfyUI] [comfy-env] PRE-SERIALIZE 'image' shape: torch.Size([1, 2048, 4096, 3])
|
||
[ComfyUI] [SubprocessWorker] serializing kwargs to shm...
|
||
[ComfyUI] [SubprocessWorker] created 0 shm blocks
|
||
[ComfyUI] [SubprocessWorker] sending request via socket...
|
||
[ComfyUI] [SubprocessWorker] call_id=1 sending call_method
|
||
[ComfyUI] [worker:ComfyUI-PanoPack] [comfy-env] _from_shm got dict with keys: ['__type__', 'strategy', 'parent_pid', 'fd', 'storage_size']
|
||
[ComfyUI] [worker:ComfyUI-PanoPack] [comfy-env] DESERIALIZE TensorRef: tensor_size=[1, 2048, 4096, 3]
|
||
[ComfyUI] [worker:ComfyUI-PanoPack] [comfy-env] DESERIALIZED tensor shape: torch.Size([1, 2048, 4096, 3])
|
||
[ComfyUI] [SubprocessWorker] got response: ok
|
||
[ComfyUI] [comfy-env] PanoramaWrap done (1.64s): result: NodeOutput
|
||
[ComfyUI] [VRAM] After PanoramaWrap: 1742 / 24122 MB
|
||
[ComfyUI] [comfy-env] Running PanoramaSplit: split_method: dict, resolution: 952, fov_degrees: 90.0, use_gpu: True, create_masks: False, fname: 'pano_bank', panorama: dict
|
||
[ComfyUI] [VRAM] Before PanoramaSplit: 1742 / 24122 MB
|
||
[ComfyUI] [SubprocessWorker] call_method: nodes.panorama_split.PanoramaSplit.EXECUTE_NORMALIZED
|
||
[ComfyUI] [SubprocessWorker] acquired lock, ensuring started...
|
||
[ComfyUI] [ComfyUI-PanoPack] Health check: ping (timeout=5.0s)...
|
||
[ComfyUI] [ComfyUI-PanoPack] Health check: ok
|
||
[ComfyUI] [SubprocessWorker] worker started/confirmed
|
||
[ComfyUI] [SubprocessWorker] serializing kwargs to shm...
|
||
[ComfyUI] [SubprocessWorker] created 0 shm blocks
|
||
[ComfyUI] [SubprocessWorker] sending request via socket...
|
||
[ComfyUI] [SubprocessWorker] call_id=2 sending call_method
|
||
[ComfyUI] [worker:ComfyUI-PanoPack] [comfy-env] _from_shm got dict with keys: ['__type__', 'strategy', 'parent_pid', 'fd', 'storage_size']
|
||
[ComfyUI] [worker:ComfyUI-PanoPack] [comfy-env] DESERIALIZE TensorRef: tensor_size=[1, 2048, 4096, 3]
|
||
[ComfyUI] [worker:ComfyUI-PanoPack] [comfy-env] DESERIALIZED tensor shape: torch.Size([1, 2048, 4096, 3])
|
||
[capture-loop] iter=400 t=43.8s state={'complete': False, 'error': None, 'executedCount': 0, 'wsState': 1} eval_ms=1 ram=6.3/31.3GB (20%) swap=2.3/32.0GB (7%) cpu=14% browser_rss=0.94GB
|
||
Frame 17 saved (frame_016.jpg, t=43.9s)
|
||
[capture-periodic] freeze=1ms shot=126ms unfreeze=5ms saved=True
|
||
[ComfyUI] [worker:ComfyUI-PanoPack] [PanoramaSplit] swapped up=[0,1,0] for 2 pole vertices
|
||
Frame 18 saved (frame_017.jpg, t=46.1s)
|
||
[capture-periodic] freeze=1ms shot=88ms unfreeze=4ms saved=True
|
||
[capture-loop] iter=450 t=49.3s state={'complete': False, 'error': None, 'executedCount': 0, 'wsState': 1} eval_ms=1 ram=6.8/31.3GB (22%) swap=2.3/32.0GB (7%) cpu=14% browser_rss=0.94GB
|
||
[ComfyUI] [worker:ComfyUI-PanoPack] [VRAM] +290MB (now 290MB) reserved=320MB peak=290MB
|
||
[ComfyUI] [worker:ComfyUI-PanoPack] [VRAM] -291MB (now 0MB) reserved=1312MB peak=822MB
|
||
[ComfyUI] [worker:ComfyUI-PanoPack] [PanoramaSplit] icosahedron_42: (4096x2048) -> 42 crops @ 952x952, fov=(90,90) via grid_sample (GPU); cameras 1.446s, split 5.319s, total 8.298s
|
||
[ComfyUI] [SubprocessWorker] got response: ok
|
||
[ComfyUI] [comfy-env] PanoramaSplit done (9.51s): result: NodeOutput
|
||
[ComfyUI] [VRAM] After PanoramaSplit: 3116 / 24122 MB
|
||
[capture-loop] iter=500 t=54.7s state={'complete': False, 'error': None, 'executedCount': 0, 'wsState': 1} eval_ms=1 ram=7.5/31.3GB (24%) swap=2.3/32.0GB (7%) cpu=14% browser_rss=0.93GB
|
||
Frame 19 saved (frame_018.jpg, t=54.8s)
|
||
[capture-periodic] freeze=1ms shot=98ms unfreeze=6ms saved=True
|
||
[ComfyUI] [comfy-env] Running MoGe2Inference: resolution_level: 9, num_tokens: 0, fov_x_deg: 90.0, force_projection: True, apply_mask: True, moge2_model: dict, images: torch.float32 [42,952,952,3] cpu
|
||
[ComfyUI] [VRAM] Before MoGe2Inference: 3116 / 24122 MB
|
||
[ComfyUI] [SubprocessWorker] call_method: nodes.nodes_inference.MoGe2Inference.EXECUTE_NORMALIZED
|
||
[ComfyUI] [SubprocessWorker] acquired lock, ensuring started...
|
||
[ComfyUI] [ComfyUI-MoGe2] Health check: ping (timeout=5.0s)...
|
||
[ComfyUI] [ComfyUI-MoGe2] Health check: ok
|
||
[ComfyUI] [SubprocessWorker] worker started/confirmed
|
||
[ComfyUI] [comfy-env] PRE-SERIALIZE 'images' shape: torch.Size([42, 952, 952, 3])
|
||
[ComfyUI] [SubprocessWorker] serializing kwargs to shm...
|
||
Node executed (1 total), capturing...
|
||
[ComfyUI] [SubprocessWorker] created 0 shm blocks
|
||
[ComfyUI] [SubprocessWorker] sending request via socket...
|
||
[ComfyUI] [SubprocessWorker] call_id=2 sending call_method
|
||
[ComfyUI] [worker:ComfyUI-MoGe2] [comfy-env] _from_shm got dict with keys: ['__type__', 'strategy', 'parent_pid', 'fd', 'storage_size']
|
||
[ComfyUI] [worker:ComfyUI-MoGe2] [comfy-env] DESERIALIZE TensorRef: tensor_size=[42, 952, 952, 3]
|
||
[ComfyUI] [worker:ComfyUI-MoGe2] [comfy-env] DESERIALIZED tensor shape: torch.Size([42, 952, 952, 3])
|
||
Frame 20 saved (frame_019.jpg, t=55.9s)
|
||
[capture-node] freeze=23ms shot=128ms unfreeze=1ms saved=True
|
||
[capture-loop] iter=550 t=60.5s state={'complete': False, 'error': None, 'executedCount': 1, 'wsState': 1} eval_ms=2 ram=8.1/31.3GB (26%) swap=2.3/32.0GB (7%) cpu=17% browser_rss=1.08GB
|
||
[ComfyUI] [SubprocessWorker] callback 'request_vram_budget' from call_id=2
|
||
[ComfyUI] [comfy-env] VRAM request: 0.66GB, free before eviction: 22.03GB
|
||
[ComfyUI] [comfy-env] VRAM after eviction: 22.03GB
|
||
[ComfyUI] [worker:ComfyUI-MoGe2] [VRAM] +480MB (now 480MB) reserved=512MB peak=480MB
|
||
[ComfyUI] [SubprocessWorker] callback 'report_progress' from call_id=2
|
||
[ComfyUI] [SubprocessWorker] callback 'report_progress' from call_id=2
|
||
[ComfyUI] [worker:ComfyUI-MoGe2] [VRAM] +200MB (now 680MB) reserved=1568MB peak=817MB
|
||
[ComfyUI] [SubprocessWorker] callback 'report_progress' from call_id=2
|
||
[capture-loop] iter=600 t=65.9s state={'complete': False, 'error': None, 'executedCount': 1, 'wsState': 1} eval_ms=3 ram=10.3/31.3GB (33%) swap=2.3/32.0GB (7%) cpu=14% browser_rss=1.06GB
|
||
[ComfyUI] [SubprocessWorker] callback 'report_progress' from call_id=2
|
||
[ComfyUI] [SubprocessWorker] callback 'report_progress' from call_id=2
|
||
[ComfyUI] [SubprocessWorker] callback 'report_progress' from call_id=2
|
||
[ComfyUI] [SubprocessWorker] callback 'report_progress' from call_id=2
|
||
[ComfyUI] [SubprocessWorker] callback 'report_progress' from call_id=2
|
||
Frame 21 saved (frame_020.jpg, t=66.8s)
|
||
[capture-periodic] freeze=1ms shot=95ms unfreeze=1ms saved=True
|
||
[ComfyUI] [SubprocessWorker] callback 'report_progress' from call_id=2
|
||
[ComfyUI] [SubprocessWorker] callback 'report_progress' from call_id=2
|
||
[ComfyUI] [SubprocessWorker] callback 'report_progress' from call_id=2
|
||
[ComfyUI] [SubprocessWorker] callback 'report_progress' from call_id=2
|
||
[ComfyUI] [SubprocessWorker] callback 'report_progress' from call_id=2
|
||
[ComfyUI] [SubprocessWorker] callback 'report_progress' from call_id=2
|
||
[ComfyUI] [SubprocessWorker] callback 'report_progress' from call_id=2
|
||
[ComfyUI] [SubprocessWorker] callback 'report_progress' from call_id=2
|
||
[ComfyUI] [SubprocessWorker] callback 'report_progress' from call_id=2
|
||
[ComfyUI] [SubprocessWorker] callback 'report_progress' from call_id=2
|
||
Frame 22 saved (frame_021.jpg, t=69.1s)
|
||
[capture-periodic] freeze=2ms shot=126ms unfreeze=8ms saved=True
|
||
[ComfyUI] [SubprocessWorker] callback 'report_progress' from call_id=2
|
||
[ComfyUI] [SubprocessWorker] callback 'report_progress' from call_id=2
|
||
[ComfyUI] [SubprocessWorker] callback 'report_progress' from call_id=2
|
||
[ComfyUI] [SubprocessWorker] callback 'report_progress' from call_id=2
|
||
[ComfyUI] [SubprocessWorker] callback 'report_progress' from call_id=2
|
||
[ComfyUI] [SubprocessWorker] callback 'report_progress' from call_id=2
|
||
[ComfyUI] [worker:ComfyUI-MoGe2] [VRAM] +292MB (now 973MB) reserved=1696MB peak=973MB
|
||
[ComfyUI] [SubprocessWorker] callback 'report_progress' from call_id=2
|
||
Frame 23 saved (frame_022.jpg, t=71.2s)
|
||
[capture-periodic] freeze=1ms shot=112ms unfreeze=7ms saved=True
|
||
[ComfyUI] [SubprocessWorker] callback 'report_progress' from call_id=2
|
||
[capture-loop] iter=650 t=71.6s state={'complete': False, 'error': None, 'executedCount': 1, 'wsState': 1} eval_ms=2 ram=11.0/31.3GB (35%) swap=2.3/32.0GB (7%) cpu=50% browser_rss=1.09GB
|
||
[ComfyUI] [SubprocessWorker] callback 'report_progress' from call_id=2
|
||
[ComfyUI] [worker:ComfyUI-MoGe2] [VRAM] -302MB (now 671MB) reserved=1696MB peak=973MB
|
||
[ComfyUI] [SubprocessWorker] callback 'report_progress' from call_id=2
|
||
[ComfyUI] [SubprocessWorker] callback 'report_progress' from call_id=2
|
||
[ComfyUI] [SubprocessWorker] callback 'report_progress' from call_id=2
|
||
[ComfyUI] [SubprocessWorker] callback 'report_progress' from call_id=2
|
||
[ComfyUI] [SubprocessWorker] callback 'report_progress' from call_id=2
|
||
[ComfyUI] [SubprocessWorker] callback 'report_progress' from call_id=2
|
||
[ComfyUI] [SubprocessWorker] callback 'report_progress' from call_id=2
|
||
Frame 24 saved (frame_023.jpg, t=73.5s)
|
||
[capture-periodic] freeze=1ms shot=97ms unfreeze=1ms saved=True
|
||
[ComfyUI] [SubprocessWorker] callback 'report_progress' from call_id=2
|
||
[ComfyUI] [SubprocessWorker] callback 'report_progress' from call_id=2
|
||
[ComfyUI] [SubprocessWorker] callback 'report_progress' from call_id=2
|
||
[ComfyUI] [SubprocessWorker] callback 'report_progress' from call_id=2
|
||
[ComfyUI] [SubprocessWorker] callback 'report_progress' from call_id=2
|
||
[ComfyUI] [SubprocessWorker] callback 'report_progress' from call_id=2
|
||
[ComfyUI] [SubprocessWorker] callback 'report_progress' from call_id=2
|
||
[ComfyUI] [SubprocessWorker] callback 'report_progress' from call_id=2
|
||
Frame 25 saved (frame_024.jpg, t=75.7s)
|
||
[capture-periodic] freeze=1ms shot=81ms unfreeze=7ms saved=True
|
||
[capture-loop] iter=700 t=77.0s state={'complete': False, 'error': None, 'executedCount': 1, 'wsState': 1} eval_ms=2 ram=13.7/31.3GB (44%) swap=2.3/32.0GB (7%) cpu=24% browser_rss=1.10GB
|
||
[ComfyUI] [SubprocessWorker] got response: ok
|
||
[ComfyUI] [comfy-env] Created 1 model patchers: ['MoGeWrapper_1']
|
||
[ComfyUI] [comfy-env] MoGe2Inference done (22.87s): result: NodeOutput
|
||
[ComfyUI] [VRAM] After MoGe2Inference: 4930 / 24122 MB
|
||
[ComfyUI] [VRAM] Loaded: SubprocessModel (631 MB)
|
||
[ComfyUI] [comfy-env] Running PanoramaDepthMerge: out_width: 4096, out_height: 2048, use_gpu: True, scale_anchor: False, chunk_size: 8, center_weight_power: 2.0, normal_edge_threshold_deg: 0.0, normal_consistency_boost: False, max_ray_distance_m: 0.0, face_points: torch.float32 [42,952,952,3] cpu, extrinsics: torch.float32 [42,4,4] cpu, intrinsics: torch.float32 [42,3,3] cpu, face_valid_masks: torch.float32 [42,952,952] cpu, face_normals: torch.float32 [42,952,952,3] cpu
|
||
[ComfyUI] [VRAM] Before PanoramaDepthMerge: 4930 / 24122 MB
|
||
[ComfyUI] [VRAM] Loaded: SubprocessModel (631 MB)
|
||
[ComfyUI] [SubprocessWorker] call_method: nodes.depth_merge.PanoramaDepthMerge.EXECUTE_NORMALIZED
|
||
[ComfyUI] [SubprocessWorker] acquired lock, ensuring started...
|
||
[ComfyUI] [ComfyUI-PanoPack] Health check: ping (timeout=5.0s)...
|
||
[ComfyUI] [ComfyUI-PanoPack] Health check: ok
|
||
[ComfyUI] [SubprocessWorker] worker started/confirmed
|
||
[ComfyUI] [comfy-env] PRE-SERIALIZE 'face_points' shape: torch.Size([42, 952, 952, 3])
|
||
[ComfyUI] [comfy-env] PRE-SERIALIZE 'extrinsics' shape: torch.Size([42, 4, 4])
|
||
[ComfyUI] [comfy-env] PRE-SERIALIZE 'intrinsics' shape: torch.Size([42, 3, 3])
|
||
[ComfyUI] [comfy-env] PRE-SERIALIZE 'face_valid_masks' shape: torch.Size([42, 952, 952])
|
||
[ComfyUI] [comfy-env] PRE-SERIALIZE 'face_normals' shape: torch.Size([42, 952, 952, 3])
|
||
[ComfyUI] [SubprocessWorker] serializing kwargs to shm...
|
||
Node executed (2 total), capturing...
|
||
Frame 26 saved (frame_025.jpg, t=79.9s)
|
||
[capture-node] freeze=4ms shot=100ms unfreeze=1ms saved=True
|
||
[ComfyUI] [SubprocessWorker] created 0 shm blocks
|
||
[ComfyUI] [SubprocessWorker] sending request via socket...
|
||
[ComfyUI] [SubprocessWorker] call_id=3 sending call_method
|
||
[ComfyUI] [worker:ComfyUI-PanoPack] [comfy-env] _from_shm got dict with keys: ['__type__', 'strategy', 'parent_pid', 'fd', 'storage_size']
|
||
[ComfyUI] [worker:ComfyUI-PanoPack] [comfy-env] DESERIALIZE TensorRef: tensor_size=[42, 952, 952, 3]
|
||
[ComfyUI] [worker:ComfyUI-PanoPack] [comfy-env] DESERIALIZED tensor shape: torch.Size([42, 952, 952, 3])
|
||
[ComfyUI] [worker:ComfyUI-PanoPack] [comfy-env] _from_shm got dict with keys: ['__type__', 'strategy', 'parent_pid', 'fd', 'storage_size']
|
||
[ComfyUI] [worker:ComfyUI-PanoPack] [comfy-env] DESERIALIZE TensorRef: tensor_size=[42, 4, 4]
|
||
[ComfyUI] [worker:ComfyUI-PanoPack] [comfy-env] DESERIALIZED tensor shape: torch.Size([42, 4, 4])
|
||
[ComfyUI] [worker:ComfyUI-PanoPack] [comfy-env] _from_shm got dict with keys: ['__type__', 'strategy', 'parent_pid', 'fd', 'storage_size']
|
||
[ComfyUI] [worker:ComfyUI-PanoPack] [comfy-env] DESERIALIZE TensorRef: tensor_size=[42, 3, 3]
|
||
[ComfyUI] [worker:ComfyUI-PanoPack] [comfy-env] DESERIALIZED tensor shape: torch.Size([42, 3, 3])
|
||
[ComfyUI] [worker:ComfyUI-PanoPack] [comfy-env] _from_shm got dict with keys: ['__type__', 'strategy', 'parent_pid', 'fd', 'storage_size']
|
||
[ComfyUI] [worker:ComfyUI-PanoPack] [comfy-env] DESERIALIZE TensorRef: tensor_size=[42, 952, 952]
|
||
[ComfyUI] [worker:ComfyUI-PanoPack] [comfy-env] DESERIALIZED tensor shape: torch.Size([42, 952, 952])
|
||
[ComfyUI] [worker:ComfyUI-PanoPack] [comfy-env] _from_shm got dict with keys: ['__type__', 'strategy', 'parent_pid', 'fd', 'storage_size']
|
||
[ComfyUI] [worker:ComfyUI-PanoPack] [comfy-env] DESERIALIZE TensorRef: tensor_size=[42, 952, 952, 3]
|
||
[ComfyUI] [worker:ComfyUI-PanoPack] [comfy-env] DESERIALIZED tensor shape: torch.Size([42, 952, 952, 3])
|
||
Frame 27 saved (frame_026.jpg, t=82.0s)
|
||
[capture-periodic] freeze=1ms shot=102ms unfreeze=5ms saved=True
|
||
[capture-loop] iter=750 t=82.7s state={'complete': False, 'error': None, 'executedCount': 2, 'wsState': 1} eval_ms=1 ram=15.9/31.3GB (51%) swap=2.3/32.0GB (7%) cpu=16% browser_rss=1.15GB
|
||
Frame 28 saved (frame_027.jpg, t=84.3s)
|
||
[capture-periodic] freeze=1ms shot=84ms unfreeze=1ms saved=True
|
||
[capture-loop] iter=800 t=88.1s state={'complete': False, 'error': None, 'executedCount': 2, 'wsState': 1} eval_ms=2 ram=16.7/31.3GB (53%) swap=2.3/32.0GB (7%) cpu=22% browser_rss=1.14GB
|
||
[capture-loop] iter=850 t=93.7s state={'complete': False, 'error': None, 'executedCount': 2, 'wsState': 1} eval_ms=4 ram=16.8/31.3GB (54%) swap=2.3/32.0GB (7%) cpu=24% browser_rss=1.14GB
|
||
[capture-loop] iter=900 t=99.1s state={'complete': False, 'error': None, 'executedCount': 2, 'wsState': 1} eval_ms=4 ram=16.8/31.3GB (54%) swap=2.3/32.0GB (7%) cpu=23% browser_rss=1.14GB
|
||
[ComfyUI] [worker:ComfyUI-PanoPack]
|
||
[ComfyUI] === WATCHDOG TICK 1 ===
|
||
[ComfyUI] [worker:ComfyUI-PanoPack] Thread 0x00007060433ff640 (most recent call first):
|
||
[ComfyUI] File "/tmp/comfytest-home/.ce/.pixi/envs/panopack-nodes/lib/python3.12/socket.py", line 295 in accept
|
||
[ComfyUI] File "/tmp/comfytest-home/.ce/.pixi/envs/panopack-nodes/lib/python3.12/multiprocessing/connection.py", line 626 in accept
|
||
[ComfyUI] File "/tmp/comfytest-home/.ce/.pixi/envs/panopack-nodes/lib/python3.12/multiprocessing/connection.py", line 480 in accept
|
||
[ComfyUI] File "/tmp/comfytest-home/.ce/.pixi/envs/panopack-nodes/lib/python3.12/multiprocessing/resource_sharer.py", line 138 in _serve
|
||
[ComfyUI] File "/tmp/comfytest-home/.ce/.pixi/envs/panopack-nodes/lib/python3.12/threading.py", line 1012 in run
|
||
[ComfyUI] File "/tmp/comfytest-home/.ce/.pixi/envs/panopack-nodes/lib/python3.12/threading.py", line 1075 in _bootstrap_inner
|
||
[ComfyUI] File "/tmp/comfytest-home/.ce/.pixi/envs/panopack-nodes/lib/python3.12/threading.py", line 1032 in _bootstrap
|
||
[ComfyUI]
|
||
[ComfyUI] Thread 0x000070621ffff640 (most recent call first):
|
||
[ComfyUI] File "/tmp/comfyui_pvenv_aouilws_/persistent_worker.py", line 106 in _vram_poller
|
||
[ComfyUI] File "/tmp/comfytest-home/.ce/.pixi/envs/panopack-nodes/lib/python3.12/threading.py", line 1012 in run
|
||
[ComfyUI] File "/tmp/comfytest-home/.ce/.pixi/envs/panopack-nodes/lib/python3.12/threading.py", line 1075 in _bootstrap_inner
|
||
[ComfyUI] File "/tmp/comfytest-home/.ce/.pixi/envs/panopack-nodes/lib/python3.12/threading.py", line 1032 in _bootstrap
|
||
[ComfyUI]
|
||
[ComfyUI] Current thread 0x0000706224a44640 (most recent call first):
|
||
[ComfyUI] File "/tmp/comfyui_pvenv_aouilws_/persistent_worker.py", line 52 in _watchdog
|
||
[ComfyUI] File "/tmp/comfytest-home/.ce/.pixi/envs/panopack-nodes/lib/python3.12/threading.py", line 1012 in run
|
||
[ComfyUI] File "/tmp/comfytest-home/.ce/.pixi/envs/panopack-nodes/lib/python3.12/threading.py", line 1075 in _bootstrap_inner
|
||
[ComfyUI] File "/tmp/comfytest-home/.ce/.pixi/envs/panopack-nodes/lib/python3.12/threading.py", line 1032 in _bootstrap
|
||
[ComfyUI]
|
||
[ComfyUI] Thread 0x000070622503f740 (most recent call first):
|
||
[ComfyUI] File "/workspaces/Sharp-2132/ComfyUI/custom_nodes/ComfyUI-PanoPack/nodes/depth_merge.py", line 435 in _merge_world_normals
|
||
[ComfyUI] File "/workspaces/Sharp-2132/ComfyUI/custom_nodes/ComfyUI-PanoPack/nodes/depth_merge.py", line 896 in execute
|
||
[ComfyUI] File "/workspaces/Sharp-2132/ComfyUI/comfy_api/latest/_io.py", line 1892 in EXECUTE_NORMALIZED
|
||
[ComfyUI] File "/tmp/comfyui_pvenv_aouilws_/persistent_worker.py", line 1762 in main
|
||
[ComfyUI] File "/tmp/comfyui_pvenv_aouilws_/persistent_worker.py", line 1807 in <module>
|
||
[ComfyUI]
|
||
[ComfyUI] [worker:ComfyUI-PanoPack] === END ===
|
||
[ComfyUI]
|
||
[capture-loop] iter=950 t=104.5s state={'complete': False, 'error': None, 'executedCount': 2, 'wsState': 1} eval_ms=1 ram=17.0/31.3GB (54%) swap=2.3/32.0GB (7%) cpu=24% browser_rss=1.14GB
|
||
[ComfyUI] [worker:ComfyUI-PanoPack] [PanoramaDepthMerge] normals merged: 2048x4096
|
||
[ComfyUI] [worker:ComfyUI-PanoPack] [PanoramaDepthMerge] merging 42 faces @ 952x952 -> equirect 2048x4096 (use_gpu=True); input = points (||.|| -> ray distance)
|
||
[ComfyUI] [SubprocessWorker] callback 'report_progress' from call_id=3
|
||
[ComfyUI] [worker:ComfyUI-PanoPack] [PanoramaDepthMerge] top-level peak VRAM estimate: 3.46 GB (4096x2048, N=42, chunk_size=8)
|
||
[ComfyUI] [SubprocessWorker] callback 'request_vram_budget' from call_id=3
|
||
[ComfyUI] [comfy-env] VRAM request: 3.46GB, free before eviction: 20.12GB
|
||
[ComfyUI] [comfy-env] VRAM after eviction: 20.12GB
|
||
[ComfyUI] [worker:ComfyUI-PanoPack] [PanoramaDepthMerge] -> requested 3.46 GB eviction via comfy_worker.call_parent
|
||
[ComfyUI] [worker:ComfyUI-PanoPack] [VRAM] +290MB (now 290MB) reserved=448MB peak=822MB
|
||
[ComfyUI] /workspaces/Sharp-2132/ComfyUI/custom_nodes/ComfyUI-PanoPack/nodes/_vendor/worldgen/src/panorama_utils.py:349: UserWarning: Sparse CSR tensor support is in beta state. If you miss a functionality in the sparse tensor support, please submit a feature request to https://github.com/pytorch/pytorch/issues. (Triggered internally at /pytorch/aten/src/ATen/SparseCsrTensorImpl.cpp:49.)
|
||
[ComfyUI] A_gpu = torch.sparse_csr_tensor(
|
||
[ComfyUI] [worker:ComfyUI-PanoPack] [merge_panorama_depth_gpu 256x128 ] done 0.53s (warp 0.30, build 0.01, LSMR 0.22); N=42 K=8 chunks=6; depth min/med/max = 0.384/0.945/3.091; valid 32768/32768
|
||
[ComfyUI] [worker:ComfyUI-PanoPack] [merge_panorama_depth_gpu 512x256 ] done 0.74s (warp 0.09, build 0.02, LSMR 0.07); N=42 K=8 chunks=6; depth min/med/max = 0.384/0.945/3.094; valid 131072/131072
|
||
[ComfyUI] [worker:ComfyUI-PanoPack] [merge_panorama_depth_gpu 1024x512 ] done 1.06s (warp 0.12, build 0.05, LSMR 0.13); N=42 K=8 chunks=6; depth min/med/max = 0.384/0.945/3.094; valid 524288/524288
|
||
[ComfyUI] [worker:ComfyUI-PanoPack] [VRAM] -283MB (now 8MB) reserved=32MB peak=822MB
|
||
Frame 29 saved (frame_028.jpg, t=106.1s)
|
||
[capture-periodic] freeze=1ms shot=103ms unfreeze=7ms saved=True
|
||
[ComfyUI] [worker:ComfyUI-PanoPack] [merge_panorama_depth_gpu 2048x1024] done 1.99s (warp 0.21, build 0.26, LSMR 0.40); N=42 K=8 chunks=6; depth min/med/max = 0.384/0.945/3.095; valid 2097152/2097152
|
||
[ComfyUI] [worker:ComfyUI-PanoPack] [VRAM] +241MB (now 249MB) reserved=288MB peak=822MB
|
||
[capture-loop] iter=1000 t=110.0s state={'complete': False, 'error': None, 'executedCount': 2, 'wsState': 1} eval_ms=2 ram=18.0/31.3GB (58%) swap=2.3/32.0GB (7%) cpu=15% browser_rss=1.14GB
|
||
[ComfyUI] [worker:ComfyUI-PanoPack] [VRAM] +721MB (now 970MB) reserved=1088MB peak=970MB
|
||
[ComfyUI] [worker:ComfyUI-PanoPack] [VRAM] +607MB (now 1578MB) reserved=1664MB peak=1578MB
|
||
[ComfyUI] [worker:ComfyUI-PanoPack] [merge_panorama_depth_gpu 4096x2048] done 9.12s (warp 0.61, build 4.29, LSMR 2.02); N=42 K=8 chunks=6; depth min/med/max = 0.384/0.945/3.094; valid 8388608/8388608
|
||
[ComfyUI] [worker:ComfyUI-PanoPack] [PanoramaDepthMerge] merged depth: shape (2048, 4096), min=0.384, median=0.945, max=3.094; valid pixels: 8388608 / 8388608
|
||
[ComfyUI] [worker:ComfyUI-PanoPack] [VRAM] -1571MB (now 8MB) reserved=2176MB peak=1898MB
|
||
[capture-loop] iter=1050 t=115.4s state={'complete': False, 'error': None, 'executedCount': 2, 'wsState': 1} eval_ms=4 ram=17.5/31.3GB (56%) swap=2.3/32.0GB (7%) cpu=16% browser_rss=1.14GB
|
||
[capture-loop] iter=1100 t=120.9s state={'complete': False, 'error': None, 'executedCount': 2, 'wsState': 1} eval_ms=2 ram=17.6/31.3GB (56%) swap=2.2/32.0GB (7%) cpu=21% browser_rss=1.14GB
|
||
[capture-loop] iter=1150 t=126.4s state={'complete': False, 'error': None, 'executedCount': 2, 'wsState': 1} eval_ms=1 ram=17.6/31.3GB (56%) swap=2.2/32.0GB (7%) cpu=22% browser_rss=1.14GB
|
||
[ComfyUI] [worker:ComfyUI-PanoPack] [PanoramaDepthMerge] debug_image: H=2048+102, mult_disagreement (log-d, sphere-uniform): mean=11.22%, p99=24.69%, max=28.22%; overlap_pixels=8388608
|
||
[ComfyUI] [worker:ComfyUI-PanoPack] [headless_gl] prefix=/tmp/comfytest-home/.ce/.pixi/envs/panopack-nodes
|
||
[ComfyUI] [worker:ComfyUI-PanoPack] [headless_gl] OSMesa: ['libOSMesa.so', 'libOSMesa.so.8', 'libOSMesa.so.8.0.0']
|
||
[ComfyUI] [worker:ComfyUI-PanoPack] [headless_gl] env: VTK_DEFAULT_OPENGL_WINDOW=vtkOSOpenGLRenderWindow PYVISTA_OFF_SCREEN=true
|
||
[ComfyUI] [worker:ComfyUI-PanoPack] [PanoramaDepthMerge] xyz_views: cloud bbox center=(-0.79, -0.31, +0.03) m, size=(4.27 x 3.57 x 1.96) m, N=80000 (subsampled)
|
||
[capture-loop] iter=1200 t=131.7s state={'complete': False, 'error': None, 'executedCount': 2, 'wsState': 1} eval_ms=2 ram=17.2/31.3GB (55%) swap=2.2/32.0GB (7%) cpu=16% browser_rss=1.14GB
|
||
[ComfyUI] [worker:ComfyUI-PanoPack] [PanoramaDepthMerge] points: merged equirect point map (1, 2048, 4096, 3)
|
||
[ComfyUI] [SubprocessWorker] callback 'report_progress' from call_id=3
|
||
[ComfyUI] [SubprocessWorker] got response: ok
|
||
[ComfyUI] [comfy-env] PanoramaDepthMerge done (52.56s): result: NodeOutput
|
||
[ComfyUI] [VRAM] After PanoramaDepthMerge: 3660 / 24122 MB
|
||
[ComfyUI] [VRAM] Loaded: SubprocessModel (631 MB)
|
||
Frame 30 saved (frame_029.jpg, t=132.3s)
|
||
[capture-periodic] freeze=1ms shot=94ms unfreeze=7ms saved=True
|
||
[ComfyUI] [comfy-env] Running PanoramaSplitAdaptive: split_method: 'icosahedron_42', resolution: 1536, fov_degrees: 90.0, use_gpu: True, create_masks: True, mask_method: 'closest_to', panorama: dict, depth_panorama: torch.float32 [1,2048,4096,3] cpu, normals_panorama: torch.float32 [1,2048,4096,3] cpu
|
||
[ComfyUI] [VRAM] Before PanoramaSplitAdaptive: 3660 / 24122 MB
|
||
[ComfyUI] [VRAM] Loaded: SubprocessModel (631 MB)
|
||
[ComfyUI] [SubprocessWorker] call_method: nodes.panorama_split_adaptive.PanoramaSplitAdaptive.EXECUTE_NORMALIZED
|
||
[ComfyUI] [SubprocessWorker] acquired lock, ensuring started...
|
||
[ComfyUI] [ComfyUI-PanoPack] Health check: ping (timeout=5.0s)...
|
||
[ComfyUI] [ComfyUI-PanoPack] Health check: ok
|
||
[ComfyUI] [SubprocessWorker] worker started/confirmed
|
||
[ComfyUI] [comfy-env] PRE-SERIALIZE 'depth_panorama' shape: torch.Size([1, 2048, 4096, 3])
|
||
[ComfyUI] [comfy-env] PRE-SERIALIZE 'normals_panorama' shape: torch.Size([1, 2048, 4096, 3])
|
||
[ComfyUI] [SubprocessWorker] serializing kwargs to shm...
|
||
Node executed (3 total), capturing...
|
||
[ComfyUI] [SubprocessWorker] created 0 shm blocks
|
||
[ComfyUI] [SubprocessWorker] sending request via socket...
|
||
[ComfyUI] [SubprocessWorker] call_id=4 sending call_method
|
||
[ComfyUI] [worker:ComfyUI-PanoPack] [comfy-env] _from_shm got dict with keys: ['__type__', 'strategy', 'parent_pid', 'fd', 'storage_size']
|
||
[ComfyUI] [worker:ComfyUI-PanoPack] [comfy-env] DESERIALIZE TensorRef: tensor_size=[1, 2048, 4096, 3]
|
||
[ComfyUI] [worker:ComfyUI-PanoPack] [comfy-env] DESERIALIZED tensor shape: torch.Size([1, 2048, 4096, 3])
|
||
[ComfyUI] [worker:ComfyUI-PanoPack] [comfy-env] _from_shm got dict with keys: ['__type__', 'strategy', 'parent_pid', 'fd', 'storage_size']
|
||
[ComfyUI] [worker:ComfyUI-PanoPack] [comfy-env] DESERIALIZE TensorRef: tensor_size=[1, 2048, 4096, 3]
|
||
[ComfyUI] [worker:ComfyUI-PanoPack] [comfy-env] DESERIALIZED tensor shape: torch.Size([1, 2048, 4096, 3])
|
||
[ComfyUI] [worker:ComfyUI-PanoPack] [comfy-env] _from_shm got dict with keys: ['__type__', 'strategy', 'parent_pid', 'fd', 'storage_size']
|
||
[ComfyUI] [worker:ComfyUI-PanoPack] [comfy-env] DESERIALIZE TensorRef: tensor_size=[1, 2048, 4096, 3]
|
||
[ComfyUI] [worker:ComfyUI-PanoPack] [comfy-env] DESERIALIZED tensor shape: torch.Size([1, 2048, 4096, 3])
|
||
Frame 31 saved (frame_030.jpg, t=132.7s)
|
||
[capture-node] freeze=2ms shot=110ms unfreeze=9ms saved=True
|
||
[ComfyUI] [worker:ComfyUI-PanoPack] [PanoramaSplitAdaptive] computing area weights from depth (2048x4096) + normals...
|
||
[ComfyUI] [worker:ComfyUI-PanoPack] [PanoramaSplitAdaptive] weight range: [1.06, 131], mean=11.7
|
||
[ComfyUI] [worker:ComfyUI-PanoPack] [PanoramaSplitAdaptive] adaptive relax: icosahedron_42 (42 cameras), weighted Lloyd...
|
||
[capture-loop] iter=1250 t=137.6s state={'complete': False, 'error': None, 'executedCount': 3, 'wsState': 1} eval_ms=2 ram=17.6/31.3GB (56%) swap=2.2/32.0GB (7%) cpu=14% browser_rss=1.15GB
|
||
[capture-loop] iter=1300 t=142.9s state={'complete': False, 'error': None, 'executedCount': 3, 'wsState': 1} eval_ms=2 ram=17.4/31.3GB (56%) swap=2.2/32.0GB (7%) cpu=14% browser_rss=1.15GB
|
||
[capture-loop] iter=1350 t=148.4s state={'complete': False, 'error': None, 'executedCount': 3, 'wsState': 1} eval_ms=2 ram=17.6/31.3GB (56%) swap=2.2/32.0GB (7%) cpu=15% browser_rss=1.15GB
|
||
[capture-loop] iter=1400 t=153.7s state={'complete': False, 'error': None, 'executedCount': 3, 'wsState': 1} eval_ms=2 ram=17.2/31.3GB (55%) swap=2.2/32.0GB (7%) cpu=13% browser_rss=1.15GB
|
||
[ComfyUI] [worker:ComfyUI-PanoPack] [PanoramaSplitAdaptive] Lloyd ran 24 iters (max move 1.42e-02)
|
||
[ComfyUI] [worker:ComfyUI-PanoPack] [PanoramaSplitAdaptive] Lloyd relaxation done: 42 camera directions in 25.850s
|
||
[ComfyUI] [worker:ComfyUI-PanoPack] [PanoramaSplitAdaptive] rasterizing 42 faces @ 1536x1536...
|
||
[capture-loop] iter=1450 t=159.2s state={'complete': False, 'error': None, 'executedCount': 3, 'wsState': 1} eval_ms=1 ram=16.9/31.3GB (54%) swap=2.2/32.0GB (7%) cpu=15% browser_rss=1.15GB
|
||
[ComfyUI] [worker:ComfyUI-PanoPack]
|
||
[ComfyUI] === WATCHDOG TICK 2 ===
|
||
[ComfyUI] [worker:ComfyUI-PanoPack] Thread 0x00007060433ff640 (most recent call first):
|
||
[ComfyUI] File "/tmp/comfytest-home/.ce/.pixi/envs/panopack-nodes/lib/python3.12/socket.py", line 295 in accept
|
||
[ComfyUI] File "/tmp/comfytest-home/.ce/.pixi/envs/panopack-nodes/lib/python3.12/multiprocessing/connection.py", line 626 in accept
|
||
[ComfyUI] File "/tmp/comfytest-home/.ce/.pixi/envs/panopack-nodes/lib/python3.12/multiprocessing/connection.py", line 480 in accept
|
||
[ComfyUI] File "/tmp/comfytest-home/.ce/.pixi/envs/panopack-nodes/lib/python3.12/multiprocessing/resource_sharer.py", line 138 in _serve
|
||
[ComfyUI] File "/tmp/comfytest-home/.ce/.pixi/envs/panopack-nodes/lib/python3.12/threading.py", line 1012 in run
|
||
[ComfyUI] File "/tmp/comfytest-home/.ce/.pixi/envs/panopack-nodes/lib/python3.12/threading.py", line 1075 in _bootstrap_inner
|
||
[ComfyUI] File "/tmp/comfytest-home/.ce/.pixi/envs/panopack-nodes/lib/python3.12/threading.py", line 1032 in _bootstrap
|
||
[ComfyUI]
|
||
[ComfyUI] Thread 0x000070621ffff640 (most recent call first):
|
||
[ComfyUI] File "/tmp/comfyui_pvenv_aouilws_/persistent_worker.py", line 106 in _vram_poller
|
||
[ComfyUI] File "/tmp/comfytest-home/.ce/.pixi/envs/panopack-nodes/lib/python3.12/threading.py", line 1012 in run
|
||
[ComfyUI] File "/tmp/comfytest-home/.ce/.pixi/envs/panopack-nodes/lib/python3.12/threading.py", line 1075 in _bootstrap_inner
|
||
[ComfyUI] File "/tmp/comfytest-home/.ce/.pixi/envs/panopack-nodes/lib/python3.12/threading.py", line 1032 in _bootstrap
|
||
[ComfyUI]
|
||
[ComfyUI] Current thread 0x0000706224a44640 (most recent call first):
|
||
[ComfyUI] File "/tmp/comfyui_pvenv_aouilws_/persistent_worker.py", line 52 in _watchdog
|
||
[ComfyUI] File "/tmp/comfytest-home/.ce/.pixi/envs/panopack-nodes/lib/python3.12/threading.py", line 1012 in run
|
||
[ComfyUI] File "/tmp/comfytest-home/.ce/.pixi/envs/panopack-nodes/lib/python3.12/threading.py", line 1075 in _bootstrap_inner
|
||
[ComfyUI] File "/tmp/comfytest-home/.ce/.pixi/envs/panopack-nodes/lib/python3.12/threading.py", line 1032 in _bootstrap
|
||
[ComfyUI]
|
||
[ComfyUI] Thread 0x000070622503f740 (most recent call first):
|
||
[ComfyUI] File "/workspaces/Sharp-2132/ComfyUI/custom_nodes/ComfyUI-PanoPack/nodes/_vendor/moge_panorama.py", line 36 in directions_to_spherical_uv
|
||
[ComfyUI] File "/workspaces/Sharp-2132/ComfyUI/custom_nodes/ComfyUI-PanoPack/nodes/_vendor/moge_panorama.py", line 92 in split_panorama_image_gpu
|
||
[ComfyUI] File "/workspaces/Sharp-2132/ComfyUI/custom_nodes/ComfyUI-PanoPack/nodes/panorama_split_adaptive.py", line 434 in execute
|
||
[ComfyUI] File "/workspaces/Sharp-2132/ComfyUI/comfy_api/latest/_io.py", line 1892 in EXECUTE_NORMALIZED
|
||
[ComfyUI] File "/tmp/comfyui_pvenv_aouilws_/persistent_worker.py", line 1762 in main
|
||
[ComfyUI] File "/tmp/comfyui_pvenv_aouilws_/persistent_worker.py", line 1807 in <module>
|
||
[ComfyUI]
|
||
[ComfyUI] [worker:ComfyUI-PanoPack] === END ===
|
||
[ComfyUI]
|
||
[capture-loop] iter=1500 t=164.5s state={'complete': False, 'error': None, 'executedCount': 3, 'wsState': 1} eval_ms=2 ram=17.3/31.3GB (55%) swap=2.2/32.0GB (7%) cpu=14% browser_rss=1.15GB
|
||
[ComfyUI] [worker:ComfyUI-PanoPack] [VRAM] +756MB (now 764MB) reserved=800MB peak=1898MB
|
||
[ComfyUI] [worker:ComfyUI-PanoPack] [VRAM] +1230MB (now 1994MB) reserved=3168MB peak=1994MB
|
||
[ComfyUI] [worker:ComfyUI-PanoPack] [VRAM] -1986MB (now 8MB) reserved=3168MB peak=1994MB
|
||
[capture-loop] iter=1550 t=170.0s state={'complete': False, 'error': None, 'executedCount': 3, 'wsState': 1} eval_ms=1 ram=19.5/31.3GB (62%) swap=2.2/32.0GB (7%) cpu=14% browser_rss=1.14GB
|
||
[ComfyUI] [worker:ComfyUI-PanoPack] [PanoramaSplitAdaptive] rasterized RGB in 11.675s (GPU)
|
||
[ComfyUI] [worker:ComfyUI-PanoPack] [PanoramaSplitAdaptive] rasterizing depth crops...
|
||
[capture-loop] iter=1600 t=175.4s state={'complete': False, 'error': None, 'executedCount': 3, 'wsState': 1} eval_ms=1 ram=19.5/31.3GB (62%) swap=2.2/32.0GB (7%) cpu=13% browser_rss=1.14GB
|
||
[capture-loop] iter=1650 t=180.8s state={'complete': False, 'error': None, 'executedCount': 3, 'wsState': 1} eval_ms=2 ram=21.1/31.3GB (67%) swap=2.2/32.0GB (7%) cpu=13% browser_rss=1.14GB
|
||
[ComfyUI] [worker:ComfyUI-PanoPack] [VRAM] +756MB (now 764MB) reserved=3168MB peak=1994MB
|
||
[ComfyUI] [worker:ComfyUI-PanoPack] [VRAM] +1230MB (now 1994MB) reserved=3264MB peak=1994MB
|
||
[ComfyUI] [worker:ComfyUI-PanoPack] [VRAM] -1986MB (now 8MB) reserved=3264MB peak=1994MB
|
||
[ComfyUI] [worker:ComfyUI-PanoPack] [PanoramaSplitAdaptive] rasterizing normals crops...
|
||
[capture-loop] iter=1700 t=186.2s state={'complete': False, 'error': None, 'executedCount': 3, 'wsState': 1} eval_ms=2 ram=21.5/31.3GB (69%) swap=2.2/32.0GB (7%) cpu=13% browser_rss=1.14GB
|
||
[capture-loop] iter=1750 t=191.6s state={'complete': False, 'error': None, 'executedCount': 3, 'wsState': 1} eval_ms=2 ram=22.1/31.3GB (70%) swap=2.2/32.0GB (7%) cpu=12% browser_rss=1.14GB
|
||
[ComfyUI] [worker:ComfyUI-PanoPack] [VRAM] +756MB (now 764MB) reserved=3264MB peak=1994MB
|
||
[capture-loop] iter=1800 t=197.0s state={'complete': False, 'error': None, 'executedCount': 3, 'wsState': 1} eval_ms=1 ram=23.9/31.3GB (76%) swap=2.2/32.0GB (7%) cpu=13% browser_rss=1.14GB
|
||
[ComfyUI] [worker:ComfyUI-PanoPack] [VRAM] +1230MB (now 1994MB) reserved=3264MB peak=1994MB
|
||
[ComfyUI] [worker:ComfyUI-PanoPack] [VRAM] -1986MB (now 8MB) reserved=3264MB peak=1994MB
|
||
[ComfyUI] [worker:ComfyUI-PanoPack] [PanoramaSplitAdaptive] generating closest_to masks...
|
||
[capture-loop] iter=1850 t=202.5s state={'complete': False, 'error': None, 'executedCount': 3, 'wsState': 1} eval_ms=2 ram=24.0/31.3GB (77%) swap=2.3/32.0GB (7%) cpu=12% browser_rss=1.14GB
|
||
[capture-loop] iter=1900 t=207.8s state={'complete': False, 'error': None, 'executedCount': 3, 'wsState': 1} eval_ms=2 ram=24.5/31.3GB (78%) swap=2.3/32.0GB (7%) cpu=12% browser_rss=1.14GB
|
||
[capture-loop] iter=1950 t=213.3s state={'complete': False, 'error': None, 'executedCount': 3, 'wsState': 1} eval_ms=1 ram=24.4/31.3GB (78%) swap=2.3/32.0GB (7%) cpu=11% browser_rss=1.15GB
|
||
[capture-loop] iter=2000 t=218.6s state={'complete': False, 'error': None, 'executedCount': 3, 'wsState': 1} eval_ms=1 ram=24.5/31.3GB (78%) swap=2.3/32.0GB (7%) cpu=13% browser_rss=1.14GB
|
||
[ComfyUI] [worker:ComfyUI-PanoPack]
|
||
[ComfyUI] === WATCHDOG TICK 3 ===
|
||
[ComfyUI] [worker:ComfyUI-PanoPack] Thread 0x00007060433ff640 (most recent call first):
|
||
[ComfyUI] File "/tmp/comfytest-home/.ce/.pixi/envs/panopack-nodes/lib/python3.12/socket.py", line 295 in accept
|
||
[ComfyUI] File "/tmp/comfytest-home/.ce/.pixi/envs/panopack-nodes/lib/python3.12/multiprocessing/connection.py", line 626 in accept
|
||
[ComfyUI] File "/tmp/comfytest-home/.ce/.pixi/envs/panopack-nodes/lib/python3.12/multiprocessing/connection.py", line 480 in accept
|
||
[ComfyUI] File "/tmp/comfytest-home/.ce/.pixi/envs/panopack-nodes/lib/python3.12/multiprocessing/resource_sharer.py", line 138 in _serve
|
||
[ComfyUI] File "/tmp/comfytest-home/.ce/.pixi/envs/panopack-nodes/lib/python3.12/threading.py", line 1012 in run
|
||
[ComfyUI] File "/tmp/comfytest-home/.ce/.pixi/envs/panopack-nodes/lib/python3.12/threading.py", line 1075 in _bootstrap_inner
|
||
[ComfyUI] File "/tmp/comfytest-home/.ce/.pixi/envs/panopack-nodes/lib/python3.12/threading.py", line 1032 in _bootstrap
|
||
[ComfyUI]
|
||
[ComfyUI] Thread 0x000070621ffff640 (most recent call first):
|
||
[ComfyUI] File "/tmp/comfyui_pvenv_aouilws_/persistent_worker.py", line 106 in _vram_poller
|
||
[ComfyUI] File "/tmp/comfytest-home/.ce/.pixi/envs/panopack-nodes/lib/python3.12/threading.py", line 1012 in run
|
||
[ComfyUI] File "/tmp/comfytest-home/.ce/.pixi/envs/panopack-nodes/lib/python3.12/threading.py", line 1075 in _bootstrap_inner
|
||
[ComfyUI] File "/tmp/comfytest-home/.ce/.pixi/envs/panopack-nodes/lib/python3.12/threading.py", line 1032 in _bootstrap
|
||
[ComfyUI]
|
||
[ComfyUI] Current thread 0x0000706224a44640 (most recent call first):
|
||
[ComfyUI] File "/tmp/comfyui_pvenv_aouilws_/persistent_worker.py", line 52 in _watchdog
|
||
[ComfyUI] File "/tmp/comfytest-home/.ce/.pixi/envs/panopack-nodes/lib/python3.12/threading.py", line 1012 in run
|
||
[ComfyUI] File "/tmp/comfytest-home/.ce/.pixi/envs/panopack-nodes/lib/python3.12/threading.py", line 1075 in _bootstrap_inner
|
||
[ComfyUI] File "/tmp/comfytest-home/.ce/.pixi/envs/panopack-nodes/lib/python3.12/threading.py", line 1032 in _bootstrap
|
||
[ComfyUI]
|
||
[ComfyUI] Thread 0x000070622503f740 (most recent call first):
|
||
[ComfyUI] File "/tmp/comfytest-home/.ce/.pixi/envs/panopack-nodes/lib/python3.12/site-packages/numpy/_core/einsumfunc.py", line 1610 in einsum
|
||
[ComfyUI] File "/workspaces/Sharp-2132/ComfyUI/custom_nodes/ComfyUI-PanoPack/nodes/panorama_split_adaptive.py", line 483 in execute
|
||
[ComfyUI] File "/workspaces/Sharp-2132/ComfyUI/comfy_api/latest/_io.py", line 1892 in EXECUTE_NORMALIZED
|
||
[ComfyUI] File "/tmp/comfyui_pvenv_aouilws_/persistent_worker.py", line 1762 in main
|
||
[ComfyUI] File "/tmp/comfyui_pvenv_aouilws_/persistent_worker.py", line 1807 in <module>
|
||
[ComfyUI]
|
||
[ComfyUI] [worker:ComfyUI-PanoPack] === END ===
|
||
[ComfyUI]
|
||
[capture-loop] iter=2050 t=224.0s state={'complete': False, 'error': None, 'executedCount': 3, 'wsState': 1} eval_ms=1 ram=24.6/31.3GB (79%) swap=2.3/32.0GB (7%) cpu=13% browser_rss=1.15GB
|
||
[ComfyUI] [worker:ComfyUI-PanoPack] [PanoramaSplitAdaptive] generating debug_masks equirect image...
|
||
[capture-loop] iter=2100 t=229.4s state={'complete': False, 'error': None, 'executedCount': 3, 'wsState': 1} eval_ms=1 ram=24.8/31.3GB (79%) swap=3.2/32.0GB (10%) cpu=15% browser_rss=0.99GB
|
||
[capture-loop] iter=2150 t=234.8s state={'complete': False, 'error': None, 'executedCount': 3, 'wsState': 1} eval_ms=1 ram=23.1/31.3GB (74%) swap=5.6/32.0GB (17%) cpu=13% browser_rss=0.89GB
|
||
[ComfyUI] [worker:ComfyUI-PanoPack] [PanoramaSplitAdaptive] pixels/area: lowest 0.243 -> 0.336 (+38% on the worst-sampled cell), highest 6.44 -> 2.85; spread max/min 26.5x -> 8.5x
|
||
[ComfyUI] [worker:ComfyUI-PanoPack] [PanoramaSplitAdaptive] done: 42 adaptive faces, 103.951s total
|
||
[ComfyUI] [SubprocessWorker] got response: ok
|
||
[ComfyUI] [comfy-env] PanoramaSplitAdaptive done (107.40s): result: NodeOutput
|
||
[ComfyUI] [VRAM] After PanoramaSplitAdaptive: 6892 / 24122 MB
|
||
[ComfyUI] [VRAM] Loaded: SubprocessModel (631 MB)
|
||
[capture-loop] iter=2200 t=240.2s state={'complete': False, 'error': None, 'executedCount': 3, 'wsState': 1} eval_ms=2 ram=16.8/31.3GB (54%) swap=6.1/32.0GB (19%) cpu=14% browser_rss=0.89GB
|
||
[ComfyUI] [comfy-env] Running SharpRayToPlanarDepth: image: torch.float32 [42,1536,1536,3] cpu, intrinsics: torch.float32 [42,3,3] cpu, extrinsics: torch.float32 [42,4,4] cpu
|
||
[ComfyUI] [VRAM] Before SharpRayToPlanarDepth: 6892 / 24122 MB
|
||
[ComfyUI] [VRAM] Loaded: SubprocessModel (631 MB)
|
||
[ComfyUI] [SubprocessWorker] call_method: nodes.ray_to_planar_depth.SharpRayToPlanarDepth.EXECUTE_NORMALIZED
|
||
[ComfyUI] [SubprocessWorker] acquired lock, ensuring started...
|
||
[ComfyUI] [ComfyUI-Sharp] Health check: ping (timeout=5.0s)...
|
||
[ComfyUI] [ComfyUI-Sharp] Health check: failed
|
||
[ComfyUI] [ComfyUI-Sharp] Socket unhealthy, restarting worker...
|
||
[ComfyUI] [ComfyUI-Sharp] python: /tmp/comfytest-home/.ce/.pixi/envs/sharp-nodes/bin/python
|
||
[ComfyUI] [ComfyUI-Sharp] sys_path sent to worker: ['/workspaces/Sharp-2132/ComfyUI', '/workspaces/Sharp-2132/ComfyUI/custom_nodes/ComfyUI-Sharp', '/tmp/comfytest-home/.ce/.pixi/envs/sharp-nodes/lib/python3.1/site-packages', '/workspaces/Sharp-2132/ComfyUI/custom_nodes/ComfyUI-Sharp']
|
||
[ComfyUI] [SubprocessWorker] is_pixi=True, python=/tmp/comfytest-home/.ce/.pixi/envs/sharp-nodes/bin/python
|
||
[ComfyUI] [SubprocessWorker] launching cmd=['/tmp/comfytest-home/.pixi/bin/pixi', 'run', '--as-is', '--manifest-path', '/tmp/comfytest-home/.ce/pixi.toml', '-e', 'sharp-nodes', 'python', '/tmp/comfyui_pvenv_fah6gilt/persistent_worker.py', 'abstract://comfy_worker_3763d1a0c0c3']...
|
||
[ComfyUI] [SubprocessWorker] socket_addr=abstract://comfy_worker_3763d1a0c0c3 (abstract, no filesystem path)
|
||
Node executed (4 total), capturing...
|
||
Frame 32 saved (frame_031.jpg, t=240.8s)
|
||
[capture-node] freeze=2ms shot=94ms unfreeze=1ms saved=True
|
||
[ComfyUI] [worker:ComfyUI-Sharp] ERROR: Failed to import comfy_kitchen, Error: No module named 'comfy_kitchen', fp8 and fp4 support will not be available.
|
||
[ComfyUI] [worker:ComfyUI-Sharp] WARNING: comfy_kitchen does not support stochastic FP8 rounding, please update comfy_kitchen.
|
||
[ComfyUI] [SubprocessWorker] worker started/confirmed
|
||
[ComfyUI] [comfy-env] PRE-SERIALIZE 'image' shape: torch.Size([42, 1536, 1536, 3])
|
||
[ComfyUI] [comfy-env] PRE-SERIALIZE 'intrinsics' shape: torch.Size([42, 3, 3])
|
||
[ComfyUI] [comfy-env] PRE-SERIALIZE 'extrinsics' shape: torch.Size([42, 4, 4])
|
||
[ComfyUI] [SubprocessWorker] serializing kwargs to shm...
|
||
[ComfyUI] [SubprocessWorker] created 0 shm blocks
|
||
[ComfyUI] [SubprocessWorker] sending request via socket...
|
||
[ComfyUI] [SubprocessWorker] call_id=2 sending call_method
|
||
[ComfyUI] [worker:ComfyUI-Sharp] [comfy-env] _from_shm got dict with keys: ['__type__', 'strategy', 'parent_pid', 'fd', 'storage_size']
|
||
[ComfyUI] [worker:ComfyUI-Sharp] [comfy-env] DESERIALIZE TensorRef: tensor_size=[42, 1536, 1536, 3]
|
||
[ComfyUI] [worker:ComfyUI-Sharp] [comfy-env] DESERIALIZED tensor shape: torch.Size([42, 1536, 1536, 3])
|
||
[ComfyUI] [worker:ComfyUI-Sharp] [comfy-env] _from_shm got dict with keys: ['__type__', 'strategy', 'parent_pid', 'fd', 'storage_size']
|
||
[ComfyUI] [worker:ComfyUI-Sharp] [comfy-env] DESERIALIZE TensorRef: tensor_size=[42, 3, 3]
|
||
[ComfyUI] [worker:ComfyUI-Sharp] [comfy-env] DESERIALIZED tensor shape: torch.Size([42, 3, 3])
|
||
[ComfyUI] [worker:ComfyUI-Sharp] [comfy-env] _from_shm got dict with keys: ['__type__', 'strategy', 'parent_pid', 'fd', 'storage_size']
|
||
[ComfyUI] [worker:ComfyUI-Sharp] [comfy-env] DESERIALIZE TensorRef: tensor_size=[42, 4, 4]
|
||
[ComfyUI] [worker:ComfyUI-Sharp] [comfy-env] DESERIALIZED tensor shape: torch.Size([42, 4, 4])
|
||
[ComfyUI] [worker:ComfyUI-Sharp] [SharpRayToPlanarDepth] detected normalized intrinsics (fx<2); rescaled to pixel-K for 1536×1536: fx=768.0
|
||
Frame 33 saved (frame_032.jpg, t=243.0s)
|
||
[capture-periodic] freeze=1ms shot=104ms unfreeze=6ms saved=True
|
||
[ComfyUI] [worker:ComfyUI-Sharp] [SharpRayToPlanarDepth] ray->planar: B=42 1536×1536, cos_map per-face (3D K), intrinsics_rescaled fx=768.0 cx=768.0
|
||
[ComfyUI] [SubprocessWorker] got response: ok
|
||
[ComfyUI] [comfy-env] SharpRayToPlanarDepth done (5.04s): result: NodeOutput
|
||
[ComfyUI] [VRAM] After SharpRayToPlanarDepth: 6892 / 24122 MB
|
||
[ComfyUI] [VRAM] Loaded: SubprocessModel (631 MB)
|
||
[ComfyUI] [comfy-env] Running SharpPredictGaussiansFromMetricDepth: snap_to_external_depth: 'none', depth_convention: 'planar_z', focal_length_mm: 30.0, output_prefix: 'sharp_aligned', save_background_layer: True, edge_crop: 0.0, model: dict, image: torch.float32 [42,1536,1536,3] cpu, metric_depth_layer0: torch.float32 [42,1536,1536,3] cpu, extrinsics: torch.float32 [42,4,4] cpu, intrinsics: torch.float32 [42,3,3] cpu, mask: torch.float32 [42,1536,1536] cpu
|
||
[ComfyUI] [VRAM] Before SharpPredictGaussiansFromMetricDepth: 6892 / 24122 MB
|
||
[ComfyUI] [VRAM] Loaded: SubprocessModel (631 MB)
|
||
[ComfyUI] [SubprocessWorker] call_method: nodes.predict_gaussians_from_depth.SharpPredictGaussiansFromMetricDepth.EXECUTE_NORMALIZED
|
||
[ComfyUI] [SubprocessWorker] acquired lock, ensuring started...
|
||
[ComfyUI] [ComfyUI-Sharp] Health check: ping (timeout=5.0s)...
|
||
[ComfyUI] [ComfyUI-Sharp] Health check: ok
|
||
[ComfyUI] [SubprocessWorker] worker started/confirmed
|
||
[ComfyUI] [comfy-env] PRE-SERIALIZE 'image' shape: torch.Size([42, 1536, 1536, 3])
|
||
[ComfyUI] [comfy-env] PRE-SERIALIZE 'metric_depth_layer0' shape: torch.Size([42, 1536, 1536, 3])
|
||
[ComfyUI] [comfy-env] PRE-SERIALIZE 'extrinsics' shape: torch.Size([42, 4, 4])
|
||
[ComfyUI] [comfy-env] PRE-SERIALIZE 'intrinsics' shape: torch.Size([42, 3, 3])
|
||
[ComfyUI] [comfy-env] PRE-SERIALIZE 'mask' shape: torch.Size([42, 1536, 1536])
|
||
[ComfyUI] [SubprocessWorker] serializing kwargs to shm...
|
||
[capture-loop] iter=2250 t=246.0s state={'complete': False, 'error': None, 'executedCount': 4, 'wsState': 1} eval_ms=3 ram=20.7/31.3GB (66%) swap=5.8/32.0GB (18%) cpu=16% browser_rss=0.94GB
|
||
[ComfyUI] [SubprocessWorker] created 0 shm blocks
|
||
[ComfyUI] [SubprocessWorker] sending request via socket...
|
||
[ComfyUI] [SubprocessWorker] call_id=3 sending call_method
|
||
[ComfyUI] [worker:ComfyUI-Sharp] [comfy-env] _from_shm got dict with keys: ['__type__', 'strategy', 'parent_pid', 'fd', 'storage_size']
|
||
[ComfyUI] [worker:ComfyUI-Sharp] [comfy-env] DESERIALIZE TensorRef: tensor_size=[42, 1536, 1536, 3]
|
||
[ComfyUI] [worker:ComfyUI-Sharp] [comfy-env] DESERIALIZED tensor shape: torch.Size([42, 1536, 1536, 3])
|
||
[ComfyUI] [worker:ComfyUI-Sharp] [comfy-env] _from_shm got dict with keys: ['__type__', 'strategy', 'parent_pid', 'fd', 'storage_size']
|
||
[ComfyUI] [worker:ComfyUI-Sharp] [comfy-env] DESERIALIZE TensorRef: tensor_size=[42, 1536, 1536, 3]
|
||
[ComfyUI] [worker:ComfyUI-Sharp] [comfy-env] DESERIALIZED tensor shape: torch.Size([42, 1536, 1536, 3])
|
||
[ComfyUI] [worker:ComfyUI-Sharp] [comfy-env] _from_shm got dict with keys: ['__type__', 'strategy', 'parent_pid', 'fd', 'storage_size']
|
||
[ComfyUI] [worker:ComfyUI-Sharp] [comfy-env] DESERIALIZE TensorRef: tensor_size=[42, 4, 4]
|
||
[ComfyUI] [worker:ComfyUI-Sharp] [comfy-env] DESERIALIZED tensor shape: torch.Size([42, 4, 4])
|
||
[ComfyUI] [worker:ComfyUI-Sharp] [comfy-env] _from_shm got dict with keys: ['__type__', 'strategy', 'parent_pid', 'fd', 'storage_size']
|
||
[ComfyUI] [worker:ComfyUI-Sharp] [comfy-env] DESERIALIZE TensorRef: tensor_size=[42, 3, 3]
|
||
[ComfyUI] [worker:ComfyUI-Sharp] [comfy-env] DESERIALIZED tensor shape: torch.Size([42, 3, 3])
|
||
[ComfyUI] [worker:ComfyUI-Sharp] [comfy-env] _from_shm got dict with keys: ['__type__', 'strategy', 'parent_pid', 'fd', 'storage_size']
|
||
[ComfyUI] [worker:ComfyUI-Sharp] [comfy-env] DESERIALIZE TensorRef: tensor_size=[42, 1536, 1536]
|
||
[ComfyUI] [worker:ComfyUI-Sharp] [comfy-env] DESERIALIZED tensor shape: torch.Size([42, 1536, 1536])
|
||
Frame 34 saved (frame_033.jpg, t=247.4s)
|
||
[capture-periodic] freeze=1ms shot=98ms unfreeze=5ms saved=True
|
||
Frame 35 saved (frame_034.jpg, t=249.6s)
|
||
[capture-periodic] freeze=1ms shot=94ms unfreeze=5ms saved=True
|
||
[capture-loop] iter=2300 t=251.4s state={'complete': False, 'error': None, 'executedCount': 4, 'wsState': 1} eval_ms=1 ram=21.8/31.3GB (70%) swap=5.8/32.0GB (18%) cpu=19% browser_rss=0.94GB
|
||
[ComfyUI] [worker:ComfyUI-Sharp] [LoadSharpModel] loading checkpoint from /workspaces/Sharp-2132/ComfyUI/models/sharp/sharp_2572gikvuh.pt (dtype=bf16)
|
||
[ComfyUI] [worker:ComfyUI-Sharp] [LoadSharpModel] initializing model on meta device...
|
||
[ComfyUI] [worker:ComfyUI-Sharp] [LoadSharpModel] model ready (torch.bfloat16)
|
||
[ComfyUI] [worker:ComfyUI-Sharp] [SharpPredictGaussiansFromMetricDepth] metric_depth_layer1 unwired -> layer 1 will duplicate layer 0 (legacy behavior)
|
||
[ComfyUI] [SubprocessWorker] callback 'request_vram_budget' from call_id=3
|
||
[ComfyUI] [comfy-env] VRAM request: 2.81GB, free before eviction: 18.07GB
|
||
[ComfyUI] [comfy-env] VRAM after eviction: 18.07GB
|
||
[ComfyUI] [worker:ComfyUI-Sharp] [VRAM] +635MB (now 635MB) reserved=640MB peak=635MB
|
||
[ComfyUI] [worker:ComfyUI-Sharp] [SharpPredictGaussiansFromMetricDepth] face 1/42: 1536×1536, extrinsics=[-0.00, -0.00, -0.00], intrinsics=fx=0.5000 cx=0.5000, mask=yes, snap=none, depth_conv=planar_z
|
||
[ComfyUI] [worker:ComfyUI-Sharp] [VRAM] +2679MB (now 3314MB) reserved=3424MB peak=3359MB
|
||
[ComfyUI] [worker:ComfyUI-Sharp] [VRAM] +296MB (now 3610MB) reserved=3776MB peak=3610MB
|
||
[capture-loop] iter=2350 t=256.9s state={'complete': False, 'error': None, 'executedCount': 4, 'wsState': 1} eval_ms=1 ram=22.6/31.3GB (72%) swap=5.8/32.0GB (18%) cpu=18% browser_rss=0.59GB
|
||
[ComfyUI] [worker:ComfyUI-Sharp] [VRAM] +562MB (now 4173MB) reserved=7584MB peak=7062MB
|
||
[ComfyUI] [worker:ComfyUI-Sharp] [SharpPredictGaussiansFromMetricDepth] detected normalized intrinsics (fx<2); rescaled to pixel-K for 1536x1536: fx=768.0 cx=768.0
|
||
[ComfyUI] [worker:ComfyUI-Sharp] [VRAM] +605MB (now 4778MB) reserved=6976MB peak=7062MB
|
||
[ComfyUI] [worker:ComfyUI-Sharp] [SharpPredictGaussiansFromMetricDepth] mask -> kept 89266/1179648 gaussians (7.6%)
|
||
[ComfyUI] [SubprocessWorker] callback 'report_progress' from call_id=3
|
||
[ComfyUI] [worker:ComfyUI-Sharp] [SharpPredictGaussiansFromMetricDepth] face 2/42: 1536×1536, extrinsics=[-0.00, -0.00, -0.00], intrinsics=fx=0.5000 cx=0.5000, mask=yes, snap=none, depth_conv=planar_z
|
||
[ComfyUI] [worker:ComfyUI-Sharp] [VRAM] +330MB (now 5108MB) reserved=6976MB peak=7062MB
|
||
Frame 36 saved (frame_035.jpg, t=260.4s)
|
||
[capture-periodic] freeze=1ms shot=99ms unfreeze=4ms saved=True
|
||
[ComfyUI] [worker:ComfyUI-Sharp] [VRAM] -519MB (now 4590MB) reserved=9984MB peak=7062MB
|
||
[capture-loop] iter=2400 t=262.2s state={'complete': False, 'error': None, 'executedCount': 4, 'wsState': 1} eval_ms=1 ram=26.3/31.3GB (84%) swap=5.8/32.0GB (18%) cpu=14% browser_rss=0.59GB
|
||
[ComfyUI] [SubprocessWorker] callback 'report_progress' from call_id=3
|
||
[ComfyUI] [worker:ComfyUI-Sharp] [SharpPredictGaussiansFromMetricDepth] face 3/42: 1536×1536, extrinsics=[-0.00, -0.00, -0.00], intrinsics=fx=0.5000 cx=0.5000, mask=yes, snap=none, depth_conv=planar_z
|
||
[ComfyUI] [worker:ComfyUI-Sharp] [VRAM] +520MB (now 5110MB) reserved=7264MB peak=7062MB
|
||
Frame 37 saved (frame_036.jpg, t=264.8s)
|
||
[capture-periodic] freeze=1ms shot=93ms unfreeze=1ms saved=True
|
||
[ComfyUI] [worker:ComfyUI-Sharp] [VRAM] +345MB (now 5456MB) reserved=5760MB peak=7062MB
|
||
[ComfyUI] [worker:ComfyUI-Sharp] [VRAM] -864MB (now 4592MB) reserved=10112MB peak=7062MB
|
||
[capture-loop] iter=2450 t=267.8s state={'complete': False, 'error': None, 'executedCount': 4, 'wsState': 1} eval_ms=1 ram=24.4/31.3GB (78%) swap=6.9/32.0GB (22%) cpu=19% browser_rss=0.57GB
|
||
[ComfyUI] [SubprocessWorker] callback 'report_progress' from call_id=3
|
||
[ComfyUI] [worker:ComfyUI-Sharp] [SharpPredictGaussiansFromMetricDepth] face 4/42: 1536×1536, extrinsics=[-0.00, -0.00, -0.00], intrinsics=fx=0.5000 cx=0.5000, mask=yes, snap=none, depth_conv=planar_z
|
||
[ComfyUI] [worker:ComfyUI-Sharp] [VRAM] +550MB (now 5143MB) reserved=7648MB peak=7062MB
|
||
Frame 38 saved (frame_037.jpg, t=269.2s)
|
||
[capture-periodic] freeze=1ms shot=101ms unfreeze=5ms saved=True
|
||
[ComfyUI] [worker:ComfyUI-Sharp] [VRAM] +309MB (now 5453MB) reserved=6208MB peak=7062MB
|
||
[ComfyUI] [worker:ComfyUI-Sharp] [VRAM] -864MB (now 4589MB) reserved=10112MB peak=7062MB
|
||
[ComfyUI] [SubprocessWorker] callback 'report_progress' from call_id=3
|
||
[ComfyUI] [worker:ComfyUI-Sharp] [SharpPredictGaussiansFromMetricDepth] face 5/42: 1536×1536, extrinsics=[-0.00, -0.00, -0.00], intrinsics=fx=0.5000 cx=0.5000, mask=yes, snap=none, depth_conv=planar_z
|
||
[ComfyUI] [worker:ComfyUI-Sharp] [VRAM] +621MB (now 5211MB) reserved=7648MB peak=7062MB
|
||
[capture-loop] iter=2500 t=273.2s state={'complete': False, 'error': None, 'executedCount': 4, 'wsState': 1} eval_ms=1 ram=24.1/31.3GB (77%) swap=7.6/32.0GB (24%) cpu=20% browser_rss=0.55GB
|
||
Frame 39 saved (frame_038.jpg, t=273.7s)
|
||
[capture-periodic] freeze=1ms shot=111ms unfreeze=4ms saved=True
|
||
[ComfyUI] [worker:ComfyUI-Sharp] [VRAM] -618MB (now 4593MB) reserved=10784MB peak=7062MB
|
||
[ComfyUI] [SubprocessWorker] callback 'report_progress' from call_id=3
|
||
[ComfyUI] [worker:ComfyUI-Sharp] [SharpPredictGaussiansFromMetricDepth] face 6/42: 1536×1536, extrinsics=[-0.00, -0.00, -0.00], intrinsics=fx=0.5000 cx=0.5000, mask=yes, snap=none, depth_conv=planar_z
|
||
[ComfyUI] [worker:ComfyUI-Sharp] [VRAM] +514MB (now 5108MB) reserved=7392MB peak=7062MB
|
||
Frame 40 saved (frame_039.jpg, t=278.0s)
|
||
[capture-periodic] freeze=1ms shot=114ms unfreeze=1ms saved=True
|
||
[ComfyUI] [worker:ComfyUI-Sharp] [VRAM] -519MB (now 4590MB) reserved=10112MB peak=7062MB
|
||
[capture-loop] iter=2550 t=278.8s state={'complete': False, 'error': None, 'executedCount': 4, 'wsState': 1} eval_ms=2 ram=24.6/31.3GB (79%) swap=7.9/32.0GB (25%) cpu=21% browser_rss=0.54GB
|
||
[ComfyUI] [SubprocessWorker] callback 'report_progress' from call_id=3
|
||
[ComfyUI] [worker:ComfyUI-Sharp] [SharpPredictGaussiansFromMetricDepth] face 7/42: 1536×1536, extrinsics=[-0.00, -0.00, -0.00], intrinsics=fx=0.5000 cx=0.5000, mask=yes, snap=none, depth_conv=planar_z
|
||
[ComfyUI] [worker:ComfyUI-Sharp] [VRAM] +507MB (now 5097MB) reserved=7648MB peak=7062MB
|
||
[ComfyUI] [worker:ComfyUI-Sharp] [VRAM] -269MB (now 4829MB) reserved=5472MB peak=7062MB
|
||
Frame 41 saved (frame_040.jpg, t=282.4s)
|
||
[capture-periodic] freeze=1ms shot=95ms unfreeze=3ms saved=True
|
||
[ComfyUI] [worker:ComfyUI-Sharp] [VRAM] -241MB (now 4588MB) reserved=10656MB peak=7062MB
|
||
[capture-loop] iter=2600 t=284.2s state={'complete': False, 'error': None, 'executedCount': 4, 'wsState': 1} eval_ms=1 ram=23.9/31.3GB (77%) swap=8.5/32.0GB (27%) cpu=20% browser_rss=0.53GB
|
||
[ComfyUI] [SubprocessWorker] callback 'report_progress' from call_id=3
|
||
[ComfyUI] [worker:ComfyUI-Sharp] [SharpPredictGaussiansFromMetricDepth] face 8/42: 1536×1536, extrinsics=[-0.00, -0.00, -0.00], intrinsics=fx=0.5000 cx=0.5000, mask=yes, snap=none, depth_conv=planar_z
|
||
[ComfyUI] [worker:ComfyUI-Sharp] [VRAM] +556MB (now 5145MB) reserved=7616MB peak=7062MB
|
||
[ComfyUI] [worker:ComfyUI-Sharp] [VRAM] +309MB (now 5455MB) reserved=6176MB peak=7062MB
|
||
Frame 42 saved (frame_041.jpg, t=286.8s)
|
||
[capture-periodic] freeze=1ms shot=107ms unfreeze=6ms saved=True
|
||
[ComfyUI] [worker:ComfyUI-Sharp] [VRAM] -864MB (now 4591MB) reserved=10720MB peak=7062MB
|
||
[ComfyUI] [SubprocessWorker] callback 'report_progress' from call_id=3
|
||
[ComfyUI] [worker:ComfyUI-Sharp] [SharpPredictGaussiansFromMetricDepth] face 9/42: 1536×1536, extrinsics=[-0.00, -0.00, -0.00], intrinsics=fx=0.5000 cx=0.5000, mask=yes, snap=none, depth_conv=planar_z
|
||
[ComfyUI] [worker:ComfyUI-Sharp] [VRAM] +547MB (now 5138MB) reserved=7712MB peak=7062MB
|
||
[capture-loop] iter=2650 t=289.7s state={'complete': False, 'error': None, 'executedCount': 4, 'wsState': 1} eval_ms=1 ram=23.9/31.3GB (77%) swap=8.9/32.0GB (28%) cpu=22% browser_rss=0.53GB
|
||
[ComfyUI] [worker:ComfyUI-Sharp] [VRAM] -312MB (now 4826MB) reserved=5504MB peak=7062MB
|
||
Frame 43 saved (frame_042.jpg, t=291.2s)
|
||
[capture-periodic] freeze=1ms shot=105ms unfreeze=7ms saved=True
|
||
[ComfyUI] [worker:ComfyUI-Sharp] [VRAM] -234MB (now 4593MB) reserved=10720MB peak=7062MB
|
||
[ComfyUI] [SubprocessWorker] callback 'report_progress' from call_id=3
|
||
[ComfyUI] [worker:ComfyUI-Sharp] [SharpPredictGaussiansFromMetricDepth] face 10/42: 1536×1536, extrinsics=[-0.00, -0.00, -0.00], intrinsics=fx=0.5000 cx=0.5000, mask=yes, snap=none, depth_conv=planar_z
|
||
[ComfyUI] [worker:ComfyUI-Sharp] [VRAM] +517MB (now 5110MB) reserved=7840MB peak=7062MB
|
||
[ComfyUI] [worker:ComfyUI-Sharp] [VRAM] -519MB (now 4592MB) reserved=10624MB peak=7062MB
|
||
[capture-loop] iter=2700 t=295.2s state={'complete': False, 'error': None, 'executedCount': 4, 'wsState': 1} eval_ms=1 ram=22.7/31.3GB (73%) swap=9.4/32.0GB (29%) cpu=22% browser_rss=0.53GB
|
||
Frame 44 saved (frame_043.jpg, t=295.6s)
|
||
[capture-periodic] freeze=1ms shot=103ms unfreeze=18ms saved=True
|
||
[ComfyUI] [SubprocessWorker] callback 'report_progress' from call_id=3
|
||
[ComfyUI] [worker:ComfyUI-Sharp] [SharpPredictGaussiansFromMetricDepth] face 11/42: 1536×1536, extrinsics=[-0.00, -0.00, -0.00], intrinsics=fx=0.5000 cx=0.5000, mask=yes, snap=none, depth_conv=planar_z
|
||
[ComfyUI] [worker:ComfyUI-Sharp] [VRAM] +578MB (now 5170MB) reserved=7904MB peak=7062MB
|
||
[ComfyUI] [worker:ComfyUI-Sharp] [VRAM] -582MB (now 4589MB) reserved=11520MB peak=7062MB
|
||
Frame 45 saved (frame_044.jpg, t=300.0s)
|
||
[capture-periodic] freeze=1ms shot=95ms unfreeze=8ms saved=True
|
||
[ComfyUI] [worker:ComfyUI-Sharp]
|
||
[ComfyUI] === WATCHDOG TICK 1 ===
|
||
[ComfyUI] [worker:ComfyUI-Sharp] Thread 0x00007b50afbff640 (most recent call first):
|
||
[ComfyUI] File "/tmp/comfytest-home/.ce/.pixi/envs/sharp-nodes/lib/python3.12/socket.py", line 295 in accept
|
||
[capture-loop] iter=2750 t=300.7s state={'complete': False, 'error': None, 'executedCount': 4, 'wsState': 1} eval_ms=1 ram=24.1/31.3GB (77%) swap=10.0/32.0GB (31%) cpu=22% browser_rss=0.51GB
|
||
[ComfyUI] File "/tmp/comfytest-home/.ce/.pixi/envs/sharp-nodes/lib/python3.12/multiprocessing/connection.py", line 626 in accept
|
||
[ComfyUI] File "/tmp/comfytest-home/.ce/.pixi/envs/sharp-nodes/lib/python3.12/multiprocessing/connection.py", line 480 in accept
|
||
[ComfyUI] File "/tmp/comfytest-home/.ce/.pixi/envs/sharp-nodes/lib/python3.12/multiprocessing/resource_sharer.py", line 138 in _serve
|
||
[ComfyUI] File "/tmp/comfytest-home/.ce/.pixi/envs/sharp-nodes/lib/python3.12/threading.py", line 1012 in run
|
||
[ComfyUI] File "/tmp/comfytest-home/.ce/.pixi/envs/sharp-nodes/lib/python3.12/threading.py", line 1075 in _bootstrap_inner
|
||
[ComfyUI] File "/tmp/comfytest-home/.ce/.pixi/envs/sharp-nodes/lib/python3.12/threading.py", line 1032 in _bootstrap
|
||
[ComfyUI]
|
||
[ComfyUI] Thread 0x00007b5263794640 (most recent call first):
|
||
[ComfyUI] File "/tmp/comfyui_pvenv_fah6gilt/persistent_worker.py", line 106 in _vram_poller
|
||
[ComfyUI] File "/tmp/comfytest-home/.ce/.pixi/envs/sharp-nodes/lib/python3.12/threading.py", line 1012 in run
|
||
[ComfyUI] File "/tmp/comfytest-home/.ce/.pixi/envs/sharp-nodes/lib/python3.12/threading.py", line 1075 in _bootstrap_inner
|
||
[ComfyUI] File "/tmp/comfytest-home/.ce/.pixi/envs/sharp-nodes/lib/python3.12/threading.py", line 1032 in _bootstrap
|
||
[ComfyUI]
|
||
[ComfyUI] Current thread 0x00007b5263f99640 (most recent call first):
|
||
[ComfyUI] File "/tmp/comfyui_pvenv_fah6gilt/persistent_worker.py", line 52 in _watchdog
|
||
[ComfyUI] File "/tmp/comfytest-home/.ce/.pixi/envs/sharp-nodes/lib/python3.12/threading.py", line 1012 in run
|
||
[ComfyUI] File "/tmp/comfytest-home/.ce/.pixi/envs/sharp-nodes/lib/python3.12/threading.py", line 1075 in _bootstrap_inner
|
||
[ComfyUI] File "/tmp/comfytest-home/.ce/.pixi/envs/sharp-nodes/lib/python3.12/threading.py", line 1032 in _bootstrap
|
||
[ComfyUI]
|
||
[ComfyUI] Thread 0x00007b5264594740 (most recent call first):
|
||
[ComfyUI] File "/workspaces/Sharp-2132/ComfyUI/custom_nodes/ComfyUI-Sharp/nodes/predict_gaussian_attrs.py", line 112 in _monodepth_to
|
||
[ComfyUI] File "/workspaces/Sharp-2132/ComfyUI/custom_nodes/ComfyUI-Sharp/nodes/predict_gaussians_from_depth.py", line 394 in execute
|
||
[ComfyUI] File "/tmp/comfytest-home/.ce/.pixi/envs/sharp-nodes/lib/python3.12/site-packages/torch/utils/_contextlib.py", line 124 in decorate_context
|
||
[ComfyUI] File "/workspaces/Sharp-2132/ComfyUI/comfy_api/latest/_io.py", line 1892 in EXECUTE_NORMALIZED
|
||
[ComfyUI] File "/tmp/comfyui_pvenv_fah6gilt/persistent_worker.py", line 1762 in main
|
||
[ComfyUI] File "/tmp/comfyui_pvenv_fah6gilt/persistent_worker.py", line 1807 in <module>
|
||
[ComfyUI]
|
||
[ComfyUI] [worker:ComfyUI-Sharp] === END ===
|
||
[ComfyUI]
|
||
[ComfyUI] [SubprocessWorker] callback 'report_progress' from call_id=3
|
||
[ComfyUI] [worker:ComfyUI-Sharp] [SharpPredictGaussiansFromMetricDepth] face 12/42: 1536×1536, extrinsics=[-0.00, -0.00, -0.00], intrinsics=fx=0.5000 cx=0.5000, mask=yes, snap=none, depth_conv=planar_z
|
||
[ComfyUI] [worker:ComfyUI-Sharp] [VRAM] +573MB (now 5162MB) reserved=7584MB peak=7062MB
|
||
[ComfyUI] [worker:ComfyUI-Sharp] [VRAM] -573MB (now 4590MB) reserved=10688MB peak=7062MB
|
||
Frame 46 saved (frame_045.jpg, t=304.4s)
|
||
[capture-periodic] freeze=1ms shot=107ms unfreeze=1ms saved=True
|
||
[capture-loop] iter=2800 t=306.2s state={'complete': False, 'error': None, 'executedCount': 4, 'wsState': 1} eval_ms=1 ram=21.6/31.3GB (69%) swap=11.0/32.0GB (34%) cpu=22% browser_rss=0.50GB
|
||
[ComfyUI] [SubprocessWorker] callback 'report_progress' from call_id=3
|
||
[ComfyUI] [worker:ComfyUI-Sharp] [SharpPredictGaussiansFromMetricDepth] face 13/42: 1536×1536, extrinsics=[-0.00, -0.00, -0.00], intrinsics=fx=0.5000 cx=0.5000, mask=yes, snap=none, depth_conv=planar_z
|
||
[ComfyUI] [worker:ComfyUI-Sharp] [VRAM] +582MB (now 5173MB) reserved=7904MB peak=7062MB
|
||
Frame 47 saved (frame_046.jpg, t=306.6s)
|
||
[capture-periodic] freeze=1ms shot=147ms unfreeze=1ms saved=True
|
||
[ComfyUI] [worker:ComfyUI-Sharp] [VRAM] -582MB (now 4592MB) reserved=10784MB peak=7062MB
|
||
Frame 48 saved (frame_047.jpg, t=308.8s)
|
||
[capture-periodic] freeze=1ms shot=108ms unfreeze=7ms saved=True
|
||
[ComfyUI] [SubprocessWorker] callback 'report_progress' from call_id=3
|
||
[ComfyUI] [worker:ComfyUI-Sharp] [SharpPredictGaussiansFromMetricDepth] face 14/42: 1536×1536, extrinsics=[-0.00, -0.00, -0.00], intrinsics=fx=0.5000 cx=0.5000, mask=yes, snap=none, depth_conv=planar_z
|
||
[ComfyUI] [worker:ComfyUI-Sharp] [VRAM] +583MB (now 5176MB) reserved=7712MB peak=7062MB
|
||
Frame 49 saved (frame_048.jpg, t=311.0s)
|
||
[capture-periodic] freeze=1ms shot=120ms unfreeze=19ms saved=True
|
||
[capture-loop] iter=2850 t=311.8s state={'complete': False, 'error': None, 'executedCount': 4, 'wsState': 1} eval_ms=2 ram=20.3/31.3GB (65%) swap=12.0/32.0GB (38%) cpu=23% browser_rss=0.50GB
|
||
[ComfyUI] [worker:ComfyUI-Sharp] [VRAM] -582MB (now 4594MB) reserved=10688MB peak=7062MB
|
||
Frame 50 saved (frame_049.jpg, t=313.3s)
|
||
[capture-periodic] freeze=1ms shot=104ms unfreeze=4ms saved=True
|
||
[ComfyUI] [SubprocessWorker] callback 'report_progress' from call_id=3
|
||
[ComfyUI] [worker:ComfyUI-Sharp] [SharpPredictGaussiansFromMetricDepth] face 15/42: 1536×1536, extrinsics=[-0.00, -0.00, -0.00], intrinsics=fx=0.5000 cx=0.5000, mask=yes, snap=none, depth_conv=planar_z
|
||
[ComfyUI] [worker:ComfyUI-Sharp] [VRAM] +563MB (now 5158MB) reserved=7936MB peak=7062MB
|
||
Frame 51 saved (frame_050.jpg, t=315.5s)
|
||
[capture-periodic] freeze=2ms shot=119ms unfreeze=1ms saved=True
|
||
[ComfyUI] [worker:ComfyUI-Sharp] [VRAM] -564MB (now 4595MB) reserved=11424MB peak=7062MB
|
||
[capture-loop] iter=2900 t=317.3s state={'complete': False, 'error': None, 'executedCount': 4, 'wsState': 1} eval_ms=1 ram=20.4/31.3GB (65%) swap=12.1/32.0GB (38%) cpu=22% browser_rss=0.50GB
|
||
[ComfyUI] [SubprocessWorker] callback 'report_progress' from call_id=3
|
||
[ComfyUI] [worker:ComfyUI-Sharp] [SharpPredictGaussiansFromMetricDepth] face 16/42: 1536×1536, extrinsics=[-0.00, -0.00, -0.00], intrinsics=fx=0.5000 cx=0.5000, mask=yes, snap=none, depth_conv=planar_z
|
||
[ComfyUI] [worker:ComfyUI-Sharp] [VRAM] +553MB (now 5149MB) reserved=7424MB peak=7062MB
|
||
Frame 52 saved (frame_051.jpg, t=319.9s)
|
||
[capture-periodic] freeze=1ms shot=98ms unfreeze=5ms saved=True
|
||
[ComfyUI] [worker:ComfyUI-Sharp] [VRAM] +309MB (now 5459MB) reserved=6176MB peak=7062MB
|
||
[ComfyUI] [worker:ComfyUI-Sharp] [VRAM] -864MB (now 4595MB) reserved=10752MB peak=7062MB
|
||
[capture-loop] iter=2950 t=322.8s state={'complete': False, 'error': None, 'executedCount': 4, 'wsState': 1} eval_ms=1 ram=19.7/31.3GB (63%) swap=13.0/32.0GB (40%) cpu=20% browser_rss=0.50GB
|
||
[ComfyUI] [SubprocessWorker] callback 'report_progress' from call_id=3
|
||
[ComfyUI] [worker:ComfyUI-Sharp] [SharpPredictGaussiansFromMetricDepth] face 17/42: 1536×1536, extrinsics=[-0.00, -0.00, -0.00], intrinsics=fx=0.5000 cx=0.5000, mask=yes, snap=none, depth_conv=planar_z
|
||
[ComfyUI] [worker:ComfyUI-Sharp] [VRAM] +503MB (now 5099MB) reserved=7296MB peak=7062MB
|
||
Frame 53 saved (frame_052.jpg, t=324.2s)
|
||
[capture-periodic] freeze=1ms shot=109ms unfreeze=4ms saved=True
|
||
[ComfyUI] [worker:ComfyUI-Sharp] [VRAM] -510MB (now 4589MB) reserved=11552MB peak=7062MB
|
||
[ComfyUI] [SubprocessWorker] callback 'report_progress' from call_id=3
|
||
[ComfyUI] [worker:ComfyUI-Sharp] [SharpPredictGaussiansFromMetricDepth] face 18/42: 1536×1536, extrinsics=[-0.00, -0.00, -0.00], intrinsics=fx=0.5000 cx=0.5000, mask=yes, snap=none, depth_conv=planar_z
|
||
[ComfyUI] [worker:ComfyUI-Sharp] [VRAM] +517MB (now 5107MB) reserved=7616MB peak=7062MB
|
||
[capture-loop] iter=3000 t=328.2s state={'complete': False, 'error': None, 'executedCount': 4, 'wsState': 1} eval_ms=2 ram=19.1/31.3GB (61%) swap=13.3/32.0GB (42%) cpu=22% browser_rss=0.51GB
|
||
Frame 54 saved (frame_053.jpg, t=328.6s)
|
||
[capture-periodic] freeze=1ms shot=99ms unfreeze=5ms saved=True
|
||
[ComfyUI] [worker:ComfyUI-Sharp] [VRAM] +345MB (now 5453MB) reserved=6112MB peak=7062MB
|
||
[ComfyUI] [worker:ComfyUI-Sharp] [VRAM] -864MB (now 4589MB) reserved=10688MB peak=7062MB
|
||
[ComfyUI] [SubprocessWorker] callback 'report_progress' from call_id=3
|
||
[ComfyUI] [worker:ComfyUI-Sharp] [SharpPredictGaussiansFromMetricDepth] face 19/42: 1536×1536, extrinsics=[-0.00, -0.00, -0.00], intrinsics=fx=0.5000 cx=0.5000, mask=yes, snap=none, depth_conv=planar_z
|
||
[ComfyUI] [worker:ComfyUI-Sharp] [VRAM] +544MB (now 5134MB) reserved=7872MB peak=7062MB
|
||
Frame 55 saved (frame_054.jpg, t=333.0s)
|
||
[capture-periodic] freeze=1ms shot=105ms unfreeze=5ms saved=True
|
||
[ComfyUI] [worker:ComfyUI-Sharp] [VRAM] -546MB (now 4589MB) reserved=10048MB peak=7062MB
|
||
[capture-loop] iter=3050 t=333.7s state={'complete': False, 'error': None, 'executedCount': 4, 'wsState': 1} eval_ms=1 ram=18.6/31.3GB (60%) swap=13.4/32.0GB (42%) cpu=21% browser_rss=0.51GB
|
||
[ComfyUI] [SubprocessWorker] callback 'report_progress' from call_id=3
|
||
[ComfyUI] [worker:ComfyUI-Sharp] [SharpPredictGaussiansFromMetricDepth] face 20/42: 1536×1536, extrinsics=[-0.00, -0.00, -0.00], intrinsics=fx=0.5000 cx=0.5000, mask=yes, snap=none, depth_conv=planar_z
|
||
[ComfyUI] [worker:ComfyUI-Sharp] [VRAM] +554MB (now 5143MB) reserved=7648MB peak=7062MB
|
||
Frame 56 saved (frame_055.jpg, t=337.4s)
|
||
[capture-periodic] freeze=1ms shot=116ms unfreeze=16ms saved=True
|
||
[ComfyUI] [worker:ComfyUI-Sharp] [VRAM] +309MB (now 5453MB) reserved=6176MB peak=7062MB
|
||
[ComfyUI] [worker:ComfyUI-Sharp] [VRAM] -864MB (now 4589MB) reserved=11520MB peak=7062MB
|
||
[capture-loop] iter=3100 t=339.2s state={'complete': False, 'error': None, 'executedCount': 4, 'wsState': 1} eval_ms=2 ram=20.5/31.3GB (66%) swap=13.8/32.0GB (43%) cpu=21% browser_rss=0.50GB
|
||
[ComfyUI] [SubprocessWorker] callback 'report_progress' from call_id=3
|
||
[ComfyUI] [worker:ComfyUI-Sharp] [SharpPredictGaussiansFromMetricDepth] face 21/42: 1536×1536, extrinsics=[-0.00, -0.00, -0.00], intrinsics=fx=0.5000 cx=0.5000, mask=yes, snap=none, depth_conv=planar_z
|
||
[ComfyUI] [worker:ComfyUI-Sharp] [VRAM] +581MB (now 5170MB) reserved=7520MB peak=7062MB
|
||
[ComfyUI] [worker:ComfyUI-Sharp] [VRAM] -582MB (now 4589MB) reserved=11520MB peak=7062MB
|
||
Frame 57 saved (frame_056.jpg, t=341.7s)
|
||
[capture-periodic] freeze=1ms shot=104ms unfreeze=5ms saved=True
|
||
[ComfyUI] [SubprocessWorker] callback 'report_progress' from call_id=3
|
||
[ComfyUI] [worker:ComfyUI-Sharp] [SharpPredictGaussiansFromMetricDepth] face 22/42: 1536×1536, extrinsics=[-0.00, -0.00, -0.00], intrinsics=fx=0.5000 cx=0.5000, mask=yes, snap=none, depth_conv=planar_z
|
||
[ComfyUI] [worker:ComfyUI-Sharp] [VRAM] +582MB (now 5171MB) reserved=7648MB peak=7062MB
|
||
[capture-loop] iter=3150 t=344.6s state={'complete': False, 'error': None, 'executedCount': 4, 'wsState': 1} eval_ms=2 ram=19.2/31.3GB (62%) swap=14.0/32.0GB (44%) cpu=19% browser_rss=0.50GB
|
||
[ComfyUI] [worker:ComfyUI-Sharp] [VRAM] -582MB (now 4590MB) reserved=10528MB peak=7062MB
|
||
Frame 58 saved (frame_057.jpg, t=346.1s)
|
||
[capture-periodic] freeze=1ms shot=100ms unfreeze=1ms saved=True
|
||
[ComfyUI] [SubprocessWorker] callback 'report_progress' from call_id=3
|
||
[ComfyUI] [worker:ComfyUI-Sharp] [SharpPredictGaussiansFromMetricDepth] face 23/42: 1536×1536, extrinsics=[-0.00, -0.00, -0.00], intrinsics=fx=0.5000 cx=0.5000, mask=yes, snap=none, depth_conv=planar_z
|
||
[ComfyUI] [worker:ComfyUI-Sharp] [VRAM] +563MB (now 5153MB) reserved=7872MB peak=7062MB
|
||
[capture-loop] iter=3200 t=350.1s state={'complete': False, 'error': None, 'executedCount': 4, 'wsState': 1} eval_ms=1 ram=17.5/31.3GB (56%) swap=14.0/32.0GB (44%) cpu=22% browser_rss=0.50GB
|
||
[ComfyUI] [worker:ComfyUI-Sharp] [VRAM] -564MB (now 4590MB) reserved=10080MB peak=7062MB
|
||
Frame 59 saved (frame_058.jpg, t=350.5s)
|
||
[capture-periodic] freeze=1ms shot=109ms unfreeze=6ms saved=True
|
||
[ComfyUI] [SubprocessWorker] callback 'report_progress' from call_id=3
|
||
[ComfyUI] [worker:ComfyUI-Sharp] [SharpPredictGaussiansFromMetricDepth] face 24/42: 1536×1536, extrinsics=[-0.00, -0.00, -0.00], intrinsics=fx=0.5000 cx=0.5000, mask=yes, snap=none, depth_conv=planar_z
|
||
[ComfyUI] [worker:ComfyUI-Sharp] [VRAM] +508MB (now 5099MB) reserved=7328MB peak=7062MB
|
||
[ComfyUI] [worker:ComfyUI-Sharp] [VRAM] -510MB (now 4590MB) reserved=11520MB peak=7062MB
|
||
Frame 60 saved (frame_059.jpg, t=354.9s)
|
||
[capture-periodic] freeze=1ms shot=106ms unfreeze=1ms saved=True
|
||
[capture-loop] iter=3250 t=355.6s state={'complete': False, 'error': None, 'executedCount': 4, 'wsState': 1} eval_ms=2 ram=19.8/31.3GB (64%) swap=14.0/32.0GB (44%) cpu=20% browser_rss=0.50GB
|
||
[ComfyUI] [SubprocessWorker] callback 'report_progress' from call_id=3
|
||
[ComfyUI] [worker:ComfyUI-Sharp] [SharpPredictGaussiansFromMetricDepth] face 25/42: 1536×1536, extrinsics=[-0.00, -0.00, -0.00], intrinsics=fx=0.5000 cx=0.5000, mask=yes, snap=none, depth_conv=planar_z
|
||
[ComfyUI] [worker:ComfyUI-Sharp] [VRAM] +553MB (now 5143MB) reserved=7552MB peak=7062MB
|
||
[ComfyUI] [worker:ComfyUI-Sharp] [VRAM] -555MB (now 4589MB) reserved=9984MB peak=7062MB
|
||
Frame 61 saved (frame_060.jpg, t=359.3s)
|
||
[capture-periodic] freeze=1ms shot=109ms unfreeze=7ms saved=True
|
||
[ComfyUI] [worker:ComfyUI-Sharp]
|
||
[ComfyUI] === WATCHDOG TICK 2 ===
|
||
[ComfyUI] [worker:ComfyUI-Sharp] Thread 0x00007b50afbff640 (most recent call first):
|
||
[ComfyUI] File "/tmp/comfytest-home/.ce/.pixi/envs/sharp-nodes/lib/python3.12/socket.py", line 295 in accept
|
||
[ComfyUI] File "/tmp/comfytest-home/.ce/.pixi/envs/sharp-nodes/lib/python3.12/multiprocessing/connection.py", line 626 in accept
|
||
[ComfyUI] File "/tmp/comfytest-home/.ce/.pixi/envs/sharp-nodes/lib/python3.12/multiprocessing/connection.py", line 480 in accept
|
||
[ComfyUI] File "/tmp/comfytest-home/.ce/.pixi/envs/sharp-nodes/lib/python3.12/multiprocessing/resource_sharer.py", line 138 in _serve
|
||
[ComfyUI] File "/tmp/comfytest-home/.ce/.pixi/envs/sharp-nodes/lib/python3.12/threading.py", line 1012 in run
|
||
[ComfyUI] File "/tmp/comfytest-home/.ce/.pixi/envs/sharp-nodes/lib/python3.12/threading.py", line 1075 in _bootstrap_inner
|
||
[ComfyUI] File "/tmp/comfytest-home/.ce/.pixi/envs/sharp-nodes/lib/python3.12/threading.py", line 1032 in _bootstrap
|
||
[ComfyUI]
|
||
[ComfyUI] Thread 0x00007b5263794640 (most recent call first):
|
||
[ComfyUI] File "/tmp/comfytest-home/.ce/.pixi/envs/sharp-nodes/lib/python3.12/site-packages/torch/cuda/memory.py", line 393 in memory_stats_as_nested_dict
|
||
[ComfyUI] File "/tmp/comfytest-home/.ce/.pixi/envs/sharp-nodes/lib/python3.12/site-packages/torch/cuda/memory.py", line 381 in memory_stats
|
||
[ComfyUI] File "/tmp/comfytest-home/.ce/.pixi/envs/sharp-nodes/lib/python3.12/site-packages/torch/cuda/memory.py", line 597 in memory_allocated
|
||
[ComfyUI] File "/tmp/comfyui_pvenv_fah6gilt/persistent_worker.py", line 112 in _vram_poller
|
||
[ComfyUI] File "/tmp/comfytest-home/.ce/.pixi/envs/sharp-nodes/lib/python3.12/threading.py", line 1012 in run
|
||
[ComfyUI] File "/tmp/comfytest-home/.ce/.pixi/envs/sharp-nodes/lib/python3.12/threading.py", line 1075 in _bootstrap_inner
|
||
[ComfyUI] File "/tmp/comfytest-home/.ce/.pixi/envs/sharp-nodes/lib/python3.12/threading.py", line 1032 in _bootstrap
|
||
[ComfyUI]
|
||
[ComfyUI] Current thread 0x00007b5263f99640 (most recent call first):
|
||
[ComfyUI] File "/tmp/comfyui_pvenv_fah6gilt/persistent_worker.py", line 52 in _watchdog
|
||
[ComfyUI] File "/tmp/comfytest-home/.ce/.pixi/envs/sharp-nodes/lib/python3.12/threading.py", line 1012 in run
|
||
[ComfyUI] File "/tmp/comfytest-home/.ce/.pixi/envs/sharp-nodes/lib/python3.12/threading.py", line 1075 in _bootstrap_inner
|
||
[ComfyUI] File "/tmp/comfytest-home/.ce/.pixi/envs/sharp-nodes/lib/python3.12/threading.py", line 1032 in _bootstrap
|
||
[ComfyUI]
|
||
[ComfyUI] Thread 0x00007b5264594740 (most recent call first):
|
||
[ComfyUI] File "/workspaces/Sharp-2132/ComfyUI/custom_nodes/ComfyUI-Sharp/nodes/predict_gaussians_from_depth.py", line 419 in execute
|
||
[ComfyUI] File "/tmp/comfytest-home/.ce/.pixi/envs/sharp-nodes/lib/python3.12/site-packages/torch/utils/_contextlib.py", line 124 in decorate_context
|
||
[ComfyUI] File "/workspaces/Sharp-2132/ComfyUI/comfy_api/latest/_io.py", line 1892 in EXECUTE_NORMALIZED
|
||
[ComfyUI] File "/tmp/comfyui_pvenv_fah6gilt/persistent_worker.py", line 1762 in main
|
||
[ComfyUI] File "/tmp/comfyui_pvenv_fah6gilt/persistent_worker.py", line 1807 in <module>
|
||
[ComfyUI]
|
||
[ComfyUI] [worker:ComfyUI-Sharp] === END ===
|
||
[ComfyUI]
|
||
[capture-loop] iter=3300 t=361.1s state={'complete': False, 'error': None, 'executedCount': 4, 'wsState': 1} eval_ms=2 ram=18.8/31.3GB (60%) swap=14.0/32.0GB (44%) cpu=22% browser_rss=0.50GB
|
||
[ComfyUI] [SubprocessWorker] callback 'report_progress' from call_id=3
|
||
[ComfyUI] [worker:ComfyUI-Sharp] [SharpPredictGaussiansFromMetricDepth] face 26/42: 1536×1536, extrinsics=[-0.00, -0.00, -0.00], intrinsics=fx=0.5000 cx=0.5000, mask=yes, snap=none, depth_conv=planar_z
|
||
[ComfyUI] [worker:ComfyUI-Sharp] [VRAM] +521MB (now 5111MB) reserved=7776MB peak=7062MB
|
||
[ComfyUI] [worker:ComfyUI-Sharp] [VRAM] -519MB (now 4593MB) reserved=10048MB peak=7062MB
|
||
Frame 62 saved (frame_061.jpg, t=363.6s)
|
||
[capture-periodic] freeze=1ms shot=116ms unfreeze=15ms saved=True
|
||
[ComfyUI] [SubprocessWorker] callback 'report_progress' from call_id=3
|
||
[ComfyUI] [worker:ComfyUI-Sharp] [SharpPredictGaussiansFromMetricDepth] face 27/42: 1536×1536, extrinsics=[-0.00, -0.00, -0.00], intrinsics=fx=0.5000 cx=0.5000, mask=yes, snap=none, depth_conv=planar_z
|
||
[ComfyUI] [worker:ComfyUI-Sharp] [VRAM] +506MB (now 5100MB) reserved=7648MB peak=7062MB
|
||
Frame 63 saved (frame_062.jpg, t=365.9s)
|
||
[capture-periodic] freeze=1ms shot=97ms unfreeze=1ms saved=True
|
||
[capture-loop] iter=3350 t=366.6s state={'complete': False, 'error': None, 'executedCount': 4, 'wsState': 1} eval_ms=1 ram=18.7/31.3GB (60%) swap=14.0/32.0GB (44%) cpu=23% browser_rss=0.50GB
|
||
[ComfyUI] [worker:ComfyUI-Sharp] [VRAM] -274MB (now 4826MB) reserved=5408MB peak=7062MB
|
||
[ComfyUI] [worker:ComfyUI-Sharp] [VRAM] -236MB (now 4591MB) reserved=10112MB peak=7062MB
|
||
[ComfyUI] [SubprocessWorker] callback 'report_progress' from call_id=3
|
||
[ComfyUI] [worker:ComfyUI-Sharp] [SharpPredictGaussiansFromMetricDepth] face 28/42: 1536×1536, extrinsics=[-0.00, -0.00, -0.00], intrinsics=fx=0.5000 cx=0.5000, mask=yes, snap=none, depth_conv=planar_z
|
||
[ComfyUI] [worker:ComfyUI-Sharp] [VRAM] +521MB (now 5112MB) reserved=7296MB peak=7062MB
|
||
Frame 64 saved (frame_063.jpg, t=370.6s)
|
||
[capture-periodic] freeze=1ms shot=103ms unfreeze=6ms saved=True
|
||
[ComfyUI] [worker:ComfyUI-Sharp] [VRAM] -519MB (now 4594MB) reserved=10080MB peak=7062MB
|
||
[capture-loop] iter=3400 t=372.4s state={'complete': False, 'error': None, 'executedCount': 4, 'wsState': 1} eval_ms=2 ram=19.3/31.3GB (62%) swap=14.0/32.0GB (44%) cpu=21% browser_rss=0.51GB
|
||
[ComfyUI] [SubprocessWorker] callback 'report_progress' from call_id=3
|
||
[ComfyUI] [worker:ComfyUI-Sharp] [SharpPredictGaussiansFromMetricDepth] face 29/42: 1536×1536, extrinsics=[-0.00, -0.00, -0.00], intrinsics=fx=0.5000 cx=0.5000, mask=yes, snap=none, depth_conv=planar_z
|
||
[ComfyUI] [worker:ComfyUI-Sharp] [VRAM] +553MB (now 5147MB) reserved=7680MB peak=7062MB
|
||
Frame 65 saved (frame_064.jpg, t=375.0s)
|
||
[capture-periodic] freeze=1ms shot=102ms unfreeze=5ms saved=True
|
||
[ComfyUI] [worker:ComfyUI-Sharp] [VRAM] -308MB (now 4840MB) reserved=5408MB peak=7062MB
|
||
[ComfyUI] [worker:ComfyUI-Sharp] [VRAM] -247MB (now 4593MB) reserved=10080MB peak=7062MB
|
||
[capture-loop] iter=3450 t=377.9s state={'complete': False, 'error': None, 'executedCount': 4, 'wsState': 1} eval_ms=2 ram=19.0/31.3GB (61%) swap=14.0/32.0GB (44%) cpu=21% browser_rss=0.51GB
|
||
[ComfyUI] [SubprocessWorker] callback 'report_progress' from call_id=3
|
||
[ComfyUI] [worker:ComfyUI-Sharp] [SharpPredictGaussiansFromMetricDepth] face 30/42: 1536×1536, extrinsics=[-0.00, -0.00, -0.00], intrinsics=fx=0.5000 cx=0.5000, mask=yes, snap=none, depth_conv=planar_z
|
||
[ComfyUI] [worker:ComfyUI-Sharp] [VRAM] +521MB (now 5115MB) reserved=7840MB peak=7062MB
|
||
Frame 66 saved (frame_065.jpg, t=379.3s)
|
||
[capture-periodic] freeze=1ms shot=101ms unfreeze=5ms saved=True
|
||
[ComfyUI] [worker:ComfyUI-Sharp] [VRAM] -519MB (now 4597MB) reserved=10688MB peak=7062MB
|
||
[ComfyUI] [SubprocessWorker] callback 'report_progress' from call_id=3
|
||
[ComfyUI] [worker:ComfyUI-Sharp] [SharpPredictGaussiansFromMetricDepth] face 31/42: 1536×1536, extrinsics=[-0.00, -0.00, -0.00], intrinsics=fx=0.5000 cx=0.5000, mask=yes, snap=none, depth_conv=planar_z
|
||
[ComfyUI] [worker:ComfyUI-Sharp] [VRAM] +504MB (now 5101MB) reserved=7808MB peak=7062MB
|
||
[capture-loop] iter=3500 t=383.4s state={'complete': False, 'error': None, 'executedCount': 4, 'wsState': 1} eval_ms=1 ram=18.7/31.3GB (60%) swap=14.0/32.0GB (44%) cpu=21% browser_rss=0.51GB
|
||
[ComfyUI] [worker:ComfyUI-Sharp] [VRAM] +354MB (now 5456MB) reserved=6208MB peak=7062MB
|
||
Frame 67 saved (frame_066.jpg, t=383.7s)
|
||
[capture-periodic] freeze=1ms shot=101ms unfreeze=6ms saved=True
|
||
[ComfyUI] [worker:ComfyUI-Sharp] [VRAM] -864MB (now 4592MB) reserved=12128MB peak=7062MB
|
||
[ComfyUI] [SubprocessWorker] callback 'report_progress' from call_id=3
|
||
[ComfyUI] [worker:ComfyUI-Sharp] [SharpPredictGaussiansFromMetricDepth] face 32/42: 1536×1536, extrinsics=[-0.00, -0.00, -0.00], intrinsics=fx=0.5000 cx=0.5000, mask=yes, snap=none, depth_conv=planar_z
|
||
[ComfyUI] [worker:ComfyUI-Sharp] [VRAM] +518MB (now 5110MB) reserved=7936MB peak=7062MB
|
||
[ComfyUI] [worker:ComfyUI-Sharp] [VRAM] -519MB (now 4592MB) reserved=10720MB peak=7062MB
|
||
Frame 68 saved (frame_067.jpg, t=388.1s)
|
||
[capture-periodic] freeze=1ms shot=103ms unfreeze=6ms saved=True
|
||
[capture-loop] iter=3550 t=388.9s state={'complete': False, 'error': None, 'executedCount': 4, 'wsState': 1} eval_ms=1 ram=20.6/31.3GB (66%) swap=14.0/32.0GB (44%) cpu=19% browser_rss=0.51GB
|
||
[ComfyUI] [SubprocessWorker] callback 'report_progress' from call_id=3
|
||
[ComfyUI] [worker:ComfyUI-Sharp] [SharpPredictGaussiansFromMetricDepth] face 33/42: 1536×1536, extrinsics=[-0.00, -0.00, -0.00], intrinsics=fx=0.5000 cx=0.5000, mask=yes, snap=none, depth_conv=planar_z
|
||
[ComfyUI] [worker:ComfyUI-Sharp] [VRAM] +506MB (now 5098MB) reserved=8000MB peak=7062MB
|
||
Frame 69 saved (frame_068.jpg, t=392.5s)
|
||
[ComfyUI] [worker:ComfyUI-Sharp] [VRAM] -510MB (now 4589MB) reserved=10624MB peak=7062MB
|
||
[capture-periodic] freeze=1ms shot=96ms unfreeze=8ms saved=True
|
||
[ComfyUI] [SubprocessWorker] callback 'report_progress' from call_id=3
|
||
[ComfyUI] [worker:ComfyUI-Sharp] [SharpPredictGaussiansFromMetricDepth] face 34/42: 1536×1536, extrinsics=[-0.00, -0.00, -0.00], intrinsics=fx=0.5000 cx=0.5000, mask=yes, snap=none, depth_conv=planar_z
|
||
[ComfyUI] [worker:ComfyUI-Sharp] [VRAM] +518MB (now 5108MB) reserved=7840MB peak=7062MB
|
||
[capture-loop] iter=3600 t=396.1s state={'complete': False, 'error': None, 'executedCount': 4, 'wsState': 1} eval_ms=1 ram=18.7/31.3GB (60%) swap=14.0/32.0GB (44%) cpu=22% browser_rss=0.50GB
|
||
[ComfyUI] [worker:ComfyUI-Sharp] [VRAM] +345MB (now 5454MB) reserved=6112MB peak=7062MB
|
||
Frame 70 saved (frame_069.jpg, t=396.4s)
|
||
[capture-periodic] freeze=1ms shot=95ms unfreeze=6ms saved=True
|
||
[ComfyUI] [worker:ComfyUI-Sharp] [VRAM] -864MB (now 4590MB) reserved=11552MB peak=7062MB
|
||
[ComfyUI] [SubprocessWorker] callback 'report_progress' from call_id=3
|
||
[ComfyUI] [worker:ComfyUI-Sharp] [SharpPredictGaussiansFromMetricDepth] face 35/42: 1536×1536, extrinsics=[-0.00, -0.00, -0.00], intrinsics=fx=0.5000 cx=0.5000, mask=yes, snap=none, depth_conv=planar_z
|
||
[ComfyUI] [worker:ComfyUI-Sharp] [VRAM] +519MB (now 5109MB) reserved=7584MB peak=7062MB
|
||
[ComfyUI] [worker:ComfyUI-Sharp] [VRAM] +345MB (now 5455MB) reserved=6176MB peak=7062MB
|
||
Frame 71 saved (frame_070.jpg, t=400.8s)
|
||
[capture-periodic] freeze=1ms shot=112ms unfreeze=8ms saved=True
|
||
[ComfyUI] [worker:ComfyUI-Sharp] [VRAM] -864MB (now 4591MB) reserved=10144MB peak=7062MB
|
||
[capture-loop] iter=3650 t=401.6s state={'complete': False, 'error': None, 'executedCount': 4, 'wsState': 1} eval_ms=2 ram=20.6/31.3GB (66%) swap=14.0/32.0GB (44%) cpu=22% browser_rss=0.51GB
|
||
[ComfyUI] [SubprocessWorker] callback 'report_progress' from call_id=3
|
||
[ComfyUI] [worker:ComfyUI-Sharp] [SharpPredictGaussiansFromMetricDepth] face 36/42: 1536×1536, extrinsics=[-0.00, -0.00, -0.00], intrinsics=fx=0.5000 cx=0.5000, mask=yes, snap=none, depth_conv=planar_z
|
||
[ComfyUI] [worker:ComfyUI-Sharp] [VRAM] +552MB (now 5144MB) reserved=7904MB peak=7062MB
|
||
Frame 72 saved (frame_071.jpg, t=403.0s)
|
||
[capture-periodic] freeze=1ms shot=97ms unfreeze=1ms saved=True
|
||
[ComfyUI] [worker:ComfyUI-Sharp] [VRAM] -555MB (now 4589MB) reserved=12000MB peak=7062MB
|
||
[capture-loop] iter=3700 t=407.0s state={'complete': False, 'error': None, 'executedCount': 4, 'wsState': 1} eval_ms=1 ram=19.4/31.3GB (62%) swap=14.0/32.0GB (44%) cpu=22% browser_rss=0.51GB
|
||
[ComfyUI] [SubprocessWorker] callback 'report_progress' from call_id=3
|
||
[ComfyUI] [worker:ComfyUI-Sharp] [SharpPredictGaussiansFromMetricDepth] face 37/42: 1536×1536, extrinsics=[-0.00, -0.00, -0.00], intrinsics=fx=0.5000 cx=0.5000, mask=yes, snap=none, depth_conv=planar_z
|
||
[ComfyUI] [worker:ComfyUI-Sharp] [VRAM] +526MB (now 5115MB) reserved=8000MB peak=7062MB
|
||
Frame 73 saved (frame_072.jpg, t=407.3s)
|
||
[capture-periodic] freeze=6ms shot=117ms unfreeze=1ms saved=True
|
||
[ComfyUI] [worker:ComfyUI-Sharp] [VRAM] +336MB (now 5452MB) reserved=6336MB peak=7062MB
|
||
[ComfyUI] [worker:ComfyUI-Sharp] [VRAM] -864MB (now 4588MB) reserved=11648MB peak=7062MB
|
||
[ComfyUI] [SubprocessWorker] callback 'report_progress' from call_id=3
|
||
[ComfyUI] [worker:ComfyUI-Sharp] [SharpPredictGaussiansFromMetricDepth] face 38/42: 1536×1536, extrinsics=[-0.00, -0.00, -0.00], intrinsics=fx=0.5000 cx=0.5000, mask=yes, snap=none, depth_conv=planar_z
|
||
Frame 74 saved (frame_073.jpg, t=411.7s)
|
||
[capture-periodic] freeze=1ms shot=330ms unfreeze=15ms saved=True
|
||
[ComfyUI] [worker:ComfyUI-Sharp] [VRAM] +527MB (now 5116MB) reserved=7776MB peak=7062MB
|
||
[ComfyUI] [worker:ComfyUI-Sharp] [VRAM] +336MB (now 5453MB) reserved=6240MB peak=7062MB
|
||
[capture-loop] iter=3750 t=414.6s state={'complete': False, 'error': None, 'executedCount': 4, 'wsState': 1} eval_ms=1 ram=20.5/31.3GB (66%) swap=14.0/32.0GB (44%) cpu=21% browser_rss=0.51GB
|
||
[ComfyUI] [worker:ComfyUI-Sharp] [VRAM] -864MB (now 4589MB) reserved=11680MB peak=7062MB
|
||
[ComfyUI] [SubprocessWorker] callback 'report_progress' from call_id=3
|
||
[ComfyUI] [worker:ComfyUI-Sharp] [SharpPredictGaussiansFromMetricDepth] face 39/42: 1536×1536, extrinsics=[-0.00, -0.00, -0.00], intrinsics=fx=0.5000 cx=0.5000, mask=yes, snap=none, depth_conv=planar_z
|
||
Frame 75 saved (frame_074.jpg, t=418.0s)
|
||
[ComfyUI] [worker:ComfyUI-Sharp] [VRAM] +499MB (now 5089MB) reserved=7456MB peak=7062MB
|
||
[capture-periodic] freeze=1ms shot=936ms unfreeze=10ms saved=True
|
||
[ComfyUI] [worker:ComfyUI-Sharp]
|
||
[ComfyUI] === WATCHDOG TICK 3 ===
|
||
[ComfyUI] [worker:ComfyUI-Sharp] [VRAM] -501MB (now 4589MB) reserved=12192MB peak=7062MB
|
||
[ComfyUI] [worker:ComfyUI-Sharp] Thread 0x00007b50afbff640 (most recent call first):
|
||
[ComfyUI] File "/tmp/comfytest-home/.ce/.pixi/envs/sharp-nodes/lib/python3.12/socket.py", line 295 in accept
|
||
[ComfyUI] File "/tmp/comfytest-home/.ce/.pixi/envs/sharp-nodes/lib/python3.12/multiprocessing/connection.py", line 626 in accept
|
||
[ComfyUI] File "/tmp/comfytest-home/.ce/.pixi/envs/sharp-nodes/lib/python3.12/multiprocessing/connection.py", line 480 in accept
|
||
[ComfyUI] File "/tmp/comfytest-home/.ce/.pixi/envs/sharp-nodes/lib/python3.12/multiprocessing/resource_sharer.py", line 138 in _serve
|
||
[ComfyUI] File "/tmp/comfytest-home/.ce/.pixi/envs/sharp-nodes/lib/python3.12/threading.py", line 1012 in run
|
||
[ComfyUI] File "/tmp/comfytest-home/.ce/.pixi/envs/sharp-nodes/lib/python3.12/threading.py", line 1075 in _bootstrap_inner
|
||
Frame 76 saved (frame_075.jpg, t=423.2s)
|
||
[capture-periodic] freeze=1ms shot=838ms unfreeze=9ms saved=True
|
||
[ComfyUI] File "/tmp/comfytest-home/.ce/.pixi/envs/sharp-nodes/lib/python3.12/threading.py", line 1032 in _bootstrap
|
||
[ComfyUI]
|
||
[ComfyUI] Thread 0x00007b5263794640 (most recent call first):
|
||
[capture-loop] iter=3800 t=425.6s state={'complete': False, 'error': None, 'executedCount': 4, 'wsState': 1} eval_ms=2 ram=19.4/31.3GB (62%) swap=14.0/32.0GB (44%) cpu=20% browser_rss=0.50GB
|
||
[ComfyUI] File "/tmp/comfyui_pvenv_fah6gilt/persistent_worker.py", line 86 in wlog
|
||
Frame 77 saved (frame_076.jpg, t=426.9s)
|
||
[ComfyUI] File "/tmp/comfyui_pvenv_fah6gilt/persistent_worker.py", line 124 in _vram_poller
|
||
[ComfyUI] File "/tmp/comfytest-home/.ce/.pixi/envs/sharp-nodes/lib/python3.12/threading.py", line 1012 in run
|
||
[capture-periodic] freeze=141ms shot=138ms unfreeze=5ms saved=True
|
||
[ComfyUI] File "/tmp/comfytest-home/.ce/.pixi/envs/sharp-nodes/lib/python3.12/threading.py", line 1075 in _bootstrap_inner
|
||
[ComfyUI] File "/tmp/comfytest-home/.ce/.pixi/envs/sharp-nodes/lib/python3.12/threading.py", line 1032 in _bootstrap
|
||
Frame 78 saved (frame_077.jpg, t=432.7s)
|
||
[ComfyUI]
|
||
[capture-periodic] freeze=212ms shot=612ms unfreeze=5ms saved=True
|
||
[ComfyUI] Current thread 0x00007b5263f99640 (most recent call first):
|
||
[ComfyUI] File "/tmp/comfyui_pvenv_fah6gilt/persistent_worker.py", line 52 in _watchdog
|
||
[ComfyUI] File "/tmp/comfytest-home/.ce/.pixi/envs/sharp-nodes/lib/python3.12/threading.py", line 1012 in run
|
||
[ComfyUI] File "/tmp/comfytest-home/.ce/.pixi/envs/sharp-nodes/lib/python3.12/threading.py", line 1075 in _bootstrap_inner
|
||
[ComfyUI] File "/tmp/comfytest-home/.ce/.pixi/envs/sharp-nodes/lib/python3.12/threading.py", line 1032 in _bootstrap
|
||
Frame 79 saved (frame_078.jpg, t=440.0s)
|
||
[capture-periodic] freeze=2ms shot=2197ms unfreeze=6ms saved=True
|
||
[ComfyUI]
|
||
[ComfyUI] Thread 0x00007b5264594740 (most recent call first):
|
||
[ComfyUI] File "/workspaces/Sharp-2132/ComfyUI/custom_nodes/ComfyUI-Sharp/nodes/predict_gaussians_from_depth.py", line 395 in execute
|
||
Frame 80 saved (frame_079.jpg, t=447.5s)
|
||
[capture-periodic] freeze=1ms shot=117ms unfreeze=1ms saved=True
|
||
[ComfyUI] File "/tmp/comfytest-home/.ce/.pixi/envs/sharp-nodes/lib/python3.12/site-packages/torch/utils/_contextlib.py", line 124 in decorate_context
|
||
[ComfyUI] File "/workspaces/Sharp-2132/ComfyUI/comfy_api/latest/_io.py", line 1892 in EXECUTE_NORMALIZED
|
||
[capture-loop] iter=3850 t=452.9s state={'complete': False, 'error': None, 'executedCount': 4, 'wsState': 1} eval_ms=2 ram=19.9/31.3GB (64%) swap=14.0/32.0GB (44%) cpu=11% browser_rss=0.50GB
|
||
[ComfyUI] File "/tmp/comfyui_pvenv_fah6gilt/persistent_worker.py", line 1762 in main
|
||
[ComfyUI] File "/tmp/comfyui_pvenv_fah6gilt/persistent_worker.py", line 1807 in <module>
|
||
Frame 81 saved (frame_080.jpg, t=454.2s)
|
||
[ComfyUI]
|
||
[ComfyUI] [worker:ComfyUI-Sharp] === END ===
|
||
[capture-periodic] freeze=2ms shot=769ms unfreeze=16ms saved=True
|
||
[ComfyUI]
|
||
[ComfyUI] [SubprocessWorker] callback 'report_progress' from call_id=3
|
||
[ComfyUI] [worker:ComfyUI-Sharp] [SharpPredictGaussiansFromMetricDepth] face 40/42: 1536×1536, extrinsics=[-0.00, -0.00, -0.00], intrinsics=fx=0.5000 cx=0.5000, mask=yes, snap=none, depth_conv=planar_z
|
||
[ComfyUI] [worker:ComfyUI-Sharp] [VRAM] +509MB (now 5098MB) reserved=7968MB peak=7062MB
|
||
Frame 82 saved (frame_081.jpg, t=458.5s)
|
||
[ComfyUI] [worker:ComfyUI-Sharp] [VRAM] -510MB (now 4589MB) reserved=10176MB peak=7062MB
|
||
[capture-periodic] freeze=8ms shot=802ms unfreeze=21ms saved=True
|
||
[ComfyUI] [SubprocessWorker] callback 'report_progress' from call_id=3
|
||
[ComfyUI] [worker:ComfyUI-Sharp] [SharpPredictGaussiansFromMetricDepth] face 41/42: 1536×1536, extrinsics=[-0.00, -0.00, -0.00], intrinsics=fx=0.5000 cx=0.5000, mask=yes, snap=none, depth_conv=planar_z
|
||
[ComfyUI] [worker:ComfyUI-Sharp] [VRAM] +582MB (now 5171MB) reserved=7616MB peak=7062MB
|
||
[ComfyUI] [SubprocessWorker] callback 'report_progress' from call_id=3
|
||
Frame 83 saved (frame_082.jpg, t=464.2s)
|
||
[ComfyUI] [worker:ComfyUI-Sharp] [SharpPredictGaussiansFromMetricDepth] face 42/42: 1536×1536, extrinsics=[-0.00, -0.00, -0.00], intrinsics=fx=0.5000 cx=0.5000, mask=yes, snap=none, depth_conv=planar_z
|
||
[capture-periodic] freeze=1ms shot=263ms unfreeze=15ms saved=True
|
||
[ComfyUI] [worker:ComfyUI-Sharp] [VRAM] +282MB (now 5454MB) reserved=6112MB peak=7062MB
|
||
[ComfyUI] [worker:ComfyUI-Sharp] [VRAM] -865MB (now 4590MB) reserved=7680MB peak=7062MB
|
||
[ComfyUI] [worker:ComfyUI-Sharp] [VRAM] +511MB (now 5101MB) reserved=7680MB peak=7062MB
|
||
[ComfyUI] [comfy-env] SubprocessWorker: /tmp/comfytest-home/.ce/.pixi/envs/gaussianpack-nodes/bin/python
|
||
[ComfyUI] [SubprocessWorker] callback 'report_progress' from call_id=3
|
||
[ComfyUI] [comfy-env] env_vars: {'COMFYUI_BASE': '/workspaces/Sharp-2132/ComfyUI'}
|
||
[ComfyUI] [worker:ComfyUI-Sharp] [SharpPredictGaussiansFromMetricDepth] 42 face(s) -> 4.07M gaussians total (both layers, snap=none); saved to /workspaces/Sharp-2132/ComfyUI/output/sharp_aligned_1780868515653; 183.0s
|
||
[ComfyUI] [worker:ComfyUI-Sharp] [VRAM] -512MB (now 4590MB) reserved=11520MB peak=7062MB
|
||
[ComfyUI] [ComfyUI-GaussianPack] python: /tmp/comfytest-home/.ce/.pixi/envs/gaussianpack-nodes/bin/python
|
||
Frame 84 saved (frame_083.jpg, t=470.0s)
|
||
[ComfyUI] [worker:ComfyUI-Sharp] [VRAM] -1903MB (now 2688MB) reserved=7904MB peak=7062MB
|
||
[ComfyUI] [ComfyUI-GaussianPack] sys_path sent to worker: ['/workspaces/Sharp-2132/ComfyUI', '/workspaces/Sharp-2132/ComfyUI/custom_nodes/ComfyUI-GaussianPack', '/tmp/comfytest-home/.ce/.pixi/envs/gaussianpack-nodes/lib/python3.1/site-packages', '/workspaces/Sharp-2132/ComfyUI/custom_nodes/ComfyUI-GaussianPack']
|
||
[capture-periodic] freeze=360ms shot=1492ms unfreeze=10ms saved=True
|
||
[ComfyUI] [SubprocessWorker] got response: ok
|
||
[ComfyUI] [SubprocessWorker] is_pixi=True, python=/tmp/comfytest-home/.ce/.pixi/envs/gaussianpack-nodes/bin/python
|
||
[ComfyUI] [comfy-env] Created 1 model patchers: ['RGBGaussianPredictor_1']
|
||
[ComfyUI] [SubprocessWorker] launching cmd=['/tmp/comfytest-home/.pixi/bin/pixi', 'run', '--as-is', '--manifest-path', '/tmp/comfytest-home/.ce/pixi.toml', '-e', 'gaussianpack-nodes', 'python', '/tmp/comfyui_pvenv_3vhbt_t_/persistent_worker.py', 'abstract://comfy_worker_996cb82cd0e1']...
|
||
[capture-loop] iter=3900 t=474.4s state={'complete': False, 'error': None, 'executedCount': 4, 'wsState': 1} eval_ms=2 ram=18.9/31.3GB (60%) swap=14.0/32.0GB (44%) cpu=10% browser_rss=0.51GB
|
||
[ComfyUI] [SubprocessWorker] socket_addr=abstract://comfy_worker_996cb82cd0e1 (abstract, no filesystem path)
|
||
[ComfyUI] [comfy-env] SharpPredictGaussiansFromMetricDepth done (196.44s): result: NodeOutput
|
||
[ComfyUI] [VRAM] After SharpPredictGaussiansFromMetricDepth: 14910 / 24122 MB
|
||
[ComfyUI] [VRAM] Loaded: SubprocessModel (2679 MB), SubprocessModel (631 MB)
|
||
Frame 85 saved (frame_084.jpg, t=481.7s)
|
||
[ComfyUI] [comfy-env] Running MergeGaussians: ply_folder: '/workspaces/Sharp-2132/ComfyUI/output/sharp_aligned_1780..., output_prefix: 'merged', max_depth: 0.0, min_opacity: 0.0
|
||
[ComfyUI] [VRAM] Before MergeGaussians: 14910 / 24122 MB
|
||
[capture-periodic] freeze=1ms shot=144ms unfreeze=1ms saved=True
|
||
[ComfyUI] [VRAM] Loaded: SubprocessModel (2679 MB), SubprocessModel (631 MB)
|
||
[ComfyUI] [SubprocessWorker] call_method: nodes.merge_gaussians.MergeGaussians.EXECUTE_NORMALIZED
|
||
[ComfyUI] [SubprocessWorker] acquired lock, ensuring started...
|
||
[ComfyUI] [ComfyUI-Sharp] Health check: ping (timeout=5.0s)...
|
||
[ComfyUI] [ComfyUI-Sharp] Health check: ok
|
||
[ComfyUI] [SubprocessWorker] worker started/confirmed
|
||
[ComfyUI] [SubprocessWorker] serializing kwargs to shm...
|
||
[ComfyUI] [SubprocessWorker] created 0 shm blocks
|
||
[ComfyUI] [SubprocessWorker] sending request via socket...
|
||
[ComfyUI] [SubprocessWorker] call_id=4 sending call_method
|
||
[ComfyUI] [worker:ComfyUI-Sharp] [MergeGaussians] merging 42 PLY file(s) from /workspaces/Sharp-2132/ComfyUI/output/sharp_aligned_1780868515653 (no filters)
|
||
[ComfyUI] [SubprocessWorker] callback 'report_progress' from call_id=4
|
||
[ComfyUI] [SubprocessWorker] callback 'report_progress' from call_id=4
|
||
[ComfyUI] [SubprocessWorker] callback 'report_progress' from call_id=4
|
||
[ComfyUI] [SubprocessWorker] callback 'report_progress' from call_id=4
|
||
[ComfyUI] [SubprocessWorker] callback 'report_progress' from call_id=4
|
||
[ComfyUI] [SubprocessWorker] callback 'report_progress' from call_id=4
|
||
[ComfyUI] [SubprocessWorker] callback 'report_progress' from call_id=4
|
||
[ComfyUI] [SubprocessWorker] callback 'report_progress' from call_id=4
|
||
[ComfyUI] [SubprocessWorker] callback 'report_progress' from call_id=4
|
||
[capture-loop] iter=3950 t=489.0s state={'complete': False, 'error': None, 'executedCount': 4, 'wsState': 1} eval_ms=2 ram=20.1/31.3GB (64%) swap=14.0/32.0GB (44%) cpu=13% browser_rss=0.51GB
|
||
[ComfyUI] [SubprocessWorker] callback 'report_progress' from call_id=4
|
||
[ComfyUI] [SubprocessWorker] callback 'report_progress' from call_id=4
|
||
[ComfyUI] [SubprocessWorker] callback 'report_progress' from call_id=4
|
||
[ComfyUI] [SubprocessWorker] callback 'report_progress' from call_id=4
|
||
[ComfyUI] [SubprocessWorker] callback 'report_progress' from call_id=4
|
||
[ComfyUI] [worker:ComfyUI-Sharp] [MergeGaussians] merged 42 file(s) -> 4.07M gaussians -> /workspaces/Sharp-2132/ComfyUI/output/merged_1780868721902.ply, 217.5 MB; save 1.3s, total 5.8s
|
||
[ComfyUI] [worker:ComfyUI-Sharp] [MergeGaussians] field PLY (positions + face_id only) -> /workspaces/Sharp-2132/ComfyUI/output/merged_1780868721902_fields.ply
|
||
[ComfyUI] [SubprocessWorker] got response: ok
|
||
[ComfyUI] [comfy-env] MergeGaussians done (26.32s): result: NodeOutput
|
||
[ComfyUI] [VRAM] After MergeGaussians: 14910 / 24122 MB
|
||
[ComfyUI] [VRAM] Loaded: SubprocessModel (2679 MB), SubprocessModel (631 MB)
|
||
[ComfyUI] [comfy-env] Running TransformGaussian: rotate_x: -90.0, rotate_y: 0.0, rotate_z: 0.0, ply_path: '/workspaces/Sharp-2132/ComfyUI/output/merged_17808687219...
|
||
[capture-loop] iter=4000 t=497.8s state={'complete': False, 'error': None, 'executedCount': 4, 'wsState': 1} eval_ms=2 ram=20.1/31.3GB (64%) swap=14.0/32.0GB (44%) cpu=14% browser_rss=0.51GB
|
||
[ComfyUI] [VRAM] Before TransformGaussian: 14910 / 24122 MB
|
||
[ComfyUI] [VRAM] Loaded: SubprocessModel (2679 MB), SubprocessModel (631 MB)
|
||
[ComfyUI] [SubprocessWorker] call_method: nodes.transform_gaussian.TransformGaussian.transform
|
||
[ComfyUI] [SubprocessWorker] acquired lock, ensuring started...
|
||
Frame 86 saved (frame_085.jpg, t=500.8s)
|
||
[ComfyUI] [SubprocessWorker] worker started/confirmed
|
||
[capture-periodic] freeze=1ms shot=104ms unfreeze=13ms saved=True
|
||
[ComfyUI] [SubprocessWorker] serializing kwargs to shm...
|
||
[ComfyUI] [SubprocessWorker] created 0 shm blocks
|
||
[ComfyUI] [SubprocessWorker] sending request via socket...
|
||
[ComfyUI] [SubprocessWorker] call_id=1 sending call_method
|
||
[ComfyUI] [worker:ComfyUI-GaussianPack] WARNING: SPZ route not registered (ModuleNotFoundError: No module named 'comfy_aimdo')
|
||
[capture-loop] iter=4050 t=508.0s state={'complete': False, 'error': None, 'executedCount': 4, 'wsState': 1} eval_ms=2 ram=20.8/31.3GB (66%) swap=14.0/32.0GB (44%) cpu=13% browser_rss=0.51GB
|
||
[ComfyUI] [SubprocessWorker] got response: ok
|
||
[ComfyUI] [comfy-env] TransformGaussian done (30.25s): result: list[1]
|
||
[ComfyUI] [VRAM] After TransformGaussian: 14910 / 24122 MB
|
||
[ComfyUI] [VRAM] Loaded: SubprocessModel (2679 MB), SubprocessModel (631 MB)
|
||
[ComfyUI] [comfy-env] Running PreviewGaussians: camera_mode: 'orbit', fov_degrees: 71.0, renderer: 'playcanvas', transport_format: 'ply', ply_path: '/workspaces/Sharp-2132/ComfyUI/output/merged_17808687219...
|
||
[ComfyUI] [VRAM] Before PreviewGaussians: 14910 / 24122 MB
|
||
[ComfyUI] [VRAM] Loaded: SubprocessModel (2679 MB), SubprocessModel (631 MB)
|
||
Node executed (5 total), capturing...
|
||
[ComfyUI] [SubprocessWorker] call_method: nodes.preview_gaussian.PreviewGaussians.preview
|
||
[ComfyUI] [SubprocessWorker] acquired lock, ensuring started...
|
||
Frame 87 saved (frame_086.jpg, t=514.0s)
|
||
[ComfyUI] [ComfyUI-GaussianPack] Health check: ping (timeout=5.0s)...
|
||
[capture-node] freeze=155ms shot=367ms unfreeze=1ms saved=True
|
||
[ComfyUI] [ComfyUI-GaussianPack] Health check: ok
|
||
Execution complete (t=516.2s)
|
||
[ComfyUI] [SubprocessWorker] worker started/confirmed
|
||
[ComfyUI] [SubprocessWorker] serializing kwargs to shm...
|
||
[3d-wait] Phase 1: Waiting for 'Loading 3D Model' text to disappear...
|
||
[ComfyUI] [SubprocessWorker] created 0 shm blocks
|
||
[3d-wait] Phase 1 done in 0.1s
|
||
[ComfyUI] [SubprocessWorker] sending request via socket...
|
||
[3d-wait] Phase 2: iframes=1
|
||
[ComfyUI] [SubprocessWorker] call_id=2 sending call_method
|
||
[3d-wait] iframe viewer_ready=False (matched 0 console logs)
|
||
[ComfyUI] [SubprocessWorker] got response: ok
|
||
[3d-wait] Waiting for 'Loaded successfully' console message (timeout=60s)...
|
||
[ComfyUI] [comfy-env] PreviewGaussians done (12.69s): result: dict
|
||
[ComfyUI] [VRAM] After PreviewGaussians: 14910 / 24122 MB
|
||
[ComfyUI] [VRAM] Loaded: SubprocessModel (2679 MB), SubprocessModel (631 MB)
|
||
[ComfyUI] [32m[INFO][0m [32mPrompt executed in 512.44 seconds[0m
|
||
[3d-wait] Got 'Loaded successfully' after 27.2s
|
||
[3d-wait] Unfrozen in 1.862s, rendering for 5s...
|
||
[3d-wait] JS halted via CDP after 7.9s
|
||
[3d-wait] Re-frozen in 9.4s
|
||
[3d-wait] Total 3D wait: 40.6s
|
||
Captured 87 unique frames over 557.47s
|
||
[debug] iframes: 1
|
||
[debug] iframe[0]: src=http://127.0.0.1:41883/extensions/ComfyUI-GaussianPack/viewer_gaussian.html?v=17, canvas=486x403, rafFrozen=True
|
||
[timing] trigger_3d_previews: 0.0s
|
||
Saved high-quality screenshot: pano_executed.png
|
||
[timing] final_screenshot: 1.6s
|
||
Captured 88 video frames |