346 lines
32 KiB
Plaintext
346 lines
32 KiB
Plaintext
Capturing execution frames: da3_streaming.json
|
|
Frame 1 saved (frame_000.jpg, t=0.0s)
|
|
Validating workflow...
|
|
[ComfyUI] === /validate endpoint called ===
|
|
[ComfyUI] Received JSON with keys: ['prompt']
|
|
[ComfyUI] Prompt has 5 nodes
|
|
[ComfyUI] Node 2: DownloadAndLoadDepthAnythingV3Model
|
|
[ComfyUI] Inputs: {"model": "da3_large.safetensors", "precision": "auto", "attention": "auto"}
|
|
Queuing workflow for execution...
|
|
[ComfyUI] Node 3: LoadVideo
|
|
[ComfyUI] Inputs: {"file": "robot_unitree.mp4", "video-preview": ""}
|
|
[ComfyUI] Node 4: SaveVideo
|
|
[ComfyUI] Inputs: {"filename_prefix": "video/preview_da3", "format": "auto", "codec": "auto", "video": ["6", 0]}
|
|
[ComfyUI] Node 5: LoadSALADModel
|
|
[ComfyUI] Inputs: {}
|
|
[ComfyUI] Node 6: DepthAnythingV3_Streaming
|
|
[ComfyUI] Inputs: {"normalization_mode": "Standard", "chunk_size": 30, "overlap": 8, "align_lib": "auto", "align_method": "sim3", "resize_method": "resize", "invert_depth": true, "save_pointcloud": false, "sample_ratio
|
|
[ComfyUI] Generated prompt_id: 9b9ee04f-b168-4d74-bfa5-d7c00b97597d
|
|
[ComfyUI] Calling execution.validate_prompt()...
|
|
[ComfyUI] Validation result: valid=True
|
|
[ComfyUI] === Validation PASSED ===
|
|
[ComfyUI] got prompt
|
|
[ComfyUI] [comfy-env] Running LoadSALADModel:
|
|
[ComfyUI] [VRAM] Before LoadSALADModel: 507 / 7703 MB
|
|
[ComfyUI] [SubprocessWorker] call_method: nodes.load_model.LoadSALADModel.EXECUTE_NORMALIZED
|
|
[ComfyUI] [SubprocessWorker] acquired lock, ensuring started...
|
|
[ComfyUI] [ComfyUI-DepthAnythingV3] Health check: ping (timeout=5.0s)...
|
|
[ComfyUI] [ComfyUI-DepthAnythingV3] Health check: failed
|
|
[ComfyUI] [ComfyUI-DepthAnythingV3] Socket unhealthy, restarting worker...
|
|
[ComfyUI] [ComfyUI-DepthAnythingV3] python: /root/.ce/.pixi/envs/depthanythingv3-nodes/bin/python
|
|
[ComfyUI] [comfy-env] Invalidated 1 stale model patchers (will be cleaned up during next unload)
|
|
[ComfyUI] [ComfyUI-DepthAnythingV3] sys_path sent to worker: ['/workspaces/DepthAnythingV3-0833/ComfyUI', '/workspaces/DepthAnythingV3-0833/ComfyUI/custom_nodes/ComfyUI-DepthAnythingV3', '/root/.ce/.pixi/envs/depthanythingv3-nodes/lib/python3.11/site-packages', '/workspaces/DepthAnythingV3-0833/ComfyUI/custom_nodes/ComfyUI-DepthAnythingV3']
|
|
[ComfyUI] [SubprocessWorker] is_pixi=True, python=/root/.ce/.pixi/envs/depthanythingv3-nodes/bin/python
|
|
[ComfyUI] [SubprocessWorker] launching cmd=['/root/.pixi/bin/pixi', 'run', '--as-is', '--manifest-path', '/root/.ce/pixi.toml', '-e', 'depthanythingv3-nodes', 'python', '/tmp/comfyui_pvenv_u36y2nop/persistent_worker.py', 'abstract://comfy_worker_903775a8d6fb']...
|
|
[ComfyUI] [SubprocessWorker] socket_addr=abstract://comfy_worker_903775a8d6fb (abstract, no filesystem path)
|
|
[ComfyUI] [worker:ComfyUI-DepthAnythingV3] ERROR: Failed to import comfy_kitchen, Error: No module named 'comfy_kitchen', fp8 and fp4 support will not be available.
|
|
[ComfyUI] [SubprocessWorker] worker started/confirmed
|
|
[ComfyUI] [SubprocessWorker] sending request via socket...
|
|
[ComfyUI] [SubprocessWorker] call_id=27 sending call_method
|
|
[ComfyUI] Warning: You are sending unauthenticated requests to the HF Hub. Please set a HF_TOKEN to enable higher rate limits and faster downloads.
|
|
[ComfyUI] [worker:ComfyUI-DepthAnythingV3] WARNING: Warning: You are sending unauthenticated requests to the HF Hub. Please set a HF_TOKEN to enable higher rate limits and faster downloads.
|
|
[ComfyUI]
|
|
Frame 2 saved (frame_001.jpg, t=2.3s)
|
|
[capture-periodic] freeze=2ms shot=128ms unfreeze=5ms saved=True
|
|
Frame 3 saved (frame_002.jpg, t=4.6s)
|
|
[capture-periodic] freeze=2ms shot=136ms unfreeze=2ms saved=True
|
|
[ComfyUI] dino_salad.safetensors: 0%| | 0.00/352M [00:00<?, ?B/s]
|
|
[ComfyUI] dino_salad.safetensors: 35%|███▍ | 122M/352M [00:02<00:05, 43.9MB/s][SubprocessWorker] callback 'report_progress' from call_id=27
|
|
[capture-loop] iter=50 t=5.7s state={'complete': False, 'error': None, 'executedCount': 0, 'wsState': 1} eval_ms=2 ram=4.3/31.3GB (14%) swap=0.0/32.0GB (0%) cpu=17% browser_rss=1.08GB
|
|
[ComfyUI]
|
|
[ComfyUI] dino_salad.safetensors: 37%|███▋ | 129M/352M [00:04<00:08, 26.8MB/s][SubprocessWorker] callback 'report_progress' from call_id=27
|
|
Frame 4 saved (frame_003.jpg, t=6.9s)
|
|
[capture-periodic] freeze=1ms shot=136ms unfreeze=9ms saved=True
|
|
[ComfyUI]
|
|
[ComfyUI] dino_salad.safetensors: 39%|███▉ | 138M/352M [00:05<00:09, 21.7MB/s][SubprocessWorker] callback 'report_progress' from call_id=27
|
|
[ComfyUI]
|
|
[ComfyUI] dino_salad.safetensors: 47%|████▋ | 166M/352M [00:06<00:07, 25.6MB/s][SubprocessWorker] callback 'report_progress' from call_id=27
|
|
[ComfyUI]
|
|
[ComfyUI] dino_salad.safetensors: 55%|█████▌ | 195M/352M [00:07<00:05, 26.5MB/s][SubprocessWorker] callback 'report_progress' from call_id=27
|
|
Frame 5 saved (frame_004.jpg, t=9.1s)
|
|
[capture-periodic] freeze=1ms shot=142ms unfreeze=2ms saved=True
|
|
[ComfyUI]
|
|
[ComfyUI] dino_salad.safetensors: 91%|█████████ | 320M/352M [00:07<00:00, 67.4MB/s][SubprocessWorker] callback 'report_progress' from call_id=27
|
|
[ComfyUI]
|
|
[ComfyUI] dino_salad.safetensors: 96%|█████████▌| 337M/352M [00:07<00:00, 67.2MB/s][SubprocessWorker] callback 'report_progress' from call_id=27
|
|
[capture-loop] iter=100 t=11.3s state={'complete': False, 'error': None, 'executedCount': 0, 'wsState': 1} eval_ms=2 ram=4.3/31.3GB (14%) swap=0.0/32.0GB (0%) cpu=7% browser_rss=1.07GB
|
|
[ComfyUI]
|
|
[ComfyUI] dino_salad.safetensors: 100%|██████████| 352M/352M [00:09<00:00, 38.9MB/s][SubprocessWorker] callback 'report_progress' from call_id=27
|
|
[ComfyUI]
|
|
[ComfyUI] dino_salad.safetensors: 100%|██████████| 352M/352M [00:09<00:00, 37.8MB/s]
|
|
[ComfyUI] [SubprocessWorker] got response: ok
|
|
[ComfyUI] [comfy-env] [VRAM] Before offload 'DepthAnything3Net_1' (783 MB) -> cpu: 269 / 7703 MB
|
|
[ComfyUI] [ComfyUI-DepthAnythingV3] Health check: ping (timeout=5.0s)...
|
|
[ComfyUI] [ComfyUI-DepthAnythingV3] Health check: ok
|
|
[ComfyUI] [SubprocessWorker] call_id=28 sending model_to_device
|
|
[ComfyUI] Model 'DepthAnything3Net_1' gone from worker (restarted?), treating as offloaded
|
|
[ComfyUI] [comfy-env] [VRAM] After offload 'DepthAnything3Net_1' (783 MB): 269 / 7703 MB
|
|
[ComfyUI] [comfy-env] LoadSALADModel done (11.33s): result: NodeOutput
|
|
[ComfyUI] [VRAM] After LoadSALADModel: 269 / 7703 MB
|
|
[ComfyUI] [comfy-env] Running DownloadAndLoadDepthAnythingV3Model: model: 'da3_large.safetensors', precision: 'auto', attention: 'auto'
|
|
[ComfyUI] [VRAM] Before DownloadAndLoadDepthAnythingV3Model: 269 / 7703 MB
|
|
[ComfyUI] [SubprocessWorker] call_method: nodes.load_model.DownloadAndLoadDepthAnythingV3Model.EXECUTE_NORMALIZED
|
|
[ComfyUI] [SubprocessWorker] acquired lock, ensuring started...
|
|
[ComfyUI] [ComfyUI-DepthAnythingV3] Health check: ping (timeout=5.0s)...
|
|
[ComfyUI] [ComfyUI-DepthAnythingV3] Health check: ok
|
|
[ComfyUI] [SubprocessWorker] worker started/confirmed
|
|
[ComfyUI] [SubprocessWorker] serializing kwargs to shm...
|
|
[ComfyUI] [SubprocessWorker] created 0 shm blocks
|
|
[ComfyUI] [SubprocessWorker] sending request via socket...
|
|
[ComfyUI] [SubprocessWorker] call_id=29 sending call_method
|
|
[ComfyUI] [SubprocessWorker] got response: ok
|
|
[ComfyUI] [comfy-env] DownloadAndLoadDepthAnythingV3Model done (0.02s): result: NodeOutput
|
|
[ComfyUI] [VRAM] After DownloadAndLoadDepthAnythingV3Model: 269 / 7703 MB
|
|
[ComfyUI] [comfy-env] Running DepthAnythingV3_Streaming: normalization_mode: 'Standard', chunk_size: 30, overlap: 8, align_lib: 'auto', align_method: 'sim3', resize_method: 'resize', invert_depth: True, save_pointcloud: False, sample_ratio: 0.015, conf_threshold_coef: 0.75, da3_model: dict, video: VideoFromFile, salad_model: dict
|
|
[ComfyUI] [VRAM] Before DepthAnythingV3_Streaming: 269 / 7703 MB
|
|
[ComfyUI] [SubprocessWorker] call_method: nodes.streaming.node.DepthAnythingV3_Streaming.EXECUTE_NORMALIZED
|
|
[ComfyUI] [SubprocessWorker] acquired lock, ensuring started...
|
|
[ComfyUI] [ComfyUI-DepthAnythingV3] Health check: ping (timeout=5.0s)...
|
|
[ComfyUI] [ComfyUI-DepthAnythingV3] Health check: ok
|
|
[ComfyUI] [SubprocessWorker] worker started/confirmed
|
|
[ComfyUI] [SubprocessWorker] serializing kwargs to shm...
|
|
[ComfyUI] [SubprocessWorker] created 1 shm blocks
|
|
[ComfyUI] [SubprocessWorker] sending request via socket...
|
|
[ComfyUI] [SubprocessWorker] call_id=30 sending call_method
|
|
Frame 6 saved (frame_005.jpg, t=11.4s)
|
|
[capture-periodic] freeze=2ms shot=146ms unfreeze=2ms saved=True
|
|
[ComfyUI] [worker:ComfyUI-DepthAnythingV3] WARNING: No comfy kitchen, using old apply_rope functions.
|
|
Frame 7 saved (frame_006.jpg, t=13.7s)
|
|
[capture-periodic] freeze=1ms shot=79ms unfreeze=5ms saved=True
|
|
[ComfyUI] [SubprocessWorker] callback 'request_vram_budget' from call_id=30
|
|
[ComfyUI] [comfy-env] VRAM request: 1.17GB, free before eviction: 7.80GB
|
|
[ComfyUI] [comfy-env] VRAM after eviction: 7.80GB
|
|
[ComfyUI] [worker:ComfyUI-DepthAnythingV3] [VRAM] +324MB (now 324MB) reserved=352MB peak=324MB
|
|
[ComfyUI] [worker:ComfyUI-DepthAnythingV3] [VRAM] +795MB (now 1119MB) reserved=1120MB peak=1119MB
|
|
[capture-loop] iter=150 t=16.9s state={'complete': False, 'error': None, 'executedCount': 0, 'wsState': 1} eval_ms=2 ram=7.7/31.3GB (24%) swap=0.0/32.0GB (0%) cpu=14% browser_rss=1.07GB
|
|
[ComfyUI] [SubprocessWorker] callback 'report_progress' from call_id=30
|
|
[ComfyUI] [worker:ComfyUI-DepthAnythingV3] [VRAM] +276MB (now 1395MB) reserved=1408MB peak=1395MB
|
|
[ComfyUI] [worker:ComfyUI-DepthAnythingV3] [VRAM] +1240MB (now 2635MB) reserved=4032MB peak=2635MB
|
|
[ComfyUI] [worker:ComfyUI-DepthAnythingV3] [VRAM] +350MB (now 2986MB) reserved=4480MB peak=3249MB
|
|
[ComfyUI] [worker:ComfyUI-DepthAnythingV3] [VRAM] +350MB (now 3337MB) reserved=4928MB peak=3337MB
|
|
[capture-loop] iter=200 t=22.4s state={'complete': False, 'error': None, 'executedCount': 0, 'wsState': 1} eval_ms=2 ram=7.3/31.3GB (23%) swap=0.0/32.0GB (0%) cpu=13% browser_rss=1.04GB
|
|
[ComfyUI] [worker:ComfyUI-DepthAnythingV3] [VRAM] +350MB (now 3688MB) reserved=5280MB peak=3688MB
|
|
[ComfyUI] [worker:ComfyUI-DepthAnythingV3] [VRAM] +579MB (now 4267MB) reserved=4512MB peak=4267MB
|
|
[ComfyUI] [worker:ComfyUI-DepthAnythingV3] [VRAM] +206MB (now 4473MB) reserved=5504MB peak=4473MB
|
|
[capture-loop] iter=250 t=28.0s state={'complete': False, 'error': None, 'executedCount': 0, 'wsState': 1} eval_ms=2 ram=7.1/31.3GB (23%) swap=0.0/32.0GB (0%) cpu=12% browser_rss=0.96GB
|
|
[ComfyUI] [worker:ComfyUI-DepthAnythingV3] [VRAM] -2957MB (now 1517MB) reserved=7136MB peak=4556MB
|
|
[ComfyUI] [SubprocessWorker] callback 'report_progress' from call_id=30
|
|
Frame 8 saved (frame_007.jpg, t=29.1s)
|
|
[capture-periodic] freeze=2ms shot=139ms unfreeze=3ms saved=True
|
|
[ComfyUI] [worker:ComfyUI-DepthAnythingV3] [VRAM] +1118MB (now 2635MB) reserved=4064MB peak=4556MB
|
|
[ComfyUI] [worker:ComfyUI-DepthAnythingV3] [VRAM] +350MB (now 2986MB) reserved=4416MB peak=4556MB
|
|
[ComfyUI] [worker:ComfyUI-DepthAnythingV3] [VRAM] +350MB (now 3337MB) reserved=4832MB peak=4556MB
|
|
[ComfyUI] [worker:ComfyUI-DepthAnythingV3] [VRAM] +350MB (now 3688MB) reserved=5120MB peak=4556MB
|
|
[capture-loop] iter=300 t=33.5s state={'complete': False, 'error': None, 'executedCount': 0, 'wsState': 1} eval_ms=1 ram=7.3/31.3GB (23%) swap=0.0/32.0GB (0%) cpu=12% browser_rss=0.96GB
|
|
[ComfyUI] [worker:ComfyUI-DepthAnythingV3] [VRAM] +579MB (now 4267MB) reserved=4608MB peak=4556MB
|
|
[ComfyUI] [worker:ComfyUI-DepthAnythingV3] [VRAM] +206MB (now 4473MB) reserved=5536MB peak=4556MB
|
|
[ComfyUI] [worker:ComfyUI-DepthAnythingV3] [VRAM] -2957MB (now 1517MB) reserved=7264MB peak=4556MB
|
|
[ComfyUI] [SubprocessWorker] callback 'report_progress' from call_id=30
|
|
[capture-loop] iter=350 t=39.1s state={'complete': False, 'error': None, 'executedCount': 0, 'wsState': 1} eval_ms=2 ram=7.5/31.3GB (24%) swap=0.0/32.0GB (0%) cpu=12% browser_rss=0.96GB
|
|
[ComfyUI] [worker:ComfyUI-DepthAnythingV3] [VRAM] +1118MB (now 2635MB) reserved=4064MB peak=4556MB
|
|
Frame 9 saved (frame_008.jpg, t=40.2s)
|
|
[capture-periodic] freeze=2ms shot=115ms unfreeze=1ms saved=True
|
|
[ComfyUI] [worker:ComfyUI-DepthAnythingV3] [VRAM] +350MB (now 2986MB) reserved=4416MB peak=4556MB
|
|
[ComfyUI] [worker:ComfyUI-DepthAnythingV3] [VRAM] +350MB (now 3337MB) reserved=4832MB peak=4556MB
|
|
[ComfyUI] [worker:ComfyUI-DepthAnythingV3] [VRAM] +877MB (now 4214MB) reserved=5120MB peak=4556MB
|
|
[capture-loop] iter=400 t=44.5s state={'complete': False, 'error': None, 'executedCount': 0, 'wsState': 1} eval_ms=2 ram=7.5/31.3GB (24%) swap=0.0/32.0GB (0%) cpu=11% browser_rss=0.96GB
|
|
[ComfyUI] [worker:ComfyUI-DepthAnythingV3] [VRAM] +207MB (now 4422MB) reserved=5248MB peak=4556MB
|
|
[ComfyUI] [worker:ComfyUI-DepthAnythingV3] [VRAM] -2906MB (now 1517MB) reserved=7264MB peak=4556MB
|
|
[ComfyUI] [SubprocessWorker] callback 'report_progress' from call_id=30
|
|
Frame 10 saved (frame_009.jpg, t=49.1s)
|
|
[capture-periodic] freeze=2ms shot=130ms unfreeze=3ms saved=True
|
|
[ComfyUI] [worker:ComfyUI-DepthAnythingV3] [VRAM] +1118MB (now 2635MB) reserved=4064MB peak=4556MB
|
|
[capture-loop] iter=450 t=50.2s state={'complete': False, 'error': None, 'executedCount': 0, 'wsState': 1} eval_ms=2 ram=7.7/31.3GB (25%) swap=0.0/32.0GB (0%) cpu=11% browser_rss=0.96GB
|
|
[ComfyUI] [worker:ComfyUI-DepthAnythingV3] [VRAM] +350MB (now 2986MB) reserved=4416MB peak=4556MB
|
|
[ComfyUI] [worker:ComfyUI-DepthAnythingV3] [VRAM] +350MB (now 3337MB) reserved=4832MB peak=4556MB
|
|
[ComfyUI] [worker:ComfyUI-DepthAnythingV3] [VRAM] +350MB (now 3688MB) reserved=5120MB peak=4556MB
|
|
[ComfyUI] [worker:ComfyUI-DepthAnythingV3] [VRAM] +568MB (now 4257MB) reserved=4544MB peak=4556MB
|
|
[capture-loop] iter=500 t=55.6s state={'complete': False, 'error': None, 'executedCount': 0, 'wsState': 1} eval_ms=2 ram=7.7/31.3GB (25%) swap=0.0/32.0GB (0%) cpu=11% browser_rss=0.96GB
|
|
[ComfyUI] [worker:ComfyUI-DepthAnythingV3] [VRAM] +206MB (now 4463MB) reserved=5440MB peak=4556MB
|
|
[ComfyUI] [worker:ComfyUI-DepthAnythingV3] [VRAM] -2947MB (now 1517MB) reserved=7264MB peak=4556MB
|
|
[ComfyUI] [SubprocessWorker] callback 'report_progress' from call_id=30
|
|
[ComfyUI] [worker:ComfyUI-DepthAnythingV3] [VRAM] +1118MB (now 2635MB) reserved=4064MB peak=4556MB
|
|
[ComfyUI] [worker:ComfyUI-DepthAnythingV3] [VRAM] +350MB (now 2986MB) reserved=4416MB peak=4556MB
|
|
[ComfyUI] [worker:ComfyUI-DepthAnythingV3]
|
|
[ComfyUI] === WATCHDOG TICK 1 ===
|
|
[ComfyUI] [worker:ComfyUI-DepthAnythingV3] Thread 0x00007f9d01447640 (most recent call first):
|
|
[ComfyUI] File "/root/.ce/.pixi/envs/depthanythingv3-nodes/lib/python3.11/threading.py", line 331 in wait
|
|
[ComfyUI] File "/root/.ce/.pixi/envs/depthanythingv3-nodes/lib/python3.11/threading.py", line 629 in wait
|
|
[ComfyUI] File "/root/.ce/.pixi/envs/depthanythingv3-nodes/lib/python3.11/site-packages/tqdm/_monitor.py", line 60 in run
|
|
[ComfyUI] File "/root/.ce/.pixi/envs/depthanythingv3-nodes/lib/python3.11/threading.py", line 1045 in _bootstrap_inner
|
|
[ComfyUI] File "/root/.ce/.pixi/envs/depthanythingv3-nodes/lib/python3.11/threading.py", line 1002 in _bootstrap
|
|
[ComfyUI]
|
|
[ComfyUI] Thread 0x00007fa0ab220640 (most recent call first):
|
|
[ComfyUI] File "/tmp/comfyui_pvenv_u36y2nop/persistent_worker.py", line 106 in _vram_poller
|
|
[ComfyUI] File "/root/.ce/.pixi/envs/depthanythingv3-nodes/lib/python3.11/threading.py", line 982 in run
|
|
[ComfyUI] File "/root/.ce/.pixi/envs/depthanythingv3-nodes/lib/python3.11/threading.py", line 1045 in _bootstrap_inner
|
|
[ComfyUI] File "/root/.ce/.pixi/envs/depthanythingv3-nodes/lib/python3.11/threading.py", line 1002 in _bootstrap
|
|
[ComfyUI]
|
|
[ComfyUI] Current thread 0x00007fa0aba25640 (most recent call first):
|
|
[ComfyUI] File "/tmp/comfyui_pvenv_u36y2nop/persistent_worker.py", line 52 in _watchdog
|
|
[ComfyUI] File "/root/.ce/.pixi/envs/depthanythingv3-nodes/lib/python3.11/threading.py", line 982 in run
|
|
[ComfyUI] File "/root/.ce/.pixi/envs/depthanythingv3-nodes/lib/python3.11/threading.py", line 1045 in _bootstrap_inner
|
|
[ComfyUI] File "/root/.ce/.pixi/envs/depthanythingv3-nodes/lib/python3.11/threading.py", line 1002 in _bootstrap
|
|
[ComfyUI]
|
|
[ComfyUI] Thread 0x00007fa0ac045740 (most recent call first):
|
|
[ComfyUI] File "/workspaces/DepthAnythingV3-0833/ComfyUI/custom_nodes/ComfyUI-DepthAnythingV3/nodes/depth_anything_v3/model.py", line 338 in forward
|
|
[ComfyUI] File "/root/.ce/.pixi/envs/depthanythingv3-nodes/lib/python3.11/site-packages/torch/nn/modules/module.py", line 1790 in _call_impl
|
|
[ComfyUI] File "/root/.ce/.pixi/envs/depthanythingv3-nodes/lib/python3.11/site-packages/torch/nn/modules/module.py", line 1779 in _wrapped_call_impl
|
|
[ComfyUI] File "/workspaces/DepthAnythingV3-0833/ComfyUI/custom_nodes/ComfyUI-DepthAnythingV3/nodes/depth_anything_v3/model.py", line 445 in forward
|
|
[ComfyUI] File "/root/.ce/.pixi/envs/depthanythingv3-nodes/lib/python3.11/site-packages/torch/nn/modules/module.py", line 1790 in _call_impl
|
|
[ComfyUI] File "/root/.ce/.pixi/envs/depthanythingv3-nodes/lib/python3.11/site-packages/torch/nn/modules/module.py", line 1779 in _wrapped_call_impl
|
|
[ComfyUI] File "/workspaces/DepthAnythingV3-0833/ComfyUI/custom_nodes/ComfyUI-DepthAnythingV3/nodes/depth_anything_v3/model.py", line 516 in attn_residual_func
|
|
[ComfyUI] File "/workspaces/DepthAnythingV3-0833/ComfyUI/custom_nodes/ComfyUI-DepthAnythingV3/nodes/depth_anything_v3/model.py", line 521 in forward
|
|
[ComfyUI] File "/root/.ce/.pixi/envs/depthanythingv3-nodes/lib/python3.11/site-packages/torch/nn/modules/module.py", line 1790 in _call_impl
|
|
[ComfyUI] File "/root/.ce/.pixi/envs/depthanythingv3-nodes/lib/python3.11/site-packages/torch/nn/modules/module.py", line 1779 in _wrapped_call_impl
|
|
[ComfyUI] File "/workspaces/DepthAnythingV3-0833/ComfyUI/custom_nodes/ComfyUI-DepthAnythingV3/nodes/depth_anything_v3/model.py", line 791 in process_attention
|
|
[ComfyUI] File "/workspaces/DepthAnythingV3-0833/ComfyUI/custom_nodes/ComfyUI-DepthAnythingV3/nodes/depth_anything_v3/model.py", line 750 in _get_intermediate_layers_not_chunked
|
|
[ComfyUI] File "/workspaces/DepthAnythingV3-0833/ComfyUI/custom_nodes/ComfyUI-DepthAnythingV3/nodes/depth_anything_v3/model.py", line 800 in get_intermediate_layers
|
|
[ComfyUI] File "/workspaces/DepthAnythingV3-0833/ComfyUI/custom_nodes/ComfyUI-DepthAnythingV3/nodes/depth_anything_v3/model.py", line 891 in forward
|
|
[ComfyUI] File "/root/.ce/.pixi/envs/depthanythingv3-nodes/lib/python3.11/site-packages/torch/nn/modules/module.py", line 1790 in _call_impl
|
|
[ComfyUI] File "/root/.ce/.pixi/envs/depthanythingv3-nodes/lib/python3.11/site-packages/torch/nn/modules/module.py", line 1779 in _wrapped_call_impl
|
|
[ComfyUI] File "/workspaces/DepthAnythingV3-0833/ComfyUI/custom_nodes/ComfyUI-DepthAnythingV3/nodes/depth_anything_v3/model.py", line 1560 in forward
|
|
[ComfyUI] File "/root/.ce/.pixi/envs/depthanythingv3-nodes/lib/python3.11/site-packages/torch/nn/modules/module.py", line 1790 in _call_impl
|
|
[ComfyUI] File "/root/.ce/.pixi/envs/depthanythingv3-nodes/lib/python3.11/site-packages/torch/nn/modules/module.py", line 1779 in _wrapped_call_impl
|
|
[ComfyUI] File "/workspaces/DepthAnythingV3-0833/ComfyUI/custom_nodes/ComfyUI-DepthAnythingV3/nodes/streaming/pipeline.py", line 330 in _process_chunk
|
|
[ComfyUI] File "/workspaces/DepthAnythingV3-0833/ComfyUI/custom_nodes/ComfyUI-DepthAnythingV3/nodes/streaming/pipeline.py", line 277 in run
|
|
[ComfyUI] File "/workspaces/DepthAnythingV3-0833/ComfyUI/custom_nodes/ComfyUI-DepthAnythingV3/nodes/streaming/node.py", line 249 in execute
|
|
[ComfyUI] File "/workspaces/DepthAnythingV3-0833/ComfyUI/comfy_api/latest/_io.py", line 1833 in EXECUTE_NORMALIZED
|
|
[ComfyUI] File "/tmp/comfyui_pvenv_u36y2nop/persistent_worker.py", line 1762 in main
|
|
[ComfyUI] File "/tmp/comfyui_pvenv_u36y2nop/persistent_worker.py", line 1807 in <module>
|
|
[ComfyUI]
|
|
[ComfyUI] [worker:ComfyUI-DepthAnythingV3] === END ===
|
|
[ComfyUI]
|
|
Frame 11 saved (frame_010.jpg, t=60.2s)
|
|
[capture-periodic] freeze=2ms shot=135ms unfreeze=5ms saved=True
|
|
[ComfyUI] [worker:ComfyUI-DepthAnythingV3] [VRAM] +350MB (now 3337MB) reserved=4832MB peak=4556MB
|
|
[capture-loop] iter=550 t=61.3s state={'complete': False, 'error': None, 'executedCount': 0, 'wsState': 1} eval_ms=2 ram=7.9/31.3GB (25%) swap=0.0/32.0GB (0%) cpu=12% browser_rss=0.97GB
|
|
[ComfyUI] [worker:ComfyUI-DepthAnythingV3] [VRAM] +350MB (now 3688MB) reserved=5120MB peak=4556MB
|
|
[ComfyUI] [worker:ComfyUI-DepthAnythingV3] [VRAM] +579MB (now 4267MB) reserved=4608MB peak=4556MB
|
|
[ComfyUI] [worker:ComfyUI-DepthAnythingV3] [VRAM] +206MB (now 4473MB) reserved=5472MB peak=4556MB
|
|
[capture-loop] iter=600 t=66.7s state={'complete': False, 'error': None, 'executedCount': 0, 'wsState': 1} eval_ms=2 ram=7.9/31.3GB (25%) swap=0.0/32.0GB (0%) cpu=11% browser_rss=0.97GB
|
|
[ComfyUI] [worker:ComfyUI-DepthAnythingV3] [VRAM] -2957MB (now 1517MB) reserved=7264MB peak=4556MB
|
|
[ComfyUI] [SubprocessWorker] callback 'report_progress' from call_id=30
|
|
[ComfyUI] [worker:ComfyUI-DepthAnythingV3] [VRAM] +1118MB (now 2635MB) reserved=4064MB peak=4556MB
|
|
Frame 12 saved (frame_011.jpg, t=69.0s)
|
|
[capture-periodic] freeze=2ms shot=127ms unfreeze=5ms saved=True
|
|
[ComfyUI] [worker:ComfyUI-DepthAnythingV3] [VRAM] +350MB (now 2986MB) reserved=4416MB peak=4556MB
|
|
[ComfyUI] [worker:ComfyUI-DepthAnythingV3] [VRAM] +350MB (now 3337MB) reserved=4832MB peak=4556MB
|
|
[ComfyUI] [worker:ComfyUI-DepthAnythingV3] [VRAM] +350MB (now 3688MB) reserved=5120MB peak=4556MB
|
|
[capture-loop] iter=650 t=72.3s state={'complete': False, 'error': None, 'executedCount': 0, 'wsState': 1} eval_ms=1 ram=8.1/31.3GB (26%) swap=0.0/32.0GB (0%) cpu=12% browser_rss=0.97GB
|
|
[ComfyUI] [worker:ComfyUI-DepthAnythingV3] [VRAM] +579MB (now 4267MB) reserved=4608MB peak=4556MB
|
|
[ComfyUI] [worker:ComfyUI-DepthAnythingV3] [VRAM] +206MB (now 4473MB) reserved=5472MB peak=4556MB
|
|
[capture-loop] iter=700 t=77.8s state={'complete': False, 'error': None, 'executedCount': 0, 'wsState': 1} eval_ms=2 ram=8.2/31.3GB (26%) swap=0.0/32.0GB (0%) cpu=11% browser_rss=0.97GB
|
|
[ComfyUI] [worker:ComfyUI-DepthAnythingV3] [VRAM] -2957MB (now 1517MB) reserved=7264MB peak=4556MB
|
|
[ComfyUI] [SubprocessWorker] callback 'report_progress' from call_id=30
|
|
Frame 13 saved (frame_012.jpg, t=77.9s)
|
|
[capture-periodic] freeze=2ms shot=130ms unfreeze=5ms saved=True
|
|
[ComfyUI] [worker:ComfyUI-DepthAnythingV3] [VRAM] +1118MB (now 2635MB) reserved=4064MB peak=4556MB
|
|
[ComfyUI] [worker:ComfyUI-DepthAnythingV3] [VRAM] +350MB (now 2986MB) reserved=4416MB peak=4556MB
|
|
[ComfyUI] [worker:ComfyUI-DepthAnythingV3] [VRAM] +350MB (now 3337MB) reserved=4832MB peak=4556MB
|
|
[ComfyUI] [worker:ComfyUI-DepthAnythingV3] [VRAM] +350MB (now 3688MB) reserved=5120MB peak=4556MB
|
|
[ComfyUI] [worker:ComfyUI-DepthAnythingV3] [VRAM] +579MB (now 4267MB) reserved=4608MB peak=4556MB
|
|
[capture-loop] iter=750 t=83.4s state={'complete': False, 'error': None, 'executedCount': 0, 'wsState': 1} eval_ms=2 ram=8.3/31.3GB (26%) swap=0.0/32.0GB (0%) cpu=11% browser_rss=0.97GB
|
|
[ComfyUI] [worker:ComfyUI-DepthAnythingV3] [VRAM] +206MB (now 4473MB) reserved=5472MB peak=4556MB
|
|
[ComfyUI] [worker:ComfyUI-DepthAnythingV3] [VRAM] -2957MB (now 1517MB) reserved=7264MB peak=4556MB
|
|
[ComfyUI] [SubprocessWorker] callback 'report_progress' from call_id=30
|
|
[ComfyUI] [worker:ComfyUI-DepthAnythingV3] [VRAM] +850MB (now 2367MB) reserved=3200MB peak=4556MB
|
|
[capture-loop] iter=800 t=88.9s state={'complete': False, 'error': None, 'executedCount': 0, 'wsState': 1} eval_ms=2 ram=8.5/31.3GB (27%) swap=0.0/32.0GB (0%) cpu=12% browser_rss=0.97GB
|
|
Frame 14 saved (frame_013.jpg, t=89.0s)
|
|
[capture-periodic] freeze=1ms shot=138ms unfreeze=5ms saved=True
|
|
[ComfyUI] [worker:ComfyUI-DepthAnythingV3] [VRAM] +467MB (now 2834MB) reserved=4000MB peak=4556MB
|
|
[ComfyUI] [worker:ComfyUI-DepthAnythingV3] [VRAM] +473MB (now 3308MB) reserved=3648MB peak=4556MB
|
|
[ComfyUI] [worker:ComfyUI-DepthAnythingV3] [VRAM] -1921MB (now 1387MB) reserved=5504MB peak=4556MB
|
|
[ComfyUI] [SubprocessWorker] callback 'report_progress' from call_id=30
|
|
[capture-loop] iter=850 t=94.5s state={'complete': False, 'error': None, 'executedCount': 0, 'wsState': 1} eval_ms=2 ram=8.9/31.3GB (29%) swap=0.0/32.0GB (0%) cpu=12% browser_rss=0.97GB
|
|
[ComfyUI] [worker:ComfyUI-DepthAnythingV3] [VRAM] -259MB (now 1128MB) reserved=1216MB peak=4556MB
|
|
[ComfyUI] [worker:ComfyUI-DepthAnythingV3] [VRAM] +343MB (now 1471MB) reserved=1536MB peak=4556MB
|
|
Frame 15 saved (frame_014.jpg, t=95.7s)
|
|
[capture-periodic] freeze=2ms shot=139ms unfreeze=3ms saved=True
|
|
[ComfyUI] [worker:ComfyUI-DepthAnythingV3] [VRAM] -344MB (now 1128MB) reserved=1632MB peak=4556MB
|
|
[ComfyUI] [SubprocessWorker] callback 'report_progress' from call_id=30
|
|
[ComfyUI] [worker:ComfyUI-DepthAnythingV3] [VRAM] +221MB (now 1349MB) reserved=1632MB peak=4556MB
|
|
Frame 16 saved (frame_015.jpg, t=97.9s)
|
|
[capture-periodic] freeze=2ms shot=137ms unfreeze=6ms saved=True
|
|
[ComfyUI] [SubprocessWorker] callback 'report_progress' from call_id=30
|
|
[ComfyUI] [worker:ComfyUI-DepthAnythingV3] [VRAM] -222MB (now 1128MB) reserved=1728MB peak=4556MB
|
|
[ComfyUI] [SubprocessWorker] callback 'report_progress' from call_id=30
|
|
[capture-loop] iter=900 t=100.1s state={'complete': False, 'error': None, 'executedCount': 0, 'wsState': 1} eval_ms=2 ram=9.0/31.3GB (29%) swap=0.0/32.0GB (0%) cpu=13% browser_rss=0.97GB
|
|
Frame 17 saved (frame_016.jpg, t=100.2s)
|
|
[capture-periodic] freeze=2ms shot=132ms unfreeze=3ms saved=True
|
|
[ComfyUI] [worker:ComfyUI-DepthAnythingV3] [VRAM] +315MB (now 1444MB) reserved=1728MB peak=4556MB
|
|
[ComfyUI] [SubprocessWorker] callback 'report_progress' from call_id=30
|
|
[ComfyUI] [worker:ComfyUI-DepthAnythingV3] [VRAM] -316MB (now 1128MB) reserved=1728MB peak=4556MB
|
|
[ComfyUI] [SubprocessWorker] callback 'report_progress' from call_id=30
|
|
Frame 18 saved (frame_017.jpg, t=102.5s)
|
|
[capture-periodic] freeze=1ms shot=140ms unfreeze=5ms saved=True
|
|
[ComfyUI] [worker:ComfyUI-DepthAnythingV3] [VRAM] +257MB (now 1385MB) reserved=1728MB peak=4556MB
|
|
[ComfyUI] [SubprocessWorker] callback 'report_progress' from call_id=30
|
|
[ComfyUI] [worker:ComfyUI-DepthAnythingV3] [VRAM] -258MB (now 1128MB) reserved=1728MB peak=4556MB
|
|
Frame 19 saved (frame_018.jpg, t=104.8s)
|
|
[capture-periodic] freeze=2ms shot=140ms unfreeze=7ms saved=True
|
|
[ComfyUI] [SubprocessWorker] callback 'report_progress' from call_id=30
|
|
[ComfyUI] [worker:ComfyUI-DepthAnythingV3] WARNING: faiss not installed, skipping loop closure. pip install faiss-cpu
|
|
[capture-loop] iter=950 t=105.9s state={'complete': False, 'error': None, 'executedCount': 0, 'wsState': 1} eval_ms=2 ram=9.0/31.3GB (29%) swap=0.0/32.0GB (0%) cpu=13% browser_rss=0.97GB
|
|
Frame 20 saved (frame_019.jpg, t=107.0s)
|
|
[capture-periodic] freeze=1ms shot=141ms unfreeze=4ms saved=True
|
|
[ComfyUI] [SubprocessWorker] callback 'report_progress' from call_id=30
|
|
Frame 21 saved (frame_020.jpg, t=109.3s)
|
|
[capture-periodic] freeze=1ms shot=130ms unfreeze=5ms saved=True
|
|
[capture-loop] iter=1000 t=111.5s state={'complete': False, 'error': None, 'executedCount': 0, 'wsState': 1} eval_ms=2 ram=8.4/31.3GB (27%) swap=0.0/32.0GB (0%) cpu=12% browser_rss=0.98GB
|
|
[capture-loop] iter=1050 t=117.0s state={'complete': False, 'error': None, 'executedCount': 0, 'wsState': 1} eval_ms=2 ram=8.3/31.3GB (27%) swap=0.0/32.0GB (0%) cpu=11% browser_rss=0.97GB
|
|
[ComfyUI] [worker:ComfyUI-DepthAnythingV3]
|
|
[ComfyUI] === WATCHDOG TICK 2 ===
|
|
[ComfyUI] [worker:ComfyUI-DepthAnythingV3] Thread 0x00007f9d01447640 (most recent call first):
|
|
[ComfyUI] File "/root/.ce/.pixi/envs/depthanythingv3-nodes/lib/python3.11/threading.py", line 331 in wait
|
|
[ComfyUI] File "/root/.ce/.pixi/envs/depthanythingv3-nodes/lib/python3.11/threading.py", line 629 in wait
|
|
[ComfyUI] File "/root/.ce/.pixi/envs/depthanythingv3-nodes/lib/python3.11/site-packages/tqdm/_monitor.py", line 60 in run
|
|
[ComfyUI] File "/root/.ce/.pixi/envs/depthanythingv3-nodes/lib/python3.11/threading.py", line 1045 in _bootstrap_inner
|
|
[ComfyUI] File "/root/.ce/.pixi/envs/depthanythingv3-nodes/lib/python3.11/threading.py", line 1002 in _bootstrap
|
|
[ComfyUI]
|
|
[ComfyUI] Thread 0x00007fa0ab220640 (most recent call first):
|
|
[ComfyUI] File "/tmp/comfyui_pvenv_u36y2nop/persistent_worker.py", line 106 in _vram_poller
|
|
[ComfyUI] File "/root/.ce/.pixi/envs/depthanythingv3-nodes/lib/python3.11/threading.py", line 982 in run
|
|
[ComfyUI] File "/root/.ce/.pixi/envs/depthanythingv3-nodes/lib/python3.11/threading.py", line 1045 in _bootstrap_inner
|
|
[ComfyUI] File "/root/.ce/.pixi/envs/depthanythingv3-nodes/lib/python3.11/threading.py", line 1002 in _bootstrap
|
|
[ComfyUI]
|
|
[ComfyUI] Current thread 0x00007fa0aba25640 (most recent call first):
|
|
[ComfyUI] File "/tmp/comfyui_pvenv_u36y2nop/persistent_worker.py", line 52 in _watchdog
|
|
[ComfyUI] File "/root/.ce/.pixi/envs/depthanythingv3-nodes/lib/python3.11/threading.py", line 982 in run
|
|
[ComfyUI] File "/root/.ce/.pixi/envs/depthanythingv3-nodes/lib/python3.11/threading.py", line 1045 in _bootstrap_inner
|
|
[ComfyUI] File "/root/.ce/.pixi/envs/depthanythingv3-nodes/lib/python3.11/threading.py", line 1002 in _bootstrap
|
|
[ComfyUI]
|
|
[ComfyUI] Thread 0x00007fa0ac045740 (most recent call first):
|
|
[ComfyUI] File "/root/.ce/.pixi/envs/depthanythingv3-nodes/lib/python3.11/zipfile.py", line 1194 in write
|
|
[ComfyUI] File "/root/.ce/.pixi/envs/depthanythingv3-nodes/lib/python3.11/site-packages/numpy/lib/_format_impl.py", line 777 in write_array
|
|
[ComfyUI] File "/root/.ce/.pixi/envs/depthanythingv3-nodes/lib/python3.11/site-packages/numpy/lib/_npyio_impl.py", line 786 in _savez
|
|
[ComfyUI] File "/root/.ce/.pixi/envs/depthanythingv3-nodes/lib/python3.11/site-packages/numpy/lib/_npyio_impl.py", line 753 in savez_compressed
|
|
[ComfyUI] File "/workspaces/DepthAnythingV3-0833/ComfyUI/custom_nodes/ComfyUI-DepthAnythingV3/nodes/streaming/node.py", line 271 in execute
|
|
[ComfyUI] File "/workspaces/DepthAnythingV3-0833/ComfyUI/comfy_api/latest/_io.py", line 1833 in EXECUTE_NORMALIZED
|
|
[ComfyUI] File "/tmp/comfyui_pvenv_u36y2nop/persistent_worker.py", line 1762 in main
|
|
[ComfyUI] File "/tmp/comfyui_pvenv_u36y2nop/persistent_worker.py", line 1807 in <module>
|
|
[ComfyUI]
|
|
[ComfyUI] [worker:ComfyUI-DepthAnythingV3] === END ===
|
|
[ComfyUI]
|
|
[capture-loop] iter=1100 t=122.5s state={'complete': False, 'error': None, 'executedCount': 0, 'wsState': 1} eval_ms=1 ram=8.4/31.3GB (27%) swap=0.0/32.0GB (0%) cpu=11% browser_rss=0.97GB
|
|
[capture-loop] iter=1150 t=128.0s state={'complete': False, 'error': None, 'executedCount': 0, 'wsState': 1} eval_ms=2 ram=8.3/31.3GB (27%) swap=0.0/32.0GB (0%) cpu=12% browser_rss=0.97GB
|
|
[capture-loop] iter=1200 t=133.5s state={'complete': False, 'error': None, 'executedCount': 0, 'wsState': 1} eval_ms=2 ram=8.3/31.3GB (27%) swap=0.0/32.0GB (0%) cpu=11% browser_rss=0.97GB
|
|
[capture-loop] iter=1250 t=139.1s state={'complete': False, 'error': None, 'executedCount': 0, 'wsState': 1} eval_ms=2 ram=8.4/31.3GB (27%) swap=0.0/32.0GB (0%) cpu=11% browser_rss=0.97GB
|
|
[capture-loop] iter=1300 t=144.5s state={'complete': False, 'error': None, 'executedCount': 0, 'wsState': 1} eval_ms=2 ram=6.7/31.3GB (22%) swap=0.0/32.0GB (0%) cpu=12% browser_rss=0.97GB
|
|
[ComfyUI] [SubprocessWorker] got response: ok
|
|
[ComfyUI] [comfy-env] Created 2 model patchers: ['DepthAnything3Net_1', 'VPRModel_2']
|
|
[ComfyUI] [comfy-env] DepthAnythingV3_Streaming done (137.62s): result: NodeOutput
|
|
[ComfyUI] [VRAM] After DepthAnythingV3_Streaming: 2171 / 7703 MB
|
|
[ComfyUI] [VRAM] Loaded: SubprocessModel (335 MB), SubprocessModel (783 MB)
|
|
[capture-loop] iter=1350 t=150.1s state={'complete': False, 'error': None, 'executedCount': 0, 'wsState': 1} eval_ms=1 ram=9.3/31.3GB (30%) swap=0.0/32.0GB (0%) cpu=18% browser_rss=0.98GB
|
|
[ComfyUI] Prompt executed in 150.86 seconds
|
|
Node executed (1 total), capturing...
|
|
Frame 22 saved (frame_021.jpg, t=151.2s)
|
|
[capture-node] freeze=2ms shot=135ms unfreeze=8ms saved=True
|
|
Execution complete (t=151.5s)
|
|
Captured 22 unique frames over 151.49s
|
|
[debug] iframes: 0
|
|
[timing] trigger_3d_previews: 0.0s
|
|
Saved high-quality screenshot: da3_streaming_executed.png
|
|
[timing] final_screenshot: 0.2s
|
|
Captured 23 video frames |