328 lines
30 KiB
Plaintext
328 lines
30 KiB
Plaintext
Capturing execution frames: da3_streaming.json
|
|
Frame 1 saved (frame_000.jpg, t=0.0s)
|
|
Validating workflow...
|
|
[ComfyUI] === /validate endpoint called ===
|
|
[ComfyUI] Received JSON with keys: ['prompt']
|
|
[ComfyUI] Prompt has 5 nodes
|
|
[ComfyUI] Node 2: DownloadAndLoadDepthAnythingV3Model
|
|
[ComfyUI] Inputs: {"model": "da3_large.safetensors", "precision": "auto", "attention": "auto"}
|
|
Queuing workflow for execution...
|
|
[ComfyUI] Node 3: LoadVideo
|
|
[ComfyUI] Inputs: {"file": "robot_unitree.mp4", "video-preview": ""}
|
|
[ComfyUI] Node 4: SaveVideo
|
|
[ComfyUI] Inputs: {"filename_prefix": "video/preview_da3", "format": "auto", "codec": "auto", "video": ["6", 0]}
|
|
[ComfyUI] Node 5: LoadSALADModel
|
|
[ComfyUI] Inputs: {}
|
|
[ComfyUI] Node 6: DepthAnythingV3_Streaming
|
|
[ComfyUI] Inputs: {"normalization_mode": "Standard", "chunk_size": 30, "overlap": 8, "align_lib": "auto", "align_method": "sim3", "resize_method": "resize", "invert_depth": true, "save_pointcloud": false, "sample_ratio
|
|
[ComfyUI] Generated prompt_id: 8efc0fe4-5c45-4fba-93d5-849bb3c22d60
|
|
[ComfyUI] Calling execution.validate_prompt()...
|
|
[ComfyUI] Validation result: valid=True
|
|
[ComfyUI] === Validation PASSED ===
|
|
[ComfyUI] got prompt
|
|
[ComfyUI] [comfy-env] Running LoadSALADModel:
|
|
[ComfyUI] [VRAM] Before LoadSALADModel: 507 / 7703 MB
|
|
[ComfyUI] [SubprocessWorker] call_method: nodes.load_model.LoadSALADModel.EXECUTE_NORMALIZED
|
|
[ComfyUI] [SubprocessWorker] acquired lock, ensuring started...
|
|
[ComfyUI] [ComfyUI-DepthAnythingV3] Health check: ping (timeout=5.0s)...
|
|
[ComfyUI] [ComfyUI-DepthAnythingV3] Health check: failed
|
|
[ComfyUI] [ComfyUI-DepthAnythingV3] Socket unhealthy, restarting worker...
|
|
[ComfyUI] [ComfyUI-DepthAnythingV3] python: /root/.ce/.pixi/envs/depthanythingv3-nodes/bin/python
|
|
[ComfyUI] [comfy-env] Invalidated 1 stale model patchers (will be cleaned up during next unload)
|
|
[ComfyUI] [ComfyUI-DepthAnythingV3] sys_path sent to worker: ['/workspaces/DepthAnythingV3-0926/ComfyUI', '/workspaces/DepthAnythingV3-0926/ComfyUI/custom_nodes/ComfyUI-DepthAnythingV3', '/root/.ce/.pixi/envs/depthanythingv3-nodes/lib/python3.10/site-packages', '/workspaces/DepthAnythingV3-0926/ComfyUI/custom_nodes/ComfyUI-DepthAnythingV3']
|
|
[ComfyUI] [SubprocessWorker] is_pixi=True, python=/root/.ce/.pixi/envs/depthanythingv3-nodes/bin/python
|
|
[ComfyUI] [SubprocessWorker] launching cmd=['/root/.pixi/bin/pixi', 'run', '--as-is', '--manifest-path', '/root/.ce/pixi.toml', '-e', 'depthanythingv3-nodes', 'python', '/tmp/comfyui_pvenv_xvidy7rt/persistent_worker.py', 'abstract://comfy_worker_b5d267a4bded']...
|
|
[ComfyUI] [SubprocessWorker] socket_addr=abstract://comfy_worker_b5d267a4bded (abstract, no filesystem path)
|
|
[ComfyUI] [worker:ComfyUI-DepthAnythingV3] ERROR: Failed to import comfy_kitchen, Error: No module named 'comfy_kitchen', fp8 and fp4 support will not be available.
|
|
[ComfyUI] [SubprocessWorker] worker started/confirmed
|
|
[ComfyUI] [SubprocessWorker] sending request via socket...
|
|
[ComfyUI] [SubprocessWorker] call_id=27 sending call_method
|
|
[ComfyUI]
|
|
Frame 2 saved (frame_001.jpg, t=2.3s)
|
|
[capture-periodic] freeze=2ms shot=100ms unfreeze=1ms saved=True
|
|
Frame 3 saved (frame_002.jpg, t=4.5s)
|
|
[capture-periodic] freeze=2ms shot=140ms unfreeze=5ms saved=True
|
|
[capture-loop] iter=50 t=5.7s state={'complete': False, 'error': None, 'executedCount': 0, 'wsState': 1} eval_ms=3 ram=4.1/31.3GB (13%) swap=0.7/32.0GB (2%) cpu=15% browser_rss=1.08GB
|
|
[ComfyUI] dino_salad.safetensors: 0%| | 0.00/352M [00:00<?, ?B/s]
|
|
[ComfyUI] dino_salad.safetensors: 63%|██████▎ | 223M/352M [00:03<00:02, 63.4MB/s][SubprocessWorker] callback 'report_progress' from call_id=27
|
|
[ComfyUI]
|
|
[ComfyUI] dino_salad.safetensors: 77%|███████▋ | 271M/352M [00:03<00:01, 75.0MB/s][SubprocessWorker] callback 'report_progress' from call_id=27
|
|
[ComfyUI]
|
|
[ComfyUI] dino_salad.safetensors: 100%|██████████| 352M/352M [00:04<00:00, 94.1MB/s][SubprocessWorker] callback 'report_progress' from call_id=27
|
|
[ComfyUI]
|
|
[ComfyUI] dino_salad.safetensors: 100%|██████████| 352M/352M [00:04<00:00, 82.8MB/s]
|
|
[ComfyUI] [SubprocessWorker] got response: ok
|
|
[ComfyUI] [comfy-env] [VRAM] Before offload 'DepthAnything3Net_1' (783 MB) -> cpu: 269 / 7703 MB
|
|
[ComfyUI] [ComfyUI-DepthAnythingV3] Health check: ping (timeout=5.0s)...
|
|
[ComfyUI] [ComfyUI-DepthAnythingV3] Health check: ok
|
|
[ComfyUI] [SubprocessWorker] call_id=28 sending model_to_device
|
|
[ComfyUI] Model 'DepthAnything3Net_1' gone from worker (restarted?), treating as offloaded
|
|
[ComfyUI] [comfy-env] [VRAM] After offload 'DepthAnything3Net_1' (783 MB): 269 / 7703 MB
|
|
[ComfyUI] [comfy-env] LoadSALADModel done (6.30s): result: NodeOutput
|
|
[ComfyUI] [VRAM] After LoadSALADModel: 269 / 7703 MB
|
|
[ComfyUI] [comfy-env] Running DownloadAndLoadDepthAnythingV3Model: model: 'da3_large.safetensors', precision: 'auto', attention: 'auto'
|
|
[ComfyUI] [VRAM] Before DownloadAndLoadDepthAnythingV3Model: 269 / 7703 MB
|
|
[ComfyUI] [SubprocessWorker] call_method: nodes.load_model.DownloadAndLoadDepthAnythingV3Model.EXECUTE_NORMALIZED
|
|
[ComfyUI] [SubprocessWorker] acquired lock, ensuring started...
|
|
[ComfyUI] [ComfyUI-DepthAnythingV3] Health check: ping (timeout=5.0s)...
|
|
[ComfyUI] [ComfyUI-DepthAnythingV3] Health check: ok
|
|
[ComfyUI] [SubprocessWorker] worker started/confirmed
|
|
[ComfyUI] [SubprocessWorker] serializing kwargs to shm...
|
|
[ComfyUI] [SubprocessWorker] created 0 shm blocks
|
|
[ComfyUI] [SubprocessWorker] sending request via socket...
|
|
[ComfyUI] [SubprocessWorker] call_id=29 sending call_method
|
|
[ComfyUI] [SubprocessWorker] got response: ok
|
|
[ComfyUI] [comfy-env] DownloadAndLoadDepthAnythingV3Model done (0.03s): result: NodeOutput
|
|
[ComfyUI] [VRAM] After DownloadAndLoadDepthAnythingV3Model: 269 / 7703 MB
|
|
[ComfyUI] [comfy-env] Running DepthAnythingV3_Streaming: normalization_mode: 'Standard', chunk_size: 30, overlap: 8, align_lib: 'auto', align_method: 'sim3', resize_method: 'resize', invert_depth: True, save_pointcloud: False, sample_ratio: 0.015, conf_threshold_coef: 0.75, da3_model: dict, video: VideoFromFile, salad_model: dict
|
|
[ComfyUI] [VRAM] Before DepthAnythingV3_Streaming: 269 / 7703 MB
|
|
[ComfyUI] [SubprocessWorker] call_method: nodes.streaming.node.DepthAnythingV3_Streaming.EXECUTE_NORMALIZED
|
|
[ComfyUI] [SubprocessWorker] acquired lock, ensuring started...
|
|
[ComfyUI] [ComfyUI-DepthAnythingV3] Health check: ping (timeout=5.0s)...
|
|
[ComfyUI] [ComfyUI-DepthAnythingV3] Health check: ok
|
|
[ComfyUI] [SubprocessWorker] worker started/confirmed
|
|
[ComfyUI] [SubprocessWorker] serializing kwargs to shm...
|
|
[ComfyUI] [SubprocessWorker] created 1 shm blocks
|
|
[ComfyUI] [SubprocessWorker] sending request via socket...
|
|
[ComfyUI] [SubprocessWorker] call_id=30 sending call_method
|
|
Frame 4 saved (frame_003.jpg, t=6.8s)
|
|
[capture-periodic] freeze=2ms shot=126ms unfreeze=5ms saved=True
|
|
[ComfyUI] [worker:ComfyUI-DepthAnythingV3] WARNING: No comfy kitchen, using old apply_rope functions.
|
|
[ComfyUI] [SubprocessWorker] callback 'request_vram_budget' from call_id=30
|
|
[ComfyUI] [comfy-env] VRAM request: 1.17GB, free before eviction: 7.80GB
|
|
[ComfyUI] [comfy-env] VRAM after eviction: 7.80GB
|
|
[ComfyUI] [worker:ComfyUI-DepthAnythingV3] [VRAM] +335MB (now 335MB) reserved=352MB peak=335MB
|
|
[capture-loop] iter=100 t=11.2s state={'complete': False, 'error': None, 'executedCount': 0, 'wsState': 1} eval_ms=2 ram=6.7/31.3GB (21%) swap=0.7/32.0GB (2%) cpu=14% browser_rss=1.07GB
|
|
[ComfyUI] [worker:ComfyUI-DepthAnythingV3] [VRAM] +783MB (now 1119MB) reserved=1120MB peak=1119MB
|
|
[ComfyUI] [SubprocessWorker] callback 'report_progress' from call_id=30
|
|
[ComfyUI] [worker:ComfyUI-DepthAnythingV3] [VRAM] +277MB (now 1396MB) reserved=1408MB peak=1396MB
|
|
[ComfyUI] [worker:ComfyUI-DepthAnythingV3] [VRAM] +1238MB (now 2635MB) reserved=4032MB peak=2635MB
|
|
[ComfyUI] [worker:ComfyUI-DepthAnythingV3] [VRAM] +350MB (now 2986MB) reserved=4480MB peak=2986MB
|
|
[capture-loop] iter=150 t=16.8s state={'complete': False, 'error': None, 'executedCount': 0, 'wsState': 1} eval_ms=2 ram=7.0/31.3GB (22%) swap=0.7/32.0GB (2%) cpu=13% browser_rss=1.07GB
|
|
[ComfyUI] [worker:ComfyUI-DepthAnythingV3] [VRAM] +350MB (now 3337MB) reserved=4928MB peak=3337MB
|
|
[ComfyUI] [worker:ComfyUI-DepthAnythingV3] [VRAM] +350MB (now 3688MB) reserved=5280MB peak=3688MB
|
|
[ComfyUI] [worker:ComfyUI-DepthAnythingV3] [VRAM] +568MB (now 4257MB) reserved=4544MB peak=4257MB
|
|
[capture-loop] iter=200 t=22.2s state={'complete': False, 'error': None, 'executedCount': 0, 'wsState': 1} eval_ms=2 ram=7.0/31.3GB (22%) swap=0.7/32.0GB (2%) cpu=11% browser_rss=1.07GB
|
|
[ComfyUI] [worker:ComfyUI-DepthAnythingV3] [VRAM] +206MB (now 4463MB) reserved=5440MB peak=4463MB
|
|
[ComfyUI] [worker:ComfyUI-DepthAnythingV3] [VRAM] -2947MB (now 1517MB) reserved=7136MB peak=4556MB
|
|
[ComfyUI] [SubprocessWorker] callback 'report_progress' from call_id=30
|
|
Frame 5 saved (frame_004.jpg, t=24.6s)
|
|
[capture-periodic] freeze=5ms shot=143ms unfreeze=4ms saved=True
|
|
[ComfyUI] [worker:ComfyUI-DepthAnythingV3] [VRAM] +1118MB (now 2635MB) reserved=4064MB peak=4556MB
|
|
[ComfyUI] [worker:ComfyUI-DepthAnythingV3] [VRAM] +350MB (now 2986MB) reserved=4416MB peak=4556MB
|
|
[ComfyUI] [worker:ComfyUI-DepthAnythingV3] [VRAM] +350MB (now 3337MB) reserved=4832MB peak=4556MB
|
|
[capture-loop] iter=250 t=27.9s state={'complete': False, 'error': None, 'executedCount': 0, 'wsState': 1} eval_ms=2 ram=7.1/31.3GB (23%) swap=0.7/32.0GB (2%) cpu=12% browser_rss=0.97GB
|
|
[ComfyUI] [worker:ComfyUI-DepthAnythingV3] [VRAM] +350MB (now 3688MB) reserved=5120MB peak=4556MB
|
|
[ComfyUI] [worker:ComfyUI-DepthAnythingV3] [VRAM] +568MB (now 4257MB) reserved=4544MB peak=4556MB
|
|
[ComfyUI] [worker:ComfyUI-DepthAnythingV3] [VRAM] +206MB (now 4463MB) reserved=5472MB peak=4556MB
|
|
[capture-loop] iter=300 t=33.3s state={'complete': False, 'error': None, 'executedCount': 0, 'wsState': 1} eval_ms=2 ram=7.0/31.3GB (22%) swap=0.7/32.0GB (2%) cpu=12% browser_rss=0.96GB
|
|
[ComfyUI] [worker:ComfyUI-DepthAnythingV3] [VRAM] -2947MB (now 1517MB) reserved=7264MB peak=4556MB
|
|
[ComfyUI] [SubprocessWorker] callback 'report_progress' from call_id=30
|
|
[ComfyUI] [worker:ComfyUI-DepthAnythingV3] [VRAM] +1118MB (now 2635MB) reserved=4064MB peak=4556MB
|
|
[ComfyUI] [worker:ComfyUI-DepthAnythingV3] [VRAM] +350MB (now 2986MB) reserved=4416MB peak=4556MB
|
|
Frame 6 saved (frame_005.jpg, t=35.7s)
|
|
[capture-periodic] freeze=1ms shot=130ms unfreeze=4ms saved=True
|
|
[ComfyUI] [worker:ComfyUI-DepthAnythingV3] [VRAM] +350MB (now 3337MB) reserved=4832MB peak=4556MB
|
|
[ComfyUI] [worker:ComfyUI-DepthAnythingV3] [VRAM] +350MB (now 3688MB) reserved=5120MB peak=4556MB
|
|
[ComfyUI] [worker:ComfyUI-DepthAnythingV3] [VRAM] +568MB (now 4257MB) reserved=4544MB peak=4556MB
|
|
[capture-loop] iter=350 t=39.0s state={'complete': False, 'error': None, 'executedCount': 0, 'wsState': 1} eval_ms=2 ram=7.1/31.3GB (23%) swap=0.7/32.0GB (2%) cpu=13% browser_rss=0.97GB
|
|
[ComfyUI] [worker:ComfyUI-DepthAnythingV3] [VRAM] +206MB (now 4463MB) reserved=5440MB peak=4556MB
|
|
[ComfyUI] [worker:ComfyUI-DepthAnythingV3] [VRAM] -2947MB (now 1517MB) reserved=7264MB peak=4556MB
|
|
[ComfyUI] [SubprocessWorker] callback 'report_progress' from call_id=30
|
|
[ComfyUI] [worker:ComfyUI-DepthAnythingV3] [VRAM] +1118MB (now 2635MB) reserved=4064MB peak=4556MB
|
|
[capture-loop] iter=400 t=44.4s state={'complete': False, 'error': None, 'executedCount': 0, 'wsState': 1} eval_ms=2 ram=7.3/31.3GB (23%) swap=0.7/32.0GB (2%) cpu=11% browser_rss=0.97GB
|
|
Frame 7 saved (frame_006.jpg, t=44.5s)
|
|
[capture-periodic] freeze=1ms shot=129ms unfreeze=5ms saved=True
|
|
[ComfyUI] [worker:ComfyUI-DepthAnythingV3] [VRAM] +350MB (now 2986MB) reserved=4416MB peak=4556MB
|
|
[ComfyUI] [worker:ComfyUI-DepthAnythingV3] [VRAM] +350MB (now 3337MB) reserved=4832MB peak=4556MB
|
|
[ComfyUI] [worker:ComfyUI-DepthAnythingV3] [VRAM] +350MB (now 3688MB) reserved=5120MB peak=4556MB
|
|
[ComfyUI] [worker:ComfyUI-DepthAnythingV3] [VRAM] +568MB (now 4257MB) reserved=4544MB peak=4556MB
|
|
[capture-loop] iter=450 t=50.0s state={'complete': False, 'error': None, 'executedCount': 0, 'wsState': 1} eval_ms=2 ram=7.3/31.3GB (23%) swap=0.7/32.0GB (2%) cpu=11% browser_rss=0.97GB
|
|
[ComfyUI] [worker:ComfyUI-DepthAnythingV3] [VRAM] +206MB (now 4463MB) reserved=5440MB peak=4556MB
|
|
[ComfyUI] [worker:ComfyUI-DepthAnythingV3] [VRAM] -2947MB (now 1517MB) reserved=7264MB peak=4556MB
|
|
[ComfyUI] [SubprocessWorker] callback 'report_progress' from call_id=30
|
|
Frame 8 saved (frame_007.jpg, t=53.4s)
|
|
[capture-periodic] freeze=6ms shot=127ms unfreeze=5ms saved=True
|
|
[ComfyUI] [worker:ComfyUI-DepthAnythingV3] [VRAM] +1118MB (now 2635MB) reserved=4064MB peak=4556MB
|
|
[ComfyUI] [worker:ComfyUI-DepthAnythingV3] [VRAM] +350MB (now 2986MB) reserved=4416MB peak=4556MB
|
|
[capture-loop] iter=500 t=55.5s state={'complete': False, 'error': None, 'executedCount': 0, 'wsState': 1} eval_ms=2 ram=7.5/31.3GB (24%) swap=0.7/32.0GB (2%) cpu=11% browser_rss=0.97GB
|
|
[ComfyUI] [worker:ComfyUI-DepthAnythingV3] [VRAM] +350MB (now 3337MB) reserved=4832MB peak=4556MB
|
|
[ComfyUI] [worker:ComfyUI-DepthAnythingV3] [VRAM] +350MB (now 3688MB) reserved=5120MB peak=4556MB
|
|
[ComfyUI] [worker:ComfyUI-DepthAnythingV3] [VRAM] +568MB (now 4257MB) reserved=4544MB peak=4556MB
|
|
[ComfyUI] [worker:ComfyUI-DepthAnythingV3]
|
|
[ComfyUI] === WATCHDOG TICK 1 ===
|
|
[ComfyUI] [worker:ComfyUI-DepthAnythingV3] Thread 0x00007440cd2fa640 (most recent call first):
|
|
[ComfyUI] File "/root/.ce/.pixi/envs/depthanythingv3-nodes/lib/python3.10/threading.py", line 324 in wait
|
|
[ComfyUI] File "/root/.ce/.pixi/envs/depthanythingv3-nodes/lib/python3.10/threading.py", line 607 in wait
|
|
[ComfyUI] File "/root/.ce/.pixi/envs/depthanythingv3-nodes/lib/python3.10/site-packages/tqdm/_monitor.py", line 60 in run
|
|
[ComfyUI] File "/root/.ce/.pixi/envs/depthanythingv3-nodes/lib/python3.10/threading.py", line 1016 in _bootstrap_inner
|
|
[ComfyUI] File "/root/.ce/.pixi/envs/depthanythingv3-nodes/lib/python3.10/threading.py", line 973 in _bootstrap
|
|
[ComfyUI]
|
|
[ComfyUI] Thread 0x000074446ed08640 (most recent call first):
|
|
[ComfyUI] File "/tmp/comfyui_pvenv_xvidy7rt/persistent_worker.py", line 106 in _vram_poller
|
|
[ComfyUI] File "/root/.ce/.pixi/envs/depthanythingv3-nodes/lib/python3.10/threading.py", line 953 in run
|
|
[ComfyUI] File "/root/.ce/.pixi/envs/depthanythingv3-nodes/lib/python3.10/threading.py", line 1016 in _bootstrap_inner
|
|
[ComfyUI] File "/root/.ce/.pixi/envs/depthanythingv3-nodes/lib/python3.10/threading.py", line 973 in _bootstrap
|
|
[ComfyUI]
|
|
[ComfyUI] Current thread 0x000074446f509640 (most recent call first):
|
|
[ComfyUI] File "/tmp/comfyui_pvenv_xvidy7rt/persistent_worker.py", line 52 in _watchdog
|
|
[ComfyUI] File "/root/.ce/.pixi/envs/depthanythingv3-nodes/lib/python3.10/threading.py", line 953 in run
|
|
[ComfyUI] File "/root/.ce/.pixi/envs/depthanythingv3-nodes/lib/python3.10/threading.py", line 1016 in _bootstrap_inner
|
|
[ComfyUI] File "/root/.ce/.pixi/envs/depthanythingv3-nodes/lib/python3.10/threading.py", line 973 in _bootstrap
|
|
[ComfyUI]
|
|
[ComfyUI] Thread 0x000074446fadf740 (most recent call first):
|
|
[ComfyUI] File "/root/.ce/.pixi/envs/depthanythingv3-nodes/lib/python3.10/site-packages/torch/nn/modules/conv.py", line 548 in _conv_forward
|
|
[ComfyUI] File "/workspaces/DepthAnythingV3-0926/ComfyUI/comfy/ops.py", line 509 in forward_comfy_cast_weights
|
|
[ComfyUI] File "/workspaces/DepthAnythingV3-0926/ComfyUI/comfy/ops.py", line 516 in forward
|
|
[ComfyUI] File "/root/.ce/.pixi/envs/depthanythingv3-nodes/lib/python3.10/site-packages/torch/nn/modules/module.py", line 1790 in _call_impl
|
|
[ComfyUI] File "/root/.ce/.pixi/envs/depthanythingv3-nodes/lib/python3.10/site-packages/torch/nn/modules/module.py", line 1779 in _wrapped_call_impl
|
|
[ComfyUI] File "/workspaces/DepthAnythingV3-0926/ComfyUI/custom_nodes/ComfyUI-DepthAnythingV3/nodes/depth_anything_v3/model.py", line 973 in forward
|
|
[ComfyUI] File "/root/.ce/.pixi/envs/depthanythingv3-nodes/lib/python3.10/site-packages/torch/nn/modules/module.py", line 1790 in _call_impl
|
|
[ComfyUI] File "/root/.ce/.pixi/envs/depthanythingv3-nodes/lib/python3.10/site-packages/torch/nn/modules/module.py", line 1779 in _wrapped_call_impl
|
|
[ComfyUI] File "/workspaces/DepthAnythingV3-0926/ComfyUI/custom_nodes/ComfyUI-DepthAnythingV3/nodes/depth_anything_v3/model.py", line 1466 in _fuse
|
|
[ComfyUI] File "/workspaces/DepthAnythingV3-0926/ComfyUI/custom_nodes/ComfyUI-DepthAnythingV3/nodes/depth_anything_v3/model.py", line 1405 in _forward_impl
|
|
[ComfyUI] File "/workspaces/DepthAnythingV3-0926/ComfyUI/custom_nodes/ComfyUI-DepthAnythingV3/nodes/depth_anything_v3/model.py", line 1379 in forward
|
|
[ComfyUI] File "/root/.ce/.pixi/envs/depthanythingv3-nodes/lib/python3.10/site-packages/torch/nn/modules/module.py", line 1790 in _call_impl
|
|
[ComfyUI] File "/root/.ce/.pixi/envs/depthanythingv3-nodes/lib/python3.10/site-packages/torch/nn/modules/module.py", line 1779 in _wrapped_call_impl
|
|
[ComfyUI] File "/workspaces/DepthAnythingV3-0926/ComfyUI/custom_nodes/ComfyUI-DepthAnythingV3/nodes/depth_anything_v3/model.py", line 1591 in _process_depth_head
|
|
[ComfyUI] File "/workspaces/DepthAnythingV3-0926/ComfyUI/custom_nodes/ComfyUI-DepthAnythingV3/nodes/depth_anything_v3/model.py", line 1577 in forward
|
|
[ComfyUI] File "/root/.ce/.pixi/envs/depthanythingv3-nodes/lib/python3.10/site-packages/torch/nn/modules/module.py", line 1790 in _call_impl
|
|
[ComfyUI] File "/root/.ce/.pixi/envs/depthanythingv3-nodes/lib/python3.10/site-packages/torch/nn/modules/module.py", line 1779 in _wrapped_call_impl
|
|
[ComfyUI] File "/workspaces/DepthAnythingV3-0926/ComfyUI/custom_nodes/ComfyUI-DepthAnythingV3/nodes/streaming/pipeline.py", line 330 in _process_chunk
|
|
[ComfyUI] File "/workspaces/DepthAnythingV3-0926/ComfyUI/custom_nodes/ComfyUI-DepthAnythingV3/nodes/streaming/pipeline.py", line 277 in run
|
|
[ComfyUI] File "/workspaces/DepthAnythingV3-0926/ComfyUI/custom_nodes/ComfyUI-DepthAnythingV3/nodes/streaming/node.py", line 249 in execute
|
|
[ComfyUI] File "/workspaces/DepthAnythingV3-0926/ComfyUI/comfy_api/latest/_io.py", line 1833 in EXECUTE_NORMALIZED
|
|
[ComfyUI] File "/tmp/comfyui_pvenv_xvidy7rt/persistent_worker.py", line 1762 in main
|
|
[ComfyUI] File "/tmp/comfyui_pvenv_xvidy7rt/persistent_worker.py", line 1807 in <module>
|
|
[ComfyUI]
|
|
[ComfyUI] [worker:ComfyUI-DepthAnythingV3] === END ===
|
|
[ComfyUI]
|
|
[capture-loop] iter=550 t=61.1s state={'complete': False, 'error': None, 'executedCount': 0, 'wsState': 1} eval_ms=2 ram=7.5/31.3GB (24%) swap=0.7/32.0GB (2%) cpu=11% browser_rss=0.97GB
|
|
[ComfyUI] [worker:ComfyUI-DepthAnythingV3] [VRAM] +206MB (now 4463MB) reserved=5440MB peak=4556MB
|
|
[ComfyUI] [worker:ComfyUI-DepthAnythingV3] [VRAM] -2947MB (now 1517MB) reserved=7264MB peak=4556MB
|
|
[ComfyUI] [SubprocessWorker] callback 'report_progress' from call_id=30
|
|
[ComfyUI] [worker:ComfyUI-DepthAnythingV3] [VRAM] +1118MB (now 2635MB) reserved=4064MB peak=4556MB
|
|
Frame 9 saved (frame_008.jpg, t=64.4s)
|
|
[capture-periodic] freeze=1ms shot=152ms unfreeze=15ms saved=True
|
|
[ComfyUI] [worker:ComfyUI-DepthAnythingV3] [VRAM] +350MB (now 2986MB) reserved=4416MB peak=4556MB
|
|
[ComfyUI] [worker:ComfyUI-DepthAnythingV3] [VRAM] +350MB (now 3337MB) reserved=4832MB peak=4556MB
|
|
[capture-loop] iter=600 t=66.6s state={'complete': False, 'error': None, 'executedCount': 0, 'wsState': 1} eval_ms=2 ram=7.7/31.3GB (25%) swap=0.7/32.0GB (2%) cpu=12% browser_rss=0.97GB
|
|
[ComfyUI] [worker:ComfyUI-DepthAnythingV3] [VRAM] +350MB (now 3688MB) reserved=5120MB peak=4556MB
|
|
[ComfyUI] [worker:ComfyUI-DepthAnythingV3] [VRAM] +568MB (now 4257MB) reserved=4544MB peak=4556MB
|
|
[ComfyUI] [worker:ComfyUI-DepthAnythingV3] [VRAM] +206MB (now 4463MB) reserved=5440MB peak=4556MB
|
|
[capture-loop] iter=650 t=72.2s state={'complete': False, 'error': None, 'executedCount': 0, 'wsState': 1} eval_ms=2 ram=7.7/31.3GB (25%) swap=0.7/32.0GB (2%) cpu=11% browser_rss=0.97GB
|
|
[ComfyUI] [worker:ComfyUI-DepthAnythingV3] [VRAM] -2947MB (now 1517MB) reserved=7264MB peak=4556MB
|
|
[ComfyUI] [SubprocessWorker] callback 'report_progress' from call_id=30
|
|
Frame 10 saved (frame_009.jpg, t=73.3s)
|
|
[capture-periodic] freeze=1ms shot=126ms unfreeze=4ms saved=True
|
|
[ComfyUI] [worker:ComfyUI-DepthAnythingV3] [VRAM] +1118MB (now 2635MB) reserved=4064MB peak=4556MB
|
|
[ComfyUI] [worker:ComfyUI-DepthAnythingV3] [VRAM] +350MB (now 2986MB) reserved=4416MB peak=4556MB
|
|
[ComfyUI] [worker:ComfyUI-DepthAnythingV3] [VRAM] +350MB (now 3337MB) reserved=4832MB peak=4556MB
|
|
[ComfyUI] [worker:ComfyUI-DepthAnythingV3] [VRAM] +350MB (now 3688MB) reserved=5120MB peak=4556MB
|
|
[ComfyUI] [worker:ComfyUI-DepthAnythingV3] [VRAM] +568MB (now 4257MB) reserved=4544MB peak=4556MB
|
|
[capture-loop] iter=700 t=77.6s state={'complete': False, 'error': None, 'executedCount': 0, 'wsState': 1} eval_ms=2 ram=7.9/31.3GB (25%) swap=0.7/32.0GB (2%) cpu=11% browser_rss=0.97GB
|
|
[ComfyUI] [worker:ComfyUI-DepthAnythingV3] [VRAM] +206MB (now 4463MB) reserved=5440MB peak=4556MB
|
|
[ComfyUI] [worker:ComfyUI-DepthAnythingV3] [VRAM] -2947MB (now 1517MB) reserved=7264MB peak=4556MB
|
|
[ComfyUI] [SubprocessWorker] callback 'report_progress' from call_id=30
|
|
[capture-loop] iter=750 t=83.2s state={'complete': False, 'error': None, 'executedCount': 0, 'wsState': 1} eval_ms=2 ram=8.0/31.3GB (26%) swap=0.7/32.0GB (2%) cpu=12% browser_rss=0.98GB
|
|
[ComfyUI] [worker:ComfyUI-DepthAnythingV3] [VRAM] +850MB (now 2367MB) reserved=3200MB peak=4556MB
|
|
[ComfyUI] [worker:ComfyUI-DepthAnythingV3] [VRAM] +233MB (now 2601MB) reserved=4000MB peak=4556MB
|
|
Frame 11 saved (frame_010.jpg, t=84.3s)
|
|
[capture-periodic] freeze=2ms shot=144ms unfreeze=12ms saved=True
|
|
[ComfyUI] [worker:ComfyUI-DepthAnythingV3] [VRAM] +697MB (now 3298MB) reserved=3648MB peak=4556MB
|
|
[ComfyUI] [worker:ComfyUI-DepthAnythingV3] [VRAM] -1911MB (now 1387MB) reserved=5504MB peak=4556MB
|
|
[ComfyUI] [SubprocessWorker] callback 'report_progress' from call_id=30
|
|
[capture-loop] iter=800 t=88.7s state={'complete': False, 'error': None, 'executedCount': 0, 'wsState': 1} eval_ms=2 ram=8.3/31.3GB (26%) swap=0.7/32.0GB (2%) cpu=11% browser_rss=0.97GB
|
|
Frame 12 saved (frame_011.jpg, t=88.8s)
|
|
[capture-periodic] freeze=1ms shot=137ms unfreeze=7ms saved=True
|
|
[ComfyUI] [worker:ComfyUI-DepthAnythingV3] [VRAM] -259MB (now 1128MB) reserved=1216MB peak=4556MB
|
|
[ComfyUI] [worker:ComfyUI-DepthAnythingV3] [VRAM] +214MB (now 1343MB) reserved=1408MB peak=4556MB
|
|
[ComfyUI] [worker:ComfyUI-DepthAnythingV3] [VRAM] -215MB (now 1128MB) reserved=1664MB peak=4556MB
|
|
[ComfyUI] [SubprocessWorker] callback 'report_progress' from call_id=30
|
|
[ComfyUI] [worker:ComfyUI-DepthAnythingV3] [VRAM] +221MB (now 1349MB) reserved=1728MB peak=4556MB
|
|
Frame 13 saved (frame_012.jpg, t=93.3s)
|
|
[capture-periodic] freeze=2ms shot=141ms unfreeze=3ms saved=True
|
|
[ComfyUI] [SubprocessWorker] callback 'report_progress' from call_id=30
|
|
[ComfyUI] [worker:ComfyUI-DepthAnythingV3] [VRAM] -222MB (now 1128MB) reserved=1728MB peak=4556MB
|
|
[capture-loop] iter=850 t=94.4s state={'complete': False, 'error': None, 'executedCount': 0, 'wsState': 1} eval_ms=2 ram=8.7/31.3GB (28%) swap=0.7/32.0GB (2%) cpu=12% browser_rss=0.98GB
|
|
[ComfyUI] [SubprocessWorker] callback 'report_progress' from call_id=30
|
|
Frame 14 saved (frame_013.jpg, t=95.6s)
|
|
[capture-periodic] freeze=2ms shot=143ms unfreeze=5ms saved=True
|
|
[ComfyUI] [worker:ComfyUI-DepthAnythingV3] [VRAM] +213MB (now 1342MB) reserved=1728MB peak=4556MB
|
|
[ComfyUI] [SubprocessWorker] callback 'report_progress' from call_id=30
|
|
[ComfyUI] [worker:ComfyUI-DepthAnythingV3] [VRAM] -214MB (now 1128MB) reserved=1728MB peak=4556MB
|
|
Frame 15 saved (frame_014.jpg, t=97.8s)
|
|
[capture-periodic] freeze=1ms shot=129ms unfreeze=7ms saved=True
|
|
[ComfyUI] [SubprocessWorker] callback 'report_progress' from call_id=30
|
|
[ComfyUI] [worker:ComfyUI-DepthAnythingV3] [VRAM] +223MB (now 1351MB) reserved=1728MB peak=4556MB
|
|
[ComfyUI] [SubprocessWorker] callback 'report_progress' from call_id=30
|
|
[ComfyUI] [worker:ComfyUI-DepthAnythingV3] [VRAM] -224MB (now 1128MB) reserved=1728MB peak=4556MB
|
|
[capture-loop] iter=900 t=100.0s state={'complete': False, 'error': None, 'executedCount': 0, 'wsState': 1} eval_ms=2 ram=8.6/31.3GB (28%) swap=0.7/32.0GB (2%) cpu=13% browser_rss=0.98GB
|
|
Frame 16 saved (frame_015.jpg, t=100.1s)
|
|
[capture-periodic] freeze=2ms shot=139ms unfreeze=5ms saved=True
|
|
[ComfyUI] [SubprocessWorker] callback 'report_progress' from call_id=30
|
|
[ComfyUI] [worker:ComfyUI-DepthAnythingV3] WARNING: faiss not installed, skipping loop closure. pip install faiss-cpu
|
|
Frame 17 saved (frame_016.jpg, t=102.4s)
|
|
[capture-periodic] freeze=1ms shot=129ms unfreeze=5ms saved=True
|
|
[capture-loop] iter=950 t=105.7s state={'complete': False, 'error': None, 'executedCount': 0, 'wsState': 1} eval_ms=2 ram=10.6/31.3GB (34%) swap=0.7/32.0GB (2%) cpu=12% browser_rss=0.98GB
|
|
[ComfyUI] [SubprocessWorker] callback 'report_progress' from call_id=30
|
|
Frame 18 saved (frame_017.jpg, t=106.9s)
|
|
[capture-periodic] freeze=1ms shot=133ms unfreeze=4ms saved=True
|
|
[capture-loop] iter=1000 t=111.2s state={'complete': False, 'error': None, 'executedCount': 0, 'wsState': 1} eval_ms=2 ram=8.0/31.3GB (26%) swap=0.7/32.0GB (2%) cpu=12% browser_rss=0.98GB
|
|
[capture-loop] iter=1050 t=116.8s state={'complete': False, 'error': None, 'executedCount': 0, 'wsState': 1} eval_ms=1 ram=8.0/31.3GB (26%) swap=0.7/32.0GB (2%) cpu=11% browser_rss=0.98GB
|
|
[ComfyUI] [worker:ComfyUI-DepthAnythingV3]
|
|
[ComfyUI] === WATCHDOG TICK 2 ===
|
|
[ComfyUI] [worker:ComfyUI-DepthAnythingV3] Thread 0x00007440cd2fa640 (most recent call first):
|
|
[ComfyUI] File "/root/.ce/.pixi/envs/depthanythingv3-nodes/lib/python3.10/threading.py", line 324 in wait
|
|
[ComfyUI] File "/root/.ce/.pixi/envs/depthanythingv3-nodes/lib/python3.10/threading.py", line 607 in wait
|
|
[ComfyUI] File "/root/.ce/.pixi/envs/depthanythingv3-nodes/lib/python3.10/site-packages/tqdm/_monitor.py", line 60 in run
|
|
[ComfyUI] File "/root/.ce/.pixi/envs/depthanythingv3-nodes/lib/python3.10/threading.py", line 1016 in _bootstrap_inner
|
|
[ComfyUI] File "/root/.ce/.pixi/envs/depthanythingv3-nodes/lib/python3.10/threading.py", line 973 in _bootstrap
|
|
[ComfyUI]
|
|
[ComfyUI] Thread 0x000074446ed08640 (most recent call first):
|
|
[ComfyUI] File "/tmp/comfyui_pvenv_xvidy7rt/persistent_worker.py", line 106 in _vram_poller
|
|
[ComfyUI] File "/root/.ce/.pixi/envs/depthanythingv3-nodes/lib/python3.10/threading.py", line 953 in run
|
|
[ComfyUI] File "/root/.ce/.pixi/envs/depthanythingv3-nodes/lib/python3.10/threading.py", line 1016 in _bootstrap_inner
|
|
[ComfyUI] File "/root/.ce/.pixi/envs/depthanythingv3-nodes/lib/python3.10/threading.py", line 973 in _bootstrap
|
|
[ComfyUI]
|
|
[ComfyUI] Current thread 0x000074446f509640 (most recent call first):
|
|
[ComfyUI] File "/tmp/comfyui_pvenv_xvidy7rt/persistent_worker.py", line 52 in _watchdog
|
|
[ComfyUI] File "/root/.ce/.pixi/envs/depthanythingv3-nodes/lib/python3.10/threading.py", line 953 in run
|
|
[ComfyUI] File "/root/.ce/.pixi/envs/depthanythingv3-nodes/lib/python3.10/threading.py", line 1016 in _bootstrap_inner
|
|
[ComfyUI] File "/root/.ce/.pixi/envs/depthanythingv3-nodes/lib/python3.10/threading.py", line 973 in _bootstrap
|
|
[ComfyUI]
|
|
[ComfyUI] Thread 0x000074446fadf740 (most recent call first):
|
|
[ComfyUI] File "/root/.ce/.pixi/envs/depthanythingv3-nodes/lib/python3.10/zipfile.py", line 1158 in write
|
|
[ComfyUI] File "/root/.ce/.pixi/envs/depthanythingv3-nodes/lib/python3.10/site-packages/numpy/lib/format.py", line 759 in write_array
|
|
[ComfyUI] File "/root/.ce/.pixi/envs/depthanythingv3-nodes/lib/python3.10/site-packages/numpy/lib/_npyio_impl.py", line 796 in _savez
|
|
[ComfyUI] File "/root/.ce/.pixi/envs/depthanythingv3-nodes/lib/python3.10/site-packages/numpy/lib/_npyio_impl.py", line 763 in savez_compressed
|
|
[ComfyUI] File "/workspaces/DepthAnythingV3-0926/ComfyUI/custom_nodes/ComfyUI-DepthAnythingV3/nodes/streaming/node.py", line 271 in execute
|
|
[ComfyUI] File "/workspaces/DepthAnythingV3-0926/ComfyUI/comfy_api/latest/_io.py", line 1833 in EXECUTE_NORMALIZED
|
|
[ComfyUI] File "/tmp/comfyui_pvenv_xvidy7rt/persistent_worker.py", line 1762 in main
|
|
[ComfyUI] File "/tmp/comfyui_pvenv_xvidy7rt/persistent_worker.py", line 1807 in <module>
|
|
[ComfyUI]
|
|
[ComfyUI] [worker:ComfyUI-DepthAnythingV3] === END ===
|
|
[ComfyUI]
|
|
[capture-loop] iter=1100 t=122.3s state={'complete': False, 'error': None, 'executedCount': 0, 'wsState': 1} eval_ms=2 ram=8.0/31.3GB (26%) swap=0.7/32.0GB (2%) cpu=11% browser_rss=0.98GB
|
|
[capture-loop] iter=1150 t=127.8s state={'complete': False, 'error': None, 'executedCount': 0, 'wsState': 1} eval_ms=1 ram=7.9/31.3GB (25%) swap=0.7/32.0GB (2%) cpu=11% browser_rss=0.98GB
|
|
[capture-loop] iter=1200 t=133.3s state={'complete': False, 'error': None, 'executedCount': 0, 'wsState': 1} eval_ms=2 ram=7.9/31.3GB (25%) swap=0.7/32.0GB (2%) cpu=11% browser_rss=0.98GB
|
|
[capture-loop] iter=1250 t=138.9s state={'complete': False, 'error': None, 'executedCount': 0, 'wsState': 1} eval_ms=2 ram=8.6/31.3GB (27%) swap=0.7/32.0GB (2%) cpu=11% browser_rss=0.98GB
|
|
[capture-loop] iter=1300 t=144.4s state={'complete': False, 'error': None, 'executedCount': 0, 'wsState': 1} eval_ms=2 ram=8.3/31.3GB (26%) swap=0.7/32.0GB (2%) cpu=12% browser_rss=0.98GB
|
|
[ComfyUI] [SubprocessWorker] got response: ok
|
|
[ComfyUI] [comfy-env] Created 2 model patchers: ['DepthAnything3Net_1', 'VPRModel_2']
|
|
[ComfyUI] [comfy-env] DepthAnythingV3_Streaming done (140.11s): result: NodeOutput
|
|
[ComfyUI] [VRAM] After DepthAnythingV3_Streaming: 2169 / 7703 MB
|
|
[ComfyUI] [VRAM] Loaded: SubprocessModel (335 MB), SubprocessModel (783 MB)
|
|
Frame 19 saved (frame_018.jpg, t=146.7s)
|
|
[capture-periodic] freeze=1ms shot=104ms unfreeze=7ms saved=True
|
|
[ComfyUI] Prompt executed in 148.29 seconds
|
|
Node executed (1 total), capturing...
|
|
Frame 20 saved (frame_019.jpg, t=148.7s)
|
|
[capture-node] freeze=2ms shot=142ms unfreeze=3ms saved=True
|
|
Execution complete (t=149.0s)
|
|
Captured 20 unique frames over 148.99s
|
|
[debug] iframes: 0
|
|
[timing] trigger_3d_previews: 0.0s
|
|
Saved high-quality screenshot: da3_streaming_executed.png
|
|
[timing] final_screenshot: 0.3s
|
|
Captured 21 video frames |