331 lines
45 KiB
Plaintext
331 lines
45 KiB
Plaintext
Capturing execution frames: advanced.json
|
|
[ComfyUI] [DEPRECATION WARNING] Detected import of deprecated legacy API: /extensions/core/widgetInputs.js. This is likely caused by a custom node extension using outdated APIs. Please update your extensions or contact the extension author for an updated version.
|
|
Frame 1 saved (frame_000.jpg, t=0.0s)
|
|
Validating workflow...
|
|
[ComfyUI] === /validate endpoint called ===
|
|
[ComfyUI] Received JSON with keys: ['prompt']
|
|
[ComfyUI] Prompt has 11 nodes
|
|
Queuing workflow for execution...
|
|
[ComfyUI] Node 2: LoadImage
|
|
[ComfyUI] Inputs: {"image": "bridge.jpg"}
|
|
[ComfyUI] Node 3: DownloadAndLoadDepthAnythingV3Model
|
|
[ComfyUI] Inputs: {"model": "da3_large.safetensors", "precision": "auto", "attention": "auto"}
|
|
[ComfyUI] Node 4: PreviewImage
|
|
[ComfyUI] Inputs: {"images": ["12", 0]}
|
|
[ComfyUI] Node 6: PreviewImage
|
|
[ComfyUI] Inputs: {"images": ["12", 1]}
|
|
[ComfyUI] Node 7: PreviewImage
|
|
[ComfyUI] Inputs: {"images": ["12", 2]}
|
|
[ComfyUI] Node 8: PreviewImage
|
|
[ComfyUI] Inputs: {"images": ["12", 3]}
|
|
[ComfyUI] Node 9: PreviewAny
|
|
[ComfyUI] Inputs: {"source": ["12", 6]}
|
|
[ComfyUI] Node 10: PreviewAny
|
|
[ComfyUI] Inputs: {"source": ["12", 5]}
|
|
[ComfyUI] Node 11: MaskPreview
|
|
[ComfyUI] Inputs: {"mask": ["12", 7]}
|
|
[ComfyUI] Node 12: DepthAnything_V3
|
|
[ComfyUI] Inputs: {"normalization_mode": "V2-Style", "resize_method": "resize", "invert_depth": false, "keep_model_size": false, "da3_model": ["3", 0], "images": ["2", 0]}
|
|
[ComfyUI] Node 13: PreviewImage
|
|
[ComfyUI] Inputs: {"images": ["12", 4]}
|
|
[ComfyUI] Generated prompt_id: ea74b14a-1d8f-46b5-998f-c0877e565cbc
|
|
[ComfyUI] Calling execution.validate_prompt()...
|
|
[ComfyUI] Validation result: valid=True
|
|
[ComfyUI] === Validation PASSED ===
|
|
[ComfyUI] got prompt
|
|
[ComfyUI] [comfy-env] Running DownloadAndLoadDepthAnythingV3Model: model: 'da3_large.safetensors', precision: 'auto', attention: 'auto'
|
|
[ComfyUI] [comfy-env] SubprocessWorker: /root/.ce/.pixi/envs/depthanythingv3-nodes/bin/python
|
|
[ComfyUI] [VRAM] Before DownloadAndLoadDepthAnythingV3Model: 22353 / 24124 MB
|
|
[ComfyUI] [comfy-env] env_vars: {'COMFYUI_BASE': '/workspaces/DepthAnythingV3-1231/ComfyUI'}
|
|
[ComfyUI] [SubprocessWorker] call_method: nodes.load_model.DownloadAndLoadDepthAnythingV3Model.EXECUTE_NORMALIZED
|
|
[ComfyUI] [ComfyUI-DepthAnythingV3] python: /root/.ce/.pixi/envs/depthanythingv3-nodes/bin/python
|
|
[ComfyUI] [SubprocessWorker] acquired lock, ensuring started...
|
|
[ComfyUI] [ComfyUI-DepthAnythingV3] sys_path sent to worker: ['/workspaces/DepthAnythingV3-1231/ComfyUI', '/workspaces/DepthAnythingV3-1231/ComfyUI/custom_nodes/ComfyUI-DepthAnythingV3', '/root/.ce/.pixi/envs/depthanythingv3-nodes/lib/python3.1/site-packages', '/workspaces/DepthAnythingV3-1231/ComfyUI/custom_nodes/ComfyUI-DepthAnythingV3']
|
|
[ComfyUI] [SubprocessWorker] is_pixi=True, python=/root/.ce/.pixi/envs/depthanythingv3-nodes/bin/python
|
|
[ComfyUI] [SubprocessWorker] launching cmd=['/root/.pixi/bin/pixi', 'run', '--as-is', '--manifest-path', '/root/.ce/pixi.toml', '-e', 'depthanythingv3-nodes', 'python', '/tmp/comfyui_pvenv_c1iflygq/persistent_worker.py', 'abstract://comfy_worker_dbc1c1ce7155']...
|
|
[ComfyUI] [SubprocessWorker] socket_addr=abstract://comfy_worker_dbc1c1ce7155 (abstract, no filesystem path)
|
|
[ComfyUI] [worker:ComfyUI-DepthAnythingV3] ERROR: Failed to import comfy_kitchen, Error: No module named 'comfy_kitchen', fp8 and fp4 support will not be available.
|
|
Frame 2 saved (frame_001.jpg, t=2.5s)
|
|
[capture-periodic] freeze=4ms shot=210ms unfreeze=5ms saved=True
|
|
[ComfyUI] [SubprocessWorker] worker started/confirmed
|
|
[ComfyUI] [SubprocessWorker] serializing kwargs to shm...
|
|
[ComfyUI] [SubprocessWorker] created 0 shm blocks
|
|
[ComfyUI] [SubprocessWorker] sending request via socket...
|
|
[ComfyUI] [SubprocessWorker] call_id=1 sending call_method
|
|
[ComfyUI] Warning: You are sending unauthenticated requests to the HF Hub. Please set a HF_TOKEN to enable higher rate limits and faster downloads.
|
|
[ComfyUI] [worker:ComfyUI-DepthAnythingV3] WARNING: Warning: You are sending unauthenticated requests to the HF Hub. Please set a HF_TOKEN to enable higher rate limits and faster downloads.
|
|
[ComfyUI]
|
|
Frame 3 saved (frame_002.jpg, t=4.9s)
|
|
[capture-periodic] freeze=4ms shot=198ms unfreeze=11ms saved=True
|
|
[capture-loop] iter=50 t=6.3s state={'complete': False, 'error': None, 'executedCount': 0, 'wsState': 1} eval_ms=4 ram=24.8/31.2GB (80%) swap=19.8/32.0GB (62%) cpu=6% browser_rss=0.85GB
|
|
[ComfyUI] model.safetensors: 0%| | 0.00/1.64G [00:00<?, ?B/s]
|
|
[ComfyUI] model.safetensors: 8%|▊ | 134M/1.64G [00:03<00:39, 38.0MB/s][SubprocessWorker] callback 'report_progress' from call_id=1
|
|
Frame 4 saved (frame_003.jpg, t=9.4s)
|
|
[capture-periodic] freeze=4ms shot=195ms unfreeze=6ms saved=True
|
|
[capture-loop] iter=100 t=12.4s state={'complete': False, 'error': None, 'executedCount': 0, 'wsState': 1} eval_ms=4 ram=24.8/31.2GB (79%) swap=20.2/32.0GB (63%) cpu=9% browser_rss=0.85GB
|
|
[capture-loop] iter=150 t=18.1s state={'complete': False, 'error': None, 'executedCount': 0, 'wsState': 1} eval_ms=4 ram=25.1/31.2GB (81%) swap=20.3/32.0GB (64%) cpu=6% browser_rss=0.85GB
|
|
[capture-loop] iter=200 t=24.1s state={'complete': False, 'error': None, 'executedCount': 0, 'wsState': 1} eval_ms=3 ram=25.1/31.2GB (81%) swap=20.5/32.0GB (64%) cpu=4% browser_rss=0.78GB
|
|
[ComfyUI]
|
|
[capture-loop] iter=250 t=30.0s state={'complete': False, 'error': None, 'executedCount': 0, 'wsState': 1} eval_ms=4 ram=25.2/31.2GB (81%) swap=20.5/32.0GB (64%) cpu=3% browser_rss=0.78GB
|
|
[capture-loop] iter=300 t=35.7s state={'complete': False, 'error': None, 'executedCount': 0, 'wsState': 1} eval_ms=4 ram=24.9/31.2GB (80%) swap=20.6/32.0GB (64%) cpu=3% browser_rss=0.78GB
|
|
[ComfyUI] model.safetensors: 8%|▊ | 134M/1.64G [00:19<00:39, 38.0MB/s]
|
|
[ComfyUI] model.safetensors: 33%|███▎ | 537M/1.64G [00:31<01:08, 16.2MB/s][SubprocessWorker] callback 'report_progress' from call_id=1
|
|
Frame 5 saved (frame_004.jpg, t=36.3s)
|
|
[capture-periodic] freeze=4ms shot=191ms unfreeze=5ms saved=True
|
|
[capture-loop] iter=350 t=41.7s state={'complete': False, 'error': None, 'executedCount': 0, 'wsState': 1} eval_ms=4 ram=24.7/31.2GB (79%) swap=20.6/32.0GB (64%) cpu=3% browser_rss=0.78GB
|
|
[capture-loop] iter=400 t=47.4s state={'complete': False, 'error': None, 'executedCount': 0, 'wsState': 1} eval_ms=4 ram=24.8/31.2GB (80%) swap=20.6/32.0GB (64%) cpu=2% browser_rss=0.78GB
|
|
[capture-loop] iter=450 t=53.4s state={'complete': False, 'error': None, 'executedCount': 0, 'wsState': 1} eval_ms=4 ram=24.3/31.2GB (78%) swap=20.9/32.0GB (65%) cpu=3% browser_rss=0.78GB
|
|
[ComfyUI]
|
|
[ComfyUI] model.safetensors: 100%|██████████| 1.64G/1.64G [00:49<00:00, 37.1MB/s][SubprocessWorker] callback 'report_progress' from call_id=1
|
|
[ComfyUI]
|
|
[ComfyUI] model.safetensors: 100%|██████████| 1.64G/1.64G [00:49<00:00, 33.2MB/s]
|
|
[ComfyUI] [SubprocessWorker] got response: ok
|
|
[ComfyUI] [comfy-env] DownloadAndLoadDepthAnythingV3Model done (53.29s): result: NodeOutput
|
|
[ComfyUI] [VRAM] After DownloadAndLoadDepthAnythingV3Model: 22614 / 24124 MB
|
|
[ComfyUI] [comfy-env] Running DepthAnything_V3: normalization_mode: 'V2-Style', resize_method: 'resize', invert_depth: False, keep_model_size: False, da3_model: dict, images: torch.float32 [1,683,1024,3] cpu
|
|
[ComfyUI] [VRAM] Before DepthAnything_V3: 22614 / 24124 MB
|
|
[ComfyUI] [SubprocessWorker] call_method: nodes.nodes_inference.DepthAnything_V3.EXECUTE_NORMALIZED
|
|
[ComfyUI] [SubprocessWorker] acquired lock, ensuring started...
|
|
[ComfyUI] [ComfyUI-DepthAnythingV3] Health check: ping (timeout=5.0s)...
|
|
[ComfyUI] [ComfyUI-DepthAnythingV3] Health check: ok
|
|
[ComfyUI] [SubprocessWorker] worker started/confirmed
|
|
[ComfyUI] [comfy-env] PRE-SERIALIZE 'images' shape: torch.Size([1, 683, 1024, 3])
|
|
[ComfyUI] [SubprocessWorker] serializing kwargs to shm...
|
|
[ComfyUI] [SubprocessWorker] created 0 shm blocks
|
|
[ComfyUI] [SubprocessWorker] sending request via socket...
|
|
[ComfyUI] [SubprocessWorker] call_id=2 sending call_method
|
|
[ComfyUI] [worker:ComfyUI-DepthAnythingV3] [comfy-env] _from_shm got dict with keys: ['__type__', 'strategy', 'parent_pid', 'fd', 'storage_size']
|
|
[ComfyUI] [worker:ComfyUI-DepthAnythingV3] [comfy-env] DESERIALIZE TensorRef: tensor_size=[1, 683, 1024, 3]
|
|
[ComfyUI] [worker:ComfyUI-DepthAnythingV3] [comfy-env] DESERIALIZED tensor shape: torch.Size([1, 683, 1024, 3])
|
|
[ComfyUI] [worker:ComfyUI-DepthAnythingV3] WARNING: No comfy kitchen, using old apply_rope functions.
|
|
Frame 6 saved (frame_005.jpg, t=54.2s)
|
|
[capture-periodic] freeze=2ms shot=159ms unfreeze=7ms saved=True
|
|
[capture-loop] iter=500 t=59.3s state={'complete': False, 'error': None, 'executedCount': 0, 'wsState': 1} eval_ms=3 ram=23.5/31.2GB (75%) swap=21.0/32.0GB (66%) cpu=7% browser_rss=0.78GB
|
|
[ComfyUI] [SubprocessWorker] callback 'request_vram_budget' from call_id=2
|
|
[ComfyUI] [comfy-env] VRAM request: 0.82GB, free before eviction: 1.58GB
|
|
[ComfyUI] [comfy-env] VRAM after eviction: 1.58GB
|
|
[ComfyUI] [worker:ComfyUI-DepthAnythingV3]
|
|
[ComfyUI] === WATCHDOG TICK 1 ===
|
|
[ComfyUI] [worker:ComfyUI-DepthAnythingV3] Thread 0x00007e0653e76640 (most recent call first):
|
|
[ComfyUI] File "/root/.ce/.pixi/envs/depthanythingv3-nodes/lib/python3.11/threading.py", line 331 in wait
|
|
[ComfyUI] File "/root/.ce/.pixi/envs/depthanythingv3-nodes/lib/python3.11/threading.py", line 629 in wait
|
|
[ComfyUI] File "/root/.ce/.pixi/envs/depthanythingv3-nodes/lib/python3.11/site-packages/tqdm/_monitor.py", line 60 in run
|
|
[ComfyUI] File "/root/.ce/.pixi/envs/depthanythingv3-nodes/lib/python3.11/threading.py", line 1045 in _bootstrap_inner
|
|
[ComfyUI] File "/root/.ce/.pixi/envs/depthanythingv3-nodes/lib/python3.11/threading.py", line 1002 in _bootstrap
|
|
[ComfyUI]
|
|
[ComfyUI] Thread 0x00007e080a39a640 (most recent call first):
|
|
[ComfyUI] File "/tmp/comfyui_pvenv_c1iflygq/persistent_worker.py", line 106 in _vram_poller
|
|
[ComfyUI] File "/root/.ce/.pixi/envs/depthanythingv3-nodes/lib/python3.11/threading.py", line 982 in run
|
|
[ComfyUI] File "/root/.ce/.pixi/envs/depthanythingv3-nodes/lib/python3.11/threading.py", line 1045 in _bootstrap_inner
|
|
[ComfyUI] File "/root/.ce/.pixi/envs/depthanythingv3-nodes/lib/python3.11/threading.py", line 1002 in _bootstrap
|
|
[ComfyUI]
|
|
[ComfyUI] Current thread 0x00007e080ab9f640 (most recent call first):
|
|
[ComfyUI] File "/tmp/comfyui_pvenv_c1iflygq/persistent_worker.py", line 52 in _watchdog
|
|
[ComfyUI] File "/root/.ce/.pixi/envs/depthanythingv3-nodes/lib/python3.11/threading.py", line 982 in run
|
|
[ComfyUI] File "/root/.ce/.pixi/envs/depthanythingv3-nodes/lib/python3.11/threading.py", line 1045 in _bootstrap_inner
|
|
[ComfyUI] File "/root/.ce/.pixi/envs/depthanythingv3-nodes/lib/python3.11/threading.py", line 1002 in _bootstrap
|
|
[ComfyUI]
|
|
[ComfyUI] Thread 0x00007e080b1bf740 (most recent call first):
|
|
[ComfyUI] File "/workspaces/DepthAnythingV3-1231/ComfyUI/comfy/model_management.py", line 1388 in pin_memory
|
|
[ComfyUI] File "/workspaces/DepthAnythingV3-1231/ComfyUI/comfy/model_patcher.py", line 765 in pin_weight_to_device
|
|
[ComfyUI] File "/workspaces/DepthAnythingV3-1231/ComfyUI/comfy/model_patcher.py", line 922 in load
|
|
[ComfyUI] File "/workspaces/DepthAnythingV3-1231/ComfyUI/comfy/model_patcher.py", line 1110 in partially_load
|
|
[ComfyUI] File "/workspaces/DepthAnythingV3-1231/ComfyUI/comfy/model_management.py", line 607 in model_use_more_vram
|
|
[ComfyUI] File "/workspaces/DepthAnythingV3-1231/ComfyUI/comfy/model_management.py", line 579 in model_load
|
|
[ComfyUI] File "/workspaces/DepthAnythingV3-1231/ComfyUI/comfy/model_management.py", line 817 in load_models_gpu
|
|
[ComfyUI] File "/tmp/comfyui_pvenv_c1iflygq/persistent_worker.py", line 1539 in _shimmed_load_models_gpu
|
|
[ComfyUI] File "/workspaces/DepthAnythingV3-1231/ComfyUI/custom_nodes/ComfyUI-DepthAnythingV3/nodes/nodes_inference.py", line 89 in execute
|
|
[ComfyUI] File "/workspaces/DepthAnythingV3-1231/ComfyUI/comfy_api/latest/_io.py", line 1833 in EXECUTE_NORMALIZED
|
|
[ComfyUI] File "/tmp/comfyui_pvenv_c1iflygq/persistent_worker.py", line 1762 in main
|
|
[ComfyUI] File "/tmp/comfyui_pvenv_c1iflygq/persistent_worker.py", line 1807 in <module>
|
|
[ComfyUI]
|
|
[ComfyUI] [worker:ComfyUI-DepthAnythingV3] === END ===
|
|
[ComfyUI]
|
|
[ComfyUI] [worker:ComfyUI-DepthAnythingV3] [VRAM] +267MB (now 267MB) reserved=288MB peak=267MB
|
|
[ComfyUI] [worker:ComfyUI-DepthAnythingV3] WARNING: WARNING: This model does not support sky segmentation. V2-Style normalization will work but without sky masking. Use Mono/Metric/Nested models for best V2-Style results.
|
|
[ComfyUI] [worker:ComfyUI-DepthAnythingV3] [VRAM] +324MB (now 591MB) reserved=736MB peak=591MB
|
|
[ComfyUI] [SubprocessWorker] got response: error
|
|
[ComfyUI] !!! Exception during processing !!! Allocation on device 0 would exceed allowed memory. (out of memory)
|
|
[ComfyUI] Currently allocated : 936.80 MiB
|
|
[ComfyUI] Requested : 223.56 MiB
|
|
[ComfyUI] Device limit : 23.56 GiB
|
|
[ComfyUI] Free (according to CUDA): 18.25 MiB
|
|
[ComfyUI] PyTorch limit (set by user-supplied memory fraction)
|
|
[ComfyUI] : 17179869184.00 GiB
|
|
[ComfyUI]
|
|
[ComfyUI] Worker traceback:
|
|
[ComfyUI] Traceback (most recent call last):
|
|
[ComfyUI] File "/tmp/comfyui_pvenv_c1iflygq/persistent_worker.py", line 1762, in main
|
|
[ComfyUI] result = method(**inputs)
|
|
[ComfyUI] ^^^^^^^^^^^^^^^^
|
|
[ComfyUI] File "/workspaces/DepthAnythingV3-1231/ComfyUI/comfy_api/latest/_io.py", line 1833, in EXECUTE_NORMALIZED
|
|
[ComfyUI] to_return = cls.execute(*args, **kwargs)
|
|
[ComfyUI] ^^^^^^^^^^^^^^^^^^^^^^^^^^^^
|
|
[ComfyUI] File "/workspaces/DepthAnythingV3-1231/ComfyUI/custom_nodes/ComfyUI-DepthAnythingV3/nodes/nodes_inference.py", line 156, in execute
|
|
[ComfyUI] output = model(img, extrinsics=ext_i, intrinsics=int_i, infer_gs=infer_gs)
|
|
[ComfyUI] ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
|
|
[ComfyUI] File "/root/.ce/.pixi/envs/depthanythingv3-nodes/lib/python3.11/site-packages/torch/nn/modules/module.py", line 1779, in _wrapped_call_impl
|
|
[ComfyUI] return self._call_impl(*args, **kwargs)
|
|
[ComfyUI] ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
|
|
[ComfyUI] File "/root/.ce/.pixi/envs/depthanythingv3-nodes/lib/python3.11/site-packages/torch/nn/modules/module.py", line 1790, in _call_impl
|
|
[ComfyUI] return forward_call(*args, **kwargs)
|
|
[ComfyUI] ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
|
|
[ComfyUI] File "/workspaces/DepthAnythingV3-1231/ComfyUI/custom_nodes/ComfyUI-DepthAnythingV3/nodes/depth_anything_v3/model.py", line 1577, in forward
|
|
[ComfyUI] output = self._process_depth_head(feats, H, W)
|
|
[ComfyUI] ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
|
|
[ComfyUI] File "/workspaces/DepthAnythingV3-1231/ComfyUI/custom_nodes/ComfyUI-DepthAnythingV3/nodes/depth_anything_v3/model.py", line 1591, in _process_depth_head
|
|
[ComfyUI] return self.head(feats, H, W, patch_start_idx=0)
|
|
[ComfyUI] ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
|
|
[ComfyUI] File "/root/.ce/.pixi/envs/depthanythingv3-nodes/lib/python3.11/site-packages/torch/nn/modules/module.py", line 1779, in _wrapped_call_impl
|
|
[ComfyUI] return self._call_impl(*args, **kwargs)
|
|
[ComfyUI] ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
|
|
[ComfyUI] File "/root/.ce/.pixi/envs/depthanythingv3-nodes/lib/python3.11/site-packages/torch/nn/modules/module.py", line 1790, in _call_impl
|
|
[capture-loop] iter=550 t=65.1s state={'complete': False, 'error': None, 'executedCount': 0, 'wsState': 1} eval_ms=3 ram=24.0/31.2GB (77%) swap=21.6/32.0GB (67%) cpu=5% browser_rss=0.78GB
|
|
[ComfyUI] return forward_call(*args, **kwargs)
|
|
[ComfyUI] ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
|
|
[ComfyUI] File "/workspaces/DepthAnythingV3-1231/ComfyUI/custom_nodes/ComfyUI-DepthAnythingV3/nodes/depth_anything_v3/model.py", line 1366, in forward
|
|
[ComfyUI] out_dict = self._forward_impl(feats, H, W, patch_start_idx)
|
|
[ComfyUI] ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
|
|
[ComfyUI] File "/workspaces/DepthAnythingV3-1231/ComfyUI/custom_nodes/ComfyUI-DepthAnythingV3/nodes/depth_anything_v3/model.py", line 1405, in _forward_impl
|
|
[ComfyUI] fused_main, fused_aux_pyr = self._fuse(resized_feats)
|
|
[ComfyUI] ^^^^^^^^^^^^^^^^^^^^^^^^^
|
|
[ComfyUI] File "/workspaces/DepthAnythingV3-1231/ComfyUI/custom_nodes/ComfyUI-DepthAnythingV3/nodes/depth_anything_v3/model.py", line 1465, in _fuse
|
|
[ComfyUI] out = self.scratch.refinenet1(out, l1_rn)
|
|
[ComfyUI] ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
|
|
[ComfyUI] File "/root/.ce/.pixi/envs/depthanythingv3-nodes/lib/python3.11/site-packages/torch/nn/modules/module.py", line 1779, in _wrapped_call_impl
|
|
[ComfyUI] return self._call_impl(*args, **kwargs)
|
|
[ComfyUI] ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
|
|
[ComfyUI] File "/root/.ce/.pixi/envs/depthanythingv3-nodes/lib/python3.11/site-packages/torch/nn/modules/module.py", line 1790, in _call_impl
|
|
[ComfyUI] return forward_call(*args, **kwargs)
|
|
[ComfyUI] ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
|
|
[ComfyUI] File "/workspaces/DepthAnythingV3-1231/ComfyUI/custom_nodes/ComfyUI-DepthAnythingV3/nodes/depth_anything_v3/model.py", line 973, in forward
|
|
[ComfyUI] y = self.out_conv(y)
|
|
[ComfyUI] ^^^^^^^^^^^^^^^^
|
|
[ComfyUI] File "/root/.ce/.pixi/envs/depthanythingv3-nodes/lib/python3.11/site-packages/torch/nn/modules/module.py", line 1779, in _wrapped_call_impl
|
|
[ComfyUI] return self._call_impl(*args, **kwargs)
|
|
[ComfyUI] ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
|
|
[ComfyUI] File "/root/.ce/.pixi/envs/depthanythingv3-nodes/lib/python3.11/site-packages/torch/nn/modules/module.py", line 1790, in _call_impl
|
|
[ComfyUI] return forward_call(*args, **kwargs)
|
|
[ComfyUI] ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
|
|
[ComfyUI] File "/workspaces/DepthAnythingV3-1231/ComfyUI/comfy/ops.py", line 516, in forward
|
|
[ComfyUI] return self.forward_comfy_cast_weights(*args, **kwargs)
|
|
[ComfyUI] ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
|
|
[ComfyUI] File "/workspaces/DepthAnythingV3-1231/ComfyUI/comfy/ops.py", line 509, in forward_comfy_cast_weights
|
|
[ComfyUI] x = self._conv_forward(input, weight, bias)
|
|
[ComfyUI] ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
|
|
[ComfyUI] File "/root/.ce/.pixi/envs/depthanythingv3-nodes/lib/python3.11/site-packages/torch/nn/modules/conv.py", line 548, in _conv_forward
|
|
[ComfyUI] return F.conv2d(
|
|
[ComfyUI] ^^^^^^^^^
|
|
[ComfyUI] torch.OutOfMemoryError: Allocation on device 0 would exceed allowed memory. (out of memory)
|
|
[ComfyUI] Currently allocated : 936.80 MiB
|
|
[ComfyUI] Requested : 223.56 MiB
|
|
[ComfyUI] Device limit : 23.56 GiB
|
|
[ComfyUI] Free (according to CUDA): 18.25 MiB
|
|
[ComfyUI] PyTorch limit (set by user-supplied memory fraction)
|
|
[ComfyUI] : 17179869184.00 GiB
|
|
[ComfyUI]
|
|
[ComfyUI] Traceback (most recent call last):
|
|
[ComfyUI] File "/workspaces/DepthAnythingV3-1231/ComfyUI/execution.py", line 535, in execute
|
|
[ComfyUI] output_data, output_ui, has_subgraph, has_pending_tasks = await get_output_data(prompt_id, unique_id, obj, input_data_all, execution_block_cb=execution_block_cb, pre_execute_cb=pre_execute_cb, v3_data=v3_data)
|
|
[ComfyUI] ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
|
|
[ComfyUI] File "/workspaces/DepthAnythingV3-1231/ComfyUI/execution.py", line 335, in get_output_data
|
|
[ComfyUI] return_values = await _async_map_node_over_list(prompt_id, unique_id, obj, input_data_all, obj.FUNCTION, allow_interrupt=True, execution_block_cb=execution_block_cb, pre_execute_cb=pre_execute_cb, v3_data=v3_data)
|
|
[ComfyUI] ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
|
|
[ComfyUI] File "/workspaces/DepthAnythingV3-1231/ComfyUI/execution.py", line 309, in _async_map_node_over_list
|
|
[ComfyUI] await process_inputs(input_dict, i)
|
|
[ComfyUI] File "/workspaces/DepthAnythingV3-1231/ComfyUI/execution.py", line 297, in process_inputs
|
|
[ComfyUI] result = f(**inputs)
|
|
[ComfyUI] ^^^^^^^^^^^
|
|
[ComfyUI] File "/workspaces/DepthAnythingV3-1231/.venv/lib/python3.11/site-packages/comfy_env/isolation/metadata.py", line 556, in proxy
|
|
[ComfyUI] result = worker.call_method(
|
|
[ComfyUI] ^^^^^^^^^^^^^^^^^^^
|
|
[ComfyUI] File "/workspaces/DepthAnythingV3-1231/.venv/lib/python3.11/site-packages/comfy_env/isolation/workers/subprocess.py", line 674, in call_method
|
|
[ComfyUI] raise WorkerError(
|
|
[ComfyUI] comfy_env.isolation.workers.base.WorkerError: Allocation on device 0 would exceed allowed memory. (out of memory)
|
|
[ComfyUI] Currently allocated : 936.80 MiB
|
|
[ComfyUI] Requested : 223.56 MiB
|
|
[ComfyUI] Device limit : 23.56 GiB
|
|
[ComfyUI] Free (according to CUDA): 18.25 MiB
|
|
[ComfyUI] PyTorch limit (set by user-supplied memory fraction)
|
|
[ComfyUI] : 17179869184.00 GiB
|
|
[ComfyUI]
|
|
[ComfyUI] Worker traceback:
|
|
[ComfyUI] Traceback (most recent call last):
|
|
[ComfyUI] File "/tmp/comfyui_pvenv_c1iflygq/persistent_worker.py", line 1762, in main
|
|
[ComfyUI] result = method(**inputs)
|
|
[ComfyUI] ^^^^^^^^^^^^^^^^
|
|
[ComfyUI] File "/workspaces/DepthAnythingV3-1231/ComfyUI/comfy_api/latest/_io.py", line 1833, in EXECUTE_NORMALIZED
|
|
[ComfyUI] to_return = cls.execute(*args, **kwargs)
|
|
[ComfyUI] ^^^^^^^^^^^^^^^^^^^^^^^^^^^^
|
|
[ComfyUI] File "/workspaces/DepthAnythingV3-1231/ComfyUI/custom_nodes/ComfyUI-DepthAnythingV3/nodes/nodes_inference.py", line 156, in execute
|
|
[ComfyUI] output = model(img, extrinsics=ext_i, intrinsics=int_i, infer_gs=infer_gs)
|
|
[ComfyUI] ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
|
|
[ComfyUI] File "/root/.ce/.pixi/envs/depthanythingv3-nodes/lib/python3.11/site-packages/torch/nn/modules/module.py", line 1779, in _wrapped_call_impl
|
|
[ComfyUI] return self._call_impl(*args, **kwargs)
|
|
[ComfyUI] ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
|
|
[ComfyUI] File "/root/.ce/.pixi/envs/depthanythingv3-nodes/lib/python3.11/site-packages/torch/nn/modules/module.py", line 1790, in _call_impl
|
|
[ComfyUI] return forward_call(*args, **kwargs)
|
|
[ComfyUI] ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
|
|
[ComfyUI] File "/workspaces/DepthAnythingV3-1231/ComfyUI/custom_nodes/ComfyUI-DepthAnythingV3/nodes/depth_anything_v3/model.py", line 1577, in forward
|
|
[ComfyUI] output = self._process_depth_head(feats, H, W)
|
|
[ComfyUI] ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
|
|
[ComfyUI] File "/workspaces/DepthAnythingV3-1231/ComfyUI/custom_nodes/ComfyUI-DepthAnythingV3/nodes/depth_anything_v3/model.py", line 1591, in _process_depth_head
|
|
[ComfyUI] return self.head(feats, H, W, patch_start_idx=0)
|
|
[ComfyUI] ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
|
|
[ComfyUI] File "/root/.ce/.pixi/envs/depthanythingv3-nodes/lib/python3.11/site-packages/torch/nn/modules/module.py", line 1779, in _wrapped_call_impl
|
|
[ComfyUI] return self._call_impl(*args, **kwargs)
|
|
[ComfyUI] ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
|
|
[ComfyUI] File "/root/.ce/.pixi/envs/depthanythingv3-nodes/lib/python3.11/site-packages/torch/nn/modules/module.py", line 1790, in _call_impl
|
|
[ComfyUI] return forward_call(*args, **kwargs)
|
|
[ComfyUI] ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
|
|
[ComfyUI] File "/workspaces/DepthAnythingV3-1231/ComfyUI/custom_nodes/ComfyUI-DepthAnythingV3/nodes/depth_anything_v3/model.py", line 1366, in forward
|
|
[ComfyUI] out_dict = self._forward_impl(feats, H, W, patch_start_idx)
|
|
[ComfyUI] ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
|
|
[ComfyUI] File "/workspaces/DepthAnythingV3-1231/ComfyUI/custom_nodes/ComfyUI-DepthAnythingV3/nodes/depth_anything_v3/model.py", line 1405, in _forward_impl
|
|
[ComfyUI] fused_main, fused_aux_pyr = self._fuse(resized_feats)
|
|
[ComfyUI] ^^^^^^^^^^^^^^^^^^^^^^^^^
|
|
[ComfyUI] File "/workspaces/DepthAnythingV3-1231/ComfyUI/custom_nodes/ComfyUI-DepthAnythingV3/nodes/depth_anything_v3/model.py", line 1465, in _fuse
|
|
[ComfyUI] out = self.scratch.refinenet1(out, l1_rn)
|
|
[ComfyUI] ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
|
|
[ComfyUI] File "/root/.ce/.pixi/envs/depthanythingv3-nodes/lib/python3.11/site-packages/torch/nn/modules/module.py", line 1779, in _wrapped_call_impl
|
|
[ComfyUI] return self._call_impl(*args, **kwargs)
|
|
[ComfyUI] ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
|
|
[ComfyUI] File "/root/.ce/.pixi/envs/depthanythingv3-nodes/lib/python3.11/site-packages/torch/nn/modules/module.py", line 1790, in _call_impl
|
|
[ComfyUI] return forward_call(*args, **kwargs)
|
|
[ComfyUI] ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
|
|
[ComfyUI] File "/workspaces/DepthAnythingV3-1231/ComfyUI/custom_nodes/ComfyUI-DepthAnythingV3/nodes/depth_anything_v3/model.py", line 973, in forward
|
|
[ComfyUI] y = self.out_conv(y)
|
|
[ComfyUI] ^^^^^^^^^^^^^^^^
|
|
[ComfyUI] File "/root/.ce/.pixi/envs/depthanythingv3-nodes/lib/python3.11/site-packages/torch/nn/modules/module.py", line 1779, in _wrapped_call_impl
|
|
[ComfyUI] return self._call_impl(*args, **kwargs)
|
|
[ComfyUI] ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
|
|
[ComfyUI] File "/root/.ce/.pixi/envs/depthanythingv3-nodes/lib/python3.11/site-packages/torch/nn/modules/module.py", line 1790, in _call_impl
|
|
[ComfyUI] return forward_call(*args, **kwargs)
|
|
[ComfyUI] ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
|
|
[ComfyUI] File "/workspaces/DepthAnythingV3-1231/ComfyUI/comfy/ops.py", line 516, in forward
|
|
[ComfyUI] return self.forward_comfy_cast_weights(*args, **kwargs)
|
|
[ComfyUI] ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
|
|
[ComfyUI] File "/workspaces/DepthAnythingV3-1231/ComfyUI/comfy/ops.py", line 509, in forward_comfy_cast_weights
|
|
[ComfyUI] x = self._conv_forward(input, weight, bias)
|
|
[ComfyUI] ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
|
|
[ComfyUI] File "/root/.ce/.pixi/envs/depthanythingv3-nodes/lib/python3.11/site-packages/torch/nn/modules/conv.py", line 548, in _conv_forward
|
|
[ComfyUI] return F.conv2d(
|
|
[ComfyUI] ^^^^^^^^^
|
|
[ComfyUI] torch.OutOfMemoryError: Allocation on device 0 would exceed allowed memory. (out of memory)
|
|
[ComfyUI] Currently allocated : 936.80 MiB
|
|
[ComfyUI] Requested : 223.56 MiB
|
|
[ComfyUI] Device limit : 23.56 GiB
|
|
[ComfyUI] Free (according to CUDA): 18.25 MiB
|
|
[ComfyUI] PyTorch limit (set by user-supplied memory fraction)
|
|
[ComfyUI] : 17179869184.00 GiB
|
|
[ComfyUI]
|
|
[ComfyUI]
|
|
[ComfyUI] Prompt executed in 64.60 seconds
|
|
Frame 7 saved (frame_006.jpg, t=65.3s)
|
|
[capture-periodic] freeze=3ms shot=276ms unfreeze=3ms saved=True
|
|
Execution complete (t=65.8s)
|
|
Execution error: {'prompt_id': 'e0c035eb-f05f-41eb-84c6-6805d60bdad1', 'node_id': '12', 'node_type': 'DepthAnything_V3', 'executed': ['3', '2'], 'exception_message': 'Allocation on device 0 would exceed allowed memory. (out of memory)\nCurrently allocated : 936.80 MiB\nRequested : 223.56 MiB\nDevice limit : 23.56 GiB\nFree (according to CUDA): 18.25 MiB\nPyTorch limit (set by user-supplied memory fraction)\n : 17179869184.00 GiB\n\nWorker traceback:\nTraceback (most recent call last):\n File "/tmp/comfyui_pvenv_c1iflygq/persistent_worker.py", line 1762, in main\n result = method(**inputs)\n ^^^^^^^^^^^^^^^^\n File "/workspaces/DepthAnythingV3-1231/ComfyUI/comfy_api/latest/_io.py", line 1833, in EXECUTE_NORMALIZED\n to_return = cls.execute(*args, **kwargs)\n ^^^^^^^^^^^^^^^^^^^^^^^^^^^^\n File "/workspaces/DepthAnythingV3-1231/ComfyUI/custom_nodes/ComfyUI-DepthAnythingV3/nodes/nodes_inference.py", line 156, in execute\n output = model(img, extrinsics=ext_i, intrinsics=int_i, infer_gs=infer_gs)\n ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^\n File "/root/.ce/.pixi/envs/depthanythingv3-nodes/lib/python3.11/site-packages/torch/nn/modules/module.py", line 1779, in _wrapped_call_impl\n return self._call_impl(*args, **kwargs)\n ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^\n File "/root/.ce/.pixi/envs/depthanythingv3-nodes/lib/python3.11/site-packages/torch/nn/modules/module.py", line 1790, in _call_impl\n return forward_call(*args, **kwargs)\n ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^\n File "/workspaces/DepthAnythingV3-1231/ComfyUI/custom_nodes/ComfyUI-DepthAnythingV3/nodes/depth_anything_v3/model.py", line 1577, in forward\n output = self._process_depth_head(feats, H, W)\n ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^\n File "/workspaces/DepthAnythingV3-1231/ComfyUI/custom_nodes/ComfyUI-DepthAnythingV3/nodes/depth_anything_v3/model.py", line 1591, in _process_depth_head\n return self.head(feats, H, W, patch_start_idx=0)\n ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^\n File "/root/.ce/.pixi/envs/depthanythingv3-nodes/lib/python3.11/site-packages/torch/nn/modules/module.py", line 1779, in _wrapped_call_impl\n return self._call_impl(*args, **kwargs)\n ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^\n File "/root/.ce/.pixi/envs/depthanythingv3-nodes/lib/python3.11/site-packages/torch/nn/modules/module.py", line 1790, in _call_impl\n return forward_call(*args, **kwargs)\n ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^\n File "/workspaces/DepthAnythingV3-1231/ComfyUI/custom_nodes/ComfyUI-DepthAnythingV3/nodes/depth_anything_v3/model.py", line 1366, in forward\n out_dict = self._forward_impl(feats, H, W, patch_start_idx)\n ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^\n File "/workspaces/DepthAnythingV3-1231/ComfyUI/custom_nodes/ComfyUI-DepthAnythingV3/nodes/depth_anything_v3/model.py", line 1405, in _forward_impl\n fused_main, fused_aux_pyr = self._fuse(resized_feats)\n ^^^^^^^^^^^^^^^^^^^^^^^^^\n File "/workspaces/DepthAnythingV3-1231/ComfyUI/custom_nodes/ComfyUI-DepthAnythingV3/nodes/depth_anything_v3/model.py", line 1465, in _fuse\n out = self.scratch.refinenet1(out, l1_rn)\n ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^\n File "/root/.ce/.pixi/envs/depthanythingv3-nodes/lib/python3.11/site-packages/torch/nn/modules/module.py", line 1779, in _wrapped_call_impl\n return self._call_impl(*args, **kwargs)\n ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^\n File "/root/.ce/.pixi/envs/depthanythingv3-nodes/lib/python3.11/site-packages/torch/nn/modules/module.py", line 1790, in _call_impl\n return forward_call(*args, **kwargs)\n ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^\n File "/workspaces/DepthAnythingV3-1231/ComfyUI/custom_nodes/ComfyUI-DepthAnythingV3/nodes/depth_anything_v3/model.py", line 973, in forward\n y = self.out_conv(y)\n ^^^^^^^^^^^^^^^^\n File "/root/.ce/.pixi/envs/depthanythingv3-nodes/lib/python3.11/site-packages/torch/nn/modules/module.py", line 1779, in _wrapped_call_impl\n return self._call_impl(*args, **kwargs)\n ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^\n File "/root/.ce/.pixi/envs/depthanythingv3-nodes/lib/python3.11/site-packages/torch/nn/modules/module.py", line 1790, in _call_impl\n return forward_call(*args, **kwargs)\n ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^\n File "/workspaces/DepthAnythingV3-1231/ComfyUI/comfy/ops.py", line 516, in forward\n return self.forward_comfy_cast_weights(*args, **kwargs)\n ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^\n File "/workspaces/DepthAnythingV3-1231/ComfyUI/comfy/ops.py", line 509, in forward_comfy_cast_weights\n x = self._conv_forward(input, weight, bias)\n ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^\n File "/root/.ce/.pixi/envs/depthanythingv3-nodes/lib/python3.11/site-packages/torch/nn/modules/conv.py", line 548, in _conv_forward\n return F.conv2d(\n ^^^^^^^^^\ntorch.OutOfMemoryError: Allocation on device 0 would exceed allowed memory. (out of memory)\nCurrently allocated : 936.80 MiB\nRequested : 223.56 MiB\nDevice limit : 23.56 GiB\nFree (according to CUDA): 18.25 MiB\nPyTorch limit (set by user-supplied memory fraction)\n : 17179869184.00 GiB\n\n', 'exception_type': 'comfy_env.isolation.workers.base.WorkerError', 'traceback': [' File "/workspaces/DepthAnythingV3-1231/ComfyUI/execution.py", line 535, in execute\n output_data, output_ui, has_subgraph, has_pending_tasks = await get_output_data(prompt_id, unique_id, obj, input_data_all, execution_block_cb=execution_block_cb, pre_execute_cb=pre_execute_cb, v3_data=v3_data)\n ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^\n', ' File "/workspaces/DepthAnythingV3-1231/ComfyUI/execution.py", line 335, in get_output_data\n return_values = await _async_map_node_over_list(prompt_id, unique_id, obj, input_data_all, obj.FUNCTION, allow_interrupt=True, execution_block_cb=execution_block_cb, pre_execute_cb=pre_execute_cb, v3_data=v3_data)\n ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^\n', ' File "/workspaces/DepthAnythingV3-1231/ComfyUI/execution.py", line 309, in _async_map_node_over_list\n await process_inputs(input_dict, i)\n', ' File "/workspaces/DepthAnythingV3-1231/ComfyUI/execution.py", line 297, in process_inputs\n result = f(**inputs)\n ^^^^^^^^^^^\n', ' File "/workspaces/DepthAnythingV3-1231/.venv/lib/python3.11/site-packages/comfy_env/isolation/metadata.py", line 556, in proxy\n result = worker.call_method(\n ^^^^^^^^^^^^^^^^^^^\n', ' File "/workspaces/DepthAnythingV3-1231/.venv/lib/python3.11/site-packages/comfy_env/isolation/workers/subprocess.py", line 674, in call_method\n raise WorkerError(\n'], 'current_inputs': {'normalization_mode': ['V2-Style'], 'resize_method': ['resize'], 'invert_depth': [False], 'keep_model_size': [False], 'da3_model': ["{'model_path': '/workspaces/DepthAnythingV3-1231/ComfyUI/models/depthanything3/da3_large.safetensors', 'model_key': 'da3-large', 'dtype': 'bf16', 'attention': 'auto'}"], 'images': ['tensor([[[[0.0000, 0.0000, 0.0000],\n [0.0000, 0.0000, 0.0000],\n [0.0000, 0.0000, 0.0000],\n ...,\n [0.0000, 0.0000, 0.0000],\n [0.0000, 0.0000, 0.0000],\n [0.0000, 0.0000, 0.0000]],\n\n [[0.0000, 0.0000, 0.0000],\n [0.0000, 0.0000, 0.0000],\n [0.0000, 0.0000, 0.0000],\n ...,\n [0.0000, 0.0000, 0.0000],\n [0.0000, 0.0000, 0.0000],\n [0.0000, 0.0000, 0.0000]],\n\n [[0.0000, 0.0000, 0.0000],\n [0.0000, 0.0000, 0.0000],\n [0.0000, 0.0000, 0.0000],\n ...,\n [0.0000, 0.0000, 0.0000],\n [0.0000, 0.0000, 0.0000],\n [0.0000, 0.0000, 0.0000]],\n\n ...,\n\n [[0.1367, 0.1367, 0.1367],\n [0.2500, 0.2500, 0.2500],\n [0.0352, 0.0352, 0.0352],\n ...,\n [0.0000, 0.0000, 0.0000],\n [0.0000, 0.0000, 0.0000],\n [0.0000, 0.0000, 0.0000]],\n\n [[0.1250, 0.1250, 0.1250],\n [0.1602, 0.1602, 0.1602],\n [0.5234, 0.5234, 0.5234],\n ...,\n [0.0000, 0.0000, 0.0000],\n [0.0000, 0.0000, 0.0000],\n [0.0000, 0.0000, 0.0000]],\n\n [[0.0000, 0.0000, 0.0000],\n [0.0195, 0.0195, 0.0195],\n [0.2266, 0.2266, 0.2266],\n ...,\n [0.0000, 0.0000, 0.0000],\n [0.0000, 0.0000, 0.0000],\n [0.0000, 0.0000, 0.0000]]]])']}, 'current_outputs': ['8', '10', '6', '13', '11', '3', '2', '12', '4', '7', '9'], 'timestamp': 1778675945035}
|
|
Status: FAILED
|
|
Error: Workflow execution failed: {'prompt_id': 'e0c035eb-f05f-41eb-84c6-6805d60bdad1', 'node_id': '12', 'node_type': 'DepthAnything_V3', 'executed': ['3', '2'], 'exception_message': 'Allocation on device 0 would exceed allowed memory. (out of memory)\nCurrently allocated : 936.80 MiB\nRequested : 223.56 MiB\nDevice limit : 23.56 GiB\nFree (according to CUDA): 18.25 MiB\nPyTorch limit (set by user-supplied memory fraction)\n : 17179869184.00 GiB\n\nWorker traceback:\nTraceback (most recent call last):\n File "/tmp/comfyui_pvenv_c1iflygq/persistent_worker.py", line 1762, in main\n result = method(**inputs)\n ^^^^^^^^^^^^^^^^\n File "/workspaces/DepthAnythingV3-1231/ComfyUI/comfy_api/latest/_io.py", line 1833, in EXECUTE_NORMALIZED\n to_return = cls.execute(*args, **kwargs)\n ^^^^^^^^^^^^^^^^^^^^^^^^^^^^\n File "/workspaces/DepthAnythingV3-1231/ComfyUI/custom_nodes/ComfyUI-DepthAnythingV3/nodes/nodes_inference.py", line 156, in execute\n output = model(img, extrinsics=ext_i, intrinsics=int_i, infer_gs=infer_gs)\n ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^\n File "/root/.ce/.pixi/envs/depthanythingv3-nodes/lib/python3.11/site-packages/torch/nn/modules/module.py", line 1779, in _wrapped_call_impl\n return self._call_impl(*args, **kwargs)\n ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^\n File "/root/.ce/.pixi/envs/depthanythingv3-nodes/lib/python3.11/site-packages/torch/nn/modules/module.py", line 1790, in _call_impl\n return forward_call(*args, **kwargs)\n ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^\n File "/workspaces/DepthAnythingV3-1231/ComfyUI/custom_nodes/ComfyUI-DepthAnythingV3/nodes/depth_anything_v3/model.py", line 1577, in forward\n output = self._process_depth_head(feats, H, W)\n ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^\n File "/workspaces/DepthAnythingV3-1231/ComfyUI/custom_nodes/ComfyUI-DepthAnythingV3/nodes/depth_anything_v3/model.py", line 1591, in _process_depth_head\n return self.head(feats, H, W, patch_start_idx=0)\n ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^\n File "/root/.ce/.pixi/envs/depthanythingv3-nodes/lib/python3.11/site-packages/torch/nn/modules/module.py", line 1779, in _wrapped_call_impl\n return self._call_impl(*args, **kwargs)\n ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^\n File "/root/.ce/.pixi/envs/depthanythingv3-nodes/lib/python3.11/site-packages/torch/nn/modules/module.py", line 1790, in _call_impl\n return forward_call(*args, **kwargs)\n ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^\n File "/workspaces/DepthAnythingV3-1231/ComfyUI/custom_nodes/ComfyUI-DepthAnythingV3/nodes/depth_anything_v3/model.py", line 1366, in forward\n out_dict = self._forward_impl(feats, H, W, patch_start_idx)\n ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^\n File "/workspaces/DepthAnythingV3-1231/ComfyUI/custom_nodes/ComfyUI-DepthAnythingV3/nodes/depth_anything_v3/model.py", line 1405, in _forward_impl\n fused_main, fused_aux_pyr = self._fuse(resized_feats)\n ^^^^^^^^^^^^^^^^^^^^^^^^^\n File "/workspaces/DepthAnythingV3-1231/ComfyUI/custom_nodes/ComfyUI-DepthAnythingV3/nodes/depth_anything_v3/model.py", line 1465, in _fuse\n out = self.scratch.refinenet1(out, l1_rn)\n ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^\n File "/root/.ce/.pixi/envs/depthanythingv3-nodes/lib/python3.11/site-packages/torch/nn/modules/module.py", line 1779, in _wrapped_call_impl\n return self._call_impl(*args, **kwargs)\n ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^\n File "/root/.ce/.pixi/envs/depthanythingv3-nodes/lib/python3.11/site-packages/torch/nn/modules/module.py", line 1790, in _call_impl\n return forward_call(*args, **kwargs)\n ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^\n File "/workspaces/DepthAnythingV3-1231/ComfyUI/custom_nodes/ComfyUI-DepthAnythingV3/nodes/depth_anything_v3/model.py", line 973, in forward\n y = self.out_conv(y)\n ^^^^^^^^^^^^^^^^\n File "/root/.ce/.pixi/envs/depthanythingv3-nodes/lib/python3.11/site-packages/torch/nn/modules/module.py", line 1779, in _wrapped_call_impl\n return self._call_impl(*args, **kwargs)\n ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^\n File "/root/.ce/.pixi/envs/depthanythingv3-nodes/lib/python3.11/site-packages/torch/nn/modules/module.py", line 1790, in _call_impl\n return forward_call(*args, **kwargs)\n ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^\n File "/workspaces/DepthAnythingV3-1231/ComfyUI/comfy/ops.py", line 516, in forward\n return self.forward_comfy_cast_weights(*args, **kwargs)\n ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^\n File "/workspaces/DepthAnythingV3-1231/ComfyUI/comfy/ops.py", line 509, in forward_comfy_cast_weights\n x = self._conv_forward(input, weight, bias)\n ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^\n File "/root/.ce/.pixi/envs/depthanythingv3-nodes/lib/python3.11/site-packages/torch/nn/modules/conv.py", line 548, in _conv_forward\n return F.conv2d(\n ^^^^^^^^^\ntorch.OutOfMemoryError: Allocation on device 0 would exceed allowed memory. (out of memory)\nCurrently allocated : 936.80 MiB\nRequested : 223.56 MiB\nDevice limit : 23.56 GiB\nFree (according to CUDA): 18.25 MiB\nPyTorch limit (set by user-supplied memory fraction)\n : 17179869184.00 GiB\n\n', 'exception_type': 'comfy_env.isolation.workers.base.WorkerError', 'traceback': [' File "/workspaces/DepthAnythingV3-1231/ComfyUI/execution.py", line 535, in execute\n output_data, output_ui, has_subgraph, has_pending_tasks = await get_output_data(prompt_id, unique_id, obj, input_data_all, execution_block_cb=execution_block_cb, pre_execute_cb=pre_execute_cb, v3_data=v3_data)\n ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^\n', ' File "/workspaces/DepthAnythingV3-1231/ComfyUI/execution.py", line 335, in get_output_data\n return_values = await _async_map_node_over_list(prompt_id, unique_id, obj, input_data_all, obj.FUNCTION, allow_interrupt=True, execution_block_cb=execution_block_cb, pre_execute_cb=pre_execute_cb, v3_data=v3_data)\n ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^\n', ' File "/workspaces/DepthAnythingV3-1231/ComfyUI/execution.py", line 309, in _async_map_node_over_list\n await process_inputs(input_dict, i)\n', ' File "/workspaces/DepthAnythingV3-1231/ComfyUI/execution.py", line 297, in process_inputs\n result = f(**inputs)\n ^^^^^^^^^^^\n', ' File "/workspaces/DepthAnythingV3-1231/.venv/lib/python3.11/site-packages/comfy_env/isolation/metadata.py", line 556, in proxy\n result = worker.call_method(\n ^^^^^^^^^^^^^^^^^^^\n', ' File "/workspaces/DepthAnythingV3-1231/.venv/lib/python3.11/site-packages/comfy_env/isolation/workers/subprocess.py", line 674, in call_method\n raise WorkerError(\n'], 'current_inputs': {'normalization_mode': ['V2-Style'], 'resize_method': ['resize'], 'invert_depth': [False], 'keep_model_size': [False], 'da3_model': ["{'model_path': '/workspaces/DepthAnythingV3-1231/ComfyUI/models/depthanything3/da3_large.safetensors', 'model_key': 'da3-large', 'dtype': 'bf16', 'attention': 'auto'}"], 'images': ['tensor([[[[0.0000, 0.0000, 0.0000],\n [0.0000, 0.0000, 0.0000],\n [0.0000, 0.0000, 0.0000],\n ...,\n [0.0000, 0.0000, 0.0000],\n [0.0000, 0.0000, 0.0000],\n [0.0000, 0.0000, 0.0000]],\n\n [[0.0000, 0.0000, 0.0000],\n [0.0000, 0.0000, 0.0000],\n [0.0000, 0.0000, 0.0000],\n ...,\n [0.0000, 0.0000, 0.0000],\n [0.0000, 0.0000, 0.0000],\n [0.0000, 0.0000, 0.0000]],\n\n [[0.0000, 0.0000, 0.0000],\n [0.0000, 0.0000, 0.0000],\n [0.0000, 0.0000, 0.0000],\n ...,\n [0.0000, 0.0000, 0.0000],\n [0.0000, 0.0000, 0.0000],\n [0.0000, 0.0000, 0.0000]],\n\n ...,\n\n [[0.1367, 0.1367, 0.1367],\n [0.2500, 0.2500, 0.2500],\n [0.0352, 0.0352, 0.0352],\n ...,\n [0.0000, 0.0000, 0.0000],\n [0.0000, 0.0000, 0.0000],\n [0.0000, 0.0000, 0.0000]],\n\n [[0.1250, 0.1250, 0.1250],\n [0.1602, 0.1602, 0.1602],\n [0.5234, 0.5234, 0.5234],\n ...,\n [0.0000, 0.0000, 0.0000],\n [0.0000, 0.0000, 0.0000],\n [0.0000, 0.0000, 0.0000]],\n\n [[0.0000, 0.0000, 0.0000],\n [0.0195, 0.0195, 0.0195],\n [0.2266, 0.2266, 0.2266],\n ...,\n [0.0000, 0.0000, 0.0000],\n [0.0000, 0.0000, 0.0000],\n [0.0000, 0.0000, 0.0000]]]])']}, 'current_outputs': ['8', '10', '6', '13', '11', '3', '2', '12', '4', '7', '9'], 'timestamp': 1778675945035}
|
|
Details: Workflow: /node/ComfyUI-DepthAnythingV3/workflows/advanced.json
|
|
Node error: DepthAnything_V3 |