1065 lines
105 KiB
Plaintext
1065 lines
105 KiB
Plaintext
[00:00] Crash dump logging enabled: /Users/runner/work/comfy-gpu-ci/comfy-gpu-ci/comfy-test-logs/SAM3-2137/dev/macos-cpu/crash_dump.log
|
|
[00:00]
|
|
[00:00] [1/5] SYNTAX
|
|
[00:00] ----------------------------------------
|
|
[00:00]
|
|
[DEBUG] server=None, server_url=None, api=None
|
|
[00:00] Found pyproject.toml (modern format)
|
|
[00:00] Found requirements.txt (legacy format)
|
|
[00:00] Unicode check: OK (all characters cp1252-safe)
|
|
[00:00] Forbidden patterns check: OK
|
|
[00:00] [SYNTAX] PASSED
|
|
[00:00]
|
|
[00:00] [2/5] INSTALL
|
|
[00:00] ----------------------------------------
|
|
[00:00]
|
|
[DEBUG] server=None, server_url=None, api=None
|
|
[00:00]
|
|
Setting up ComfyUI...
|
|
[00:00] Cloning ComfyUI (latest)...
|
|
[00:00] Running: git clone --depth 1 https://github.com/comfyanonymous/ComfyUI.git /Users/runner/work/comfy-gpu-ci/comfy-gpu-ci/test_workspaces/SAM3-2137/ComfyUI
|
|
[00:02] Creating virtual environment...
|
|
[00:02] Running: /Library/Frameworks/Python.framework/Versions/3.10/bin/python -m venv /Users/runner/work/comfy-gpu-ci/comfy-gpu-ci/test_workspaces/SAM3-2137/venv
|
|
[00:06] Installing uv into venv...
|
|
[00:06] Running: /Users/runner/work/comfy-gpu-ci/comfy-gpu-ci/test_workspaces/SAM3-2137/venv/bin/python -m pip install uv
|
|
[00:08] Installing PyTorch...
|
|
[00:08] Running: /Users/runner/work/comfy-gpu-ci/comfy-gpu-ci/test_workspaces/SAM3-2137/venv/bin/python -m uv pip install torch torchvision torchaudio
|
|
[00:20] Installing ComfyUI requirements...
|
|
[00:20] Running: /Users/runner/work/comfy-gpu-ci/comfy-gpu-ci/test_workspaces/SAM3-2137/venv/bin/python -m uv pip install -r /Users/runner/work/comfy-gpu-ci/comfy-gpu-ci/test_workspaces/SAM3-2137/ComfyUI/requirements.txt
|
|
[00:36]
|
|
Installing custom node...
|
|
[00:36] Copying ComfyUI-SAM3 to custom_nodes/...
|
|
[00:36] Installing node requirements...
|
|
[00:36] Running: /Users/runner/work/comfy-gpu-ci/comfy-gpu-ci/test_workspaces/SAM3-2137/venv/bin/python -m uv pip install -r /Users/runner/work/comfy-gpu-ci/comfy-gpu-ci/test_workspaces/SAM3-2137/ComfyUI/custom_nodes/ComfyUI-SAM3/requirements.txt
|
|
[00:37]
|
|
Running install.py...
|
|
[00:37] Running: /Users/runner/work/comfy-gpu-ci/comfy-gpu-ci/test_workspaces/SAM3-2137/venv/bin/python /Users/runner/work/comfy-gpu-ci/comfy-gpu-ci/test_workspaces/SAM3-2137/ComfyUI/custom_nodes/ComfyUI-SAM3/install.py
|
|
[00:37]
|
|
[00:37] Installing 2 node dependencies...
|
|
[00:37] Cloning ComfyUI-VideoHelperSuite...
|
|
[00:38] Installing requirements for ComfyUI-VideoHelperSuite...
|
|
[00:39] Cloning ComfyUI-Multiband...
|
|
[00:40] Installing requirements for ComfyUI-Multiband...
|
|
[00:40]
|
|
[00:40] [requirements] Re-installing main package requirements...
|
|
[00:40] Installing requirements for ComfyUI-SAM3...
|
|
[00:41] [comfy-env] _discover: scanning /Users/runner/work/comfy-gpu-ci/comfy-gpu-ci/test_workspaces/SAM3-2137/ComfyUI/custom_nodes
|
|
[00:41] [comfy-env] _discover: ComfyUI-Multiband: no comfy-env.toml found
|
|
[00:41] [comfy-env] _discover: ComfyUI-SAM3 -> sam3-nodes (custom_nodes/ComfyUI-SAM3/nodes/comfy-env.toml)
|
|
[00:41] [comfy-env] _discover: ComfyUI-VideoHelperSuite: no comfy-env.toml found
|
|
[00:41] [comfy-env] Workspace: /Users/runner/.ce
|
|
[00:41] [comfy-env] ComfyUI: /Users/runner/work/comfy-gpu-ci/comfy-gpu-ci/test_workspaces/SAM3-2137/ComfyUI
|
|
[00:41] [comfy-env] Found 1 node config(s):
|
|
[00:41] - sam3-nodes <- custom_nodes/ComfyUI-SAM3/nodes/comfy-env.toml (python=host)
|
|
[00:41] [comfy-env] Bootstrap interpreter has python 3.10 + torch 2.11.0 (cpu). Looking for cuda-only wheels matching cpu/torch2.11/cp310.
|
|
[00:41] Generated /Users/runner/.ce/pixi.toml
|
|
[00:41] [comfy-env] Installing 1 environment(s):
|
|
[00:41] - sam3-nodes (python=host, 19 pypi deps, 3 cuda wheels)
|
|
[00:41] [comfy-env] Running `pixi install -e sam3-nodes`...
|
|
[00:52] WARN Skipped running the post-link scripts because `run-post-link-scripts` = `false`
|
|
[00:52] - bin/.librsvg-pre-unlink.sh
|
|
[00:52] To enable them, run:
|
|
[00:52] pixi config set --local run-post-link-scripts insecure
|
|
[00:52] More info:
|
|
[00:52] https://pixi.sh/latest/reference/pixi_configuration/#run-post-link-scripts
|
|
[01:05] ✔ The sam3-nodes environment has been installed.
|
|
[01:05] [comfy-env] sam3-nodes: deduped libomp
|
|
[01:05] [comfy-env] Install log: /Users/runner/.ce/install.log
|
|
[01:05]
|
|
[01:05] Installation complete!
|
|
[01:05] Installing 2 node dependency(ies)...
|
|
[01:05] ComfyUI-VideoHelperSuite from Kosinkadink/ComfyUI-VideoHelperSuite
|
|
[01:05] ComfyUI-VideoHelperSuite already exists, skipping...
|
|
[01:05] ComfyUI-Multiband from PozzettiAndrea/ComfyUI-Multiband
|
|
[01:05] ComfyUI-Multiband already exists, skipping...
|
|
[01:05] Installing validation endpoint...
|
|
[01:05] Cloning PozzettiAndrea/ComfyUI-validate-endpoint...
|
|
[01:05] Running: git clone --depth 1 https://github.com/PozzettiAndrea/ComfyUI-validate-endpoint.git /Users/runner/work/comfy-gpu-ci/comfy-gpu-ci/test_workspaces/SAM3-2137/ComfyUI/custom_nodes/ComfyUI-validate-endpoint
|
|
[01:05] CUDA packages absent (will mock): cc_torch, torch_generic_nms, flash_attn
|
|
[01:05] [INSTALL] PASSED
|
|
[01:05]
|
|
[01:05] [3/5] REGISTRATION
|
|
[01:05] ----------------------------------------
|
|
[01:05]
|
|
[DEBUG] server=None, server_url=None, api=None
|
|
[01:05]
|
|
Starting ComfyUI server...
|
|
[01:05] Starting ComfyUI server on port 41889...
|
|
[01:05] CUDA mock packages: cc_torch, torch_generic_nms, flash_attn
|
|
[01:05] Starting ComfyUI server on port 41889...
|
|
[01:05] Waiting for server to be ready (timeout: 600s)...
|
|
[01:07] [ComfyUI] setup plugin alembic.autogenerate.schemas
|
|
[01:07] [ComfyUI] setup plugin alembic.autogenerate.tables
|
|
[01:07] [ComfyUI] setup plugin alembic.autogenerate.types
|
|
[01:07] [ComfyUI] setup plugin alembic.autogenerate.constraints
|
|
[01:07] [ComfyUI] setup plugin alembic.autogenerate.defaults
|
|
[01:07] [ComfyUI] setup plugin alembic.autogenerate.comments
|
|
[01:07] [ComfyUI] Could not autodetect AIMDO implementation, assuming Nvidia
|
|
[01:07] [ComfyUI] comfy-aimdo unsupported operating system: Darwin
|
|
[01:07] [ComfyUI] NOTE: comfy-aimdo currently only supports Windows and Linux
|
|
[01:08] [ComfyUI] [comfy-env] ComfyUI-SAM3: 1 isolation env(s):
|
|
[01:08] [ComfyUI] [comfy-env] nodes -> /Users/runner/work/comfy-gpu-ci/comfy-gpu-ci/test_workspaces/SAM3-2137/ComfyUI/custom_nodes/ComfyUI-SAM3/nodes
|
|
[01:11] [ComfyUI] [comfy-env] prestartup complete
|
|
[01:11] [ComfyUI]
|
|
[01:11] [ComfyUI] Prestartup times for custom nodes:
|
|
[01:11] [ComfyUI] 3.8 seconds: /Users/runner/work/comfy-gpu-ci/comfy-gpu-ci/test_workspaces/SAM3-2137/ComfyUI/custom_nodes/ComfyUI-SAM3
|
|
[01:11] [ComfyUI]
|
|
[01:11] [ComfyUI] WARNING: Potential Error in code: Torch already imported, torch should never be imported before this point.
|
|
[01:16] [ComfyUI] Found comfy_kitchen backend triton: {'available': False, 'disabled': True, 'unavailable_reason': "ImportError: No module named 'triton'", 'capabilities': []}
|
|
[01:16] [ComfyUI] Found comfy_kitchen backend eager: {'available': True, 'disabled': False, 'unavailable_reason': None, 'capabilities': ['apply_rope', 'apply_rope1', 'dequantize_mxfp8', 'dequantize_nvfp4', 'dequantize_per_tensor_fp8', 'quantize_mxfp8', 'quantize_nvfp4', 'quantize_per_tensor_fp8', 'scaled_mm_mxfp8', 'scaled_mm_nvfp4']}
|
|
[01:16] [ComfyUI] Found comfy_kitchen backend cuda: {'available': False, 'disabled': True, 'unavailable_reason': 'Extension file not found: /Users/runner/work/comfy-gpu-ci/comfy-gpu-ci/test_workspaces/SAM3-2137/venv/lib/python3.10/site-packages/comfy_kitchen/backends/cuda/_C.abi3.so', 'capabilities': []}
|
|
[01:16] [ComfyUI] Checkpoint files will always be loaded safely.
|
|
[01:16] [ComfyUI] Total VRAM 7168 MB, total RAM 7168 MB
|
|
[01:16] [ComfyUI] pytorch version: 2.11.0
|
|
[01:16] [ComfyUI] Mac Version (15, 7, 4)
|
|
[01:16] [ComfyUI] Set vram state to: SHARED
|
|
[01:16] [ComfyUI] Device: mps
|
|
[01:17] [ComfyUI] Using sub quadratic optimization for attention, if you have memory or speed issues try using: --use-split-cross-attention
|
|
[01:25] [ComfyUI] objc[3353]: Class AVFFrameReceiver is implemented in both /Users/runner/work/comfy-gpu-ci/comfy-gpu-ci/test_workspaces/SAM3-2137/venv/lib/python3.10/site-packages/cv2/.dylibs/libavdevice.61.3.100.dylib (0x1101f43a8) and /Users/runner/work/comfy-gpu-ci/comfy-gpu-ci/test_workspaces/SAM3-2137/venv/lib/python3.10/site-packages/av/.dylibs/libavdevice.62.1.100.dylib (0x1274ec3a8). This may cause spurious casting failures and mysterious crashes. One of the duplicates must be removed or renamed.
|
|
[01:25] [ComfyUI] objc[3353]: Class AVFAudioReceiver is implemented in both /Users/runner/work/comfy-gpu-ci/comfy-gpu-ci/test_workspaces/SAM3-2137/venv/lib/python3.10/site-packages/cv2/.dylibs/libavdevice.61.3.100.dylib (0x1101f43f8) and /Users/runner/work/comfy-gpu-ci/comfy-gpu-ci/test_workspaces/SAM3-2137/venv/lib/python3.10/site-packages/av/.dylibs/libavdevice.62.1.100.dylib (0x1274ec3f8). This may cause spurious casting failures and mysterious crashes. One of the duplicates must be removed or renamed.
|
|
[01:27] [ComfyUI] Python version: 3.10.11 (v3.10.11:7d4cc5aa85, Apr 4 2023, 19:05:19) [Clang 13.0.0 (clang-1300.0.29.30)]
|
|
[01:27] [ComfyUI] ComfyUI version: 0.20.1
|
|
[01:27] [ComfyUI] comfy-aimdo version: 0.3.0
|
|
[01:27] [ComfyUI] comfy-kitchen version: 0.2.8
|
|
[01:27] [ComfyUI] ****** User settings have been changed to be stored on the server instead of browser storage. ******
|
|
[01:27] [ComfyUI] ****** For multi-user setups add the --multi-user CLI argument to enable multiple user profiles. ******
|
|
[01:27] [ComfyUI] ComfyUI frontend version: 1.43.18
|
|
[01:27] [ComfyUI] [Prompt Server] web root: /Users/runner/work/comfy-gpu-ci/comfy-gpu-ci/test_workspaces/SAM3-2137/venv/lib/python3.10/site-packages/comfyui_frontend_package/static
|
|
[01:27] [ComfyUI] Asset seeder disabled
|
|
[01:31] [ComfyUI] [comfy-env] Version: 0.3.82
|
|
[01:31] [ComfyUI] [comfy-env] register_nodes: ComfyUI-SAM3
|
|
[01:31] [ComfyUI] [comfy-env] ComfyUI source dir: /Users/runner/work/comfy-gpu-ci/comfy-gpu-ci/test_workspaces/SAM3-2137/ComfyUI
|
|
[01:31] [ComfyUI] [comfy-env] Found 1 isolation env(s)
|
|
[01:31] [ComfyUI] [comfy-env] Scanning nodes metadata (isolation root)...
|
|
[01:31] [ComfyUI] [comfy-env] Metadata scan: /Users/runner/.pixi/bin/pixi run --as-is --manifest-path /Users/runner/.ce/pixi.toml -e sam3-nodes python /var/folders/tb/y368xp_x10s3ty1b_mtl5mxr0000gn/T/comfy_meta_tdfmpg5m.py /Users/runner/work/comfy-gpu-ci/comfy-gpu-ci/test_workspaces/SAM3-2137/ComfyUI/custom_nodes/ComfyUI-SAM3 nodes
|
|
[01:31] [ComfyUI] [comfy-env] Scan env PATH for nodes:
|
|
[01:31] [ComfyUI] [comfy-env] [0] /Users/runner/hostedtoolcache/Python/3.10.11/arm64/bin
|
|
[01:31] [ComfyUI] [comfy-env] [1] /Users/runner/hostedtoolcache/Python/3.10.11/arm64
|
|
[01:31] [ComfyUI] [comfy-env] [2] /opt/homebrew/lib/ruby/gems/3.3.0/bin
|
|
[01:31] [ComfyUI] [comfy-env] [3] /opt/homebrew/opt/ruby@3.3/bin
|
|
[01:31] [ComfyUI] [comfy-env] [4] /Users/runner/.local/bin
|
|
[01:31] [ComfyUI] [comfy-env] [5] /opt/homebrew/bin
|
|
[01:31] [ComfyUI] [comfy-env] [6] /opt/homebrew/sbin
|
|
[01:31] [ComfyUI] [comfy-env] [7] /Users/runner/.cargo/bin
|
|
[01:31] [ComfyUI] [comfy-env] [8] /usr/local/opt/curl/bin
|
|
[01:31] [ComfyUI] [comfy-env] [9] /usr/local/bin
|
|
[01:31] [ComfyUI] [comfy-env] [10] /usr/local/sbin
|
|
[01:31] [ComfyUI] [comfy-env] [11] /Users/runner/bin
|
|
[01:31] [ComfyUI] [comfy-env] [12] /Users/runner/.yarn/bin
|
|
[01:31] [ComfyUI] [comfy-env] [13] /Users/runner/Library/Android/sdk/tools
|
|
[01:31] [ComfyUI] [comfy-env] [14] /Users/runner/Library/Android/sdk/platform-tools
|
|
[01:31] [ComfyUI] [comfy-env] [15] /Library/Frameworks/Python.framework/Versions/Current/bin
|
|
[01:31] [ComfyUI] [comfy-env] [16] /Library/Frameworks/Mono.framework/Versions/Current/Commands
|
|
[01:31] [ComfyUI] [comfy-env] [17] /usr/bin
|
|
[01:31] [ComfyUI] [comfy-env] [18] /bin
|
|
[01:31] [ComfyUI] [comfy-env] [19] /usr/sbin
|
|
[01:31] [ComfyUI] [comfy-env] [20] /sbin
|
|
[01:31] [ComfyUI] [comfy-env] [21] /Users/runner/.dotnet/tools
|
|
[01:44] [ComfyUI] [comfy-env] Metadata scan stderr for nodes:
|
|
[01:44] [ComfyUI] [comfy-env] [meta-scan] importing nodes from /Users/runner/work/comfy-gpu-ci/comfy-gpu-ci/test_workspaces/SAM3-2137/ComfyUI/custom_nodes/ComfyUI-SAM3
|
|
[01:44] [ComfyUI] [comfy-env] [meta-scan] import OK
|
|
[01:44] [ComfyUI] [comfy-env] Scanned nodes: 15 nodes (12.7s)
|
|
[01:44] [ComfyUI] [comfy-env] Scanned nodes root: 15 nodes (12.7s)
|
|
[01:44] [ComfyUI] [comfy-env] Registered proxy route: POST /sam3/interactive_segment_one -> nodes.sam3_interactive._api_segment_one
|
|
[01:44] [ComfyUI] [comfy-env] Imported nodes root: 15 nodes (isolation)
|
|
[01:44] [ComfyUI] [comfy-env] Registered 15 total nodes
|
|
[01:44] [ComfyUI] ComfyUI-Multiband loaded: 15 nodes registered
|
|
[01:44] [ComfyUI]
|
|
[01:44] [ComfyUI] Import times for custom nodes:
|
|
[01:44] [ComfyUI] 0.0 seconds: /Users/runner/work/comfy-gpu-ci/comfy-gpu-ci/test_workspaces/SAM3-2137/ComfyUI/custom_nodes/ComfyUI-validate-endpoint
|
|
[01:44] [ComfyUI] 0.0 seconds: /Users/runner/work/comfy-gpu-ci/comfy-gpu-ci/test_workspaces/SAM3-2137/ComfyUI/custom_nodes/websocket_image_save.py
|
|
[01:44] [ComfyUI] 0.2 seconds: /Users/runner/work/comfy-gpu-ci/comfy-gpu-ci/test_workspaces/SAM3-2137/ComfyUI/custom_nodes/ComfyUI-VideoHelperSuite
|
|
[01:44] [ComfyUI] 0.3 seconds: /Users/runner/work/comfy-gpu-ci/comfy-gpu-ci/test_workspaces/SAM3-2137/ComfyUI/custom_nodes/ComfyUI-Multiband
|
|
[01:44] [ComfyUI] 13.1 seconds: /Users/runner/work/comfy-gpu-ci/comfy-gpu-ci/test_workspaces/SAM3-2137/ComfyUI/custom_nodes/ComfyUI-SAM3
|
|
[01:44] [ComfyUI]
|
|
[01:44] [ComfyUI] Context impl SQLiteImpl.
|
|
[01:44] [ComfyUI] Will assume non-transactional DDL.
|
|
[01:44] [ComfyUI] Context impl SQLiteImpl.
|
|
[01:44] [ComfyUI] Will assume non-transactional DDL.
|
|
[01:44] [ComfyUI] Running upgrade -> 0001_assets, Initial assets schema
|
|
[01:44] [ComfyUI] Revision ID: 0001_assets
|
|
[01:44] [ComfyUI] Revises: None
|
|
[01:44] [ComfyUI] Create Date: 2025-12-10 00:00:00
|
|
[01:44] [ComfyUI] Running upgrade 0001_assets -> 0002_merge_to_asset_references, Merge AssetInfo and AssetCacheState into unified asset_references table.
|
|
[01:44] [ComfyUI] Running upgrade 0002_merge_to_asset_references -> 0003_add_metadata_job_id, Add system_metadata and job_id columns to asset_references.
|
|
[01:44] [ComfyUI] Change preview_id FK from assets.id to asset_references.id.
|
|
[01:44] [ComfyUI] Database upgraded from None to 0003_add_metadata_job_id
|
|
[01:45] [ComfyUI] Starting server
|
|
[01:45] [ComfyUI]
|
|
[01:45] [ComfyUI] To see the GUI go to: http://127.0.0.1:41889
|
|
[01:45] Server responding, waiting for nodes to load...
|
|
[02:05] Server is ready!
|
|
[02:05] Checking for import errors in server logs...
|
|
[02:05] No import errors detected
|
|
[02:05] Found 775 registered nodes
|
|
[02:05] [REGISTRATION] PASSED
|
|
[02:05]
|
|
[02:05] [4/5] INSTANTIATION
|
|
[02:05] ----------------------------------------
|
|
[02:05]
|
|
[DEBUG] server=<comfy_test.comfyui.server.ComfyUIServer object at 0x101fa6290>, server_url=None, api=<comfy_test.comfyui.api.ComfyUIAPI object at 0x101fe7790>
|
|
[02:05] Testing node constructors...
|
|
[02:15] All 15 node(s) instantiated successfully!
|
|
[02:15] [INSTANTIATION] PASSED
|
|
[02:15]
|
|
[02:15] [5/5] EXECUTION
|
|
[02:15] ----------------------------------------
|
|
[02:15]
|
|
[DEBUG] server=<comfy_test.comfyui.server.ComfyUIServer object at 0x101fa6290>, server_url=None, api=<comfy_test.comfyui.api.ComfyUIAPI object at 0x101fe7790>
|
|
[02:15] CPU runner - will execute 4 workflow(s)
|
|
[02:15] Running 5 workflow(s) (all with videos)...
|
|
[02:15] Installing screenshot dependencies (playwright, pillow)...
|
|
[02:16] Packages installed, downloading chromium browser...
|
|
[02:26] Screenshot dependencies installed successfully
|
|
[02:27] Starting headless browser...
|
|
[02:27] macOS -- using Apple Metal GPU via ANGLE
|
|
[02:28] Capturing execution frames: image_seg_point.json
|
|
[02:31] [ComfyUI] [DEPRECATION WARNING] Detected import of deprecated legacy API: /extensions/core/widgetInputs.js. This is likely caused by a custom node extension using outdated APIs. Please update your extensions or contact the extension author for an updated version.
|
|
[02:39] Frame 1 saved (frame_000.jpg, t=0.0s)
|
|
[02:39] Validating workflow...
|
|
[02:39] [ComfyUI] === /validate endpoint called ===
|
|
[02:39] [ComfyUI] Received JSON with keys: ['prompt']
|
|
[02:39] [ComfyUI] Prompt has 6 nodes
|
|
[02:39] [ComfyUI] Node 1: LoadImage
|
|
[02:39] [ComfyUI] Inputs: {"image": "example_image.jpg"}
|
|
[02:39] [ComfyUI] Node 15: SAM3PointCollector
|
|
[02:39] [ComfyUI] Inputs: {"points_store": "{\"positive\":[{\"x\":426.27735719657574,\"y\":321.42611685978835},{\"x\":417.13743597288953,\"y\":407.3413796907987},{\"x\":431.76130993078743,\"y\":549.9241563039649}],\"negative\"
|
|
[02:39] [ComfyUI] Node 28: PreviewImage
|
|
[02:39] [ComfyUI] Inputs: {"images": ["31", 2]}
|
|
[02:39] [ComfyUI] Node 29: MaskPreview
|
|
[02:39] [ComfyUI] Inputs: {"mask": ["31", 0]}
|
|
[02:39] [ComfyUI] Node 30: LoadSAM3Model
|
|
[02:39] [ComfyUI] Inputs: {"precision": "auto", "compile": false}
|
|
[02:39] [ComfyUI] Node 31: SAM3Segmentation
|
|
[02:39] [ComfyUI] Inputs: {"refinement_iterations": 0, "use_multimask": true, "output_best_mask": true, "sam3_model_config": ["30", 0], "image": ["1", 0], "positive_points": ["15", 0], "negative_points": ["15", 1]}
|
|
[02:39] [ComfyUI] Generated prompt_id: 6d114ed1-1552-42d0-9689-5f529102a40a
|
|
[02:39] [ComfyUI] Calling execution.validate_prompt()...
|
|
[02:39] [ComfyUI] Validation result: valid=True
|
|
[02:39] [ComfyUI] === Validation PASSED ===
|
|
[02:39] Queuing workflow for execution...
|
|
[02:39] [ComfyUI] got prompt
|
|
[02:39] [ComfyUI] [comfy-env] Running SAM3PointCollector: points_store: '{"positive":[{"x":426.27735719657574,"y":321.42611685978..., coordinates: '[{"x":426.27735719657574,"y":321.42611685978835},{"x":41..., neg_coordinates: '[]', image: torch.float32 [1,720,1280,3] cpu
|
|
[02:39] [ComfyUI] [comfy-env] SubprocessWorker: /Users/runner/.ce/.pixi/envs/sam3-nodes/bin/python
|
|
[02:39] [ComfyUI] [comfy-env] env_vars: {'PYTORCH_ENABLE_MPS_FALLBACK': '1', 'COMFYUI_BASE': '/Users/runner/work/comfy-gpu-ci/comfy-gpu-ci/test_workspaces/SAM3-2137/ComfyUI'}
|
|
[02:39] [ComfyUI] [SubprocessWorker] call_method: nodes.sam3_interactive.SAM3PointCollector.EXECUTE_NORMALIZED
|
|
[02:39] [ComfyUI] [SubprocessWorker] acquired lock, ensuring started...
|
|
[02:39] [ComfyUI] [ComfyUI-SAM3] python: /Users/runner/.ce/.pixi/envs/sam3-nodes/bin/python
|
|
[02:39] [ComfyUI] [ComfyUI-SAM3] sys_path sent to worker: ['/Users/runner/work/comfy-gpu-ci/comfy-gpu-ci/test_workspaces/SAM3-2137/ComfyUI', '/Users/runner/work/comfy-gpu-ci/comfy-gpu-ci/test_workspaces/SAM3-2137/ComfyUI/custom_nodes/ComfyUI-SAM3', '/Users/runner/.ce/.pixi/envs/sam3-nodes/lib/python3.1/site-packages', '/Users/runner/work/comfy-gpu-ci/comfy-gpu-ci/test_workspaces/SAM3-2137/ComfyUI/custom_nodes/ComfyUI-SAM3']
|
|
[02:39] [ComfyUI] [SubprocessWorker] is_pixi=True, python=/Users/runner/.ce/.pixi/envs/sam3-nodes/bin/python
|
|
[02:39] [ComfyUI] [SubprocessWorker] launching cmd=['/Users/runner/.pixi/bin/pixi', 'run', '--as-is', '--manifest-path', '/Users/runner/.ce/pixi.toml', '-e', 'sam3-nodes', 'python', '/var/folders/tb/y368xp_x10s3ty1b_mtl5mxr0000gn/T/comfyui_pvenv_9iclx1mf/persistent_worker.py', 'unix:///var/folders/tb/y368xp_x10s3ty1b_mtl5mxr0000gn/T/comfy_worker_424ee1f4d280.sock']...
|
|
[02:39] [ComfyUI] [SubprocessWorker] socket_addr=unix:///var/folders/tb/y368xp_x10s3ty1b_mtl5mxr0000gn/T/comfy_worker_424ee1f4d280.sock exists=True
|
|
[02:41] Frame 2 saved (frame_001.jpg, t=2.8s)
|
|
[02:41] [capture-periodic] freeze=3ms shot=159ms unfreeze=8ms saved=True
|
|
[02:44] Frame 3 saved (frame_002.jpg, t=5.1s)
|
|
[02:44] [capture-periodic] freeze=2ms shot=142ms unfreeze=4ms saved=True
|
|
[02:45] [capture-loop] iter=50 t=6.6s state={'complete': False, 'error': None, 'executedCount': 0, 'wsState': 1} eval_ms=4 ram=3.8/7.0GB (59%) swap=0.0/0.0GB (0%) cpu=84% browser_rss=0.58GB
|
|
[02:45] [ComfyUI] [SubprocessWorker] worker started/confirmed
|
|
[02:45] [ComfyUI] [comfy-env] PRE-SERIALIZE 'image' shape: torch.Size([1, 720, 1280, 3])
|
|
[02:45] [ComfyUI] [SubprocessWorker] serializing kwargs to shm...
|
|
[02:46] [ComfyUI] [SubprocessWorker] created 0 shm blocks
|
|
[02:46] [ComfyUI] [SubprocessWorker] sending request via socket...
|
|
[02:46] [ComfyUI] [SubprocessWorker] call_id=1 sending call_method
|
|
[02:46] [ComfyUI] [worker:ComfyUI-SAM3] [comfy-env] _from_shm got dict with keys: ['__type__', 'strategy', 'manager_path', 'storage_key', 'storage_size']
|
|
[02:46] [ComfyUI] [worker:ComfyUI-SAM3] [comfy-env] DESERIALIZE TensorRef: tensor_size=[1, 720, 1280, 3]
|
|
[02:46] [ComfyUI] [worker:ComfyUI-SAM3] [comfy-env] DESERIALIZED tensor shape: torch.Size([1, 720, 1280, 3])
|
|
[02:48] [ComfyUI] [SubprocessWorker] got response: ok
|
|
[02:48] [ComfyUI] [comfy-env] SAM3PointCollector done (8.16s): result: NodeOutput
|
|
[02:48] [ComfyUI] [comfy-env] Running LoadSAM3Model: precision: 'auto', compile: False
|
|
[02:48] [ComfyUI] [SubprocessWorker] call_method: nodes.load_model.LoadSAM3Model.EXECUTE_NORMALIZED
|
|
[02:48] [ComfyUI] [SubprocessWorker] acquired lock, ensuring started...
|
|
[02:48] [ComfyUI] [ComfyUI-SAM3] Health check: ping (timeout=5.0s)...
|
|
[02:48] [ComfyUI] [ComfyUI-SAM3] Health check: ok
|
|
[02:48] [ComfyUI] [SubprocessWorker] worker started/confirmed
|
|
[02:48] [ComfyUI] [SubprocessWorker] serializing kwargs to shm...
|
|
[02:48] [ComfyUI] [SubprocessWorker] created 0 shm blocks
|
|
[02:48] [ComfyUI] [SubprocessWorker] sending request via socket...
|
|
[02:48] [ComfyUI] [SubprocessWorker] call_id=2 sending call_method
|
|
[02:48] [ComfyUI] [worker:ComfyUI-SAM3] [SAM3] Model not found at /Users/runner/work/comfy-gpu-ci/comfy-gpu-ci/test_workspaces/SAM3-2137/ComfyUI/models/sam3/sam3.safetensors, downloading from HuggingFace...
|
|
[02:48] Node executed (1 total), capturing...
|
|
[02:48] Frame 4 saved (frame_003.jpg, t=9.3s)
|
|
[02:48] [capture-node] freeze=2ms shot=172ms unfreeze=4ms saved=True
|
|
[02:49] [ComfyUI] [worker:ComfyUI-SAM3] [SAM3] Downloading sam3.safetensors from apozz/sam3-safetensors...
|
|
[02:49] [ComfyUI] [SubprocessWorker] callback 'report_progress' from call_id=2
|
|
[02:49] [ComfyUI] [SubprocessWorker] callback 'report_progress' from call_id=2
|
|
[02:50] [ComfyUI] [SubprocessWorker] callback 'report_progress' from call_id=2
|
|
[02:50] [ComfyUI] [SubprocessWorker] callback 'report_progress' from call_id=2
|
|
[02:51] [ComfyUI] [SubprocessWorker] callback 'report_progress' from call_id=2
|
|
[02:51] Frame 5 saved (frame_004.jpg, t=11.6s)
|
|
[02:51] [capture-periodic] freeze=4ms shot=704ms unfreeze=11ms saved=True
|
|
[02:51] [ComfyUI] [SubprocessWorker] callback 'report_progress' from call_id=2
|
|
[02:52] [ComfyUI] [SubprocessWorker] callback 'report_progress' from call_id=2
|
|
[02:52] [ComfyUI] [SubprocessWorker] callback 'report_progress' from call_id=2
|
|
[02:52] [ComfyUI] [SubprocessWorker] callback 'report_progress' from call_id=2
|
|
[02:52] [ComfyUI] [SubprocessWorker] callback 'report_progress' from call_id=2
|
|
[02:52] [ComfyUI] [worker:ComfyUI-SAM3] [SAM3] Download progress: 10%
|
|
[02:53] [capture-loop] iter=100 t=14.0s state={'complete': False, 'error': None, 'executedCount': 1, 'wsState': 1} eval_ms=18 ram=3.8/7.0GB (60%) swap=0.0/0.0GB (0%) cpu=83% browser_rss=0.55GB
|
|
[02:53] [ComfyUI] [SubprocessWorker] callback 'report_progress' from call_id=2
|
|
[02:53] [ComfyUI] [SubprocessWorker] callback 'report_progress' from call_id=2
|
|
[02:53] [ComfyUI] [SubprocessWorker] callback 'report_progress' from call_id=2
|
|
[02:54] [ComfyUI] [SubprocessWorker] callback 'report_progress' from call_id=2
|
|
[02:54] [ComfyUI] [SubprocessWorker] callback 'report_progress' from call_id=2
|
|
[02:54] Frame 6 saved (frame_005.jpg, t=14.6s)
|
|
[02:54] [capture-periodic] freeze=6ms shot=686ms unfreeze=11ms saved=True
|
|
[02:54] [ComfyUI] [SubprocessWorker] callback 'report_progress' from call_id=2
|
|
[02:54] [ComfyUI] [SubprocessWorker] callback 'report_progress' from call_id=2
|
|
[02:54] [ComfyUI] [SubprocessWorker] callback 'report_progress' from call_id=2
|
|
[02:55] [ComfyUI] [SubprocessWorker] callback 'report_progress' from call_id=2
|
|
[02:55] [ComfyUI] [SubprocessWorker] callback 'report_progress' from call_id=2
|
|
[02:55] [ComfyUI] [worker:ComfyUI-SAM3] [SAM3] Download progress: 20%
|
|
[02:55] [ComfyUI] [SubprocessWorker] callback 'report_progress' from call_id=2
|
|
[02:55] [ComfyUI] [SubprocessWorker] callback 'report_progress' from call_id=2
|
|
[02:55] [ComfyUI] [SubprocessWorker] callback 'report_progress' from call_id=2
|
|
[02:56] [ComfyUI] [SubprocessWorker] callback 'report_progress' from call_id=2
|
|
[02:56] [ComfyUI] [SubprocessWorker] callback 'report_progress' from call_id=2
|
|
[02:56] [ComfyUI] [SubprocessWorker] callback 'report_progress' from call_id=2
|
|
[02:56] [ComfyUI] [SubprocessWorker] callback 'report_progress' from call_id=2
|
|
[02:56] Frame 7 saved (frame_006.jpg, t=17.5s)
|
|
[02:56] [capture-periodic] freeze=14ms shot=280ms unfreeze=14ms saved=True
|
|
[02:56] [ComfyUI] [SubprocessWorker] callback 'report_progress' from call_id=2
|
|
[02:57] [ComfyUI] [SubprocessWorker] callback 'report_progress' from call_id=2
|
|
[02:57] [ComfyUI] [SubprocessWorker] callback 'report_progress' from call_id=2
|
|
[02:57] [ComfyUI] [worker:ComfyUI-SAM3] [SAM3] Download progress: 30%
|
|
[02:57] [ComfyUI] [SubprocessWorker] callback 'report_progress' from call_id=2
|
|
[02:57] [ComfyUI] [SubprocessWorker] callback 'report_progress' from call_id=2
|
|
[02:58] [ComfyUI] [SubprocessWorker] callback 'report_progress' from call_id=2
|
|
[02:58] [ComfyUI] [SubprocessWorker] callback 'report_progress' from call_id=2
|
|
[02:58] [ComfyUI] [SubprocessWorker] callback 'report_progress' from call_id=2
|
|
[02:58] [ComfyUI] [SubprocessWorker] callback 'report_progress' from call_id=2
|
|
[02:59] [ComfyUI] [SubprocessWorker] callback 'report_progress' from call_id=2
|
|
[02:59] [ComfyUI] [SubprocessWorker] callback 'report_progress' from call_id=2
|
|
[02:59] Frame 8 saved (frame_007.jpg, t=19.9s)
|
|
[02:59] [capture-periodic] freeze=5ms shot=379ms unfreeze=17ms saved=True
|
|
[02:59] [ComfyUI] [SubprocessWorker] callback 'report_progress' from call_id=2
|
|
[02:59] [ComfyUI] [SubprocessWorker] callback 'report_progress' from call_id=2
|
|
[02:59] [ComfyUI] [worker:ComfyUI-SAM3] [SAM3] Download progress: 40%
|
|
[02:59] [ComfyUI] [SubprocessWorker] callback 'report_progress' from call_id=2
|
|
[03:00] [ComfyUI] [SubprocessWorker] callback 'report_progress' from call_id=2
|
|
[03:00] [ComfyUI] [SubprocessWorker] callback 'report_progress' from call_id=2
|
|
[03:00] [ComfyUI] [SubprocessWorker] callback 'report_progress' from call_id=2
|
|
[03:00] [ComfyUI] [SubprocessWorker] callback 'report_progress' from call_id=2
|
|
[03:00] [ComfyUI] [SubprocessWorker] callback 'report_progress' from call_id=2
|
|
[03:01] [capture-loop] iter=150 t=22.1s state={'complete': False, 'error': None, 'executedCount': 1, 'wsState': 1} eval_ms=20 ram=3.8/7.0GB (60%) swap=0.0/0.0GB (0%) cpu=96% browser_rss=0.56GB
|
|
[03:01] [ComfyUI] [SubprocessWorker] callback 'report_progress' from call_id=2
|
|
[03:01] [ComfyUI] [SubprocessWorker] callback 'report_progress' from call_id=2
|
|
[03:01] [ComfyUI] [SubprocessWorker] callback 'report_progress' from call_id=2
|
|
[03:01] [ComfyUI] [SubprocessWorker] callback 'report_progress' from call_id=2
|
|
[03:01] [ComfyUI] [worker:ComfyUI-SAM3] [SAM3] Download progress: 50%
|
|
[03:01] Frame 9 saved (frame_008.jpg, t=22.4s)
|
|
[03:02] [capture-periodic] freeze=9ms shot=393ms unfreeze=5ms saved=True
|
|
[03:02] [ComfyUI] [SubprocessWorker] callback 'report_progress' from call_id=2
|
|
[03:02] [ComfyUI] [SubprocessWorker] callback 'report_progress' from call_id=2
|
|
[03:02] [ComfyUI] [SubprocessWorker] callback 'report_progress' from call_id=2
|
|
[03:03] [ComfyUI] [SubprocessWorker] callback 'report_progress' from call_id=2
|
|
[03:03] [ComfyUI] [SubprocessWorker] callback 'report_progress' from call_id=2
|
|
[03:03] [ComfyUI] [SubprocessWorker] callback 'report_progress' from call_id=2
|
|
[03:03] [ComfyUI] [SubprocessWorker] callback 'report_progress' from call_id=2
|
|
[03:04] [ComfyUI] [SubprocessWorker] callback 'report_progress' from call_id=2
|
|
[03:04] [ComfyUI] [SubprocessWorker] callback 'report_progress' from call_id=2
|
|
[03:04] Frame 10 saved (frame_009.jpg, t=25.1s)
|
|
[03:04] [capture-periodic] freeze=11ms shot=487ms unfreeze=18ms saved=True
|
|
[03:04] [ComfyUI] [SubprocessWorker] callback 'report_progress' from call_id=2
|
|
[03:04] [ComfyUI] [worker:ComfyUI-SAM3] [SAM3] Download progress: 60%
|
|
[03:05] [ComfyUI] [SubprocessWorker] callback 'report_progress' from call_id=2
|
|
[03:05] [ComfyUI] [SubprocessWorker] callback 'report_progress' from call_id=2
|
|
[03:05] [ComfyUI] [SubprocessWorker] callback 'report_progress' from call_id=2
|
|
[03:06] [ComfyUI] [SubprocessWorker] callback 'report_progress' from call_id=2
|
|
[03:06] [ComfyUI] [SubprocessWorker] callback 'report_progress' from call_id=2
|
|
[03:06] [ComfyUI] [SubprocessWorker] callback 'report_progress' from call_id=2
|
|
[03:06] [ComfyUI] [SubprocessWorker] callback 'report_progress' from call_id=2
|
|
[03:06] [ComfyUI] [SubprocessWorker] callback 'report_progress' from call_id=2
|
|
[03:07] [ComfyUI] [SubprocessWorker] callback 'report_progress' from call_id=2
|
|
[03:07] Frame 11 saved (frame_010.jpg, t=27.8s)
|
|
[03:07] [capture-periodic] freeze=4ms shot=287ms unfreeze=10ms saved=True
|
|
[03:07] [ComfyUI] [SubprocessWorker] callback 'report_progress' from call_id=2
|
|
[03:07] [ComfyUI] [worker:ComfyUI-SAM3] [SAM3] Download progress: 70%
|
|
[03:07] [ComfyUI] [SubprocessWorker] callback 'report_progress' from call_id=2
|
|
[03:07] [ComfyUI] [SubprocessWorker] callback 'report_progress' from call_id=2
|
|
[03:07] [ComfyUI] [SubprocessWorker] callback 'report_progress' from call_id=2
|
|
[03:08] [ComfyUI] [SubprocessWorker] callback 'report_progress' from call_id=2
|
|
[03:08] [ComfyUI] [SubprocessWorker] callback 'report_progress' from call_id=2
|
|
[03:08] [ComfyUI] [SubprocessWorker] callback 'report_progress' from call_id=2
|
|
[03:08] [capture-loop] iter=200 t=29.9s state={'complete': False, 'error': None, 'executedCount': 1, 'wsState': 1} eval_ms=4 ram=3.8/7.0GB (60%) swap=0.0/0.0GB (0%) cpu=97% browser_rss=0.57GB
|
|
[03:08] [ComfyUI] [SubprocessWorker] callback 'report_progress' from call_id=2
|
|
[03:09] [ComfyUI] [SubprocessWorker] callback 'report_progress' from call_id=2
|
|
[03:09] [ComfyUI] [SubprocessWorker] callback 'report_progress' from call_id=2
|
|
[03:09] Frame 12 saved (frame_011.jpg, t=30.2s)
|
|
[03:09] [capture-periodic] freeze=19ms shot=337ms unfreeze=2ms saved=True
|
|
[03:09] [ComfyUI] [SubprocessWorker] callback 'report_progress' from call_id=2
|
|
[03:09] [ComfyUI] [worker:ComfyUI-SAM3] [SAM3] Download progress: 80%
|
|
[03:10] [ComfyUI] [SubprocessWorker] callback 'report_progress' from call_id=2
|
|
[03:10] [ComfyUI] [SubprocessWorker] callback 'report_progress' from call_id=2
|
|
[03:10] [ComfyUI] [SubprocessWorker] callback 'report_progress' from call_id=2
|
|
[03:10] [ComfyUI] [SubprocessWorker] callback 'report_progress' from call_id=2
|
|
[03:11] [ComfyUI] [SubprocessWorker] callback 'report_progress' from call_id=2
|
|
[03:11] [ComfyUI] [SubprocessWorker] callback 'report_progress' from call_id=2
|
|
[03:11] [ComfyUI] [SubprocessWorker] callback 'report_progress' from call_id=2
|
|
[03:12] [ComfyUI] [SubprocessWorker] callback 'report_progress' from call_id=2
|
|
[03:12] Frame 13 saved (frame_012.jpg, t=32.7s)
|
|
[03:12] [capture-periodic] freeze=4ms shot=310ms unfreeze=16ms saved=True
|
|
[03:12] [ComfyUI] [SubprocessWorker] callback 'report_progress' from call_id=2
|
|
[03:12] [ComfyUI] [SubprocessWorker] callback 'report_progress' from call_id=2
|
|
[03:12] [ComfyUI] [worker:ComfyUI-SAM3] [SAM3] Download progress: 90%
|
|
[03:13] [ComfyUI] [SubprocessWorker] callback 'report_progress' from call_id=2
|
|
[03:13] [ComfyUI] [SubprocessWorker] callback 'report_progress' from call_id=2
|
|
[03:13] [ComfyUI] [SubprocessWorker] callback 'report_progress' from call_id=2
|
|
[03:13] [ComfyUI] [SubprocessWorker] callback 'report_progress' from call_id=2
|
|
[03:14] [ComfyUI] [SubprocessWorker] callback 'report_progress' from call_id=2
|
|
[03:14] [ComfyUI] [SubprocessWorker] callback 'report_progress' from call_id=2
|
|
[03:14] [ComfyUI] [SubprocessWorker] callback 'report_progress' from call_id=2
|
|
[03:14] Frame 14 saved (frame_013.jpg, t=35.2s)
|
|
[03:14] [capture-periodic] freeze=7ms shot=463ms unfreeze=3ms saved=True
|
|
[03:14] [ComfyUI] [SubprocessWorker] callback 'report_progress' from call_id=2
|
|
[03:14] [ComfyUI] [SubprocessWorker] callback 'report_progress' from call_id=2
|
|
[03:15] [ComfyUI] [SubprocessWorker] callback 'report_progress' from call_id=2
|
|
[03:15] [ComfyUI] [worker:ComfyUI-SAM3] [SAM3] Download progress: 100%
|
|
[03:15] [ComfyUI] [SubprocessWorker] callback 'report_progress' from call_id=2
|
|
[03:15] [ComfyUI] [worker:ComfyUI-SAM3] [SAM3] Downloaded sam3.safetensors
|
|
[03:15] [ComfyUI] [worker:ComfyUI-SAM3] [SAM3] Model downloaded successfully
|
|
[03:15] [ComfyUI] [SubprocessWorker] got response: ok
|
|
[03:15] [ComfyUI] [comfy-env] LoadSAM3Model done (27.19s): result: NodeOutput
|
|
[03:15] [ComfyUI] [comfy-env] Running SAM3Segmentation: refinement_iterations: 0, use_multimask: True, output_best_mask: True, sam3_model_config: dict, image: torch.float32 [1,720,1280,3] cpu, positive_points: dict, negative_points: dict
|
|
[03:15] [ComfyUI] [SubprocessWorker] call_method: nodes.segmentation.SAM3Segmentation.EXECUTE_NORMALIZED
|
|
[03:15] [ComfyUI] [SubprocessWorker] acquired lock, ensuring started...
|
|
[03:15] [ComfyUI] [ComfyUI-SAM3] Health check: ping (timeout=5.0s)...
|
|
[03:15] [ComfyUI] [ComfyUI-SAM3] Health check: ok
|
|
[03:15] [ComfyUI] [SubprocessWorker] worker started/confirmed
|
|
[03:15] [ComfyUI] [comfy-env] PRE-SERIALIZE 'image' shape: torch.Size([1, 720, 1280, 3])
|
|
[03:15] [ComfyUI] [SubprocessWorker] serializing kwargs to shm...
|
|
[03:15] [ComfyUI] [SubprocessWorker] created 0 shm blocks
|
|
[03:15] [ComfyUI] [SubprocessWorker] sending request via socket...
|
|
[03:15] [ComfyUI] [SubprocessWorker] call_id=3 sending call_method
|
|
[03:15] [ComfyUI] [worker:ComfyUI-SAM3] [comfy-env] _from_shm got dict with keys: ['__type__', 'strategy', 'manager_path', 'storage_key', 'storage_size']
|
|
[03:15] [ComfyUI] [worker:ComfyUI-SAM3] [comfy-env] DESERIALIZE TensorRef: tensor_size=[1, 720, 1280, 3]
|
|
[03:15] [ComfyUI] [worker:ComfyUI-SAM3] [comfy-env] DESERIALIZED tensor shape: torch.Size([1, 720, 1280, 3])
|
|
[03:16] [capture-loop] iter=250 t=37.3s state={'complete': False, 'error': None, 'executedCount': 1, 'wsState': 1} eval_ms=5 ram=3.8/7.0GB (60%) swap=0.0/0.0GB (0%) cpu=92% browser_rss=0.52GB
|
|
[03:16] Frame 15 saved (frame_014.jpg, t=37.8s)
|
|
[03:16] [capture-periodic] freeze=4ms shot=171ms unfreeze=13ms saved=True
|
|
[03:18] [ComfyUI] objc[5214]: Class AVFFrameReceiver is implemented in both /Users/runner/.ce/.pixi/envs/sam3-nodes/lib/libavdevice.62.3.101.dylib (0x112f047a8) and /Users/runner/.ce/.pixi/envs/sam3-nodes/lib/python3.10/site-packages/cv2/.dylibs/libavdevice.61.3.100.dylib (0x1366143a8). This may cause spurious casting failures and mysterious crashes. One of the duplicates must be removed or renamed.
|
|
[03:18] [ComfyUI] objc[5214]: Class AVFAudioReceiver is implemented in both /Users/runner/.ce/.pixi/envs/sam3-nodes/lib/libavdevice.62.3.101.dylib (0x112f047f8) and /Users/runner/.ce/.pixi/envs/sam3-nodes/lib/python3.10/site-packages/cv2/.dylibs/libavdevice.61.3.100.dylib (0x1366143f8). This may cause spurious casting failures and mysterious crashes. One of the duplicates must be removed or renamed.
|
|
[03:22] [capture-loop] iter=300 t=43.4s state={'complete': False, 'error': None, 'executedCount': 1, 'wsState': 1} eval_ms=4 ram=3.8/7.0GB (60%) swap=0.0/0.0GB (0%) cpu=62% browser_rss=0.52GB
|
|
[03:28] [capture-loop] iter=350 t=49.9s state={'complete': False, 'error': None, 'executedCount': 1, 'wsState': 1} eval_ms=6 ram=3.7/7.0GB (61%) swap=0.0/0.0GB (0%) cpu=64% browser_rss=0.45GB
|
|
[03:35] [capture-loop] iter=400 t=56.2s state={'complete': False, 'error': None, 'executedCount': 1, 'wsState': 1} eval_ms=7 ram=3.4/7.0GB (66%) swap=0.0/0.0GB (0%) cpu=69% browser_rss=0.43GB
|
|
[03:40] [ComfyUI] [worker:ComfyUI-SAM3]
|
|
[03:40] [ComfyUI] === WATCHDOG TICK 1 ===
|
|
[03:40] [ComfyUI] [worker:ComfyUI-SAM3] Current thread 0x0000000170d83000 (most recent call first):
|
|
[03:40] [ComfyUI] File "/var/folders/tb/y368xp_x10s3ty1b_mtl5mxr0000gn/T/comfyui_pvenv_9iclx1mf/persistent_worker.py", line 52 in _watchdog
|
|
[03:40] [ComfyUI] File "/Users/runner/.ce/.pixi/envs/sam3-nodes/lib/python3.10/threading.py", line 953 in run
|
|
[03:40] [ComfyUI] File "/Users/runner/.ce/.pixi/envs/sam3-nodes/lib/python3.10/threading.py", line 1016 in _bootstrap_inner
|
|
[03:40] [ComfyUI] File "/Users/runner/.ce/.pixi/envs/sam3-nodes/lib/python3.10/threading.py", line 973 in _bootstrap
|
|
[03:40] [ComfyUI]
|
|
[03:40] [ComfyUI] Thread 0x00000002054da240 (most recent call first):
|
|
[03:40] [ComfyUI] File "/Users/runner/work/comfy-gpu-ci/comfy-gpu-ci/test_workspaces/SAM3-2137/ComfyUI/custom_nodes/ComfyUI-SAM3/nodes/_model_cache.py", line 117 in get_or_build_model
|
|
[03:40] [ComfyUI] File "/Users/runner/work/comfy-gpu-ci/comfy-gpu-ci/test_workspaces/SAM3-2137/ComfyUI/custom_nodes/ComfyUI-SAM3/nodes/segmentation.py", line 469 in execute
|
|
[03:40] [ComfyUI] File "/Users/runner/work/comfy-gpu-ci/comfy-gpu-ci/test_workspaces/SAM3-2137/ComfyUI/comfy_api/latest/_io.py", line 1833 in EXECUTE_NORMALIZED
|
|
[03:40] [ComfyUI] File "/var/folders/tb/y368xp_x10s3ty1b_mtl5mxr0000gn/T/comfyui_pvenv_9iclx1mf/persistent_worker.py", line 1762 in main
|
|
[03:40] [ComfyUI] File "/var/folders/tb/y368xp_x10s3ty1b_mtl5mxr0000gn/T/comfyui_pvenv_9iclx1mf/persistent_worker.py", line 1807 in <module>
|
|
[03:40] [ComfyUI]
|
|
[03:40] [ComfyUI] [worker:ComfyUI-SAM3] === END ===
|
|
[03:40] [ComfyUI]
|
|
[03:42] [capture-loop] iter=450 t=63.0s state={'complete': False, 'error': None, 'executedCount': 1, 'wsState': 1} eval_ms=8 ram=3.0/7.0GB (71%) swap=0.0/0.0GB (0%) cpu=77% browser_rss=0.29GB
|
|
[03:48] [capture-loop] iter=500 t=69.9s state={'complete': False, 'error': None, 'executedCount': 1, 'wsState': 1} eval_ms=5 ram=2.8/7.0GB (74%) swap=0.0/0.0GB (0%) cpu=74% browser_rss=0.29GB
|
|
[03:55] [capture-loop] iter=550 t=76.2s state={'complete': False, 'error': None, 'executedCount': 1, 'wsState': 1} eval_ms=3 ram=2.6/7.0GB (76%) swap=0.0/0.0GB (0%) cpu=60% browser_rss=0.27GB
|
|
[03:56] [ComfyUI] [SubprocessWorker] callback 'request_vram_budget' from call_id=3
|
|
[03:56] [ComfyUI] [comfy-env] VRAM request: 1.84GB, free before eviction: 1.81GB
|
|
[03:56] [ComfyUI] [comfy-env] VRAM after eviction: 1.81GB
|
|
[04:01] [capture-loop] iter=600 t=82.8s state={'complete': False, 'error': None, 'executedCount': 1, 'wsState': 1} eval_ms=6 ram=3.4/7.0GB (76%) swap=0.0/0.0GB (0%) cpu=80% browser_rss=0.25GB
|
|
[04:08] [capture-loop] iter=650 t=89.4s state={'complete': False, 'error': None, 'executedCount': 1, 'wsState': 1} eval_ms=9 ram=3.5/7.0GB (66%) swap=0.0/0.0GB (0%) cpu=93% browser_rss=0.27GB
|
|
[04:19] [capture-loop] iter=700 t=100.8s state={'complete': False, 'error': None, 'executedCount': 1, 'wsState': 1} eval_ms=7 ram=3.1/7.0GB (83%) swap=0.0/0.0GB (0%) cpu=81% browser_rss=0.29GB
|
|
[04:29] [capture-loop] iter=750 t=110.7s state={'complete': False, 'error': None, 'executedCount': 1, 'wsState': 1} eval_ms=7 ram=4.4/7.0GB (83%) swap=0.0/0.0GB (0%) cpu=80% browser_rss=0.29GB
|
|
[04:35] [capture-loop] iter=800 t=116.6s state={'complete': False, 'error': None, 'executedCount': 1, 'wsState': 1} eval_ms=4 ram=3.3/7.0GB (66%) swap=0.0/0.0GB (0%) cpu=79% browser_rss=0.28GB
|
|
[04:40] [ComfyUI] [worker:ComfyUI-SAM3]
|
|
[04:40] [ComfyUI] === WATCHDOG TICK 2 ===
|
|
[04:40] [ComfyUI] [worker:ComfyUI-SAM3] Current thread 0x0000000170d83000 (most recent call first):
|
|
[04:40] [ComfyUI] File "/var/folders/tb/y368xp_x10s3ty1b_mtl5mxr0000gn/T/comfyui_pvenv_9iclx1mf/persistent_worker.py", line 52 in _watchdog
|
|
[04:40] [ComfyUI] File "/Users/runner/.ce/.pixi/envs/sam3-nodes/lib/python3.10/threading.py", line 953 in run
|
|
[04:40] [ComfyUI] File "/Users/runner/.ce/.pixi/envs/sam3-nodes/lib/python3.10/threading.py", line 1016 in _bootstrap_inner
|
|
[04:40] [ComfyUI] File "/Users/runner/.ce/.pixi/envs/sam3-nodes/lib/python3.10/threading.py", line 973 in _bootstrap
|
|
[04:40] [ComfyUI]
|
|
[04:40] [ComfyUI] Thread 0x00000002054da240 (most recent call first):
|
|
[04:40] [ComfyUI] File "/Users/runner/work/comfy-gpu-ci/comfy-gpu-ci/test_workspaces/SAM3-2137/ComfyUI/comfy/ops.py", line 475 in forward_comfy_cast_weights
|
|
[04:40] [ComfyUI] File "/Users/runner/work/comfy-gpu-ci/comfy-gpu-ci/test_workspaces/SAM3-2137/ComfyUI/comfy/ops.py", line 482 in forward
|
|
[04:40] [ComfyUI] File "/Users/runner/.ce/.pixi/envs/sam3-nodes/lib/python3.10/site-packages/torch/nn/modules/module.py", line 1790 in _call_impl
|
|
[04:40] [ComfyUI] File "/Users/runner/.ce/.pixi/envs/sam3-nodes/lib/python3.10/site-packages/torch/nn/modules/module.py", line 1779 in _wrapped_call_impl
|
|
[04:40] [ComfyUI] File "/Users/runner/work/comfy-gpu-ci/comfy-gpu-ci/test_workspaces/SAM3-2137/ComfyUI/custom_nodes/ComfyUI-SAM3/nodes/sam3/attention.py", line 373 in forward
|
|
[04:40] [ComfyUI] File "/Users/runner/.ce/.pixi/envs/sam3-nodes/lib/python3.10/site-packages/torch/nn/modules/module.py", line 1790 in _call_impl
|
|
[04:40] [ComfyUI] File "/Users/runner/.ce/.pixi/envs/sam3-nodes/lib/python3.10/site-packages/torch/nn/modules/module.py", line 1779 in _wrapped_call_impl
|
|
[04:40] [ComfyUI] File "/Users/runner/work/comfy-gpu-ci/comfy-gpu-ci/test_workspaces/SAM3-2137/ComfyUI/custom_nodes/ComfyUI-SAM3/nodes/sam3/attention.py", line 602 in forward
|
|
[04:40] [ComfyUI] File "/Users/runner/.ce/.pixi/envs/sam3-nodes/lib/python3.10/site-packages/torch/nn/modules/module.py", line 1790 in _call_impl
|
|
[04:40] [ComfyUI] File "/Users/runner/.ce/.pixi/envs/sam3-nodes/lib/python3.10/site-packages/torch/nn/modules/module.py", line 1779 in _wrapped_call_impl
|
|
[04:40] [ComfyUI] File "/Users/runner/work/comfy-gpu-ci/comfy-gpu-ci/test_workspaces/SAM3-2137/ComfyUI/custom_nodes/ComfyUI-SAM3/nodes/sam3/attention.py", line 674 in forward
|
|
[04:40] [ComfyUI] File "/Users/runner/.ce/.pixi/envs/sam3-nodes/lib/python3.10/site-packages/torch/nn/modules/module.py", line 1790 in _call_impl
|
|
[04:40] [ComfyUI] File "/Users/runner/.ce/.pixi/envs/sam3-nodes/lib/python3.10/site-packages/torch/nn/modules/module.py", line 1779 in _wrapped_call_impl
|
|
[04:40] [ComfyUI] File "/Users/runner/work/comfy-gpu-ci/comfy-gpu-ci/test_workspaces/SAM3-2137/ComfyUI/custom_nodes/ComfyUI-SAM3/nodes/sam3/model.py", line 2886 in predict_masks
|
|
[04:40] [ComfyUI] File "/Users/runner/work/comfy-gpu-ci/comfy-gpu-ci/test_workspaces/SAM3-2137/ComfyUI/custom_nodes/ComfyUI-SAM3/nodes/sam3/model.py", line 2807 in forward
|
|
[04:40] [ComfyUI] File "/Users/runner/.ce/.pixi/envs/sam3-nodes/lib/python3.10/site-packages/torch/nn/modules/module.py", line 1790 in _call_impl
|
|
[04:40] [ComfyUI] File "/Users/runner/.ce/.pixi/envs/sam3-nodes/lib/python3.10/site-packages/torch/nn/modules/module.py", line 1779 in _wrapped_call_impl
|
|
[04:40] [ComfyUI] File "/Users/runner/work/comfy-gpu-ci/comfy-gpu-ci/test_workspaces/SAM3-2137/ComfyUI/custom_nodes/ComfyUI-SAM3/nodes/sam3/model.py", line 9601 in _predict
|
|
[04:40] [ComfyUI] File "/Users/runner/.ce/.pixi/envs/sam3-nodes/lib/python3.10/site-packages/torch/utils/_contextlib.py", line 124 in decorate_context
|
|
[04:40] [ComfyUI] File "/Users/runner/work/comfy-gpu-ci/comfy-gpu-ci/test_workspaces/SAM3-2137/ComfyUI/custom_nodes/ComfyUI-SAM3/nodes/sam3/model.py", line 9499 in predict
|
|
[04:40] [ComfyUI] File "/Users/runner/work/comfy-gpu-ci/comfy-gpu-ci/test_workspaces/SAM3-2137/ComfyUI/custom_nodes/ComfyUI-SAM3/nodes/sam3/model.py", line 3989 in predict_inst
|
|
[04:40] [ComfyUI] File "/Users/runner/work/comfy-gpu-ci/comfy-gpu-ci/test_workspaces/SAM3-2137/ComfyUI/custom_nodes/ComfyUI-SAM3/nodes/segmentation.py", line 556 in execute
|
|
[04:40] [ComfyUI] File "/Users/runner/work/comfy-gpu-ci/comfy-gpu-ci/test_workspaces/SAM3-2137/ComfyUI/comfy_api/latest/_io.py", line 1833 in EXECUTE_NORMALIZED
|
|
[04:40] [ComfyUI] File "/var/folders/tb/y368xp_x10s3ty1b_mtl5mxr0000gn/T/comfyui_pvenv_9iclx1mf/persistent_worker.py", line 1762 in main
|
|
[04:40] [ComfyUI] File "/var/folders/tb/y368xp_x10s3ty1b_mtl5mxr0000gn/T/comfyui_pvenv_9iclx1mf/persistent_worker.py", line 1807 in <module>
|
|
[04:40] [ComfyUI]
|
|
[04:40] [ComfyUI] [worker:ComfyUI-SAM3] === END ===
|
|
[04:40] [ComfyUI]
|
|
[04:42] [capture-loop] iter=850 t=123.2s state={'complete': False, 'error': None, 'executedCount': 1, 'wsState': 1} eval_ms=7 ram=3.8/7.0GB (74%) swap=0.0/0.0GB (0%) cpu=81% browser_rss=0.29GB
|
|
[04:45] [ComfyUI] [SubprocessWorker] got response: ok
|
|
[04:45] [ComfyUI] [comfy-env] SAM3Segmentation done (90.62s): result: NodeOutput
|
|
[04:46] Node executed (2 total), capturing...
|
|
[04:46] [ComfyUI] Prompt executed in 126.52 seconds
|
|
[04:47] Frame 16 saved (frame_015.jpg, t=127.3s)
|
|
[04:47] [capture-node] freeze=4ms shot=483ms unfreeze=8ms saved=True
|
|
[04:47] Node executed (3 total), capturing...
|
|
[04:47] Frame 17 saved (frame_016.jpg, t=128.3s)
|
|
[04:47] [capture-node] freeze=5ms shot=270ms unfreeze=0ms saved=True
|
|
[04:47] Execution complete (t=128.3s)
|
|
[04:47] Captured 17 unique frames over 128.64s
|
|
[04:47] [debug] iframes: 0
|
|
[04:47] [timing] trigger_3d_previews: 0.0s
|
|
[04:50] Saved high-quality screenshot: image_seg_point_executed.png
|
|
[04:50] [timing] final_screenshot: 0.4s
|
|
[04:50] Capturing execution frames: image_seg_text.json
|
|
[04:58] Frame 1 saved (frame_000.jpg, t=0.0s)
|
|
[04:58] Validating workflow...
|
|
[04:58] [ComfyUI] === /validate endpoint called ===
|
|
[04:58] [ComfyUI] Received JSON with keys: ['prompt']
|
|
[04:58] [ComfyUI] Prompt has 5 nodes
|
|
[04:58] [ComfyUI] Node 1: LoadImage
|
|
[04:58] Queuing workflow for execution...
|
|
[04:58] [ComfyUI] Inputs: {"image": "example_image.jpg"}
|
|
[04:58] [ComfyUI] Node 3: PreviewImage
|
|
[04:58] [ComfyUI] Inputs: {"images": ["15", 1]}
|
|
[04:58] [ComfyUI] Node 4: MaskPreview
|
|
[04:58] [ComfyUI] Inputs: {"mask": ["15", 0]}
|
|
[04:58] [ComfyUI] Node 12: LoadSAM3Model
|
|
[04:59] [ComfyUI] Inputs: {"precision": "fp32", "compile": false}
|
|
[04:59] [ComfyUI] Node 15: SAM3Grounding
|
|
[04:59] [ComfyUI] Inputs: {"confidence_threshold": 0.2, "text_prompt": "child", "max_detections": -1, "sam3_model_config": ["12", 0], "image": ["1", 0]}
|
|
[04:59] [ComfyUI] Generated prompt_id: 10797ef8-b644-4c26-8823-cef0f948467a
|
|
[04:59] [ComfyUI] Calling execution.validate_prompt()...
|
|
[04:59] [ComfyUI] Validation result: valid=True
|
|
[04:59] [ComfyUI] === Validation PASSED ===
|
|
[04:59] [ComfyUI] got prompt
|
|
[04:59] [ComfyUI] [comfy-env] Running LoadSAM3Model: precision: 'fp32', compile: False
|
|
[04:59] [ComfyUI] [SubprocessWorker] call_method: nodes.load_model.LoadSAM3Model.EXECUTE_NORMALIZED
|
|
[04:59] [ComfyUI] [SubprocessWorker] acquired lock, ensuring started...
|
|
[04:59] [ComfyUI] [ComfyUI-SAM3] Health check: ping (timeout=5.0s)...
|
|
[04:59] [ComfyUI] [ComfyUI-SAM3] Health check: ok
|
|
[04:59] [ComfyUI] [SubprocessWorker] worker started/confirmed
|
|
[04:59] [ComfyUI] [SubprocessWorker] serializing kwargs to shm...
|
|
[04:59] [ComfyUI] [SubprocessWorker] created 0 shm blocks
|
|
[04:59] [ComfyUI] [SubprocessWorker] sending request via socket...
|
|
[04:59] [ComfyUI] [SubprocessWorker] call_id=4 sending call_method
|
|
[04:59] [ComfyUI] [SubprocessWorker] got response: ok
|
|
[04:59] [ComfyUI] [comfy-env] LoadSAM3Model done (0.28s): result: NodeOutput
|
|
[04:59] [ComfyUI] [comfy-env] Running SAM3Grounding: confidence_threshold: 0.2, text_prompt: 'child', max_detections: -1, sam3_model_config: dict, image: torch.float32 [1,720,1280,3] cpu
|
|
[04:59] [ComfyUI] [SubprocessWorker] call_method: nodes.segmentation.SAM3Grounding.EXECUTE_NORMALIZED
|
|
[04:59] [ComfyUI] [SubprocessWorker] acquired lock, ensuring started...
|
|
[04:59] [ComfyUI] [ComfyUI-SAM3] Health check: ping (timeout=5.0s)...
|
|
[04:59] [ComfyUI] [ComfyUI-SAM3] Health check: ok
|
|
[04:59] [ComfyUI] [SubprocessWorker] worker started/confirmed
|
|
[04:59] [ComfyUI] [comfy-env] PRE-SERIALIZE 'image' shape: torch.Size([1, 720, 1280, 3])
|
|
[04:59] [ComfyUI] [SubprocessWorker] serializing kwargs to shm...
|
|
[04:59] [ComfyUI] [SubprocessWorker] created 0 shm blocks
|
|
[04:59] [ComfyUI] [SubprocessWorker] sending request via socket...
|
|
[04:59] [ComfyUI] [SubprocessWorker] call_id=5 sending call_method
|
|
[04:59] [ComfyUI] [worker:ComfyUI-SAM3] [comfy-env] _from_shm got dict with keys: ['__type__', 'strategy', 'manager_path', 'storage_key', 'storage_size']
|
|
[04:59] [ComfyUI] [worker:ComfyUI-SAM3] [comfy-env] DESERIALIZE TensorRef: tensor_size=[1, 720, 1280, 3]
|
|
[04:59] [ComfyUI] [worker:ComfyUI-SAM3] [comfy-env] DESERIALIZED tensor shape: torch.Size([1, 720, 1280, 3])
|
|
[05:01] Frame 2 saved (frame_001.jpg, t=2.9s)
|
|
[05:01] [capture-periodic] freeze=6ms shot=193ms unfreeze=5ms saved=True
|
|
[05:01] [ComfyUI] [SubprocessWorker] callback 'request_vram_budget' from call_id=5
|
|
[05:01] [ComfyUI] [comfy-env] VRAM request: 3.50GB, free before eviction: 1.52GB
|
|
[05:01] [ComfyUI] [comfy-env] VRAM after eviction: 1.52GB
|
|
[05:03] Frame 3 saved (frame_002.jpg, t=5.2s)
|
|
[05:03] [capture-periodic] freeze=3ms shot=236ms unfreeze=3ms saved=True
|
|
[05:05] [capture-loop] iter=50 t=7.3s state={'complete': False, 'error': None, 'executedCount': 0, 'wsState': 1} eval_ms=4 ram=4.1/7.0GB (70%) swap=0.0/0.0GB (0%) cpu=88% browser_rss=0.53GB
|
|
[05:08] Frame 4 saved (frame_003.jpg, t=7.5s)
|
|
[05:08] [capture-periodic] freeze=4ms shot=2564ms unfreeze=11ms saved=True
|
|
[05:14] Frame 5 saved (frame_004.jpg, t=14.1s)
|
|
[05:14] [capture-periodic] freeze=320ms shot=2068ms unfreeze=15ms saved=True
|
|
[05:17] Frame 6 saved (frame_005.jpg, t=18.6s)
|
|
[05:17] [capture-periodic] freeze=5ms shot=987ms unfreeze=17ms saved=True
|
|
[05:34] [capture-loop] iter=100 t=36.4s state={'complete': False, 'error': None, 'executedCount': 0, 'wsState': 1} eval_ms=60 ram=2.9/7.0GB (86%) swap=1.6/2.0GB (80%) cpu=73% browser_rss=0.26GB
|
|
[05:40] [ComfyUI] [worker:ComfyUI-SAM3]
|
|
[05:40] [ComfyUI] === WATCHDOG TICK 3 ===
|
|
[05:40] [ComfyUI] [worker:ComfyUI-SAM3] Current thread 0x0000000170d83000 (most recent call first):
|
|
[05:40] [ComfyUI] File "/var/folders/tb/y368xp_x10s3ty1b_mtl5mxr0000gn/T/comfyui_pvenv_9iclx1mf/persistent_worker.py", line 52 in _watchdog
|
|
[05:40] [ComfyUI] File "/Users/runner/.ce/.pixi/envs/sam3-nodes/lib/python3.10/threading.py", line 953 in run
|
|
[05:40] [ComfyUI] File "/Users/runner/.ce/.pixi/envs/sam3-nodes/lib/python3.10/threading.py", line 1016 in _bootstrap_inner
|
|
[05:40] [ComfyUI] File "/Users/runner/.ce/.pixi/envs/sam3-nodes/lib/python3.10/threading.py", line 973 in _bootstrap
|
|
[05:40] [ComfyUI]
|
|
[05:40] [ComfyUI] Thread 0x00000002054da240 (most recent call first):
|
|
[05:40] [ComfyUI] File "/Users/runner/.ce/.pixi/envs/sam3-nodes/lib/python3.10/site-packages/torch/nn/modules/module.py", line 1370 in convert
|
|
[05:40] [ComfyUI] File "/Users/runner/.ce/.pixi/envs/sam3-nodes/lib/python3.10/site-packages/torch/nn/modules/module.py", line 965 in _apply
|
|
[05:40] [ComfyUI] File "/Users/runner/.ce/.pixi/envs/sam3-nodes/lib/python3.10/site-packages/torch/nn/modules/module.py", line 1384 in to
|
|
[05:40] [ComfyUI] File "/var/folders/tb/y368xp_x10s3ty1b_mtl5mxr0000gn/T/comfyui_pvenv_9iclx1mf/persistent_worker.py", line 1341 in _hooked_to
|
|
[05:40] [ComfyUI] File "/Users/runner/work/comfy-gpu-ci/comfy-gpu-ci/test_workspaces/SAM3-2137/ComfyUI/comfy/model_patcher.py", line 885 in load
|
|
[05:40] [ComfyUI] File "/Users/runner/work/comfy-gpu-ci/comfy-gpu-ci/test_workspaces/SAM3-2137/ComfyUI/comfy/model_patcher.py", line 1079 in partially_load
|
|
[05:40] [ComfyUI] File "/Users/runner/work/comfy-gpu-ci/comfy-gpu-ci/test_workspaces/SAM3-2137/ComfyUI/comfy/model_management.py", line 607 in model_use_more_vram
|
|
[05:40] [ComfyUI] File "/Users/runner/work/comfy-gpu-ci/comfy-gpu-ci/test_workspaces/SAM3-2137/ComfyUI/comfy/model_management.py", line 579 in model_load
|
|
[05:40] [ComfyUI] File "/Users/runner/work/comfy-gpu-ci/comfy-gpu-ci/test_workspaces/SAM3-2137/ComfyUI/comfy/model_management.py", line 817 in load_models_gpu
|
|
[05:40] [ComfyUI] File "/var/folders/tb/y368xp_x10s3ty1b_mtl5mxr0000gn/T/comfyui_pvenv_9iclx1mf/persistent_worker.py", line 1539 in _shimmed_load_models_gpu
|
|
[05:40] [ComfyUI] File "/Users/runner/work/comfy-gpu-ci/comfy-gpu-ci/test_workspaces/SAM3-2137/ComfyUI/custom_nodes/ComfyUI-SAM3/nodes/segmentation.py", line 87 in execute
|
|
[05:40] [ComfyUI] File "/Users/runner/work/comfy-gpu-ci/comfy-gpu-ci/test_workspaces/SAM3-2137/ComfyUI/comfy_api/latest/_io.py", line 1833 in EXECUTE_NORMALIZED
|
|
[05:40] [ComfyUI] File "/var/folders/tb/y368xp_x10s3ty1b_mtl5mxr0000gn/T/comfyui_pvenv_9iclx1mf/persistent_worker.py", line 1762 in main
|
|
[05:40] [ComfyUI] File "/var/folders/tb/y368xp_x10s3ty1b_mtl5mxr0000gn/T/comfyui_pvenv_9iclx1mf/persistent_worker.py", line 1807 in <module>
|
|
[05:40] [ComfyUI]
|
|
[05:40] [ComfyUI] [worker:ComfyUI-SAM3] === END ===
|
|
[05:40] [ComfyUI]
|
|
[05:46] [capture-loop] iter=150 t=48.2s state={'complete': False, 'error': None, 'executedCount': 0, 'wsState': 1} eval_ms=10 ram=1.7/7.0GB (82%) swap=3.3/4.0GB (82%) cpu=66% browser_rss=0.25GB
|
|
[05:54] [capture-loop] iter=200 t=56.5s state={'complete': False, 'error': None, 'executedCount': 0, 'wsState': 1} eval_ms=3 ram=2.7/7.0GB (57%) swap=3.3/4.0GB (82%) cpu=70% browser_rss=0.27GB
|
|
[06:15] Frame 7 saved (frame_006.jpg, t=62.2s)
|
|
[06:15] [capture-periodic] freeze=4ms shot=13216ms unfreeze=993ms saved=True
|
|
[06:25] [capture-loop] iter=250 t=87.2s state={'complete': False, 'error': None, 'executedCount': 0, 'wsState': 1} eval_ms=5 ram=5.7/7.0GB (87%) swap=1.2/2.0GB (62%) cpu=60% browser_rss=0.18GB
|
|
[06:30] Frame 8 saved (frame_007.jpg, t=88.6s)
|
|
[06:30] [capture-periodic] freeze=7ms shot=3410ms unfreeze=77ms saved=True
|
|
[06:40] [ComfyUI] [worker:ComfyUI-SAM3]
|
|
[06:40] [ComfyUI] === WATCHDOG TICK 4 ===
|
|
[06:40] [ComfyUI] [worker:ComfyUI-SAM3] Current thread 0x0000000170d83000 (most recent call first):
|
|
[06:40] [ComfyUI] File "/var/folders/tb/y368xp_x10s3ty1b_mtl5mxr0000gn/T/comfyui_pvenv_9iclx1mf/persistent_worker.py", line 52 in _watchdog
|
|
[06:40] [ComfyUI] File "/Users/runner/.ce/.pixi/envs/sam3-nodes/lib/python3.10/threading.py", line 953 in run
|
|
[06:40] [ComfyUI] File "/Users/runner/.ce/.pixi/envs/sam3-nodes/lib/python3.10/threading.py", line 1016 in _bootstrap_inner
|
|
[06:40] [ComfyUI] File "/Users/runner/.ce/.pixi/envs/sam3-nodes/lib/python3.10/threading.py", line 973 in _bootstrap
|
|
[06:40] [ComfyUI]
|
|
[06:40] [ComfyUI] Thread 0x00000002054da240 (most recent call first):
|
|
[06:40] [ComfyUI] File "/Users/runner/.ce/.pixi/envs/sam3-nodes/lib/python3.10/site-packages/torch/nn/modules/conv.py", line 548 in _conv_forward
|
|
[06:40] [ComfyUI] File "/Users/runner/work/comfy-gpu-ci/comfy-gpu-ci/test_workspaces/SAM3-2137/ComfyUI/comfy/ops.py", line 509 in forward_comfy_cast_weights
|
|
[06:40] [ComfyUI] File "/Users/runner/work/comfy-gpu-ci/comfy-gpu-ci/test_workspaces/SAM3-2137/ComfyUI/comfy/ops.py", line 516 in forward
|
|
[06:40] [ComfyUI] File "/Users/runner/.ce/.pixi/envs/sam3-nodes/lib/python3.10/site-packages/torch/nn/modules/module.py", line 1790 in _call_impl
|
|
[06:40] [ComfyUI] File "/Users/runner/.ce/.pixi/envs/sam3-nodes/lib/python3.10/site-packages/torch/nn/modules/module.py", line 1779 in _wrapped_call_impl
|
|
[06:40] [ComfyUI] File "/Users/runner/.ce/.pixi/envs/sam3-nodes/lib/python3.10/site-packages/torch/nn/modules/container.py", line 253 in forward
|
|
[06:40] [ComfyUI] File "/Users/runner/.ce/.pixi/envs/sam3-nodes/lib/python3.10/site-packages/torch/nn/modules/module.py", line 1790 in _call_impl
|
|
[06:40] [ComfyUI] File "/Users/runner/.ce/.pixi/envs/sam3-nodes/lib/python3.10/site-packages/torch/nn/modules/module.py", line 1779 in _wrapped_call_impl
|
|
[06:40] [ComfyUI] File "/Users/runner/work/comfy-gpu-ci/comfy-gpu-ci/test_workspaces/SAM3-2137/ComfyUI/custom_nodes/ComfyUI-SAM3/nodes/sam3/model.py", line 2049 in forward
|
|
[06:40] [ComfyUI] File "/Users/runner/work/comfy-gpu-ci/comfy-gpu-ci/test_workspaces/SAM3-2137/ComfyUI/custom_nodes/ComfyUI-SAM3/nodes/sam3/model.py", line 3321 in _forward_image_no_act_ckpt
|
|
[06:40] [ComfyUI] File "/Users/runner/work/comfy-gpu-ci/comfy-gpu-ci/test_workspaces/SAM3-2137/ComfyUI/custom_nodes/ComfyUI-SAM3/nodes/sam3/model.py", line 3314 in forward_image
|
|
[06:40] [ComfyUI] File "/Users/runner/work/comfy-gpu-ci/comfy-gpu-ci/test_workspaces/SAM3-2137/ComfyUI/custom_nodes/ComfyUI-SAM3/nodes/sam3/utils.py", line 1324 in set_image
|
|
[06:40] [ComfyUI] File "/Users/runner/.ce/.pixi/envs/sam3-nodes/lib/python3.10/site-packages/torch/utils/_contextlib.py", line 124 in decorate_context
|
|
[06:40] [ComfyUI] File "/Users/runner/work/comfy-gpu-ci/comfy-gpu-ci/test_workspaces/SAM3-2137/ComfyUI/custom_nodes/ComfyUI-SAM3/nodes/segmentation.py", line 133 in _segment_grounding
|
|
[06:40] [ComfyUI] File "/Users/runner/work/comfy-gpu-ci/comfy-gpu-ci/test_workspaces/SAM3-2137/ComfyUI/custom_nodes/ComfyUI-SAM3/nodes/segmentation.py", line 111 in execute
|
|
[06:40] [ComfyUI] File "/Users/runner/work/comfy-gpu-ci/comfy-gpu-ci/test_workspaces/SAM3-2137/ComfyUI/comfy_api/latest/_io.py", line 1833 in EXECUTE_NORMALIZED
|
|
[06:40] [ComfyUI] File "/var/folders/tb/y368xp_x10s3ty1b_mtl5mxr0000gn/T/comfyui_pvenv_9iclx1mf/persistent_worker.py", line 1762 in main
|
|
[06:40] [ComfyUI] File "/var/folders/tb/y368xp_x10s3ty1b_mtl5mxr0000gn/T/comfyui_pvenv_9iclx1mf/persistent_worker.py", line 1807 in <module>
|
|
[06:40] [ComfyUI]
|
|
[06:40] [ComfyUI] [worker:ComfyUI-SAM3] === END ===
|
|
[06:40] [ComfyUI]
|
|
[06:41] Frame 9 saved (frame_008.jpg, t=96.9s)
|
|
[06:41] [capture-periodic] freeze=322ms shot=6306ms unfreeze=26ms saved=True
|
|
[06:42] [capture-loop] iter=300 t=104.5s state={'complete': False, 'error': None, 'executedCount': 0, 'wsState': 1} eval_ms=4 ram=4.4/7.0GB (89%) swap=1.6/2.0GB (81%) cpu=72% browser_rss=0.15GB
|
|
[06:48] Frame 10 saved (frame_009.jpg, t=105.6s)
|
|
[06:48] [capture-periodic] freeze=6ms shot=4824ms unfreeze=7ms saved=True
|
|
[07:00] [ComfyUI] /Users/runner/work/comfy-gpu-ci/comfy-gpu-ci/test_workspaces/SAM3-2137/ComfyUI/custom_nodes/ComfyUI-SAM3/nodes/sam3/utils.py:1824: UserWarning: The operator 'aten::_assert_async' is not currently supported on the MPS backend and will fall back to run on the CPU. This may have performance implications. (Triggered internally at /Users/runner/work/pytorch/pytorch/pytorch/aten/src/ATen/mps/MPSFallback.mm:34.)
|
|
[07:01] [ComfyUI] torch._assert_async(is_right_padded(mask1))
|
|
[07:01] Frame 11 saved (frame_010.jpg, t=115.0s)
|
|
[07:01] [capture-periodic] freeze=4ms shot=7971ms unfreeze=29ms saved=True
|
|
[07:01] [capture-loop] iter=350 t=123.7s state={'complete': False, 'error': None, 'executedCount': 0, 'wsState': 1} eval_ms=4 ram=2.3/7.0GB (84%) swap=1.3/2.0GB (64%) cpu=70% browser_rss=0.18GB
|
|
[07:03] Frame 12 saved (frame_011.jpg, t=125.2s)
|
|
[07:03] [capture-periodic] freeze=7ms shot=498ms unfreeze=4ms saved=True
|
|
[07:08] [capture-loop] iter=400 t=130.4s state={'complete': False, 'error': None, 'executedCount': 0, 'wsState': 1} eval_ms=3 ram=2.0/7.0GB (80%) swap=1.7/2.0GB (86%) cpu=71% browser_rss=0.19GB
|
|
[07:16] Frame 13 saved (frame_012.jpg, t=132.3s)
|
|
[07:16] [capture-periodic] freeze=6ms shot=6069ms unfreeze=10ms saved=True
|
|
[07:18] Frame 14 saved (frame_013.jpg, t=140.5s)
|
|
[07:18] [capture-periodic] freeze=4ms shot=183ms unfreeze=18ms saved=True
|
|
[07:20] [capture-loop] iter=450 t=142.4s state={'complete': False, 'error': None, 'executedCount': 0, 'wsState': 1} eval_ms=6 ram=3.8/7.0GB (88%) swap=1.9/3.0GB (64%) cpu=70% browser_rss=0.19GB
|
|
[07:27] [capture-loop] iter=500 t=148.8s state={'complete': False, 'error': None, 'executedCount': 0, 'wsState': 1} eval_ms=3 ram=2.8/7.0GB (73%) swap=1.9/3.0GB (63%) cpu=64% browser_rss=0.19GB
|
|
[07:33] [capture-loop] iter=550 t=155.7s state={'complete': False, 'error': None, 'executedCount': 0, 'wsState': 1} eval_ms=3 ram=3.8/7.0GB (88%) swap=2.0/3.0GB (67%) cpu=68% browser_rss=0.19GB
|
|
[07:40] [capture-loop] iter=600 t=161.8s state={'complete': False, 'error': None, 'executedCount': 0, 'wsState': 1} eval_ms=5 ram=3.2/7.0GB (82%) swap=2.0/3.0GB (66%) cpu=67% browser_rss=0.18GB
|
|
[07:41] [ComfyUI] [worker:ComfyUI-SAM3]
|
|
[07:41] [ComfyUI] === WATCHDOG TICK 5 ===
|
|
[07:41] [ComfyUI] [worker:ComfyUI-SAM3] Current thread 0x0000000170d83000 (most recent call first):
|
|
[07:41] [ComfyUI] File "/var/folders/tb/y368xp_x10s3ty1b_mtl5mxr0000gn/T/comfyui_pvenv_9iclx1mf/persistent_worker.py", line 52 in _watchdog
|
|
[07:41] [ComfyUI] File "/Users/runner/.ce/.pixi/envs/sam3-nodes/lib/python3.10/threading.py", line 953 in run
|
|
[07:41] [ComfyUI] File "/Users/runner/.ce/.pixi/envs/sam3-nodes/lib/python3.10/threading.py", line 1016 in _bootstrap_inner
|
|
[07:41] [ComfyUI] File "/Users/runner/.ce/.pixi/envs/sam3-nodes/lib/python3.10/threading.py", line 973 in _bootstrap
|
|
[07:41] [ComfyUI]
|
|
[07:41] [ComfyUI] Thread 0x00000002054da240 (most recent call first):
|
|
[07:41] [ComfyUI] File "/Users/runner/work/comfy-gpu-ci/comfy-gpu-ci/test_workspaces/SAM3-2137/ComfyUI/custom_nodes/ComfyUI-SAM3/nodes/sam3/perflib.py", line 107 in nms_masks
|
|
[07:41] [ComfyUI] File "/Users/runner/work/comfy-gpu-ci/comfy-gpu-ci/test_workspaces/SAM3-2137/ComfyUI/custom_nodes/ComfyUI-SAM3/nodes/sam3/utils.py", line 1502 in _forward_grounding
|
|
[07:41] [ComfyUI] File "/Users/runner/.ce/.pixi/envs/sam3-nodes/lib/python3.10/site-packages/torch/utils/_contextlib.py", line 124 in decorate_context
|
|
[07:41] [ComfyUI] File "/Users/runner/work/comfy-gpu-ci/comfy-gpu-ci/test_workspaces/SAM3-2137/ComfyUI/custom_nodes/ComfyUI-SAM3/nodes/sam3/utils.py", line 1393 in set_text_prompt
|
|
[07:41] [ComfyUI] File "/Users/runner/.ce/.pixi/envs/sam3-nodes/lib/python3.10/site-packages/torch/utils/_contextlib.py", line 124 in decorate_context
|
|
[07:41] [ComfyUI] File "/Users/runner/work/comfy-gpu-ci/comfy-gpu-ci/test_workspaces/SAM3-2137/ComfyUI/custom_nodes/ComfyUI-SAM3/nodes/segmentation.py", line 138 in _segment_grounding
|
|
[07:41] [ComfyUI] File "/Users/runner/work/comfy-gpu-ci/comfy-gpu-ci/test_workspaces/SAM3-2137/ComfyUI/custom_nodes/ComfyUI-SAM3/nodes/segmentation.py", line 111 in execute
|
|
[07:41] [ComfyUI] File "/Users/runner/work/comfy-gpu-ci/comfy-gpu-ci/test_workspaces/SAM3-2137/ComfyUI/comfy_api/latest/_io.py", line 1833 in EXECUTE_NORMALIZED
|
|
[07:41] [ComfyUI] File "/var/folders/tb/y368xp_x10s3ty1b_mtl5mxr0000gn/T/comfyui_pvenv_9iclx1mf/persistent_worker.py", line 1762 in main
|
|
[07:41] [ComfyUI] File "/var/folders/tb/y368xp_x10s3ty1b_mtl5mxr0000gn/T/comfyui_pvenv_9iclx1mf/persistent_worker.py", line 1807 in <module>
|
|
[07:41] [ComfyUI]
|
|
[07:41] [ComfyUI] [worker:ComfyUI-SAM3] === END ===
|
|
[07:41] [ComfyUI]
|
|
[07:45] [ComfyUI] [SubprocessWorker] got response: error
|
|
[07:46] [ComfyUI] !!! Exception during processing !!! Expected all tensors to be on the same device, but found at least two devices, mps:0 and cpu!
|
|
[07:46] [ComfyUI]
|
|
[07:46] [ComfyUI] Worker traceback:
|
|
[07:46] [ComfyUI] Traceback (most recent call last):
|
|
[07:46] [ComfyUI] File "/var/folders/tb/y368xp_x10s3ty1b_mtl5mxr0000gn/T/comfyui_pvenv_9iclx1mf/persistent_worker.py", line 1762, in main
|
|
[07:46] [ComfyUI] result = method(**inputs)
|
|
[07:46] [ComfyUI] File "/Users/runner/work/comfy-gpu-ci/comfy-gpu-ci/test_workspaces/SAM3-2137/ComfyUI/comfy_api/latest/_io.py", line 1833, in EXECUTE_NORMALIZED
|
|
[07:46] [ComfyUI] to_return = cls.execute(*args, **kwargs)
|
|
[07:46] [ComfyUI] File "/Users/runner/work/comfy-gpu-ci/comfy-gpu-ci/test_workspaces/SAM3-2137/ComfyUI/custom_nodes/ComfyUI-SAM3/nodes/segmentation.py", line 111, in execute
|
|
[07:46] [ComfyUI] result = cls._segment_grounding(
|
|
[07:46] [ComfyUI] File "/Users/runner/work/comfy-gpu-ci/comfy-gpu-ci/test_workspaces/SAM3-2137/ComfyUI/custom_nodes/ComfyUI-SAM3/nodes/segmentation.py", line 201, in _segment_grounding
|
|
[07:46] [ComfyUI] vis_image = visualize_masks_on_image(
|
|
[07:46] [ComfyUI] File "/Users/runner/work/comfy-gpu-ci/comfy-gpu-ci/test_workspaces/SAM3-2137/ComfyUI/custom_nodes/ComfyUI-SAM3/nodes/utils.py", line 164, in visualize_masks_on_image
|
|
[07:46] [ComfyUI] overlay = torch.where(mask_3d, overlay * (1 - alpha) + color * alpha, overlay)
|
|
[07:46] [ComfyUI] RuntimeError: Expected all tensors to be on the same device, but found at least two devices, mps:0 and cpu!
|
|
[07:46] [ComfyUI]
|
|
[07:46] [ComfyUI] Traceback (most recent call last):
|
|
[07:46] [ComfyUI] File "/Users/runner/work/comfy-gpu-ci/comfy-gpu-ci/test_workspaces/SAM3-2137/ComfyUI/execution.py", line 535, in execute
|
|
[07:46] [ComfyUI] output_data, output_ui, has_subgraph, has_pending_tasks = await get_output_data(prompt_id, unique_id, obj, input_data_all, execution_block_cb=execution_block_cb, pre_execute_cb=pre_execute_cb, v3_data=v3_data)
|
|
[07:46] [ComfyUI] File "/Users/runner/work/comfy-gpu-ci/comfy-gpu-ci/test_workspaces/SAM3-2137/ComfyUI/execution.py", line 335, in get_output_data
|
|
[07:46] [ComfyUI] return_values = await _async_map_node_over_list(prompt_id, unique_id, obj, input_data_all, obj.FUNCTION, allow_interrupt=True, execution_block_cb=execution_block_cb, pre_execute_cb=pre_execute_cb, v3_data=v3_data)
|
|
[07:46] [ComfyUI] File "/Users/runner/work/comfy-gpu-ci/comfy-gpu-ci/test_workspaces/SAM3-2137/ComfyUI/execution.py", line 309, in _async_map_node_over_list
|
|
[07:46] [ComfyUI] await process_inputs(input_dict, i)
|
|
[07:46] [ComfyUI] File "/Users/runner/work/comfy-gpu-ci/comfy-gpu-ci/test_workspaces/SAM3-2137/ComfyUI/execution.py", line 297, in process_inputs
|
|
[07:46] [ComfyUI] result = f(**inputs)
|
|
[07:46] [ComfyUI] File "/Users/runner/work/comfy-gpu-ci/comfy-gpu-ci/test_workspaces/SAM3-2137/venv/lib/python3.10/site-packages/comfy_env/isolation/metadata.py", line 536, in proxy
|
|
[07:46] [ComfyUI] result = worker.call_method(
|
|
[07:46] [ComfyUI] File "/Users/runner/work/comfy-gpu-ci/comfy-gpu-ci/test_workspaces/SAM3-2137/venv/lib/python3.10/site-packages/comfy_env/isolation/workers/subprocess.py", line 674, in call_method
|
|
[07:46] [ComfyUI] raise WorkerError(
|
|
[07:46] [ComfyUI] comfy_env.isolation.workers.base.WorkerError: Expected all tensors to be on the same device, but found at least two devices, mps:0 and cpu!
|
|
[07:46] [ComfyUI]
|
|
[07:46] [ComfyUI] Worker traceback:
|
|
[07:46] [ComfyUI] Traceback (most recent call last):
|
|
[07:46] [ComfyUI] File "/var/folders/tb/y368xp_x10s3ty1b_mtl5mxr0000gn/T/comfyui_pvenv_9iclx1mf/persistent_worker.py", line 1762, in main
|
|
[07:46] [ComfyUI] result = method(**inputs)
|
|
[07:46] [ComfyUI] File "/Users/runner/work/comfy-gpu-ci/comfy-gpu-ci/test_workspaces/SAM3-2137/ComfyUI/comfy_api/latest/_io.py", line 1833, in EXECUTE_NORMALIZED
|
|
[07:46] [ComfyUI] to_return = cls.execute(*args, **kwargs)
|
|
[07:46] [ComfyUI] File "/Users/runner/work/comfy-gpu-ci/comfy-gpu-ci/test_workspaces/SAM3-2137/ComfyUI/custom_nodes/ComfyUI-SAM3/nodes/segmentation.py", line 111, in execute
|
|
[07:46] [ComfyUI] result = cls._segment_grounding(
|
|
[07:46] [ComfyUI] File "/Users/runner/work/comfy-gpu-ci/comfy-gpu-ci/test_workspaces/SAM3-2137/ComfyUI/custom_nodes/ComfyUI-SAM3/nodes/segmentation.py", line 201, in _segment_grounding
|
|
[07:46] [ComfyUI] vis_image = visualize_masks_on_image(
|
|
[07:46] [ComfyUI] File "/Users/runner/work/comfy-gpu-ci/comfy-gpu-ci/test_workspaces/SAM3-2137/ComfyUI/custom_nodes/ComfyUI-SAM3/nodes/utils.py", line 164, in visualize_masks_on_image
|
|
[07:46] [ComfyUI] overlay = torch.where(mask_3d, overlay * (1 - alpha) + color * alpha, overlay)
|
|
[07:46] [ComfyUI] RuntimeError: Expected all tensors to be on the same device, but found at least two devices, mps:0 and cpu!
|
|
[07:46] [ComfyUI]
|
|
[07:46] [ComfyUI]
|
|
[07:46] [ComfyUI] Prompt executed in 167.49 seconds
|
|
[07:47] Execution complete (t=168.9s)
|
|
[07:47] Execution error: {'prompt_id': 'd49ef70f-d2d0-4eaf-bcc9-9bb34ce2e60a', 'node_id': '15', 'node_type': 'SAM3Grounding', 'executed': ['12', '1'], 'exception_message': 'Expected all tensors to be on the same device, but found at least two devices, mps:0 and cpu!\n\nWorker traceback:\nTraceback (most recent call last):\n File "/var/folders/tb/y368xp_x10s3ty1b_mtl5mxr0000gn/T/comfyui_pvenv_9iclx1mf/persistent_worker.py", line 1762, in main\n result = method(**inputs)\n File "/Users/runner/work/comfy-gpu-ci/comfy-gpu-ci/test_workspaces/SAM3-2137/ComfyUI/comfy_api/latest/_io.py", line 1833, in EXECUTE_NORMALIZED\n to_return = cls.execute(*args, **kwargs)\n File "/Users/runner/work/comfy-gpu-ci/comfy-gpu-ci/test_workspaces/SAM3-2137/ComfyUI/custom_nodes/ComfyUI-SAM3/nodes/segmentation.py", line 111, in execute\n result = cls._segment_grounding(\n File "/Users/runner/work/comfy-gpu-ci/comfy-gpu-ci/test_workspaces/SAM3-2137/ComfyUI/custom_nodes/ComfyUI-SAM3/nodes/segmentation.py", line 201, in _segment_grounding\n vis_image = visualize_masks_on_image(\n File "/Users/runner/work/comfy-gpu-ci/comfy-gpu-ci/test_workspaces/SAM3-2137/ComfyUI/custom_nodes/ComfyUI-SAM3/nodes/utils.py", line 164, in visualize_masks_on_image\n overlay = torch.where(mask_3d, overlay * (1 - alpha) + color * alpha, overlay)\nRuntimeError: Expected all tensors to be on the same device, but found at least two devices, mps:0 and cpu!\n\n', 'exception_type': 'comfy_env.isolation.workers.base.WorkerError', 'traceback': [' File "/Users/runner/work/comfy-gpu-ci/comfy-gpu-ci/test_workspaces/SAM3-2137/ComfyUI/execution.py", line 535, in execute\n output_data, output_ui, has_subgraph, has_pending_tasks = await get_output_data(prompt_id, unique_id, obj, input_data_all, execution_block_cb=execution_block_cb, pre_execute_cb=pre_execute_cb, v3_data=v3_data)\n', ' File "/Users/runner/work/comfy-gpu-ci/comfy-gpu-ci/test_workspaces/SAM3-2137/ComfyUI/execution.py", line 335, in get_output_data\n return_values = await _async_map_node_over_list(prompt_id, unique_id, obj, input_data_all, obj.FUNCTION, allow_interrupt=True, execution_block_cb=execution_block_cb, pre_execute_cb=pre_execute_cb, v3_data=v3_data)\n', ' File "/Users/runner/work/comfy-gpu-ci/comfy-gpu-ci/test_workspaces/SAM3-2137/ComfyUI/execution.py", line 309, in _async_map_node_over_list\n await process_inputs(input_dict, i)\n', ' File "/Users/runner/work/comfy-gpu-ci/comfy-gpu-ci/test_workspaces/SAM3-2137/ComfyUI/execution.py", line 297, in process_inputs\n result = f(**inputs)\n', ' File "/Users/runner/work/comfy-gpu-ci/comfy-gpu-ci/test_workspaces/SAM3-2137/venv/lib/python3.10/site-packages/comfy_env/isolation/metadata.py", line 536, in proxy\n result = worker.call_method(\n', ' File "/Users/runner/work/comfy-gpu-ci/comfy-gpu-ci/test_workspaces/SAM3-2137/venv/lib/python3.10/site-packages/comfy_env/isolation/workers/subprocess.py", line 674, in call_method\n raise WorkerError(\n'], 'current_inputs': {'confidence_threshold': [0.2], 'text_prompt': ['child'], 'max_detections': [-1], 'sam3_model_config': ["{'checkpoint_path': '/Users/runner/work/comfy-gpu-ci/comfy-gpu-ci/test_workspaces/SAM3-2137/ComfyUI/models/sam3/sam3.safetensors', 'bpe_path': '/Users/runner/work/comfy-gpu-ci/comfy-gpu-ci/test_workspaces/SAM3-2137/ComfyUI/custom_nodes/ComfyUI-SAM3/nodes/sam3/bpe_simple_vocab_16e6.txt.gz', 'precision': 'fp32', 'dtype': 'fp32', 'compile': False}"], 'image': ['tensor([[[[0.2902, 0.4667, 0.5961],\n [0.2902, 0.4667, 0.5961],\n [0.2902, 0.4667, 0.5961],\n ...,\n [0.3176, 0.5804, 0.7216],\n [0.3333, 0.6039, 0.7451],\n [0.3529, 0.6235, 0.7647]],\n\n [[0.2902, 0.4667, 0.5961],\n [0.2902, 0.4667, 0.5961],\n [0.2902, 0.4667, 0.5961],\n ...,\n [0.3137, 0.5765, 0.7176],\n [0.3137, 0.5843, 0.7255],\n [0.3255, 0.5961, 0.7373]],\n\n [[0.2902, 0.4667, 0.5961],\n [0.2902, 0.4667, 0.5961],\n [0.2902, 0.4667, 0.5961],\n ...,\n [0.3922, 0.5333, 0.6275],\n [0.3922, 0.5294, 0.6235],\n [0.3961, 0.5333, 0.6275]],\n\n ...,\n\n [[0.4941, 0.4863, 0.4157],\n [0.4941, 0.4863, 0.4157],\n [0.4980, 0.4902, 0.4196],\n ...,\n [0.5647, 0.5608, 0.5059],\n [0.5647, 0.5608, 0.5059],\n [0.5647, 0.5608, 0.5059]],\n\n [[0.5098, 0.5020, 0.4314],\n [0.5098, 0.5020, 0.4314],\n [0.5137, 0.5059, 0.4353],\n ...,\n [0.5647, 0.5608, 0.5059],\n [0.5647, 0.5608, 0.5059],\n [0.5647, 0.5608, 0.5059]],\n\n [[0.5176, 0.5098, 0.4392],\n [0.5216, 0.5137, 0.4431],\n [0.5255, 0.5176, 0.4471],\n ...,\n [0.5647, 0.5608, 0.5059],\n [0.5647, 0.5608, 0.5059],\n [0.5647, 0.5608, 0.5059]]]])']}, 'current_outputs': ['12', '3', '15', '4', '1'], 'timestamp': 1778449493366}
|
|
[07:51] Capturing execution frames: scene_seg.json
|
|
[08:00] Frame 1 saved (frame_000.jpg, t=0.0s)
|
|
[08:00] Validating workflow...
|
|
[08:00] [ComfyUI] === /validate endpoint called ===
|
|
[08:00] [ComfyUI] Received JSON with keys: ['prompt']
|
|
[08:00] [ComfyUI] Prompt has 10 nodes
|
|
[08:00] [ComfyUI] Node 1: LoadImage
|
|
[08:00] [ComfyUI] Inputs: {"image": "image.png"}
|
|
[08:00] [ComfyUI] Node 3: PreviewImage
|
|
[08:00] [ComfyUI] Inputs: {"images": ["27", 1]}
|
|
[08:00] [ComfyUI] Node 4: MaskPreview
|
|
[08:00] [ComfyUI] Inputs: {"mask": ["27", 0]}
|
|
[08:00] [ComfyUI] Node 12: LoadSAM3Model
|
|
[08:00] [ComfyUI] Inputs: {"precision": "fp32", "compile": false}
|
|
[08:00] [ComfyUI] Node 20: SAM3MultiRegionCollector
|
|
[08:00] [ComfyUI] Inputs: {"multi_prompts_store": "[{\"positive_points\":[{\"x\":5052.74953932266,\"y\":2847.0600693869637},{\"x\":4932.510591392486,\"y\":2953.9413227753366},{\"x\":4718.752461738845,\"y\":2967.301479448883},{
|
|
[08:00] [ComfyUI] Node 22: MultibandFromBatch
|
|
[08:00] [ComfyUI] Inputs: {"images": ["1", 0], "masks": ["27", 0]}
|
|
[08:00] [ComfyUI] Node 23: MultibandSave
|
|
[08:00] [ComfyUI] Inputs: {"file_path": "output/multiband", "format": "npz", "multiband": ["26", 0]}
|
|
[08:00] [ComfyUI] Node 24: MultibandPreview
|
|
[08:00] [ComfyUI] Inputs: {"channel_index": 0, "multiband": ["26", 0]}
|
|
[08:00] [ComfyUI] Node 26: MultibandResize
|
|
[08:00] Queuing workflow for execution...
|
|
[08:00] [ComfyUI] Inputs: {"upscale_method": "nearest-exact", "width": 900, "height": 600, "crop": "center", "multiband": ["22", 0]}
|
|
[08:00] [ComfyUI] Node 27: SAM3MultipromptSegmentation
|
|
[08:00] [ComfyUI] Inputs: {"refinement_iterations": 0, "use_multimask": false, "sam3_model_config": ["12", 0], "image": ["1", 0], "multi_prompts": ["20", 0]}
|
|
[08:00] [ComfyUI] Generated prompt_id: 0fce3713-a834-446e-a6e1-0cbec123e670
|
|
[08:00] [ComfyUI] Calling execution.validate_prompt()...
|
|
[08:00] [ComfyUI] Validation result: valid=True
|
|
[08:00] [ComfyUI] === Validation PASSED ===
|
|
[08:00] [ComfyUI] got prompt
|
|
[08:04] Frame 2 saved (frame_001.jpg, t=2.4s)
|
|
[08:04] [capture-periodic] freeze=29ms shot=629ms unfreeze=78ms saved=True
|
|
[08:05] [ComfyUI] [comfy-env] Running SAM3MultiRegionCollector: multi_prompts_store: '[{"positive_points":[{"x":5052.74953932266,"y":2847.0600..., image: torch.float32 [1,4480,6720,3] cpu
|
|
[08:05] [ComfyUI] [SubprocessWorker] call_method: nodes.sam3_interactive.SAM3MultiRegionCollector.EXECUTE_NORMALIZED
|
|
[08:05] [ComfyUI] [SubprocessWorker] acquired lock, ensuring started...
|
|
[08:05] [ComfyUI] [ComfyUI-SAM3] Health check: ping (timeout=5.0s)...
|
|
[08:06] [ComfyUI] [ComfyUI-SAM3] Health check: ok
|
|
[08:06] [ComfyUI] [SubprocessWorker] worker started/confirmed
|
|
[08:06] [ComfyUI] [comfy-env] PRE-SERIALIZE 'image' shape: torch.Size([1, 4480, 6720, 3])
|
|
[08:06] [ComfyUI] [SubprocessWorker] serializing kwargs to shm...
|
|
[08:06] [ComfyUI] [SubprocessWorker] created 0 shm blocks
|
|
[08:06] [ComfyUI] [SubprocessWorker] sending request via socket...
|
|
[08:06] [ComfyUI] [SubprocessWorker] call_id=6 sending call_method
|
|
[08:06] [ComfyUI] [worker:ComfyUI-SAM3] [comfy-env] _from_shm got dict with keys: ['__type__', 'strategy', 'manager_path', 'storage_key', 'storage_size']
|
|
[08:06] [ComfyUI] [worker:ComfyUI-SAM3] [comfy-env] DESERIALIZE TensorRef: tensor_size=[1, 4480, 6720, 3]
|
|
[08:06] Frame 3 saved (frame_002.jpg, t=5.5s)
|
|
[08:06] [capture-periodic] freeze=54ms shot=533ms unfreeze=7ms saved=True
|
|
[08:06] [ComfyUI] [worker:ComfyUI-SAM3] [comfy-env] DESERIALIZED tensor shape: torch.Size([1, 4480, 6720, 3])
|
|
[08:08] [ComfyUI] [SubprocessWorker] got response: ok
|
|
[08:08] [ComfyUI] [comfy-env] SAM3MultiRegionCollector done (2.59s): result: NodeOutput
|
|
[08:08] [ComfyUI] [comfy-env] Running LoadSAM3Model: precision: 'fp32', compile: False
|
|
[08:08] [ComfyUI] [SubprocessWorker] call_method: nodes.load_model.LoadSAM3Model.EXECUTE_NORMALIZED
|
|
[08:08] [ComfyUI] [SubprocessWorker] acquired lock, ensuring started...
|
|
[08:08] [ComfyUI] [ComfyUI-SAM3] Health check: ping (timeout=5.0s)...
|
|
[08:08] [ComfyUI] [ComfyUI-SAM3] Health check: ok
|
|
[08:08] [ComfyUI] [SubprocessWorker] worker started/confirmed
|
|
[08:08] [ComfyUI] [SubprocessWorker] serializing kwargs to shm...
|
|
[08:08] [ComfyUI] [SubprocessWorker] created 0 shm blocks
|
|
[08:08] [ComfyUI] [SubprocessWorker] sending request via socket...
|
|
[08:08] [ComfyUI] [SubprocessWorker] call_id=7 sending call_method
|
|
[08:08] [ComfyUI] [SubprocessWorker] got response: ok
|
|
[08:08] [ComfyUI] [comfy-env] LoadSAM3Model done (0.05s): result: NodeOutput
|
|
[08:08] [ComfyUI] [comfy-env] Running SAM3MultipromptSegmentation: refinement_iterations: 0, use_multimask: False, sam3_model_config: dict, image: torch.float32 [1,4480,6720,3] cpu, multi_prompts: list[7]
|
|
[08:08] [ComfyUI] [SubprocessWorker] call_method: nodes.segmentation.SAM3MultipromptSegmentation.EXECUTE_NORMALIZED
|
|
[08:08] [ComfyUI] [SubprocessWorker] acquired lock, ensuring started...
|
|
[08:08] [ComfyUI] [ComfyUI-SAM3] Health check: ping (timeout=5.0s)...
|
|
[08:08] [ComfyUI] [ComfyUI-SAM3] Health check: ok
|
|
[08:08] [ComfyUI] [SubprocessWorker] worker started/confirmed
|
|
[08:08] [ComfyUI] [comfy-env] PRE-SERIALIZE 'image' shape: torch.Size([1, 4480, 6720, 3])
|
|
[08:08] [ComfyUI] [SubprocessWorker] serializing kwargs to shm...
|
|
[08:08] [ComfyUI] [SubprocessWorker] created 0 shm blocks
|
|
[08:08] [ComfyUI] [SubprocessWorker] sending request via socket...
|
|
[08:08] [ComfyUI] [SubprocessWorker] call_id=8 sending call_method
|
|
[08:08] [ComfyUI] [worker:ComfyUI-SAM3] [comfy-env] _from_shm got dict with keys: ['__type__', 'strategy', 'manager_path', 'storage_key', 'storage_size']
|
|
[08:08] [ComfyUI] [worker:ComfyUI-SAM3] [comfy-env] DESERIALIZE TensorRef: tensor_size=[1, 4480, 6720, 3]
|
|
[08:08] [ComfyUI] [worker:ComfyUI-SAM3] [comfy-env] DESERIALIZED tensor shape: torch.Size([1, 4480, 6720, 3])
|
|
[08:08] [ComfyUI] [SubprocessWorker] callback 'request_vram_budget' from call_id=8
|
|
[08:08] [ComfyUI] [comfy-env] VRAM request: 3.50GB, free before eviction: 1.40GB
|
|
[08:08] [ComfyUI] [comfy-env] VRAM after eviction: 1.39GB
|
|
[08:09] Node executed (1 total), capturing...
|
|
[08:09] Frame 4 saved (frame_003.jpg, t=8.9s)
|
|
[08:09] [capture-node] freeze=155ms shot=201ms unfreeze=5ms saved=True
|
|
[08:10] [capture-loop] iter=50 t=9.5s state={'complete': False, 'error': None, 'executedCount': 1, 'wsState': 1} eval_ms=3 ram=2.6/7.0GB (75%) swap=2.7/3.0GB (89%) cpu=75% browser_rss=0.60GB
|
|
[08:45] [ComfyUI] [worker:ComfyUI-SAM3]
|
|
[08:45] [ComfyUI] === WATCHDOG TICK 6 ===
|
|
[08:45] [ComfyUI] [worker:ComfyUI-SAM3] Current thread 0x0000000170d83000 (most recent call first):
|
|
[08:45] [ComfyUI] File "/var/folders/tb/y368xp_x10s3ty1b_mtl5mxr0000gn/T/comfyui_pvenv_9iclx1mf/persistent_worker.py", line 52 in _watchdog
|
|
[08:45] [ComfyUI] File "/Users/runner/.ce/.pixi/envs/sam3-nodes/lib/python3.10/threading.py", line 953 in run
|
|
[08:45] [ComfyUI] File "/Users/runner/.ce/.pixi/envs/sam3-nodes/lib/python3.10/threading.py", line 1016 in _bootstrap_inner
|
|
[08:45] [ComfyUI] File "/Users/runner/.ce/.pixi/envs/sam3-nodes/lib/python3.10/threading.py", line 973 in _bootstrap
|
|
[08:45] [ComfyUI]
|
|
[08:45] [ComfyUI] Thread 0x00000002054da240 (most recent call first):
|
|
[08:45] [ComfyUI] File "/Users/runner/work/comfy-gpu-ci/comfy-gpu-ci/test_workspaces/SAM3-2137/ComfyUI/comfy/ldm/modules/sub_quadratic_attention.py", line 181 in _get_attention_scores_no_kv_chunking
|
|
[08:45] [ComfyUI] File "/Users/runner/work/comfy-gpu-ci/comfy-gpu-ci/test_workspaces/SAM3-2137/ComfyUI/comfy/ldm/modules/sub_quadratic_attention.py", line 269 in <listcomp>
|
|
[08:45] [ComfyUI] File "/Users/runner/work/comfy-gpu-ci/comfy-gpu-ci/test_workspaces/SAM3-2137/ComfyUI/comfy/ldm/modules/sub_quadratic_attention.py", line 268 in efficient_dot_product_attention
|
|
[08:45] [ComfyUI] File "/Users/runner/work/comfy-gpu-ci/comfy-gpu-ci/test_workspaces/SAM3-2137/ComfyUI/comfy/ldm/modules/attention.py", line 275 in attention_sub_quad
|
|
[08:45] [ComfyUI] File "/Users/runner/work/comfy-gpu-ci/comfy-gpu-ci/test_workspaces/SAM3-2137/ComfyUI/comfy/ldm/modules/attention.py", line 139 in wrapper
|
|
[08:45] [ComfyUI] File "/Users/runner/work/comfy-gpu-ci/comfy-gpu-ci/test_workspaces/SAM3-2137/ComfyUI/custom_nodes/ComfyUI-SAM3/nodes/sam3/attention.py", line 120 in sam3_attention
|
|
[08:45] [ComfyUI] File "/Users/runner/work/comfy-gpu-ci/comfy-gpu-ci/test_workspaces/SAM3-2137/ComfyUI/custom_nodes/ComfyUI-SAM3/nodes/sam3/model.py", line 729 in forward
|
|
[08:45] [ComfyUI] File "/Users/runner/.ce/.pixi/envs/sam3-nodes/lib/python3.10/site-packages/torch/nn/modules/module.py", line 1790 in _call_impl
|
|
[08:45] [ComfyUI] File "/Users/runner/.ce/.pixi/envs/sam3-nodes/lib/python3.10/site-packages/torch/nn/modules/module.py", line 1779 in _wrapped_call_impl
|
|
[08:45] [ComfyUI] File "/Users/runner/work/comfy-gpu-ci/comfy-gpu-ci/test_workspaces/SAM3-2137/ComfyUI/custom_nodes/ComfyUI-SAM3/nodes/sam3/model.py", line 819 in forward
|
|
[08:45] [ComfyUI] File "/Users/runner/.ce/.pixi/envs/sam3-nodes/lib/python3.10/site-packages/torch/nn/modules/module.py", line 1790 in _call_impl
|
|
[08:45] [ComfyUI] File "/Users/runner/.ce/.pixi/envs/sam3-nodes/lib/python3.10/site-packages/torch/nn/modules/module.py", line 1779 in _wrapped_call_impl
|
|
[08:45] [ComfyUI] File "/Users/runner/work/comfy-gpu-ci/comfy-gpu-ci/test_workspaces/SAM3-2137/ComfyUI/custom_nodes/ComfyUI-SAM3/nodes/sam3/model.py", line 983 in forward
|
|
[08:45] [ComfyUI] File "/Users/runner/.ce/.pixi/envs/sam3-nodes/lib/python3.10/site-packages/torch/nn/modules/module.py", line 1790 in _call_impl
|
|
[08:45] [ComfyUI] File "/Users/runner/.ce/.pixi/envs/sam3-nodes/lib/python3.10/site-packages/torch/nn/modules/module.py", line 1779 in _wrapped_call_impl
|
|
[08:45] [ComfyUI] File "/Users/runner/work/comfy-gpu-ci/comfy-gpu-ci/test_workspaces/SAM3-2137/ComfyUI/custom_nodes/ComfyUI-SAM3/nodes/sam3/model.py", line 2041 in forward
|
|
[08:45] [ComfyUI] File "/Users/runner/work/comfy-gpu-ci/comfy-gpu-ci/test_workspaces/SAM3-2137/ComfyUI/custom_nodes/ComfyUI-SAM3/nodes/sam3/model.py", line 3321 in _forward_image_no_act_ckpt
|
|
[08:45] [ComfyUI] File "/Users/runner/work/comfy-gpu-ci/comfy-gpu-ci/test_workspaces/SAM3-2137/ComfyUI/custom_nodes/ComfyUI-SAM3/nodes/sam3/model.py", line 3314 in forward_image
|
|
[08:45] [ComfyUI] File "/Users/runner/work/comfy-gpu-ci/comfy-gpu-ci/test_workspaces/SAM3-2137/ComfyUI/custom_nodes/ComfyUI-SAM3/nodes/sam3/utils.py", line 1324 in set_image
|
|
[08:45] [ComfyUI] File "/Users/runner/.ce/.pixi/envs/sam3-nodes/lib/python3.10/site-packages/torch/utils/_contextlib.py", line 124 in decorate_context
|
|
[08:45] [ComfyUI] File "/Users/runner/work/comfy-gpu-ci/comfy-gpu-ci/test_workspaces/SAM3-2137/ComfyUI/custom_nodes/ComfyUI-SAM3/nodes/segmentation.py", line 733 in execute
|
|
[08:45] [ComfyUI] File "/Users/runner/work/comfy-gpu-ci/comfy-gpu-ci/test_workspaces/SAM3-2137/ComfyUI/comfy_api/latest/_io.py", line 1833 in EXECUTE_NORMALIZED
|
|
[08:45] [ComfyUI] File "/var/folders/tb/y368xp_x10s3ty1b_mtl5mxr0000gn/T/comfyui_pvenv_9iclx1mf/persistent_worker.py", line 1762 in main
|
|
[08:45] [ComfyUI] File "/var/folders/tb/y368xp_x10s3ty1b_mtl5mxr0000gn/T/comfyui_pvenv_9iclx1mf/persistent_worker.py", line 1807 in <module>
|
|
[08:45] [ComfyUI]
|
|
[08:45] [ComfyUI] [worker:ComfyUI-SAM3] === END ===
|
|
[08:45] [ComfyUI]
|
|
[08:47] [capture-loop] iter=100 t=47.1s state={'complete': False, 'error': None, 'executedCount': 1, 'wsState': 1} eval_ms=4 ram=4.8/7.0GB (87%) swap=2.4/3.0GB (79%) cpu=62% browser_rss=0.24GB
|
|
[09:20] [capture-loop] iter=150 t=79.7s state={'complete': False, 'error': None, 'executedCount': 1, 'wsState': 1} eval_ms=391 ram=3.9/7.0GB (90%) swap=2.2/3.0GB (74%) cpu=56% browser_rss=0.20GB
|
|
[09:24] [ComfyUI] [SubprocessWorker] callback 'report_progress' from call_id=8
|
|
[09:25] Frame 5 saved (frame_004.jpg, t=84.3s)
|
|
[09:25] [capture-periodic] freeze=7ms shot=184ms unfreeze=4ms saved=True
|
|
[09:25] [ComfyUI] [SubprocessWorker] callback 'report_progress' from call_id=8
|
|
[09:25] [ComfyUI] [SubprocessWorker] callback 'report_progress' from call_id=8
|
|
[09:26] [capture-loop] iter=200 t=86.3s state={'complete': False, 'error': None, 'executedCount': 1, 'wsState': 1} eval_ms=4 ram=4.0/7.0GB (89%) swap=2.5/3.0GB (83%) cpu=67% browser_rss=0.22GB
|
|
[09:27] Frame 6 saved (frame_005.jpg, t=86.7s)
|
|
[09:27] [capture-periodic] freeze=6ms shot=274ms unfreeze=5ms saved=True
|
|
[09:27] [ComfyUI] [SubprocessWorker] callback 'report_progress' from call_id=8
|
|
[09:28] [ComfyUI] [SubprocessWorker] callback 'report_progress' from call_id=8
|
|
[09:28] [ComfyUI] [SubprocessWorker] callback 'report_progress' from call_id=8
|
|
[09:29] Frame 7 saved (frame_006.jpg, t=89.0s)
|
|
[09:29] [capture-periodic] freeze=4ms shot=185ms unfreeze=3ms saved=True
|
|
[09:30] [ComfyUI] [SubprocessWorker] callback 'report_progress' from call_id=8
|
|
[09:34] Frame 8 saved (frame_007.jpg, t=91.3s)
|
|
[09:34] [capture-periodic] freeze=725ms shot=1706ms unfreeze=3ms saved=True
|
|
[09:36] [capture-loop] iter=250 t=96.2s state={'complete': False, 'error': None, 'executedCount': 1, 'wsState': 1} eval_ms=11 ram=2.1/7.0GB (85%) swap=2.8/4.0GB (69%) cpu=72% browser_rss=0.14GB
|
|
[09:45] [capture-loop] iter=300 t=104.6s state={'complete': False, 'error': None, 'executedCount': 1, 'wsState': 1} eval_ms=12 ram=2.1/7.0GB (81%) swap=3.2/4.0GB (79%) cpu=75% browser_rss=0.16GB
|
|
[09:45] [ComfyUI] [worker:ComfyUI-SAM3]
|
|
[09:45] [ComfyUI] === WATCHDOG TICK 7 ===
|
|
[09:45] [ComfyUI] [worker:ComfyUI-SAM3] Current thread 0x0000000170d83000 (most recent call first):
|
|
[09:45] [ComfyUI] File "/var/folders/tb/y368xp_x10s3ty1b_mtl5mxr0000gn/T/comfyui_pvenv_9iclx1mf/persistent_worker.py", line 52 in _watchdog
|
|
[09:45] [ComfyUI] File "/Users/runner/.ce/.pixi/envs/sam3-nodes/lib/python3.10/threading.py", line 953 in run
|
|
[09:45] [ComfyUI] File "/Users/runner/.ce/.pixi/envs/sam3-nodes/lib/python3.10/threading.py", line 1016 in _bootstrap_inner
|
|
[09:45] [ComfyUI] File "/Users/runner/.ce/.pixi/envs/sam3-nodes/lib/python3.10/threading.py", line 973 in _bootstrap
|
|
[09:45] [ComfyUI]
|
|
[09:45] [ComfyUI] Thread 0x00000002054da240 (most recent call first):
|
|
[09:45] [ComfyUI] File "/Users/runner/work/comfy-gpu-ci/comfy-gpu-ci/test_workspaces/SAM3-2137/ComfyUI/custom_nodes/ComfyUI-SAM3/nodes/utils.py", line 164 in visualize_masks_on_image
|
|
[09:45] [ComfyUI] File "/Users/runner/work/comfy-gpu-ci/comfy-gpu-ci/test_workspaces/SAM3-2137/ComfyUI/custom_nodes/ComfyUI-SAM3/nodes/segmentation.py", line 849 in execute
|
|
[09:45] [ComfyUI] File "/Users/runner/work/comfy-gpu-ci/comfy-gpu-ci/test_workspaces/SAM3-2137/ComfyUI/comfy_api/latest/_io.py", line 1833 in EXECUTE_NORMALIZED
|
|
[09:45] [ComfyUI] File "/var/folders/tb/y368xp_x10s3ty1b_mtl5mxr0000gn/T/comfyui_pvenv_9iclx1mf/persistent_worker.py", line 1762 in main
|
|
[09:45] [ComfyUI] File "/var/folders/tb/y368xp_x10s3ty1b_mtl5mxr0000gn/T/comfyui_pvenv_9iclx1mf/persistent_worker.py", line 1807 in <module>
|
|
[09:45] [ComfyUI]
|
|
[09:45] [ComfyUI] [worker:ComfyUI-SAM3] === END ===
|
|
[09:45] [ComfyUI]
|
|
[09:55] [capture-loop] iter=350 t=115.1s state={'complete': False, 'error': None, 'executedCount': 1, 'wsState': 1} eval_ms=2 ram=2.3/7.0GB (82%) swap=3.5/4.0GB (87%) cpu=78% browser_rss=0.26GB
|
|
[10:03] [capture-loop] iter=400 t=122.4s state={'complete': False, 'error': None, 'executedCount': 1, 'wsState': 1} eval_ms=3 ram=2.5/7.0GB (79%) swap=3.4/4.0GB (85%) cpu=60% browser_rss=0.25GB
|
|
[10:04] [ComfyUI] [SubprocessWorker] got response: ok
|
|
[10:04] [ComfyUI] [comfy-env] SAM3MultipromptSegmentation done (116.19s): result: NodeOutput
|
|
[10:07] Frame 9 saved (frame_008.jpg, t=126.2s)
|
|
[10:07] [capture-periodic] freeze=4ms shot=182ms unfreeze=5ms saved=True
|
|
[10:07] Node executed (2 total), capturing...
|
|
[10:08] Frame 10 saved (frame_009.jpg, t=126.8s)
|
|
[10:08] [capture-node] freeze=78ms shot=1222ms unfreeze=4ms saved=True
|
|
[10:10] [capture-loop] iter=450 t=130.1s state={'complete': False, 'error': None, 'executedCount': 2, 'wsState': 1} eval_ms=17 ram=2.7/7.0GB (70%) swap=3.3/4.0GB (83%) cpu=75% browser_rss=0.41GB
|
|
[10:15] [ComfyUI] BatchToMultiband: Processed 1 images with 3 channels each -> 3 channels
|
|
[10:15] [ComfyUI] BatchToMultiband: Processed 7 masks -> 7 channels
|
|
[10:16] Node executed (3 total), capturing...
|
|
[10:18] Frame 11 saved (frame_010.jpg, t=136.0s)
|
|
[10:18] [capture-node] freeze=3ms shot=1761ms unfreeze=32ms saved=True
|
|
[10:19] [capture-loop] iter=500 t=139.2s state={'complete': False, 'error': None, 'executedCount': 3, 'wsState': 1} eval_ms=12 ram=2.6/7.0GB (77%) swap=3.1/4.0GB (76%) cpu=79% browser_rss=0.35GB
|
|
[10:20] [ComfyUI] BatchToMultiband: Output shape torch.Size([1, 10, 4480, 6720]), channels: ['img_01_r', 'img_01_g', 'img_01_b', 'mask_01', 'mask_02', 'mask_03', 'mask_04', 'mask_05', 'mask_06', 'mask_07']
|
|
[10:20] [ComfyUI] ResizeMultiband: 4480x6720 -> 600x900
|
|
[10:20] [ComfyUI] PreviewMultibandImage: Batch=1, Channels=10, Names=['img_01_r', 'img_01_g', 'img_01_b', 'mask_01', 'mask_02', 'mask_03', 'mask_04', 'mask_05', 'mask_06', 'mask_07']
|
|
[10:20] Frame 12 saved (frame_011.jpg, t=139.9s)
|
|
[10:20] [capture-periodic] freeze=5ms shot=239ms unfreeze=5ms saved=True
|
|
[10:21] Node executed (4 total), capturing...
|
|
[10:21] Frame 13 saved (frame_012.jpg, t=140.6s)
|
|
[10:21] [capture-node] freeze=3ms shot=159ms unfreeze=7ms saved=True
|
|
[10:21] [ComfyUI] SaveMultibandImage: Saved to output/multiband.npz
|
|
[10:21] [ComfyUI] Shape: (1, 10, 600, 900)
|
|
[10:21] [ComfyUI] Format: npz
|
|
[10:21] [ComfyUI] Prompt executed in 140.59 seconds
|
|
[10:21] Execution complete (t=140.9s)
|
|
[10:21] Captured 13 unique frames over 140.95s
|
|
[10:21] [debug] iframes: 0
|
|
[10:21] [timing] trigger_3d_previews: 0.0s
|
|
[10:24] Saved high-quality screenshot: scene_seg_executed.png
|
|
[10:24] [timing] final_screenshot: 0.7s
|
|
[10:25] Capturing execution frames: scene_seg_interactive.json
|
|
[10:34] Frame 1 saved (frame_000.jpg, t=0.0s)
|
|
[10:34] Validating workflow...
|
|
[10:34] [ComfyUI] === /validate endpoint called ===
|
|
[10:34] [ComfyUI] Received JSON with keys: ['prompt']
|
|
[10:34] [ComfyUI] Prompt has 4 nodes
|
|
[10:34] [ComfyUI] Node 1: LoadImage
|
|
[10:34] [ComfyUI] Inputs: {"image": "image.png"}
|
|
[10:34] [ComfyUI] Node 4: MaskPreview
|
|
[10:34] [ComfyUI] Inputs: {"mask": ["26", 0]}
|
|
[10:34] [ComfyUI] Node 12: LoadSAM3Model
|
|
[10:34] [ComfyUI] Inputs: {"precision": "auto", "compile": false}
|
|
[10:34] [ComfyUI] Node 26: SAM3InteractiveCollector
|
|
[10:34] [ComfyUI] Inputs: {"multi_prompts_store": "[{\"positive_points\":[{\"x\":3348.288109906738,\"y\":2452.2208696844737}],\"negative_points\":[],\"positive_boxes\":[],\"negative_boxes\":[],\"name\":\"Prompt 1\"},{\"positiv
|
|
[10:34] [ComfyUI] Generated prompt_id: 9d8cc15c-fb7d-485c-a869-abaa194e27f4
|
|
[10:34] [ComfyUI] Calling execution.validate_prompt()...
|
|
[10:34] [ComfyUI] Validation result: valid=True
|
|
[10:34] [ComfyUI] === Validation PASSED ===
|
|
[10:34] Queuing workflow for execution...
|
|
[10:34] [ComfyUI] got prompt
|
|
[10:37] Frame 2 saved (frame_001.jpg, t=2.2s)
|
|
[10:37] [capture-periodic] freeze=15ms shot=748ms unfreeze=14ms saved=True
|
|
[10:39] [ComfyUI] [comfy-env] Running LoadSAM3Model: precision: 'auto', compile: False
|
|
[10:39] [ComfyUI] [SubprocessWorker] call_method: nodes.load_model.LoadSAM3Model.EXECUTE_NORMALIZED
|
|
[10:39] [ComfyUI] [SubprocessWorker] acquired lock, ensuring started...
|
|
[10:39] [ComfyUI] [ComfyUI-SAM3] Health check: ping (timeout=5.0s)...
|
|
[10:39] [ComfyUI] [ComfyUI-SAM3] Health check: ok
|
|
[10:39] [ComfyUI] [SubprocessWorker] worker started/confirmed
|
|
[10:39] [ComfyUI] [SubprocessWorker] serializing kwargs to shm...
|
|
[10:39] [ComfyUI] [SubprocessWorker] created 0 shm blocks
|
|
[10:39] [ComfyUI] [SubprocessWorker] sending request via socket...
|
|
[10:39] [ComfyUI] [SubprocessWorker] call_id=9 sending call_method
|
|
[10:39] [ComfyUI] [SubprocessWorker] got response: ok
|
|
[10:39] [ComfyUI] [comfy-env] LoadSAM3Model done (0.14s): result: NodeOutput
|
|
[10:39] [ComfyUI] [comfy-env] Running SAM3InteractiveCollector: multi_prompts_store: '[{"positive_points":[{"x":3348.288109906738,"y":2452.220..., sam3_model_config: dict, image: torch.float32 [1,4480,6720,3] cpu, unique_id: '26'
|
|
[10:39] [ComfyUI] [SubprocessWorker] call_method: nodes.sam3_interactive.SAM3InteractiveCollector.EXECUTE_NORMALIZED
|
|
[10:39] [ComfyUI] [SubprocessWorker] acquired lock, ensuring started...
|
|
[10:39] [ComfyUI] [ComfyUI-SAM3] Health check: ping (timeout=5.0s)...
|
|
[10:39] [ComfyUI] [ComfyUI-SAM3] Health check: ok
|
|
[10:39] [ComfyUI] [SubprocessWorker] worker started/confirmed
|
|
[10:39] [ComfyUI] [comfy-env] PRE-SERIALIZE 'image' shape: torch.Size([1, 4480, 6720, 3])
|
|
[10:39] [ComfyUI] [SubprocessWorker] serializing kwargs to shm...
|
|
[10:39] [ComfyUI] [SubprocessWorker] created 0 shm blocks
|
|
[10:39] [ComfyUI] [SubprocessWorker] sending request via socket...
|
|
[10:39] [ComfyUI] [SubprocessWorker] call_id=10 sending call_method
|
|
[10:39] [ComfyUI] [worker:ComfyUI-SAM3] [comfy-env] _from_shm got dict with keys: ['__type__', 'strategy', 'manager_path', 'storage_key', 'storage_size']
|
|
[10:39] [ComfyUI] [worker:ComfyUI-SAM3] [comfy-env] DESERIALIZE TensorRef: tensor_size=[1, 4480, 6720, 3]
|
|
[10:39] [ComfyUI] [worker:ComfyUI-SAM3] [comfy-env] DESERIALIZED tensor shape: torch.Size([1, 4480, 6720, 3])
|
|
[10:39] Frame 3 saved (frame_002.jpg, t=5.3s)
|
|
[10:39] [capture-periodic] freeze=42ms shot=636ms unfreeze=8ms saved=True
|
|
[10:42] Frame 4 saved (frame_003.jpg, t=8.2s)
|
|
[10:42] [capture-periodic] freeze=7ms shot=227ms unfreeze=4ms saved=True
|
|
[10:42] [capture-loop] iter=50 t=9.0s state={'complete': False, 'error': None, 'executedCount': 0, 'wsState': 1} eval_ms=3 ram=2.4/7.0GB (78%) swap=2.8/4.0GB (70%) cpu=73% browser_rss=0.46GB
|
|
[10:45] [ComfyUI] [worker:ComfyUI-SAM3]
|
|
[10:45] [ComfyUI] === WATCHDOG TICK 8 ===
|
|
[10:45] [ComfyUI] [worker:ComfyUI-SAM3] Current thread 0x0000000170d83000 (most recent call first):
|
|
[10:45] [ComfyUI] File "/var/folders/tb/y368xp_x10s3ty1b_mtl5mxr0000gn/T/comfyui_pvenv_9iclx1mf/persistent_worker.py", line 52 in _watchdog
|
|
[10:45] [ComfyUI] File "/Users/runner/.ce/.pixi/envs/sam3-nodes/lib/python3.10/threading.py", line 953 in run
|
|
[10:45] [ComfyUI] File "/Users/runner/.ce/.pixi/envs/sam3-nodes/lib/python3.10/threading.py", line 1016 in _bootstrap_inner
|
|
[10:45] [ComfyUI] File "/Users/runner/.ce/.pixi/envs/sam3-nodes/lib/python3.10/threading.py", line 973 in _bootstrap
|
|
[10:45] [ComfyUI]
|
|
[10:45] [ComfyUI] Thread 0x00000002054da240 (most recent call first):
|
|
[10:45] [ComfyUI] File "/Users/runner/work/comfy-gpu-ci/comfy-gpu-ci/test_workspaces/SAM3-2137/ComfyUI/custom_nodes/ComfyUI-SAM3/nodes/_model_cache.py", line 117 in get_or_build_model
|
|
[10:45] [ComfyUI] File "/Users/runner/work/comfy-gpu-ci/comfy-gpu-ci/test_workspaces/SAM3-2137/ComfyUI/custom_nodes/ComfyUI-SAM3/nodes/sam3_interactive.py", line 667 in execute
|
|
[10:45] [ComfyUI] File "/Users/runner/work/comfy-gpu-ci/comfy-gpu-ci/test_workspaces/SAM3-2137/ComfyUI/comfy_api/latest/_io.py", line 1833 in EXECUTE_NORMALIZED
|
|
[10:45] [ComfyUI] File "/var/folders/tb/y368xp_x10s3ty1b_mtl5mxr0000gn/T/comfyui_pvenv_9iclx1mf/persistent_worker.py", line 1762 in main
|
|
[10:45] [ComfyUI] File "/var/folders/tb/y368xp_x10s3ty1b_mtl5mxr0000gn/T/comfyui_pvenv_9iclx1mf/persistent_worker.py", line 1807 in <module>
|
|
[10:45] [ComfyUI]
|
|
[10:45] [ComfyUI] [worker:ComfyUI-SAM3] === END ===
|
|
[10:45] [ComfyUI]
|
|
[10:50] [capture-loop] iter=100 t=16.2s state={'complete': False, 'error': None, 'executedCount': 0, 'wsState': 1} eval_ms=3 ram=2.2/7.0GB (82%) swap=2.9/4.0GB (73%) cpu=61% browser_rss=0.30GB
|
|
[10:56] [capture-loop] iter=150 t=22.9s state={'complete': False, 'error': None, 'executedCount': 0, 'wsState': 1} eval_ms=4 ram=2.2/7.0GB (82%) swap=3.3/4.0GB (84%) cpu=76% browser_rss=0.23GB
|
|
[11:02] [capture-loop] iter=200 t=29.0s state={'complete': False, 'error': None, 'executedCount': 0, 'wsState': 1} eval_ms=4 ram=2.1/7.0GB (82%) swap=3.7/4.0GB (91%) cpu=51% browser_rss=0.27GB
|
|
[11:09] [capture-loop] iter=250 t=35.3s state={'complete': False, 'error': None, 'executedCount': 0, 'wsState': 1} eval_ms=7 ram=2.2/7.0GB (82%) swap=4.1/5.0GB (82%) cpu=56% browser_rss=0.21GB
|
|
[11:11] [ComfyUI] [SubprocessWorker] callback 'request_vram_budget' from call_id=10
|
|
[11:11] [ComfyUI] [comfy-env] VRAM request: 1.84GB, free before eviction: 1.32GB
|
|
[11:11] [ComfyUI] [comfy-env] VRAM after eviction: 1.33GB
|
|
[11:15] [capture-loop] iter=300 t=41.6s state={'complete': False, 'error': None, 'executedCount': 0, 'wsState': 1} eval_ms=5 ram=3.3/7.0GB (76%) swap=3.8/5.0GB (76%) cpu=67% browser_rss=0.24GB
|
|
[11:21] [capture-loop] iter=350 t=48.0s state={'complete': False, 'error': None, 'executedCount': 0, 'wsState': 1} eval_ms=4 ram=3.3/7.0GB (67%) swap=2.1/5.0GB (42%) cpu=70% browser_rss=0.23GB
|
|
[11:31] [capture-loop] iter=400 t=57.6s state={'complete': False, 'error': None, 'executedCount': 0, 'wsState': 1} eval_ms=11 ram=4.3/7.0GB (84%) swap=0.5/2.0GB (25%) cpu=79% browser_rss=0.24GB
|
|
[11:41] [capture-loop] iter=450 t=67.7s state={'complete': False, 'error': None, 'executedCount': 0, 'wsState': 1} eval_ms=3 ram=3.4/7.0GB (80%) swap=0.5/2.0GB (24%) cpu=55% browser_rss=0.24GB
|
|
[11:45] [ComfyUI] [worker:ComfyUI-SAM3]
|
|
[11:45] [ComfyUI] === WATCHDOG TICK 9 ===
|
|
[11:45] [ComfyUI] [worker:ComfyUI-SAM3] Current thread 0x0000000170d83000 (most recent call first):
|
|
[11:45] [ComfyUI] File "/var/folders/tb/y368xp_x10s3ty1b_mtl5mxr0000gn/T/comfyui_pvenv_9iclx1mf/persistent_worker.py", line 52 in _watchdog
|
|
[11:45] [ComfyUI] File "/Users/runner/.ce/.pixi/envs/sam3-nodes/lib/python3.10/threading.py", line 953 in run
|
|
[11:45] [ComfyUI] File "/Users/runner/.ce/.pixi/envs/sam3-nodes/lib/python3.10/threading.py", line 1016 in _bootstrap_inner
|
|
[11:45] [ComfyUI] File "/Users/runner/.ce/.pixi/envs/sam3-nodes/lib/python3.10/threading.py", line 973 in _bootstrap
|
|
[11:45] [ComfyUI]
|
|
[11:45] [ComfyUI] Thread 0x00000002054da240 (most recent call first):
|
|
[11:45] [ComfyUI] File "/Users/runner/work/comfy-gpu-ci/comfy-gpu-ci/test_workspaces/SAM3-2137/ComfyUI/custom_nodes/ComfyUI-SAM3/nodes/sam3/model.py", line 9507 in predict
|
|
[11:45] [ComfyUI] File "/Users/runner/work/comfy-gpu-ci/comfy-gpu-ci/test_workspaces/SAM3-2137/ComfyUI/custom_nodes/ComfyUI-SAM3/nodes/sam3/model.py", line 3989 in predict_inst
|
|
[11:45] [ComfyUI] File "/Users/runner/work/comfy-gpu-ci/comfy-gpu-ci/test_workspaces/SAM3-2137/ComfyUI/custom_nodes/ComfyUI-SAM3/nodes/sam3_interactive.py", line 642 in _run_prompts
|
|
[11:45] [ComfyUI] File "/Users/runner/work/comfy-gpu-ci/comfy-gpu-ci/test_workspaces/SAM3-2137/ComfyUI/custom_nodes/ComfyUI-SAM3/nodes/sam3_interactive.py", line 709 in execute
|
|
[11:45] [ComfyUI] File "/Users/runner/work/comfy-gpu-ci/comfy-gpu-ci/test_workspaces/SAM3-2137/ComfyUI/comfy_api/latest/_io.py", line 1833 in EXECUTE_NORMALIZED
|
|
[11:45] [ComfyUI] File "/var/folders/tb/y368xp_x10s3ty1b_mtl5mxr0000gn/T/comfyui_pvenv_9iclx1mf/persistent_worker.py", line 1762 in main
|
|
[11:45] [ComfyUI] File "/var/folders/tb/y368xp_x10s3ty1b_mtl5mxr0000gn/T/comfyui_pvenv_9iclx1mf/persistent_worker.py", line 1807 in <module>
|
|
[11:45] [ComfyUI]
|
|
[11:45] [ComfyUI] [worker:ComfyUI-SAM3] === END ===
|
|
[11:45] [ComfyUI]
|
|
[11:49] [ComfyUI] [SubprocessWorker] callback 'report_progress' from call_id=10
|
|
[11:54] Frame 5 saved (frame_004.jpg, t=78.9s)
|
|
[11:54] [capture-periodic] freeze=30ms shot=1335ms unfreeze=46ms saved=True
|
|
[11:57] [ComfyUI] [SubprocessWorker] got response: ok
|
|
[11:57] [capture-loop] iter=500 t=83.9s state={'complete': False, 'error': None, 'executedCount': 0, 'wsState': 1} eval_ms=3 ram=2.2/7.0GB (77%) swap=0.9/2.0GB (47%) cpu=75% browser_rss=0.20GB
|
|
[11:57] [ComfyUI] [comfy-env] SAM3InteractiveCollector done (78.31s): result: NodeOutput
|
|
[12:00] [ComfyUI] Prompt executed in 86.63 seconds
|
|
[12:01] Node executed (1 total), capturing...
|
|
[12:03] Frame 6 saved (frame_005.jpg, t=87.4s)
|
|
[12:03] [capture-node] freeze=470ms shot=1619ms unfreeze=5ms saved=True
|
|
[12:03] Node executed (2 total), capturing...
|
|
[12:04] [capture-node] freeze=8ms shot=386ms unfreeze=0ms saved=False
|
|
[12:04] Execution complete (t=89.8s)
|
|
[12:04] Captured 6 unique frames over 90.27s
|
|
[12:04] [debug] iframes: 0
|
|
[12:04] [timing] trigger_3d_previews: 0.0s
|
|
[12:06] Saved high-quality screenshot: scene_seg_interactive_executed.png
|
|
[12:06] [timing] final_screenshot: 0.4s
|
|
[12:07] [5/5] SKIPPED (not in cpu list) video_point_prompt.json
|
|
[12:07] Results saved to /Users/runner/work/comfy-gpu-ci/comfy-gpu-ci/comfy-test-logs/SAM3-2137/dev/macos-cpu/results.json
|
|
[12:07] Model report: 1 files, 3.2 GB -> /Users/runner/work/comfy-gpu-ci/comfy-gpu-ci/comfy-test-logs/SAM3-2137/dev/macos-cpu/models.json
|
|
[12:08] Saved: /Users/runner/work/comfy-gpu-ci/comfy-gpu-ci/comfy-test-logs/SAM3-2137/dev/macos-cpu/index.html
|
|
[12:08]
|
|
macos: FAILED
|
|
[12:08] Error: Workflow execution failed (1 error(s))
|
|
[12:08] Details: image_seg_text.json: Workflow execution failed: {'prompt_id': 'd49ef70f-d2d0-4eaf-bcc9-9bb34ce2e60a', 'node_id': '15', 'node_type': 'SAM3Grounding', 'executed': ['12', '1'], 'exception_message': 'Expected all tensors to be on the same device, but found at least two devices, mps:0 and cpu!\n\nWorker traceback:\nTraceback (most recent call last):\n File "/var/folders/tb/y368xp_x10s3ty1b_mtl5mxr0000gn/T/comfyui_pvenv_9iclx1mf/persistent_worker.py", line 1762, in main\n result = method(**inputs)\n File "/Users/runner/work/comfy-gpu-ci/comfy-gpu-ci/test_workspaces/SAM3-2137/ComfyUI/comfy_api/latest/_io.py", line 1833, in EXECUTE_NORMALIZED\n to_return = cls.execute(*args, **kwargs)\n File "/Users/runner/work/comfy-gpu-ci/comfy-gpu-ci/test_workspaces/SAM3-2137/ComfyUI/custom_nodes/ComfyUI-SAM3/nodes/segmentation.py", line 111, in execute\n result = cls._segment_grounding(\n File "/Users/runner/work/comfy-gpu-ci/comfy-gpu-ci/test_workspaces/SAM3-2137/ComfyUI/custom_nodes/ComfyUI-SAM3/nodes/segmentation.py", line 201, in _segment_grounding\n vis_image = visualize_masks_on_image(\n File "/Users/runner/work/comfy-gpu-ci/comfy-gpu-ci/test_workspaces/SAM3-2137/ComfyUI/custom_nodes/ComfyUI-SAM3/nodes/utils.py", line 164, in visualize_masks_on_image\n overlay = torch.where(mask_3d, overlay * (1 - alpha) + color * alpha, overlay)\nRuntimeError: Expected all tensors to be on the same device, but found at least two devices, mps:0 and cpu!\n\n', 'exception_type': 'comfy_env.isolation.workers.base.WorkerError', 'traceback': [' File "/Users/runner/work/comfy-gpu-ci/comfy-gpu-ci/test_workspaces/SAM3-2137/ComfyUI/execution.py", line 535, in execute\n output_data, output_ui, has_subgraph, has_pending_tasks = await get_output_data(prompt_id, unique_id, obj, input_data_all, execution_block_cb=execution_block_cb, pre_execute_cb=pre_execute_cb, v3_data=v3_data)\n', ' File "/Users/runner/work/comfy-gpu-ci/comfy-gpu-ci/test_workspaces/SAM3-2137/ComfyUI/execution.py", line 335, in get_output_data\n return_values = await _async_map_node_over_list(prompt_id, unique_id, obj, input_data_all, obj.FUNCTION, allow_interrupt=True, execution_block_cb=execution_block_cb, pre_execute_cb=pre_execute_cb, v3_data=v3_data)\n', ' File "/Users/runner/work/comfy-gpu-ci/comfy-gpu-ci/test_workspaces/SAM3-2137/ComfyUI/execution.py", line 309, in _async_map_node_over_list\n await process_inputs(input_dict, i)\n', ' File "/Users/runner/work/comfy-gpu-ci/comfy-gpu-ci/test_workspaces/SAM3-2137/ComfyUI/execution.py", line 297, in process_inputs\n result = f(**inputs)\n', ' File "/Users/runner/work/comfy-gpu-ci/comfy-gpu-ci/test_workspaces/SAM3-2137/venv/lib/python3.10/site-packages/comfy_env/isolation/metadata.py", line 536, in proxy\n result = worker.call_method(\n', ' File "/Users/runner/work/comfy-gpu-ci/comfy-gpu-ci/test_workspaces/SAM3-2137/venv/lib/python3.10/site-packages/comfy_env/isolation/workers/subprocess.py", line 674, in call_method\n raise WorkerError(\n'], 'current_inputs': {'confidence_threshold': [0.2], 'text_prompt': ['child'], 'max_detections': [-1], 'sam3_model_config': ["{'checkpoint_path': '/Users/runner/work/comfy-gpu-ci/comfy-gpu-ci/test_workspaces/SAM3-2137/ComfyUI/models/sam3/sam3.safetensors', 'bpe_path': '/Users/runner/work/comfy-gpu-ci/comfy-gpu-ci/test_workspaces/SAM3-2137/ComfyUI/custom_nodes/ComfyUI-SAM3/nodes/sam3/bpe_simple_vocab_16e6.txt.gz', 'precision': 'fp32', 'dtype': 'fp32', 'compile': False}"], 'image': ['tensor([[[[0.2902, 0.4667, 0.5961],\n [0.2902, 0.4667, 0.5961],\n [0.2902, 0.4667, 0.5961],\n ...,\n [0.3176, 0.5804, 0.7216],\n [0.3333, 0.6039, 0.7451],\n [0.3529, 0.6235, 0.7647]],\n\n [[0.2902, 0.4667, 0.5961],\n [0.2902, 0.4667, 0.5961],\n [0.2902, 0.4667, 0.5961],\n ...,\n [0.3137, 0.5765, 0.7176],\n [0.3137, 0.5843, 0.7255],\n [0.3255, 0.5961, 0.7373]],\n\n [[0.2902, 0.4667, 0.5961],\n [0.2902, 0.4667, 0.5961],\n [0.2902, 0.4667, 0.5961],\n ...,\n [0.3922, 0.5333, 0.6275],\n [0.3922, 0.5294, 0.6235],\n [0.3961, 0.5333, 0.6275]],\n\n ...,\n\n [[0.4941, 0.4863, 0.4157],\n [0.4941, 0.4863, 0.4157],\n [0.4980, 0.4902, 0.4196],\n ...,\n [0.5647, 0.5608, 0.5059],\n [0.5647, 0.5608, 0.5059],\n [0.5647, 0.5608, 0.5059]],\n\n [[0.5098, 0.5020, 0.4314],\n [0.5098, 0.5020, 0.4314],\n [0.5137, 0.5059, 0.4353],\n ...,\n [0.5647, 0.5608, 0.5059],\n [0.5647, 0.5608, 0.5059],\n [0.5647, 0.5608, 0.5059]],\n\n [[0.5176, 0.5098, 0.4392],\n [0.5216, 0.5137, 0.4431],\n [0.5255, 0.5176, 0.4471],\n ...,\n [0.5647, 0.5608, 0.5059],\n [0.5647, 0.5608, 0.5059],\n [0.5647, 0.5608, 0.5059]]]])']}, 'current_outputs': ['12', '3', '15', '4', '1'], 'timestamp': 1778449493366}
|
|
|
|
Details:
|
|
Workflow: /private/var/folders/tb/y368xp_x10s3ty1b_mtl5mxr0000gn/T/comfy-test-run-nbu3rvsj/ComfyUI-SAM3/workflows/image_seg_text.json
|
|
Node error: SAM3Grounding
|
|
[12:08] Stopping ComfyUI server...
|