Files
PozzettiAndrea-ComfyUI-SAM3/dev/macos-cpu/session.log
T
2026-05-11 10:20:51 +00:00

968 lines
87 KiB
Plaintext

[00:00] Crash dump logging enabled: /Users/runner/work/comfy-gpu-ci/comfy-gpu-ci/comfy-test-logs/SAM3-1010/dev/macos-cpu/crash_dump.log
[00:00]
[00:00] [1/5] SYNTAX
[00:00] ----------------------------------------
[00:00]
[DEBUG] server=None, server_url=None, api=None
[00:00] Found pyproject.toml (modern format)
[00:00] Found requirements.txt (legacy format)
[00:00] Unicode check: OK (all characters cp1252-safe)
[00:00] Forbidden patterns check: OK
[00:00] [SYNTAX] PASSED
[00:00]
[00:00] [2/5] INSTALL
[00:00] ----------------------------------------
[00:00]
[DEBUG] server=None, server_url=None, api=None
[00:00]
Setting up ComfyUI...
[00:00] Cloning ComfyUI (latest)...
[00:00] Running: git clone --depth 1 https://github.com/comfyanonymous/ComfyUI.git /Users/runner/work/comfy-gpu-ci/comfy-gpu-ci/test_workspaces/SAM3-1010/ComfyUI
[00:01] Creating virtual environment...
[00:01] Running: /Library/Frameworks/Python.framework/Versions/3.10/bin/python -m venv /Users/runner/work/comfy-gpu-ci/comfy-gpu-ci/test_workspaces/SAM3-1010/venv
[00:04] Installing uv into venv...
[00:04] Running: /Users/runner/work/comfy-gpu-ci/comfy-gpu-ci/test_workspaces/SAM3-1010/venv/bin/python -m pip install uv
[00:05] Installing PyTorch...
[00:05] Running: /Users/runner/work/comfy-gpu-ci/comfy-gpu-ci/test_workspaces/SAM3-1010/venv/bin/python -m uv pip install torch torchvision torchaudio
[00:14] Installing ComfyUI requirements...
[00:14] Running: /Users/runner/work/comfy-gpu-ci/comfy-gpu-ci/test_workspaces/SAM3-1010/venv/bin/python -m uv pip install -r /Users/runner/work/comfy-gpu-ci/comfy-gpu-ci/test_workspaces/SAM3-1010/ComfyUI/requirements.txt
[00:24]
Installing custom node...
[00:24] Copying ComfyUI-SAM3 to custom_nodes/...
[00:24] Installing node requirements...
[00:24] Running: /Users/runner/work/comfy-gpu-ci/comfy-gpu-ci/test_workspaces/SAM3-1010/venv/bin/python -m uv pip install -r /Users/runner/work/comfy-gpu-ci/comfy-gpu-ci/test_workspaces/SAM3-1010/ComfyUI/custom_nodes/ComfyUI-SAM3/requirements.txt
[00:25]
Running install.py...
[00:25] Running: /Users/runner/work/comfy-gpu-ci/comfy-gpu-ci/test_workspaces/SAM3-1010/venv/bin/python /Users/runner/work/comfy-gpu-ci/comfy-gpu-ci/test_workspaces/SAM3-1010/ComfyUI/custom_nodes/ComfyUI-SAM3/install.py
[00:25]
[00:25] Installing 2 node dependencies...
[00:25] Cloning ComfyUI-VideoHelperSuite...
[00:26] Installing requirements for ComfyUI-VideoHelperSuite...
[00:27] Cloning ComfyUI-Multiband...
[00:27] Installing requirements for ComfyUI-Multiband...
[00:27]
[00:27] [requirements] Re-installing main package requirements...
[00:27] Installing requirements for ComfyUI-SAM3...
[00:28] [comfy-env] _discover: scanning /Users/runner/work/comfy-gpu-ci/comfy-gpu-ci/test_workspaces/SAM3-1010/ComfyUI/custom_nodes
[00:28] [comfy-env] _discover: ComfyUI-Multiband: no comfy-env.toml found
[00:28] [comfy-env] _discover: ComfyUI-SAM3 -> sam3-nodes (custom_nodes/ComfyUI-SAM3/nodes/comfy-env.toml)
[00:28] [comfy-env] _discover: ComfyUI-VideoHelperSuite: no comfy-env.toml found
[00:28] [comfy-env] Workspace: /Users/runner/.ce
[00:28] [comfy-env] ComfyUI: /Users/runner/work/comfy-gpu-ci/comfy-gpu-ci/test_workspaces/SAM3-1010/ComfyUI
[00:28] [comfy-env] Found 1 node config(s):
[00:28] - sam3-nodes <- custom_nodes/ComfyUI-SAM3/nodes/comfy-env.toml (python=host)
[00:28] [comfy-env] Bootstrap interpreter has python 3.10 + torch 2.11.0 (cpu). Looking for cuda-only wheels matching cpu/torch2.11/cp310.
[00:28] Generated /Users/runner/.ce/pixi.toml
[00:28] [comfy-env] Installing 1 environment(s):
[00:28] - sam3-nodes (python=host, 19 pypi deps, 3 cuda wheels)
[00:28] [comfy-env] Running `pixi install -e sam3-nodes`...
[00:36] WARN Skipped running the post-link scripts because `run-post-link-scripts` = `false`
[00:36] - bin/.librsvg-pre-unlink.sh
[00:36] To enable them, run:
[00:36] pixi config set --local run-post-link-scripts insecure
[00:36] More info:
[00:36] https://pixi.sh/latest/reference/pixi_configuration/#run-post-link-scripts
[00:44] ✔ The sam3-nodes environment has been installed.
[00:44] [comfy-env] sam3-nodes: deduped libomp
[00:44] [comfy-env] Recorded install hash e21c08d4d5c5 -> /Users/runner/.ce/install.hash
[00:44] [comfy-env] Install log: /Users/runner/.ce/install.log
[00:44]
[00:44] Installation complete!
[00:44] Installing 2 node dependency(ies)...
[00:44] ComfyUI-VideoHelperSuite from Kosinkadink/ComfyUI-VideoHelperSuite
[00:44] ComfyUI-VideoHelperSuite already exists, skipping...
[00:44] ComfyUI-Multiband from PozzettiAndrea/ComfyUI-Multiband
[00:44] ComfyUI-Multiband already exists, skipping...
[00:44] Installing validation endpoint...
[00:44] Cloning PozzettiAndrea/ComfyUI-validate-endpoint...
[00:44] Running: git clone --depth 1 https://github.com/PozzettiAndrea/ComfyUI-validate-endpoint.git /Users/runner/work/comfy-gpu-ci/comfy-gpu-ci/test_workspaces/SAM3-1010/ComfyUI/custom_nodes/ComfyUI-validate-endpoint
[00:45] CUDA packages absent (will mock): cc_torch, torch_generic_nms, flash_attn
[00:45] [INSTALL] PASSED
[00:45]
[00:45] [3/5] REGISTRATION
[00:45] ----------------------------------------
[00:45]
[DEBUG] server=None, server_url=None, api=None
[00:45]
Starting ComfyUI server...
[00:45] Starting ComfyUI server on port 41882...
[00:45] CUDA mock packages: cc_torch, torch_generic_nms, flash_attn
[00:45] Starting ComfyUI server on port 41882...
[00:45] Waiting for server to be ready (timeout: 600s)...
[00:46] [ComfyUI] setup plugin alembic.autogenerate.schemas
[00:46] [ComfyUI] setup plugin alembic.autogenerate.tables
[00:46] [ComfyUI] setup plugin alembic.autogenerate.types
[00:46] [ComfyUI] setup plugin alembic.autogenerate.constraints
[00:46] [ComfyUI] setup plugin alembic.autogenerate.defaults
[00:46] [ComfyUI] setup plugin alembic.autogenerate.comments
[00:46] [ComfyUI] Could not autodetect AIMDO implementation, assuming Nvidia
[00:46] [ComfyUI] comfy-aimdo unsupported operating system: Darwin
[00:46] [ComfyUI] NOTE: comfy-aimdo currently only supports Windows and Linux
[00:47] [ComfyUI] [comfy-env] ComfyUI-SAM3: 1 isolation env(s):
[00:47] [ComfyUI] [comfy-env] nodes -> /Users/runner/work/comfy-gpu-ci/comfy-gpu-ci/test_workspaces/SAM3-1010/ComfyUI/custom_nodes/ComfyUI-SAM3/nodes
[00:49] [ComfyUI] [comfy-env] prestartup complete
[00:49] [ComfyUI]
[00:49] [ComfyUI] Prestartup times for custom nodes:
[00:49] [ComfyUI] 3.0 seconds: /Users/runner/work/comfy-gpu-ci/comfy-gpu-ci/test_workspaces/SAM3-1010/ComfyUI/custom_nodes/ComfyUI-SAM3
[00:49] [ComfyUI]
[00:49] [ComfyUI] WARNING: Potential Error in code: Torch already imported, torch should never be imported before this point.
[00:53] [ComfyUI] Found comfy_kitchen backend triton: {'available': False, 'disabled': True, 'unavailable_reason': "ImportError: No module named 'triton'", 'capabilities': []}
[00:53] [ComfyUI] Found comfy_kitchen backend cuda: {'available': False, 'disabled': True, 'unavailable_reason': 'Extension file not found: /Users/runner/work/comfy-gpu-ci/comfy-gpu-ci/test_workspaces/SAM3-1010/venv/lib/python3.10/site-packages/comfy_kitchen/backends/cuda/_C.abi3.so', 'capabilities': []}
[00:53] [ComfyUI] Found comfy_kitchen backend eager: {'available': True, 'disabled': False, 'unavailable_reason': None, 'capabilities': ['apply_rope', 'apply_rope1', 'dequantize_mxfp8', 'dequantize_nvfp4', 'dequantize_per_tensor_fp8', 'quantize_mxfp8', 'quantize_nvfp4', 'quantize_per_tensor_fp8', 'scaled_mm_mxfp8', 'scaled_mm_nvfp4']}
[00:53] [ComfyUI] Checkpoint files will always be loaded safely.
[00:53] [ComfyUI] Total VRAM 7168 MB, total RAM 7168 MB
[00:53] [ComfyUI] pytorch version: 2.11.0
[00:53] [ComfyUI] Mac Version (15, 7, 4)
[00:53] [ComfyUI] Set vram state to: SHARED
[00:53] [ComfyUI] Device: mps
[00:53] [ComfyUI] Using sub quadratic optimization for attention, if you have memory or speed issues try using: --use-split-cross-attention
[01:00] [ComfyUI] objc[2900]: Class AVFFrameReceiver is implemented in both /Users/runner/work/comfy-gpu-ci/comfy-gpu-ci/test_workspaces/SAM3-1010/venv/lib/python3.10/site-packages/cv2/.dylibs/libavdevice.61.3.100.dylib (0x112fa43a8) and /Users/runner/work/comfy-gpu-ci/comfy-gpu-ci/test_workspaces/SAM3-1010/venv/lib/python3.10/site-packages/av/.dylibs/libavdevice.62.1.100.dylib (0x11dfc43a8). This may cause spurious casting failures and mysterious crashes. One of the duplicates must be removed or renamed.
[01:00] [ComfyUI] objc[2900]: Class AVFAudioReceiver is implemented in both /Users/runner/work/comfy-gpu-ci/comfy-gpu-ci/test_workspaces/SAM3-1010/venv/lib/python3.10/site-packages/cv2/.dylibs/libavdevice.61.3.100.dylib (0x112fa43f8) and /Users/runner/work/comfy-gpu-ci/comfy-gpu-ci/test_workspaces/SAM3-1010/venv/lib/python3.10/site-packages/av/.dylibs/libavdevice.62.1.100.dylib (0x11dfc43f8). This may cause spurious casting failures and mysterious crashes. One of the duplicates must be removed or renamed.
[01:01] [ComfyUI] Python version: 3.10.11 (v3.10.11:7d4cc5aa85, Apr 4 2023, 19:05:19) [Clang 13.0.0 (clang-1300.0.29.30)]
[01:01] [ComfyUI] ComfyUI version: 0.21.0
[01:01] [ComfyUI] comfy-aimdo version: 0.3.0
[01:01] [ComfyUI] comfy-kitchen version: 0.2.8
[01:01] [ComfyUI] ****** User settings have been changed to be stored on the server instead of browser storage. ******
[01:01] [ComfyUI] ****** For multi-user setups add the --multi-user CLI argument to enable multiple user profiles. ******
[01:01] [ComfyUI] ComfyUI frontend version: 1.43.18
[01:01] [ComfyUI] [Prompt Server] web root: /Users/runner/work/comfy-gpu-ci/comfy-gpu-ci/test_workspaces/SAM3-1010/venv/lib/python3.10/site-packages/comfyui_frontend_package/static
[01:01] [ComfyUI] Asset seeder disabled
[01:04] [ComfyUI] [comfy-env] Version: 0.3.84
[01:05] [ComfyUI] [comfy-env] register_nodes: ComfyUI-SAM3
[01:05] [ComfyUI] [comfy-env] ComfyUI source dir: /Users/runner/work/comfy-gpu-ci/comfy-gpu-ci/test_workspaces/SAM3-1010/ComfyUI
[01:05] [ComfyUI] [comfy-env] Found 1 isolation env(s)
[01:05] [ComfyUI] [comfy-env] Scanning nodes metadata (isolation root)...
[01:05] [ComfyUI] [comfy-env] Metadata scan: /Users/runner/.pixi/bin/pixi run --as-is --manifest-path /Users/runner/.ce/pixi.toml -e sam3-nodes python /var/folders/tb/y368xp_x10s3ty1b_mtl5mxr0000gn/T/comfy_meta_is5dsfu2.py /Users/runner/work/comfy-gpu-ci/comfy-gpu-ci/test_workspaces/SAM3-1010/ComfyUI/custom_nodes/ComfyUI-SAM3 nodes /var/folders/tb/y368xp_x10s3ty1b_mtl5mxr0000gn/T/comfy_meta_out_kc6y06cm.pkl
[01:05] [ComfyUI] [comfy-env] Scan env PATH for nodes:
[01:05] [ComfyUI] [comfy-env] [0] /Users/runner/hostedtoolcache/Python/3.10.11/arm64/bin
[01:05] [ComfyUI] [comfy-env] [1] /Users/runner/hostedtoolcache/Python/3.10.11/arm64
[01:05] [ComfyUI] [comfy-env] [2] /opt/homebrew/lib/ruby/gems/3.3.0/bin
[01:05] [ComfyUI] [comfy-env] [3] /opt/homebrew/opt/ruby@3.3/bin
[01:05] [ComfyUI] [comfy-env] [4] /Users/runner/.local/bin
[01:05] [ComfyUI] [comfy-env] [5] /opt/homebrew/bin
[01:05] [ComfyUI] [comfy-env] [6] /opt/homebrew/sbin
[01:05] [ComfyUI] [comfy-env] [7] /Users/runner/.cargo/bin
[01:05] [ComfyUI] [comfy-env] [8] /usr/local/opt/curl/bin
[01:05] [ComfyUI] [comfy-env] [9] /usr/local/bin
[01:05] [ComfyUI] [comfy-env] [10] /usr/local/sbin
[01:05] [ComfyUI] [comfy-env] [11] /Users/runner/bin
[01:05] [ComfyUI] [comfy-env] [12] /Users/runner/.yarn/bin
[01:05] [ComfyUI] [comfy-env] [13] /Users/runner/Library/Android/sdk/tools
[01:05] [ComfyUI] [comfy-env] [14] /Users/runner/Library/Android/sdk/platform-tools
[01:05] [ComfyUI] [comfy-env] [15] /Library/Frameworks/Python.framework/Versions/Current/bin
[01:05] [ComfyUI] [comfy-env] [16] /Library/Frameworks/Mono.framework/Versions/Current/Commands
[01:05] [ComfyUI] [comfy-env] [17] /usr/bin
[01:05] [ComfyUI] [comfy-env] [18] /bin
[01:05] [ComfyUI] [comfy-env] [19] /usr/sbin
[01:05] [ComfyUI] [comfy-env] [20] /sbin
[01:05] [ComfyUI] [comfy-env] [21] /Users/runner/.dotnet/tools
[01:15] [ComfyUI] [comfy-env] Metadata scan stderr for nodes:
[01:15] [ComfyUI] [comfy-env] [meta-scan] importing nodes from /Users/runner/work/comfy-gpu-ci/comfy-gpu-ci/test_workspaces/SAM3-1010/ComfyUI/custom_nodes/ComfyUI-SAM3
[01:15] [ComfyUI] [comfy-env] [meta-scan] import OK
[01:15] [ComfyUI] [comfy-env] Scanned nodes: 15 nodes (10.5s)
[01:15] [ComfyUI] [comfy-env] Scanned nodes root: 15 nodes (10.5s)
[01:15] [ComfyUI] [comfy-env] Registered proxy route: POST /sam3/interactive_segment_one -> nodes.sam3_interactive._api_segment_one
[01:15] [ComfyUI] [comfy-env] Imported nodes root: 15 nodes (isolation)
[01:15] [ComfyUI] [comfy-env] Registered 15 total nodes
[01:15] [ComfyUI] ComfyUI-Multiband loaded: 15 nodes registered
[01:15] [ComfyUI]
[01:15] [ComfyUI] Import times for custom nodes:
[01:15] [ComfyUI] 0.0 seconds: /Users/runner/work/comfy-gpu-ci/comfy-gpu-ci/test_workspaces/SAM3-1010/ComfyUI/custom_nodes/ComfyUI-validate-endpoint
[01:15] [ComfyUI] 0.0 seconds: /Users/runner/work/comfy-gpu-ci/comfy-gpu-ci/test_workspaces/SAM3-1010/ComfyUI/custom_nodes/websocket_image_save.py
[01:15] [ComfyUI] 0.1 seconds: /Users/runner/work/comfy-gpu-ci/comfy-gpu-ci/test_workspaces/SAM3-1010/ComfyUI/custom_nodes/ComfyUI-VideoHelperSuite
[01:15] [ComfyUI] 0.2 seconds: /Users/runner/work/comfy-gpu-ci/comfy-gpu-ci/test_workspaces/SAM3-1010/ComfyUI/custom_nodes/ComfyUI-Multiband
[01:15] [ComfyUI] 10.8 seconds: /Users/runner/work/comfy-gpu-ci/comfy-gpu-ci/test_workspaces/SAM3-1010/ComfyUI/custom_nodes/ComfyUI-SAM3
[01:15] [ComfyUI]
[01:15] [ComfyUI] Context impl SQLiteImpl.
[01:15] [ComfyUI] Will assume non-transactional DDL.
[01:15] [ComfyUI] Context impl SQLiteImpl.
[01:15] [ComfyUI] Will assume non-transactional DDL.
[01:15] [ComfyUI] Running upgrade -> 0001_assets, Initial assets schema
[01:15] [ComfyUI] Revision ID: 0001_assets
[01:15] [ComfyUI] Revises: None
[01:15] [ComfyUI] Create Date: 2025-12-10 00:00:00
[01:15] [ComfyUI] Running upgrade 0001_assets -> 0002_merge_to_asset_references, Merge AssetInfo and AssetCacheState into unified asset_references table.
[01:15] [ComfyUI] Running upgrade 0002_merge_to_asset_references -> 0003_add_metadata_job_id, Add system_metadata and job_id columns to asset_references.
[01:15] [ComfyUI] Change preview_id FK from assets.id to asset_references.id.
[01:16] [ComfyUI] Database upgraded from None to 0003_add_metadata_job_id
[01:16] [ComfyUI] Starting server
[01:16] [ComfyUI]
[01:16] [ComfyUI] To see the GUI go to: http://127.0.0.1:41882
[01:16] Server responding, waiting for nodes to load...
[01:36] Server is ready!
[01:36] Checking for import errors in server logs...
[01:36] No import errors detected
[01:37] Found 778 registered nodes
[01:37] [REGISTRATION] PASSED
[01:37]
[01:37] [4/5] INSTANTIATION
[01:37] ----------------------------------------
[01:37]
[DEBUG] server=<comfy_test.comfyui.server.ComfyUIServer object at 0x10257a110>, server_url=None, api=<comfy_test.comfyui.api.ComfyUIAPI object at 0x1025bb730>
[01:37] Testing node constructors...
[01:44] All 15 node(s) instantiated successfully!
[01:44] [INSTANTIATION] PASSED
[01:44]
[01:44] [5/5] EXECUTION
[01:44] ----------------------------------------
[01:44]
[DEBUG] server=<comfy_test.comfyui.server.ComfyUIServer object at 0x10257a110>, server_url=None, api=<comfy_test.comfyui.api.ComfyUIAPI object at 0x1025bb730>
[01:44] CPU runner - will execute 4 workflow(s)
[01:44] Running 5 workflow(s) (all with videos)...
[01:44] Installing screenshot dependencies (playwright, pillow)...
[01:46] Packages installed, downloading chromium browser...
[01:54] Screenshot dependencies installed successfully
[01:54] Starting headless browser...
[01:55] macOS -- using Apple Metal GPU via ANGLE
[01:55] Capturing execution frames: image_seg_point.json
[01:58] [ComfyUI] [DEPRECATION WARNING] Detected import of deprecated legacy API: /extensions/core/widgetInputs.js. This is likely caused by a custom node extension using outdated APIs. Please update your extensions or contact the extension author for an updated version.
[02:04] Frame 1 saved (frame_000.jpg, t=0.0s)
[02:04] Validating workflow...
[02:04] [ComfyUI] === /validate endpoint called ===
[02:04] [ComfyUI] Received JSON with keys: ['prompt']
[02:04] [ComfyUI] Prompt has 6 nodes
[02:04] [ComfyUI] Node 1: LoadImage
[02:04] [ComfyUI] Inputs: {"image": "example_image.jpg"}
[02:04] [ComfyUI] Node 15: SAM3PointCollector
[02:04] [ComfyUI] Inputs: {"points_store": "{\"positive\":[{\"x\":426.27735719657574,\"y\":321.42611685978835},{\"x\":417.13743597288953,\"y\":407.3413796907987},{\"x\":431.76130993078743,\"y\":549.9241563039649}],\"negative\"
[02:04] [ComfyUI] Node 28: PreviewImage
[02:04] [ComfyUI] Inputs: {"images": ["31", 2]}
[02:04] [ComfyUI] Node 29: MaskPreview
[02:04] [ComfyUI] Inputs: {"mask": ["31", 0]}
[02:04] [ComfyUI] Node 30: LoadSAM3Model
[02:04] [ComfyUI] Inputs: {"precision": "auto", "compile": false}
[02:04] [ComfyUI] Node 31: SAM3Segmentation
[02:04] [ComfyUI] Inputs: {"refinement_iterations": 0, "use_multimask": true, "output_best_mask": true, "sam3_model_config": ["30", 0], "image": ["1", 0], "positive_points": ["15", 0], "negative_points": ["15", 1]}
[02:04] [ComfyUI] Generated prompt_id: 11abe579-9616-4a3b-95f2-56fb5d102f2a
[02:04] [ComfyUI] Calling execution.validate_prompt()...
[02:04] [ComfyUI] Validation result: valid=True
[02:04] [ComfyUI] === Validation PASSED ===
[02:04] Queuing workflow for execution...
[02:04] [ComfyUI] got prompt
[02:04] [ComfyUI] [comfy-env] Running SAM3PointCollector: points_store: '{"positive":[{"x":426.27735719657574,"y":321.42611685978..., coordinates: '[{"x":426.27735719657574,"y":321.42611685978835},{"x":41..., neg_coordinates: '[]', image: torch.float32 [1,720,1280,3] cpu
[02:04] [ComfyUI] [comfy-env] SubprocessWorker: /Users/runner/.ce/.pixi/envs/sam3-nodes/bin/python
[02:04] [ComfyUI] [comfy-env] env_vars: {'PYTORCH_ENABLE_MPS_FALLBACK': '1', 'COMFYUI_BASE': '/Users/runner/work/comfy-gpu-ci/comfy-gpu-ci/test_workspaces/SAM3-1010/ComfyUI'}
[02:04] [ComfyUI] [SubprocessWorker] call_method: nodes.sam3_interactive.SAM3PointCollector.EXECUTE_NORMALIZED
[02:04] [ComfyUI] [SubprocessWorker] acquired lock, ensuring started...
[02:04] [ComfyUI] [ComfyUI-SAM3] python: /Users/runner/.ce/.pixi/envs/sam3-nodes/bin/python
[02:04] [ComfyUI] [ComfyUI-SAM3] sys_path sent to worker: ['/Users/runner/work/comfy-gpu-ci/comfy-gpu-ci/test_workspaces/SAM3-1010/ComfyUI', '/Users/runner/work/comfy-gpu-ci/comfy-gpu-ci/test_workspaces/SAM3-1010/ComfyUI/custom_nodes/ComfyUI-SAM3', '/Users/runner/.ce/.pixi/envs/sam3-nodes/lib/python3.1/site-packages', '/Users/runner/work/comfy-gpu-ci/comfy-gpu-ci/test_workspaces/SAM3-1010/ComfyUI/custom_nodes/ComfyUI-SAM3']
[02:04] [ComfyUI] [SubprocessWorker] is_pixi=True, python=/Users/runner/.ce/.pixi/envs/sam3-nodes/bin/python
[02:04] [ComfyUI] [SubprocessWorker] launching cmd=['/Users/runner/.pixi/bin/pixi', 'run', '--as-is', '--manifest-path', '/Users/runner/.ce/pixi.toml', '-e', 'sam3-nodes', 'python', '/var/folders/tb/y368xp_x10s3ty1b_mtl5mxr0000gn/T/comfyui_pvenv_qg3md4xk/persistent_worker.py', 'unix:///var/folders/tb/y368xp_x10s3ty1b_mtl5mxr0000gn/T/comfy_worker_7e5fc5a86b6d.sock']...
[02:04] [ComfyUI] [SubprocessWorker] socket_addr=unix:///var/folders/tb/y368xp_x10s3ty1b_mtl5mxr0000gn/T/comfy_worker_7e5fc5a86b6d.sock exists=True
[02:06] Frame 2 saved (frame_001.jpg, t=2.5s)
[02:06] [capture-periodic] freeze=2ms shot=111ms unfreeze=7ms saved=True
[02:08] [ComfyUI] [SubprocessWorker] worker started/confirmed
[02:08] [ComfyUI] [comfy-env] PRE-SERIALIZE 'image' shape: torch.Size([1, 720, 1280, 3])
[02:08] [ComfyUI] [SubprocessWorker] serializing kwargs to shm...
[02:08] [ComfyUI] [SubprocessWorker] created 0 shm blocks
[02:08] [ComfyUI] [SubprocessWorker] sending request via socket...
[02:08] [ComfyUI] [SubprocessWorker] call_id=1 sending call_method
[02:08] [ComfyUI] [worker:ComfyUI-SAM3] [comfy-env] _from_shm got dict with keys: ['__type__', 'strategy', 'manager_path', 'storage_key', 'storage_size']
[02:08] [ComfyUI] [worker:ComfyUI-SAM3] [comfy-env] DESERIALIZE TensorRef: tensor_size=[1, 720, 1280, 3]
[02:08] [ComfyUI] [worker:ComfyUI-SAM3] [comfy-env] DESERIALIZED tensor shape: torch.Size([1, 720, 1280, 3])
[02:09] Frame 3 saved (frame_002.jpg, t=4.8s)
[02:09] [capture-periodic] freeze=6ms shot=146ms unfreeze=11ms saved=True
[02:10] [ComfyUI] [SubprocessWorker] got response: ok
[02:10] [ComfyUI] [comfy-env] SAM3PointCollector done (5.36s): result: NodeOutput
[02:10] [ComfyUI] [comfy-env] Running LoadSAM3Model: precision: 'auto', compile: False
[02:10] [ComfyUI] [SubprocessWorker] call_method: nodes.load_model.LoadSAM3Model.EXECUTE_NORMALIZED
[02:10] [ComfyUI] [SubprocessWorker] acquired lock, ensuring started...
[02:10] [ComfyUI] [ComfyUI-SAM3] Health check: ping (timeout=5.0s)...
[02:10] [ComfyUI] [ComfyUI-SAM3] Health check: ok
[02:10] [ComfyUI] [SubprocessWorker] worker started/confirmed
[02:10] [ComfyUI] [SubprocessWorker] serializing kwargs to shm...
[02:10] [ComfyUI] [SubprocessWorker] created 0 shm blocks
[02:10] [ComfyUI] [SubprocessWorker] sending request via socket...
[02:10] [ComfyUI] [SubprocessWorker] call_id=2 sending call_method
[02:10] [ComfyUI] [worker:ComfyUI-SAM3] [SAM3] Model not found at /Users/runner/work/comfy-gpu-ci/comfy-gpu-ci/test_workspaces/SAM3-1010/ComfyUI/models/sam3/sam3.safetensors, downloading from HuggingFace...
[02:10] Node executed (1 total), capturing...
[02:10] Frame 4 saved (frame_003.jpg, t=6.2s)
[02:10] [capture-node] freeze=3ms shot=125ms unfreeze=4ms saved=True
[02:10] [ComfyUI] [worker:ComfyUI-SAM3] [SAM3] Downloading sam3.safetensors from apozz/sam3-safetensors...
[02:10] [capture-loop] iter=50 t=6.6s state={'complete': False, 'error': None, 'executedCount': 1, 'wsState': 1} eval_ms=5 ram=3.8/7.0GB (60%) swap=0.0/0.0GB (0%) cpu=74% browser_rss=0.56GB
[02:11] [ComfyUI] [SubprocessWorker] callback 'report_progress' from call_id=2
[02:11] [ComfyUI] [SubprocessWorker] callback 'report_progress' from call_id=2
[02:11] [ComfyUI] [SubprocessWorker] callback 'report_progress' from call_id=2
[02:11] [ComfyUI] [SubprocessWorker] callback 'report_progress' from call_id=2
[02:12] [ComfyUI] [SubprocessWorker] callback 'report_progress' from call_id=2
[02:12] [ComfyUI] [SubprocessWorker] callback 'report_progress' from call_id=2
[02:12] [ComfyUI] [SubprocessWorker] callback 'report_progress' from call_id=2
[02:12] [ComfyUI] [SubprocessWorker] callback 'report_progress' from call_id=2
[02:13] Frame 5 saved (frame_004.jpg, t=8.4s)
[02:13] [capture-periodic] freeze=7ms shot=372ms unfreeze=10ms saved=True
[02:13] [ComfyUI] [SubprocessWorker] callback 'report_progress' from call_id=2
[02:13] [ComfyUI] [SubprocessWorker] callback 'report_progress' from call_id=2
[02:13] [ComfyUI] [worker:ComfyUI-SAM3] [SAM3] Download progress: 10%
[02:13] [ComfyUI] [SubprocessWorker] callback 'report_progress' from call_id=2
[02:13] [ComfyUI] [SubprocessWorker] callback 'report_progress' from call_id=2
[02:13] [ComfyUI] [SubprocessWorker] callback 'report_progress' from call_id=2
[02:13] [ComfyUI] [SubprocessWorker] callback 'report_progress' from call_id=2
[02:14] [ComfyUI] [SubprocessWorker] callback 'report_progress' from call_id=2
[02:14] [ComfyUI] [SubprocessWorker] callback 'report_progress' from call_id=2
[02:14] [ComfyUI] [SubprocessWorker] callback 'report_progress' from call_id=2
[02:14] [ComfyUI] [SubprocessWorker] callback 'report_progress' from call_id=2
[02:14] [ComfyUI] [SubprocessWorker] callback 'report_progress' from call_id=2
[02:14] [ComfyUI] [SubprocessWorker] callback 'report_progress' from call_id=2
[02:14] [ComfyUI] [worker:ComfyUI-SAM3] [SAM3] Download progress: 20%
[02:15] [ComfyUI] [SubprocessWorker] callback 'report_progress' from call_id=2
[02:15] [ComfyUI] [SubprocessWorker] callback 'report_progress' from call_id=2
[02:15] Frame 6 saved (frame_005.jpg, t=10.9s)
[02:15] [capture-periodic] freeze=17ms shot=279ms unfreeze=15ms saved=True
[02:15] [ComfyUI] [SubprocessWorker] callback 'report_progress' from call_id=2
[02:15] [ComfyUI] [SubprocessWorker] callback 'report_progress' from call_id=2
[02:15] [ComfyUI] [SubprocessWorker] callback 'report_progress' from call_id=2
[02:16] [ComfyUI] [SubprocessWorker] callback 'report_progress' from call_id=2
[02:16] [ComfyUI] [SubprocessWorker] callback 'report_progress' from call_id=2
[02:16] [ComfyUI] [SubprocessWorker] callback 'report_progress' from call_id=2
[02:16] [ComfyUI] [SubprocessWorker] callback 'report_progress' from call_id=2
[02:17] [ComfyUI] [SubprocessWorker] callback 'report_progress' from call_id=2
[02:17] [ComfyUI] [worker:ComfyUI-SAM3] [SAM3] Download progress: 30%
[02:17] [ComfyUI] [SubprocessWorker] callback 'report_progress' from call_id=2
[02:17] [capture-loop] iter=100 t=13.2s state={'complete': False, 'error': None, 'executedCount': 1, 'wsState': 1} eval_ms=14 ram=3.8/7.0GB (60%) swap=0.0/0.0GB (0%) cpu=82% browser_rss=0.56GB
[02:17] [ComfyUI] [SubprocessWorker] callback 'report_progress' from call_id=2
[02:17] [ComfyUI] [SubprocessWorker] callback 'report_progress' from call_id=2
[02:17] Frame 7 saved (frame_006.jpg, t=13.4s)
[02:17] [capture-periodic] freeze=11ms shot=233ms unfreeze=3ms saved=True
[02:17] [ComfyUI] [SubprocessWorker] callback 'report_progress' from call_id=2
[02:18] [ComfyUI] [SubprocessWorker] callback 'report_progress' from call_id=2
[02:18] [ComfyUI] [SubprocessWorker] callback 'report_progress' from call_id=2
[02:18] [ComfyUI] [SubprocessWorker] callback 'report_progress' from call_id=2
[02:18] [ComfyUI] [SubprocessWorker] callback 'report_progress' from call_id=2
[02:18] [ComfyUI] [SubprocessWorker] callback 'report_progress' from call_id=2
[02:19] [ComfyUI] [SubprocessWorker] callback 'report_progress' from call_id=2
[02:19] [ComfyUI] [worker:ComfyUI-SAM3] [SAM3] Download progress: 40%
[02:19] [ComfyUI] [SubprocessWorker] callback 'report_progress' from call_id=2
[02:19] [ComfyUI] [SubprocessWorker] callback 'report_progress' from call_id=2
[02:19] [ComfyUI] [SubprocessWorker] callback 'report_progress' from call_id=2
[02:20] [ComfyUI] [SubprocessWorker] callback 'report_progress' from call_id=2
[02:20] Frame 8 saved (frame_007.jpg, t=15.7s)
[02:20] [capture-periodic] freeze=7ms shot=294ms unfreeze=10ms saved=True
[02:20] [ComfyUI] [SubprocessWorker] callback 'report_progress' from call_id=2
[02:20] [ComfyUI] [SubprocessWorker] callback 'report_progress' from call_id=2
[02:20] [ComfyUI] [SubprocessWorker] callback 'report_progress' from call_id=2
[02:20] [ComfyUI] [SubprocessWorker] callback 'report_progress' from call_id=2
[02:21] [ComfyUI] [SubprocessWorker] callback 'report_progress' from call_id=2
[02:21] [ComfyUI] [SubprocessWorker] callback 'report_progress' from call_id=2
[02:21] [ComfyUI] [worker:ComfyUI-SAM3] [SAM3] Download progress: 50%
[02:21] [ComfyUI] [SubprocessWorker] callback 'report_progress' from call_id=2
[02:22] [ComfyUI] [SubprocessWorker] callback 'report_progress' from call_id=2
[02:22] [ComfyUI] [SubprocessWorker] callback 'report_progress' from call_id=2
[02:22] [ComfyUI] [SubprocessWorker] callback 'report_progress' from call_id=2
[02:22] Frame 9 saved (frame_008.jpg, t=18.2s)
[02:22] [capture-periodic] freeze=10ms shot=273ms unfreeze=4ms saved=True
[02:22] [ComfyUI] [SubprocessWorker] callback 'report_progress' from call_id=2
[02:23] [ComfyUI] [SubprocessWorker] callback 'report_progress' from call_id=2
[02:23] [ComfyUI] [SubprocessWorker] callback 'report_progress' from call_id=2
[02:23] [ComfyUI] [SubprocessWorker] callback 'report_progress' from call_id=2
[02:23] [ComfyUI] [SubprocessWorker] callback 'report_progress' from call_id=2
[02:23] [ComfyUI] [SubprocessWorker] callback 'report_progress' from call_id=2
[02:23] [ComfyUI] [worker:ComfyUI-SAM3] [SAM3] Download progress: 60%
[02:24] [ComfyUI] [SubprocessWorker] callback 'report_progress' from call_id=2
[02:24] [capture-loop] iter=150 t=20.0s state={'complete': False, 'error': None, 'executedCount': 1, 'wsState': 1} eval_ms=4 ram=3.8/7.0GB (60%) swap=0.0/0.0GB (0%) cpu=87% browser_rss=0.59GB
[02:24] [ComfyUI] [SubprocessWorker] callback 'report_progress' from call_id=2
[02:24] [ComfyUI] [SubprocessWorker] callback 'report_progress' from call_id=2
[02:24] [ComfyUI] [SubprocessWorker] callback 'report_progress' from call_id=2
[02:24] [ComfyUI] [SubprocessWorker] callback 'report_progress' from call_id=2
[02:25] Frame 10 saved (frame_009.jpg, t=20.6s)
[02:25] [capture-periodic] freeze=15ms shot=205ms unfreeze=2ms saved=True
[02:25] [ComfyUI] [SubprocessWorker] callback 'report_progress' from call_id=2
[02:25] [ComfyUI] [SubprocessWorker] callback 'report_progress' from call_id=2
[02:25] [ComfyUI] [SubprocessWorker] callback 'report_progress' from call_id=2
[02:25] [ComfyUI] [SubprocessWorker] callback 'report_progress' from call_id=2
[02:25] [ComfyUI] [SubprocessWorker] callback 'report_progress' from call_id=2
[02:25] [ComfyUI] [worker:ComfyUI-SAM3] [SAM3] Download progress: 70%
[02:26] [ComfyUI] [SubprocessWorker] callback 'report_progress' from call_id=2
[02:26] [ComfyUI] [SubprocessWorker] callback 'report_progress' from call_id=2
[02:26] [ComfyUI] [SubprocessWorker] callback 'report_progress' from call_id=2
[02:26] [ComfyUI] [SubprocessWorker] callback 'report_progress' from call_id=2
[02:26] [ComfyUI] [SubprocessWorker] callback 'report_progress' from call_id=2
[02:27] [ComfyUI] [SubprocessWorker] callback 'report_progress' from call_id=2
[02:27] [ComfyUI] [SubprocessWorker] callback 'report_progress' from call_id=2
[02:27] Frame 11 saved (frame_010.jpg, t=23.0s)
[02:27] [capture-periodic] freeze=4ms shot=279ms unfreeze=9ms saved=True
[02:27] [ComfyUI] [SubprocessWorker] callback 'report_progress' from call_id=2
[02:27] [ComfyUI] [SubprocessWorker] callback 'report_progress' from call_id=2
[02:27] [ComfyUI] [SubprocessWorker] callback 'report_progress' from call_id=2
[02:27] [ComfyUI] [worker:ComfyUI-SAM3] [SAM3] Download progress: 80%
[02:28] [ComfyUI] [SubprocessWorker] callback 'report_progress' from call_id=2
[02:28] [ComfyUI] [SubprocessWorker] callback 'report_progress' from call_id=2
[02:28] [ComfyUI] [SubprocessWorker] callback 'report_progress' from call_id=2
[02:28] [ComfyUI] [SubprocessWorker] callback 'report_progress' from call_id=2
[02:28] [ComfyUI] [SubprocessWorker] callback 'report_progress' from call_id=2
[02:29] [ComfyUI] [SubprocessWorker] callback 'report_progress' from call_id=2
[02:29] [ComfyUI] [SubprocessWorker] callback 'report_progress' from call_id=2
[02:29] [ComfyUI] [SubprocessWorker] callback 'report_progress' from call_id=2
[02:29] [ComfyUI] [SubprocessWorker] callback 'report_progress' from call_id=2
[02:29] Frame 12 saved (frame_011.jpg, t=25.4s)
[02:29] [capture-periodic] freeze=34ms shot=181ms unfreeze=14ms saved=True
[02:29] [ComfyUI] [SubprocessWorker] callback 'report_progress' from call_id=2
[02:29] [ComfyUI] [worker:ComfyUI-SAM3] [SAM3] Download progress: 90%
[02:30] [ComfyUI] [SubprocessWorker] callback 'report_progress' from call_id=2
[02:30] [ComfyUI] [SubprocessWorker] callback 'report_progress' from call_id=2
[02:30] [ComfyUI] [SubprocessWorker] callback 'report_progress' from call_id=2
[02:30] [ComfyUI] [SubprocessWorker] callback 'report_progress' from call_id=2
[02:30] [capture-loop] iter=200 t=26.6s state={'complete': False, 'error': None, 'executedCount': 1, 'wsState': 1} eval_ms=9 ram=3.7/7.0GB (60%) swap=0.0/0.0GB (0%) cpu=94% browser_rss=0.61GB
[02:30] [ComfyUI] [SubprocessWorker] callback 'report_progress' from call_id=2
[02:31] [ComfyUI] [SubprocessWorker] callback 'report_progress' from call_id=2
[02:31] [ComfyUI] [SubprocessWorker] callback 'report_progress' from call_id=2
[02:31] [ComfyUI] [SubprocessWorker] callback 'report_progress' from call_id=2
[02:31] [ComfyUI] [SubprocessWorker] callback 'report_progress' from call_id=2
[02:31] [ComfyUI] [SubprocessWorker] callback 'report_progress' from call_id=2
[02:32] [ComfyUI] [worker:ComfyUI-SAM3] [SAM3] Download progress: 100%
[02:32] [ComfyUI] [SubprocessWorker] callback 'report_progress' from call_id=2
[02:32] [ComfyUI] [worker:ComfyUI-SAM3] [SAM3] Downloaded sam3.safetensors
[02:32] [ComfyUI] [worker:ComfyUI-SAM3] [SAM3] Model downloaded successfully
[02:32] [ComfyUI] [SubprocessWorker] got response: ok
[02:32] [ComfyUI] [comfy-env] LoadSAM3Model done (21.94s): result: NodeOutput
[02:32] [ComfyUI] [comfy-env] Running SAM3Segmentation: refinement_iterations: 0, use_multimask: True, output_best_mask: True, sam3_model_config: dict, image: torch.float32 [1,720,1280,3] cpu, positive_points: dict, negative_points: dict
[02:32] [ComfyUI] [SubprocessWorker] call_method: nodes.segmentation.SAM3Segmentation.EXECUTE_NORMALIZED
[02:32] [ComfyUI] [SubprocessWorker] acquired lock, ensuring started...
[02:32] [ComfyUI] [ComfyUI-SAM3] Health check: ping (timeout=5.0s)...
[02:32] [ComfyUI] [ComfyUI-SAM3] Health check: ok
[02:32] [ComfyUI] [SubprocessWorker] worker started/confirmed
[02:32] [ComfyUI] [comfy-env] PRE-SERIALIZE 'image' shape: torch.Size([1, 720, 1280, 3])
[02:32] [ComfyUI] [SubprocessWorker] serializing kwargs to shm...
[02:32] [ComfyUI] [SubprocessWorker] created 0 shm blocks
[02:32] [ComfyUI] [SubprocessWorker] sending request via socket...
[02:32] [ComfyUI] [SubprocessWorker] call_id=3 sending call_method
[02:32] [ComfyUI] [worker:ComfyUI-SAM3] [comfy-env] _from_shm got dict with keys: ['__type__', 'strategy', 'manager_path', 'storage_key', 'storage_size']
[02:32] [ComfyUI] [worker:ComfyUI-SAM3] [comfy-env] DESERIALIZE TensorRef: tensor_size=[1, 720, 1280, 3]
[02:32] [ComfyUI] [worker:ComfyUI-SAM3] [comfy-env] DESERIALIZED tensor shape: torch.Size([1, 720, 1280, 3])
[02:32] Frame 13 saved (frame_012.jpg, t=27.8s)
[02:32] [capture-periodic] freeze=2ms shot=167ms unfreeze=11ms saved=True
[02:34] Frame 14 saved (frame_013.jpg, t=30.1s)
[02:34] [capture-periodic] freeze=3ms shot=122ms unfreeze=4ms saved=True
[02:34] [ComfyUI] objc[4434]: Class AVFFrameReceiver is implemented in both /Users/runner/.ce/.pixi/envs/sam3-nodes/lib/libavdevice.62.3.101.dylib (0x12b5c07a8) and /Users/runner/.ce/.pixi/envs/sam3-nodes/lib/python3.10/site-packages/cv2/.dylibs/libavdevice.61.3.100.dylib (0x1449743a8). This may cause spurious casting failures and mysterious crashes. One of the duplicates must be removed or renamed.
[02:34] [ComfyUI] objc[4434]: Class AVFAudioReceiver is implemented in both /Users/runner/.ce/.pixi/envs/sam3-nodes/lib/libavdevice.62.3.101.dylib (0x12b5c07f8) and /Users/runner/.ce/.pixi/envs/sam3-nodes/lib/python3.10/site-packages/cv2/.dylibs/libavdevice.61.3.100.dylib (0x1449743f8). This may cause spurious casting failures and mysterious crashes. One of the duplicates must be removed or renamed.
[02:36] [capture-loop] iter=250 t=32.6s state={'complete': False, 'error': None, 'executedCount': 1, 'wsState': 1} eval_ms=4 ram=3.7/7.0GB (60%) swap=0.0/0.0GB (0%) cpu=69% browser_rss=0.60GB
[02:42] [capture-loop] iter=300 t=38.4s state={'complete': False, 'error': None, 'executedCount': 1, 'wsState': 1} eval_ms=6 ram=3.6/7.0GB (62%) swap=0.0/0.0GB (0%) cpu=49% browser_rss=0.58GB
[02:48] [capture-loop] iter=350 t=44.8s state={'complete': False, 'error': None, 'executedCount': 1, 'wsState': 1} eval_ms=4 ram=3.2/7.0GB (68%) swap=0.0/0.0GB (0%) cpu=70% browser_rss=0.46GB
[02:55] [capture-loop] iter=400 t=51.2s state={'complete': False, 'error': None, 'executedCount': 1, 'wsState': 1} eval_ms=3 ram=2.9/7.0GB (72%) swap=0.0/0.0GB (0%) cpu=74% browser_rss=0.28GB
[03:01] [capture-loop] iter=450 t=57.5s state={'complete': False, 'error': None, 'executedCount': 1, 'wsState': 1} eval_ms=5 ram=2.7/7.0GB (74%) swap=0.0/0.0GB (0%) cpu=56% browser_rss=0.25GB
[03:05] [ComfyUI] [worker:ComfyUI-SAM3]
[03:05] [ComfyUI] === WATCHDOG TICK 1 ===
[03:05] [ComfyUI] [worker:ComfyUI-SAM3] Current thread 0x000000016ca8b000 (most recent call first):
[03:05] [ComfyUI] File "/var/folders/tb/y368xp_x10s3ty1b_mtl5mxr0000gn/T/comfyui_pvenv_qg3md4xk/persistent_worker.py", line 52 in _watchdog
[03:05] [ComfyUI] File "/Users/runner/.ce/.pixi/envs/sam3-nodes/lib/python3.10/threading.py", line 953 in run
[03:05] [ComfyUI] File "/Users/runner/.ce/.pixi/envs/sam3-nodes/lib/python3.10/threading.py", line 1016 in _bootstrap_inner
[03:05] [ComfyUI] File "/Users/runner/.ce/.pixi/envs/sam3-nodes/lib/python3.10/threading.py", line 973 in _bootstrap
[03:05] [ComfyUI]
[03:05] [ComfyUI] Thread 0x00000001feaca240 (most recent call first):
[03:05] [ComfyUI] File "/Users/runner/work/comfy-gpu-ci/comfy-gpu-ci/test_workspaces/SAM3-1010/ComfyUI/custom_nodes/ComfyUI-SAM3/nodes/_model_cache.py", line 120 in get_or_build_model
[03:05] [ComfyUI] File "/Users/runner/work/comfy-gpu-ci/comfy-gpu-ci/test_workspaces/SAM3-1010/ComfyUI/custom_nodes/ComfyUI-SAM3/nodes/segmentation.py", line 469 in execute
[03:05] [ComfyUI] File "/Users/runner/work/comfy-gpu-ci/comfy-gpu-ci/test_workspaces/SAM3-1010/ComfyUI/comfy_api/latest/_io.py", line 1833 in EXECUTE_NORMALIZED
[03:05] [ComfyUI] File "/var/folders/tb/y368xp_x10s3ty1b_mtl5mxr0000gn/T/comfyui_pvenv_qg3md4xk/persistent_worker.py", line 1762 in main
[03:05] [ComfyUI] File "/var/folders/tb/y368xp_x10s3ty1b_mtl5mxr0000gn/T/comfyui_pvenv_qg3md4xk/persistent_worker.py", line 1807 in <module>
[03:05] [ComfyUI]
[03:05] [ComfyUI] [worker:ComfyUI-SAM3] === END ===
[03:05] [ComfyUI]
[03:06] [ComfyUI] [SubprocessWorker] callback 'request_vram_budget' from call_id=3
[03:06] [ComfyUI] [comfy-env] VRAM request: 1.84GB, free before eviction: 1.79GB
[03:06] [ComfyUI] [comfy-env] VRAM after eviction: 1.79GB
[03:07] [capture-loop] iter=500 t=63.8s state={'complete': False, 'error': None, 'executedCount': 1, 'wsState': 1} eval_ms=14 ram=3.1/7.0GB (83%) swap=0.0/0.0GB (0%) cpu=56% browser_rss=0.21GB
[03:14] [capture-loop] iter=550 t=70.1s state={'complete': False, 'error': None, 'executedCount': 1, 'wsState': 1} eval_ms=6 ram=3.5/7.0GB (67%) swap=0.0/0.0GB (0%) cpu=78% browser_rss=0.28GB
[03:25] [capture-loop] iter=600 t=81.2s state={'complete': False, 'error': None, 'executedCount': 1, 'wsState': 1} eval_ms=3 ram=2.7/7.0GB (80%) swap=0.0/0.0GB (0%) cpu=73% browser_rss=0.28GB
[03:35] [capture-loop] iter=650 t=91.2s state={'complete': False, 'error': None, 'executedCount': 1, 'wsState': 1} eval_ms=4 ram=4.3/7.0GB (83%) swap=0.0/0.0GB (0%) cpu=63% browser_rss=0.28GB
[03:42] [capture-loop] iter=700 t=98.4s state={'complete': False, 'error': None, 'executedCount': 1, 'wsState': 1} eval_ms=3 ram=2.5/7.0GB (78%) swap=0.0/0.0GB (0%) cpu=78% browser_rss=0.28GB
[03:49] [capture-loop] iter=750 t=105.0s state={'complete': False, 'error': None, 'executedCount': 1, 'wsState': 1} eval_ms=3 ram=3.1/7.0GB (84%) swap=0.0/0.0GB (0%) cpu=76% browser_rss=0.29GB
[03:52] [ComfyUI] [SubprocessWorker] got response: ok
[03:52] [ComfyUI] [comfy-env] SAM3Segmentation done (80.67s): result: NodeOutput
[03:53] [ComfyUI] Prompt executed in 108.43 seconds
[03:53] Node executed (2 total), capturing...
[03:53] Frame 15 saved (frame_014.jpg, t=109.1s)
[03:53] [capture-node] freeze=7ms shot=213ms unfreeze=4ms saved=True
[03:53] Node executed (3 total), capturing...
[03:53] Frame 16 saved (frame_015.jpg, t=109.6s)
[03:53] [capture-node] freeze=4ms shot=126ms unfreeze=0ms saved=True
[03:53] Execution complete (t=109.6s)
[03:53] Captured 16 unique frames over 109.77s
[03:53] [debug] iframes: 0
[03:53] [timing] trigger_3d_previews: 0.0s
[03:56] Saved high-quality screenshot: image_seg_point_executed.png
[03:56] [timing] final_screenshot: 0.2s
[03:56] Capturing execution frames: image_seg_text.json
[04:03] Frame 1 saved (frame_000.jpg, t=0.0s)
[04:03] Validating workflow...
[04:03] [ComfyUI] === /validate endpoint called ===
[04:03] [ComfyUI] Received JSON with keys: ['prompt']
[04:03] [ComfyUI] Prompt has 5 nodes
[04:03] [ComfyUI] Node 1: LoadImage
[04:03] [ComfyUI] Inputs: {"image": "example_image.jpg"}
[04:03] [ComfyUI] Node 3: PreviewImage
[04:03] [ComfyUI] Inputs: {"images": ["15", 1]}
[04:03] [ComfyUI] Node 4: MaskPreview
[04:03] [ComfyUI] Inputs: {"mask": ["15", 0]}
[04:03] [ComfyUI] Node 12: LoadSAM3Model
[04:03] [ComfyUI] Inputs: {"precision": "fp32", "compile": false}
[04:03] [ComfyUI] Node 15: SAM3Grounding
[04:03] [ComfyUI] Inputs: {"confidence_threshold": 0.2, "text_prompt": "child", "max_detections": -1, "sam3_model_config": ["12", 0], "image": ["1", 0]}
[04:03] [ComfyUI] Generated prompt_id: 848cc9c9-ffb8-4657-8a9c-3e12608ee23c
[04:03] [ComfyUI] Calling execution.validate_prompt()...
[04:03] [ComfyUI] Validation result: valid=True
[04:03] [ComfyUI] === Validation PASSED ===
[04:03] Queuing workflow for execution...
[04:03] [ComfyUI] got prompt
[04:03] [ComfyUI] [comfy-env] Running LoadSAM3Model: precision: 'fp32', compile: False
[04:03] [ComfyUI] [SubprocessWorker] call_method: nodes.load_model.LoadSAM3Model.EXECUTE_NORMALIZED
[04:03] [ComfyUI] [SubprocessWorker] acquired lock, ensuring started...
[04:03] [ComfyUI] [ComfyUI-SAM3] Health check: ping (timeout=5.0s)...
[04:03] [ComfyUI] [ComfyUI-SAM3] Health check: ok
[04:03] [ComfyUI] [SubprocessWorker] worker started/confirmed
[04:03] [ComfyUI] [SubprocessWorker] serializing kwargs to shm...
[04:03] [ComfyUI] [SubprocessWorker] created 0 shm blocks
[04:03] [ComfyUI] [SubprocessWorker] sending request via socket...
[04:03] [ComfyUI] [SubprocessWorker] call_id=4 sending call_method
[04:03] [ComfyUI] [SubprocessWorker] got response: ok
[04:03] [ComfyUI] [comfy-env] LoadSAM3Model done (0.08s): result: NodeOutput
[04:03] [ComfyUI] [comfy-env] Running SAM3Grounding: confidence_threshold: 0.2, text_prompt: 'child', max_detections: -1, sam3_model_config: dict, image: torch.float32 [1,720,1280,3] cpu
[04:03] [ComfyUI] [SubprocessWorker] call_method: nodes.segmentation.SAM3Grounding.EXECUTE_NORMALIZED
[04:03] [ComfyUI] [SubprocessWorker] acquired lock, ensuring started...
[04:03] [ComfyUI] [ComfyUI-SAM3] Health check: ping (timeout=5.0s)...
[04:03] [ComfyUI] [ComfyUI-SAM3] Health check: ok
[04:03] [ComfyUI] [SubprocessWorker] worker started/confirmed
[04:03] [ComfyUI] [comfy-env] PRE-SERIALIZE 'image' shape: torch.Size([1, 720, 1280, 3])
[04:03] [ComfyUI] [SubprocessWorker] serializing kwargs to shm...
[04:03] [ComfyUI] [SubprocessWorker] created 0 shm blocks
[04:03] [ComfyUI] [SubprocessWorker] sending request via socket...
[04:03] [ComfyUI] [SubprocessWorker] call_id=5 sending call_method
[04:03] [ComfyUI] [worker:ComfyUI-SAM3] [comfy-env] _from_shm got dict with keys: ['__type__', 'strategy', 'manager_path', 'storage_key', 'storage_size']
[04:03] [ComfyUI] [worker:ComfyUI-SAM3] [comfy-env] DESERIALIZE TensorRef: tensor_size=[1, 720, 1280, 3]
[04:03] [ComfyUI] [worker:ComfyUI-SAM3] [comfy-env] DESERIALIZED tensor shape: torch.Size([1, 720, 1280, 3])
[04:04] [ComfyUI] [SubprocessWorker] callback 'request_vram_budget' from call_id=5
[04:04] [ComfyUI] [comfy-env] VRAM request: 3.50GB, free before eviction: 1.44GB
[04:04] [ComfyUI] [comfy-env] VRAM after eviction: 1.44GB
[04:06] [ComfyUI] [worker:ComfyUI-SAM3]
[04:06] [ComfyUI] === WATCHDOG TICK 2 ===
[04:06] [ComfyUI] [worker:ComfyUI-SAM3] Current thread 0x000000016ca8b000 (most recent call first):
[04:06] [ComfyUI] File "/var/folders/tb/y368xp_x10s3ty1b_mtl5mxr0000gn/T/comfyui_pvenv_qg3md4xk/persistent_worker.py", line 52 in _watchdog
[04:06] [ComfyUI] File "/Users/runner/.ce/.pixi/envs/sam3-nodes/lib/python3.10/threading.py", line 953 in run
[04:06] [ComfyUI] File "/Users/runner/.ce/.pixi/envs/sam3-nodes/lib/python3.10/threading.py", line 1016 in _bootstrap_inner
[04:06] [ComfyUI] File "/Users/runner/.ce/.pixi/envs/sam3-nodes/lib/python3.10/threading.py", line 973 in _bootstrap
[04:06] [ComfyUI]
[04:06] [ComfyUI] Thread 0x00000001feaca240 (most recent call first):
[04:06] [ComfyUI] File "/Users/runner/.ce/.pixi/envs/sam3-nodes/lib/python3.10/site-packages/torch/nn/modules/module.py", line 2161 in _save_to_state_dict
[04:06] [ComfyUI] File "/Users/runner/.ce/.pixi/envs/sam3-nodes/lib/python3.10/site-packages/torch/nn/modules/module.py", line 2267 in state_dict
[04:06] [ComfyUI] File "/Users/runner/.ce/.pixi/envs/sam3-nodes/lib/python3.10/site-packages/torch/nn/modules/module.py", line 2270 in state_dict
[04:06] [ComfyUI] File "/Users/runner/.ce/.pixi/envs/sam3-nodes/lib/python3.10/site-packages/torch/nn/modules/module.py", line 2270 in state_dict
[04:06] [ComfyUI] File "/Users/runner/.ce/.pixi/envs/sam3-nodes/lib/python3.10/site-packages/torch/nn/modules/module.py", line 2270 in state_dict
[04:06] [ComfyUI] File "/Users/runner/.ce/.pixi/envs/sam3-nodes/lib/python3.10/site-packages/torch/nn/modules/module.py", line 2270 in state_dict
[04:06] [ComfyUI] File "/Users/runner/.ce/.pixi/envs/sam3-nodes/lib/python3.10/site-packages/torch/nn/modules/module.py", line 2270 in state_dict
[04:06] [ComfyUI] File "/Users/runner/.ce/.pixi/envs/sam3-nodes/lib/python3.10/site-packages/torch/nn/modules/module.py", line 2270 in state_dict
[04:06] [ComfyUI] File "/Users/runner/.ce/.pixi/envs/sam3-nodes/lib/python3.10/site-packages/torch/nn/modules/module.py", line 2270 in state_dict
[04:06] [ComfyUI] File "/Users/runner/.ce/.pixi/envs/sam3-nodes/lib/python3.10/site-packages/torch/nn/modules/module.py", line 2270 in state_dict
[04:06] [ComfyUI] File "/Users/runner/.ce/.pixi/envs/sam3-nodes/lib/python3.10/site-packages/torch/nn/modules/module.py", line 2270 in state_dict
[04:06] [ComfyUI] File "/Users/runner/work/comfy-gpu-ci/comfy-gpu-ci/test_workspaces/SAM3-1010/ComfyUI/comfy/model_management.py", line 500 in module_size
[04:06] [ComfyUI] File "/Users/runner/work/comfy-gpu-ci/comfy-gpu-ci/test_workspaces/SAM3-1010/ComfyUI/custom_nodes/ComfyUI-SAM3/nodes/sam3_model_patcher.py", line 110 in model_size
[04:06] [ComfyUI] File "/Users/runner/work/comfy-gpu-ci/comfy-gpu-ci/test_workspaces/SAM3-1010/ComfyUI/comfy/model_management.py", line 554 in model_memory
[04:06] [ComfyUI] File "/Users/runner/work/comfy-gpu-ci/comfy-gpu-ci/test_workspaces/SAM3-1010/ComfyUI/comfy/model_management.py", line 569 in model_memory_required
[04:06] [ComfyUI] File "/Users/runner/work/comfy-gpu-ci/comfy-gpu-ci/test_workspaces/SAM3-1010/ComfyUI/comfy/model_management.py", line 771 in load_models_gpu
[04:06] [ComfyUI] File "/var/folders/tb/y368xp_x10s3ty1b_mtl5mxr0000gn/T/comfyui_pvenv_qg3md4xk/persistent_worker.py", line 1539 in _shimmed_load_models_gpu
[04:06] [ComfyUI] File "/Users/runner/work/comfy-gpu-ci/comfy-gpu-ci/test_workspaces/SAM3-1010/ComfyUI/custom_nodes/ComfyUI-SAM3/nodes/segmentation.py", line 87 in execute
[04:06] [ComfyUI] File "/Users/runner/work/comfy-gpu-ci/comfy-gpu-ci/test_workspaces/SAM3-1010/ComfyUI/comfy_api/latest/_io.py", line 1833 in EXECUTE_NORMALIZED
[04:06] [ComfyUI] File "/var/folders/tb/y368xp_x10s3ty1b_mtl5mxr0000gn/T/comfyui_pvenv_qg3md4xk/persistent_worker.py", line 1762 in main
[04:06] [ComfyUI] File "/var/folders/tb/y368xp_x10s3ty1b_mtl5mxr0000gn/T/comfyui_pvenv_qg3md4xk/persistent_worker.py", line 1807 in <module>
[04:06] [ComfyUI]
[04:06] [ComfyUI] [worker:ComfyUI-SAM3] === END ===
[04:06] [ComfyUI]
[04:06] Frame 2 saved (frame_001.jpg, t=2.3s)
[04:06] [capture-periodic] freeze=3ms shot=933ms unfreeze=4ms saved=True
[04:11] Frame 3 saved (frame_002.jpg, t=5.3s)
[04:11] [capture-periodic] freeze=9ms shot=2158ms unfreeze=48ms saved=True
[04:13] [capture-loop] iter=50 t=9.6s state={'complete': False, 'error': None, 'executedCount': 0, 'wsState': 1} eval_ms=45 ram=3.0/7.0GB (82%) swap=0.0/0.0GB (0%) cpu=68% browser_rss=0.46GB
[04:18] Frame 4 saved (frame_003.jpg, t=13.9s)
[04:18] [capture-periodic] freeze=5ms shot=1371ms unfreeze=22ms saved=True
[04:31] Frame 5 saved (frame_004.jpg, t=17.5s)
[04:31] [capture-periodic] freeze=222ms shot=9760ms unfreeze=56ms saved=True
[04:35] [capture-loop] iter=100 t=31.8s state={'complete': False, 'error': None, 'executedCount': 0, 'wsState': 1} eval_ms=28 ram=2.6/7.0GB (91%) swap=1.8/3.0GB (60%) cpu=76% browser_rss=0.26GB
[04:45] [capture-loop] iter=150 t=42.1s state={'complete': False, 'error': None, 'executedCount': 0, 'wsState': 1} eval_ms=17 ram=1.8/7.0GB (80%) swap=3.5/4.0GB (86%) cpu=62% browser_rss=0.25GB
[04:51] [capture-loop] iter=200 t=48.2s state={'complete': False, 'error': None, 'executedCount': 0, 'wsState': 1} eval_ms=4 ram=2.7/7.0GB (58%) swap=3.6/4.0GB (90%) cpu=65% browser_rss=0.26GB
[05:08] [ComfyUI] [worker:ComfyUI-SAM3]
[05:08] [ComfyUI] === WATCHDOG TICK 3 ===
[05:08] [ComfyUI] [worker:ComfyUI-SAM3] Current thread 0x000000016ca8b000 (most recent call first):
[05:08] [ComfyUI] File "/var/folders/tb/y368xp_x10s3ty1b_mtl5mxr0000gn/T/comfyui_pvenv_qg3md4xk/persistent_worker.py", line 52 in _watchdog
[05:08] [ComfyUI] File "/Users/runner/.ce/.pixi/envs/sam3-nodes/lib/python3.10/threading.py", line 953 in run
[05:08] [ComfyUI] File "/Users/runner/.ce/.pixi/envs/sam3-nodes/lib/python3.10/threading.py", line 1016 in _bootstrap_inner
[05:08] [ComfyUI] File "/Users/runner/.ce/.pixi/envs/sam3-nodes/lib/python3.10/threading.py", line 973 in _bootstrap
[05:08] [ComfyUI]
[05:08] [ComfyUI] Thread 0x00000001feaca240 (most recent call first):
[05:08] [ComfyUI] File "/Users/runner/work/comfy-gpu-ci/comfy-gpu-ci/test_workspaces/SAM3-1010/ComfyUI/comfy/ldm/modules/sub_quadratic_attention.py", line 181 in _get_attention_scores_no_kv_chunking
[05:08] [ComfyUI] File "/Users/runner/work/comfy-gpu-ci/comfy-gpu-ci/test_workspaces/SAM3-1010/ComfyUI/comfy/ldm/modules/sub_quadratic_attention.py", line 269 in <listcomp>
[05:08] [ComfyUI] File "/Users/runner/work/comfy-gpu-ci/comfy-gpu-ci/test_workspaces/SAM3-1010/ComfyUI/comfy/ldm/modules/sub_quadratic_attention.py", line 268 in efficient_dot_product_attention
[05:08] [ComfyUI] File "/Users/runner/work/comfy-gpu-ci/comfy-gpu-ci/test_workspaces/SAM3-1010/ComfyUI/comfy/ldm/modules/attention.py", line 275 in attention_sub_quad
[05:08] [ComfyUI] File "/Users/runner/work/comfy-gpu-ci/comfy-gpu-ci/test_workspaces/SAM3-1010/ComfyUI/comfy/ldm/modules/attention.py", line 139 in wrapper
[05:08] [ComfyUI] File "/Users/runner/work/comfy-gpu-ci/comfy-gpu-ci/test_workspaces/SAM3-1010/ComfyUI/custom_nodes/ComfyUI-SAM3/nodes/sam3/attention.py", line 120 in sam3_attention
[05:08] [ComfyUI] File "/Users/runner/work/comfy-gpu-ci/comfy-gpu-ci/test_workspaces/SAM3-1010/ComfyUI/custom_nodes/ComfyUI-SAM3/nodes/sam3/model.py", line 729 in forward
[05:08] [ComfyUI] File "/Users/runner/.ce/.pixi/envs/sam3-nodes/lib/python3.10/site-packages/torch/nn/modules/module.py", line 1790 in _call_impl
[05:08] [ComfyUI] File "/Users/runner/.ce/.pixi/envs/sam3-nodes/lib/python3.10/site-packages/torch/nn/modules/module.py", line 1779 in _wrapped_call_impl
[05:08] [ComfyUI] File "/Users/runner/work/comfy-gpu-ci/comfy-gpu-ci/test_workspaces/SAM3-1010/ComfyUI/custom_nodes/ComfyUI-SAM3/nodes/sam3/model.py", line 819 in forward
[05:08] [ComfyUI] File "/Users/runner/.ce/.pixi/envs/sam3-nodes/lib/python3.10/site-packages/torch/nn/modules/module.py", line 1790 in _call_impl
[05:08] [ComfyUI] File "/Users/runner/.ce/.pixi/envs/sam3-nodes/lib/python3.10/site-packages/torch/nn/modules/module.py", line 1779 in _wrapped_call_impl
[05:08] [ComfyUI] File "/Users/runner/work/comfy-gpu-ci/comfy-gpu-ci/test_workspaces/SAM3-1010/ComfyUI/custom_nodes/ComfyUI-SAM3/nodes/sam3/model.py", line 983 in forward
[05:08] [ComfyUI] File "/Users/runner/.ce/.pixi/envs/sam3-nodes/lib/python3.10/site-packages/torch/nn/modules/module.py", line 1790 in _call_impl
[05:08] [ComfyUI] File "/Users/runner/.ce/.pixi/envs/sam3-nodes/lib/python3.10/site-packages/torch/nn/modules/module.py", line 1779 in _wrapped_call_impl
[05:08] [ComfyUI] File "/Users/runner/work/comfy-gpu-ci/comfy-gpu-ci/test_workspaces/SAM3-1010/ComfyUI/custom_nodes/ComfyUI-SAM3/nodes/sam3/model.py", line 2041 in forward
[05:08] [ComfyUI] File "/Users/runner/work/comfy-gpu-ci/comfy-gpu-ci/test_workspaces/SAM3-1010/ComfyUI/custom_nodes/ComfyUI-SAM3/nodes/sam3/model.py", line 3321 in _forward_image_no_act_ckpt
[05:08] [ComfyUI] File "/Users/runner/work/comfy-gpu-ci/comfy-gpu-ci/test_workspaces/SAM3-1010/ComfyUI/custom_nodes/ComfyUI-SAM3/nodes/sam3/model.py", line 3314 in forward_image
[05:08] [ComfyUI] File "/Users/runner/work/comfy-gpu-ci/comfy-gpu-ci/test_workspaces/SAM3-1010/ComfyUI/custom_nodes/ComfyUI-SAM3/nodes/sam3/utils.py", line 1324 in set_image
[05:08] [ComfyUI] File "/Users/runner/.ce/.pixi/envs/sam3-nodes/lib/python3.10/site-packages/torch/utils/_contextlib.py", line 124 in decorate_context
[05:08] [ComfyUI] File "/Users/runner/work/comfy-gpu-ci/comfy-gpu-ci/test_workspaces/SAM3-1010/ComfyUI/custom_nodes/ComfyUI-SAM3/nodes/segmentation.py", line 133 in _segment_grounding
[05:08] [ComfyUI] File "/Users/runner/work/comfy-gpu-ci/comfy-gpu-ci/test_workspaces/SAM3-1010/ComfyUI/custom_nodes/ComfyUI-SAM3/nodes/segmentation.py", line 111 in execute
[05:08] [ComfyUI] File "/Users/runner/work/comfy-gpu-ci/comfy-gpu-ci/test_workspaces/SAM3-1010/ComfyUI/comfy_api/latest/_io.py", line 1833 in EXECUTE_NORMALIZED
[05:08] [ComfyUI] File "/var/folders/tb/y368xp_x10s3ty1b_mtl5mxr0000gn/T/comfyui_pvenv_qg3md4xk/persistent_worker.py", line 1762 in main
[05:08] [ComfyUI] File "/var/folders/tb/y368xp_x10s3ty1b_mtl5mxr0000gn/T/comfyui_pvenv_qg3md4xk/persistent_worker.py", line 1807 in <module>
[05:08] [ComfyUI]
[05:08] [ComfyUI] [worker:ComfyUI-SAM3] === END ===
[05:08] [ComfyUI]
[05:09] Frame 6 saved (frame_005.jpg, t=52.5s)
[05:09] [capture-periodic] freeze=3ms shot=13785ms unfreeze=65ms saved=True
[05:15] Frame 7 saved (frame_006.jpg, t=68.6s)
[05:15] [capture-periodic] freeze=257ms shot=3318ms unfreeze=126ms saved=True
[05:15] [capture-loop] iter=250 t=72.5s state={'complete': False, 'error': None, 'executedCount': 0, 'wsState': 1} eval_ms=10 ram=5.6/7.0GB (92%) swap=1.2/2.0GB (62%) cpu=58% browser_rss=0.18GB
[05:29] Frame 8 saved (frame_007.jpg, t=81.8s)
[05:29] [capture-periodic] freeze=3ms shot=4290ms unfreeze=7ms saved=True
[05:30] [capture-loop] iter=300 t=87.2s state={'complete': False, 'error': None, 'executedCount': 0, 'wsState': 1} eval_ms=3 ram=3.9/7.0GB (87%) swap=1.3/2.0GB (65%) cpu=63% browser_rss=0.16GB
[05:33] Frame 9 saved (frame_008.jpg, t=88.2s)
[05:33] [capture-periodic] freeze=5ms shot=1644ms unfreeze=8ms saved=True
[05:35] [ComfyUI] /Users/runner/work/comfy-gpu-ci/comfy-gpu-ci/test_workspaces/SAM3-1010/ComfyUI/custom_nodes/ComfyUI-SAM3/nodes/sam3/utils.py:1824: UserWarning: The operator 'aten::_assert_async' is not currently supported on the MPS backend and will fall back to run on the CPU. This may have performance implications. (Triggered internally at /Users/runner/work/pytorch/pytorch/pytorch/aten/src/ATen/mps/MPSFallback.mm:34.)
[05:35] [ComfyUI] torch._assert_async(is_right_padded(mask1))
[05:45] [capture-loop] iter=350 t=101.7s state={'complete': False, 'error': None, 'executedCount': 0, 'wsState': 1} eval_ms=8 ram=1.7/7.0GB (88%) swap=1.4/2.0GB (69%) cpu=63% browser_rss=0.18GB
[06:00] [capture-loop] iter=400 t=116.7s state={'complete': False, 'error': None, 'executedCount': 0, 'wsState': 1} eval_ms=3 ram=3.8/7.0GB (87%) swap=2.0/3.0GB (68%) cpu=72% browser_rss=0.17GB
[06:05] [capture-loop] iter=450 t=122.6s state={'complete': False, 'error': None, 'executedCount': 0, 'wsState': 1} eval_ms=4 ram=3.9/7.0GB (88%) swap=2.0/3.0GB (66%) cpu=50% browser_rss=0.18GB
[06:08] [ComfyUI] [worker:ComfyUI-SAM3]
[06:08] [ComfyUI] === WATCHDOG TICK 4 ===
[06:08] [ComfyUI] [worker:ComfyUI-SAM3] Current thread 0x000000016ca8b000 (most recent call first):
[06:08] [ComfyUI] File "/var/folders/tb/y368xp_x10s3ty1b_mtl5mxr0000gn/T/comfyui_pvenv_qg3md4xk/persistent_worker.py", line 52 in _watchdog
[06:08] [ComfyUI] File "/Users/runner/.ce/.pixi/envs/sam3-nodes/lib/python3.10/threading.py", line 953 in run
[06:08] [ComfyUI] File "/Users/runner/.ce/.pixi/envs/sam3-nodes/lib/python3.10/threading.py", line 1016 in _bootstrap_inner
[06:08] [ComfyUI] File "/Users/runner/.ce/.pixi/envs/sam3-nodes/lib/python3.10/threading.py", line 973 in _bootstrap
[06:08] [ComfyUI]
[06:08] [ComfyUI] Thread 0x00000001feaca240 (most recent call first):
[06:08] [ComfyUI] File "/Users/runner/work/comfy-gpu-ci/comfy-gpu-ci/test_workspaces/SAM3-1010/ComfyUI/custom_nodes/ComfyUI-SAM3/nodes/sam3/model.py", line 44 in _dtype_debug
[06:08] [ComfyUI] File "/Users/runner/work/comfy-gpu-ci/comfy-gpu-ci/test_workspaces/SAM3-1010/ComfyUI/custom_nodes/ComfyUI-SAM3/nodes/sam3/model.py", line 3848 in forward_grounding
[06:08] [ComfyUI] File "/Users/runner/work/comfy-gpu-ci/comfy-gpu-ci/test_workspaces/SAM3-1010/ComfyUI/custom_nodes/ComfyUI-SAM3/nodes/sam3/utils.py", line 1477 in _forward_grounding
[06:08] [ComfyUI] File "/Users/runner/.ce/.pixi/envs/sam3-nodes/lib/python3.10/site-packages/torch/utils/_contextlib.py", line 124 in decorate_context
[06:08] [ComfyUI] File "/Users/runner/work/comfy-gpu-ci/comfy-gpu-ci/test_workspaces/SAM3-1010/ComfyUI/custom_nodes/ComfyUI-SAM3/nodes/sam3/utils.py", line 1393 in set_text_prompt
[06:08] [ComfyUI] File "/Users/runner/.ce/.pixi/envs/sam3-nodes/lib/python3.10/site-packages/torch/utils/_contextlib.py", line 124 in decorate_context
[06:08] [ComfyUI] File "/Users/runner/work/comfy-gpu-ci/comfy-gpu-ci/test_workspaces/SAM3-1010/ComfyUI/custom_nodes/ComfyUI-SAM3/nodes/segmentation.py", line 138 in _segment_grounding
[06:08] [ComfyUI] File "/Users/runner/work/comfy-gpu-ci/comfy-gpu-ci/test_workspaces/SAM3-1010/ComfyUI/custom_nodes/ComfyUI-SAM3/nodes/segmentation.py", line 111 in execute
[06:08] [ComfyUI] File "/Users/runner/work/comfy-gpu-ci/comfy-gpu-ci/test_workspaces/SAM3-1010/ComfyUI/comfy_api/latest/_io.py", line 1833 in EXECUTE_NORMALIZED
[06:08] [ComfyUI] File "/var/folders/tb/y368xp_x10s3ty1b_mtl5mxr0000gn/T/comfyui_pvenv_qg3md4xk/persistent_worker.py", line 1762 in main
[06:08] [ComfyUI] File "/var/folders/tb/y368xp_x10s3ty1b_mtl5mxr0000gn/T/comfyui_pvenv_qg3md4xk/persistent_worker.py", line 1807 in <module>
[06:08] [ComfyUI]
[06:08] [ComfyUI] [worker:ComfyUI-SAM3] === END ===
[06:08] [ComfyUI]
[06:11] [capture-loop] iter=500 t=128.5s state={'complete': False, 'error': None, 'executedCount': 0, 'wsState': 1} eval_ms=3 ram=3.8/7.0GB (88%) swap=2.0/3.0GB (66%) cpu=60% browser_rss=0.18GB
[06:18] [capture-loop] iter=550 t=135.4s state={'complete': False, 'error': None, 'executedCount': 0, 'wsState': 1} eval_ms=3 ram=3.8/7.0GB (88%) swap=2.1/3.0GB (70%) cpu=79% browser_rss=0.18GB
[06:24] [capture-loop] iter=600 t=141.5s state={'complete': False, 'error': None, 'executedCount': 0, 'wsState': 1} eval_ms=4 ram=2.8/7.0GB (74%) swap=2.0/3.0GB (68%) cpu=60% browser_rss=0.19GB
[06:26] [ComfyUI] [SubprocessWorker] got response: ok
[06:26] [ComfyUI] [comfy-env] SAM3Grounding done (142.43s): result: NodeOutput
[06:26] [ComfyUI] Prompt executed in 143.12 seconds
[06:26] Node executed (1 total), capturing...
[06:27] Frame 10 saved (frame_009.jpg, t=143.5s)
[06:27] [capture-node] freeze=2ms shot=98ms unfreeze=3ms saved=True
[06:27] Node executed (2 total), capturing...
[06:27] Frame 11 saved (frame_010.jpg, t=143.9s)
[06:27] [capture-node] freeze=5ms shot=95ms unfreeze=0ms saved=True
[06:27] Execution complete (t=144.0s)
[06:27] Captured 11 unique frames over 144.08s
[06:27] [debug] iframes: 0
[06:27] [timing] trigger_3d_previews: 0.0s
[06:29] Saved high-quality screenshot: image_seg_text_executed.png
[06:29] [timing] final_screenshot: 0.2s
[06:29] Capturing execution frames: scene_seg.json
[06:36] Frame 1 saved (frame_000.jpg, t=0.0s)
[06:36] Validating workflow...
[06:36] [ComfyUI] === /validate endpoint called ===
[06:36] [ComfyUI] Received JSON with keys: ['prompt']
[06:36] [ComfyUI] Prompt has 10 nodes
[06:36] [ComfyUI] Node 1: LoadImage
[06:36] [ComfyUI] Inputs: {"image": "image.png"}
[06:36] [ComfyUI] Node 3: PreviewImage
[06:36] [ComfyUI] Inputs: {"images": ["27", 1]}
[06:36] [ComfyUI] Node 4: MaskPreview
[06:36] [ComfyUI] Inputs: {"mask": ["27", 0]}
[06:36] [ComfyUI] Node 12: LoadSAM3Model
[06:36] [ComfyUI] Inputs: {"precision": "fp32", "compile": false}
[06:36] [ComfyUI] Node 20: SAM3MultiRegionCollector
[06:36] [ComfyUI] Inputs: {"multi_prompts_store": "[{\"positive_points\":[{\"x\":5052.74953932266,\"y\":2847.0600693869637},{\"x\":4932.510591392486,\"y\":2953.9413227753366},{\"x\":4718.752461738845,\"y\":2967.301479448883},{
[06:36] [ComfyUI] Node 22: MultibandFromBatch
[06:36] [ComfyUI] Inputs: {"images": ["1", 0], "masks": ["27", 0]}
[06:36] [ComfyUI] Node 23: MultibandSave
[06:36] [ComfyUI] Inputs: {"file_path": "output/multiband", "format": "npz", "multiband": ["26", 0]}
[06:36] [ComfyUI] Node 24: MultibandPreview
[06:36] [ComfyUI] Inputs: {"channel_index": 0, "multiband": ["26", 0]}
[06:36] [ComfyUI] Node 26: MultibandResize
[06:36] [ComfyUI] Inputs: {"upscale_method": "nearest-exact", "width": 900, "height": 600, "crop": "center", "multiband": ["22", 0]}
[06:36] Queuing workflow for execution...
[06:36] [ComfyUI] Node 27: SAM3MultipromptSegmentation
[06:36] [ComfyUI] Inputs: {"refinement_iterations": 0, "use_multimask": false, "sam3_model_config": ["12", 0], "image": ["1", 0], "multi_prompts": ["20", 0]}
[06:36] [ComfyUI] Generated prompt_id: fb164e12-e6b4-43cd-8947-0ffae5fc8639
[06:36] [ComfyUI] Calling execution.validate_prompt()...
[06:36] [ComfyUI] Validation result: valid=True
[06:36] [ComfyUI] === Validation PASSED ===
[06:36] [ComfyUI] got prompt
[06:40] Frame 2 saved (frame_001.jpg, t=2.3s)
[06:40] [capture-periodic] freeze=30ms shot=928ms unfreeze=3ms saved=True
[06:42] [ComfyUI] [comfy-env] Running SAM3MultiRegionCollector: multi_prompts_store: '[{"positive_points":[{"x":5052.74953932266,"y":2847.0600..., image: torch.float32 [1,4480,6720,3] cpu
[06:42] [ComfyUI] [SubprocessWorker] call_method: nodes.sam3_interactive.SAM3MultiRegionCollector.EXECUTE_NORMALIZED
[06:42] [ComfyUI] [SubprocessWorker] acquired lock, ensuring started...
[06:42] [ComfyUI] [ComfyUI-SAM3] Health check: ping (timeout=5.0s)...
[06:42] [ComfyUI] [ComfyUI-SAM3] Health check: ok
[06:42] [ComfyUI] [SubprocessWorker] worker started/confirmed
[06:42] [ComfyUI] [comfy-env] PRE-SERIALIZE 'image' shape: torch.Size([1, 4480, 6720, 3])
[06:42] [ComfyUI] [SubprocessWorker] serializing kwargs to shm...
[06:42] Frame 3 saved (frame_002.jpg, t=5.4s)
[06:42] [capture-periodic] freeze=5ms shot=237ms unfreeze=69ms saved=True
[06:42] [ComfyUI] [SubprocessWorker] created 0 shm blocks
[06:42] [ComfyUI] [SubprocessWorker] sending request via socket...
[06:42] [ComfyUI] [SubprocessWorker] call_id=6 sending call_method
[06:42] [ComfyUI] [worker:ComfyUI-SAM3] [comfy-env] _from_shm got dict with keys: ['__type__', 'strategy', 'manager_path', 'storage_key', 'storage_size']
[06:42] [ComfyUI] [worker:ComfyUI-SAM3] [comfy-env] DESERIALIZE TensorRef: tensor_size=[1, 4480, 6720, 3]
[06:42] [ComfyUI] [worker:ComfyUI-SAM3] [comfy-env] DESERIALIZED tensor shape: torch.Size([1, 4480, 6720, 3])
[06:43] [ComfyUI] [SubprocessWorker] got response: ok
[06:43] [ComfyUI] [comfy-env] SAM3MultiRegionCollector done (0.85s): result: NodeOutput
[06:43] [ComfyUI] [comfy-env] Running LoadSAM3Model: precision: 'fp32', compile: False
[06:43] [ComfyUI] [SubprocessWorker] call_method: nodes.load_model.LoadSAM3Model.EXECUTE_NORMALIZED
[06:43] [ComfyUI] [SubprocessWorker] acquired lock, ensuring started...
[06:43] [ComfyUI] [ComfyUI-SAM3] Health check: ping (timeout=5.0s)...
[06:43] [ComfyUI] [ComfyUI-SAM3] Health check: ok
[06:43] [ComfyUI] [SubprocessWorker] worker started/confirmed
[06:43] [ComfyUI] [SubprocessWorker] serializing kwargs to shm...
[06:43] [ComfyUI] [SubprocessWorker] created 0 shm blocks
[06:43] [ComfyUI] [SubprocessWorker] sending request via socket...
[06:43] [ComfyUI] [SubprocessWorker] call_id=7 sending call_method
[06:43] [ComfyUI] [SubprocessWorker] got response: ok
[06:43] [ComfyUI] [comfy-env] LoadSAM3Model done (0.03s): result: NodeOutput
[06:43] [ComfyUI] [comfy-env] Running SAM3MultipromptSegmentation: refinement_iterations: 0, use_multimask: False, sam3_model_config: dict, image: torch.float32 [1,4480,6720,3] cpu, multi_prompts: list[7]
[06:43] [ComfyUI] [SubprocessWorker] call_method: nodes.segmentation.SAM3MultipromptSegmentation.EXECUTE_NORMALIZED
[06:43] [ComfyUI] [SubprocessWorker] acquired lock, ensuring started...
[06:43] [ComfyUI] [ComfyUI-SAM3] Health check: ping (timeout=5.0s)...
[06:43] [ComfyUI] [ComfyUI-SAM3] Health check: ok
[06:43] [ComfyUI] [SubprocessWorker] worker started/confirmed
[06:43] [ComfyUI] [comfy-env] PRE-SERIALIZE 'image' shape: torch.Size([1, 4480, 6720, 3])
[06:43] [ComfyUI] [SubprocessWorker] serializing kwargs to shm...
[06:43] [ComfyUI] [SubprocessWorker] created 0 shm blocks
[06:43] [ComfyUI] [SubprocessWorker] sending request via socket...
[06:43] [ComfyUI] [SubprocessWorker] call_id=8 sending call_method
[06:43] [ComfyUI] [worker:ComfyUI-SAM3] [comfy-env] _from_shm got dict with keys: ['__type__', 'strategy', 'manager_path', 'storage_key', 'storage_size']
[06:43] [ComfyUI] [worker:ComfyUI-SAM3] [comfy-env] DESERIALIZE TensorRef: tensor_size=[1, 4480, 6720, 3]
[06:43] [ComfyUI] [worker:ComfyUI-SAM3] [comfy-env] DESERIALIZED tensor shape: torch.Size([1, 4480, 6720, 3])
[06:43] [ComfyUI] [SubprocessWorker] callback 'request_vram_budget' from call_id=8
[06:43] [ComfyUI] [comfy-env] VRAM request: 3.50GB, free before eviction: 1.39GB
[06:43] [ComfyUI] [comfy-env] VRAM after eviction: 1.39GB
[06:45] Node executed (1 total), capturing...
[06:46] Frame 4 saved (frame_003.jpg, t=8.6s)
[06:46] [capture-node] freeze=575ms shot=212ms unfreeze=3ms saved=True
[06:47] [capture-loop] iter=50 t=10.3s state={'complete': False, 'error': None, 'executedCount': 1, 'wsState': 1} eval_ms=53 ram=2.4/7.0GB (82%) swap=2.1/3.0GB (70%) cpu=71% browser_rss=0.54GB
[07:08] [ComfyUI] [worker:ComfyUI-SAM3]
[07:08] [ComfyUI] === WATCHDOG TICK 5 ===
[07:08] [ComfyUI] [worker:ComfyUI-SAM3] Current thread 0x000000016ca8b000 (most recent call first):
[07:08] [ComfyUI] File "/var/folders/tb/y368xp_x10s3ty1b_mtl5mxr0000gn/T/comfyui_pvenv_qg3md4xk/persistent_worker.py", line 52 in _watchdog
[07:08] [ComfyUI] File "/Users/runner/.ce/.pixi/envs/sam3-nodes/lib/python3.10/threading.py", line 953 in run
[07:08] [ComfyUI] File "/Users/runner/.ce/.pixi/envs/sam3-nodes/lib/python3.10/threading.py", line 1016 in _bootstrap_inner
[07:08] [ComfyUI] File "/Users/runner/.ce/.pixi/envs/sam3-nodes/lib/python3.10/threading.py", line 973 in _bootstrap
[07:08] [ComfyUI]
[07:08] [ComfyUI] Thread 0x00000001feaca240 (most recent call first):
[07:08] [ComfyUI] File "/Users/runner/work/comfy-gpu-ci/comfy-gpu-ci/test_workspaces/SAM3-1010/ComfyUI/comfy/ops.py", line 475 in forward_comfy_cast_weights
[07:08] [ComfyUI] File "/Users/runner/work/comfy-gpu-ci/comfy-gpu-ci/test_workspaces/SAM3-1010/ComfyUI/comfy/ops.py", line 482 in forward
[07:08] [ComfyUI] File "/Users/runner/.ce/.pixi/envs/sam3-nodes/lib/python3.10/site-packages/torch/nn/modules/module.py", line 1790 in _call_impl
[07:08] [ComfyUI] File "/Users/runner/.ce/.pixi/envs/sam3-nodes/lib/python3.10/site-packages/torch/nn/modules/module.py", line 1779 in _wrapped_call_impl
[07:08] [ComfyUI] File "/Users/runner/work/comfy-gpu-ci/comfy-gpu-ci/test_workspaces/SAM3-1010/ComfyUI/custom_nodes/ComfyUI-SAM3/nodes/sam3/model.py", line 144 in forward
[07:08] [ComfyUI] File "/Users/runner/.ce/.pixi/envs/sam3-nodes/lib/python3.10/site-packages/torch/nn/modules/module.py", line 1790 in _call_impl
[07:08] [ComfyUI] File "/Users/runner/.ce/.pixi/envs/sam3-nodes/lib/python3.10/site-packages/torch/nn/modules/module.py", line 1779 in _wrapped_call_impl
[07:08] [ComfyUI] File "/Users/runner/work/comfy-gpu-ci/comfy-gpu-ci/test_workspaces/SAM3-1010/ComfyUI/custom_nodes/ComfyUI-SAM3/nodes/sam3/model.py", line 823 in forward
[07:08] [ComfyUI] File "/Users/runner/.ce/.pixi/envs/sam3-nodes/lib/python3.10/site-packages/torch/nn/modules/module.py", line 1790 in _call_impl
[07:08] [ComfyUI] File "/Users/runner/.ce/.pixi/envs/sam3-nodes/lib/python3.10/site-packages/torch/nn/modules/module.py", line 1779 in _wrapped_call_impl
[07:08] [ComfyUI] File "/Users/runner/work/comfy-gpu-ci/comfy-gpu-ci/test_workspaces/SAM3-1010/ComfyUI/custom_nodes/ComfyUI-SAM3/nodes/sam3/model.py", line 983 in forward
[07:08] [ComfyUI] File "/Users/runner/.ce/.pixi/envs/sam3-nodes/lib/python3.10/site-packages/torch/nn/modules/module.py", line 1790 in _call_impl
[07:08] [ComfyUI] File "/Users/runner/.ce/.pixi/envs/sam3-nodes/lib/python3.10/site-packages/torch/nn/modules/module.py", line 1779 in _wrapped_call_impl
[07:08] [ComfyUI] File "/Users/runner/work/comfy-gpu-ci/comfy-gpu-ci/test_workspaces/SAM3-1010/ComfyUI/custom_nodes/ComfyUI-SAM3/nodes/sam3/model.py", line 2041 in forward
[07:08] [ComfyUI] File "/Users/runner/work/comfy-gpu-ci/comfy-gpu-ci/test_workspaces/SAM3-1010/ComfyUI/custom_nodes/ComfyUI-SAM3/nodes/sam3/model.py", line 3321 in _forward_image_no_act_ckpt
[07:08] [ComfyUI] File "/Users/runner/work/comfy-gpu-ci/comfy-gpu-ci/test_workspaces/SAM3-1010/ComfyUI/custom_nodes/ComfyUI-SAM3/nodes/sam3/model.py", line 3314 in forward_image
[07:08] [ComfyUI] File "/Users/runner/work/comfy-gpu-ci/comfy-gpu-ci/test_workspaces/SAM3-1010/ComfyUI/custom_nodes/ComfyUI-SAM3/nodes/sam3/utils.py", line 1324 in set_image
[07:08] [ComfyUI] File "/Users/runner/.ce/.pixi/envs/sam3-nodes/lib/python3.10/site-packages/torch/utils/_contextlib.py", line 124 in decorate_context
[07:08] [ComfyUI] File "/Users/runner/work/comfy-gpu-ci/comfy-gpu-ci/test_workspaces/SAM3-1010/ComfyUI/custom_nodes/ComfyUI-SAM3/nodes/segmentation.py", line 733 in execute
[07:08] [ComfyUI] File "/Users/runner/work/comfy-gpu-ci/comfy-gpu-ci/test_workspaces/SAM3-1010/ComfyUI/comfy_api/latest/_io.py", line 1833 in EXECUTE_NORMALIZED
[07:08] [ComfyUI] File "/var/folders/tb/y368xp_x10s3ty1b_mtl5mxr0000gn/T/comfyui_pvenv_qg3md4xk/persistent_worker.py", line 1762 in main
[07:08] [ComfyUI] File "/var/folders/tb/y368xp_x10s3ty1b_mtl5mxr0000gn/T/comfyui_pvenv_qg3md4xk/persistent_worker.py", line 1807 in <module>
[07:08] [ComfyUI]
[07:08] [ComfyUI] [worker:ComfyUI-SAM3] === END ===
[07:08] [ComfyUI]
[07:13] [capture-loop] iter=100 t=37.2s state={'complete': False, 'error': None, 'executedCount': 1, 'wsState': 1} eval_ms=3 ram=5.8/7.0GB (90%) swap=1.4/2.0GB (69%) cpu=57% browser_rss=0.31GB
[07:24] [capture-loop] iter=150 t=47.6s state={'complete': False, 'error': None, 'executedCount': 1, 'wsState': 1} eval_ms=2 ram=2.6/7.0GB (79%) swap=1.2/2.0GB (58%) cpu=54% browser_rss=0.28GB
[07:27] [ComfyUI] [SubprocessWorker] callback 'report_progress' from call_id=8
[07:32] Frame 5 saved (frame_004.jpg, t=54.1s)
[07:32] [capture-periodic] freeze=10ms shot=493ms unfreeze=4ms saved=True
[07:32] [ComfyUI] [SubprocessWorker] callback 'report_progress' from call_id=8
[07:33] [ComfyUI] [SubprocessWorker] callback 'report_progress' from call_id=8
[07:34] Frame 6 saved (frame_005.jpg, t=57.4s)
[07:34] [capture-periodic] freeze=4ms shot=220ms unfreeze=7ms saved=True
[07:34] [capture-loop] iter=200 t=57.8s state={'complete': False, 'error': None, 'executedCount': 1, 'wsState': 1} eval_ms=4 ram=3.2/7.0GB (86%) swap=1.9/3.0GB (63%) cpu=60% browser_rss=0.30GB
[07:34] [ComfyUI] [SubprocessWorker] callback 'report_progress' from call_id=8
[07:35] [ComfyUI] [SubprocessWorker] callback 'report_progress' from call_id=8
[07:35] [ComfyUI] [SubprocessWorker] callback 'report_progress' from call_id=8
[07:36] Frame 7 saved (frame_006.jpg, t=59.7s)
[07:36] [capture-periodic] freeze=2ms shot=206ms unfreeze=2ms saved=True
[07:37] [ComfyUI] [SubprocessWorker] callback 'report_progress' from call_id=8
[07:40] Frame 8 saved (frame_007.jpg, t=62.1s)
[07:40] [capture-periodic] freeze=124ms shot=1175ms unfreeze=4ms saved=True
[07:42] [capture-loop] iter=250 t=66.0s state={'complete': False, 'error': None, 'executedCount': 1, 'wsState': 1} eval_ms=3 ram=3.0/7.0GB (88%) swap=2.4/3.0GB (80%) cpu=85% browser_rss=0.19GB
[08:01] [capture-loop] iter=300 t=84.7s state={'complete': False, 'error': None, 'executedCount': 1, 'wsState': 1} eval_ms=7 ram=3.1/7.0GB (70%) swap=3.7/5.0GB (74%) cpu=66% browser_rss=0.15GB
[08:02] [ComfyUI] [SubprocessWorker] got response: ok
[08:02] [ComfyUI] [comfy-env] SAM3MultipromptSegmentation done (79.37s): result: NodeOutput
[08:03] Frame 9 saved (frame_008.jpg, t=86.5s)
[08:03] [capture-periodic] freeze=3ms shot=518ms unfreeze=6ms saved=True
[08:07] [capture-loop] iter=350 t=91.2s state={'complete': False, 'error': None, 'executedCount': 1, 'wsState': 1} eval_ms=2 ram=2.7/7.0GB (64%) swap=3.6/5.0GB (73%) cpu=75% browser_rss=0.27GB
[08:08] Node executed (2 total), capturing...
[08:09] Frame 10 saved (frame_009.jpg, t=91.9s)
[08:09] [capture-node] freeze=4ms shot=975ms unfreeze=3ms saved=True
[08:10] [ComfyUI] BatchToMultiband: Processed 1 images with 3 channels each -> 3 channels
[08:10] [ComfyUI] BatchToMultiband: Processed 7 masks -> 7 channels
[08:10] Node executed (3 total), capturing...
[08:11] Frame 11 saved (frame_010.jpg, t=93.6s)
[08:11] [capture-node] freeze=57ms shot=774ms unfreeze=4ms saved=True
[08:12] [ComfyUI] BatchToMultiband: Output shape torch.Size([1, 10, 4480, 6720]), channels: ['img_01_r', 'img_01_g', 'img_01_b', 'mask_01', 'mask_02', 'mask_03', 'mask_04', 'mask_05', 'mask_06', 'mask_07']
[08:12] [ComfyUI] ResizeMultiband: 4480x6720 -> 600x900
[08:13] [ComfyUI] SaveMultibandImage: Saved to output/multiband.npz
[08:13] [ComfyUI] Shape: (1, 10, 600, 900)
[08:13] [ComfyUI] Format: npz
[08:13] [ComfyUI] PreviewMultibandImage: Batch=1, Channels=10, Names=['img_01_r', 'img_01_g', 'img_01_b', 'mask_01', 'mask_02', 'mask_03', 'mask_04', 'mask_05', 'mask_06', 'mask_07']
[08:13] [ComfyUI] Prompt executed in 96.45 seconds
[08:13] Frame 12 saved (frame_011.jpg, t=96.6s)
[08:13] [capture-periodic] freeze=3ms shot=237ms unfreeze=3ms saved=True
[08:13] Node executed (4 total), capturing...
[08:14] Frame 13 saved (frame_012.jpg, t=97.1s)
[08:14] [capture-node] freeze=2ms shot=134ms unfreeze=0ms saved=True
[08:14] Execution complete (t=97.1s)
[08:14] Captured 13 unique frames over 97.3s
[08:14] [debug] iframes: 0
[08:14] [timing] trigger_3d_previews: 0.0s
[08:17] Saved high-quality screenshot: scene_seg_executed.png
[08:17] [timing] final_screenshot: 1.4s
[08:17] Capturing execution frames: scene_seg_interactive.json
[08:24] Frame 1 saved (frame_000.jpg, t=0.0s)
[08:24] Validating workflow...
[08:24] [ComfyUI] === /validate endpoint called ===
[08:24] [ComfyUI] Received JSON with keys: ['prompt']
[08:24] [ComfyUI] Prompt has 4 nodes
[08:24] [ComfyUI] Node 1: LoadImage
[08:24] [ComfyUI] Inputs: {"image": "image.png"}
[08:24] [ComfyUI] Node 4: MaskPreview
[08:24] [ComfyUI] Inputs: {"mask": ["26", 0]}
[08:24] [ComfyUI] Node 12: LoadSAM3Model
[08:24] Queuing workflow for execution...
[08:24] [ComfyUI] Inputs: {"precision": "auto", "compile": false}
[08:24] [ComfyUI] Node 26: SAM3InteractiveCollector
[08:24] [ComfyUI] Inputs: {"multi_prompts_store": "[{\"positive_points\":[{\"x\":3348.288109906738,\"y\":2452.2208696844737}],\"negative_points\":[],\"positive_boxes\":[],\"negative_boxes\":[],\"name\":\"Prompt 1\"},{\"positiv
[08:24] [ComfyUI] Generated prompt_id: f504d920-dcbb-484d-bfae-ce72dbaec7db
[08:24] [ComfyUI] Calling execution.validate_prompt()...
[08:24] [ComfyUI] Validation result: valid=True
[08:24] [ComfyUI] === Validation PASSED ===
[08:24] [ComfyUI] got prompt
[08:27] [ComfyUI] [comfy-env] Running LoadSAM3Model: precision: 'auto', compile: False
[08:27] [ComfyUI] [SubprocessWorker] call_method: nodes.load_model.LoadSAM3Model.EXECUTE_NORMALIZED
[08:27] [ComfyUI] [SubprocessWorker] acquired lock, ensuring started...
[08:27] Frame 2 saved (frame_001.jpg, t=2.2s)
[08:27] [capture-periodic] freeze=21ms shot=709ms unfreeze=15ms saved=True
[08:27] [ComfyUI] [ComfyUI-SAM3] Health check: ping (timeout=5.0s)...
[08:27] [ComfyUI] [ComfyUI-SAM3] Health check: failed
[08:27] [ComfyUI] [ComfyUI-SAM3] Socket unhealthy, restarting worker...
[08:27] [ComfyUI] [ComfyUI-SAM3] python: /Users/runner/.ce/.pixi/envs/sam3-nodes/bin/python
[08:27] [ComfyUI] [ComfyUI-SAM3] sys_path sent to worker: ['/Users/runner/work/comfy-gpu-ci/comfy-gpu-ci/test_workspaces/SAM3-1010/ComfyUI', '/Users/runner/work/comfy-gpu-ci/comfy-gpu-ci/test_workspaces/SAM3-1010/ComfyUI/custom_nodes/ComfyUI-SAM3', '/Users/runner/.ce/.pixi/envs/sam3-nodes/lib/python3.1/site-packages', '/Users/runner/work/comfy-gpu-ci/comfy-gpu-ci/test_workspaces/SAM3-1010/ComfyUI/custom_nodes/ComfyUI-SAM3']
[08:27] [ComfyUI] [SubprocessWorker] is_pixi=True, python=/Users/runner/.ce/.pixi/envs/sam3-nodes/bin/python
[08:27] [ComfyUI] [SubprocessWorker] launching cmd=['/Users/runner/.pixi/bin/pixi', 'run', '--as-is', '--manifest-path', '/Users/runner/.ce/pixi.toml', '-e', 'sam3-nodes', 'python', '/var/folders/tb/y368xp_x10s3ty1b_mtl5mxr0000gn/T/comfyui_pvenv_qg3md4xk/persistent_worker.py', 'unix:///var/folders/tb/y368xp_x10s3ty1b_mtl5mxr0000gn/T/comfy_worker_55d0b61774bb.sock']...
[08:27] [ComfyUI] [SubprocessWorker] socket_addr=unix:///var/folders/tb/y368xp_x10s3ty1b_mtl5mxr0000gn/T/comfy_worker_55d0b61774bb.sock exists=True
[08:29] Frame 3 saved (frame_002.jpg, t=5.3s)
[08:29] [capture-periodic] freeze=6ms shot=222ms unfreeze=4ms saved=True
[08:31] [capture-loop] iter=50 t=7.0s state={'complete': False, 'error': None, 'executedCount': 0, 'wsState': 1} eval_ms=3 ram=2.6/7.0GB (49%) swap=3.0/4.0GB (75%) cpu=64% browser_rss=0.66GB
[08:33] [ComfyUI] [SubprocessWorker] worker started/confirmed
[08:33] [ComfyUI] [SubprocessWorker] serializing kwargs to shm...
[08:33] [ComfyUI] [SubprocessWorker] created 0 shm blocks
[08:33] [ComfyUI] [SubprocessWorker] sending request via socket...
[08:33] [ComfyUI] [SubprocessWorker] call_id=9 sending call_method
[08:34] [ComfyUI] [SubprocessWorker] got response: ok
[08:34] [ComfyUI] [comfy-env] LoadSAM3Model done (6.46s): result: NodeOutput
[08:34] [ComfyUI] [comfy-env] Running SAM3InteractiveCollector: multi_prompts_store: '[{"positive_points":[{"x":3348.288109906738,"y":2452.220..., sam3_model_config: dict, image: torch.float32 [1,4480,6720,3] cpu, unique_id: '26'
[08:34] [ComfyUI] [SubprocessWorker] call_method: nodes.sam3_interactive.SAM3InteractiveCollector.EXECUTE_NORMALIZED
[08:34] [ComfyUI] [SubprocessWorker] acquired lock, ensuring started...
[08:34] [ComfyUI] [ComfyUI-SAM3] Health check: ping (timeout=5.0s)...
[08:34] [ComfyUI] [ComfyUI-SAM3] Health check: ok
[08:34] [ComfyUI] [SubprocessWorker] worker started/confirmed
[08:34] [ComfyUI] [comfy-env] PRE-SERIALIZE 'image' shape: torch.Size([1, 4480, 6720, 3])
[08:34] [ComfyUI] [SubprocessWorker] serializing kwargs to shm...
[08:34] [ComfyUI] [SubprocessWorker] created 0 shm blocks
[08:34] [ComfyUI] [SubprocessWorker] sending request via socket...
[08:34] [ComfyUI] [SubprocessWorker] call_id=10 sending call_method
[08:34] [ComfyUI] [worker:ComfyUI-SAM3] [comfy-env] _from_shm got dict with keys: ['__type__', 'strategy', 'manager_path', 'storage_key', 'storage_size']
[08:34] [ComfyUI] [worker:ComfyUI-SAM3] [comfy-env] DESERIALIZE TensorRef: tensor_size=[1, 4480, 6720, 3]
[08:34] [ComfyUI] [worker:ComfyUI-SAM3] [comfy-env] DESERIALIZED tensor shape: torch.Size([1, 4480, 6720, 3])
[08:34] Frame 4 saved (frame_003.jpg, t=9.9s)
[08:34] [capture-periodic] freeze=6ms shot=105ms unfreeze=4ms saved=True
[08:35] [ComfyUI] objc[12035]: Class AVFFrameReceiver is implemented in both /Users/runner/.ce/.pixi/envs/sam3-nodes/lib/libavdevice.62.3.101.dylib (0x1318207a8) and /Users/runner/.ce/.pixi/envs/sam3-nodes/lib/python3.10/site-packages/cv2/.dylibs/libavdevice.61.3.100.dylib (0x16a06c3a8). This may cause spurious casting failures and mysterious crashes. One of the duplicates must be removed or renamed.
[08:35] [ComfyUI] objc[12035]: Class AVFAudioReceiver is implemented in both /Users/runner/.ce/.pixi/envs/sam3-nodes/lib/libavdevice.62.3.101.dylib (0x1318207f8) and /Users/runner/.ce/.pixi/envs/sam3-nodes/lib/python3.10/site-packages/cv2/.dylibs/libavdevice.61.3.100.dylib (0x16a06c3f8). This may cause spurious casting failures and mysterious crashes. One of the duplicates must be removed or renamed.
[08:37] [capture-loop] iter=100 t=12.9s state={'complete': False, 'error': None, 'executedCount': 0, 'wsState': 1} eval_ms=2 ram=3.0/7.0GB (54%) swap=1.3/4.0GB (32%) cpu=49% browser_rss=0.61GB
[08:42] [capture-loop] iter=150 t=18.5s state={'complete': False, 'error': None, 'executedCount': 0, 'wsState': 1} eval_ms=4 ram=3.5/7.0GB (62%) swap=0.5/2.0GB (24%) cpu=31% browser_rss=0.57GB
[08:49] [capture-loop] iter=200 t=25.1s state={'complete': False, 'error': None, 'executedCount': 0, 'wsState': 1} eval_ms=5 ram=2.9/7.0GB (72%) swap=0.5/2.0GB (24%) cpu=66% browser_rss=0.43GB
[08:55] [capture-loop] iter=250 t=31.4s state={'complete': False, 'error': None, 'executedCount': 0, 'wsState': 1} eval_ms=3 ram=2.6/7.0GB (76%) swap=0.5/2.0GB (24%) cpu=55% browser_rss=0.24GB
[09:01] [capture-loop] iter=300 t=37.7s state={'complete': False, 'error': None, 'executedCount': 0, 'wsState': 1} eval_ms=4 ram=2.5/7.0GB (78%) swap=0.4/2.0GB (22%) cpu=52% browser_rss=0.23GB
[09:03] [ComfyUI] [SubprocessWorker] callback 'request_vram_budget' from call_id=10
[09:03] [ComfyUI] [comfy-env] VRAM request: 1.84GB, free before eviction: 1.69GB
[09:03] [ComfyUI] [comfy-env] VRAM after eviction: 1.69GB
[09:08] [capture-loop] iter=350 t=44.5s state={'complete': False, 'error': None, 'executedCount': 0, 'wsState': 1} eval_ms=3 ram=3.4/7.0GB (70%) swap=0.4/2.0GB (22%) cpu=68% browser_rss=0.22GB
[09:18] [capture-loop] iter=400 t=53.9s state={'complete': False, 'error': None, 'executedCount': 0, 'wsState': 1} eval_ms=31 ram=2.5/7.0GB (78%) swap=0.4/2.0GB (20%) cpu=76% browser_rss=0.21GB
[09:25] [capture-loop] iter=450 t=61.7s state={'complete': False, 'error': None, 'executedCount': 0, 'wsState': 1} eval_ms=4 ram=4.2/7.0GB (86%) swap=0.5/2.0GB (23%) cpu=72% browser_rss=0.20GB
[09:28] [ComfyUI] [worker:ComfyUI-SAM3]
[09:28] [ComfyUI] === WATCHDOG TICK 1 ===
[09:28] [ComfyUI] [worker:ComfyUI-SAM3] Current thread 0x000000016e563000 (most recent call first):
[09:28] [ComfyUI] File "/var/folders/tb/y368xp_x10s3ty1b_mtl5mxr0000gn/T/comfyui_pvenv_qg3md4xk/persistent_worker.py", line 52 in _watchdog
[09:28] [ComfyUI] File "/Users/runner/.ce/.pixi/envs/sam3-nodes/lib/python3.10/threading.py", line 953 in run
[09:28] [ComfyUI] File "/Users/runner/.ce/.pixi/envs/sam3-nodes/lib/python3.10/threading.py", line 1016 in _bootstrap_inner
[09:28] [ComfyUI] File "/Users/runner/.ce/.pixi/envs/sam3-nodes/lib/python3.10/threading.py", line 973 in _bootstrap
[09:28] [ComfyUI]
[09:28] [ComfyUI] Thread 0x00000001feaca240 (most recent call first):
[09:28] [ComfyUI] File "/Users/runner/work/comfy-gpu-ci/comfy-gpu-ci/test_workspaces/SAM3-1010/ComfyUI/comfy/ops.py", line 640 in forward_comfy_cast_weights
[09:28] [ComfyUI] File "/Users/runner/work/comfy-gpu-ci/comfy-gpu-ci/test_workspaces/SAM3-1010/ComfyUI/comfy/ops.py", line 649 in forward
[09:28] [ComfyUI] File "/Users/runner/.ce/.pixi/envs/sam3-nodes/lib/python3.10/site-packages/torch/nn/modules/module.py", line 1790 in _call_impl
[09:28] [ComfyUI] File "/Users/runner/.ce/.pixi/envs/sam3-nodes/lib/python3.10/site-packages/torch/nn/modules/module.py", line 1779 in _wrapped_call_impl
[09:28] [ComfyUI] File "/Users/runner/.ce/.pixi/envs/sam3-nodes/lib/python3.10/site-packages/torch/nn/modules/container.py", line 253 in forward
[09:28] [ComfyUI] File "/Users/runner/.ce/.pixi/envs/sam3-nodes/lib/python3.10/site-packages/torch/nn/modules/module.py", line 1790 in _call_impl
[09:28] [ComfyUI] File "/Users/runner/.ce/.pixi/envs/sam3-nodes/lib/python3.10/site-packages/torch/nn/modules/module.py", line 1779 in _wrapped_call_impl
[09:28] [ComfyUI] File "/Users/runner/work/comfy-gpu-ci/comfy-gpu-ci/test_workspaces/SAM3-1010/ComfyUI/custom_nodes/ComfyUI-SAM3/nodes/sam3/model.py", line 2049 in forward
[09:28] [ComfyUI] File "/Users/runner/work/comfy-gpu-ci/comfy-gpu-ci/test_workspaces/SAM3-1010/ComfyUI/custom_nodes/ComfyUI-SAM3/nodes/sam3/model.py", line 3321 in _forward_image_no_act_ckpt
[09:28] [ComfyUI] File "/Users/runner/work/comfy-gpu-ci/comfy-gpu-ci/test_workspaces/SAM3-1010/ComfyUI/custom_nodes/ComfyUI-SAM3/nodes/sam3/model.py", line 3314 in forward_image
[09:28] [ComfyUI] File "/Users/runner/work/comfy-gpu-ci/comfy-gpu-ci/test_workspaces/SAM3-1010/ComfyUI/custom_nodes/ComfyUI-SAM3/nodes/sam3/utils.py", line 1324 in set_image
[09:28] [ComfyUI] File "/Users/runner/.ce/.pixi/envs/sam3-nodes/lib/python3.10/site-packages/torch/utils/_contextlib.py", line 124 in decorate_context
[09:28] [ComfyUI] File "/Users/runner/work/comfy-gpu-ci/comfy-gpu-ci/test_workspaces/SAM3-1010/ComfyUI/custom_nodes/ComfyUI-SAM3/nodes/sam3_interactive.py", line 687 in execute
[09:28] [ComfyUI] File "/Users/runner/work/comfy-gpu-ci/comfy-gpu-ci/test_workspaces/SAM3-1010/ComfyUI/comfy_api/latest/_io.py", line 1833 in EXECUTE_NORMALIZED
[09:28] [ComfyUI] File "/var/folders/tb/y368xp_x10s3ty1b_mtl5mxr0000gn/T/comfyui_pvenv_qg3md4xk/persistent_worker.py", line 1762 in main
[09:28] [ComfyUI] File "/var/folders/tb/y368xp_x10s3ty1b_mtl5mxr0000gn/T/comfyui_pvenv_qg3md4xk/persistent_worker.py", line 1807 in <module>
[09:28] [ComfyUI]
[09:28] [ComfyUI] [worker:ComfyUI-SAM3] === END ===
[09:28] [ComfyUI]
[09:34] [capture-loop] iter=500 t=70.3s state={'complete': False, 'error': None, 'executedCount': 0, 'wsState': 1} eval_ms=8 ram=3.3/7.0GB (84%) swap=0.5/2.0GB (22%) cpu=62% browser_rss=0.21GB
[09:41] [ComfyUI] [SubprocessWorker] callback 'report_progress' from call_id=10
[09:44] Frame 5 saved (frame_004.jpg, t=79.1s)
[09:44] [capture-periodic] freeze=20ms shot=686ms unfreeze=24ms saved=True
[09:52] [capture-loop] iter=550 t=88.0s state={'complete': False, 'error': None, 'executedCount': 0, 'wsState': 1} eval_ms=6 ram=2.9/7.0GB (74%) swap=1.7/2.0GB (86%) cpu=76% browser_rss=0.15GB
[09:57] [ComfyUI] [SubprocessWorker] got response: ok
[09:57] [ComfyUI] [comfy-env] SAM3InteractiveCollector done (83.35s): result: NodeOutput
[09:58] [capture-loop] iter=600 t=94.3s state={'complete': False, 'error': None, 'executedCount': 0, 'wsState': 1} eval_ms=54 ram=2.6/7.0GB (77%) swap=1.7/2.0GB (83%) cpu=66% browser_rss=0.18GB
[10:00] [ComfyUI] Prompt executed in 96.54 seconds
[10:03] Node executed (2 total), capturing...
[10:03] Frame 6 saved (frame_005.jpg, t=99.4s)
[10:03] [capture-node] freeze=7ms shot=247ms unfreeze=0ms saved=True
[10:03] Execution complete (t=99.4s)
[10:03] Captured 6 unique frames over 99.73s
[10:03] [debug] iframes: 0
[10:03] [timing] trigger_3d_previews: 0.0s
[10:07] Saved high-quality screenshot: scene_seg_interactive_executed.png
[10:07] [timing] final_screenshot: 1.4s
[10:08] [5/5] SKIPPED (not in cpu list) video_point_prompt.json
[10:08] Results saved to /Users/runner/work/comfy-gpu-ci/comfy-gpu-ci/comfy-test-logs/SAM3-1010/dev/macos-cpu/results.json
[10:08] Model report: 1 files, 3.2 GB -> /Users/runner/work/comfy-gpu-ci/comfy-gpu-ci/comfy-test-logs/SAM3-1010/dev/macos-cpu/models.json
[10:08] Saved: /Users/runner/work/comfy-gpu-ci/comfy-gpu-ci/comfy-test-logs/SAM3-1010/dev/macos-cpu/index.html
[10:08] [EXECUTION] PASSED
[10:08]
macos: PASSED
[10:08] Stopping ComfyUI server...