nodes/malkuthro-ComfyUI-Koolook
1
0
Fork 0
Code Issues Pull Requests Packages Projects Releases Wiki Activity

More files

Browse Source
This commit is contained in:
malkuthro
2025-12-01 22:16:29 +01:00
parent 455f502a4f
commit 5d7432eb4d
6 changed files with 129 additions and 0 deletions
Download Patch File Download Diff File Expand all files Collapse all files
_Utils-CAM-track/Dataset-Design_Real-Estate10k/0bf152ef84195293.txt
+17
View File
@@ -0,0 +1,17 @@
https://www.youtube.com/watch?v=QShWPZxTDoE
158692025 0.474812461 0.844111024 0.500000000 0.500000000 0.000000000 0.000000000 0.780003667 0.059620168 -0.622928321 0.726968666 -0.062449891 0.997897983 0.017311305 0.217967188 0.622651041 0.025398925 0.782087326 -1.002211444
158958959 0.474812461 0.844111024 0.500000000 0.500000000 0.000000000 0.000000000 0.743836701 0.064830206 -0.665209770 0.951841944 -0.068305343 0.997446954 0.020830527 0.206496789 0.664861917 0.029942872 0.746365905 -1.084913992
159225893 0.474812461 0.844111024 0.500000000 0.500000000 0.000000000 0.000000000 0.697046876 0.070604131 -0.713540971 1.208789672 -0.074218854 0.996899366 0.026138915 0.196421447 0.713174045 0.034738146 0.700125754 -1.130142078
159526193 0.474812461 0.844111024 0.500000000 0.500000000 0.000000000 0.000000000 0.635762572 0.077846259 -0.767949164 1.465161122 -0.080595709 0.996158004 0.034256749 0.157107229 0.767665446 0.040114246 0.639594078 -1.136893070
159793126 0.474812461 0.844111024 0.500000000 0.500000000 0.000000000 0.000000000 0.593250692 0.083153486 -0.800711632 1.635091834 -0.085384794 0.995539784 0.040124334 0.135863998 0.800476789 0.044564810 0.597704709 -1.166997229
160093427 0.474812461 0.844111024 0.500000000 0.500000000 0.000000000 0.000000000 0.555486798 0.087166689 -0.826943994 1.803789619 -0.089439675 0.994984210 0.044799786 0.145490422 0.826701283 0.049075913 0.560496747 -1.243827350
160360360 0.474812461 0.844111024 0.500000000 0.500000000 0.000000000 0.000000000 0.523399472 0.090266660 -0.847292721 1.945815368 -0.093254104 0.994468153 0.048340045 0.174777447 0.846969128 0.053712368 0.528921843 -1.336914479
160660661 0.474812461 0.844111024 0.500000000 0.500000000 0.000000000 0.000000000 0.491546303 0.092127070 -0.865964711 2.093852892 -0.095617607 0.994085968 0.051482171 0.196702533 0.865586221 0.057495601 0.497448236 -1.439709380
160927594 0.474812461 0.844111024 0.500000000 0.500000000 0.000000000 0.000000000 0.475284129 0.093297184 -0.874871790 2.200792438 -0.096743606 0.993874133 0.053430639 0.209217395 0.874497354 0.059243519 0.481398523 -1.547068315
161227895 0.474812461 0.844111024 0.500000000 0.500000000 0.000000000 0.000000000 0.464444131 0.093880348 -0.880612373 2.324141986 -0.097857766 0.993716478 0.054326952 0.220651207 0.880179226 0.060942926 0.470712721 -1.712512928
161494828 0.474812461 0.844111024 0.500000000 0.500000000 0.000000000 0.000000000 0.458157241 0.093640216 -0.883925021 2.443100890 -0.098046601 0.993691206 0.054448847 0.257385043 0.883447111 0.061719712 0.464447916 -1.885672329
161795128 0.474812461 0.844111024 0.500000000 0.500000000 0.000000000 0.000000000 0.457354397 0.093508720 -0.884354591 2.543246338 -0.097820736 0.993711591 0.054482624 0.281562244 0.883888066 0.061590351 0.463625461 -2.094829165
162062062 0.474812461 0.844111024 0.500000000 0.500000000 0.000000000 0.000000000 0.465170115 0.093944497 -0.880222261 2.606377358 -0.097235762 0.993758380 0.054675922 0.277376127 0.879864752 0.060155477 0.471401453 -2.299280675
162362362 0.474812461 0.844111024 0.500000000 0.500000000 0.000000000 0.000000000 0.511845231 0.090872414 -0.854257941 2.576774100 -0.093636356 0.994366586 0.049672548 0.270516319 0.853959382 0.054564942 0.517470777 -2.624374352
162629296 0.474812461 0.844111024 0.500000000 0.500000000 0.000000000 0.000000000 0.590568483 0.083218277 -0.802685261 2.398318316 -0.085610889 0.995516419 0.040222570 0.282138215 0.802433550 0.044964414 0.595045030 -3.012309268
162929596 0.474812461 0.844111024 0.500000000 0.500000000 0.000000000 0.000000000 0.684302032 0.072693504 -0.725566208 2.086323553 -0.074529484 0.996780157 0.029575195 0.310959312 0.725379944 0.033837710 0.687516510 -3.456740526
_Utils-CAM-track/_DATA_2_play/SETUP.txt
+2
View File
@@ -0,0 +1,2 @@
Video Format: x=1248, y=704
Duration: 41 frames
_Utils-CAM-track/_DATA_2_play/Several-Points_track-data.json
+10
View File
File diff suppressed because one or more lines are too long
_Utils-CAM-track/_DATA_2_play/test_camera_track.txt
+42
View File
@@ -0,0 +1,42 @@
https://example.com/test_track_placeholder
0 0.620000 0.620000 0.500000 0.500000 1248.000000 704.000000 1.000000 0.000000 0.000000 -0.804487 0.000000 1.000000 0.000000 -0.210227 0.000000 0.000000 1.000000 -1.000000
41667 0.620000 0.620000 0.500000 0.500000 1248.000000 704.000000 1.000000 0.000000 0.000000 -0.804487 0.000000 1.000000 0.000000 -0.210227 0.000000 0.000000 1.000000 -1.000000
83334 0.620000 0.620000 0.500000 0.500000 1248.000000 704.000000 1.000000 0.000000 0.000000 -0.807692 0.000000 1.000000 0.000000 -0.207386 0.000000 0.000000 1.000000 -1.000000
125001 0.620000 0.620000 0.500000 0.500000 1248.000000 704.000000 1.000000 0.000000 0.000000 -0.809295 0.000000 1.000000 0.000000 -0.207386 0.000000 0.000000 1.000000 -1.000000
166668 0.620000 0.620000 0.500000 0.500000 1248.000000 704.000000 1.000000 0.000000 0.000000 -0.812500 0.000000 1.000000 0.000000 -0.207386 0.000000 0.000000 1.000000 -1.000000
208335 0.620000 0.620000 0.500000 0.500000 1248.000000 704.000000 1.000000 0.000000 0.000000 -0.814103 0.000000 1.000000 0.000000 -0.207386 0.000000 0.000000 1.000000 -1.000000
250002 0.620000 0.620000 0.500000 0.500000 1248.000000 704.000000 1.000000 0.000000 0.000000 -0.817308 0.000000 1.000000 0.000000 -0.207386 0.000000 0.000000 1.000000 -1.000000
291669 0.620000 0.620000 0.500000 0.500000 1248.000000 704.000000 1.000000 0.000000 0.000000 -0.818910 0.000000 1.000000 0.000000 -0.207386 0.000000 0.000000 1.000000 -1.000000
333336 0.620000 0.620000 0.500000 0.500000 1248.000000 704.000000 1.000000 0.000000 0.000000 -0.820513 0.000000 1.000000 0.000000 -0.204545 0.000000 0.000000 1.000000 -1.000000
375003 0.620000 0.620000 0.500000 0.500000 1248.000000 704.000000 1.000000 0.000000 0.000000 -0.823718 0.000000 1.000000 0.000000 -0.204545 0.000000 0.000000 1.000000 -1.000000
416670 0.620000 0.620000 0.500000 0.500000 1248.000000 704.000000 1.000000 0.000000 0.000000 -0.825321 0.000000 1.000000 0.000000 -0.204545 0.000000 0.000000 1.000000 -1.000000
458337 0.620000 0.620000 0.500000 0.500000 1248.000000 704.000000 1.000000 0.000000 0.000000 -0.826923 0.000000 1.000000 0.000000 -0.204545 0.000000 0.000000 1.000000 -1.000000
500004 0.620000 0.620000 0.500000 0.500000 1248.000000 704.000000 1.000000 0.000000 0.000000 -0.828526 0.000000 1.000000 0.000000 -0.204545 0.000000 0.000000 1.000000 -1.000000
541671 0.620000 0.620000 0.500000 0.500000 1248.000000 704.000000 1.000000 0.000000 0.000000 -0.833333 0.000000 1.000000 0.000000 -0.193182 0.000000 0.000000 1.000000 -1.000000
583338 0.620000 0.620000 0.500000 0.500000 1248.000000 704.000000 1.000000 0.000000 0.000000 -0.839744 0.000000 1.000000 0.000000 -0.184659 0.000000 0.000000 1.000000 -1.000000
625005 0.620000 0.620000 0.500000 0.500000 1248.000000 704.000000 1.000000 0.000000 0.000000 -0.841346 0.000000 1.000000 0.000000 -0.173295 0.000000 0.000000 1.000000 -1.000000
666672 0.620000 0.620000 0.500000 0.500000 1248.000000 704.000000 1.000000 0.000000 0.000000 -0.841346 0.000000 1.000000 0.000000 -0.164773 0.000000 0.000000 1.000000 -1.000000
708339 0.620000 0.620000 0.500000 0.500000 1248.000000 704.000000 1.000000 0.000000 0.000000 -0.841346 0.000000 1.000000 0.000000 -0.161932 0.000000 0.000000 1.000000 -1.000000
750006 0.620000 0.620000 0.500000 0.500000 1248.000000 704.000000 1.000000 0.000000 0.000000 -0.842949 0.000000 1.000000 0.000000 -0.161932 0.000000 0.000000 1.000000 -1.000000
791673 0.620000 0.620000 0.500000 0.500000 1248.000000 704.000000 1.000000 0.000000 0.000000 -0.844551 0.000000 1.000000 0.000000 -0.159091 0.000000 0.000000 1.000000 -1.000000
833340 0.620000 0.620000 0.500000 0.500000 1248.000000 704.000000 1.000000 0.000000 0.000000 -0.847756 0.000000 1.000000 0.000000 -0.156250 0.000000 0.000000 1.000000 -1.000000
875007 0.620000 0.620000 0.500000 0.500000 1248.000000 704.000000 1.000000 0.000000 0.000000 -0.850962 0.000000 1.000000 0.000000 -0.156250 0.000000 0.000000 1.000000 -1.000000
916674 0.620000 0.620000 0.500000 0.500000 1248.000000 704.000000 1.000000 0.000000 0.000000 -0.855769 0.000000 1.000000 0.000000 -0.153409 0.000000 0.000000 1.000000 -1.000000
958341 0.620000 0.620000 0.500000 0.500000 1248.000000 704.000000 1.000000 0.000000 0.000000 -0.858974 0.000000 1.000000 0.000000 -0.153409 0.000000 0.000000 1.000000 -1.000000
1000008 0.620000 0.620000 0.500000 0.500000 1248.000000 704.000000 1.000000 0.000000 0.000000 -0.863782 0.000000 1.000000 0.000000 -0.150568 0.000000 0.000000 1.000000 -1.000000
1041675 0.620000 0.620000 0.500000 0.500000 1248.000000 704.000000 1.000000 0.000000 0.000000 -0.866987 0.000000 1.000000 0.000000 -0.150568 0.000000 0.000000 1.000000 -1.000000
1083342 0.620000 0.620000 0.500000 0.500000 1248.000000 704.000000 1.000000 0.000000 0.000000 -0.868590 0.000000 1.000000 0.000000 -0.150568 0.000000 0.000000 1.000000 -1.000000
1125009 0.620000 0.620000 0.500000 0.500000 1248.000000 704.000000 1.000000 0.000000 0.000000 -0.870192 0.000000 1.000000 0.000000 -0.150568 0.000000 0.000000 1.000000 -1.000000
1166676 0.620000 0.620000 0.500000 0.500000 1248.000000 704.000000 1.000000 0.000000 0.000000 -0.871795 0.000000 1.000000 0.000000 -0.147727 0.000000 0.000000 1.000000 -1.000000
1208343 0.620000 0.620000 0.500000 0.500000 1248.000000 704.000000 1.000000 0.000000 0.000000 -0.873397 0.000000 1.000000 0.000000 -0.144886 0.000000 0.000000 1.000000 -1.000000
1250010 0.620000 0.620000 0.500000 0.500000 1248.000000 704.000000 1.000000 0.000000 0.000000 -0.873397 0.000000 1.000000 0.000000 -0.139205 0.000000 0.000000 1.000000 -1.000000
1291677 0.620000 0.620000 0.500000 0.500000 1248.000000 704.000000 1.000000 0.000000 0.000000 -0.873397 0.000000 1.000000 0.000000 -0.133523 0.000000 0.000000 1.000000 -1.000000
1333344 0.620000 0.620000 0.500000 0.500000 1248.000000 704.000000 1.000000 0.000000 0.000000 -0.873397 0.000000 1.000000 0.000000 -0.130682 0.000000 0.000000 1.000000 -1.000000
1375011 0.620000 0.620000 0.500000 0.500000 1248.000000 704.000000 1.000000 0.000000 0.000000 -0.875000 0.000000 1.000000 0.000000 -0.130682 0.000000 0.000000 1.000000 -1.000000
1416678 0.620000 0.620000 0.500000 0.500000 1248.000000 704.000000 1.000000 0.000000 0.000000 -0.875000 0.000000 1.000000 0.000000 -0.130682 0.000000 0.000000 1.000000 -1.000000
1458345 0.620000 0.620000 0.500000 0.500000 1248.000000 704.000000 1.000000 0.000000 0.000000 -0.876603 0.000000 1.000000 0.000000 -0.127841 0.000000 0.000000 1.000000 -1.000000
1500012 0.620000 0.620000 0.500000 0.500000 1248.000000 704.000000 1.000000 0.000000 0.000000 -0.878205 0.000000 1.000000 0.000000 -0.127841 0.000000 0.000000 1.000000 -1.000000
1541679 0.620000 0.620000 0.500000 0.500000 1248.000000 704.000000 1.000000 0.000000 0.000000 -0.879808 0.000000 1.000000 0.000000 -0.125000 0.000000 0.000000 1.000000 -1.000000
1583346 0.620000 0.620000 0.500000 0.500000 1248.000000 704.000000 1.000000 0.000000 0.000000 -0.879808 0.000000 1.000000 0.000000 -0.122159 0.000000 0.000000 1.000000 -1.000000
1625013 0.620000 0.620000 0.500000 0.500000 1248.000000 704.000000 1.000000 0.000000 0.000000 -0.878205 0.000000 1.000000 0.000000 -0.119318 0.000000 0.000000 1.000000 -1.000000
1666680 0.620000 0.620000 0.500000 0.500000 1248.000000 704.000000 1.000000 0.000000 0.000000 -0.878205 0.000000 1.000000 0.000000 -0.116477 0.000000 0.000000 1.000000 -1.000000
_Utils-CAM-track/camera_pose_txt_template.md
+58
View File
@@ -0,0 +1,58 @@
# Camera Tracking TXT Template
This guide consolidates the RealEstate10k pose specification (`Dataset-Design_Real-Estate10k/DatasetDesign.txt`) with the behavior of the `LoadCameraPosesFromPath` node from AnimateDiff-Evolved (`Github-Repos/Comfyui-Animatedfiff-evolved/nodes_cameractrl.py`) and the `CameraPoseVisualizer` from KJNodes (`Github-Repos/Comfyui-kjnodes/nodes.py`). Follow it to author pose files that ComfyUI can ingest and preview using the workflow shown in `REF_screenshots/Desired-Workflow-Steps.png`.
## Format Constraints
- **Header line**: The loaders expect the first line to be a plain text identifier (typically the original dataset URL). The node skips this line, so anything can be placed there as long as it is a single line of text with no spaces-only entries.
- **Value separator**: Lines 2+ must be purely numeric values separated by single spaces. Do not include commas, tabs, comments, or blank lines or the parsing in `LoadCameraPosesFromPath` / `LoadCameraPosesFromFile` will fail.
- **Row length**: Every frame line contains exactly 19 columns: timestamp, 4 intrinsic terms, 2 reserved width/height slots, and a flattened 3×4 pose matrix (row-major). This matches the expectations of the CameraCtrl nodes and the `CameraPoseVisualizer`, which reshape indices 7–18 into a world-to-camera matrix.
- **Units & ranges**:
- `timestamp`: integer microseconds since clip start; must be monotonically increasing.
- `focal_length_x/y` (`fx`, `fy`): normalized focal lengths (multiply by pixel width/height to recover actual values as described in the dataset doc).
- `principal_point_x/y` (`cx`, `cy`): normalized principal point coordinates in [0, 1].
- Pose matrix: represents `[R|t]` mapping world coordinates to camera coordinates. Ensure rows/columns form a valid rigid transform to avoid warped trajectories when visualizing.
- **Width/height placeholders**: Columns 6–7 are not consumed by AnimateDiff directly. The loader overwrites them with `CAM.DEFAULT_POSE_WIDTH` (1280) and `CAM.DEFAULT_POSE_HEIGHT` (720), but you may pre-populate them if another tool downstream expects specific dimensions.
## Template Layout
1. **Line 1** – Metadata / source information. Example: `https://example.com/my_clip`. This line is ignored by the loader but retained for traceability.
2. **Lines 2+** – One frame per line, 19 space-separated values following the schema below.
| # | Column | Description |
|---|--------|-------------|
| 1 | `timestamp` | Integer microseconds since the clip begins. |
| 2 | `fx` | Normalized focal length along x; multiply by image width for pixel-space value. |
| 3 | `fy` | Normalized focal length along y; multiply by image height. |
| 4 | `cx` | Normalized principal point x coordinate (0–1). |
| 5 | `cy` | Normalized principal point y coordinate (0–1). |
| 6 | `pose_width` | Optional original image width in pixels (will be overwritten if left default). |
| 7 | `pose_height` | Optional original image height in pixels. |
| 8–11 | `r00 r01 r02 r03` | First row of the 3×4 `[R|t]` matrix (rotation + translation). |
| 12–15 | `r10 r11 r12 r13` | Second row of the matrix. |
| 16–19 | `r20 r21 r22 r23` | Third row of the matrix. |
### Sample Frame Line
```
0 0.62 0.62 0.5 0.5 1280 720 0.998 -0.010 0.060 0.150 0.012 0.995 -0.099 -1.200 -0.059 0.100 0.993 2.350
```
- Replace the timestamp, intrinsics, and matrix entries with your real measurements. The example encodes a gently moving camera with a translation of `(0.150, -1.200, 2.350)` and slight rotations.
- Ensure each subsequent line increments the timestamp and updates the matrix accordingly.
### Authoring Tips
- Generate the rotation matrix from yaw/pitch/roll or quarternions, then append translations in meters (or consistent world units) for the final column.
- Keep precision to at least 3 decimal places to avoid jitter.
- Validate the determinant of `R` stays close to 1 to confirm orthonormality.
## Workflow Integration Steps
1. **Place the TXT file** inside your ComfyUI `input` directory (e.g., `ComfyUI/input/my_camera_track.txt`).
2. **Provide the path** via a `Text Multiline` node or string field, mirroring step 1 in `Desired-Workflow-Steps.png`. Use absolute paths (preferred) to avoid ambiguity.
3. **Load poses** with `LoadCameraPoses (Path)` from AnimateDiff-Evolved. This node outputs `CAMERACTRL_POSES` suitable for downstream motion modules.
4. **Visual check**: Feed the pose output into `CameraPoseVisualizer` from KJNodes to verify the 3D trajectory. Adjust `base_xval`, `zval`, and `scale` if the model appears too small or large.
5. **Encode for video**: Connect the same pose output to nodes such as `WanVideo FunCamera Embeds` / `WanVideo FunCamera Wrapper` to supply camera embeddings before rendering, as indicated in the screenshot.
## Troubleshooting
- **"Could not parse pose file"**: Confirm each line has 19 space-separated numbers and no extra whitespace or tabs. An empty line at the end of the file can also cause this error.
- **Camera path looks skewed**: Double-check the `[R|t]` block ordering. `CameraPoseVisualizer` assumes the matrix is row-major world-to-camera; transposing rows/columns will flip axes.
- **Scale mismatch**: If previews look extremely zoomed, ensure `fx`/`fy` are normalized (0–1 range). If you are using pixel-space focal lengths, divide by width/height first.
- **Jumps between frames**: Verify timestamps increase monotonically and that `R` is continuous (small deltas). Abrupt changes often originate from incorrect unit conversions or mixing degrees/radians when generating the rotation matrices.
Following this template keeps your pose data aligned with AnimateDiff-Evolved CameraCtrl expectations and the visualization tooling in ComfyUI, reducing iteration time when building camera-aware workflows.
assets/n__TRK_sync_SMALL_N_Programming_ComfyUI_ComfyUI-Koolook__Utils-CAM-track_REF_screenshots_Desired-Workflow-Steps.png
View File