Commit Graph
114 Commits
Author SHA1 Message Date
Hawk Lee c936887aed fix(ditto): Restore EMA Logic! Wire mouth_smoothing to MotionStitch instead of Audio2Motion v1.9.46 2026-01-22 22:28:08 +08:00
Hawk Lee 4125bbce45 feat(ditto): Upgrade mouth_smoothing to Float Blend (0.0/0.3/0.5/0.7) v1.9.44 2026-01-22 22:12:56 +08:00
Hawk Lee eb2dfb065c fix(ditto): Rollback to v1.9.31 + Add Vitality Noise Injection (v1.9.41) 2026-01-22 21:32:11 +08:00
Hawk Lee 2dd439b8e0 fix: Remove EMA reset on speech onset for smooth mouth opening transition 2026-01-22 14:24:25 +08:00
Hawk Lee 9778d2c654 refactor: Implement Soft Reset - only reset seed, let model continue from idle naturally 2026-01-22 09:33:40 +08:00
Hawk Lee d6a4182edd fix: Apply warping at correct frame offset (fuse_r2_s) instead of index 0 2026-01-22 01:37:24 +08:00
Hawk Lee 27800ce3f1 fix: Expand Prediction Warping to ALL kp dimensions (incl. expression) to prevent full reset snap 2026-01-22 01:16:07 +08:00
Hawk Lee eb3227a78b fix: Reset EMA on speech onset to prevent stale closed-mouth bleed 2026-01-22 01:11:43 +08:00
Hawk Lee eff970828f feat: Expose mouth_smoothing parameter (None/Light/Normal/Heavy) 2026-01-22 01:06:44 +08:00
Hawk Lee 50c628f3d6 feat: Add Expression Temporal Smoothing (EMA) to prevent inhumanly fast mouth movements 2026-01-22 01:02:28 +08:00
Hawk Lee 832c42c325 fix: Buffer expression history to prevent capturing closed mouth, force full attack strength 2026-01-21 23:45:19 +08:00
Hawk Lee 1030be5086 fix: Robust handling of speech re-entry (Attack Phase) in MotionStitch 2026-01-21 22:50:38 +08:00
Hawk Lee 041fd03036 fix: Prevent instant mouth snap by freezing last speaking frame during VAD release 2026-01-21 22:44:37 +08:00
Hawk Lee a803a2d9ec revert: Disable Head Pose Relaxation to restore natural drift/vitality 2026-01-21 22:38:31 +08:00
Hawk Lee 038a10125a feat: Enable Full Head Pose Relaxation (Expressions + Pose) on Silence 2026-01-21 22:29:29 +08:00
Hawk Lee c1cb479775 fix: Replace Smooth Reset with Pre-Fuse Warping (fixes NameError) 2026-01-21 22:13:00 +08:00
Hawk Lee 0e5e6e8324 fix: Correct Smooth Reset start index to cover fuse overlap and use Cubic interpolation 2026-01-21 21:49:45 +08:00
Hawk Lee e13e9568ea chore: Add debug logging to Audio2Motion to trace Smooth Reset logic 2026-01-21 21:43:54 +08:00
Hawk Lee 88be1ba587 fix: Remove duplicate argument in MotionStitch.setup causing SyntaxError 2026-01-21 21:26:58 +08:00
Hawk Lee a35a069261 feat: Implement Smooth Reset (Pose Blending) to fix head snap at speech onset 2026-01-21 21:20:00 +08:00
Hawk Lee 04538bebe1 feat: Add blink_amp parameter to control eye closure intensity 2026-01-21 21:16:14 +08:00
Hawk Lee 73244a7336 fix: Revert Partial Reset to recover lip sync accuracy (sacrificing smooth head motion) 2026-01-21 20:51:26 +08:00
Hawk Lee 12c56c0754 fix: Implement Partial Reset (preserve Pose, reset Exp/Seed) to prevent head snap at speech onset 2026-01-21 20:40:46 +08:00
Hawk Lee 7f0ac8e6a8 feat: Tune blink rates to slower human average (10-20bpm / 4-6s interval) 2026-01-21 18:12:49 +08:00
Hawk Lee b7da1a19cd fix: Set blink hold duration to fixed 1 frame 2026-01-21 17:57:05 +08:00
Hawk Lee cb413354ed feat: Disable Double Blink by default and confirm blink hold duration 2026-01-21 17:55:37 +08:00
Hawk Lee eb96aaa966 style: Reduce blink hold duration to 1-3 frames for sharper blink 2026-01-21 17:47:34 +08:00
Hawk Lee 0f75bdde56 feat: Implement Blink Hold logic to extend closed-eye duration for more natural realism 2026-01-21 17:24:30 +08:00
Hawk Lee ae30694c74 style: Refine blink parameters (lower double blink prob, increase gap) for smoother look 2026-01-21 17:21:25 +08:00
Hawk Lee a6faa43b3a feat: Implement Dynamic Blink Rate based on VAD (Fast during speech, Slow during silence) 2026-01-21 17:16:55 +08:00
Hawk Lee a751dd3ac6 feat: Implement Double Blink logic with randomized interval for natural eye motion 2026-01-21 17:08:31 +08:00
Hawk Lee 5320d5048b fix: Implement RNG Seed Reset on Speech Onset to ensure diffusion noise consistency and lip sync accuracy 2026-01-21 16:44:50 +08:00
Hawk Lee bf2958b021 fix: Initialize do_reset default value to prevent UnboundLocalError 2026-01-21 16:19:36 +08:00
Hawk Lee aeb28f246d fix: Implement Exact Onset Alignment via Variable Step Length to perfectly mimic Clean Start conditions and eliminate jitter 2026-01-21 16:03:07 +08:00
Hawk Lee a607adaca0 fix: Reset clip_idx to 0 on onset reset to enforce exact First Segment conditions 2026-01-21 15:29:26 +08:00
Hawk Lee 407ae60571 fix: Implement Duration-Based Onset Reset (min 15 frames) to avoid over-resetting on breaths 2026-01-21 14:49:07 +08:00
Hawk Lee 50eefd636f fix: Robust Sub-Chunk Speech Onset Detection to fix reset failure in short silence gaps 2026-01-21 14:40:24 +08:00
Hawk Lee 6b65b228e3 fix: Disable inner 'dit' tqdm to prevent console log conflict 2026-01-21 14:30:03 +08:00
Hawk Lee 307e027807 fix: Implement Speech Onset Hard Reset to eliminate drift at speech start 2026-01-21 14:13:47 +08:00
Hawk Lee c90a0948f9 fix: Switch from Hard Reset to Soft Reset (50%) to dampen drift without oscillation 2026-01-21 14:01:34 +08:00
Hawk Lee a1f511f9d3 fix: Use getattr for vad_timeline to prevent AttributeError on cached SDK instances 2026-01-21 13:49:19 +08:00
Hawk Lee 5a45e66907 fix: Implement Hard State Reset for Auto-Correction of LMDM Drift during silence 2026-01-21 13:44:13 +08:00
Hawk Lee cdd1581a0d feat: Implement VAD-Triggered LMDM State Reset to clear accumulated drift during silences 2026-01-21 12:56:15 +08:00
Hawk Lee 42e78d72ce fix: Audio2Motion smoothing applied to wrong range (only seam), causing jittery motion on long clips 2026-01-21 12:37:45 +08:00
Hawk Lee 881bae2742 feat: Refine VAD to preserve blinks/head motion and force INFO logging 2026-01-21 09:47:45 +08:00
Hawk Lee cd0a8d23b5 feat: Add VAD-based silence handling and Blink rate control for Ditto 2026-01-21 01:46:04 +08:00
Hawk Lee ff1fc6f0e1 feat: Add mouth_amp parameter to dampen mouth motion 2026-01-20 22:38:49 +08:00
Hawk Lee 43d8ca61f8 chore: Remove debug prints after verifying fix for ONNX warnings 2026-01-20 22:00:04 +08:00
Hawk Lee 1caf769fc6 fix: Explicitly inject input_size into underlying model instance 2026-01-20 21:57:13 +08:00
Hawk Lee 1f0a35f3ee fix: debug print for module loading path 2026-01-20 21:55:03 +08:00