RandNMR73
d2e091150a
revert
2025-10-02 04:31:59 +00:00
RandNMR73
920184403f
encoder_hidden_states fix
2025-10-02 03:52:07 +00:00
RandNMR73
d016119f2e
fix wan 2.2 self forcing script
2025-10-02 03:42:50 +00:00
SolitaryThinker
066118dada
fix shape
2025-10-02 03:10:29 +00:00
RandNMR73
a547fc1005
clean up
2025-10-02 01:11:58 +00:00
RandNMR73
f27e28ad87
fix datatype?
2025-10-01 21:26:44 +00:00
RandNMR73
2b8e695721
remove deprecated tests
2025-10-01 20:32:28 +00:00
RandNMR73
6d28a05a1c
.
2025-10-01 09:28:26 +00:00
RandNMR73
b55a78be3c
.
2025-10-01 09:25:22 +00:00
RandNMR73
f468651f4e
.
2025-10-01 09:16:32 +00:00
RandNMR73
6b0f456d6f
self-forcing test
2025-10-01 09:07:15 +00:00
RandNMR73
63eeef039d
remove training script
2025-10-01 08:01:23 +00:00
RandNMR73
133533adb4
clean
2025-10-01 07:58:50 +00:00
RandNMR73
abdd8c851d
clean up
2025-10-01 05:57:01 +00:00
RandNMR73 and gemini-code-assist[bot]
d03eacc1c6
Update wan2.2_train.sh
...
Co-authored-by: gemini-code-assist[bot] <176961590+gemini-code-assist[bot]@users.noreply.github.com>
2025-09-30 22:22:00 -07:00
RandNMR73 and gemini-code-assist[bot]
03747310c6
Update examples/distill/SFWan2.2-A14B/distill_dmd.sh
...
Co-authored-by: gemini-code-assist[bot] <176961590+gemini-code-assist[bot]@users.noreply.github.com>
2025-09-30 22:21:46 -07:00
RandNMR73
a444862561
cleanup + torch.compile training support
2025-09-27 01:40:57 +00:00
RandNMR73
e9802cc5f2
make EMA consistent + clean up SF pipeline
2025-09-26 23:28:10 +00:00
RandNMR73
6ff7686a9d
make EMA and training utils MoE compatible
2025-09-26 20:49:07 +00:00
RandNMR73
92d3ce1612
training works with gradient checkpointing but config has issues
2025-09-26 11:48:07 +00:00
RandNMR73
2b9d8e91b5
gradient checkpointing bug
2025-09-26 08:49:34 +00:00
SolitaryThinker
b666de819a
add init from safetensor for transformer_2
2025-09-26 07:48:59 +00:00
RandNMR73
2df82f0ee4
training not broken
2025-09-26 04:05:14 +00:00
RandNMR73
4f45b6e515
fix hang
2025-09-25 21:01:13 +00:00
SolitaryThinker
4c11512cde
debug
2025-09-25 04:11:51 +00:00
SolitaryThinker
32a820c735
fix val
2025-09-24 04:44:22 +00:00
SolitaryThinker
d6165981b4
offload dit in training
2025-09-24 00:51:41 +00:00
SolitaryThinker
db2e2d79ca
fix rebase
2025-09-23 22:26:20 +00:00
RandNMR73
aabf1fe135
inference works after changes added
...
new branch
Stop backprop through kv_cache
Enable timestep warping & using SelfForcing scheduler
checkpoint
text preprocessing ready
fix rotary embedding
Change Wan DiT to have 0 numerical diff with SF's Wan
wan2.2 training doesn't crash
training hangs
2025-09-23 22:20:29 +00:00
William Lin
404cbf4f3c
[self-forcing] [6/n] Add Ode Init training ( #811 )
2025-09-22 17:58:19 -07:00
William Lin
958ffec844
[bugfix] Update learning rates for sparse distillation recipe ( #812 )
2025-09-22 12:07:03 -07:00
31f000d1cc
[self-forcing] [5/n] Add Self-Forcing distillation pipeline ( #808 )
...
Co-authored-by: RandNMR73 <notomatthew31@gmail.com >
Co-authored-by: SolitaryThinker <wlsaidhi@gmail.com >
2025-09-20 19:32:10 -07:00
Yongqi Chen
cd32b3e02f
Update example files and readme ( #809 )
2025-09-20 18:15:59 -07:00
Zhang Peiyuan
bf27908095
Update WeChat Link
2025-09-20 14:16:20 -07:00
William Lin
c5f9ea53b2
[self-forcing] [4/n] Preprocessing for collecting ODE trajectory ( #788 )
2025-09-15 17:54:42 -07:00
William Lin
d32a7184da
[bugfix] Wan2.2 Boundary ratio ( #804 )
2025-09-15 11:17:35 -07:00
Wenxuan Tan and gemini-code-assist[bot]
2930abe456
[Bugfix] Fix VMoba requirements ( #802 )
...
Co-authored-by: gemini-code-assist[bot] <176961590+gemini-code-assist[bot]@users.noreply.github.com>
2025-09-14 18:28:52 -07:00
William Lin
b93ef4289d
[bugfix] Fix empty PipelineConfigs for Wan2.2 A14B ( #800 )
2025-09-13 17:31:38 -07:00
401bdbd316
[self-forcing] [3/n] Text embed only preprocessing ( #797 )
...
Co-authored-by: RandNMR73 <notomatthew31@gmail.com >
Co-authored-by: JerryZhou54 <zhouw.jerry2017@outlook.com >
Co-authored-by: kevin314 <kevin.lin.cs1@gmail.com >
2025-09-13 14:03:53 -07:00
William Lin
1048d79cf8
[bugfix] pin gradio version and set current_vsa_sparsity in TrainingPipeline ( #798 )
2025-09-11 17:04:47 -07:00
1e8406162d
[bugfix] Fix delta calculation ( #796 )
...
Co-authored-by: zbchu2 <zbchu2@iflytek.com >
Co-authored-by: William Lin <SolitaryThinker@users.noreply.github.com >
2025-09-11 16:31:23 -07:00
William Lin
03edd35c83
[preprocessing] [self-forcing] [2/n] Improve preprocessing and add ode trajectory dataset schema ( #794 )
2025-09-10 17:33:57 -07:00
William Lin and RandNMR73
ac11127397
[Self-forcing] [1/n] Handle extra dim in time embedding and add timestep warping ( #792 )
...
Co-authored-by: RandNMR73 <notomatthew31@gmail.com >
2025-09-09 02:52:02 -07:00
Eric Liang and EricLiang
e028dcc7c0
[Backend][Vmoba] Add implementation of VMoba ( #778 )
...
Co-authored-by: EricLiang <https://github.com/EricLina >
2025-09-08 23:53:25 -07:00
Wenxuan Tan and gemini-code-assist[bot]
076f45c1ee
[Feature] Support Lora for DMD ( #755 )
...
Co-authored-by: gemini-code-assist[bot] <176961590+gemini-code-assist[bot]@users.noreply.github.com>
2025-09-08 14:18:21 -07:00
85eb7265db
fix: lora_B init zeros ( #781 )
...
Co-authored-by: zbchu2 <zbchu2@iflytek.com >
Co-authored-by: Wenxuan Tan <wenxuan.tan@wisc.edu >
2025-09-05 22:56:52 -07:00
William Lin
d3ceb67e66
[misc] Update Slack invite link ( #786 )
2025-09-05 12:16:18 -07:00
Zhang Peiyuan
7ac153a5ca
Update WeChat Link
2025-09-05 11:40:47 -07:00
William Lin
d1e7aa0abd
[CI] Add ssim test for causal inference ( #784 )
2025-09-05 01:23:01 -07:00
William Lin
2d846c55a1
[misc] Improve text encoding stage ( #774 )
2025-09-04 17:51:27 -07:00
RandNMR73