30 Commits
Author SHA1 Message Date
kijai a15cfb181a sd35 support and updates from upstream 2024-12-04 12:24:29 +02:00
kijai 3ba4c14e53 Updates from upstream: model detection, better full finetune block swap, update prodigyplusschedulefree 2024-11-29 13:40:30 +02:00
kijai b8fe91abdd Expose more options for ProdigyPlusScheduleFree 2024-11-21 02:02:38 +02:00
kijai f9d3824c8a Add schedulerfree optimizers 2024-09-19 16:33:56 +03:00
kijai 0419754233 Update train_network.py 2024-09-14 09:21:17 +03:00
kijai 94ae756b5e add ability to set clip and T5 LR separately 2024-09-11 02:06:24 +03:00
kijai 1d2e4c225f bugfix 2024-09-09 00:36:21 +03:00
kijai 2c41f44ef0 Merge branch 'train_t5' 2024-09-08 23:31:29 +03:00
kijai 1c70cce963 support fp8 e5m2 2024-09-07 18:27:02 +03:00
kijai cd8e756103 pbar fixes 2024-09-07 02:41:09 +03:00
kijai c6de455381 block select 2024-09-07 02:15:42 +03:00
kijai 77587e0193 cpu_offload_checkpointing 2024-09-05 16:17:11 +03:00
kijai 0d1d93931f cpu_offload_checkpointing 2024-09-05 15:58:17 +03:00
kijai 38d3d9ddf6 initial T5 training 2024-09-04 18:50:27 +03:00
kijai 19a77d835f Use relative nework module import to avoid conflicts 2024-09-01 18:42:18 +03:00
kijai 8d19121517 possible resume fix 2024-09-01 16:19:17 +03:00
kijai 7095626d6a fix the ability to disable fp8_base 2024-08-31 16:50:18 +03:00
kijai 66749c8772 clip training 2024-08-29 12:48:33 +03:00
kijai 07762fb4f0 expose mask, resume
resume doesn't seem functional in kohya for Flux yet
2024-08-27 12:21:11 +03:00
kijai a559358ac8 revert to kohya's multires training 2024-08-20 19:52:33 +03:00
kijai d07378a99d updates 2024-08-20 16:34:46 +03:00
kijai 2cd3c8e170 fix loss visualizer, and other small stuff 2024-08-19 02:51:19 +03:00
kijai fdcb5a8686 pbar 2024-08-18 22:03:33 +03:00
kijai c8be524730 updates 2024-08-18 02:10:18 +03:00
kijai 7678caf9c7 multiple max bucket resos 2024-08-17 15:59:32 +03:00
kijai dc20750105 fixes 2024-08-16 12:17:11 +03:00
kijai 9c41eb50a3 continue 2024-08-16 00:42:10 +03:00
Kijai 7f5ca3c809 updates 2024-08-15 17:38:31 +03:00
kijai 00fee231dd rename stuff 2024-08-15 11:47:31 +03:00
kijai 596149fc8d init 2024-08-15 11:32:11 +03:00