nodes/edenartlab-sd-lora-trainer
1
0
Fork 0
Code Issues Pull Requests Packages Projects Releases Wiki Activity
257 Commits 4 Branches 0 Tags
b2080da7c8a221c23b549fbecc1c649da49dfd7c
Commit Graph
257 Commits
This Branch
This Branch
All Branches
Author SHA1 Message Date
aiXander b2080da7c8 cleanup checkpoint 2024-04-19 05:08:47 -07:00
aiXander 13733a4f19 Merge branch 'main' of https://github.com/edenartlab/trainer into main 2024-04-19 04:58:09 -07:00
aiXander ccaeab8e71 freeze_ti param, save txt-encoder loras into savetensors file 2024-04-19 04:57:59 -07:00
mayukhdeb b568c0c283 load ;checkpoint from disk once training is complete 2024-04-19 04:55:02 -07:00
mayukhdeb c071905658 black formatting 2024-04-19 02:31:43 -07:00
aiXander d1d8eb125e fix 2024-04-19 01:41:28 -07:00
aiXander ea67904a9a simplify 2024-04-19 01:39:43 -07:00
aiXander 909e1c0b10 update defaults 2024-04-18 09:23:47 -07:00
aiXander d573407319 update default configs 2024-04-18 09:12:56 -07:00
aiXander 6f5253c1d4 all seems to work 2024-04-18 08:36:14 -07:00
aiXander f5a1de5ffe move token warmup to before lora init 2024-04-18 07:54:38 -07:00
aiXander 6470658e08 fix txt encoder grads 2024-04-18 07:51:43 -07:00
aiXander 2af80788ca fix txt gradients 2024-04-18 07:50:39 -07:00
aiXander 284b934567 fix typo 2024-04-18 07:30:35 -07:00
aiXander 25c9afe587 small tweaks 2024-04-18 07:28:12 -07:00
aiXander 527f075d7a add debug to lr tracking 2024-04-18 07:19:27 -07:00
aiXander a5b7621732 cleanup optimizers class and add learning rate tracking 2024-04-18 07:15:23 -07:00
mayukhdeb 6a6b5df282 accomodate case when optimizer.optimizer_textual_inversion is None and fix incorrect indent 2024-04-18 05:52:06 -07:00
mayukhdeb b4891984aa fix bug where textual inversion was disabling grads for text encoder lora 2024-04-18 05:51:35 -07:00
xander 9ac8d69bfc add experiments for debugging 2024-04-17 18:48:49 +02:00
xander 223969ed84 add std info to plots, change some defaults 2024-04-17 15:52:46 +02:00
xander 57d5b6b762 merge 2024-04-17 14:37:34 +02:00
xander 2a7c53a0c4 updates 2024-04-17 14:36:53 +02:00
mayukhdeb 4f64882f11 remove validation_prompts_raw overwrting 2024-04-17 05:35:12 -07:00
mayukhdeb 1bd9e875fc switch to the new load fn 2024-04-17 05:34:21 -07:00
mayukhdeb bcaccf01c9 new example command 2024-04-17 05:34:01 -07:00
mayukhdeb 0bd726b6be unified save and load functions 2024-04-17 05:33:50 -07:00
mayukhdeb cde4432588 cleaner checkpoint saving WIP 2024-04-17 04:56:34 -07:00
xander aaf090c2e8 fix save/load bug 2024-04-16 21:57:10 +02:00
xander 5181bbdff6 updates to test ti 2024-04-16 21:41:20 +02:00
mayukhdeb 29d62cd705 offload unet optimizer selection 2024-04-16 07:27:00 -07:00
mayukhdeb 9a985de529 better error message 2024-04-16 07:26:38 -07:00
mayukhdeb fd0c8cde12 offload unet lora param stuff 2024-04-16 06:08:12 -07:00
mayukhdeb fcc569c0a6 offload textual inversion stuff 2024-04-16 05:26:35 -07:00
mayukhdeb 7a70c18c05 offload text encoder lora peft stuff into functions 2024-04-16 01:15:36 -07:00
mayukhdeb a4a4d9aaa3 fix indentation bug on text encoder lora params 2024-04-16 00:54:04 -07:00
xander c4ea271482 fix textual_inversion bug 2024-04-16 03:22:10 +02:00
xander 66b34b312e merge 2024-04-16 01:12:24 +02:00
xander 0f9f5a7009 tiny changes 2024-04-16 01:11:28 +02:00
aiXander b8c668822b setup for gridsearch 2024-04-15 16:10:36 -07:00
aiXander 85b86f3667 remove trainable embeddings from print 2024-04-15 08:36:18 -07:00
aiXander 8d58e312ed update deps 2024-04-15 08:05:52 -07:00
aiXander a4b8149ff3 update README 2024-04-15 02:09:11 -07:00
mayukhdeb 4385a55a23 keep all optimizers in one place 2024-04-15 00:25:26 -07:00
mayukhdeb de0d8a8a41 potential fix on the bug where embedding grads were None when text encoder lora == adamw 2024-04-14 11:57:39 -07:00
aiXander b9a315bb98 try to debug bug issue 2024-04-14 11:20:47 -07:00
aiXander c788afa996 try to debug bug issue 2024-04-14 11:07:49 -07:00
aiXander e606340c56 update defaults 2024-04-14 08:09:33 -07:00
mayukhdeb 08c7394677 add new args 2024-04-11 23:04:08 -07:00
mayukhdeb 54ba9492bc auto download checkpoints 2024-04-11 23:01:16 -07:00