xander
|
e1813c75d1
|
updates to avoid OOM when plotting hist
|
2024-07-06 22:18:47 +02:00 |
|
xander
|
fdd531d3c5
|
fix full finetuning and add 8bitadam
|
2024-07-06 17:42:49 +02:00 |
|
xander
|
d8b3175b57
|
cleanup before sd3 integration
|
2024-06-13 13:57:20 +02:00 |
|
xander
|
7d78a3d76d
|
updates
|
2024-04-29 19:37:45 +02:00 |
|
xander
|
39ee9c9630
|
set defaults
|
2024-04-27 16:47:35 +02:00 |
|
xander
|
2e5912f629
|
improve token regularization
|
2024-04-26 13:32:01 +02:00 |
|
aiXander
|
b48419247a
|
refactor token regularization
|
2024-04-22 19:08:36 -07:00 |
|
aiXander
|
4d9f8c2e67
|
more tweaks
|
2024-04-22 12:22:20 -07:00 |
|
xander
|
41b7895bff
|
add unet_prodigy_growth_factor
|
2024-04-22 14:36:04 +02:00 |
|
aiXander
|
ccaeab8e71
|
freeze_ti param, save txt-encoder loras into savetensors file
|
2024-04-19 04:57:59 -07:00 |
|
aiXander
|
25c9afe587
|
small tweaks
|
2024-04-18 07:28:12 -07:00 |
|
aiXander
|
527f075d7a
|
add debug to lr tracking
|
2024-04-18 07:19:27 -07:00 |
|
aiXander
|
a5b7621732
|
cleanup optimizers class and add learning rate tracking
|
2024-04-18 07:15:23 -07:00 |
|
mayukhdeb
|
b4891984aa
|
fix bug where textual inversion was disabling grads for text encoder lora
|
2024-04-18 05:51:35 -07:00 |
|
xander
|
aaf090c2e8
|
fix save/load bug
|
2024-04-16 21:57:10 +02:00 |
|
mayukhdeb
|
29d62cd705
|
offload unet optimizer selection
|
2024-04-16 07:27:00 -07:00 |
|
mayukhdeb
|
fd0c8cde12
|
offload unet lora param stuff
|
2024-04-16 06:08:12 -07:00 |
|
mayukhdeb
|
fcc569c0a6
|
offload textual inversion stuff
|
2024-04-16 05:26:35 -07:00 |
|
mayukhdeb
|
7a70c18c05
|
offload text encoder lora peft stuff into functions
|
2024-04-16 01:15:36 -07:00 |
|
mayukhdeb
|
4385a55a23
|
keep all optimizers in one place
|
2024-04-15 00:25:26 -07:00 |
|