Commit Graph
20 Commits
Author SHA1 Message Date
xander e1813c75d1 updates to avoid OOM when plotting hist 2024-07-06 22:18:47 +02:00
xander fdd531d3c5 fix full finetuning and add 8bitadam 2024-07-06 17:42:49 +02:00
xander d8b3175b57 cleanup before sd3 integration 2024-06-13 13:57:20 +02:00
xander 7d78a3d76d updates 2024-04-29 19:37:45 +02:00
xander 39ee9c9630 set defaults 2024-04-27 16:47:35 +02:00
xander 2e5912f629 improve token regularization 2024-04-26 13:32:01 +02:00
aiXander b48419247a refactor token regularization 2024-04-22 19:08:36 -07:00
aiXander 4d9f8c2e67 more tweaks 2024-04-22 12:22:20 -07:00
xander 41b7895bff add unet_prodigy_growth_factor 2024-04-22 14:36:04 +02:00
aiXander ccaeab8e71 freeze_ti param, save txt-encoder loras into savetensors file 2024-04-19 04:57:59 -07:00
aiXander 25c9afe587 small tweaks 2024-04-18 07:28:12 -07:00
aiXander 527f075d7a add debug to lr tracking 2024-04-18 07:19:27 -07:00
aiXander a5b7621732 cleanup optimizers class and add learning rate tracking 2024-04-18 07:15:23 -07:00
mayukhdeb b4891984aa fix bug where textual inversion was disabling grads for text encoder lora 2024-04-18 05:51:35 -07:00
xander aaf090c2e8 fix save/load bug 2024-04-16 21:57:10 +02:00
mayukhdeb 29d62cd705 offload unet optimizer selection 2024-04-16 07:27:00 -07:00
mayukhdeb fd0c8cde12 offload unet lora param stuff 2024-04-16 06:08:12 -07:00
mayukhdeb fcc569c0a6 offload textual inversion stuff 2024-04-16 05:26:35 -07:00
mayukhdeb 7a70c18c05 offload text encoder lora peft stuff into functions 2024-04-16 01:15:36 -07:00
mayukhdeb 4385a55a23 keep all optimizers in one place 2024-04-15 00:25:26 -07:00