Allow changing T5 in extra_model_paths

2024-05-06 16:36:38 +02:00
parent 47758b848b
commit 77d92abf1c
2 changed files with 6 additions and 2 deletions
@@ -136,6 +136,8 @@ For faster loading/smaller file sizes, you may pick one of the following alterna
 - [FP16 converted version](https://huggingface.co/theunlikely/t5-v1_1-xxl-fp16/tree/main) - Same layout as the original, download both safetensor files as well as the `*.index.json` and `config.json` files.
 - [BF16 converter version](https://huggingface.co/city96/t5-v1_1-xxl-encoder-bf16/tree/main) - Merged into a single safetensor, only `model.safetensors` (+`config.json` for folder mode) are reqired.

+To move T5 to a different drive/folder, do the same as you would when moving checkpoints, but add `    t5: t5` to `extra_model_paths.yaml` and create a directory called "t5" in the alternate path specified in the `base_path` variable.
+
 ### Usage

 Loaded onto the CPU, it'll use about 22GBs of system RAM. Depending on which weights you use, it might use slightly more during loading.