diff --git a/README.md b/README.md index abc5086..a6fe1d6 100644 --- a/README.md +++ b/README.md @@ -40,12 +40,12 @@ git clone https://huggingface.co/LoneStriker/Mistral-7B-Instruct-v0.2-5.0bpw-h6- cache_bits - Lowers VRAM usage as well as generation speed. + Lower value equals lower VRAM usage but also impacts generation speed. max_seq_len - Max context, higher number equals higher VRAM usage. 0 will default to config. + Max context, higher value equals higher VRAM usage. 0 will default to config. Generator