From fb7b7ff683292cf62006f9cb8272c6fd4416618d Mon Sep 17 00:00:00 2001 From: Zuellni <123005779+Zuellni@users.noreply.github.com> Date: Sun, 7 Apr 2024 20:00:44 +0200 Subject: [PATCH] Update readme --- README.md | 4 ++-- 1 file changed, 2 insertions(+), 2 deletions(-) diff --git a/README.md b/README.md index abc5086..a6fe1d6 100644 --- a/README.md +++ b/README.md @@ -40,12 +40,12 @@ git clone https://huggingface.co/LoneStriker/Mistral-7B-Instruct-v0.2-5.0bpw-h6- cache_bits - Lowers VRAM usage as well as generation speed. + Lower value equals lower VRAM usage but also impacts generation speed. max_seq_len - Max context, higher number equals higher VRAM usage. 0 will default to config. + Max context, higher value equals higher VRAM usage. 0 will default to config. Generator