From ac32365b70e03e86e027285efa1435ce8f4edd58 Mon Sep 17 00:00:00 2001 From: SeanScripts <64337075+SeanScripts@users.noreply.github.com> Date: Wed, 25 Sep 2024 04:11:41 -0700 Subject: [PATCH] Add link to NF4 model --- README.md | 3 +++ 1 file changed, 3 insertions(+) diff --git a/README.md b/README.md index 616792e..e05055e 100644 --- a/README.md +++ b/README.md @@ -10,4 +10,7 @@ Requires transformers 4.45.0 Also install bitsandbytes if you don't have it already: `python_embeded\python.exe -m pip install bitsandbytes` +You can get a 4-bit quantized version of Pixtral-12B which is compatible with these custom nodes here: +[https://huggingface.co/SeanScripts/pixtral-12b-nf4] + ![Example workflow](pixtral_caption_example.jpg)