Add link to NF4 model

2024-09-25 04:11:41 -07:00
parent 32676076d5
commit ac32365b70
1 changed files with 3 additions and 0 deletions
@@ -10,4 +10,7 @@ Requires transformers 4.45.0
 Also install bitsandbytes if you don't have it already:
 `python_embeded\python.exe -m pip install bitsandbytes`

+You can get a 4-bit quantized version of Pixtral-12B which is compatible with these custom nodes here:
+[https://huggingface.co/SeanScripts/pixtral-12b-nf4]
+
 ![Example workflow](pixtral_caption_example.jpg)