I was having trouble with other quants of this model, so I made my own. imatrix Q5K_S.
Overall, a great model which I now use over my previous Phr00tyMixes for creativity and brains. However, the Phr00tyMixes might still be better for erotic roleplay, as many of the Qwen 2.5 finetunes included train with that material.
You can find an mmproj here: https://huggingface.co/n0kovo/Qwen3-VL-32B-Instruct-heretic-v2-Q4_K_M-GGUF/tree/main
- Downloads last month
- -
Hardware compatibility
Log In
to view the estimation
We're not able to determine the quantization variants.
Model tree for Phr00t/Qwen3-VL-32B-Instruct-heretic-v2-iQ5KS-GGUF
Base model
n0kovo/Qwen3-VL-32B-Instruct-heretic-v2