AetherArchitectural/GGUF-Quantization-Script
Text Generation • Updated
• 69
Useful
Handy tools and repositories for various uses.
Note Simple python script to generate various GGUF-IQ-Imatrix quantizations from a Hugging Face author/model input, for Windows and NVIDIA hardware.