mradermacher

/

model_requests

like 125

It's queued! :D

You can check for progress at http://hf.tst.eu/status.html or regularly check the model
summary page at https://hf.tst.eu/model#L3.1-Apluv3-8B-GGUF for quants to appear.

Hi. I know this model has a closed repository, but if possible, could you please make BF16 and FP16 quantizations? Thanks for your hard work.

Luckily it was one of that gated models that auto accept you. FP16 quantization should always be provided automatically for such small models. BF16 I will try to add once it is done.

@nicoboss , Do you know your way around sampler settings? I've been tweaking them for a long time, and the screenshot shows what I've come up with so far (although I will still be editing this configuration). But I think it can be tuned even better.