bartowski
/

DeepSeek-Coder-V2-Lite-Instruct-GGUF

Text Generation

Model card Files Files and versions

DeepSeek-Coder-V2-Lite-Instruct-GGUF

270 GB

1 contributor

History: 9 commits

bartowski's picture

Update README.md

8f248fa verified over 1 year ago

DeepSeek-Coder-V2-Lite-Instruct-f32.gguf
Upload folder using huggingface_hub over 1 year ago
.gitattributes

3.61 kB

Rename DeepSeek-Coder-V2-Lite-Instruct-Q8_1.gguf to DeepSeek-Coder-V2-Lite-Instruct-Q8_0_L.gguf over 1 year ago
DeepSeek-Coder-V2-Lite-Instruct-IQ2_M.gguf

6.33 GB
xet

Llamacpp quants over 1 year ago
DeepSeek-Coder-V2-Lite-Instruct-IQ2_S.gguf

6.01 GB
xet

Llamacpp quants over 1 year ago
DeepSeek-Coder-V2-Lite-Instruct-IQ2_XS.gguf

5.97 GB
xet

Llamacpp quants over 1 year ago
DeepSeek-Coder-V2-Lite-Instruct-IQ3_M.gguf

7.55 GB
xet

Llamacpp quants over 1 year ago
DeepSeek-Coder-V2-Lite-Instruct-IQ3_XS.gguf

7.12 GB
xet

Llamacpp quants over 1 year ago
DeepSeek-Coder-V2-Lite-Instruct-IQ3_XXS.gguf

6.96 GB
xet

Llamacpp quants over 1 year ago
DeepSeek-Coder-V2-Lite-Instruct-IQ4_XS.gguf

8.57 GB
xet

Llamacpp quants over 1 year ago
DeepSeek-Coder-V2-Lite-Instruct-Q2_K.gguf

6.43 GB
xet

Llamacpp quants over 1 year ago
DeepSeek-Coder-V2-Lite-Instruct-Q3_K_L.gguf

8.46 GB
xet

Llamacpp quants over 1 year ago
DeepSeek-Coder-V2-Lite-Instruct-Q3_K_M.gguf

8.13 GB
xet

Llamacpp quants over 1 year ago
DeepSeek-Coder-V2-Lite-Instruct-Q3_K_S.gguf

7.49 GB
xet

Llamacpp quants over 1 year ago
DeepSeek-Coder-V2-Lite-Instruct-Q4_K_L.gguf

10.9 GB
xet

Llamacpp quants over 1 year ago
DeepSeek-Coder-V2-Lite-Instruct-Q4_K_M.gguf

10.4 GB
xet

Llamacpp quants over 1 year ago
DeepSeek-Coder-V2-Lite-Instruct-Q4_K_S.gguf

9.53 GB
xet

Llamacpp quants over 1 year ago
DeepSeek-Coder-V2-Lite-Instruct-Q5_K_L.gguf

12.4 GB
xet

Llamacpp quants over 1 year ago
DeepSeek-Coder-V2-Lite-Instruct-Q5_K_M.gguf

11.9 GB
xet

Llamacpp quants over 1 year ago
DeepSeek-Coder-V2-Lite-Instruct-Q5_K_S.gguf

11.1 GB
xet

Llamacpp quants over 1 year ago
DeepSeek-Coder-V2-Lite-Instruct-Q6_K.gguf

14.1 GB
xet

Llamacpp quants over 1 year ago
DeepSeek-Coder-V2-Lite-Instruct-Q6_K_L.gguf

14.6 GB
xet

Llamacpp quants over 1 year ago
DeepSeek-Coder-V2-Lite-Instruct-Q8_0.gguf

16.7 GB
xet

Llamacpp quants over 1 year ago
DeepSeek-Coder-V2-Lite-Instruct-Q8_0_L.gguf

17.1 GB
xet

Rename DeepSeek-Coder-V2-Lite-Instruct-Q8_1.gguf to DeepSeek-Coder-V2-Lite-Instruct-Q8_0_L.gguf over 1 year ago
DeepSeek-Coder-V2-Lite-Instruct.imatrix

38.4 MB
xet

Llamacpp quants over 1 year ago
README.md

9.12 kB

Update README.md over 1 year ago