YAML Metadata Warning: empty or missing yaml metadata in repo card (https://huggingface.co/docs/hub/model-cards#model-card-metadata)
g0t4/ByteDance-Seed-Coder-8B-Instruct-GGUF
Based on https://huggingface.co/ByteDance-Seed/Seed-Coder-8B-Instruct
GGUF Conversion
python convert_hf_to_gguf.py --remote ByteDance-Seed/Seed-Coder-8B-Instruct \
--outtype f16 --outfile ByteDance-Seed-Coder-8B-Instruct-f16.gguf
./build/bin/llama-quantize ByteDance-Seed-Coder-8B-Instruct-f16.gguf ByteDance-Seed-Coder-8B-Instruct-Q8_0.gguf Q8_0
./build/bin/llama-quantize ByteDance-Seed-Coder-8B-Instruct-f16.gguf ByteDance-Seed-Coder-8B-Instruct-Q4_K_M.gguf Q4_K_M
hf upload ByteDance-Seed-Coder-8B-Instruct-GGUF .
- Downloads last month
- 14
Hardware compatibility
Log In to add your hardware
4-bit
8-bit
16-bit
Inference Providers NEW
This model isn't deployed by any Inference Provider. 🙋 Ask for provider support