Quantized DeepSeek models
1881 GGUF / AWQ / GPTQ versions. These are what you run on your own hardware — full precision DeepSeek V3 needs 671B parameters, a quantized 7B distill fits on a laptop.
| Model | Base | Method | Downloads | Likes | Commercial | License |
|---|---|---|---|---|---|---|
| DeepSeek-R1-Distill-Qwen-32B-AWQ MS | Valdemardi | Quantized, Distilled | 5.1M | 24 | ✓ | apache-2.0 |
| DeepSeek-R1-Distill-Qwen-32B-GPTQ-Int4 MS | tclf90 | Quantized, Distilled | 4.7M | 21 | ✓ | qwen |
| DeepSeek-R1-GGUF MS | unsloth | Quantized | 4.3M | 146 | ✓ | mit |
| deepseek-v4.1-flash-gguf HF | DeepSeek-V4.1-Flash | Quantized | 1.2M | 91 | ? | 未声明 |
| DeepSeek-R1-Distill-Qwen-7B-GGUF MS | unsloth | Quantized, Distilled | 686.6K | 166 | ✓ | apache-2.0 |
| DeepSeek-R1-Distill-Qwen-32B-QMind-GGUF MS | xitaosun | Quantized, Distilled | 617.3K | — | ✓ | MIT License |
| DeepSeek-R1-Distill-Qwen-1.5B-GGUF MS | unsloth | Quantized, Distilled | 543.5K | 99 | ✓ | apache-2.0 |
| DeepSeek-R1-Distill-Qwen-32B-GPTQ-Int8 MS | tclf90 | Quantized, Distilled | 476.1K | 7 | ✓ | qwen |
| DeepSeek-R1-Distill-Qwen-7B-Int4-W4A16 量 MS | okwinds | Quantized, Distilled | 375.0K | 7 | ✓ | Apache License 2.0 |
| DeepSeek-R1-Distill-Qwen-14B-GPTQ-Int4 MS | tclf90 | Quantized, Distilled | 303.5K | 6 | ✓ | qwen |
| DeepSeek-V3-GGUF MS | unsloth | Quantized | 151.1K | 29 | ✓ | mit |
| DeepSeek-R1-Distill-Qwen-7B-GGUF HF | DeepSeek-R1-Distill-Qwen-7 | Quantized, Distilled | 141.7K | 149 | ? | 未声明 |
| CodeFuse-DeepSeek-33B-4bits MS | codefuse-ai | Quantized | 122.9K | 5 | ✗ | other |
| DeepSeek-R1-Distill-Qwen-1.5B-GGUF HF | DeepSeek-R1-Distill-Qwen-1 | Quantized, Distilled | 117.0K | 169 | ? | 未声明 |
| DeepSeek-R1-Distill-Qwen-14B-GGUF MS | unsloth | Quantized, Distilled | 116.4K | 95 | ✓ | apache-2.0 |
| DeepSeek-V4.1-Flash-1017-GSQ-RCO-GGUF MS | ISTA-DASLab | Quantized | 86.6K | 35 | ✓ | mit |
| DeepSeek-R1-0528-Qwen3-8B-GGUF MS | unsloth | Quantized | 85.0K | 31 | ✓ | mit |
| DeepSeek-R1-Distill-Qwen-14B-GGUF HF | DeepSeek-R1-Distill-Qwen-1 | Quantized, Distilled | 78.4K | 262 | ? | 未声明 |
| DeepSeek-R1-Distill-Qwen-32B-GGUF HF | DeepSeek-R1-Distill-Qwen-3 | Quantized, Distilled | 77.7K | 333 | ? | 未声明 |
| DeepSeek-V4-Flash-FP8 MS | sgl-project | Quantized | 77.0K | 4 | ✓ | mit |
| DeepSeek-R1-Distill-Qwen-32B-GGUF MS | unsloth | Quantized, Distilled | 73.2K | 107 | ✓ | apache-2.0 |
| DeepSeek-R1-Distill-Qwen-7B-GGUF HF | DeepSeek-R1-Distill-Qwen-7 | Quantized, Distilled | 72.5K | 112 | ? | 未声明 |
| deepseek-v4.1-flash-gguf HF | DeepSeek-V4.1-Flash | Quantized | 68.7K | 4 | ? | 未声明 |
| DeepSeek-R1-0528-GGUF MS | unsloth | Quantized | 68.1K | 14 | ✓ | mit |
| DeepSeek-V4.1-Flash-1017-GGUF MS | unsloth | Quantized | 62.3K | 31 | ✓ | mit |
| DeepSeek-V3-0324-GGUF MS | unsloth | Quantized | 62.1K | 20 | ✓ | mit |
| DeepSeek-R1-Distill-Qwen-32B-Int4-W4A16 MS | okwinds | Quantized, Distilled | 56.5K | 18 | ✓ | Apache License 2.0 |
| DeepSeek-R1-Distill-Qwen-32B-GGUF HF | DeepSeek-R1-Distill-Qwen-3 | Quantized, Distilled | 54.4K | 173 | ? | 未声明 |
| DeepSeek-V4-Flash-0731-GGUF MS | unsloth | Quantized | 53.3K | 40 | ✓ | mit |
| DeepSeek-R1-Distill-Qwen-14B-GGUF HF | DeepSeek-R1-Distill-Qwen-1 | Quantized, Distilled | 49.6K | 147 | ? | 未声明 |
| DeepSeek-V4-Flash-GGUF MS | lovedheart | Quantized | 48.3K | 5 | ✓ | MIT License |
| DeepSeek-R1-Distill-Llama-8B-GGUF MS | unsloth | Quantized, Distilled | 47.1K | 46 | ✓ | llama3.1 |
| Qwen3.5-9B-DeepSeek-V4-Flash-MTP-GGUF MS | Jackrong | Quantized | 46.8K | 10 | ✗ | other |
| DeepSeek-V4.1-Flash-1017-SF-Int8 MS | siliconflow | Quantized | 46.6K | — | ✓ | mit |
| DeepSeek-R1-Distill-Llama-8B-GGUF HF | DeepSeek-R1-Distill-Llama- | Quantized, Distilled | 44.9K | 313 | ? | 未声明 |
| DeepSeek-R1-awq MS | cognitivecomputations | Quantized | 41.1K | 26 | ✓ | mit |
| DeepSeek-R1-GGUF HF | DeepSeek-R1 | Quantized | 39.7K | 1,126 | ? | 未声明 |
| DeepSeek-R1-Distill-Qwen-1.5B-GGUF HF | DeepSeek-R1-Distill-Qwen-1 | Quantized, Distilled | 39.7K | 91 | ? | 未声明 |
| DeepSeek-V3.2-AWQ MS | QuantTrio | Quantized | 37.0K | 2 | ✓ | mit |
| DeepSeek-R1-Distill-Qwen-1.5B-Q4_K_M MS | uniontech-yourong | Quantized, Distilled | 36.9K | 1 | ✓ | Apache License 2.0 |
| DeepSeek-R1-Distill-Qwen-14B-GGUF HF | DeepSeek-R1-Distill-Qwen-1 | Quantized, Distilled | 34.5K | 50 | ? | 未声明 |
| DeepSeek-V4-Flash-0731-w4a16 MS | baicai1145 | Quantized | 33.0K | 5 | ✗ | other |
| DeepSeek-R1-Distill-Llama-70B-GGUF MS | unsloth | Quantized, Distilled | 32.7K | 27 | ✓ | llama3.3 |
| DeepSeek-R1-Distill-Llama-70B-GGUF HF | DeepSeek-R1-Distill-Llama- | Quantized, Distilled | 32.1K | 124 | ? | 未声明 |
| DeepSeek-V3.1-GGUF MS | unsloth | Quantized | 26.3K | 7 | ✓ | mit |
| siliconflow/DeepSeek-V4-Flash-0731-SF-IN MS | siliconflow | Quantized | 23.8K | — | ✓ | mit |
| DeepSeek-V4.1-Flash-GSQ-RCO-GGUF HF | DeepSeek-V4.1-Flash | Quantized | 21.7K | 22 | ? | 未声明 |
| deepseek-ai.DeepSeek-V3-0324-GGUF MS | DevQuasar | Quantized | 20.2K | — | ? | 未声明 |
| DeepSeek-V2-Chat-0628-gptq-4bit MS | LLM-Research | Quantized | 19.8K | 1 | ? | 未声明 |
| DeepSeek-V4.1-Flash-GGUF HF | DeepSeek-V4.1-Flash | Quantized | 18.8K | 44 | ? | 未声明 |
| DeepSeek-R1-Distill-Qwen-7B-GGUF HF | DeepSeek-R1-Distill-Qwen-7 | Quantized, Distilled | 17.7K | 90 | ? | 未声明 |
| DeepSeek-V3-0324-AWQ MS | cognitivecomputations | Quantized | 16.8K | 8 | ✓ | mit |
| DeepSeek-R1-Distill-Qwen-7B-GGUF MS | lmstudio-community | Quantized, Distilled | 16.2K | 28 | ? | 未声明 |
| DeepSeek-R1-Distill-Llama-8B-GGUF HF | DeepSeek-R1-Distill-Llama- | Quantized, Distilled | 16.1K | 53 | ? | 未声明 |
| Qwen3.5-9B-DeepSeek-V4-Flash-GGUF MS | Jackrong | Quantized, Distilled | 15.9K | 66 | ✓ | apache-2.0 |
| DeepSeek-R1-Distill-Qwen-32B-GGUF HF | DeepSeek-R1-Distill-Qwen-3 | Quantized, Distilled | 15.1K | 39 | ? | 未声明 |
| DeepSeek-V4-Flash-GGUF MS | unsloth | Quantized | 14.6K | 9 | ✓ | mit |
| DeepSeek-R1-Distill-Llama-70B-GGUF HF | DeepSeek-R1-Distill-Llama- | Quantized, Distilled | 14.5K | 45 | ? | 未声明 |
| DeepSeek-V4.1-Flash-ROCMFP23-GGUF HF | DeepSeek-V4.1-Flash | Quantized | 14.5K | 10 | ? | 未声明 |
| DeepSeek-V2-Lite-IMat-GGUF HF | DeepSeek-V2-Lite | Quantized | 14.5K | 5 | ? | 未声明 |
| DeepSeek-Coder-V2-Lite-Instruct-GGUF MS | AI-ModelScope | Quantized | 12.7K | 19 | ✗ | other |
| deepseek-ai_DeepSeek-V3.1-GGUF HF | DeepSeek-V3.1 | Quantized | 11.9K | 9 | ? | 未声明 |
| DeepSeek-R1-0528-Qwen3-8B-AWQ MS | tclf90 | Quantized | 11.5K | 3 | ✓ | mit |
| DeepSeek-V4.1-Flash-GGUF HF | DeepSeek-V4.1-Flash | Quantized | 10.9K | 4 | ? | 未声明 |
| DeepSeek-R1-Distill-Qwen-14B-GGUF MS | lmstudio-community | Quantized, Distilled | 10.7K | 23 | ? | 未声明 |
| DeepSeek-R1-Distill-Qwen-32B-quantized.w HF | DeepSeek-R1-Distill-Qwen-3 | Quantized, Distilled | 10.6K | 6 | ? | 未声明 |
| DeepSeek-V3.1-GGUF HF | DeepSeek-V3.1 | Quantized | 10.3K | 98 | ? | 未声明 |
| DeepSeek-V3.1-Terminus-gguf-q2ks-mixed-A MS | Intel | Quantized | 10.2K | — | ? | 未声明 |
| DeepSeek-R1-Distill-Qwen-32B-GGUF MS | lmstudio-community | Quantized, Distilled | 9.8K | 19 | ? | 未声明 |
| DeepSeek-V3-0324-GGUF-Q4_K_M MS | YanfeiSong | Quantized | 9.7K | 16 | ✓ | mit |
| DeepSeek-R1-int4-sym-gguf-q4-0-inc MS | OPEA | Quantized | 9.5K | 2 | ✓ | mit |
| DeepSeek-R1-Distill-Qwen-7B-GGUF MS | bartowski | Quantized, Distilled | 9.3K | 6 | ? | 未声明 |
| DeepSeek-V3.2-GGUF HF | DeepSeek-V3.2 | Quantized | 9.1K | 41 | ? | 未声明 |
| DeepSeek-V3.2-NVFP4 MS | nv-community | Quantized | 8.6K | 2 | ✓ | mit |
| DeepSeek-R1-Distill-Llama-70B-GGUF MS | lmstudio-community | Quantized, Distilled | 8.5K | 21 | ? | 未声明 |
| FuseO1-DeepSeekR1-QwQ-SkyT1-32B-Preview- MS | FuseAI | Quantized | 8.1K | — | ✓ | apache-2.0 |
| DeepSeek-V4-Pro-Quant-W-INT8-PerChannel- MS | T-HEAD | Quantized | 7.9K | 1 | ✓ | mit |
| DeepSeek-Coder-V2-Instruct-GGUF MS | second-state | Quantized | 7.8K | 2 | ? | 未声明 |
| DeepSeek-R1-0528-AWQ MS | cognitivecomputations | Quantized | 7.6K | 8 | ✓ | mit |
| DeepSeek-R1-GGUF MS | lmstudio-community | Quantized | 7.5K | 19 | ? | 未声明 |
Verified 2026-11-05. Check the file size before downloading — 4-bit and 8-bit differ a lot.