~/model/huggingfacedeepseek-ai/DeepSeek-R1
DeepSeek

DeepSeek R1

V3 plus reasoning post-training. The model that proved RL-from-scratch chain-of-thought works at scale.

Parameters
671B
Family
DeepSeek
Context
128K tokens
FP16 weights
1342GB
// where you can run it
deepseek-r1LM StudiovLLMMLXoMLX
// hugging face stats (cached daily)
4.2M downloads · 13K likes · license: mit · updated 1 year ago

What you need to run this.

$ ./vrambudget --model deepseek-r1 --by quant
FP161342 GB
M3 Ultra 512512 GB · overM2 Ultra 192192 GB · overB200192 GB · overMI300X192 GB · over
Q8_0713 GB
M3 Ultra 512512 GB · overM2 Ultra 192192 GB · overB200192 GB · overMI300X192 GB · over
Q6_K550 GB
M3 Ultra 512512 GB · overM2 Ultra 192192 GB · overB200192 GB · overMI300X192 GB · over
Q5_K_M461 GB
M3 Ultra 512512 GB · tightM2 Ultra 192192 GB · overB200192 GB · overMI300X192 GB · over
Q4_K_M377 GB
M3 Ultra 512512 GB · fitsM2 Ultra 192192 GB · overB200192 GB · overMI300X192 GB · over

// budgets shown at ctx 8K, concurrency 1, 15% safety headroom. Tune in the calculator →

Alternatives at this size.

$ grep --params similar catalog.json
$ similarDeepSeek V3671BDeepSeek$ similarLlama 3.1 405B405BMeta$ similarMixtral 8x22B141BMistral$ similargpt-oss 120B117BOpenAI

Discussion.

$ gh discussion list

// sign in with github to leave a comment. threads live in the repo's discussions tab.