01.AI

Yi 34B

01.AI's 34B. Bilingual EN/ZH; long-context variants up to 200K available.

Parameters
34B
Family
01.AI
Context
32K tokens
FP16 weights
68GB
// where you can run it
yi:34bLM StudiovLLMMLXoMLX
// hugging face stats (cached daily)
74K downloads · 356 likes · license: apache-2.0 · updated 1 year ago

What you need to run this.

$ ./vrambudget --model yi-34b --by quant

// budgets shown at ctx 8K, concurrency 1, 15% safety headroom. Tune in the calculator →

Alternatives at this size.

$ grep --params similar catalog.json

Discussion.

$ gh discussion list

// sign in with github to leave a comment. threads live in the repo's discussions tab.