Head-to-head for local LLM inference. The honest comparison: VRAM, bandwidth, compute, and which of the 30 catalog models actually fit on each.
// showing 12 of 30 models; differing fits first
MI300X has 112 GB more.
MI300X by +58%.
MI300X by +31% TFLOPS.
Tied: 27 of 30 fit on each.
// sign in with github to leave a comment. threads live in the repo's discussions tab.