14 comments
buran77 · 37 days ago
> Each AMD EPYC 9v64H CPU physically have 96 Zen 4 cores

> 8 Zen 4 cores per EPYC 9v64H CPU

The two consecutive lines of text give two different core counts. I know initial reporting on this CPU has been unclear, with everyone initially saying 88 cores, then updating to 96. But the author could have spent a couple of words on what the extra 8 cores are used for (best I could find is "used as overhead").

Show replies

freeqaz · 37 days ago
I wonder what inference of big LLMs might look like with that much cache and memory bandwidth. Not trivial to get a benchmark for that but I wonder

Show replies

JoshTriplett · 37 days ago
I'd love to see the benchmarks for this with SMT on: 96x2x4 = 768 CPUs in one system, along with 512GB of HBM that has 6900 GB/s memory bandwidth, and then DDR5.
nusl · 37 days ago
That's a monster of a CPU, wow.
· 36 days ago
[deleted]