Comments on: This Chart is Key to Understanding the Growth of AI

By: NYC Professional

NYC Professional — Sat, 14 Dec 2024 19:40:17 +0000

Maarten they’ve got the growth rate in the lines. That looks like it’s the trend line feature in Excel. You can see the trend line is increasing much faster in the 20’s

By: Maarten Bosmans

Maarten Bosmans — Sat, 14 Dec 2024 10:06:07 +0000

> The growth rate on increasing server CPU core counts is clearly accelerating at a rate that we simply have not seen.

This is pretty unsubstantiated by that plot. At least I would expect a log plot to back such claims up, as from this linear plot one can merely see that growth is superlinear.

Growth rate implies something like a percentage increase in core count each year. As the exponential growth lines indicate, the plot simply seems to show a more or less constant growth rate over the last 15 years.

By: John Stacker

John Stacker — Thu, 12 Dec 2024 21:30:51 +0000

I must have missed something. How did you connect CPU cores to AI workloads and AI expenditure?

CPU cores seems really disconnected from GPU / AI Accelerators…

By: Name

Name — Thu, 12 Dec 2024 13:02:14 +0000

The sad part is the – even if recently accelerated – slow rate of increase in RAM bandwidth and usable size at 1DPC. Hopefully that too can get on a ~24month doubling trajectory, for non-HBM. Or is HBM the defacto main memory going forward with classic memory a cache layer before local storage, before remote storage?