Last week, Sam Altman said it’s “quite terrible” that scarce RAM for local AI sits idle in everyone’s devices most of the time. Better to allocate it to data centres.
Altman’s point on the Cheeky Pint podcast about efficiency is that memory should go into racks rather than into consumer devices. I’d add that having compute in one place can be easier to monitor and audit.
But concentration also means that a handful of the biggest RAM buyers end up choosing what the world’s memory is used for, leaving the rest of us to scramble for RAM leftovers at higher prices. Run-of-the-mill market economics, one could argue.
Normal or not, I feel it. AI labs are partly responsible for the scarcity that we’ve seen since last year, driving up consumer prices for memory in personal devices. I paid around 20-30% more for my NAS this year, partly because of higher memory costs.
If RAM gets concentrated in a handful of the biggest memory buyers, it should be subject to an appropriate level of scrutiny and oversight.