Apparently OpenAI locked down 40% of the global DRAM supply for their Stargate project, which then caused everyone else to start panic-buying, and now we're here: https://pcpartpicker.com/trends/price/memory/
I got one of the Newegg circulars in my email advertising a sweet little uATX AMD server board and got to thinking that my home FreeBSD server could use a CPU bump and more memory. As soon as I saw how much 128GB of DDR5 ECC would cost my jaw dropped and noped the fuck out. The cheapest 32GB modules are around $300 and upwards of $500. Thought I was going to gift myself early this Christmas. Depressing indeed.
Indeed, it makes mini computers with soldered ram actually end up being quite cheap by comparison. HP will currently sell you 128GB AMD or Nvidia boxes for 1.7-2.8k depending on your flavor of choice. Not ECC though.
I'd been planning to upgrade my desktop as a christmas present for myself.
Now I have the cash and was looking at buying my PCPartPicker list, the cost of the 64GB DDR5-6000 RAM I planned to buy has gone from £300-400 to £700-800+, a difference of almost the price of the 9070 XT I just bought to go in the computer.
I guess I'll stick with my outdated AM4/X370 setup and make the best of the GPU upgrade until RAM prices stop being a complete joke.
literally every market is like that. if you've got market-cap amounts of money and place a market buy order for all of it, you'll quickly learn what slippage is.
That really isn't unprecedented. We need high RAM prices for manufacturers to expand fabs, supply overshoots demand because the AI bubble will contract to some extend and then we'll have cheap RAM once again. Classic cycle.
> We need high RAM prices for manufacturers to expand fab
Manufactures aren't dumb, they lost a lot of money in the last cycle and aren't playing that game anymore. No additional capacity is planned, OEMs are simply redirecting existing capacity towards high-margin products (HBM), instead of chasing fragile demand.
Inefficiently (from society’s perspective) allocating massive amounts of resources? Why is he specifically being singled out I’m absolutely that certain..
> Apparently OpenAI locked down 40% of the global DRAM supply for their Stargate project
That sounds like a lot, and almost unbelievable, but the scales of all of this kind of sits in that space, so what do I know.
Nonetheless, where are you getting this specific number and story from? I've seen it echoed before, but no one been able to trace it to any sort of reliable source that doesn't boil down to "secret insider writing on Substack".
Samsung directly announced that OpenAI expects to procure up to 900,000 DRAM wafers every month. That number being 40% of global supply comes from third party analysis, but the market is going to notice nearly a million wafers being diverted each month however you slice it. That's a shitload of silicon.
> Samsung directly announced that OpenAI expects to procure up to 900,000 DRAM wafers every month
The article says: "OpenAI’s memory demand projected to reach up to 900,000 DRAM wafers per month", but not by when, or what current demand is. If this is based on OpenAI's >$1T of announced capex over the next 5 years, its not clear that money will ever actually materialize.
I dont even get this trend, wouldnt OpenAI be buying ECC RAM only anyway? Who in their right mind runs this much infrastructure on NON ECC RAM??? Makes no sense to me. Same with GPUs they aren't buying your 5090s. Peoples perception is wild to me.
OpenAI bought out Samsung and SK Hynixes DRAM wafers in advance, so they'll prioritize producing whatever OpenAI wants to deploy whether that's DDR/LPDDR/GDDR/HBM, with or without ECC. That means way less wafers for everything else so even if you want a different spec you're still shit out of luck.
Yes but otherwise you’d get huge shortages and would be unlikely to be able to buy it at all. Also a significant proportion of the surplus currently going to manufacturers/etc. would go to various scalper and resellers
ECC memory is a bit like RAID: A consumer-level RAM stick will (traditionally) have 8 8-bit-wide chips operating basically in RAID-0 to provide 64-bit-wide access, whereas enterprise-level RAM sticks will operate with 9 8-bit-wide chips in something closer to RAID-4 or -5.
But they are all exactly the same chips. The ECC magic happens in the memory controller, not the RAM stick. Anyone buying ECC RAM for servers is buying on the same market as you building a new desktop computer.
> Anyone buying ECC RAM for servers is buying on the same market as you building a new desktop computer.
Even when the sticks are completely incompatible with each other? I think servers tend to use RDIMM, desktops use UDIMM. Personally I'm not seeing as step increase in (b2b) RDIMMs compared to the same stores selling UDIMM (b2c), but I'm also looking at different stores tailored towards different types of users.
At the chip level there’s no difference as far as I’m aware, you just have 9 bits per byte rather than 8 bits per byte physically on the module. More chips but not different chips.
> you just have 9 bits per byte rather than 8 bits per byte physically on the module. More chips but not different chips.
For those who aren't well versed in the construction of memory modules: take a look at your DDR4 memory module, you'll see 8 identical chips per side if it's a non-ECC module, and 9 identical chips per side if it's an ECC module. That's because, for every byte, each bit is stored in a separate chip; the address and command buses are connected in parallel to all of them, while each chip gets a separate data line on the memory bus. For non-ECC memory modules, the data line which would be used for the parity/ECC bit is simply not connected, while on ECC memory modules, it's connected to the 9th chip.
(For DDR5, things are a bit different, since each memory module is split in two halves, with each half having 4 or 5 chips per side, but the principle is the same.)
Till they hit your program memory. We just had really interesting incident where one of the Ceph nodes didn't fail but started acting erratically, bringing whole cluster to a crawl, once a failing RAM module had some uncorrectable errors.
And that was caught because we had ECC. If not for that we'd be replacing drives, because metrics made it look like it is one of OSDs slowing to a crawl, which usual reason is drive dying.
Of course, chance for that is pretty damn small, bit also their scale is pretty damn big.
> Q.ANT’s photonic chips – which compute using light instead of electricity – promise to deliver a 30-fold increase in energy efficiency and a 50-fold boost in computing speed, offering transformative potential for AI-driven data centers and HPC environments. (24.02.2025)
Good point! But they are slightly more energy hungry. At these scales I wonder if Stargate could go with one less nuclear reactor simply by switching to non-ECC RAM
Penny-wise and pound foolish. Non-ECC RAM might save on the small amount of RAM power, but if a bit-flip causes a failed computation then an entire forwards/backwards step – possibly involving several nodes – might need to be redone.
Linus Torvalds was recently on Linux Tech Tips to build a new computer and he insisted on ECC RAM. Torvalds was convinced that memory errors are a much greater problem for stability than otherwise posted and he's spent an inordinate amount of time chasing phantom bugs because of it.
>but if a bit-flip causes a failed computation then an entire forwards/backwards step – possibly involving several nodes – might need to be redone.
Which for the most part it would be an irrelevant cost-of-doing business compared to the huge savings from non-ECC and how incosequential it is if some ChatGPT computation fails...
ECC RAMs utility is overblown. Major companies often use off-the-shelves non enterprise parts for huge server installations, including regular RAM. The rare bit flipping is hardly a major concern at their scale, and for their specific purposes.
Most server CPUs require RDIMMs, and while non-ECC RDIMMs exist, they are not a high-volume product and are intended for workstations rather than servers. The used parts market would look very different if there were lots of large-scale server deployments using non-ECC memory modules.
Even DDR4. Just checked, I bought a non-ECC 1x32go stick for my homelab on August 25th, priced 78€ on Amazon. Same offer is now at 229€. Yeah I guess I'll wait before updating to 64gig then
It reminds me very much of the crypto mining craze, when there was a run on GPUs and one couldn't be had for any less than 5x it's MSRP. I know that eventually passed and so too will this but it still sucks if you had been planning to purchase RAM or anything needing it.
It is still being manufactured. Older memory standards continue to be manufactured long after they stop being used in computers, e.g. for use in embedded devices.
not much use for the 100GB+ AI boards or server RAM for consumers. Tho homelab guys will be thrilled.
Enterprise wise, the used servers kinda always have been cheap (at least compared to MSRP or even after discount price), just because there is enough companies that want a feel good of having a warranty on equipment and yeet it after 5 years.
Nowadays old-gen server hardware can be a viable alternative to a new HEDT or workstation, which would typically use top-of-the-line consumer parts. The price and performance are both broadly comparable.
No. Up to you to cool. I use an Epyc based system as a home server and you can’t hear it. At a previous employer we built a cluster out of these and just water cooled them. Very easy.
This is a chassis and fan problem not a CPU problem. Some devices do need their own cooling if your case is not a rack mount. E.g. if you have a mellanox chip those run hot unless you cool them specifically. In rackmount use case that happens anyway.
