Micron Introduces 128 GB DDR5-8000 RDIMMs with Monolithic 32 Gb Cube

The trail to high-capacity RDIMMs for servers has primarily been by means of 3D stacking (3DS) of DRAM cube utilizing By means of-Silicon Vias (TSVs). Nevertheless, this has offered important challenges in packaging (driving up the associated fee), and has additionally not been environment friendly by way of power consumption. The demand for big reminiscence capability RDIMMs is being primarily pushed by the sudden emergence of large-language fashions (LLMs) for generative AI and growing CPU core counts. Each of those require important quantity of DRAM to maintain tempo with efficiency necessities. Holding these in thoughts, Micron is introducing 128 GB DDR5 RDIMMs able to working at as much as 8000 MT/s at present, with mass-production slated for 2024.

Micron has just lately began fabricating 32 Gb monolithic DDR5 cube utilizing its confirmed and mature 1β know-how. The brand new cube have a forty five%+ enhance in bit density, and are able to reaching as much as 8000 MT/s whereas additionally working with far more aggressive timing latencies in comparison with the usual JEDEC specs. The corporate is claiming that it improves power effectivity by as a lot as 24% in comparison with the competitors’s 3DS TSV choices, and the quicker operation may assist in quicker AI coaching instances. Avoiding 3DS TSV permits Micron to optimize the information enter buffers and demanding I/O circuits higher, whereas additionally decreasing the pin capacitance on the information strains. These contribute to the decreased energy and improved speeds.

Micron has been doubling its monolithic die density each 3 years or so, due to developments in CMOS course of in addition to enhancements in array effectivity. The corporate sees a transparent path to 48 Gb and 64 Gb monolithic cube sooner or later with continued technological progress. Micron can also be claiming that its 1β node has reached mass manufacturing forward of the competitors, and that it has had the quickest yield maturity within the firm’s historical past. Twin-die packages and tall form-factor (TFF) modules utilizing 1β DRAM are anticipated to allow 1TB modules within the close to future.

Together with the announcement of the 128 GB RDIMMs utilizing 1β know-how, the corporate additionally laid out its roadmap for upcoming merchandise. HDM and GDDR7 are anticipated to dominate bandwidth-hungry functions, whereas RDIMMs, MCRDIMMs, and CXL options are within the pipeline for techniques requiring huge capability. LPDDR5X, and LPCAMM2 options going as much as 192 GB are anticipated to make an look in power-sensitive techniques as early as 2026.