Samsung Electronics, TSMC tie up for HBM4 AI chip development
Chae-Yeon Kim and Jeong-Soo Hwang
4 HOURS AGO
TSMC is the world's largest foundry player TAIPEI – South Korea’s Samsung Electronics Co., the world’s largest memory chipmaker, is partnering with its foundry rival Taiwan Semiconductor Manufacturing Co. (TSMC) to jointly develop a next-generation artificial intelligence chip, HBM4, in a push to strengthen their positions in the fast-growing AI chip market.
Dan Kochpatcharin, head of Ecosystem and Alliance Management at TSMC, said during a Semicon Taiwan 2024 forum on Thursday that the two companies are co-developing a bufferless HBM4 chip.
HBM, short for high-bandwidth memory, is an advanced DRAM chip critical to the AI boom as it provides much-needed faster processing speed compared with traditional memory chips.
HBM4 is the sixth-generation HBM chip, which major memory makers such as Samsung, SK Hynix Inc. and Micron Technology Inc. plan to mass-produce for AI chip designers, including Nvidia Corp, as early as next year.
Samsung memory business chief Lee Jung-bae at Semicon Taiwan 2024 Analysts said if Samsung and TSMC collaborate on the development of bufferless HBM4 chips, it would mark their first partnership in the AI chip segment.
In foundry or contract chipmaking, Samsung is the No. 2 player, fiercely competing with bigger rival TSMC.
Semicon Taiwan 2024, organized by the chip industry association SEMI, is an annual international gathering of chip professionals. With over 1,100 chip-related enterprises participating, this year’s event is being held through Friday at the Taipei Nangang Exhibition Center.
Industry officials said the bufferless HBM4 will have 40% higher power efficiency and 10% lower latency than existing models.
As the memory manufacturing process gets more and more complex, cooperation with partners “has become more important than ever,” said Kochpatcharin.
SAMSUNG TO MASS-PRODUCE HBM4 IN 2025
Sources said Samsung’s collaboration with TSMC will start with the cutting-edge sixth-generation HBM4 chip, of which the Korean company plans to begin mass production in the second half of next year.
HBM market outlook by Morgan Stanley Through the partnership, Samsung aims to deliver “customized chips and services” requested by clients like Nvidia and Google.
While Samsung is capable of providing comprehensive HBM4 services, including memory production, foundry and advanced packaging, it hopes to leverage TSMC’s technology to secure more clients, sources said.
The move comes as Samsung is striving to overtake its crosstown rival SK Hynix, the dominant HBM player with a 53% share of the AI chip market.
Samsung commands 35% of the market, according to market research firm TrendForce.
To solidify its HBM leadership, SK Hynix, which is not engaged in the foundry business, joined hands with TSMC in April to jointly produce HBM4 chips. SK plans mass production of HBM4 in 2026.
HBM DRAM chip packaging structure (Courtesy of AMD) SAMSUNG SEEKS OUT PARTNERSHIP
On Wednesday, Lee Jung-bae, corporate president and head of Samsung’s memory business, said during a keynote speech at Semicon Taiwan 2024 that “to maximize the performance of AI chips, customized HBM is the best choice. We are working with other foundry players to offer more than 20 customized solutions.”
At the forum’s CEO Summit, he said while Samsung’s System LSI and Memory divisions handle chip design and production, the company will leverage other foundry player’s manufacturing capabilities to maximize HBM performance.
"There are limits to improving HBM performance using traditional memory processes alone,” he said.
STRATEGIC MOVE
The manufacturing process for HBM4 is different from previous generations, as the logic die, which acts as the brain of an HBM chip, will be produced by foundry companies rather than memory manufacturers.
AI chip (Courtesy of Getty Images) Samsung plans to provide a turnkey service – from DRAM production to logic die production and advanced packaging. However, it is also considering using TSMC’s technology as there are customers who prefer TSMC-produced logic dies, sources said.
“To become a leader in the HBM segment, Samsung must take bold measures that go beyond developing new technologies,” said an industry official.
SK Hynix is currently the top supplier of HBM3 AI chips to Nvidia, which controls 80% of the AI chip market.