NVIDIA is reportedly in confidential discussions with major memory semiconductor companies, including Samsung Electronics and SK Hynix, to commercialize a new memory standard known as "SOCAMM," which is being hailed as the "second high-bandwidth memory (HBM)." This development, confirmed by industry insiders on Feb. 16, marks a significant shift in the memory semiconductor landscape, with potential implications for both the B2B server market and the burgeoning on-device AI sector.

SOCAMM is a cutting-edge DRAM module designed to enhance the performance of personal AI supercomputers. It offers superior cost-performance compared to existing DRAM modules used in small PCs and laptops, thanks to its integration of LPDDR5X DRAM, which is renowned for its low power consumption and high power efficiency. The module's design includes 694 I/O ports, surpassing the 644 ports of the current LPCAMM standard, which helps alleviate data bottleneck issues—a critical challenge in AI computing.

One of the standout features of SOCAMM is its detachable nature, allowing for easy replacement and upgrades, thereby facilitating continuous performance improvements. Its compact size, comparable to an adult's middle finger, enables the installation of more DRAM modules within the same area, further enhancing its appeal for high-performance computing applications.

NVIDIA's CEO, Jensen Huang, has been a vocal advocate for making AI technology accessible to a broader audience. Last month, at CES 2025, he unveiled the AI PC "Digits," which embodies his vision of democratizing AI. "In the future, engineers, artists, and everyone using computers as tools will need a personal AI supercomputer," Huang stated, underscoring the transformative potential of SOCAMM in achieving this goal.

The development of SOCAMM is not just a technical innovation but also a strategic move by NVIDIA to establish its own memory standard, independent of the traditional consensus-driven approach of the Joint Electron Device Engineering Council (JEDEC). An industry source noted, "Memory standards have traditionally been determined by a consensus among multiple PC, memory, and server companies at JEDEC, but NVIDIA is pursuing its own memory standard, reflecting confidence in its innovation and influence."

The emergence of SOCAMM is expected to have a ripple effect across the semiconductor industry, impacting not only Samsung Electronics and SK Hynix but also domestic board companies like Simmtech and TLB, which are reportedly collaborating to supply boards for SOCAMM. An industry insider revealed that "NVIDIA and memory companies are exchanging SOCAMM prototypes and conducting performance tests," with mass production potentially commencing by the end of this year.

As NVIDIA continues to push the boundaries of AI and computing technology, the successful commercialization of SOCAMM could redefine the landscape of personal computing, making AI supercomputing capabilities accessible to a wider range of users and setting a new benchmark for memory performance in the industry.

By: DocMemory
Copyright © 2023 CST, Inc. All Rights Reserved