AI chip startup Tensordyne has taped out its data center inference chip, which the company said will offer an order-of-magnitude improvement in power efficiency compared with leading GPU alternatives. The company said systems based on its chip can achieve 17× the tokens per second per Watt versus an Nvidia GB300-based system for the same workload, or 13× the tokens per second per rack (see editor’s note at the end of this article).

The two biggest challenges in the data center AI inference market are speed and cost, said Tensordyne co-founder and VP of AI, Gilles Backhus.

“It’s more important than ever that the best tokens available also come cheap,” he said. “Otherwise, certain business models and certain applications will not be unlocked. We believe we have the first system that can address both within one technology.”

By: DocMemory
Copyright © 2023 CST, Inc. All Rights Reserved