Specialist cloud operators skilled at running hot and power-hungry GPUs and other AI infrastructure are emerging, and while some of these players like

AI cloud startup TensorWave bets AMD can beat Nvidia

submited by
Style Pass
2024-04-16 11:00:02

Specialist cloud operators skilled at running hot and power-hungry GPUs and other AI infrastructure are emerging, and while some of these players like CoreWeave, Lambda, or Voltage Park — have built their clusters using tens of thousands of Nvidia GPUs, others are turning to AMD instead.

An example of the latter is bit barn startup TensorWave which earlier this month began racking up systems powered by AMD's Instinct MI300X ,which it plans to lease the chips at a fraction of the cost charged to access Nvidia accelerators.

TensorWave co-founder Jeff Tatarchuk believes AMD's latest accelerators have many fine qualities. For starters, you can actually buy them. TensorWave has secured a large allocation of the parts.

By the end of 2024, TensorWave aims to have 20,000 MI300X accelerators deployed across two facilities, and plans to bring additional liquid-cooled systems online next year.

AMD's latest AI silicon is also faster than Nvidia's much coveted H100. "Just in raw specs, the MI300x dominates H100," Tatarchuk said.

Leave a Comment