Artificial intelligence today is largely something that occurs in the cloud, where huge AI models are trained and deployed on massive racks of GPUs. B

The Future of AI Is Hybrid

submited by

Style Pass

2024-02-12 23:00:05

Artificial intelligence today is largely something that occurs in the cloud, where huge AI models are trained and deployed on massive racks of GPUs. But as AI makes its inevitable migration into to the applications and devices that people use every day, it will need to run on smaller compute devices deployed to the edge and connected to the cloud in a hybrid manner.

That’s the prediction of Luis Ceze, the University of Washington computer science professor and Octo AI CEO, who has closely watched the AI space evolve over the past few years. According to Ceze, AI workloads will need to break out of the cloud and run locally if it’s going to have the impact foreseen by many.

In a recent interview with Datanami, Ceze gave several reasons for this shift. For starters, the Great GPU Squeeze is forcing AI practitioners to search for compute wherever they can find it. find new making the edge look downright hospitable today, he.

“If you think about the potential here, it’s that we’re going to use generative AI models for pretty much every interaction with computers,” Ceze says. “Where are we going to get compute capacity for all of that? There’s not enough GPUs in the cloud, so naturally you want to start making use of edge devices.”