Generative AI: How Companies Are Using and Scaling AI Models
Robert Nishihara is the co-founder and CEO of Anyscale, the company behind the open source platform, Ray — the distributed machine learning framework being used by ChatGPT and other highly-scaled products, such as Uber. I spoke to Nishihara to find out how ordinary companies can take advantage of AI technology and how Ray fits into the enterprise space.
In this new era of generative AI, frameworks like Ray will become increasingly important — indeed, as important as Kubernetes has been over the past decade, in terms of creating modern applications at scale.
Nishihara was one of the graduate students under Ion Stoica at Berkeley’s RISELab. It was there that he, Stoica and Philipp Moritz (another graduate student) created Ray in 2016. Anyscale was founded a few years later to commercialize the technology.
It’s worth noting that Ray was originally envisioned as “a general purpose system that would make distributed computing easy to do,” as Nishihara put it in a recent LinkedIn post. So it’s designed for “all scalable computing,” not just machine learning workloads. That said, its main use case right now is scaling machine learning.
.png)
