Jensen says solving AI hallucination problems is 'several years away,' requires increasing computation

The CEO also talked about how much AI computing power increased in the past 10 years and Nvidia’s single greatest contribution to AI.

Nvidia CEO Jensen Huang recently said he doesn't think the industry can solve the AI hallucination issue, wherein an AI makes up information to fill in its knowledge gaps, for several more years. Huang also outlined how he had wooed his wife by promising he would be a CEO by the age of 30. Huang discussed these and other topics, like how much computing needs increased in the past 10 years, during an interview at the Hong Kong University of Science and Technology.

The host said the demand for AI computing power jumps four times annually. “In 10 years, it’s [an] enormous number, actually a million.” He also added that’s why Nvidia’s stock went up 300x. “The computing needs are a million times more, so then it explains the stock probably is not that expensive.” He then asked Huang, “As you look into the future with your crystal ball, are we going to see that a million times more needs increase for the next 10 years?”

Huang did not give a direct answer, but he first explained how artificial intelligence is being developed today. The first area is pre-training, which the Nvidia CEO compared to going to college. Here, the AI takes in all the data in the world and discovers knowledge through it. Huang says this is a “very important milestone, but it’s not enough.” The second area in the AI development process is post-training, where it dives deep into a particular skill via “reinforcement learning [through] human feedback, reinforcement learning [through] AI feedback, synthetic data generation, multipath learning, reinforcement learning [sic]—there’s a whole bunch of techniques.”

Leave a Comment