Demis Hassabis - Scaling, Superhuman AIs, AlphaZero atop LLMs, Rogue Nations Threat
This transcript was made using a script I wrote where an LLM corrects an autogenerated transcript. So heads up that it might contain hallucinations.
First question, given your neuroscience background, how do you think about intelligence? Specifically, do you think it’s one higher-level general reasoning circuit, or do you think it’s thousands of independent subskills and heuristics?
Well, it’s interesting because intelligence is so broad, and what we use it for is so generally applicable. I think that suggests there must be some high-level common things, common kind of algorithmic themes, around how the brain processes the world around us. So, of course, then there are specialized parts of the brain that do specific things, but I think there are probably some underlying principles that underpin all of that.
Yeah. How do you make sense of the fact that in these LLMs, though, when you give them a lot of data in any specific domain, they tend to get asymmetrically better in that domain. Wouldn’t we expect a sort of general improvement across all the different areas?
