Large language models are the next big thing for robotics, making cars and other robots quicker to train and easier to control (if you trust them).
Self-driving car startup Wayve can now interrogate its vehicles, asking them questions about their driving decisions—and getting answers back. The idea is to use the same tech behind ChatGPT to help train driverless cars.
The company combined its existing self-driving software with a large language model, creating a hybrid model it calls LINGO-1. LINGO-1 synchs up video data and driving data (the actions that the cars take second by second) with natural-language descriptions that capture what the car sees and what it does.
The mainstream approach to driverless cars is slow and difficult. These startups think going all-in on AI will get there faster.
The UK-based firm has had a string of breakthroughs in the last few years. In 2021 it showed that it could take AI trained on the streets of London and use it to drive cars in four other cities across the UK, a challenge that typically requires significant reengineering. Last year it used that same AI to drive more than one kind of vehicle, another industry first. And now it can chat to its cars.