A Holiday Experiment: Developing a Real-Time Digital Human Interface for LLMs
I’ve been fascinated by the rapid evolution of Large Language Models (LLMs), which are redefining our interactions with machines. What really excites me is not just what these models can do, but how we interact with them. That’s why, over a recent vacation, I decided to bring my laptop along and dive into a project that was brewing in my mind: creating a real-time digital human system that could serve as a front-end for LLMs, making our interactions with AI not just smart, but also strikingly human.
The idea hit me while pondering over the future of operating systems, which Karpathy mentions in his twitter. Imagine an OS where your interface isn’t just a series of windows or icons but a digital avatar — someone you can talk to, interact with, and who understands you better than any GUI could. This vision drove me to develop a system that could make digital humans not just possible but practical for everyday computing.
Given the short holiday period I had, the challenge was thrilling: to build something groundbreaking in just a few days only myself. This wasn’t just about coding; it was about envisioning a future where human-computer interaction is as natural and intuitive as chatting with a friend.
