Welcome to The Matrix

How close are we to realizing the vision of The Matrix (1999), where AI crafts a fully immersive, interactive world, blurring the line between reality and illusion? Imagine a limitless digital universe, created in real-time with visuals that rival reality itself. This project is a pioneering step toward that vision—a first glimpse into humanity’s own "Matrix."

Curious? Read on to explore the technology powering The Matrix and experience the feel of a self-sustaining digital universe!

The Matrix distinguishes itself as a foundation model capable of generating infinitely long videos with AAA game quality, high resolution, frame-level real-time control, and robust domain generalization. Here, * indicates concurrent work with The Matrix, and supervised/unsupervised refers to the video data with/without true control signal.

The Matrix offers real-time, responsive control in first- and third-person perspectives, enabling seamless exploration of dynamic environments. Trained on data from AAA games like Forza Horizon 5 and Cyberpunk 2077 as well as real-world footage, it lets users navigate diverse terrains—deserts, cities, forests, and more—in unbroken, continuous videos. Each keyboard command responds with frame-level precision, delivering a four-frame response similar to AAA games. Explore the gallery below to experience The Matrix across immersive landscapes. Click to play or click here to play all demos. Caution: may use mobile data.

Leave a Comment