The future is seamless and collaborative
We outline the “trillion dollar” problem of materialised views, and the solution of differential dataflow. We then describe our novel approach to bi-directional materialised views, and how it enables a seamless and collaborative product.
The result of your queries is the materialised view. This view must update as new data streams in. You shouldn’t have to pay the cost of a full query each time. The database should be clever enough to compute a minimal incremental change from the current state of your view.
Here’s an illustrative quote on the extent of this issue:Software engineers worldwide continue to waste $trillions of person-hours on incidental complexity that can be fundamentally attributed to the lack of [materialised views] — Liron Shapira, Data denormalization is broken
Software engineers worldwide continue to waste $trillions of person-hours on incidental complexity that can be fundamentally attributed to the lack of [materialised views]
