Wvlet: Redesigning 50-Year-Old SQL for Modern Data Analytics
We are excited to announce the release of Wvlet version 2024.9, an open-source flow-style query language designed to help users to write efficient queries for SQL engines. You can try Wvlet, pronounced as weave-let, directly in your web browser at Wvlet Playground. The source code of Wvlet compiler is available at GitHub wvlet/wvlet.
At Treasure Data, we process over 3 million SQL queries daily. Managing this volume of queries and helping users (including LLM) write efficient queries presents significant challenges.
The primary challenges lies in SQL's syntax: its syntactic order doesn't match the actual data flow. This mismatch makes debugging complex and deeply nested queries difficult, even for SQL experts. A Critique of Modern SQL And A Proposal Towards A Simple and Expressive Query Language (CIDR '24) highlights this issue clearly:
Additionally, the SQL standard (e.g., SQL-92) is limited in scope and lacks essential software engineering features for managing multiple queries, including:
