One year after Databricks acquired Tabular for $1 billion, the table formats landscape is seeing significant innovation, especially with DuckDB's introduction of DuckLake. Initially developed by the creators of Iceberg, Tabular's merger with Databricks marked a potential convergence in table formats. However, DuckDB's newly proposed architecture and its own table format promise to stir things up further. DuckDB has garnered notable excitement from the data community, reflecting a yearning for innovative and effective data solutions, particularly in analytics and data visualization.
"It was passed around broadly across the teams, and people have been playing with it. It's captured people's imaginations for sure," he said.
DuckDB has proposed its own table format, DuckLake, and an extension to DuckDB to allow it to act as client-server data warehouse.
The merger between Databricks and Tabular prompted signs of a confluence between the two formats, highlighting a dynamic shift in the data landscape.
There has been a groundswell of interest in DuckDB from the data engineering and analytics community, particularly for its query API and data visualizer.
Collection
[
|
...
]