#apache-iceberg

[ follow ]
#data-lakehouse #cloudflare-data-platform #serverless-analytics #r2-data-catalog #ai-agents #cost-optimization
fromInfoQ
1 day ago

Cloudflare Introduces Data Platform with Zero Egress Fees

Micah Wylde, principal engineer at Cloudflare, Alex Graham, senior systems engineer at Cloudflare, and Jérôme Schneider, staff software engineer at Cloudflare, explain: Analytical data is critical for modern companies. It allows you to understand your users' behavior, your company's performance, and alerts you to issues. But traditional data infrastructure is expensive and hard to operate, requiring fixed cloud infrastructure and in-house expertise. We built the Cloudflare Data Platform to be easy enough for anyone to use with affordable, usage-based pricing.
Data science
Data science
fromTechzine Global
2 weeks ago

dbt Labs launches Fusion engine and AI agents for data teams

dbt Labs adds four AI agents, introduces the Fusion engine for state-aware orchestration to cut compute costs, and open-sources MetricFlow under Apache 2.0.
Business intelligence
fromInfoWorld
2 weeks ago

Oracle debuts Iceberg-compatible Autonomous AI Lakehouse to boost enterprise analytics

Autonomous AI Lakehouse enables multi-cloud, vendor-neutral data lakehouse deployments with Apache Iceberg, unified metadata, and plug-and-play SQL for AI and analytics workloads.
fromTechzine Global
3 weeks ago

Qlik Open Lakehouse is now generally available

Qlik is making Open Lakehouse generally available. The Apache Iceberg service promises real-time pipelines and automatic optimization without vendor lock-in. The solution combines change data capture (CDC) with automatic Iceberg optimization. Teams can continue to use their existing tools, including Amazon Athena, Snowflake, Spark, Trino, and Amazon SageMaker. During the preview phase, customers reported faster queries and significantly lower infrastructure costs. Qlik Open Lakehouse is now available to all Talend Cloud users.
Data science
Business intelligence
fromInfoWorld
1 month ago

Why observability needs Apache Iceberg

Iceberg enables storing logs, metrics, and traces in the same lakehouse as business data, allowing SQL-based telemetry exploration without costly data transfers.
fromTechzine Global
1 month ago

Fabric gets real-time data mirroring from Oracle and BigQuery

Fabric was launched in 2023 as a unified cloud platform for data and analytics. Later that same year, mirroring was added, a feature that allows data from existing warehouses and databases to be added and managed without complex ETL processes or self-built data pipelines. With the latest update, organizations can replicate a snapshot of Oracle and BigQuery databases to OneLake, the lakehouse system within Fabric, where the copies remain synchronized with the source databases in near real time.
Data science
fromInfoQ
3 months ago

Building Reproducible ML Systems with Apache Iceberg and SparkSQL: Open Source Foundations

Time travel in Apache Iceberg allows users to precisely identify which data snapshot produced exceptional results, eliminating the need to sift through production logs.
Data science
fromDevOps.com
3 months ago

StarTree Bridges the Lakehouse Gap: Serving Apache Iceberg Data Directly to Applications - DevOps.com

This introduces latency, complexity and what we call 'bloat,' explains Chad Meley, SVP of Marketing at StarTree. We're collapsing that serving and query layer into one piece of the puzzle, significantly reducing the bloat and simplifying that architecture.
Data science
E-Commerce
fromInfoQ
3 months ago

Amazon S3 Adds Sort and Z-Order Compaction to Improve Apache Iceberg Query Performance

Amazon S3 now supports sort and z-order compaction for Apache Iceberg tables to improve query performance and reduce costs.
Business intelligence
fromTheregister
6 months ago

Delta Lake and Iceberg communities collide - in a good way

Databricks collaborates on the Iceberg table format, enhancing interoperability with its own Delta Lake format, aiming to optimize analytics performance.
[ Load more ]