Amazon Web Services Inc. is adding the ability to query the popular Apache Iceberg data lake directly from its Aurora PostgreSQL database management system, allowing applications to combine live transactions with historical records without copying data or creating extract/transform/load pipelines.
The capability embeds the DuckDB analytical engine inside Aurora PostgreSQL to support data stored in Iceberg and Apache Parquet formats. Customers can use existing PostgreSQL applications, tools and endpoints to query operational records alongside data in Amazon S3, including S3 Tables.
AWS acquired DuckLabs B.V., developer of the popular open-source database, last month.
AWS is positioning the feature as a way to simplify application development and reduce the engineering work needed to maintain data pipelines. Potential uses include real-time dashboards, transactions enriched with historical information and artificial intelligence agents that need access to both current and archived…
