AWS has announced the general availability of Amazon OpenSearch Service’s zero-ETL integration with Amazon S3, enabling customers to easily query operational logs in S3 data lakes without the need to switch between tools. This new integration allows customers to access out-of-the-box dashboards for AWS record types like VPC Flow, WAF, and Elastic Load Balancer, making it easier for them to get started quickly. Customers using OpenSearch Service can also take advantage of using Amazon S3 as a cost-effective storage solution for infrequently accessed operational log data.
Previously, customers had to copy data to OpenSearch Service in order to perform data analysis and correlation across multiple sources. This process of continuously replicating data between services was time-consuming, expensive, and difficult to maintain. With the zero-ETL integration, customers can now access their operational log data stored in Amazon S3 directly through OpenSearch Service, allowing for complex queries and visualizations without the need for any data movement.
The Amazon OpenSearch Service zero-ETL integration with Amazon S3 is now generally available through OpenSearch Service 2.13 in various regions including Asia Pacific (Hong Kong), Asia Pacific (Mumbai), Asia Pacific (Seoul), Asia Pacific (Singapore), Asia Pacific (Sydney), Asia Pacific (Tokyo), Canada (Central), Europe (Frankfurt), Europe (Ireland), Europe (Stockholm), US East (Ohio), US East (Northern Virginia), and US West (Oregon). Customers can find more information on the integration on the Amazon OpenSearch Service Integration Page and the Amazon OpenSearch Service Developer Guide.
Article Source
https://aws.amazon.com/about-aws/whats-new/2024/05/amazon-opensearch-zero-etl-integration-s3/