Amazon Managed Workflows for Apache Airflow (MWAA) now supports the creation of Apache Airflow version 2.9 environments. This latest release of Apache Airflow brings several enhancements to the popular open source workflow management tool. Amazon MWAA is a managed orchestration service that simplifies the setup and operation of data pipelines in the cloud using Apache Airflow.
Some of the key improvements in Apache Airflow 2.9 include new API endpoints for more efficient dataset management, the ability to customize task names in dynamic task allocation for better readability, and advanced scheduling options such as conditional expressions for dataset dependencies and the combination of datasets with time-based schedules. These enhancements allow customers to create, schedule, and monitor workflows more effectively.
Article Source
https://aws.amazon.com/about-aws/whats-new/2024/07/amazon-mwaa-apache-airflow-version-2-9
