Microsoft has announced the general availability of Azure Synapse Runtime for Apache Spark 3.4. This release comes after a successful public preview period that started in November 2023. The new runtime is now deemed ready for production workloads.
One of the main updates in this latest version is the incorporation of Apache Spark 3.4 and Delta Lake 2.4 features. This brings enhancements and improvements to the overall performance and functionality of the runtime. In addition, the operating system has been upgraded to Mariner, which is a Linux distribution specifically designed for Microsoft’s cloud infrastructure. Furthermore, Java has been updated from version 8 to 11, ensuring compatibility and stability.
Microsoft is urging all customers using Azure Synapse with Apache Spark to transition to the latest general availability version. By doing so, users can take advantage of the new features and improvements offered in this release. For more specific information, users can refer to the versions of Azure Synapse Runtime components for Apache Spark 3.4.
In conclusion, the general availability of Azure Synapse Runtime for Apache Spark 3.4 marks a significant milestone for Microsoft and its customers. With updated features, enhancements, and improvements, this release is designed to provide a more robust and efficient experience for users working with Apache Spark on Azure Synapse.
Article Source
https://azure.microsoft.com/en-us/updates/general-available-azure-synapse-runtime-for-apache-spark-34-is-now-ga/