Support for Apache Spark 3.2 in Azure Synapse Runtime Ending Soon | Latest Updates from Microsoft Azure

Support for Apache Spark 3.2 in Azure Synapse Runtime Ending Soon | Latest Updates from Microsoft Azure

On July 8, 2023, Microsoft announced the end of support for Azure Apache Spark 3.2. It is advisable to upgrade your Apache Spark 3.2 workloads to version 3.3 (GA) or 3.4 (GA planned for the first and second quarter of 2024). The Azure Synapse runtime for Apache Spark 3.2 will be retired and disabled from … Read more

Boost Apache Spark 3.5.1 Performance by 4.5x with Amazon EMR Runtime for Apache Spark | Amazon Web Services

Boost Apache Spark 3.5.1 Performance by 4.5x with Amazon EMR Runtime for Apache Spark | Amazon Web Services

Amazon EMR for Apache Spark Runtime is a performance-optimized runtime that is 100% API compatible with open-source Apache Spark. It offers faster out-of-the-box performance than Apache Spark through enhanced query plans, faster queries, and tuned defaults. This optimized runtime is utilized by Amazon EMR on EC2, Amazon EMR serverless, Amazon EMR on Amazon EKS, and … Read more

AWS introduces support for KRaft mode in Apache Kafka clusters on Amazon MSK

AWS introduces support for KRaft mode in Apache Kafka clusters on Amazon MSK

Amazon Managed Streaming for Apache Kafka (Amazon MSK) has announced support for KRaft (Apache Kafka Raft) mode in Apache Kafka version 3.7. KRaft was developed by the Apache Kafka community to replace Apache ZooKeeper for managing metadata in Kafka clusters. This new mode allows cluster metadata to be propagated within a group of Kafka controllers, … Read more

Amazon Web Services now supports in-place version upgrades for applications on Amazon Managed Service for Apache Flink.

Amazon Web Services now supports in-place version upgrades for applications on Amazon Managed Service for Apache Flink.

Amazon Managed Service for Apache Flink has recently announced support for Apache Flink runtime version 1.18, allowing existing users to smoothly migrate their applications to the latest version without data loss. Apache Flink is an open-source distributed processing engine that supports both stream and batch processing, with first-class stateful processing and event time semantics. Managed … Read more

Leverage AWS Data Exchange for seamless sharing of Apache Hudi datasets | Amazon Web Services

Leverage AWS Data Exchange for seamless sharing of Apache Hudi datasets | Amazon Web Services

Apache Hudi, originally developed by Uber in 2016, was created to support the growth of the ride-sharing platform by establishing a transactional data lake capable of handling updates efficiently. It is now widely utilized in the industry for building large-scale data lakes, known for its fast incremental updates and robust services layer. By providing online … Read more

New technical guide introducing Apache Iceberg on AWS | Amazon Web Services

Journalist Summary: The Apache Iceberg on AWS Technical Guide has been launched to assist individuals new to Apache Iceberg on AWS or those currently using it for production workloads. Apache Iceberg is an open-source table format that simplifies data processing in data lakes by bringing SQL table familiarity to big data. It offers features such … Read more

StorPool Improves Support for VMware Alternative Apache CloudStack | Silicon Canals

StorPool Improves Support for VMware Alternative Apache CloudStack | Silicon Canals

SOFIA, Bulgaria–(BUSINESS WIRE)– Apache CloudStack is an open-source cloud computing software platform designed to deploy and manage large arrays of virtual machines as a highly available, highly scalable Infrastructure as a Service (IaaS). CloudStack is becoming increasingly popular with VMware customers looking to reduce vendor lock-in, optimize the cost of their IT environments, and future-proof … Read more

Weekly Vulnerability Recap 1/29/24: Apple, Apache, & VMware

Weekly Vulnerability Recap 1/29/24: Apple, Apache, & VMware

eSecurity Planet content and product recommendations are editorially independent. We may make money when you click on links to our partners. Learn More. In this week’s urgent updates, Apple and VMware issued updates for zero-day flaws currently under attack, and researchers detected a rise in attacks on unpatched Apache and Atlassian Confluence servers. Meanwhile, the … Read more