Twitter LinkedIn Facebook RSS Android

Apache Kafka Reaches 1.0 Milestone for Open-Source Distributed Streaming Platform

By Sean Michael Kerner     Feedback

Widely deployed open-source technology already used by major enterprises including Goldman Sachs, ING and Capital One reaches a critical milestone.

In the modern enterprise apps world, distributed streaming data is a core component, and perhaps no other technology is as widely used for that purpose as is Apache Kafka. On Nov. 1, the Apache Kafka 1.0.0 release officially debuted, marking an important new stage in the evolution of the widely used open-source project.

"Apache Kafka is playing a bigger role as companies are moving to real-time streaming and embracing stream processing," said Jun Rao, vice president of Apache Kafka. "The 1.0.0 release is an important milestone for the Apache Kafka community as we're committed to making it ready for enterprise adoption."

Kafka enables users to read, write and suscribe to streams of data, as well as providing the ability to have stream processing applications handle and react to events and data in live time. Additionally, Kafka has a storage component that enables organizations to store the data streams in a distributed fault-tolerant cluster.

The Kafka 1.0 milestone is all about stability and performance, with multiple incremental improvements that are designed to help provide enterprises with increased confidence about using Kafka at massive scale.

Kafka is already in use at massive scale by several of the Internet's leading Web properties, including both Netlflix and Uber.

"Kafka enabled us to process trillions of messages per day in a scalable way," Allen Wang, senior software engineer at Netflix, stated. "This opened up a completely new frontier for us to efficiently process data in motion to help us better serve Netflix members around the world."

Related Articles

"Apache Kafka is Uber's data platform that reliably delivers trillions of messages per day, and empowers the real-time business intelligence to serve all the users around the world," Lei Lin, engineer manager at Uber, stated. "It's very exciting to see the new milestone of Apache Kafka 1.0 release, and we are looking forward to this release."

While many organization make use of the freely available open-source Apache Kafka project, there is also commercial support available from different organizations. Among the enterprises that commercially support Kafka is Confluent, which raised $50 million in funding in March 2017 to help advance its Kafka support. Confluent was founded by the creators of the open-source Apache Kafka project

Sean Michael Kerner is a senior editor at EnterpriseAppsToday and InternetNews.com. Follow him on Twitter @TechJournalist.

This article was originally published on November 6, 2017
Close Icon
Thanks for your registration, follow us on our social networks to keep up-to-date