Apache Kafka

Apache Kafka[1]
Apache kafka.svg
Original author(s)LinkedIn
Developer(s)Apache Software Foundation
Initial releaseJanuary 2011 (2011-01)[2]
Stable release
2.6.0 / August 3, 2020 (2020-08-03)[3]
Repository Edit this at Wikidata
Written inScala, Java
Operating systemCross-platform
TypeStream processing, Message broker
LicenseApache License 2.0
Websitekafka.apache.org Edit this at Wikidata

Apache Kafka is an open-source stream-processing software platform developed by the Apache Software Foundation, written in Scala and Java. The project aims to provide a unified, high-throughput, low-latency platform for handling real-time data feeds. Kafka can connect to external systems (for data import/export) via Kafka Connect and provides Kafka Streams, a Java stream processing library. Kafka uses a binary TCP-based protocol that is optimized for efficiency and relies on a "message set" abstraction that naturally groups messages together to reduce the overhead of the network roundtrip. This "leads to larger network packets, larger sequential disk operations, contiguous memory blocks [...] which allows Kafka to turn a bursty stream of random message writes into linear writes."[4]

  1. ^ "Apache Kafka at GitHub". github.com. Retrieved 5 March 2018.
  2. ^ "Open-sourcing Kafka, LinkedIn's distributed message queue". Retrieved 27 October 2016.
  3. ^ "Download". Retrieved 2020-08-03.
  4. ^ "Efficiency". kafka.apache.org. Retrieved 2019-09-19.

Powered by 654 easy search