Kafka tool mac os

The Ultimate UI Tool for Kafka

Download

To download the Offset Explorer (formerly Kafka Tool) for your operating system, use the links below. All versions of Offset Explorer come with a bundled JRE with the exception of the Linux version. For Linux, you must have Java 8 installed on your operating system before using Offset Explorer. After downloading, refer to the Documentation to configure Offset Explorer correctly. View change history to see recent updates to Offset Explorer.

Before clicking on the download button below, carefully read the terms of the license agreement. By clicking and downloading the software you are consenting to be bound by the license agreement. Do not click on download unless you agree to all terms of the license agreement.

Offset Explorer is free for personal use only.

Offset Explorer supports Apache Kafka ® version 0.8.1 and above.

Offset Explorer 2.2

[For Kafka version 0.11 and later]

Platform	Size
Windows 32-Bit	35 MB	Download
Windows 64-Bit	34 MB	Download
macOS	55 MB	Download
Linux	16 MB	Download

UI Tool for Apache Kafka

© 2015-2021 DB Solo, LLC. All rights reserved.
Apache Kafka is a trademark of the Apache Software Foundation. Offset Explorer is not produced by or affiliated with the Apache Software Foundation.

Источник

GUI for Apache Kafka

Overview

Nowadays Apache Kafka becoming more and more popular in the Big Data world. More than 30% of Fortune 500 companies are already using Kafka. It’s a fast, durable and scalable publish-subscribe messaging system.

In this article I want to take a look at Kafka GUI, that can make a life of Big Data engineer easier.

“Kafka Tool” overview and installation.

First tool of my choice is “Kafka Tool”, sorry for tautology. It’s free for personal use and you can download it from http://www.kafkatool.com/
Also if you use Apache Avro message type it’s very useful to download Avro plugin, that will help to see actual contents of the Avro objects in a JSON format. https://github.com/laymain/kafka-tool-avro
Once you are done, open the “Kafka Tool” installation folder and put the downloaded .jar file to the /java/app/plugins/ .

Connecting to the Kafka cluster in “Kafka tool”.
Open “Kafka Tool” append and on the left side you will see folder “Clusters”. Right Click on it and choose “Add New Connection” from the drop-down list. It should open this window with cluster’s settings

You can name your cluster with any name and add a Bootstrap Server endpoint. In my case, I have Kafka Docker image running on my PC on port 9092 . Click “Add” and now you are connected to your Kafka cluster.

Then specify your schema registry endpoint. By default it’s http://localhost:8081

Now in the “Clusters” folder newly created cluster should appear. And you can see a folder “Topics” inside. If you’ll click on it, you’ll see all the topics that exist on your cluster.

Consuming from the topics in “Kafka tool”.

Click on the topic you’re interested in and then click on the play button on the left.

In the tab “Properties” you can choose Key and message content type. If you added Avro plugin, as was described above you’ll see Avro type as well.
Choose the type used for your messages and go to the “Data” tab.

Now you can see all messages that are in the selected topic.

Creating a new topic in “Kafka tool”.

You can create a new topic as well. Just click on the folder “Topics” and then on the green positive sign.

Choose the name, partition count and replica count for your topic. If you need additional configurations — click on the left “Add” button and enter your configuration name and value.

Once you are done click on the right “Add” button and the topic will be created and will appear in your “Topics” folder.

“Conduktor” overview and installation.

“Conduktor” is the second Kafka GUI on my list. You can download it here https://www.conduktor.io
It’s free for now and you don’t need to install anything for schema registry since it’s already built-in.
Let’s open it.

Adding of new Kafka cluster in “Conduktor”.

Click on “Add new cluster”.

Type any cluster name and you Bootstrap Servers endpoints. Then go to “Schema Registry” tab and put in Schema Registry’s URL. It always should start from “http” or “https”

Save your configuration and the newly added cluster should appear on the left. Click on it and you should the window with all the information about your Kafka cluster: brokers, topics, consumers, etc.

Consuming from the topics in “Conduktor”

Click on the Topics tab and you will see all topics that exist on your cluster.

If you want to see the content of the specific topic click on it. In a new window, you can choose your topic’s key and value format and start consuming from it.

Now you can see all your records and their number. If you want to see a specific message just click on it.

In the opened window you will see all the needed information about your message: name of the topic, partition, offset, key and value of the message, timestamp, and headers if they are present.

Creating a new topic in “Conduktor”.

For creating a new topic in the “Conduktor”. Press the “+CREATE” button on the right.

Type in the name of the topic, number of partitions, replication factor. Also, you can override other values if needed. Tap on “Create” and newly added topic should appear in your “Topics” list.

Conclusion.

Both of reviewed tools are free for personal use and runs on all OS. You can connect to your Kafka cluster, see your existing topic. Also, you can see a number of records in each topic, record’s offset, timestamp key, value, and headers. Also, you can create and configure a new topic.
From Kafka tool advantages, you can write your own plugin for it, which can be pretty useful in some cases.
From “Conduktor” advantages, just in my personal opinion, it is more user-friendly and its design is nicer.

Источник

The Ultimate UI Tool for Kafka

Offset Explorer (formerly Kafka Tool) is a GUI application for managing and using Apache Kafka ® clusters. It provides an intuitive UI that allows one to quickly view objects within a Kafka cluster as well as the messages stored in the topics of the cluster. It contains features geared towards both developers and administrators. Some of the key features include

• Quickly view all your Kafka clusters, including their brokers, topics and consumers
• View contents of messages in your partitions and add new messages
• View offsets of the consumers, including Apache Storm Kafka spout consumers
• Show JSON, XML and Avro messages in a pretty-printed format
• Add and drop topics plus other management features
• Save individual messages from your partitions to local hard drive
• Write your own plugins that allow you to view custom data formats
• Offset Explorer runs on Windows, Linux and Mac OS

Offset Explorer is free for personal use only. Any non-personal use, including commercial, educational and non-profit work is not permitted without purchasing a license. Non-personal use is allowed for evaluation purposes for 30 days following the download of Offset Explorer, after which you must purchase a valid license or remove the software.

UI Tool for Apache Kafka

© 2015-2021 DB Solo, LLC. All rights reserved.
Apache Kafka is a trademark of the Apache Software Foundation. Offset Explorer is not produced by or affiliated with the Apache Software Foundation.

Источник

Download

3.0.0 is the latest release. The current stable version is 3.0.0.

You can verify your download by following these procedures and using these KEYS.

• Released September 21, 2021
• Release Notes
• Source download: kafka-3.0.0-src.tgz (asc, sha512)
• Binary downloads:
  • Scala 2.12 — kafka_2.12-3.0.0.tgz (asc, sha512)
  • Scala 2.13 — kafka_2.13-3.0.0.tgz (asc, sha512)

  We build for multiple versions of Scala. This only matters if you are using Scala and you want a version built for the same Scala version you use. Otherwise any version should work (2.13 is recommended).

Kafka 3.0.0 includes a number of significant new features. Here is a summary of some notable changes:

• The deprecation of support for Java 8 and Scala 2.12
• Kafka Raft support for snapshots of the metadata topic and other improvements in the self-managed quorum
• Stronger delivery guarantees for the Kafka producer enabled by default
• Deprecation of message formats v0 and v1
• Optimizations in OffsetFetch and FindCoordinator requests
• More flexible Mirror Maker 2 configuration and deprecation of Mirror Maker 1
• Ability to restart a connector’s tasks on a single call in Kafka Connect
• Connector log contexts and connector client overrides are now enabled by default
• Enhanced semantics for timestamp synchronization in Kafka Streams
• Revamped public API for Stream’s TaskId
• Default serde becomes null in Kafka

For more information, please read the detailed Release Notes.

• Released September 17, 2021
• Release Notes
• Source download: kafka-2.8.1-src.tgz (asc, sha512)
• Binary downloads:
  • Scala 2.12 — kafka_2.12-2.8.1.tgz (asc, sha512)
  • Scala 2.13 — kafka_2.13-2.8.1.tgz (asc, sha512)

  We build for multiple versions of Scala. This only matters if you are using Scala and you want a version built for the same Scala version you use. Otherwise any version should work (2.13 is recommended).

Kafka 2.8.1 fixes 49 issues since the 2.8.0 release. For more information, please read the detailed Release Notes.

• Released April 19, 2021
• Release Notes
• Source download: kafka-2.8.0-src.tgz (asc, sha512)
• Binary downloads:
  • Scala 2.12 — kafka_2.12-2.8.0.tgz (asc, sha512)
  • Scala 2.13 — kafka_2.13-2.8.0.tgz (asc, sha512)

  We build for multiple versions of Scala. This only matters if you are using Scala and you want a version built for the same Scala version you use. Otherwise any version should work (2.13 is recommended).

Kafka 2.8.0 includes a number of significant new features. Here is a summary of some notable changes:

• Early access of replace ZooKeeper with a self-managed quorum
• Add Describe Cluster API
• Support mutual TLS authentication on SASL_SSL listeners
• JSON request/response debug logs
• Limit broker connection creation rate
• Topic identifiers
• Expose task configurations in Connect REST API
• Update Streams FSM to clarify ERROR state meaning
• Extend StreamJoined to allow more store configs
• More convenient TopologyTestDriver construtors
• Introduce Kafka-Streams-specific uncaught exception handler
• API to start and shut down Streams threads
• Improve TimeWindowedDeserializer and TimeWindowedSerde to handle window size
• Improve timeouts and retries in Kafka Streams

For more information, please read the detailed Release Notes.

• Released May 10, 2020
• Release Notes
• Source download: kafka-2.7.1-src.tgz (asc, sha512)
• Binary downloads:
  • Scala 2.12 — kafka_2.12-2.7.1.tgz (asc, sha512)
  • Scala 2.13 — kafka_2.13-2.7.1.tgz (asc, sha512)

  We build for multiple versions of Scala. This only matters if you are using Scala and you want a version built for the same Scala version you use. Otherwise any version should work (2.13 is recommended).

Kafka 2.7.1 fixes 45 issues since the 2.7.0 release. For more information, please read the detailed Release Notes.

• Released Dec 21, 2020
• Release Notes
• Source download: kafka-2.7.0-src.tgz (asc, sha512)
• Binary downloads:
  • Scala 2.12 — kafka_2.12-2.7.0.tgz (asc, sha512)
  • Scala 2.13 — kafka_2.13-2.7.0.tgz (asc, sha512)

  We build for multiple versions of Scala. This only matters if you are using Scala and you want a version built for the same Scala version you use. Otherwise any version should work (2.13 is recommended).

Kafka 2.7.0 includes a number of significant new features. Here is a summary of some notable changes:

• Configurable TCP connection timeout and improve the initial metadata fetch
• Enforce broker-wide and per-listener connection creation rate (KIP-612, part 1)
• Throttle Create Topic, Create Partition and Delete Topic Operations
• Add TRACE-level end-to-end latency metrics to Streams
• Add Broker-side SCRAM Config API
• Support PEM format for SSL certificates and private key
• Add RocksDB Memory Consumption to RocksDB Metrics
• Add Sliding-Window support for Aggregations

For more information, please read the detailed Release Notes.

• Released April 20, 2021
• Release Notes
• Source download: kafka-2.6.2-src.tgz (asc, sha512)
• Binary downloads:
  • Scala 2.12 — kafka_2.12-2.6.2.tgz (asc, sha512)
  • Scala 2.13 — kafka_2.13-2.6.2.tgz (asc, sha512)

  We build for multiple versions of Scala. This only matters if you are using Scala and you want a version built for the same Scala version you use. Otherwise any version should work (2.13 is recommended).

Kafka 2.6.2 fixes 35 issues since the 2.6.1 release. For more information, please read the detailed Release Notes.

• Released January 07, 2021
• Release Notes
• Source download: kafka-2.6.1-src.tgz (asc, sha512)
• Binary downloads:
  • Scala 2.12 — kafka_2.12-2.6.1.tgz (asc, sha512)
  • Scala 2.13 — kafka_2.13-2.6.1.tgz (asc, sha512)

  We build for multiple versions of Scala. This only matters if you are using Scala and you want a version built for the same Scala version you use. Otherwise any version should work (2.13 is recommended).

Kafka 2.6.1 fixes 41 issues since the 2.6.0 release. For more information, please read the detailed Release Notes.

• Released Aug 3, 2020
• Release Notes
• Source download: kafka-2.6.0-src.tgz (asc, sha512)
• Binary downloads:
  • Scala 2.12 — kafka_2.12-2.6.0.tgz (asc, sha512)
  • Scala 2.13 — kafka_2.13-2.6.0.tgz (asc, sha512)

  We build for multiple versions of Scala. This only matters if you are using Scala and you want a version built for the same Scala version you use. Otherwise any version should work (2.13 is recommended).

Kafka 2.6.0 includes a number of significant new features. Here is a summary of some notable changes:

• TLSv1.3 has been enabled by default for Java 11 or newer
• Significant performance improvements, especially when the broker has large numbers of partitions
• Smooth scaling out of Kafka Streams applications
• Kafka Streams support for emit on change
• New metrics for better operational insight
• Kafka Connect can automatically create topics for source connectors when configured to do so
• Improved error reporting options for sink connectors in Kafka Connect
• New Filter and conditional SMTs in Kafka Connect
• The default value for the `client.dns.lookup` configuration is now `use_all_dns_ips`
• Upgrade Zookeeper to 3.5.8

For more information, please read the detailed Release Notes.

• Released August 10, 2020
• Release Notes
• Source download: kafka-2.5.1-src.tgz (asc, sha512)
• Binary downloads:
  • Scala 2.12 — kafka_2.12-2.5.1.tgz (asc, sha512)
  • Scala 2.13 — kafka_2.13-2.5.1.tgz (asc, sha512)

  We build for multiple versions of Scala. This only matters if you are using Scala and you want a version built for the same Scala version you use. Otherwise any version should work (2.12 is recommended).

Kafka 2.5.1 fixes 72 issues since the 2.5.0 release. For more information, please read the detailed Release Notes.

• Released April 15, 2020
• Release Notes
• Source download: kafka-2.5.0-src.tgz (asc, sha512)
• Binary downloads:
  • Scala 2.12 — kafka_2.12-2.5.0.tgz (asc, sha512)
  • Scala 2.13 — kafka_2.13-2.5.0.tgz (asc, sha512)

  We build for multiple versions of Scala. This only matters if you are using Scala and you want a version built for the same Scala version you use. Otherwise any version should work (2.12 is recommended).

Kafka 2.5.0 includes a number of significant new features. Here is a summary of some notable changes:

• TLS 1.3 support (1.2 is now the default)
• Co-groups for Kafka Streams
• Incremental rebalance for Kafka Consumer
• New metrics for better operational insight
• Upgrade Zookeeper to 3.5.7
• Deprecate support for Scala 2.11

For more information, please read the detailed Release Notes.

• Released March 12, 2020
• Release Notes
• Source download: kafka-2.4.1-src.tgz (asc, sha512)
• Binary downloads:
  • Scala 2.11 — kafka_2.11-2.4.1.tgz (asc, sha512)
  • Scala 2.12 — kafka_2.12-2.4.1.tgz (asc, sha512)
  • Scala 2.13 — kafka_2.13-2.4.1.tgz (asc, sha512)

  We build for multiple versions of Scala. This only matters if you are using Scala and you want a version built for the same Scala version you use. Otherwise any version should work (2.12 is recommended).

For more information, please read the detailed Release Notes.

• Released December 16, 2019
• Release Notes
• Source download: kafka-2.4.0-src.tgz (asc, sha512)
• Binary downloads:
  • Scala 2.11 — kafka_2.11-2.4.0.tgz (asc, sha512)
  • Scala 2.12 — kafka_2.12-2.4.0.tgz (asc, sha512)
  • Scala 2.13 — kafka_2.13-2.4.0.tgz (asc, sha512)

  We build for multiple versions of Scala. This only matters if you are using Scala and you want a version built for the same Scala version you use. Otherwise any version should work (2.12 is recommended).

Kafka 2.4.0 includes a number of significant new features. Here is a summary of some notable changes:

• Allow consumers to fetch from closest replica.
• Support for incremental cooperative rebalancing to the consumer rebalance protocol.
• MirrorMaker 2.0 (MM2), a new multi-cluster, cross-datacenter replication engine.
• New Java authorizer Interface.
• Support for non-key joining in KTable.
• Administrative API for replica reassignment.

For more information, please read the detailed Release Notes.

• Released Oct 24, 2019
• Release Notes
• Source download: kafka-2.3.1-src.tgz (asc, sha512)
• Binary downloads:
  • Scala 2.11 — kafka_2.11-2.3.1.tgz (asc, sha512)
  • Scala 2.12 — kafka_2.12-2.3.1.tgz (asc, sha512)

  We build for multiple versions of Scala. This only matters if you are using Scala and you want a version built for the same Scala version you use. Otherwise any version should work (2.12 is recommended).

For more information, please read the detailed Release Notes.

• Released Jun 25, 2019
• Release Notes
• Source download: kafka-2.3.0-src.tgz (asc, sha512)
• Binary downloads:
  • Scala 2.11 — kafka_2.11-2.3.0.tgz (asc, sha512)
  • Scala 2.12 — kafka_2.12-2.3.0.tgz (asc, sha512)

  We build for multiple versions of Scala. This only matters if you are using Scala and you want a version built for the same Scala version you use. Otherwise any version should work (2.12 is recommended).

Kafka 2.3.0 includes a number of significant new features. Here is a summary of some notable changes:

• There have been several improvements to the Kafka Connect REST API.
• Kafka Connect now supports incremental cooperative rebalancing.
• Kafka Streams now supports an in-memory session store and window store.
• The AdminClient now allows users to determine what operations they are authorized to perform on topics.
• There is a new broker start time metric.
• JMXTool can now connect to secured RMI ports.
• An incremental AlterConfigs API has been added. The old AlterConfigs API has been deprecated.
• We now track partitions which are under their min ISR count.
• Consumers can now opt-out of automatic topic creation, even when it is enabled on the broker.
• Kafka components can now use external configuration stores (KIP-421).
• We have implemented improved replica fetcher behavior when errors are encountered.

For more information, please read the detailed Release Notes.

• Released Dec 1, 2019
• Release Notes
• Source download: kafka-2.2.2-src.tgz (asc, sha512)
• Binary downloads:
  • Scala 2.11 — kafka_2.11-2.2.2.tgz (asc, sha512)
  • Scala 2.12 — kafka_2.12-2.2.2.tgz (asc, sha512)

  We build for multiple versions of Scala. This only matters if you are using Scala and you want a version built for the same Scala version you use. Otherwise any version should work (2.12 is recommended).

• Released Jun 1, 2019
• Release Notes
• Source download: kafka-2.2.1-src.tgz (asc, sha512)
• Binary downloads:
  • Scala 2.11 — kafka_2.11-2.2.1.tgz (asc, sha512)
  • Scala 2.12 — kafka_2.12-2.2.1.tgz (asc, sha512)

  We build for multiple versions of Scala. This only matters if you are using Scala and you want a version built for the same Scala version you use. Otherwise any version should work (2.12 is recommended).

• Released Mar 22, 2019
• Release Notes
• Source download: kafka-2.2.0-src.tgz (asc, sha512)
• Binary downloads:
  • Scala 2.11 — kafka_2.11-2.2.0.tgz (asc, sha512)
  • Scala 2.12 — kafka_2.12-2.2.0.tgz (asc, sha512)

  We build for multiple versions of Scala. This only matters if you are using Scala and you want a version built for the same Scala version you use. Otherwise any version should work (2.12 is recommended).

Kafka 2.2.0 includes a number of significant new features. Here is a summary of some notable changes:

• Added SSL support for custom principal name
• Allow SASL connections to periodically re-authenticate
• Command line tool bin/kafka-topics.sh adds AdminClient support
• Improved consumer group management: default group.id is null instead of empty string
• API improvement:
  • Producer: introduce close(Duration)
  • AdminClient: introduce close(Duration)
  • Kafka Streams: new flatTransform() operator in Streams DSL
  • KafkaStreams (and other classed) now implement AutoClosable to support try-with-resource
  • New Serdes and default method implementations
• Kafka Streams exposed internal client.id via ThreadMetadata
• Metric improvements: All -min , -avg and -max metrics will now output NaN as default value

For more information, please read the detailed Release Notes.

• Released Feb 15, 2019
• Release Notes
• Source download: kafka-2.1.1-src.tgz (asc, sha512)
• Binary downloads:
  • Scala 2.11 — kafka_2.11-2.1.1.tgz (asc, sha512)
  • Scala 2.12 — kafka_2.12-2.1.1.tgz (asc, sha512)

  We build for multiple versions of Scala. This only matters if you are using Scala and you want a version built for the same Scala version you use. Otherwise any version should work (2.12 is recommended).

• Released Nov 20, 2018
• Release Notes
• Source download: kafka-2.1.0-src.tgz (asc, sha512)
• Binary downloads:
  • Scala 2.11 — kafka_2.11-2.1.0.tgz (asc, sha512)
  • Scala 2.12 — kafka_2.12-2.1.0.tgz (asc, sha512)

  We build for multiple versions of Scala. This only matters if you are using Scala and you want a version built for the same Scala version you use. Otherwise any version should work (2.12 is recommended).

Kafka 2.1.0 includes a number of significant new features. Here is a summary of some notable changes:

• Java 11 support
• Support for Zstandard, which achieves compression comparable to gzip with higher compression and especially decompression speeds (KIP-110)
• Avoid expiring committed offsets for active consumer group (KIP-211)
• Provide Intuitive User Timeouts in The Producer (KIP-91)
• Kafka’s replication protocol now supports improved fencing of zombies. Previously, under certain rare conditions, if a broker became partitioned from Zookeeper but not the rest of the cluster, then the logs of replicated partitions could diverge and cause data loss in the worst case (KIP-320).
• Streams API improvements (KIP-319, KIP-321, KIP-330, KIP-353, KIP-356)
• Admin script and admin client API improvements to simplify admin operation (KIP-231, KIP-308, KIP-322, KIP-324, KIP-338, KIP-340)
• DNS handling improvements (KIP-235, KIP-302)

For more information, please read the detailed Release Notes.

• Released November 9, 2018
• Release Notes
• Source download: kafka-2.0.1-src.tgz (asc, sha512)
• Binary downloads:
  • Scala 2.11 — kafka_2.11-2.0.1.tgz (asc, sha512)
  • Scala 2.12 — kafka_2.12-2.0.1.tgz (asc, sha512)

  We build for multiple versions of Scala. This only matters if you are using Scala and you want a version built for the same Scala version you use. Otherwise any version should work (2.12 is recommended).

• Released July 30, 2018
• Release Notes
• Source download: kafka-2.0.0-src.tgz (asc, sha512)
• Binary downloads:
  • Scala 2.11 — kafka_2.11-2.0.0.tgz (asc, sha512)
  • Scala 2.12 — kafka_2.12-2.0.0.tgz (asc, sha512)

  We build for multiple versions of Scala. This only matters if you are using Scala and you want a version built for the same Scala version you use. Otherwise any version should work (2.11 is recommended).

Kafka 2.0.0 includes a number of significant new features. Here is a summary of some notable changes:

• KIP-290 adds support for prefixed ACLs, simplifying access control management in large secure deployments. Bulk access to topics, consumer groups or transactional ids with a prefix can now be granted using a single rule. Access control for topic creation has also been improved to enable access to be granted to create specific topics or topics with a prefix.
• KIP-255 adds a framework for authenticating to Kafka brokers using OAuth2 bearer tokens. The SASL/OAUTHBEARER implementation is customizable using callbacks for token retrieval and validation.
• Host name verification is now enabled by default for SSL connections to ensure that the default SSL configuration is not susceptible to man-in-the-middle attacks. You can disable this verification if required.
• You can now dynamically update SSL truststores without broker restart. You can also configure security for broker listeners in ZooKeeper before starting brokers, including SSL keystore and truststore passwords and JAAS configuration for SASL. With this new feature, you can store sensitive password configs in encrypted form in ZooKeeper rather than in cleartext in the broker properties file.
• The replication protocol has been improved to avoid log divergence between leader and follower during fast leader failover. We have also improved resilience of brokers by reducing the memory footprint of message down-conversions. By using message chunking, both memory usage and memory reference time have been reduced to avoid OutOfMemory errors in brokers.
• Kafka clients are now notified of throttling before any throttling is applied when quotas are enabled. This enables clients to distinguish between network errors and large throttle times when quotas are exceeded.
• We have added a configuration option for Kafka consumer to avoid indefinite blocking in the consumer.
• We have dropped support for Java 7 and removed the previously deprecated Scala producer and consumer.
• Kafka Connect includes a number of improvements and features. KIP-298 enables you to control how errors in connectors, transformations and converters are handled by enabling automatic retries and controlling the number of errors that are tolerated before the connector is stopped. More contextual information can be included in the logs to help diagnose problems and problematic messages consumed by sink connectors can be sent to a dead letter queue rather than forcing the connector to stop.
• KIP-297 adds a new extension point to move secrets out of connector configurations and integrate with any external key management system. The placeholders in connector configurations are only resolved before sending the configuration to the connector, ensuring that secrets are stored and managed securely in your preferred key management system and not exposed over the REST APIs or in log files.
• We have added a thin Scala wrapper API for our Kafka Streams DSL, which provides better type inference and better type safety during compile time. Scala users can have less boilerplate in their code, notably regarding Serdes with new implicit Serdes.
• Message headers are now supported in the Kafka Streams Processor API, allowing users to add and manipulate headers read from the source topics and propagate them to the sink topics.
• Windowed aggregations performance in Kafka Streams has been largely improved (sometimes by an order of magnitude) thanks to the new single-key-fetch API.
• We have further improved unit testibility of Kafka Streams with the kafka-streams-testutil artifact.

For more information, please read the detailed Release Notes.

• Released July 19, 2018
• Release Notes
• Source download: kafka-1.1.1-src.tgz (asc, sha512)
• Binary downloads:
  • Scala 2.11 — kafka_2.11-1.1.1.tgz (asc, sha512)
  • Scala 2.12 — kafka_2.12-1.1.1.tgz (asc, sha512)

  We build for multiple versions of Scala. This only matters if you are using Scala and you want a version built for the same Scala version you use. Otherwise any version should work (2.11 is recommended).

• Released March 28, 2018
• Release Notes
• Source download: kafka-1.1.0-src.tgz (asc, sha512)
• Binary downloads:
  • Scala 2.11 — kafka_2.11-1.1.0.tgz (asc, sha512)
  • Scala 2.12 — kafka_2.12-1.1.0.tgz (asc, sha512)

  We build for multiple versions of Scala. This only matters if you are using Scala and you want a version built for the same Scala version you use. Otherwise any version should work (2.11 is recommended).

Kafka 1.1.0 includes a number of significant new features. Here is a summary of some notable changes:

• Kafka 1.1.0 includes significant improvements to the Kafka Controller that speed up controlled shutdown. ZooKeeper session expiration edge cases have also been fixed as part of this effort.
• Controller improvements also enable more partitions to be supported on a single cluster. KIP-227 introduced incremental fetch requests, providing more efficient replication when the number of partitions is large.
• KIP-113 added support for replica movement between log directories to enable data balancing with JBOD.
• Some of the broker configuration options like SSL keystores can now be updated dynamically without restarting the broker. See KIP-226 for details and the full list of dynamic configs.
• Delegation token based authentication (KIP-48) has been added to Kafka brokers to support large number of clients without overloading Kerberos KDCs or other authentication servers.
• Several new features have been added to Kafka Connect, including header support (KIP-145), SSL and Kafka cluster identifiers in the Connect REST interface (KIP-208 and KIP-238), validation of connector names (KIP-212) and support for topic regex in sink connectors (KIP-215). Additionally, the default maximum heap size for Connect workers was increased to 2GB.
• Several improvements have been added to the Kafka Streams API, including reducing repartition topic partitions footprint, customizable error handling for produce failures and enhanced resilience to broker unavailability. See KIPs 205, 210, 220, 224 and 239 for details.

For more information, please read the detailed Release Notes.

• Released July 8th, 2018
• Release Notes
• Source download: kafka-1.0.2-src.tgz (asc, sha512)
• Binary downloads:
  • Scala 2.11 — kafka_2.11-1.0.2.tgz (asc, sha512)
  • Scala 2.12 — kafka_2.12-1.0.2.tgz (asc, sha512)

  We build for multiple versions of Scala. This only matters if you are using Scala and you want a version built for the same Scala version you use. Otherwise any version should work (2.11 is recommended).

• Released March 5, 2018
• Release Notes
• Source download: kafka-1.0.1-src.tgz (asc, sha512)
• Binary downloads:
  • Scala 2.11 — kafka_2.11-1.0.1.tgz (asc, sha512)
  • Scala 2.12 — kafka_2.12-1.0.1.tgz (asc, sha512)

  We build for multiple versions of Scala. This only matters if you are using Scala and you want a version built for the same Scala version you use. Otherwise any version should work (2.11 is recommended).

• Released November 1, 2017
• Source download: kafka-1.0.0-src.tgz (asc, sha512)
• Binary downloads:
  • Scala 2.11 — kafka_2.11-1.0.0.tgz (asc, sha512)
  • Scala 2.12 — kafka_2.12-1.0.0.tgz (asc, sha512)

  We build for multiple versions of Scala. This only matters if you are using Scala and you want a version built for the same Scala version you use. Otherwise any version should work (2.11 is recommended).

Kafka 1.0.0 is no mere bump of the version number. The Apache Kafka Project Management Committee has packed a number of valuable enhancements into the release. Here is a summary of a few of them:

• Since its introduction in version 0.10, the Streams API has become hugely popular among Kafka users, including the likes of Pinterest, Rabobank, Zalando, and The New York Times. In 1.0, the the API continues to evolve at a healthy pace. To begin with, the builder API has been improved (KIP-120). A new API has been added to expose the state of active tasks at runtime (KIP-130). The new cogroup API makes it much easier to deal with partitioned aggregates with fewer StateStores and fewer moving parts in your code (KIP-150). Debuggability gets easier with enhancements to the print() and writeAsText() methods (KIP-160). And if that’s not enough, check out KIP-138 and KIP-161 too. For more on streams, check out the Apache Kafka Streams documentation, including some helpful new tutorial videos.
• Operating Kafka at scale requires that the system remain observable, and to make that easier, we’ve made a number of improvements to metrics. These are too many to summarize without becoming tedious, but Connect metrics have been significantly improved (KIP-196), a litany of new health check metrics are now exposed (KIP-188), and we now have a global topic and partition count (KIP-168). Check out KIP-164 and KIP-187 for even more.
• We now support Java 9, leading, among other things, to significantly faster TLS and CRC32C implementations. Over-the-wire encryption will be faster now, which will keep Kafka fast and compute costs low when encryption is enabled.
• In keeping with the security theme, KIP-152 cleans up the error handling on Simple Authentication Security Layer (SASL) authentication attempts. Previously, some authentication error conditions were indistinguishable from broker failures and were not logged in a clear way. This is cleaner now.
• Kafka can now tolerate disk failures better. Historically, JBOD storage configurations have not been recommended, but the architecture has nevertheless been tempting: after all, why not rely on Kafka’s own replication mechanism to protect against storage failure rather than using RAID? With KIP-112, Kafka now handles disk failure more gracefully. A single disk failure in a JBOD broker will not bring the entire broker down; rather, the broker will continue serving any log files that remain on functioning disks.
• Since release 0.11.0, the idempotent producer (which is the producer used in the presence of a transaction, which of course is the producer we use for exactly-once processing) required max.in.flight.requests.per.connection to be equal to one. As anyone who has written or tested a wire protocol can attest, this put an upper bound on throughput. Thanks to KAFKA-5949, this can now be as large as five, relaxing the throughput constraint quite a bit.

For more information, please read the detailed Release Notes.

0.11.0.3

• Released July 2ed, 2018
• Release Notes
• Source download: kafka-0.11.0.3-src.tgz (asc, sha512)
• Binary downloads:
  • Scala 2.11 — kafka_2.11-0.11.0.3.tgz (asc, sha512)
  • Scala 2.12 — kafka_2.12-0.11.0.3.tgz (asc, sha512)

  We build for multiple versions of Scala. This only matters if you are using Scala and you want a version built for the same Scala version you use. Otherwise any version should work (2.11 is recommended).

0.11.0.2

• Released November 17, 2017
• Release Notes
• Source download: kafka-0.11.0.2-src.tgz (asc, sha512)
• Binary downloads:
  • Scala 2.11 — kafka_2.11-0.11.0.2.tgz (asc, sha512)
  • Scala 2.12 — kafka_2.12-0.11.0.2.tgz (asc, sha512)

  We build for multiple versions of Scala. This only matters if you are using Scala and you want a version built for the same Scala version you use. Otherwise any version should work (2.11 is recommended).

0.11.0.1

• Released September 13, 2017
• Release Notes
• Source download: kafka-0.11.0.1-src.tgz (asc, md5)
• Binary downloads:
  • Scala 2.11 — kafka_2.11-0.11.0.1.tgz (asc, md5)
  • Scala 2.12 — kafka_2.12-0.11.0.1.tgz (asc, md5)

  We build for multiple versions of Scala. This only matters if you are using Scala and you want a version built for the same Scala version you use. Otherwise any version should work (2.11 is recommended).

0.11.0.0

• Released June 28, 2017
• Release Notes
• Source download: kafka-0.11.0.0-src.tgz (asc, md5)
• Binary downloads:
  • Scala 2.11 — kafka_2.11-0.11.0.0.tgz (asc, md5)
  • Scala 2.12 — kafka_2.12-0.11.0.0.tgz (asc, md5)

  We build for multiple versions of Scala. This only matters if you are using Scala and you want a version built for the same Scala version you use. Otherwise any version should work (2.11 is recommended).

0.10.2.2

• Released July 2nd, 2018
• Release Notes
• Source download: kafka-0.10.2.2-src.tgz (asc, md5)
• Binary downloads:
  • Scala 2.10 — kafka_2.10-0.10.2.2.tgz (asc, md5)
  • Scala 2.11 — kafka_2.11-0.10.2.2.tgz (asc, md5)
  • Scala 2.12 — kafka_2.12-0.10.2.2.tgz (asc, md5)

  We add 2.12 to the supported Scala version. These different versions only matter if you are using Scala and you want a version built for the same Scala version you use. Otherwise any version should work (2.11 is recommended).

0.10.2.1

• Released April 26, 2017
• Release Notes
• Source download: kafka-0.10.2.1-src.tgz (asc, md5)
• Binary downloads:
  • Scala 2.10 — kafka_2.10-0.10.2.1.tgz (asc, md5)
  • Scala 2.11 — kafka_2.11-0.10.2.1.tgz (asc, md5)
  • Scala 2.12 — kafka_2.12-0.10.2.1.tgz (asc, md5)

  We add 2.12 to the supported Scala version. These different versions only matter if you are using Scala and you want a version built for the same Scala version you use. Otherwise any version should work (2.11 is recommended).

0.10.2.0

• Released February 21, 2017
• Release Notes
• Source download: kafka-0.10.2.0-src.tgz (asc, md5)
• Binary downloads:
  • Scala 2.10 — kafka_2.10-0.10.2.0.tgz (asc, md5)
  • Scala 2.11 — kafka_2.11-0.10.2.0.tgz (asc, md5)
  • Scala 2.12 — kafka_2.12-0.10.2.0.tgz (asc, md5)

  We add 2.12 to the supported Scala version. These different versions only matter if you are using Scala and you want a version built for the same Scala version you use. Otherwise any version should work (2.11 is recommended).

0.10.1.1

• Released December 20, 2016
• Release Notes
• Source download: kafka-0.10.1.1-src.tgz (asc, md5)
• Binary downloads:
  • Scala 2.10 — kafka_2.10-0.10.1.1.tgz (asc, md5)
  • Scala 2.11 — kafka_2.11-0.10.1.1.tgz (asc, md5)
  • Scala 2.12 (pre-alpha) — kafka_2.12-0.10.1.1.tgz (asc, md5)

  We build for multiple versions of Scala, and include 2.12 as a pre-alpha before the next major release. This only matters if you are using Scala and you want a version built for the same Scala version you use. Otherwise any version should work (2.11 is recommended).

0.10.1.0

• Released October 20, 2016
• Release Notes
• Source download: kafka-0.10.1.0-src.tgz (asc, md5)
• Binary downloads:
  • Scala 2.10 — kafka_2.10-0.10.1.0.tgz (asc, md5)
  • Scala 2.11 — kafka_2.11-0.10.1.0.tgz (asc, md5)

  We build for multiple versions of Scala. This only matters if you are using Scala and you want a version built for the same Scala version you use. Otherwise any version should work (2.11 is recommended).

0.10.0.1

• Released August 10, 2016
• Release Notes
• Source download: kafka-0.10.0.1-src.tgz (asc, md5)
• Binary downloads:
  • Scala 2.10 — kafka_2.10-0.10.0.1.tgz (asc, md5)
  • Scala 2.11 — kafka_2.11-0.10.0.1.tgz (asc, md5)

  We build for multiple versions of Scala. This only matters if you are using Scala and you want a version built for the same Scala version you use. Otherwise any version should work (2.11 is recommended).

0.10.0.0

• Released May 22, 2016
• Release Notes
• Source download: kafka-0.10.0.0-src.tgz (asc, md5)
• Binary downloads:
  • Scala 2.10 — kafka_2.10-0.10.0.0.tgz (asc, md5)
  • Scala 2.11 — kafka_2.11-0.10.0.0.tgz (asc, md5)

  We build for multiple versions of Scala. This only matters if you are using Scala and you want a version built for the same Scala version you use. Otherwise any version should work (2.11 is recommended).

• Released February 19, 2016
• Release Notes
• Source download: kafka-0.9.0.1-src.tgz (asc, md5)
• Binary downloads:
  • Scala 2.10 — kafka_2.10-0.9.0.1.tgz (asc, md5)
  • Scala 2.11 — kafka_2.11-0.9.0.1.tgz (asc, md5)

  We build for multiple versions of Scala. This only matters if you are using Scala and you want a version built for the same Scala version you use. Otherwise any version should work (2.11 is recommended).

• Released November 23, 2015
• Release Notes
• Source download: kafka-0.9.0.0-src.tgz (asc, md5)
• Binary downloads:
  • Scala 2.10 — kafka_2.10-0.9.0.0.tgz (asc, md5)
  • Scala 2.11 — kafka_2.11-0.9.0.0.tgz (asc, md5)

  We build for multiple versions of Scala. This only matters if you are using Scala and you want a version built for the same Scala version you use. Otherwise any version should work (2.11 is recommended).

• Released October 2, 2015
• Release Notes
• Source download: kafka-0.8.2.2-src.tgz (asc, md5)
• Binary downloads:
  • Scala 2.9.1 — kafka_2.9.1-0.8.2.2.tgz (asc, md5)
  • Scala 2.9.2 — kafka_2.9.2-0.8.2.2.tgz (asc, md5)
  • Scala 2.10 — kafka_2.10-0.8.2.2.tgz (asc, md5)
  • Scala 2.11 — kafka_2.11-0.8.2.2.tgz (asc, md5)

  We build for multiple versions of Scala. This only matters if you are using Scala and you want a version built for the same Scala version you use. Otherwise any version should work (2.10 is recommended).

• Released March 11, 2015
• Release Notes
• Source download: kafka-0.8.2.1-src.tgz (asc, md5)
• Binary downloads:
  • Scala 2.9.1 — kafka_2.9.1-0.8.2.1.tgz (asc, md5)
  • Scala 2.9.2 — kafka_2.9.2-0.8.2.1.tgz (asc, md5)
  • Scala 2.10 — kafka_2.10-0.8.2.1.tgz (asc, md5)
  • Scala 2.11 — kafka_2.11-0.8.2.1.tgz (asc, md5)

  We build for multiple versions of Scala. This only matters if you are using Scala and you want a version built for the same Scala version you use. Otherwise any version should work (2.10 is recommended).

• Released February 2, 2015
• Release Notes
• Source download: kafka-0.8.2.0-src.tgz (asc, md5)
• Binary downloads:
  • Scala 2.9.1 — kafka_2.9.1-0.8.2.0.tgz (asc, md5)
  • Scala 2.9.2 — kafka_2.9.2-0.8.2.0.tgz (asc, md5)
  • Scala 2.10 — kafka_2.10-0.8.2.0.tgz (asc, md5)
  • Scala 2.11 — kafka_2.11-0.8.2.0.tgz (asc, md5)

  We build for multiple versions of Scala. This only matters if you are using Scala and you want a version built for the same Scala version you use. Otherwise any version should work (2.10 is recommended).

0.8.2-beta

• Released October 28, 2014
• Release Notes
• Source download: kafka-0.8.2-beta-src.tgz (asc, md5)
• Binary downloads:
  • Scala 2.9.1 — kafka_2.9.1-0.8.2-beta.tgz (asc, md5)
  • Scala 2.9.2 — kafka_2.9.2-0.8.2-beta.tgz (asc, md5)
  • Scala 2.10 — kafka_2.10-0.8.2-beta.tgz (asc, md5)
  • Scala 2.11 — kafka_2.11-0.8.2-beta.tgz (asc, md5)

  We build for multiple versions of Scala. This only matters if you are using Scala and you want a version built for the same Scala version you use. Otherwise any version should work (2.10 is recommended).

0.8.1.1 Release

• Released April 29, 2014
• Release Notes
• Source download: kafka-0.8.1.1-src.tgz (asc, md5)
• Binary downloads:
  • Scala 2.8.0 — kafka_2.8.0-0.8.1.1.tgz (asc, md5)
  • Scala 2.9.1 — kafka_2.9.1-0.8.1.1.tgz (asc, md5)
  • Scala 2.9.2 — kafka_2.9.2-0.8.1.1.tgz (asc, md5)
  • Scala 2.10 — kafka_2.10-0.8.1.1.tgz (asc, md5)

  We build for multiple versions of Scala. This only matters if you are using Scala and you want a version built for the same Scala version you use. Otherwise any version should work (2.9.2 is recommended).

0.8.1 Release

• Released March 12, 2014
• Release Notes
• Source download: kafka-0.8.1-src.tgz (asc, md5)
• Binary downloads:
  • Scala 2.8.0 — kafka_2.8.0-0.8.1.tgz (asc, md5)
  • Scala 2.8.2 — kafka_2.8.2-0.8.1.tgz (asc, md5)
  • Scala 2.9.1 — kafka_2.9.1-0.8.1.tgz (asc, md5)
  • Scala 2.9.2 — kafka_2.9.2-0.8.1.tgz (asc, md5)
  • Scala 2.10 — kafka_2.10-0.8.1.tgz (asc, md5)

  We build for multiple versions of Scala. This only matters if you are using Scala and you want a version built for the same Scala version you use. Otherwise any version should work (2.9.2 is recommended).

0.8.0 Release

• Released December 3, 2013
• Release Notes
• Source download: kafka-0.8.0-src.tgz (asc, md5)
• Binary download: kafka_2.8.0-0.8.0.tar.gz (asc, md5)

0.8.0 Beta1 Release

• Released June 28, 2013
• Release Notes
• Source download: kafka-0.8.0-beta1-src.tgz (asc, md5)
• Binary download: kafka_2.8.0-0.8.0-beta1.tgz (asc, md5)

0.7.2 Release

• Released October 10, 2012
• Release Notes
• Download: kafka-0.7.2-incubating-src.tgz (asc, md5)

0.7.1 Release

• Released June 27, 2012
• Release Notes
• Download: kafka-0.7.1-incubating-src.tgz (asc, md5)

0.7.0 Release

• Released January 4, 2012
• Release Notes
• Download: kafka-0.7.0-incubating-src.tar.gz (asc, md5)

You can download releases previous to 0.7.0-incubating here.

Источник