Yandex Managed Service for Apache Kafka®

A service for creating and managing Apache Kafka® clusters in the Yandex Cloud infrastructure.

Kafka is an open‑source platform for distributed delivery, storage, and processing of real‑time data.

Ease of use

Focus on developing data stream processing applications and don’t waste time maintaining the infrastructure. Managed Service for Apache Kafka is responsible for managing Zookeeper brokers and clusters, configuring clusters, and updating their versions.

High availability

Distribute your cluster brokers across different availability zones and set the replication factor to ensure the desired level of fault tolerance. The service analyzes the metrics and status of the cluster and automatically replaces it if one of the nodes fails.

Efficient resource usage

For each topic, you can set the replication factor, log cleanup policy, compression type, and maximum number of messages to make better use of computing, network, and disk resources.

Scalability

You can add brokers to your cluster with just a click of a button to improve its performance, or change the class of high-availability hosts without stopping them or losing any data.

Security

All connections are encrypted using the TLS protocol. User access to topics is provided using SASL authentication and access control lists (ACL). The service meets local regulatory requirements, GDPR, and ISO standards.

Real-time analytics

With Kafka, you can deliver data directly to ClickHouse® without any additional development. ClickHouse is great at handling queries to large amounts of data. And Yandex DataLens lets you visualize this data and create reports.

We'll take care of most cluster maintenance

Processes
Managed Service for Apache Kafka
Kafka self‑installation
Data access control
VM deployment
Network configurations
OS and software installation
Broker updates
Data storage and hardware security
Monitoring tools

You control

Yandex Cloud controls

Getting started

Select the necessary computing capacity and create a ready-to-use Kafka cluster.

Save up to 22% with reserved managed databases

Get up to 22% in savings on managed databases in the cloud — just reserve resources for six months or a year in advance, right in the management console.

Learn more

Questions and answers

What are the characteristic features of Kafka?

Kafka is a distributed message broker that can be scaled horizontally for streaming data between applications and their components. Kafka is based on the publication-subscription model and delivers data to and from applications using topics.

Get started with Managed Service for Apache Kafka

Apache® and Apache Kafka® are either registered trademarks or trademarks of the Apache Software Foundation in the United States and/or other countries.

ClickHouse is a registered trademark of ClickHouse, Inc.