Apache Kafka® is a stream-processing solution for collecting, processing, storing, and analysing data at scale. Excellent performance, low latency, fault tolerance, and high throughput allow Kafka to handle thousands of messages per second, build data pipelines, leverage real-time data streams, enable operational metrics, and integrate data across many sources.
Kafka combines three key capabilities:
- To publish (write) and subscribe to (read) streams of events, including continuous import/export of your data from other systems.
- To store streams of events durably and reliably for as long as you want.
- To process streams of events as they occur or retrospectively.
Warning
If you are going to use this product in production, we recommend to configure it according to the Kafka recommendations.
-
Click the button in this card to go to VM creation. The image will be automatically selected under Image/boot disk selection.
-
Under Network settings, enable a public IP address for the VM (Public IP:
Autofor a random address orListif you have a reserved static address). -
Under Access, paste the public key from the pair into the SSH key field.
-
Create the VM.
-
Check that Apache Kafka® is running and accessible:
-
Install kcat.
-
Get metadata from the Kafka broker:
kcat -b <public_IP_address_of_VM> -L
- Foundation for data platforms, event-driven architectures, and microservices.
- Payments and financial transactions real-time processing.
- Cars, fleets, and shipments real-time tracking.
- Customers orders processing, predicting changes in patients condition to ensure timely treatment.
- Continuous analysis of sensor data from IoT devices or other equipment.
Nebius AI does not provide technical support for the product. If you have any issues, please refer to the developer’s information resources.