Apache Flink® is a stream processing framework that enables you to build robust, scalable, and high-performance applications. Complex event processing, pattern recognition, and windowed aggregations with Flink’s extensive set of APIs and libraries empower you to derive meaningful insights from your streaming data.
The Apache Flink Kubernetes Operator allows you to manage Apache Flink applications and their lifecycle using native k8s tooling like kubectl. This includes deploying and monitoring deployments in Application Mode and Session Mode, as well as working with logs and metrics.
You can deploy the Apache Flink Kubernetes Operator in your Nebius AI Managed Service for Kubernetes clusters using this Marketplace product.
Warning
If you are going to use this product in production, we recommend to configure it according to the Flink recommendations.
-
If you haven’t done it yet, create a Kubernetes cluster and a node group in it.
-
Install kubectl and configure it to work with the created cluster.
-
Install cert-manager using next command:
bash kubectl create -f https://github.com/jetstack/cert-manager/releases/download/v1.8.2/cert-manager.yaml
-
Click the button in this card to go to the cluster selection form.
-
Select the folder and the cluster, and click Continue.
-
Click Install.
-
Wait for the application to change its status to
Deployed
. -
To check that the Apache Flink Kubernetes Operator is working, check that its pod is running:
kubectl get pods | grep "^flink"
- Processing data streams with Apache Flink in a Kubernetes cluster.
- Setting up high availability for Apache Flink.
- Customizing resource validators and listeners.
- Using templates in deployments.
- Autoscaling Apache Flink jobs.
- Collecting and exporting Apache Flink metrics.
Nebius AI does not provide technical support for the product. If you have any issues, please refer to the developer’s information resources.
Helm chart | Version | Pull-command | Documentation |
---|---|---|---|
cr.nemax.nebius.cloud/yc-marketplace/nebius/flink-operator/chart/flink-operator | v1.7.0 | Open |
Docker image | Version | Pull-command |
---|---|---|
cr.nemax.nebius.cloud/yc-marketplace/nebius/flink-operator/flink-operator1705405169250609639569424546172083454012139596221 | 1.7.0 |