Managed Databases for Kafka
In just a few clicks, you can deploy an Apache Kafka cluster that is 100% managed by our teams, while retaining control of your data. With this service, you can focus on developing your applications without having to worry about managing their configuration, monitoring, backup, redundancy and updates.
Your ready-to-use Kafka cluster can be directly deployed in just a few clicks. Support your developers with a platform that can collect, store and process continuous streams of event data or real-time data.
Control your budget
Our transparent and predictable pricing model includes all network traffic. You only pay for using Apache Kafka, which is billed by the hour.
Maintain control of your data
Apache Kafka runs on our trusted cloud, which complies with strict certifications. Our goal is to give you complete control of your data.
ISO/IEC 27001, 27701 and health data hosting compliance
Our cloud infrastructures and services are ISO/IEC 27001, 27017, 27018 and 27701 certified. These certifications ensure the presence of an information security management system (ISMS) for managing risks, vulnerabilities and implementing business continuity, as well as a privacy information management system (PIMS). Thanks to our compliance, you can host healthcare data securely.
Compare our Managed Databases for Kafka packs
|Number of nodes||3 nodes included||6 nodes included|
|RAM per node||7GB to 60GB||7GB to 60GB|
|Storage per node||960GB to 7.68TB SSD||1.92TB to 15.36TB SSD|
|Service Level Agreement (SLA)||99.9%||99.95%|
|Switches between different packs||Yes||Yes|
|Updates to new major versions in 1 click||Yes||Yes|
|Data encryption at rest and in transit (SSL)||Yes||Yes|
|Terraform Provider support (more information)||Yes||Yes|
|Data retention||Depending on disk space||Depending on disk space|
|Kafka Connect||Coming soon||Coming soon|
|Private network connectivity (vRack)||Yes||Yes|
Managed Databases for Kafka use cases
Real-time data processing
Our service is ideal for applications that need to quickly process large volumes of data. It allows you to more easily use Apache Kafka for live data input and analysis.
Large-scale message processing
Compared to traditional email systems, Apache Kafka architecture offers better throughput, high scalability and fault tolerance, which makes it a good solution for data processing.
In a decentralised architecture, Apache Kafka acts as an intermediary in the communication between different micro-services. In a cloud-native approach, this solution also makes it possible to create an event-driven architecture, meaning that your micro-services are triggered in real time by events.
Documentation and guides
Do you need support getting started with your service? Check out our tutorials and documentation.
Find out how to order a Managed Databases For Kafka service via the API
Keep all your Apache Kafka message schemas in a centralised registry for better data governance.
Use Apache Kafka via HTTP on platforms where Kafka connectors are not yet available.
Kafka Connect (coming soon)
Import or export your data with your Kafka cluster from or to a third-party system (such as a RDBMS, ERP, storage server, or a third-party application).
With the message publishing and subscription mechanism, you can publish messages on a given topic and distribute them to subscribers.
Scalability and high availability
The Managed Databases for Kafka plans offer a minimum of a 3-node cluster. They also have a data replication function, making your services more easily available.
To ensure data confidentiality, Apache Kafka uses the Transport Layer Security/Secure Sockets Layer (TLS/SSL) protocol to encrypt data at rest or in transit.
Private network connectivity (vRack)
With our Business and Enterprise solutions, you can restrict access to your database service thanks to our private network. You also get up to 2Gbit/s bandwidth.
Access Control List (ACL)
Manage users and topic entries in your Publish-Subscribe pattern, so you can filter and restrict access to your information.
Does your business need high availability for your critical deployments? With the Enterprise range, you get 3-node clusters and a guaranteed 99.95% SLA.
Use your dashboard to manage your users, backups, and monitor statistics for your requests, logs, and metrics. To access it, simply log in to your OVHcloud Control Panel.
Real-time log visualisation
Analyse or perform diagnostics on your database to optimise the running of your application by viewing up to the last 100 lines of real-time logs.
Terraform support (coming soon)
Save time by automating your deployments. Thanks to Terraform API and tool support, you can provision your databases automatically, so you can keep multiple environments in your application running.
Managed Databases for Kafka pricing
You receive a bill at the end of each month, which is calculated based on your database usage per hour. The price depends on the plan you have chosen (Business or Enterprise).
Deploy private networks, supported by the OVHcloud vRack, to connect your instances across the globe
Orchestrate your containerised applications with a CNCF-certified Kubernetes cluster
What is Apache Kafka?
Apache Kafka is a distributed, scalable and open-source platform. It is used to create data processing pipelines and real-time streaming data applications. Its system is well-known for facilitating the real-time management of large databases. It is compatible with a wide range of programming languages (frameworks) such as Python, Query, PHP, Java, and Ruby.
How does Apache Kafka work?
The incoming data transferred through this system are organised into topics, which can be structured according to the type of collected data they contain. Apache Kafka’s clustered architecture is orchestrated by a timestamp that sorts, replicates, then distributes this data. The sources publishing data in these topics are called “producers” or “publishers”. Those who read this data are called “consumers” or “subscribers”. They can both access Kafka Stream, the platform’s Java library. The library uses queues to manage the data flows between these sources without overloading them. It is therefore able to distribute information between different systems (such as servers, data storage spaces, and relational databases). This centralised management facilitates the processing of large volumes of data generated by big data, machine learning, and more.
Why use Apache Kafka?
This solution is ideal for applications that require fast live data analysis. Its role as a broker in centralised message processing also allows for a better management of your information.
What’s the difference between Apache Kafka and RabbitMQ?
Both solutions are open-source, but have different advantages. As mentioned above, Kafka’s strength is its ability to manage high volumes of data. It is more useful if you are working with big data or machine learning. RabbitMQ is better suited for low-latency message delivery and complex routing. Furthermore, this solution is actually a piece of distribution software rather than a distribution platform.
What is Managed Databases for Kafka?
Managed Databases for Kafka is a DBaaS (Database as a Service). It is one of the managed services available on our Public Cloud. Our goal is to save you time in your job, by entrusting us with the management and maintenance of your database.
Can I install Kafka on Public Cloud instances myself?
Once you have downloaded and accepted Kafka’s licence agreement, it is indeed possible. However, you will also need to manage and administer the database, and you will not benefit from the capabilities we provide in our turnkey service.
What is the difference between the Essential, Business and Enterprise service plans?
Each plan includes different features for different uses. Among other factors, they do not all have the same benefits or the same level of availability.
Is the data stored in Managed Databases for Kafka shared with third parties?
No. You retain complete control over your data. When you use Managed Databases for Kafka, your data is placed in a storage space dedicated solely to your use.
Can I migrate to nodes with a higher capacity?
You can do this if you need more RAM. However, you cannot revert to a lower-capacity node.
Does Managed Databases for Kafka have a backup feature?
Yes. We provide automated backups with each solution. However, the default retention policies differ depending on the chosen range.
Can this solution be integrated into a Public Cloud project?
Yes, our service can be used as a resource, or as part of a Public Cloud infrastructure. You can manage it from your Control Panel, the OVHcloud API or the OpenStack API. We also offer managed services for managing relational databases (SQL), such as MySQL and PostgreSQL, or non-relational databases (NoSQL), such as Redis or MongoDB.
Why do I have to pay to use Managed Databases for Kafka when the service is based on an open-source licence?
We perform all database management and administration tasks for you, so you don’t have to worry about maintenance. It is this added value that we charge as a service.
Can I connect Managed Databases for Kafka with my Bare Metal server?
Yes, Managed Databases for Kafka can be connected to your dedicated server via a public or private network. However, you will need to do this yourself, and then manage and administer your own database.