My company uses Apache Kafka to keep some intermediate data in the workflow.
External reviews
External reviews are not included in the AWS star rating for the product.
Kafka
Confluent est l'une des meilleures plateformes gérées pour Kafka.
2. Registre de Schémas : Nous pouvons facilement vérifier les schémas associés à différents sujets, et même consulter les versions précédentes. Cela est également possible via un appel REST, mais Confluent regroupe tout pour faciliter la vie des développeurs ou des administrateurs.
3. KSQLDB/KSQL : KSQLDB est également une offre de Confluent, nous l'utilisons pour modifier les données en streaming ou appliquer des filtres.
4. Connecteurs : Confluent propose l'idée de connecteurs qui aide les développeurs à réduire le temps et les efforts pour écrire des applications de flux Kafka à partir de zéro. Nous pouvons simplement utiliser des connecteurs source ou puits prêts pour la production.
Revue de Confluent
Confluent est l'une des meilleures plateformes pour le streaming de données sécurisé.
With valuable features like clustering and sharding, the product also offers good stability
What is our primary use case?
What is most valuable?
Apache Kafka's most valuable features include clustering and sharding. Though we have not started using Apache Kafka Streams in our company, I have heard that it is one of the good features of the product we plan to use. The good features let you replay and reconsume messages in Apache Kafka, allowing you to have multiple consumer groups. The rebalancing feature of the product is also useful since if one consumer dies, then Apache Kafka does a rebalancing. With Apache Kafka, we use clustering, sharding, and partitioning features in our company.
What needs improvement?
In Apache Kafka, it is currently difficult to create a consumer. The implementation of Apache Kafka's features, like rebalancing, is possible only when you create a consumer, which is a very difficult task since it is overly complicated. To create a consumer in Apache Kafka, a person needs to have a very strong knowledge of the internal functioning of Apache. I feel that Kaka needs to provide a consumer so that its users don't spend time in the creation of consumers. In general, Apache Kafka must provide users with a more user-friendly UI.
For how long have I used the solution?
I have been using Apache Kafka for five years. I am just a customer of the solution.
What do I think about the stability of the solution?
It is a pretty stable solution. Stability-wise, I rate the solution a nine out of ten.
What do I think about the scalability of the solution?
Scalability-wise, I rate the solution an eight out of ten.
The users of the solution are not directly involved with it. Those who use Apache Kafka in our company use it to push orders on the frontend, and then the frontend calls for some microservice, after which the microservice pushes data to Apache Kafka. Around 10,000 to 15,000 people in my organization follow the aforementioned procedure.
How are customer service and support?
I won't be able to comment on the technical support team of Apache Kafka since some other team members in my company were involved with them. In general, my company is satisfied with the technical support team of Apache Kafka. I rate Apache Kafka's technical support an eight out of ten.
How would you rate customer service and support?
Positive
Which solution did I use previously and why did I switch?
My company started off with Apache Kafka, so they did not use any other solutions previously.
How was the initial setup?
If you are using the latest version of Apache Kafka in which the use of Zookeeper is not required, then it uses the KRaft protocol, which is built into Kafka broker. Since the use of Zookeeper is no longer required, I think the setup phase of dissolution is better than its previous versions. I rate the initial setup of the product somewhere between seven to eight out of ten.
Apache Kafka's initial setup is very straightforward.
The solution is deployed on an on-premises model.
Apache Kafka was deployed in our company within a couple of days.
Three people were involved in the deployment process of Apache Kafka.
What's my experience with pricing, setup cost, and licensing?
I rate Apache Kafka's pricing a five on a scale of one to ten, where one is cheap and ten is expensive. There are no additional costs apart from the licensing fees for Apache Kafka.
Which other solutions did I evaluate?
During my company's evaluation process for other options from Apache Kafka, we came across RabbitMQ. My company chose Apache Kafka over RabbitMQ since it was one of the market's more popular tools. With Apache Kafka, more materials, support, online technical groups, and forums were available for consumers.
What other advice do I have?
Apache Kafka as a broker tool is a very stable and good product. When you need to create a consumer in any programming language, including Java, Golang or any other programming language, the team involved in the process of the creation of a consumer should have very strong knowledge and expertise in the use of Apache Kafka since it is not at all easy to create a consumer for the product. A highly qualified person with a good amount of experience should also know the internals of the solution, which may not seem too straightforward. Anyone cannot use Apache Kafka easily without proper knowledge or experience. When you use Apache Kafka in your actual application, you need to create some producers and some consumers. To create a consumer, you need to have a very strong understanding of the solution since it is not a process that anyone can manage easily. A company needs to have a very strong team with good technical knowledge to be able to use the product.
I rate the overall solution a nine out of ten.
Which deployment model are you using for this solution?
Is very scalable and has been beneficial is in the context of financial trading
What is our primary use case?
I have previous professional experience using Kafka to implement a system related to gathering software events in one centralized location.
How has it helped my organization?
One example of how Kafka has been beneficial is in the context of financial trading. When a trade is executed, it generates an event. I used Kafka to create an application that captures these events and stores them in a topic, allowing for efficient processing in real time.
What is most valuable?
Regarding the most valuable feature in Kafka, I would say it's scalability. The publisher-subscriber pattern and low latency are also essential features that greatly piqued my interest.
What needs improvement?
Maintaining and configuring Apache Kafka can be challenging, especially when you want to fine-tune its behavior. It involves configuring traffic partitioning, understanding retention times, and dealing with various variables. Monitoring and optimizing its behavior can also be difficult.
Perhaps a more straightforward approach could be using messaging queues instead of the publish-subscribe pattern. Some solutions may not require the complex features of Apache Kafka, and a messaging queue with Kafka's capabilities might provide a more complete messaging solution for events and messages.
For how long have I used the solution?
I have been using Apache Kafka for the past 10 years.
What do I think about the stability of the solution?
The stability may improve if the configuration and management aspects become less challenging.
What do I think about the scalability of the solution?
It depends on the configuration., but scalability is one of the best features of Kafka. I would rate it nine out of ten.
How are customer service and support?
Support can vary depending on whether you're using the open source version or a paid one. Our version, the paid console version, offers highly available support, and you can find a wealth of information and assistance from various providers online. However, when I used MSA on AWS, I encountered limited support for it.
How would you rate customer service and support?
Neutral
What was our ROI?
Despite the challenges we faced with configuration and management, I believe the return on investment is safeguarded.
What's my experience with pricing, setup cost, and licensing?
The cost can vary depending on the provider and the specific flavor or version you use. I'm not very knowledgeable about the pricing details.
What other advice do I have?
I believe that when working with Kafka Apache, it's essential to have a specialist who thoroughly understands and can optimize all the available variables within the solution to achieve the desired behavior.
I would rate it an eight out of ten.