Published August 26, 2024
Kafka is a beast when it comes to handling real-time data streams, but like any powerful tool, it needs to be fine-tuned to really shine. I’ve spent more time than I’d like to admit tweaking Kafka configurations, trying to squeeze every last drop of performance out of it.
Published February 23, 2023
Apache Kafka has come a long way since its initial development at LinkedIn in 2010 and its release as an open-source project the following year. Over the past decade, it has grown from a humble messaging bus used to power internal applications into the world's most popular streaming data platform.
Published November 14, 2022
Do you want to use Kafka? Or do you need a message broker and queues? While they can seem similar, they have different purposes. I’m going to explain the differences, so you don’t try to brute force patterns and concepts in Kafka that are better used with a message broker.
Published September 14, 2022
Apache Kafka is a high-throughput, low-latency platform for handling real-time data feeds. Its storage layer is in essence a massively scalable pub/sub message queue designed as a distributed transaction log. It can be used to process streams of data in real-time, building up a commit log of changes.
Published September 2, 2022
Apache Kafka is an open-source software platform for processing streams of events. Developed for the streaming and archiving of data, Kafka is now supported by a large ecosystem of third-party applications. Developed by the founders of Confluent, Kafka was initially created in 2007 while the three creators were at LinkedIn.
Published July 14, 2022
Integration and middleware staffing issues within IT Operations and Service Delivery teams are common, even in the largest enterprises. Here is the story of one large enterprise:
Talent Issues at a Large Global Financial Services Firm
Because of the complex nature of their messaging middleware and overall integration infrastructure (i2) environment, the organization required specialists for each management tool or platform, whether from a middleware vendor, homegrown solution, or third-party management tool.
Published July 11, 2022
Selecting the right middleware for your company can be one of the most important decisions that you can make at the outset of a software project, as this will determine how well your business performs going forward. We look at some of the key features from the major integration software providers below.
Published June 8, 2022
You will have seen the Nastel Messaging Middleware Performance Benchmark Report comparing the performance of the commonly used messaging middleware platforms - IBM MQ, RabbitMQ, Apache Kafka, ActiveMQ Classic, ActiveMQ Artemis, TIBCO EMS, and Apache Pulsar.
Published June 1, 2022
Apache ActiveMQ is a free and open-source message broker developed by Apache Software Foundation. It is one of the well-known message brokers that supports multiple protocols such as AMQP, MQTT, Stomp, and OpenWire. It is written in Java and fully compliant with JMS 1.1 standards.
Published May 24, 2022
We had a fantastic time at the Kafka Summit in London this year. It was so great to be meeting everyone face to face again after such a long break. It was interesting to see how people had progressed with their Kafka implementations.
