Confluent Kafka
Confluent Kafka provides enhanced features and tools on top of the open-source Apache Kafka to simplify the adoption and management of Kafka. Confluent connectors play an important role in enabling seamless integration of Apache Kafka with various data sources and sinks.
Getting started with Confluent
The order in which you configure the source and sink connectors vary depending on whether you are consuming or publishing events.
Consuming events
For consuming event messages, you need to configure the source connector only. This will ensure extracting messages from the Events Service and loading into your Kafka system.
Publishing events
For publishing event messages, you need to configure the sink connector only. This will ensure extracting messages from your Kafka system and pushing it into the Events Service.
Both publishing and consuming events
When it comes to publishing and consuming events, you have the flexibility to configure either the source connector or the sink connector first.
The event order is preserved so long as the publisher includes the entity id and the consumer uses only a single instance.