AI Features
Home
Courses
Mastering Apache Kafka

Kafka Connect Sink Connectors

Learn about the Kafka Connect Sink connectors and how to build a data pipeline from Kafka to PostgreSQL.

We'll cover the following...

Kafka Connect has Sink connectors for various systems, including databases. Here, we will learn how to build a data pipeline from Kafka to PostgreSQL using the popular JDBC Sink connector.

Here is a high-level representation of the solution we will implement. Let’s dive into its individual building blocks and understand how they work.

End-to-end solution using thw JDBC Sink connector
End-to-end solution using thw JDBC Sink connector

Kafka JDBC Sink connector

The Kafka Connect JDBC Sink connector allows us to export data from Apache Kafka topics to any relational database with a JDBC driver. The connector provides many capabilities, most of which are configured/activated using the connector properties. Here are some of the important ones:

  • It can create the destination table if it is missing (the auto.create configuration should be set to true).

  • If ...

Ask