Learn how to use Airbyte, Kafka, and Pinot to build a real-time data pipeline for a user-facing analytics dashboard. This article explores three popular open-source products in the data space, Airbyte, Apache Kafka, and Apache Pinot, to build a user-facing e-commerce dashboard that updates in real-time. The post discusses the key components of the solution, including ELT pipelines, an event streaming platform, and an analytical database. We use Airbytes MySQL CDC source to extract orders from a MySQL database, Kafka for streaming data, and Pinot for fast OLAP querying on streaming data. Having access to the source code avoids vendor-locking, giving you the flexibility to customize the solution to tailor your organizational needs.
