README.md

Demo Rosetta Unlimited

Demonstration of the use of technologies related to data streaming processing.

• Apache Kafka
• Confluent Platform
• Debezium Connector
• Kafka Connect Datagen
• Elasticsearch Sink Connector
• Kafka Streams
• KsqlDB
• MySQL
• Elastic

Architecture

Prerequisites

• Install Confluent Platform
• Create the MySQL database and tables according to the script: mysql-rosetta-setup.sql

Project execution

foo@bar:~$ ./setup-demo-customers
foo@bar:~$ ./setup-demo-customers ksql
foo@bar:~$ ./setup-demo-calls.sh
foo@bar:~$ ./setup-demo-calls.sh ksql
foo@bar:~$ ./setup-demo-calls-customers.sh

Checks

You can check the result with:

foo@bar:~$ kafka-avro-console-consumer --bootstrap-server localhost:9092 --topic CALLS_CLIENTES_ENR --from-beginning

Dashboard