Real-time data streaming project using Python, Pandas, and Confluent Kafka to publish and consume retail data through Kafka topics, demonstrating scalability and dynamic consumer behavior.
-
Updated
Dec 5, 2024 - Python
Real-time data streaming project using Python, Pandas, and Confluent Kafka to publish and consume retail data through Kafka topics, demonstrating scalability and dynamic consumer behavior.
RealTimeIncrementalSync is a real-time data streaming system that fetches product updates from a MySQL database, serializes the data in Avro format, and streams it to Kafka. Kafka consumers deserialize the data and append it to JSON files, enabling real-time monitoring and analysis of product information.
This project is a real-time people counting API designed for integration with Hanwha cameras that support the People Counting module. Built with FastAPI and utilizing Server-Sent Events (SSE), the API facilitates continuous data streaming from counting cameras to a monitoring system, providing real-time notifications of entries and exits in various
Add a description, image, and links to the real-time-data-streaming topic page so that developers can more easily learn about it.
To associate your repository with the real-time-data-streaming topic, visit your repo's landing page and select "manage topics."