Shankara Narayana

Cab hiring application with an ads system.

Project Details

• Explored and identified the characteristics of IoT stream data.
• Generated streams of data using Kafka and made it available for a Samza consumer.
• Practiced test-driven development (TDD) on Kafka and Samza when developing solutions for handling big data.
• Designed and implemented a solution to join and process multiple streams of GPS data using Samza API to set up a driver matching service like Uber.
• Designed and implemented a solution to join and process streams of IoT device data and static data using Samza API to set up an advertising system.
• Experimented with deploying a Kafka and Samza stream processing system on the YARN cluster provisioned on the cloud.
• Managed and monitored Samza jobs on Yarn. Explored different debugging techniques when running a Samza job on YARN.
• Experimented using Kafka in a frontend application to update its state.