Ambuj Kumar

Senior Data Engineer with over 9 years of experience in building data-intensive applications and managing data repositories for efficient visualization. Developed real-time streaming and batch lambda architecture pipelines for ingesting blockchain events and populating KPIs/dashboard warehouses. Skilled in optimizing and benchmarking solutions using various data technologies.

Created streaming pipelines to ingest sensor data and process it in real-time for dashboards and data warehouses. Developed pipelines for sensor data published into Kinesis and S3, ensuring data quality testing and improvement through periodic comparison jobs.

Worked on API source ingestion and entity modeling using Azure Cosmos and Scala. Designed and implemented a data warehouse for KPI tracking, managing scaled ingestion from public competitor APIs for analytics.

Developed Spark batch jobs and implemented Flask APIs for a kiosk monitoring product. Designed a lambda architecture for data ingestion and alert detection using MQTT and Kafka.

Involved in deployment and maintenance of Azure cloud-based clusters and pipeline design for GE Healthcare's device monitoring product. Implemented detection algorithms and data modeling for real-time data storage.

Activities and societies: Worked on global multi-region sources and rule-based implementation of Spark Azure Databricks notebooks. Integrated entities in the property domain using Azure Cosmos Graph.

Completed a Bachelor's degree in Engineering, focusing on various aspects of engineering principles and applications. Engaged in projects involving API source ingestion, schema creation, and entity modeling using Azure Functions and Cosmos.