Looking for a job

Mitesh Shah

@miteshshah

Data engineer at Accenture building resilient ingestion and serving systems, including a pricing API that cut P99 latency from 80ms to 6ms.

India

Message

At Accenture Technology Services, I developed migration validation frameworks for a 400GB/day ingestion platform, enabling a production cutover with zero data loss. I also implemented adaptive rate limiting for streaming consumers, reducing service throttling by 42%.

At Capgemini Technology Services, I developed CDC-based ingestion pipelines for 23+ source systems processing 4TB+ daily and improved data completeness from 50% to 90%. In my DeltaSync project, I built a CDC-driven lakehouse replication engine with replay-safe micro-batches and schema evolution.

Experience

Work history, roles, and key accomplishments

Current

Senior Analyst (Senior Data Engineer)

Current

Accenture Technology Services

Jan 2025 - Present (1 year 9 months)

Developed dependency mapping and validation frameworks for a 400GB/day ingestion platform, enabling seamless production cutover with zero data loss. Implemented adaptive rate-limiting and exponential backoff for event-driven consumers, reducing service throttling by 42% and stabilizing downstream reporting latency.

Python PySpark Kafka SQL Databricks Redis Azure Git

Associate Consultant (Data Engineer)

Capgemini Technology Services

Jul 2021 - Jan 2025 (3 years 6 months)

Developed CDC-based ingestion pipelines using Debezium and Kafka for 23+ source systems processing 4TB+ daily, improving data completeness from 50% to 90%. Redesigned storage layouts for high-cardinality datasets, improving query latency by 40% and tuning Spark configurations to reduce execution time from 5 hours to 1.7 hours.

Debezium Kafka Azure Data Factory Databricks Spark SQL