Bhanu Shekhar

I’m a data engineer with about 2 years of experience building production pipelines on AWS and delivering enterprise analytics workflows. I focus on reliable ingestion, transformation, and monitoring so teams can ship data-driven reporting with confidence.

I’ve built and optimized pipelines using AWS Glue, Lambda, S3, and PySpark, processing 15M+ records weekly for analytics clients. I improved reporting pipeline efficiency by 30% through Spark job optimization, automated data quality checks, and SLA monitoring across production workflows.

On the Azure side, I completed Microsoft Azure Data Engineer Associate coursework and applied those skills to real projects using Azure Data Factory, Azure Databricks, Azure Synapse Analytics, Power BI, and ADLS Gen2. In my Covid reporting project, I designed Bronze-Silver-Gold ingestion, cleansing/transformation, and automated orchestration with monitoring and alerting.

In production, I’ve also converted POCs into production-grade revenue workflows, stabilized pipelines, and mentored 6 interns on debugging and pipeline best practices. I’m happiest owning end-to-end delivery—from ingestion design through production deployment—while continuously strengthening data quality, performance, and operational reliability.