manideep reddy

I’m an Azure Data Engineer with 7+ years of IT experience and 4+ years specializing in cloud data engineering, ETL/ELT development, and enterprise data warehousing. I focus on building secure, scalable, high-availability data pipelines that turn requirements into reliable analytics.

In my current role at Tiger Analytics, I engineered ingestion workflows using PySpark and Python and achieved 99.8% pipeline uptime across streaming and batch sources (APIs, flat files, and RDBMS). I also improved pipeline performance by 3x through query optimization, efficient joins, and cluster/resource tuning in ADF and Databricks.

I architected Azure Data Factory pipelines for on-premises to Azure cloud migration, delivering zero data loss and minimal downtime. I implemented Delta Lake architecture with fact and dimension models, automated orchestration with ADF triggers/event-based workflows, and enforced data quality via validation rules, reconciliation checks, and anomaly detection.

Previously at Infosys, I developed reusable ADF pipeline templates, optimized SQL with stored procedures/views/indexes, and set up ARM template-based deployments for consistent environments. Earlier at Speroware Technologies, I gained AWS hands-on experience (EC2, S3, RDS, IAM, Lambda) and supported migrations, monitoring, and cost optimization—backed by Microsoft certifications including DP-900, DP-203, and DP-700.