I’m looking for an Azure Data Engineer role where I can build scalable data pipelines and cloud solutions using Azure, Databricks, PySpark, and Synapse. I enjoy solving data engineering challenges, optimizing performance, and working with modern data platforms. I’m also looking for opportunities to learn, grow, and contribute to impactful business solutions.
DA
Looking for a job
Dileep Avula
@dileep
Senior Azure Data Engineer specializing in Lakehouse pipelines, Spark tuning, and CDC.
IndiaWhat I'm looking for
I’m a Senior Azure Data Engineer with 5+ years designing, building, and orchestrating scalable data pipelines on Microsoft Azure. I bring deep hands-on expertise in Azure Databricks and Apache Spark for batch and near real-time processing, with a strong focus on reliability, performance, and data accuracy.
I’ve implemented enterprise-grade Lakehouse and Medallion (Bronze/Silver/Gold) architectures, Delta Lake optimization, and Spark performance tuning. My work spans Azure Data Factory, Azure Synapse Analytics, Azure SQL, and Logic Apps—plus Python (PySpark, Pandas, NumPy) for data processing, validation, and automation, including Change Data Capture (CDC), data quality frameworks, and cloud migration from on-premises systems.
Experience
Work history, roles, and key accomplishments
CO
Current
Corpay (Travel & Payments)
Corpay
Oct 2025 - Present (9 months)
Built Azure Data Factory pipelines processing high-volume airline transaction and travel payment datasets, including validation and reconciliation frameworks. Implemented monitoring/alerting and added error-handling and retry logic to improve resilience for ingestion failures and downstream reporting impacts.
JL
Current
Azure Data Engineer
Jeanmartian Systems India Pvt Ltd
Oct 2025 - Present (9 months)
Designed and orchestrated Azure Data Factory pipelines to ingest SQL Server and flat-file data for high-volume airline credit card and travel accommodation payment transactions. Built and optimized batch workflows with near real-time reporting support, including data validation and reconciliation logic across pipelines.
Designed ETL pipelines for healthcare data ingestion using a Medallion (Bronze/Silver/Gold) Databricks Lakehouse approach. Developed PySpark transformations and validation frameworks, implemented CDC-based incremental ingestion, and optimized Delta Lake tables with row-level security.
TL
Designed and developed end-to-end ETL/ELT pipelines using Azure Data Factory and Azure Databricks with PySpark-based transformations and Spark performance tuning. Implemented Medallion (Bronze/Silver/Gold) and Delta Lake optimizations, and migrated legacy on-premises SSIS workflows to Azure.
ME
Developed Azure Data Factory pipelines for policy and claims data, including incremental load (CDC-style) strategies. Built PySpark transformations, migrated legacy SSIS workflows, and supported Power BI reporting with data quality checks and reconciliation logic.
Education
Degrees, certifications, and relevant coursework
JNTU Anantapur
Bachelor of Technology (B.Tech)
Completed a Bachelor of Technology (B.Tech) at JNTU Anantapur.
Tech stack
Software and tools used professionally
Availability
Looking for a job
Location
IndiaAuthorized to work in
Salary expectations
1245k-1400k USD
Job categories
Skills
Azure DatabricksApache SparkSpark TuningPysparkDelta LakeChange Data CaptureOpen Data Lakehouse ArchitectureData ModellingAzure Data FactoryAzure SynapseAzure SQLAzure Logic AppsAzure Key Vaultazure monitorAzure DevOpsGitPythonPandasNumPy RemoteSQLT SQLSQL ServerAzure SQL DatabasePower BIMicrosoft SSRSSSISETL ELTCI CDData ValidationData GovernanceData WarehousingDatabricksFactoryGmailJanKeepMicrosoft Azure
Interested in hiring Dileep?
You can contact Dileep and 90k+ other talented remote workers on Himalayas.
Message DileepGet matched with your dream remote job
Sign up now and join over 250,000+ remote workers who receive personalized job alerts, curated job matches, and more for free!
