Bhakti Padwal
@bhaktipadwal
Azure Data Engineer specializing in scalable ETL, Databricks, and PySpark.
IndiaWhat I'm looking for
I am an Azure Data Engineer with seven years of hands-on experience designing, developing, and optimizing scalable big data solutions that drive business insights and operational efficiency.
I build and maintain enterprise ETL pipelines using Azure Data Factory, Azure Databricks, Delta Lake and Azure Data Lake Storage Gen2, and I write PySpark notebooks and optimized SQL for high-performance data transformation.
I have delivered measurable improvements such as reducing batch processing from 6+ hours to under 1 hour, implementing ADF-based PII masking that cut manual effort by 90%, and integrating Databricks with MuleSoft for reliable API-driven data sync to PIM systems.
I hold Microsoft certifications (DP-203, DP-900, AZ-900), a BSc in Computer Science, and I collaborate closely with cross-functional teams to ensure data quality, governance, and smooth handovers through clear documentation.
Experience
Work history, roles, and key accomplishments
Developed and optimized Azure Databricks ETL pipelines and PySpark notebooks for large-scale data transformation and MuleSoft API integration, reducing downstream failures and improving data sync performance; designed ADF pipelines for PII masking that cut manual effort by 90% and ensured GDPR compliance.
Contributed to ingestion and transformation pipelines on Azure (ADF, Databricks) for a media streaming platform, performing data cleaning, deduplication and joins to derive metrics like watch time and content completion rate.
Completed internal trainings on Databricks, Python, Delta Lake and Azure data services to prepare for client engagements and strengthen cloud data pipeline and warehousing skills.
Migrated mainframe batch processes to Spark/HDFS, ingesting mainframe outputs into HDFS and using Hive external tables to enable SQL access; improved batch processing from 6+ hours to under 1 hour and migrated schemas to Avro/Parquet.
Performed database testing and schema verification using PGAdmin and SQL, created and executed DML queries for test data, and collaborated with developers to log database-related defects via JIRA.
Education
Degrees, certifications, and relevant coursework
Fergusson College
Bachelor of Science, Computer Science
Grade: First Class with Distinction
Completed a Bachelor of Science in Computer Science with First Class with Distinction in 2018.
Availability
Location
IndiaAuthorized to work in
Salary expectations
Job categories
Interested in hiring Bhakti?
You can contact Bhakti and 90k+ other talented remote workers on Himalayas.
Message BhaktiFind your dream job
Sign up now and join over 250,000+ remote workers who receive personalized job alerts, curated job matches, and more for free!
