Looking for a job

pavan chinagi

@pavanchinagi

Senior Data Engineer at Ernst & Young, migrating enterprise data workloads to Databricks and building AWS data pipelines.

India

Message

At Ernst & Young, I’m contributing to the migration of enterprise data workloads from Azure Synapse to Databricks Unity Catalog. I’ve developed SQL views and transformation logic for reconciliation and validation, and helped improve query performance and automate daily refreshes.

I’ve also engineered healthcare market data pipelines and AWS Glue ETL pipelines using PySpark, reducing data processing time by 35%. At Futurense Technologies, I worked on Snowflake data warehousing and AWS-based ETL pipelines, and I hold the Databricks Certified Data Engineer Associate certification.

Experience

Work history, roles, and key accomplishments

Current

Senior Data Engineer

Current

Ernst & Young

Mar 2023 - Present (3 years 7 months)

Contributing to migration of enterprise data workloads from Azure Synapse to Databricks Unity Catalog, developing and optimizing SQL views, and engineering end-to-end healthcare data pipelines using AWS and SQL. Automated ETL workflows with SnapLogic and implemented CI/CD with Databricks Asset Bundles and GitHub Actions.

Databricks Unity Catalog Azure Synapse SQL AWS Glue PySpark S3 Amazon RDS Snaplogic CI CD GitHub Actions Databricks Asset Bundles Data Migration Data Quality Performance Optimization

Data Engineer

Futurense Technologies

Dec 2021 - Nov 2022 (11 months)

Enhanced client data engineering capabilities by transforming SCD type 1 to type 2 using Snowflake streams, facilitated data consolidation with AirByte, and built ETL pipelines using AWS Lambda and Glue.