Looking for a job

Devagya Awasthi

@devagya

Message

Senior Data Engineer building production-grade multi-cloud pipelines, metadata-driven ETL, and sub-second analytics.

India

Message

What I'm looking for

I’m looking for remote-first work where I can own production data pipelines end-to-end—building metadata-driven ETL in BigQuery, enforcing schema governance, and optimizing analytical platforms for sub-second performance across cloud platforms.

I’m a Senior Data Engineer with 3+ years of experience designing and operating production-grade data pipelines across Azure, GCP, and AWS. I’ve delivered remote-first engagements for global clients by architecting metadata-driven ETL frameworks in BigQuery and migrating multi-cloud data stacks.

I’m especially focused on data correctness, schema governance, and scalable, maintainable code. In my recent role, I architected and executed a multi-cloud migration (AWS, GCP, Azure) to a Managed Incorta platform with zero production downtime, and migrated SQL Server tables and views to BigQuery with zero-defect schema parity using automated reconciliation for accuracy.

I also modernize analytics platforms for speed and self-serve decision-making. I upgraded ClickHouse + Looker to reduce dashboard load times from minutes to under 3 seconds, and built BigQuery transformation layers ingesting and processing millions of rows per day for product and growth teams.

Experience

Work history, roles, and key accomplishments

Senior Data Engineer

EZData Advisory

Apr 2025 - Feb 2026 (10 months)

Architected a multi-cloud (AWS, GCP, Azure) migration to a Managed Incorta platform using distributed PySpark clusters with zero production downtime, and migrated SQL Server to BigQuery with automated reconciliation for schema parity. Built a metadata-driven BigQuery Dataform transformation framework and upgraded ClickHouse + Looker, reducing dashboard load times from minutes to under 3 seconds.

Pyspark BigQuery dataform Incorta Data Migration LookML

Data Engineer

WTD Analytics

Nov 2024 - Jan 2025 (2 months)

Evaluated and prototyped Databricks Lakehouse architectures and implemented PySpark workflows for distributed schema enforcement and data validation. Assessed Zingg RAG models for entity resolution and probabilistic data matching at scale.

Databricks Pyspark Lakehouse Data Validation Entity Resolution

Data Engineer

PW Skills

Feb 2023 - Nov 2024 (1 year 9 months)

Maintained and extended Azure Data Factory pipelines delivering reliable, SLA-bound data to sales analytics stakeholders. Implemented Slowly Changing Dimension pipelines (Type 1 and Type 2) to support long-horizon historical reporting and trend analysis.

Azure Data Factory SCD Type 1 Data Modeling SQL Server

Education

Degrees, certifications, and relevant coursework

Indian Institute of Technology (IIT) Madras

Bachelor of Science, Data Science and Applications

B.S. in Data Science and Applications with coursework in Data Science, Machine Learning, Deep Learning, Artificial Intelligence, Business Intelligence, and Data Management.