Open to opportunities

Shreya Sachan

@shreyasachan

Message

Data Engineer building scalable Azure and AWS batch ETL pipelines with PySpark and SQL performance tuning.

India

Message

What I'm looking for

I’m looking to work on Azure and AWS data pipelines where I can build batch ETL end to end, tune SQL/PySpark performance, and keep improving data quality for ingestion, transformation, storage, and reporting.

I design and implement scalable batch ETL pipelines using Azure Data Factory, Azure Databricks, and PySpark, ingesting 10+ GB of daily data into Azure Data Lake Storage Gen2.

I build end-to-end pipelines with Azure Data Factory, Azure Databricks, Azure Synapse Analytics, and ADLS Gen2—from ingestion and transformation to storage and reporting.

I optimize PySpark transformations and SQL queries, improving pipeline execution time by up to 70% while reducing Azure compute costs, and I tune Synapse serverless SQL jobs to cut data scan costs.

I’ve also implemented an end-to-end AWS pipeline with Amazon S3, AWS Glue, Athena, and Redshift, and I keep tightening SQL performance through indexing and execution plan optimization.

Experience

Work history, roles, and key accomplishments

Current

Data Engineer

Current

Independent Projects (Azure and AWS)

Aug 2023 - Present (3 years)

Designed and implemented scalable batch ETL pipelines using Azure Data Factory, Azure Databricks, and PySpark to ingest over 10 GB of daily data into Azure Data Lake Storage Gen2.