Looking for a job

Gayathri G

@gayathrig2

Message

Data Engineer specializing in scalable ETL pipelines, cloud data platforms, and Spark performance optimization.

India

Message

What I'm looking for

I seek a mid-level data engineering role focused on cloud-native ETL, large-scale pipeline optimization, collaborative Agile teams, and opportunities to lead performance improvements.

I am a results-driven Data Engineer with five years of hands-on experience building scalable data solutions for enterprise applications. I specialize in designing and implementing ETL pipelines using PySpark, Azure Data Factory, Databricks, AWS EMR, and cloud storage such as S3 and Azure Data Lake.

Across projects for clients like H&M and Bharti Airtel, I developed and optimized Spark jobs, built ingestion pipelines (Sqoop, ADF), and improved query performance through partitioning, bucketing, caching and SQL tuning—reducing job times by up to 20%.

I am organized, self-motivated, and collaborative, participating in Agile ceremonies and coordinating with cross-functional teams to deploy solutions across DEV, QA, and PROD while ensuring secure credential handling and reliable pipeline automation.

Experience

Work history, roles, and key accomplishments

Current

Azure Data Engineer

Current

Visionquest Solutions Private Limited

Sep 2024 - Present (1 year 5 months)

Designed and implemented Azure ETL pipelines using ADF and Databricks for H&M, enabling full and incremental data loads and deployments across DEV/QA/PROD while coordinating cross-team issue resolution.

Azure Data Factory Databricks Delta Lake Azure SQL SparkSQL ETL CI CD

AWS Data Engineer

Tracxn Technologies

Nov 2019 - Jul 2023 (3 years 8 months)

Built and optimized PySpark applications on AWS EMR to process large datasets from S3, implemented Sqoop-based ingestions to HDFS, and reduced job times by 20% through Spark and Hive tuning.

Pyspark AWS S3 Hadoop Hive Sqoop Performance Tuning