Open to opportunities

sindhuja User

@sindhujauser

Message

Data Engineer with expertise in ETL pipelines and data optimization.

India

Message

What I'm looking for

I am looking for opportunities that allow me to tackle complex data challenges and contribute to innovative projects in a collaborative environment.

I am a Data Engineer with 2 years of experience specializing in building and optimizing ETL pipelines using PySpark and SparkSQL on Databricks. My passion lies in solving complex data challenges and delivering scalable solutions that enhance data management and analytics capabilities.

Currently, I work at LTIMindtree, where I integrate Databricks and AWS S3 for high-performance ETL in the healthcare sector. I have successfully designed and implemented scalable ETL pipelines, migrated and transformed data using AWS services, and built a Medallion Architecture to optimize data management. My expertise in implementing Slowly Changing Dimensions (SCD2) has significantly improved reporting accuracy, allowing for refined data structures and actionable insights.

Experience

Work history, roles, and key accomplishments

Current

Data Engineer

Current

LTIMindtree

Oct 2023 - Present (1 year 9 months)

Designed and implemented scalable ETL pipelines using PySpark and SparkSQL on Databricks, integrating data from diverse sources and storing results in AWS S3. Built a Medallion Architecture (Bronze, Silver, Gold layers) in AWS S3, optimizing data management and enhancing analytics capabilities.