Open to opportunities

Sagar Thakor

@sagarthakor

Message

Senior Data Engineer with a strong background in building scalable data pipelines.

United States

Message

What I'm looking for

I am looking for opportunities that foster innovation, collaboration, and growth in data engineering.

I am a Senior Data Engineer with extensive experience in engineering and deploying scalable data pipelines. Currently at Visa, I have significantly enhanced the company's data analytics capabilities by managing and processing billions of daily transactions using Apache Airflow, Spark, and AWS Glue. My expertise lies in designing and implementing ETL processes that support incremental loads, full data refreshes, and various data capture methodologies, ensuring high data quality and compliance.

Previously, at UnitedHealth Group, I built and maintained robust data ingestion pipelines that streamlined healthcare data collection and enabled timely analytics. My work involved developing advanced data validation frameworks and spearheading migration efforts from legacy databases to cloud platforms, resulting in significant improvements in scalability and system efficiency. I am passionate about leveraging modern technologies to drive efficiency and enable real-time analytics.

Experience

Work history, roles, and key accomplishments

Current

Senior Data Engineer

Current

Visa

Aug 2022 - Present (2 years 11 months)

Engineered and deployed scalable data pipelines leveraging Apache Airflow, Spark, and Glue to manage and process billions of daily transactions, significantly enhancing Visa’s data analytics capabilities. Designed and implemented scalable ETL processes using AWS Glue, including support for incremental loads, full data refreshes, Slowly Changing Dimensions (SCD), and Change Data Capture (CDC) metho

Apache Airflow Spark AWS Glue Python ETL Data Lake Terraform Jenkins GitHub

Senior Data Engineer

UnitedHealth Group

May 2021 - Present (4 years 2 months)

Built and maintained robust data ingestion pipelines using Apache Spark and Apache Airflow, streamlining healthcare data collection and enabling timely analytics. Developed advanced data validation frameworks using Python, SQL, and Amazon S3 Storage to enhance data accuracy and compliance with stringent healthcare regulations.

Apache Spark Apache Airflow Python SQL Amazon S3 AWS Glue Pyspark Hadoop ETL

Data Engineer

UnitedHealth Group

Oct 2018 - Present (6 years 9 months)

Designed and implemented batch ETL workflows using SQL Server Integration Services (SSIS) and T-SQL to process claims and enrollment data, improving data accessibility for analytics teams. Developed monitoring scripts and logging frameworks to track data pipeline health and failure recovery, reducing data pipeline downtime and improving system observability.