Open to opportunities

YASWANTH P

@yaswanthp

Message

Data Engineer with expertise in ETL processes and cloud technologies.

India

Message

What I'm looking for

I am looking for opportunities that foster innovation and allow me to leverage my data engineering skills in cloud environments.

I am a Data Engineer with 3 years of experience specializing in data pipeline development and ETL processes. My expertise lies in migrating data workflows from Datastage to Spark/Scala and automating jobs using Airflow. I have a strong proficiency in cloud technologies, particularly Snowflake, where I have successfully migrated large schemas and optimized data processing workflows.

At Optum, I played a pivotal role in enhancing pipeline performance by migrating jobs from legacy systems, achieving a 30% cost reduction and a 50% improvement in processing time. My work involves designing and implementing Airflow DAGs to ensure efficient execution of data pipelines, and I am adept at writing complex SQL queries for data transformation. I thrive in environments that challenge my skills and allow me to contribute to innovative data solutions.

Experience

Work history, roles, and key accomplishments

Current

Data Engineer

Current

Optum

Sep 2022 - Present (2 years 10 months)

Led the migration of ETL workflows from Datastage to Spark/Scala, optimizing data processing and enhancing performance and scalability. Designed and implemented Airflow DAGs to automate and schedule ETL processes, ensuring efficient and timely execution of data pipelines.