karuna aKA
Open to opportunities

karuna a

@karunaa

Experienced Data Engineer specializing in Big Data technologies.

India
Message

What I'm looking for

I am looking for a role that challenges my data engineering skills and offers opportunities for growth in a collaborative environment.

As a Senior System Engineer with over 3.5 years of experience, I have honed my skills in data engineering, particularly in Big Data technologies such as Python, PySpark, SQL, and Databricks. My journey has been marked by a commitment to designing and implementing efficient ETL data pipelines, ensuring data integrity and availability across various platforms.

At Infosys Limited, I have successfully managed complex data processes, migrating workflows from Apache Airflow to Databricks, which significantly improved pipeline efficiency. My role involves not only developing and optimizing PySpark scripts but also performing analytics on structured data, ensuring high data quality and reliability. I take pride in my ability to validate production data proactively, ensuring accuracy and timely delivery.

My project experience includes implementing the Databricks Lakehouse ecosystem for Nike, where I designed ETL processes that reduced data processing time by 30%. I am passionate about leveraging my technical expertise to drive data-driven decision-making and contribute to innovative solutions in the field of data engineering.

Experience

Work history, roles, and key accomplishments

IL
Current

Senior System Engineer

Infosys Limited

Oct 2021 - Present (3 years 9 months)

Led data engineering initiatives, designing and implementing highly efficient ETL/ELT pipelines using PySpark and Databricks, and managing data ingestion from diverse sources. Optimized data processing workflows, migrating from Apache Airflow to Databricks, and utilized Informatica and Autosys for job scheduling and monitoring. Developed Spark applications for ETL pipelines, leveraging Medallion a

Education

Degrees, certifications, and relevant coursework

RE

RVR&JC College of Engineering

B.Tech, Electrical and Electronics Engineering

Studied Electrical and Electronics Engineering at RVR&JC College of Engineering. Gained foundational knowledge in various engineering principles and practices relevant to the field.

Interested in hiring karuna?

You can contact karuna and 90k+ other talented remote workers on Himalayas.

Message karuna

People also viewed

View all talent

Find your dream job

Sign up now and join over 100,000 remote workers who receive personalized job alerts, curated job matches, and more for free!

Sign up
Himalayas profile for an example user named Frankie Sullivan
karuna a - Senior System Engineer - Infosys Limited | Himalayas