karuna a
@karunaa
Experienced Data Engineer specializing in Big Data technologies.
What I'm looking for
As a Senior System Engineer with over 3.5 years of experience, I have honed my skills in data engineering, particularly in Big Data technologies such as Python, PySpark, SQL, and Databricks. My journey has been marked by a commitment to designing and implementing efficient ETL data pipelines, ensuring data integrity and availability across various platforms.
At Infosys Limited, I have successfully managed complex data processes, migrating workflows from Apache Airflow to Databricks, which significantly improved pipeline efficiency. My role involves not only developing and optimizing PySpark scripts but also performing analytics on structured data, ensuring high data quality and reliability. I take pride in my ability to validate production data proactively, ensuring accuracy and timely delivery.
My project experience includes implementing the Databricks Lakehouse ecosystem for Nike, where I designed ETL processes that reduced data processing time by 30%. I am passionate about leveraging my technical expertise to drive data-driven decision-making and contribute to innovative solutions in the field of data engineering.
Experience
Work history, roles, and key accomplishments
Senior System Engineer
Infosys Limited
Oct 2021 - Present (3 years 9 months)
Led data engineering initiatives, designing and implementing highly efficient ETL/ELT pipelines using PySpark and Databricks, and managing data ingestion from diverse sources. Optimized data processing workflows, migrating from Apache Airflow to Databricks, and utilized Informatica and Autosys for job scheduling and monitoring. Developed Spark applications for ETL pipelines, leveraging Medallion a
Education
Degrees, certifications, and relevant coursework
RVR&JC College of Engineering
B.Tech, Electrical and Electronics Engineering
Studied Electrical and Electronics Engineering at RVR&JC College of Engineering. Gained foundational knowledge in various engineering principles and practices relevant to the field.
Tech stack
Software and tools used professionally
Availability
Location
Authorized to work in
Job categories
Interested in hiring karuna?
You can contact karuna and 90k+ other talented remote workers on Himalayas.
Message karunaFind your dream job
Sign up now and join over 100,000 remote workers who receive personalized job alerts, curated job matches, and more for free!
