karuna a

As a Senior System Engineer with over 3.5 years of experience, I have honed my skills in data engineering, particularly in Big Data technologies such as Python, PySpark, SQL, and Databricks. My journey has been marked by a commitment to designing and implementing efficient ETL data pipelines, ensuring data integrity and availability across various platforms.

At Infosys Limited, I have successfully managed complex data processes, migrating workflows from Apache Airflow to Databricks, which significantly improved pipeline efficiency. My role involves not only developing and optimizing PySpark scripts but also performing analytics on structured data, ensuring high data quality and reliability. I take pride in my ability to validate production data proactively, ensuring accuracy and timely delivery.

My project experience includes implementing the Databricks Lakehouse ecosystem for Nike, where I designed ETL processes that reduced data processing time by 30%. I am passionate about leveraging my technical expertise to drive data-driven decision-making and contribute to innovative solutions in the field of data engineering.