Looking for a job

Kalanjali Vuyyala

@kalanjalivuyyala

I build scalable big data pipelines using Spark, Hadoop, AWS, and Airflow.

At Infosys, I've designed and developed Spark applications for complex batch transformations and aggregations, supporting the Broadcom project. I've built data lake architectures on Amazon S3 using partitioning and Parquet to improve query performance and reduce storage costs.

I've optimized PySpark and Spark RDD workloads on AWS EMR, orchestrated workflows with AWS Step Functions and Airflow, and delivered large-scale Sqoop migrations from on-premise databases to Hadoop clusters. I also troubleshoot performance, memory, scalability, and data-processing issues across Spark, Hive, and Sqoop environments.

Experience

Work history, roles, and key accomplishments

Data Engineer

Broadcom

May 2022 - May 2026 (4 years)

Designed and developed Spark applications for complex data transformations and aggregations, and implemented data lake architectures on Amazon S3 with partitioning and columnar formats. Orchestrated workflows using AWS Step Functions and managed Airflow DAGs with CI/CD pipelines.

Apache Spark PySpark S3 AWS Step Functions Hive Sqoop Hadoop Airflow Python SQL Parquet Git CI CD

Data Engineer

Infosys

May 2022 - Apr 2026 (3 years 11 months)

Worked as a Data Engineer with nearly four years of experience in designing and developing Big Data applications using Hadoop ecosystem technologies. Optimized Spark performance and integrated AWS S3 with PySpark jobs.