chetan kumar reddy

I’m a data engineer with 5+ years of big data experience, combining deep technical understanding of the SDLC with strong data analysis skills to deliver high-quality business intelligence. My goal is to build reliable, scalable data solutions in the cloud while using my technical and customer-focused mindset to drive exceptional outcomes.

In recent roles, I’ve built and optimized AWS-based ingestion and ETL frameworks using services like S3, Glue, Lambda, EMR, Athena, and Redshift. I orchestrate end-to-end pipelines with Step Functions and Apache Airflow (DAGs), while improving data accuracy through validation, audits, and automated error-checking that reduces operational inefficiencies and report generation time.

I also design data flows from diverse sources (FTP servers, S3, Redshift) and develop transformations with Python, PySpark, and Spark SQL, including performance tuning for Spark jobs. Across projects like supply chain efficiency and marketing-driven insights, my work has supported faster reporting, improved data integrity, and measurable increases in operational efficiency and quarterly revenue.