Balarami Reddy alla

Architected and delivered AWS Glue and Amazon Data Firehose ingestion pipelines at enterprise scale, improving pipeline reliability and throughput by 40%. Led migration of Ab Initio legacy ETL workloads to a modern PySpark/Python cloud-native architecture on Databricks, reducing storage costs by 25%.

Led design and governance of enterprise-scale data pipelines on Azure Data Factory and Databricks, delivering curated datasets for analytics and reporting. Directed migration of on-premises Ab Initio workloads to Azure and GCP cloud-native services.

Designed AWS data lake architecture integrating diverse sources via Amazon Glue, maintaining regulatory alignment and data consistency. Implemented real-time streaming with Apache Kafka to reduce data latency and accelerate business insight delivery.

Designed and built AWS infrastructure using CloudFormation, including EC2, S3, RDS multi-AZ, IAM, SQS, SNS, and CloudWatch. Implemented CI/CD pipelines using GitLab, Jenkins, and Puppet for automated build, test, and release management.

Migrated petabytes of data from Oracle to Redshift and from S3 to Teradata and Snowflake, enabling enterprise data warehouse modernisation. Designed SCD Type 2 dimension and Fact data flows, migrating 102+ jobs to Oracle and Hive.

Developed complex Ab Initio graphs to transform and load data into staging and target databases. Designed SCD Type 2 dimension flows ensuring data integrity and consistency.

Developed ETL extraction, transformation, and loading processes from legacy systems using Ab Initio GDE. Applied parallelism techniques for processing large datasets efficiently.

Designed Informatica mappings to extract data from Oracle, flat files, and XML sources. Implemented SCD Type 1 & 2 methodologies for historical data integrity.

Master of Science in Computer Science from Northwestern Polytechnic University in Fremont, CA.

Bachelor of Engineering in Computer Science from JNTU, India.