Looking for a job

Azam Ali

@azam_ali

Message

I build scalable data pipelines and lakehouse architectures on Databricks and AWS.

India

Message

At InfoObjects, I reengineered a monolithic Databricks pipeline into a Medallion Architecture, reducing runtime by 20%. I also built a configuration-driven ELT framework for nested JSON datasets and optimized 1+ TB Spark and Delta Lake workloads by up to 80%.

I've delivered Gold-layer data from Databricks to Amazon Redshift and built AWS analytics and streaming pipelines using S3, Glue, Step Functions, Athena, Kinesis, Lambda, and DynamoDB. Earlier, I developed 30+ REST APIs and role-based platform features at Metricoid Technology Solutions.

Experience

Work history, roles, and key accomplishments

Data Engineer

InfoObjects Inc

Oct 2024 - Jun 2026 (1 year 8 months)

Reengineered a monolithic Databricks pipeline into a Medallion Architecture, reducing runtime by 20% through broadcast joins and optimized partitioning. Developed a configuration-driven ELT framework for nested JSON datasets and optimized Spark/Delta Lake workloads on 1+ TB, reducing runtime by up to 80%.

Databricks Apache Spark PySpark Delta Lake Medallion Architecture ELT Data Pipelines S3 Amazon Redshift Z Ordering Liquid Clustering Memory Tuning

Full Stack Developer

Metricoid Technology Solutions

Feb 2024 - Jun 2024 (4 months)

Developed 30+ REST APIs using Node.js and Express.js for a referral platform, improving performance through caching, pagination, and optimized state management. Built frontend and backend features across 4 user roles, implementing role-based access control (RBAC).

NodeJS ExpressJS REST APIs Caching Pagination State Management RBAC