At Hudhud Maps, I spearheaded deployment and management of the core data platform, using Kubernetes, ArgoCD, and Terraform alongside Apache Airflow, Apache Spark, Trino, Hive, DBT, Kafka, and Superset.
I develop automated pipelines for geospatial and image data, and implemented a PySpark/Sedona validation pipeline for OSM address data that lands results in PostGIS with automated quality flagging.
At Glassdoor, I supported cross-functional data teams and refactored legacy ETL jobs. I reduced costs by 70% by migrating image files from EBS to S3, and migrated Airflow jobs from v1.8 to v1.10.
At Nomo Fintech, I built data pipelines across AWS services, S3, Redshift, DBT, and Airflow. I automated infrastructure deployment with Terraform and CI/CD processes on GitLab, including unit testing for Python and Spark jobs.
