Poonam Kumari
@poonamkumari1
Senior Data Engineer specializing in governed ETL/ELT pipelines across GCP and Azure.
IndiaWhat I'm looking for
I’m a Senior Data Engineer with 9+ years architecting and optimizing large-scale ETL/ELT pipelines, cloud data platforms, and real-time analytics across GCP and Azure. I focus on building governed data products that teams can trust, using source-to-target validation and lineage-driven quality controls.
In my recent work, I delivered enterprise migrations into BigQuery, including an Order Management System and third-party vendor datasets—processing 30–40GB hourly (~800GB total) with PySpark on Dataproc. I re-engineered core Spark jobs (JSON to Parquet, Kryo serialization, executor tuning), cutting pipeline runtime from 6+ hours to under 2 hours (67%+ reduction).
I also led Azure migrations of 5TB of daily transactional sales data from legacy on-premise Hadoop/Hive, translating complex PySpark logic into modular, testable dbt transformations and orchestrating ELT architectures with Azure Data Factory. I’ve built CDC/upsert ingestion using Apache Hudi merge-on-read, automated CI/CD with Jenkins/GitHub Actions/SonarQube, and enabled low-latency consumption by staging curated datasets for reporting and Elasticsearch.
Experience
Work history, roles, and key accomplishments
Architected and monitored end-to-end ETL pipelines on Google Cloud BigQuery, including an OMS and vendor datasets migration processed with PySpark on Dataproc. Re-engineered Spark jobs and built governed ingestion using Apache Hudi, then enabled low-latency consumption via Elasticsearch with data validation and testing.
Led migration of 5TB of daily transactional sales data from on-prem Hadoop/Hive to Microsoft Azure. Built metadata-driven ADF ingestion and dbt transformations from legacy PySpark logic, implemented SQL MERGE restatement for late-arriving data, and migrated high-volume Hive tables into Snowflake.
Developed secure integration logic with the Common Data Model (CDM) API and maintained application reliability across ELK environments. Implemented SonarQube with Jenkins CI/CD, and built Spark Structured Streaming lookup modules for micro-batch processing.
Infrastructure Support Engineer
EIT Service Pvt. Ltd
Feb 2016 - Mar 2018 (2 years 1 month)
Provided Tier-1/Tier-2 infrastructure support and performance monitoring for 3,000+ corporate servers. Diagnosed hardware and VMware issues using Event Viewer logs and participated in incident and change management processes.
Education
Degrees, certifications, and relevant coursework
Banasthali University
Master of Computer Applications, Computer Applications
2011 - 2014
Completed a Master of Computer Application degree at Banasthali University from 2011 to 2014.
Maharshi Dayanand University
Bachelor of Computer Applications, Computer Applications
2008 - 2011
Completed a Bachelor of Computer Application degree at Maharshi Dayanand University from 2008 to 2011.
Availability
Location
IndiaAuthorized to work in
Job categories
Skills
Interested in hiring Poonam?
You can contact Poonam and 90k+ other talented remote workers on Himalayas.
Message PoonamGet matched with your dream remote job
Sign up now and join over 250,000+ remote workers who receive personalized job alerts, curated job matches, and more for free!
