At Target Corporate Services Pvt. Ltd., I design and implement enterprise-scale data migration pipelines using Hive, PySpark, Kafka, and SQL. I also develop ETL workflows and work on cloud migration projects involving GCP and BigQuery.
At InterGlobe Air Transport Pvt Ltd., I worked on moving enterprise data from Oracle and Ab Initio systems into GCP. I automated workflows with Cloud Composer and created BigQuery datasets and ingestion pipelines.
Earlier, I developed Sqoop workflows and Hive tables for data migration and processing at AirIndia SATS Airport Services Ltd. and N.V. Data Systems Pvt. Ltd., including work with partitioning, bucketing, Spark memory tuning, and complex JSON datasets.
