At Impetus Technologies, I migrate legacy on-premises data processing applications to American Express's Lumi platform on GCP, using Cloud Composer, Dataproc, BigQuery, Spark Scala, Hive, and HBase. I've converted shell-based orchestration and HQL workloads into automated Spark and BigQuery solutions.
Previously at TCS, I developed Azure Data Factory and Databricks ETL/ELT pipelines that improved workflow efficiency by 20%, processed 3–5 GB of daily multi-tenant sales data, and improved incremental-load performance by 10%. I also build with Vertex AI, LangChain, LangGraph, vector databases, and prompt engineering.
