At NexWave Talent Management Solutions, I worked on Azure-based data engineering and modernization, designing and deploying Azure Data Factory pipelines for structured and semi-structured data.
I developed PySpark transformation frameworks in Azure Databricks and implemented incremental loads, metadata-driven ETL, and Delta processing.
At Tata Consultancy Services (TCS), I worked on data ingestion and data warehouse projects, using HDFS, Hive, and HBase for ingestion and developing ETL pipelines for analytics and reporting.
I also worked on migrating DB2 and PostgreSQL data to Azure Databricks, with watermark-based loads, reconciliation, and duplicate validation. My experience includes BFSI and healthcare domains.
