At Xenops Technologies Private Limited, I designed a data validation framework to check accuracy and consistency between source and target datasets. I developed Azure Data Factory pipelines and PySpark validations in Azure Databricks, including reconciliation checks, audit tables, and data quality alerts.
At Likedin Services, I developed Azure ETL/ELT pipelines and migrated Hadoop data to Azure. I used Azure Databricks, Delta Lake, and Azure Synapse Analytics to transform and validate data for analytics and reporting.
