Praveen Dasari

I’m a results-driven Azure Data Engineer with hands-on experience supporting the design and deployment of scalable data solutions. In my current role at NCPL Global Ltd, I’ve contributed to data analytics and transformation workflows across Azure-based cloud architecture, PySpark pipelines, and Delta Lake tables, with a strong focus on technical delivery and business impact.

I helped migrate over 80TB of financial data from on-premises systems into Azure Data Lake Storage Gen2 (ADLS) and Snowflake, ensuring 99.99% data accuracy through automated Azure Data Factory (ADF) pipelines and Self-hosted Integration Runtime (SHIR) setups. I designed metadata-driven ETL pipelines using ADF for ingestion, Databricks (PySpark) for transformation, and Synapse Analytics/Snowflake for structured storage, following Medallion Architecture across Bronze, Silver, and Gold layers in Delta Lake.

I also built for performance, reliability, and governance—reducing ingestion runtimes by 25%, achieving 35% faster query execution, and delivering >98% validation success through comprehensive data quality checks in Databricks. Beyond pipelines, I implemented incremental ingestion, CDC frameworks, Delta Lake MERGE strategies, RBAC and Azure Key Vault for secure credentials, documented lineage via Azure Purview, and enabled near-real-time analytics and reporting through Live Tables and Power BI serving layers.