Vishal Sharma

I’m a Systems Engineer with experience building and operating Azure-based data engineering solutions at Tata Consultancy Services. I’ve worked with Azure Data Lake Storage (ADLS), designed efficient data partitioning strategies, and implemented secure data access using Azure Active Directory groups and Azure Key Vault.

I designed and implemented ETL pipelines using Azure Data Factory and developed Databricks notebooks using Python for data cleansing and transformation. I’ve improved ingestion reliability by reducing data ingestion failures by 35%, achieved 99.9% pipeline reliability for Azure Databricks workloads, and implemented snapshot-based data retention for monthly historical datasets retained for 18 months.

I also develop backend services with Spring Boot, microservices, and REST APIs, including authentication using Spring Security JWT. I’m hands-on with monitoring, troubleshooting, structured logging, and production support, collaborating with cross-functional teams in Agile to translate business requirements into dependable technical solutions.