Utkarsh Sharma
@utkarshsharma4
I build reliable Lakehouse data pipelines and analytics solutions with Databricks, Spark, Azure, SQL, and Python.
IndiaWhat I'm looking for
I'm building reliable Lakehouse data pipelines and analytics solutions using SQL, Python, Spark, Azure Databricks, and Delta Lake. My work spans ETL workflows, incremental processing, data quality, data modeling, and cloud-based data platforms.
In my Olist Lakehouse project, I designed a Medallion architecture on Azure Databricks with ADLS Gen2, PySpark, and Delta Lake. I built idempotent ingestion, Delta MERGE-based Silver ETL, data-quality checks, logging, validation, and failure handling for auditable batch processing.
At ValianceSolutions for TVSMotors, I engineer Databricks workflows and reusable Delta Lake analytical views supporting dealer, enquiry, retail, and app-usage analytics across 1,000+ dealerships. I also set up Databricks Genie Spaces for self-service analysis and identified a lead-prioritization issue with an estimated 400–500 incremental retail opportunity per month.
Previously at Sears, I optimized Snowflake SQL and Python workflows from five hours to one hour and built pipelines that generated PDF business-insight reports. At DigiSurface and AB InBev, I developed dimensional models, Power BI reporting, Python ingestion workflows, and infrastructure monitoring that reduced daily data-refresh effort by up to 60%.
Experience
Work history, roles, and key accomplishments
Data Engineer
Valiance Solutions
Mar 2024 - Present (2 years 6 months)
Engineered automated Databricks workflows to transform Delta Lake datasets through SQL and Spark-based notebook pipelines, creating reusable analytical views for recurring business and stakeholder use cases. Built reusable SQL transformation datasets and views from Delta Lake tables, standardizing business logic across dealer, enquiry, retail, and app-usage analytics spanning 1,000+ dealerships an
Data Analyst II
Sears
Jan 2023 - Oct 2023 (9 months)
Optimized Snowflake-SQL and Python data-processing workflows, reducing execution time by 80% (5 hours to 1 hour). Created end-to-end data pipelines generating PDF reports containing business insights enabling focused business efforts.
Data Analyst
DigiSurface
Oct 2022 - Dec 2022 (2 months)
Built robust dimensional data models supporting data organization for BI reports generated by Analytics team. Developed Power BI reports to improve visibility of the Key Financial Metrics of the client.
Active Directory Analyst
AB InBev
Aug 2020 - Jun 2022 (1 year 10 months)
Designed Python-based data ingestion workflows to extract server health reports (HTML), transform operational data and load as structured datasets for Power BI reporting, reducing daily data refresh effort by up to 60%. Implemented infrastructure monitoring using Datadog to highlight problematic servers with low SLAs.
Education
Degrees, certifications, and relevant coursework
Indian Institute of Technology, Kanpur
Dual Degree (B.Tech + M.Tech), Engineering
2015 - 2020
Dual Degree (B.Tech + M.Tech) from the Indian Institute of Technology, Kanpur, completed from 2015 to 2020.
Tech stack
Software and tools used professionally
Availability
Location
IndiaAuthorized to work in
Social media
Job categories
Skills
Interested in hiring Utkarsh?
You can contact Utkarsh and 90k+ other talented remote workers on Himalayas.
Message UtkarshGet matched with your dream remote job
Sign up now and join over 250,000+ remote workers who receive personalized job alerts, curated job matches, and more for free!
