Shiv User
@shivuser3
Data Engineer building low-latency pipelines and GenAI solutions with measurable business impact.
IndiaWhat I'm looking for
I’m a Data Engineer with ~2 years of experience building production-grade data pipelines, lakehouses, and GenAI solutions at Shell. I focus on measurable outcomes—delivering $4.9M in cost savings, €3M tax rebate, and a 60× reduction in ingestion latency across enterprise-scale systems.
At Shell, I led an ENDUR workstream to build a low-latency OLAP trading platform, cutting ingestion latency from 5 hours to 5 minutes across 444+ tables. I also designed a cloud-architecture migration of fuel-quality data from GCP to Azure ADLS (bronze-silver-gold lakehouse), improving data quality while eliminating 5,900 hours of manual effort.
I bring strong production ownership: I proactively manage L2/L3 operational support, run root cause analysis for ingestion bottlenecks, and implement performance optimizations to maintain 99.9% system reliability. Beyond infrastructure, I’ve built GenAI PoCs for trade document automation (replacing manual processing across 700+ terminals) and collaborate closely with product managers to translate requirements into scalable technical execution.
Experience
Work history, roles, and key accomplishments
Led the ENDUR workstream to build a low-latency OLAP trading platform, engineering Databricks DLT pipelines to reduce ingestion latency from 5 hours to 5 minutes across 444+ tables. Migrated fuel-quality data from GCP to an Azure ADLS lakehouse (bronze-silver-gold) and delivered measurable cost and effort savings, while also supporting production pipeline reliability.
AI Engineer Intern
AiRoDigitalLabs
Jan 2024 - Jul 2024 (6 months)
Built client-facing AI solutions across conversational AI, video analytics, and demand forecasting. Improved client conversion by 20% and reduced operational inefficiencies by 25% through tailored ML pipelines.
Undergraduate Research Assistant
MIT Manipal
Jan 2023 - Sep 2023 (8 months)
Co-authored a publication on causal AI for analyzing soil nutrient loss and crop yield under stress factors. Applied causal AI and structure learning to model stressors and generate counterfactual scenarios for agronomic insights.
Data Analysis Intern
Faircent.com
Jun 2023 - Jul 2023 (1 month)
Built a rules engine to optimize lead processing for maximum profit with minimal credit risk. Produced FY-2022 insights to improve high-value prospect prioritization.
Data Science Intern
Nokia Networks
Dec 2022 - Jan 2023 (1 month)
Developed a telecom demand forecasting tool using stock data and NLP-based sentiment analysis. Applied Vector Autoregression (VAR) to predict network performance KPIs.
Education
Degrees, certifications, and relevant coursework
Manipal Institute of Technology
Bachelor of Technology (B.Tech), Data Science
2020 - 2024
Grade: CGPA: 8.53 / 10
Activities and societies: Co-Founded The Data Alchemists (data science club); ran workshops, onboarded 30+ members, and led mentorship initiatives.
Earned a B.Tech in Data Science (CGPA 8.53/10). Co-founded The Data Alchemists and led workshops, onboarding, and mentorship for 30+ members.
Tech stack
Software and tools used professionally
Availability
Location
IndiaAuthorized to work in
Job categories
Skills
Interested in hiring Shiv?
You can contact Shiv and 90k+ other talented remote workers on Himalayas.
Message ShivGet matched with your dream remote job
Sign up now and join over 250,000+ remote workers who receive personalized job alerts, curated job matches, and more for free!
