I seek a hands-on data engineering role where I can build scalable batch and real-time data platforms, build future-ready AI-integrated systems and drive measurable business impact in a collaborative, data-driven environment.
Naman Gupta
@namangupta18
Data Engineer II, Building Reliable, Cost-Efficient Data Platforms at Tata 1mg (India's leading online healthcare Platform)
What I'm looking for
Iโm a ๐๐ฎ๐๐ฎ ๐๐ป๐ด๐ถ๐ป๐ฒ๐ฒ๐ฟ ๐๐ถ๐๐ต ~๐ฐ ๐๐ฒ๐ฎ๐ฟ๐ ๐ผ๐ณ ๐ฒ๐
๐ฝ๐ฒ๐ฟ๐ถ๐ฒ๐ป๐ฐ๐ฒ building high-scale, fault-tolerant data platforms that power real-time decision-making and business operations. I specialise in Databricks Lakehouse architecture, Spark, Kafka, Airflow, and AWS, with a strong focus on reliability, cost optimisation, and SLA-driven systems.
Trusted with end-to-end ownership of the data platform, I drive platform-level strategic initiatives that translate the organisationโs data strategy into scalable, production-ready systems.
At Tata 1mg, I:
โข Own the Databricks platform and core DimโFact data model, including cluster management, access governance, and cost optimisation across production workloads
โข Re-architected workflows to a loosely coupled, fault-tolerant model, reducing processing time by 75% and failure rates to <0.05%
โข Built 99.9% SLA-compliant platforms with PagerDuty-based alerting and automated incident response
โข Designed real-time streaming pipelines (Kafka + Spark) handling critical business workflows with sub-second latency
โข Migrated unoptimised systems to incremental DimโFact models, cutting compute costs by ~50%
I strongly believe in ownership over pipelines, observability by default, and building systems that scale with the business โ not just โrunโ.
Experience
Work history, roles, and key accomplishments
Data Engineer II
Tata 1mg
Apr 2024 - Present (1 year 9 months)
Owned Databricks Lakehouse across governance, security, access, cost, and performance. Built real-time abandoned cart pipelines using Kafka and Spark Streaming, cutting lead latency from 2 hours and improving conversions by 10%. Defined scalable DimโFact models. Re-architected workflows to reduce runtime by 75%, failures to <0.05%, and meet 99.9% SLA.
Data Engineer I
Tata 1mg
Jul 2022 - Mar 2024 (1 year 8 months)
Migrated 100+ workflows to Databricks and redesigned 200 ETL tables to an incremental Dimension-Fact model, cutting processing costs by 50% and instituting data governance for a scalable platform.
Data Engineer Intern
Tata 1mg
Feb 2022 - Jun 2022 (4 months)
Delivered 15+ third-party integration pipelines and upgraded Airflow while migrating 100+ jobs with zero downtime; implemented RudderStack event pipelines and standard event schemas to improve analytics and campaign tracking.
Education
Degrees, certifications, and relevant coursework
Jaypee Institute of Information Technology
Bachelor of Technology, Computer Science Engineering
2018 - 2022
Grade: 8.4/10.0
Activities and societies: Head of Music Club
Completed a Bachelor of Technology in Computer Science Engineering with a GPA of 8.4/10.0 from 2018 to 2022.
Tech stack
Software and tools used professionally
Availability
Location
Authorized to work in
Portfolio
github.comSocial media
Job categories
Interested in hiring Naman?
You can contact Naman and 90k+ other talented remote workers on Himalayas.
Message NamanFind your dream job
Sign up now and join over 100,000 remote workers who receive personalized job alerts, curated job matches, and more for free!
