Senior data/backend engineer (4+ yrs, Walmart Global Tech) seeking a remote role owning data platforms end to end: Kafka pipelines, Spark batch jobs on GCP (200M+ records) and Cassandra/GraphQL services for 1M+ daily users. Open to Data Engineer, Data Platform and Senior Backend roles. Bengaluru (IST), can overlap with US/EU hours, 30-day notice.

Deepanshu Maheshwarri
@deepanshumaheshwarri
Data platform engineer at Walmart Global Tech who unified three market pipelines and built Kafka-to-BigQuery streaming ingestion.
What I'm looking for
At Walmart Global Tech, I designed and built an always-on Python and Kafka-to-BigQuery ingestion pipeline across two regional clusters. I tuned its Kafka TCP receive window to raise consumer throughput from 1.3K to 8K records per second.
I also unified the CA/MX/US alt-text pipelines into one configuration-driven Spark job, rolling it out through dual-write, shadow validation, cutover, and legacy decommission. When a Spark pipeline lost publishable pages, I traced the issue to over-strict filters and restored its output.
My work also includes Spark/Scala batch systems on GCP Dataproc, Cassandra publishing, and AI-generated alt-text delivery through federated GraphQL. I’ve handled production incidents, monitoring, service migrations, and an event-driven translation service built with Java 17 and Spring Boot.
Experience
Work history, roles, and key accomplishments
Designed and built real-time streaming pipelines and multi-market architectures, improving throughput and data quality. Led zero-downtime migrations and incident response for production systems.
Built and productionized advertising data pipelines and retail analytics aggregations, with infrastructure as code and monitoring.
Education
Degrees, certifications, and relevant coursework
Indian Institute of Information Technology, Lucknow
B.Tech, Information Technology
2018 - 2022
Grade: 8.0/10
Pursued a B.Tech in Information Technology, achieving a GPA of 8.0/10. Coursework included Data Structures & Algorithms, Distributed Systems, Operating Systems, Database Management, and Machine Learning.
Availability
Location
Authorized to work in
Salary expectations
Social media
Interested in hiring Deepanshu?
You can contact Deepanshu and 600K+ other talented remote workers on Himalayas.
Message DeepanshuGet matched with your dream remote job
Sign up now and join over 1,000,000+ remote workers who receive personalized job alerts, curated job matches, and more for free!
