Debanu Saha
@utpalnandy
Sr Data Engineer with 10+ yrs experience in designing and operating large-scale data platforms, CI/CD pipelines, data lakehouse,Azure &AWS echo system
What I'm looking for
Deep hands-on expertise in Apache Spark (PySpark), Airflow, Kafka, Delta Lake, and Kubernetes, with proven ability to build end-to-end batch and streaming pipelines processing hundreds of millions of records daily. Strong background in data modeling, schema evolution, data quality engineering, and pipeline optimization. Experienced in building metadata-driven ingestion frameworks, medallion-architecture data lakes, and ML-ready feature stores. Skilled at bridging data engineering with backend development and DevOps to deliver production-grade, fault-tolerant data systems.
Experience
Work history, roles, and key accomplishments
Backend /Data / Automation Engineer
Tata Consultancy Services
Sep 2024 - Present (1 year 10 months)
Designed and automated end-to-end AWS provisioning with Terraform and GoCloud, reducing provisioning time by 40% and improving infrastructure reliability by 25%; defined GitHub Actions CI/CD for testing and deployment, cutting manual efforts by 50%.
Sr Data Engineer/Python Developer
Apr 2021 - Aug 2024 (3 years 4 months)
Led data architecture and CRM integration for predictive analytics on Azure, implementing Databricks and Data Factory to cut data processing time by 30% and improve forecast accuracy to 90%.
Sr Data Engineer/Analytics Engineer
TeamLease Services Ltd/Tata Consultancy Sevices
Mar 2018 - Mar 2021 (3 years)
Architected a modular Azure data lake and CI/CD pipelines using Terraform and Azure DevOps to centralize aviation data, reducing manual processing by 50% and improving scalability for analytics.
Developed Flask-based Python backend applications and REST APIs for enterprise clients, reducing application load time by 15% and improving data retrieval performance by 25% via SQL/PostgreSQL optimizations. Implemented automated testing with PyTest to reduce production defects by 20%, and delivered Agile improvements and automation that saved ~45 hours/week while modernizing legacy services.
Education
Degrees, certifications, and relevant coursework
West Bengal University of Technology
Bachelor of Technology, Electronics & Communication Engineering
Grade: 7.6 GPA
Completed a Bachelor of Technology in Electronics & Communication Engineering with a 7.6 GPA, covering core topics in electronics, communication systems, and engineering fundamentals.
Tech stack
Software and tools used professionally
Apache Spark
Microsoft Azure
GitHub
GitLab
Kubernetes
Jenkins
GitHub Actions
NumPy
Pandas
PySpark
dbt
DB
MySQL
PostgreSQL
MongoDB
Gmail
Google Analytics
Databricks
Terraform
Azure DevOps
JavaScript
Python
Java
MLflow
scikit-learn
Kafka
Apache NiFi
FastAPI
Avro
Serverless
Azure Functions
pytest
Robot Framework
OAuth2
Docker
Airflow
Time Analytics
Root Cause
SQL
Clickhouse
Delta Lake
Bash
Loops
Increase
Bridge
Rubrik
Factory
Check
Seaborn
Availability
Location
Authorized to work in
Social media
Job categories
Skills
Interested in hiring Debanu?
You can contact Debanu and 90k+ other talented remote workers on Himalayas.
Message DebanuGet matched with your dream remote job
Sign up now and join over 250,000+ remote workers who receive personalized job alerts, curated job matches, and more for free!
