Open to opportunities

Milan Harindran

@milanharindran

Message

Data Engineer with expertise in Python, SQL, PySpark, and building scalable ETL pipelines.

India

Message

What I'm looking for

I seek roles building scalable ETL and analytics platforms where I can improve data reliability, observability, and performance while collaborating in a growth-focused team.

I am a Data Engineer with two years of experience working on high-volume fintech data, transitioning from a software engineering background. I specialize in building ETL pipelines, analytics datasets, and production data support using Python, SQL, PySpark, and Databricks.

I have implemented backend features and reliability improvements for a cloud-based fintech platform, investigated and resolved production data issues, and contributed to performance optimizations including a 13% build time improvement.

My project work includes config-driven PySpark batch pipelines, Databricks medallion architecture incremental ETL, and a Python ETL orchestration framework focused on observability, incremental processing, and operational reliability.

Experience

Work history, roles, and key accomplishments

Software Engineer

RedBlack Software Pvt Ltd

Aug 2021 - Feb 2026 (4 years 6 months)

Implemented backend features and data workflows for a cloud-based fintech platform, resolving production data issues and improving reliability; contributed to SDK migration and build optimizations that reduced build time by 13%.

C .NET SQL Python Pyspark AWS Data Validation Jenkins

Data Engineer (Projects)

Independent / Personal Projects

Jan 2025 - Apr 2025 (3 months)

Built PySpark and Databricks ETL pipelines (batch and incremental) using Medallion architecture and developed a Python ETL orchestration framework to improve pipeline reliability and observability.

Pyspark Databricks Delta Lake Python Parquet Data Modeling YAML

Education

Degrees, certifications, and relevant coursework

Birla Institute of Technology and Science, Pilani

Master of Technology, Data Science and Engineering

2024 - 2026

Master of Technology in Data Science and Engineering (WILP) focusing on data engineering topics completed through BITS Pilani's Work Integrated Learning Program.