Looking for a job

Abhinandan Tiwari

@abhinandantiwari

Data Engineer building scalable ETL pipelines with PySpark, Spark, SQL, Python and Hive for high-volume data processing.

India

Message

What I'm looking for

I'm looking to build and optimize scalable data pipelines, solve data quality and performance challenges, and contribute to end-to-end Agile delivery with strong stakeholder collaboration.

Data Engineer with 4.5+ years of experience building and supporting scalable data pipelines and ETL solutions using Python, PySpark, Apache Spark, Spark SQL and Hive.

At Infosys, I worked on a banking and mortgage data engineering project for a Netherlands-based mortgage services client, processing approximately 80 GB of data daily across 300+ Hive and Delta Lake tables. I built and supported 10+ scheduled batch pipelines involving incremental loads, CDC, SCD Type 2, partitioning, reconciliation and data-quality controls.

I have experience with data transformation, SQL optimization, distributed data processing, pipeline troubleshooting and production support. I focus on building reliable, scalable and maintainable data pipelines for high-volume workloads.

Currently seeking remote Data Engineer, PySpark, Spark, Big Data or Python Data Engineer opportunities where I can apply my experience in large-scale data processing and data pipeline development.

Experience

Work history, roles, and key accomplishments

Data Engineer

Infosys Limited

Sep 2021 - Jun 2026 (4 years 9 months)

Designed and maintained scalable batch ETL pipelines processing ~80 GB/day of mortgage data, managing 300+ tables and 10+ scheduled jobs. Led end-to-end delivery including requirements analysis, solution design, stakeholder management, and release governance, with 1 year onsite in the Netherlands.