Looking for a job

Abhinandan Tiwari

@abhinandantiwari

Data Engineer building scalable ETL pipelines with PySpark, Spark, SQL, Python and Hive for high-volume data processing.

India

Message

What I'm looking for

I'm looking to build and optimize scalable data pipelines, solve data quality and performance challenges, and contribute to end-to-end Agile delivery with strong stakeholder collaboration.

Data Engineer with 4.5+ years of experience building and supporting scalable data pipelines and ETL solutions using Python, PySpark, Apache Spark, Spark SQL and Hive.

At Infosys, I worked on a banking and mortgage data engineering project for a Netherlands-based mortgage services client, processing approximately 80 GB of data daily across 300+ Hive and Delta Lake tables. I built and supported 10+ scheduled batch pipelines involving incremental loads, CDC, SCD Type 2, partitioning, reconciliation and data-quality controls.

I have experience with data transformation, SQL optimization, distributed data processing, pipeline troubleshooting and production support. I focus on building reliable, scalable and maintainable data pipelines for high-volume workloads.

Currently seeking remote Data Engineer, PySpark, Spark, Big Data or Python Data Engineer opportunities where I can apply my experience in large-scale data processing and data pipeline development.

Experience

Work history, roles, and key accomplishments

Technology Analyst

Infosys Limited

Apr 2026 - Jun 2026 (2 months)

Worked as a Data Engineer for a Banking (Mortgage) client while holding the official designation of Technology Analyst
* Design and maintained scalable batch ETL data pipelines using PySpark, Apache Spark, SQL, Python, Hive, Hadoop.
* Optimized Spark applications and SQL queries to improve data processing performance and pipeline efficiency.

PySpark Apache Spark Hive Hadoop HDFS Delta Lake SQL Python Java Shell Scripting MySQL MariaDB Informatica JAMS Scheduler Git Jira Confluence Partitioning Data Quality

Senior Systems Engineer

Infosys Limited

Oct 2023 - Mar 2026 (2 years 5 months)

Worked as a Data Engineer while holding the official designation of Senior Systems Engineer.
* Developed ETL workflows using CDC, SCD Type 2, data transformation, partitioning, and data quality validation techniques.
* Completed a 1-year onsite assignment in the Netherlands, working directly with client stakeholders to support production systems and deliver high-quality data engineering solutions.

PySpark Apache Spark SQL Hive HDFS Python

Systems Engineer

Infosys Limited

Sep 2021 - Sep 2023 (2 years)

Worked as a Data Engineer for a Banking (Mortgage) client while holding the official designation of Systems Engineer.
* Developed ETL workflows using CDC, SCD Type 2, data transformation, partitioning, and data quality validation techniques.
* Provided production support, including job monitoring, incident analysis, issue resolution, and SLA adherence.

Apache Spark SQL Python Shell Scripting HDFS JAMS Scheduler