Open to opportunities

Nikhil Tiwari

@nikhiltiwari

Message

Expert Big Data Engineer with 14+ years building end-to-end data platforms and scalable pipelines.

India

Message

What I'm looking for

I am seeking senior data engineering roles focused on end-to-end platform delivery, automation, scalable pipelines, and collaborative client-facing engagements.

I am an Expert Big Data Engineer with 14+ years of overall experience and 11+ years focused on the Big Data domain, building end-to-end Data-as-a-Service platforms using modern big data technologies. I have worked with clients across the USA, Africa, Australia, and Singapore in telecom, payments, advertising, and insurance.

My core strengths include data analysis, modeling, and writing transformation logic with Apache Spark (PySpark, Spark SQL). I have designed and delivered data transformation modules, led migration projects (Cloudera to Azure/AWS), and implemented orchestration using Airflow, Step Functions and EventBridge.

I deliver practical solutions covering ingestion, transformation, validation and delivery—working across AWS, Azure, Databricks, HDFS, Hive, HBase, MongoDB, Oracle and MySQL—and I focus on automation, data quality and clear client communication throughout engagements.

Experience

Work history, roles, and key accomplishments

Current

Expert BigData Engineer

Current

Open Insights LLP

Apr 2018 - Present (7 years 5 months)

Led end-to-end DaaS implementations including data analysis, ingestion, transformation and delivery; migrated applications from Cloudera to Azure/AWS platforms and implemented Databricks-based transformations and automation frameworks.

Databricks Azure AWS Airflow Data Modeling Data Ingestion Data Validation

Consultant

Ligadata Inc

Aug 2017 - Mar 2018 (7 months)

Delivered large-scale data pipeline implementations for telecom clients, optimizing performance for significantly larger datasets and extending prior solutions across geographies.

Data Pipelines AWS EMR Spark Performance Optimization Data Governance CI CD Data Mapping

Senior Software Engineer

Avulze Consulting Pvt. Ltd.

Jun 2016 - Jul 2017 (1 year 1 month)

Developed end-to-end data pipelines for telecom clients including source-to-target mapping and multi-layer Spark SQL transformations; used Sqoop for ingest and contributed to RFIs and solution proposals.

Sqoop HDFS Oracle Data Mapping ETL Solution Architecture SQL Optimization

Associate Software Engineer

Synechron Technologies Pvt. Ltd.

Apr 2011 - May 2016 (5 years 1 month)

Participated in Hadoop/MongoDB POCs and developed Java/Spring MVC applications; handled requirement gathering, schema design, and delivered scalable data processing recommendations.