Open to opportunities

Tushar Choudhary

@tusharchoudhary1

Message

Senior Data Engineer with expertise in data pipelines and architecture.

India

Message

What I'm looking for

I am looking for a role that fosters innovation and collaboration, where I can leverage my data engineering expertise to drive impactful solutions and contribute to a data-driven culture.

With over 6 years of experience as a Senior Data Engineer, I have excelled in collaborating with international clients and managing large datasets, consistently driving impactful solutions. My expertise includes architecting scalable data solutions, optimizing processes, and crafting advanced algorithms that deliver measurable business value.

At TrueCaller, I orchestrated the seamless migration of Spark jobs to Big Query, enhancing efficiency and minimizing data processing time. My contributions to the Apache Iceberg project have focused on improving data management and querying efficiency. I take pride in leading teams to design and build scalable data platforms that support business needs while reducing operational costs.

Throughout my career, I have successfully migrated data lakes, developed libraries for Change Data Capture, and democratized data access for cross-functional teams. My commitment to enabling data-driven insights has been a driving force in my professional journey, and I am dedicated to leveraging my skills to create innovative solutions in the data engineering space.

Experience

Work history, roles, and key accomplishments

Current

Senior Data Engineer

Current

TrueCaller

Feb 2025 - Present (6 months)

Orchestrated the seamless migration of Spark jobs to Big Query Jobs, enhancing efficiency and minimising data processing time. Actively contributed to the Apache Iceberg project, focusing on improving data management and querying efficiency.

Spark BigQuery Apache Iceberg Data Migration Data Management Query Optimization

Senior Data Engineer

Upstox

Nov 2021 - Dec 2023 (2 years 1 month)

Successfully migrated the existing data lake from Parquet to Hudi, resulting in an annual reduction in ingestion costs by $200K and 0.97 uptime. Developed a Python library for consuming Change Data Capture (CDC) from AWS DMS service, supporting 30+ databases and 300+ tables in 1 hour SLA.

AWS Glue S3 Athena Python Spark Airflow Hudi Data Lake ETL

Business Technology Associate

ZS Associate

May 2018 - Feb 2020 (1 year 9 months)

Focused on converting diverse data sources into the OMOP Common Data Model for systematic analysis of observational databases. Proficient in designing and implementing ETL workflows, leveraging engineering expertise to develop rules and create pipelines for generating analysis-ready data.

ETL Data Analysis Data Pipelines Data Automation

Intern

Edelweiss Financial Services

Jun 2017 - Jul 2017 (1 month)

Completed an internship with a prominent fintech brokerage firm. Gained valuable exposure to blockchain technology and its applications in the financial industry.

Blockchain Technology Fintech Data Exposure

Education

Degrees, certifications, and relevant coursework

Army Institute of Technology, Pune

Bachelor of Technology, Information Technology

2014 - 2018

Grade: Distinction

Graduated with Distinction in Information Technology. Studied various aspects of information technology, preparing for a career in software and data engineering.