Open to opportunities

Atharva Upadhyay

@atharvaupadhyay

Data engineering intern building scalable ETL, streaming ingestion, and analytics-ready datasets with strong data quality.

India

Message

What I'm looking for

I’m looking for a data engineering role where I can build scalable ETL/streaming pipelines, enforce data quality and lineage, and ship reliable, monitored data platforms that support analytics and real-time operations.

I’m an M.Tech Dual Degree student in Artificial Intelligence and Data Science (CGPA: 8.0/10), focused on turning data into reliable, decision-ready systems. My coursework spans Machine Learning, Data Mining, Distributed Computing, Advanced Analytics, and Probability & Statistics, which shapes how I design end-to-end data pipelines.

As a Data Engineer Intern at Nimbus Property Systems Ltd (Warwick UK), I’ve built ingestion frameworks and ETL pipelines using PySpark, Python, and SQL—processing 2M+ records/day across batch and streaming workloads. I implemented data quality, validation, deduplication, and lineage tracking, improving reliability by 35%, and I orchestrate production pipelines with Airflow and ADF using monitoring and fault tolerance.

I also bring analytical depth from roles including Data Analyst Intern at Careervira and Research Analyst at Essmart Global, where I worked on scalable integrations and predictive modeling on 100K+ records. Through projects like a Delta Lake lakehouse for real-time delivery tracking and a Kafka/OpenTelemetry incident observability pipeline, I enjoy building systems that stay accurate under real-world conditions.

Experience

Work history, roles, and key accomplishments

Current

Data Engineer Intern

Current

Nimbus Property Systems Ltd

Jan 2025 - Present (1 year 6 months)

Built ingestion frameworks and ETL pipelines using PySpark, Python, and SQL, processing 2M+ records/day across batch and streaming workloads. Implemented data quality and lineage tracking, improving reliability by 35%, and orchestrated production pipelines with Airflow and Azure Data Factory.

PySpark Python SQL ETL Data Ingestion Batch Processing Data Quality Data Validation Deduplication Lineage Tracking Partitioning Late Arriving Data Handling data transformation Airflow Azure Data Factory Monitoring Fault Tolerance

Data Analyst Intern

Careervira Education Private Limited

Apr 2024 - Aug 2024 (4 months)

Built ingestion pipelines from 50+ data sources to support scalable batch data integration and processing workflows. Developed SQL-based transformations, implemented data quality checks and anomaly detection, and automated workflows reducing manual processing time by 40%.

SQL data transformation Partitioning Data Quality Validation Rules Anomaly Detection Azure Blob Storage Workflow Automation

Research Analyst

Essmart Global

Jan 2024 - Mar 2024 (2 months)

Developed predictive models on 100K+ records, improving targeting accuracy by 15% through statistical modeling and feature engineering. Built scalable data processing workflows and reports using Python, NumPy, and Power BI.

predictive modeling Statistical Modeling Feature Engineering Python NumPy Reporting Power BI

Education

Degrees, certifications, and relevant coursework

Devi Ahilya Vishwavidyalaya

Master of Technology (M.Tech), Artificial Intelligence and Data Science

2021 - 2026

Grade: CGPA: 8.0 / 10

M.Tech dual degree program in Artificial Intelligence and Data Science (CGPA: 8.0/10). Coursework includes Machine Learning, Data Mining, Distributed Computing, Advanced Analytics, and Probability & Statistics.