Open to opportunities

Vijay Parmar

@vijayparmar

Message

I’m a Senior Data Engineer building scalable Big Data pipelines that power analytics.

India

Message

What I'm looking for

I’m looking to lead end-to-end data engineering on scalable AWS/Spark pipelines—owning ETL/ELT, orchestration, and production reliability—while improving data quality, observability, and developer workflows through CI/CD.

I’m a results-driven Senior Data Engineer with 9+ years of experience designing and delivering scalable Big Data and cloud-based data pipelines. I bring hands-on expertise in Apache Spark, PySpark, AWS (S3, EMR, Glue, Lambda, Athena, Airflow), and Python/Scala to build reliable ETL/ELT and data warehouse solutions.

Across Pharma, Finance, and Retail, I’ve supported Fortune 500 clients including Regeneron, Novartis, Capital One, and Genentech. I’ve delivered ingestion and orchestration workflows, integrated heterogeneous sources with consistent transformation logic, and strengthened production support through monitoring, debugging, and incident response.

I enjoy production-minded engineering—CI/CD with Jenkins and GitHub, code reviews, and mentoring junior team members. As a Databricks Certified Associate Developer for Apache Spark, I focus on observability, data quality, and reusable transformation modules that improve reliability over time.

Experience

Work history, roles, and key accomplishments

Current

Senior Data Engineer

Current

Saama Technologies

Nov 2023 - Present (2 years 8 months)

Developed and maintained clinical and pharmaceutical data enablement pipelines, including centralized data lake ingestion and transformation using Python and Airflow. Built AWS-based ETL workflows with alerting and reusable transformation modules to improve reliability for production pipelines.

Python Pandas EC2 S3 Airflow Jenkins GitHub AWS Lambda AWS Glue Pyspark SNS DynamoDB EMR

Senior Software Engineer / Data Engineer

Tridhya Tech

Jul 2021 - Jun 2023 (1 year 11 months)

Built an end-to-end data migration pipeline from Oracle to AWS S3 using PySpark, including normalized and summarized data layers. Orchestrated multi-step workflows with Apache Airflow and performed peer code reviews while enforcing data quality standards.

Pyspark AWS Glue Athena EMR Airflow Apache Airflow AWS S3 Oracle

Software Engineer / Data Engineer

GS Lab

Jun 2020 - Jul 2021 (1 year 1 month)

Built daily data ingestion pipelines for restaurant order and transaction data, loading into Snowflake using bronze/silver/gold layers. Developed reusable PySpark transformation functions for null handling and data quality validation to reduce pipeline errors.

Pyspark AWS Snowflake

Software Engineer

Cygnet Infotech

Dec 2019 - May 2020 (5 months)

Contributed to backend Java microservices and supported data pipeline maintenance tasks.

Java Microservices

Software Engineer / Big Data Developer

Nascent Info Technologies

Dec 2017 - Dec 2019 (2 years)

Ingested heterogeneous data from Oracle, MySQL, and XML log servers into HDFS using Sqoop and Flume, and built staging plus Hive external warehouse tables. Applied Pig transformations for cleansing and automated weekly data warehouse refresh workflows using Oozie.

Hive Sqoop Flumes Pig Oozie HDFS Java Scala Apache Spark PostgreSQL

Java Developer

Kloudscript Pvt. Ltd

Nov 2016 - Dec 2017 (1 year 1 month)

Developed Java backend modules and REST APIs, contributing to microservices-based financial application components for credit card debt resolution workflows.

Java REST APIs Microservices