Parth Anshu
@parthanshu
Senior Data Engineer with 6+ years building scalable ETL/ELT pipelines, data lakes, and streaming analytics on cloud.
What I'm looking for
I’m an experienced Senior Data Engineer with 6+ years designing, developing, and optimizing scalable ETL/ELT pipelines, data warehouses, and data lakes for enterprise analytics and reporting. I focus on building high-performance data platforms that improve business intelligence, operational efficiency, and large-scale processing.
At Deloitte, I designed and deployed cloud-native architectures using Amazon S3, AWS Glue, and governed analytics with AWS Lake Formation and Collibra metadata. I engineered real-time transaction monitoring with Kinesis, Lambda, and Redshift, orchestrated end-to-end workflows with Apache Airflow, and delivered scalable batch processing using Apache Spark and PySpark on EMR.
I also build streaming and real-time solutions—leveraging Apache Kafka/Kafka Streams, Spark Streaming, and Kubernetes-based deployments—while keeping data trustworthy through frameworks like Great Expectations and dbt testing. I’ve implemented versioned analytics using Delta Lake and Apache Iceberg, and optimized query performance using Parquet, partition pruning, and Redshift/Athena improvements.
Previously at Cognizant, I developed GCP-based pipelines using Apache Beam and Dataflow, designed dimensional models using Star Schema, and delivered healthcare analytics workflows while maintaining strong compliance. Across both roles, I prioritize automation (Terraform, CI/CD with Jenkins/GitHub Actions), secure access (OAuth2/JWT), and observability (CloudWatch/Prometheus/Grafana/ELK) so teams can move faster with confidence.
Experience
Work history, roles, and key accomplishments
Designed and deployed scalable AWS data lake and governance architectures for banking analytics, including S3 multi-tier storage, Lake Formation policies, and Glue Data Catalog integration with Collibra. Built real-time and batch pipelines using Kinesis, Lambda, Airflow, Glue, EMR/Spark, Kafka, and Delta/Iceberg, with monitoring, data quality, and analytics enablement for Redshift/Snowflake.
Data Engineer
BMW
Mar 2022 - Jan 2024 (1 year 10 months)
Engineered end-to-end telecom data pipelines on GCP, including batch ETL orchestration with Airflow and streaming ingestion using Pub/Sub, Kafka, Dataflow (Beam), and Cloud Functions into BigQuery. Built data governance and quality frameworks (Apache Atlas, Great Expectations), migrated data to Snowflake, containerized services for GKE, and delivered KPI dashboards via Looker/Data Studio.
Built healthcare ETL pipelines on GCP using Kafka and Compute Engine for ingestion into Cloud Storage, and modeled dimensional schemas in BigQuery using star schema techniques. Developed batch and real-time workflows with Informatica PowerCenter, Hive on HDFS, MapReduce, and BigQuery, and supported predictive analytics with R while implementing security controls using Azure AD and Azure Key Vault
Education
Degrees, certifications, and relevant coursework
Sardar Vallabhbhai Patel Institute of Technology
Bachelor of Engineering, Information Technology
Bachelor of Engineering in Information Technology, completed in May 2019.
Tech stack
Software and tools used professionally
Amazon Redshift
Splunk
Azure Synapse
Apache Spark
AWS Glue
Apache Flink
Talend
Data Studio
Amazon Quicksight
Amazon Lex
Amazon EC2
Microsoft Azure
Amazon CloudWatch
Stackdriver
Amazon S3
GitHub
GitLab
Kubernetes
Jenkins
GitHub Actions
GitLab CI
Jupyter
PySpark
dbt
DB
Sqoop
MySQL
PostgreSQL
MongoDB
Microsoft SQL Server
Cassandra
Hadoop
HBase
Gmail
Yarn
Databricks
Amazon Rekognition
Terraform
Visual Studio
Azure DevOps
Jira
Java
JSON
AWS CloudTrail
PyTorch
scikit-learn
Amazon Personalize
Kafka
Apache NiFi
Grafana
Prometheus
Azure Monitor
Amazon Comprehend
Zookeeper
Linux
Windows
Azure Active Directory
AWS X-Ray
Amazon Kinesis
AWS Lambda
Serverless
Azure Functions
AWS Batch
Azure SQL Database
Kafka Streams
Amazon Polly
OAuth2
Airflow
Apache Beam
Time Analytics
erwin Data Modeler
Mapped
Amazon Elastic Container Service
Amazon EMR
Amazon Athena
SQL
Amazon SageMaker
Azure Cosmos DB
Azure Blob Storage
Amazon Textract
Apache Iceberg
Confluent Platform
Monte Carlo
Ray
Delta Lake
Great Expectations
Collibra
Cosmos
Bash
Transform
Factory
Beam
Jan
X++
Availability
Location
Authorized to work in
Job categories
Skills
Interested in hiring Parth?
You can contact Parth and 90k+ other talented remote workers on Himalayas.
Message ParthGet matched with your dream remote job
Sign up now and join over 250,000+ remote workers who receive personalized job alerts, curated job matches, and more for free!
