# Patel Kartik Patel Kartik is a remote worker on Himalayas, Senior Data Engineer at EY, based in Canada. Source: https://himalayas.app/@patelkartik ```text Senior Data Engineer at EY building HIPAA-compliant Azure lakehouse pipelines that cut data processing latency by 45%. ``` | Detail | Value | | --- | --- | | Availability | Looking for a job | | Location | Canada | | Authorized to work in | Canada | | Salary expectations | 140k+ INR | | Job categories | Data Engineer, ETL Developer | | Skills | Data Engineering, ETL ELT, Data Warehouse, Data Lake, Batch Processing, Real Time Data Streaming, Data Quality, Data Governance, Data Lineage, Dimensional Modeling, Kimball Modelling Methodology, Medallion Architecture, Data Pipelines, Lakehouse Architecture, Data Integration | ## About ```text At EY, I build Azure lakehouse solutions for healthcare data, transforming claims into analytics-ready datasets with Delta Lake and Azure Databricks. My work reduced processing latency by 45% while protecting PHI. Previously, at Toyota Motors, I developed telecom data pipelines on GCP, including BigQuery workloads that reduced query execution time by 67%. I also worked on ETL and data integration at Capgemini, and hold Azure, AWS, and Google Cloud data engineering certifications. ``` ## Experience ### Senior Data Engineer (current) [EY](https://himalayas.app/companies/ey). Aug 2024 - Present ```text Engineered robust data pipelines using Azure Data Factory and Apache Airflow, architected lakehouse solutions with Delta Lake on Azure Databricks, and developed real-time streaming workflows with Kafka and Azure Event Hubs. Implemented data quality frameworks, CI/CD pipelines, and multi-cloud data platforms across AWS, Azure, and GCP. ``` Skills: Azure-Data-Factory, Airflow, Azure-Data-Lake-Storage, Azure-Databricks, Delta-Lake, Kafka, Azure-Event-Hubs, PySpark, Apache-Spark, Azure-Synapse, SQL, Scala, Python, DBT, Snowflake, Azure-SQL-Database, Power-BI, GitHub-Actions, Terraform, Azure-Functions, IBM-DataStage, Azure-Kubernetes-Service, Docker, Informatica-PowerCenter, PostgreSQL, Azure-Machine-Learning, R, azure-monitor, Log-Analytics, KQL, S3, AWS-Glue, Amazon-EMR, Amazon-Redshift, AWS-Lambda, Google-Cloud-Storage, BigQuery, Google-Cloud-Dataflow, Google-Cloud-Dataproc, Google-Cloud-Pub-Sub, Apache-Beam, Azure-Key-Vault, Apache-NiFi, SFTP, Hive, HBase, Kafka-Connect-API, Alation, Azure-OpenAI, Azure-Bot-Service, Azure-Cognitive-Search, Azure-Form-Recognizer, ELK-Stack, Kibana, Azure-Virtual-Machines, Azure-Blob-Storage, Cognitive-Services, Azure-AI-Speech, Azure-AI-Vision, Hadoop-HDFS, SSIS, E-R-Studio, Confluence, HIPAA, HITRUST, HL7-FHIR, Agile, CI-CD, Data-Governance, Data-Quality, Data-Lineage, ETL-ELT, Batch-Processing, Real-Time-Data-Streaming, Dimensional-Modeling, Kimball-Modelling-Methodology, Medallion-Architecture, At-Rest-Encryption, Data-in-Transit-Encryption, RBAC ### Senior Data Engineer (current) [EY](https://himalayas.app/companies/ey). Aug 2024 - Present ```text Engineered robust data pipelines using Azure Data Factory and Apache Airflow, architected lakehouse solutions with Delta Lake, and developed real-time streaming workflows with Kafka and Event Hubs. Implemented data quality frameworks, CI/CD pipelines, and multi-cloud data platforms across AWS, Azure, and GCP. ``` Skills: Azure-Data-Factory, Airflow, Azure-Data-Lake-Storage, Azure-Databricks, Delta-Lake, Kafka, Azure-Event-Hubs, PySpark, Apache-Spark, Azure-Synapse, SQL, Scala, Python, DBT, Snowflake, Azure-SQL-Database, Power-BI, GitHub-Actions, Terraform, Azure-Functions, IBM-DataStage, Azure-Kubernetes-Service, Docker, Informatica-PowerCenter, PostgreSQL, Azure-Machine-Learning, R, azure-monitor, Log-Analytics, KQL, S3, AWS-Glue, Amazon-EMR, Amazon-Redshift, AWS-Lambda, Google-Cloud-Storage, BigQuery, Google-Cloud-Dataflow, Google-Cloud-Dataproc, Google-Cloud-Pub-Sub, Apache-Beam, Azure-Key-Vault, Apache-NiFi, SFTP, Hive, HBase, Kafka-Connect-API, Alation, Azure-OpenAI, Azure-Bot-Service, Azure-Cognitive-Search, Azure-Form-Recognizer, ELK-Stack, Kibana, Azure-Virtual-Machines, Azure-Blob-Storage, Cognitive-Services, Azure-AI-Speech, Azure-AI-Vision, Hadoop-HDFS, SSIS, E-R-Studio, Confluence, HIPAA, HITRUST, HL7-FHIR, Agile, CI-CD, Data-Governance, Data-Quality, Data-Lineage, ETL-ELT, Batch-Processing, Real-Time-Data-Streaming, Dimensional-Modeling, Kimball-Modelling-Methodology, Medallion-Architecture, At-Rest-Encryption, Data-in-Transit-Encryption, RBAC ### Data Engineer Toyota Motors. Nov 2021 - Aug 2024 ```text Engineered end-to-end data pipelines using Apache Beam and Dataflow, developed real-time streaming architectures with Pub/Sub and Kafka, and migrated legacy Teradata warehouse to Snowflake. Optimized BigQuery queries, built monitoring dashboards, and implemented data governance and quality frameworks. ``` Skills: Apache-Beam, Google-Cloud-Dataflow, Google-Cloud-Pub-Sub, Google-Cloud-Functions, BigQuery, Google-Cloud-Dataproc, Google-Cloud-Storage, Google-Cloud-SQL, Google-Cloud-Spanner, Google-Kubernetes-Engine, Google-Compute-Engine, Cloud-Logging, Stackdriver, Snowflake, Teradata, Talend-Open-Studio, Airflow, Kafka, Apache-Spark, PySpark, Scala, Python, Java, SQL, Hadoop, HDFS, MapReduce, Hive, Apache-Flume, Docker, GitLab-CI-CD, S3, AWS-Glue, Amazon-EMR, Amazon-Redshift, Amazon-Kinesis, Azure-Data-Factory, Data-Lake-Storage-Gen2, Azure-Databricks, Azure-Synapse, Azure-Event-Hubs, Great-Expectations, Apache-Atlas, Splunk, Looker, Data-Studio, Power-Designer, BASH, Gitlab, Slack, Scrum, SDLC, ETL-ELT, Data-Integration, Data-Quality, Data-Governance, Data-Lineage, Dimensional-Modeling, Slowly-Changing-Dimension, Batch-Processing, Real-Time-Data-Streaming, CI-CD, Infrastructure-as-Code, Cloud-Monitoring, Regulatory-Compliance, Data-Retention, ACID ### Data Engineer Toyota Motors. Nov 2021 - Aug 2024 ```text Engineered end-to-end data pipelines using Apache Beam and Dataflow, developed real-time streaming architectures with Pub/Sub and Kafka, and migrated legacy Teradata warehouse to Snowflake. Implemented data governance, optimized BigQuery queries, and built monitoring dashboards in Looker. ``` Skills: Apache-Beam, Google-Cloud-Dataflow, Google-Cloud-Pub-Sub, Google-Cloud-Functions, BigQuery, Google-Cloud-Dataproc, Google-Cloud-Storage, Google-Cloud-SQL, Google-Cloud-Spanner, Google-Kubernetes-Engine, Google-Compute-Engine, Cloud-Logging, Stackdriver, Snowflake, Teradata, Talend-Open-Studio, Airflow, Kafka, Apache-Spark, PySpark, Scala, Python, Java, SQL, Hadoop, HDFS, MapReduce, Hive, Apache-Flume, Docker, GitLab-CI-CD, S3, AWS-Glue, Amazon-EMR, Amazon-Redshift, Amazon-Kinesis, Azure-Data-Factory, Data-Lake-Storage-Gen2, Azure-Databricks, Azure-Synapse, Azure-Event-Hubs, Great-Expectations, Apache-Atlas, Splunk, Looker, Data-Studio, Power-Designer, BASH, Gitlab, Slack, Scrum, SDLC, ETL-ELT, Data-Integration, Data-Quality, Data-Governance, Data-Lineage, Dimensional-Modeling, Slowly-Changing-Dimension, Batch-Processing, Real-Time-Data-Streaming, CI-CD, Infrastructure-as-Code, Cloud-Monitoring, Regulatory-Compliance, Data-Retention, ACID ### ETL Developer [Capgemini](https://himalayas.app/companies/capgemini-technology-services). Sep 2018 - Nov 2021 ```text Engineered end-to-end data pipelines on GCP, developed dimensional models, and orchestrated batch workflows with Informatica PowerCenter. Built real-time ingestion with Kafka and performed statistical analysis using R and SQL. ``` Skills: Google-Cloud-Platform, AWS, Azure, Google-Compute-Engine, Google-Cloud-Storage, BigQuery, Google-Cloud-Dataflow, Google-Cloud-Dataproc, Apache-Beam, S3, AWS-Glue, Amazon-EMR, Amazon-Redshift, EC2, Azure-Data-Factory, Data-Lake-Storage-Gen2, Azure-Databricks, Azure-Synapse, Kafka, Apache-Spark, Spark-Streaming, PySpark, Python, SQL, Hadoop, HDFS, Hive, MapReduce, Sqoop, Flumes, Informatica-PowerCenter, Workflow-Manager, Workflow-Monitor, Repository-Manager, E-R-Studio, Tableau, R, BASH, Unix, SVN, Agile, Scrum, SDLC, ETL-ELT, Data-Integration, Data-Quality, Dimensional-Modeling, Star-Schemas, Real-Time-Data-Streaming, Batch-Processing, HIPAA, SOC2 ### ETL Developer [Capgemini](https://himalayas.app/companies/capgemini-technology-services). Sep 2018 - Nov 2021 ```text Engineered end-to-end data pipelines on GCP, developed dimensional models, and orchestrated batch workflows with Informatica PowerCenter. Built real-time ingestion with Kafka and Hadoop, performed statistical analysis, and designed Tableau visualizations. ``` Skills: Google-Cloud-Platform, AWS, Azure, Google-Compute-Engine, Google-Cloud-Storage, BigQuery, Google-Cloud-Dataflow, Google-Cloud-Dataproc, Apache-Beam, S3, AWS-Glue, Amazon-EMR, Amazon-Redshift, EC2, Azure-Data-Factory, Data-Lake-Storage-Gen2, Azure-Databricks, Azure-Synapse, Kafka, Apache-Spark, Spark-Structured-Streaming, PySpark, Python, SQL, Hadoop, HDFS, Hive, MapReduce, Sqoop, Flumes, Informatica-PowerCenter, Workflow-Manager, Workflow-Monitor, Repository-Manager, E-R-Studio, Tableau, R, BASH, Unix, SVN, Agile, Scrum, SDLC, ETL-ELT, Data-Integration, Data-Quality, Dimensional-Modeling, Star-Schemas, Real-Time-Data-Streaming, Batch-Processing, HIPAA, SOC2 ## Education ### Visvesvaraya Technological University Bachelor of Technology, Electrical and Electronics Engineering ```text Bachelor of Technology in Electrical and Electronics Engineering, completed in May 2018. ``` ### Visvesvaraya Technological University Bachelor of Technology, Electrical and Electronics Engineering ```text Bachelor of Technology in Electrical and Electronics Engineering from Visvesvaraya Technological University, Belagavi, India, completed in May 2018. ``` ## Tech stack - Amazon Redshift - Snowflake - Splunk - Apache Spark - AWS Glue - Apache Flink - Alation - Tableau - Looker - Data Studio - Amazon Quicksight - Azure Bot Service - AWS IAM - Google Compute Engine - Stackdriver - Amazon S3 - Google Cloud Storage - GitHub - GitLab - Kubernetes - Helm - Azure Kubernetes Service - Jenkins - GitHub Actions - GitLab CI - PySpark - dbt - Sqoop - MySQL - PostgreSQL - Oracle - Hadoop - HBase - Google Cloud Spanner - Slack - Terraform - Python - Java - Scala - AWS CloudTrail - Apache Flume - Apache NiFi - Grafana - Kibana - Prometheus - Azure Monitor - AWS X-Ray - Confluence - Google Cloud Dataflow - Amazon Kinesis - Google Cloud Pub/Sub - Azure Cognitive Search - AWS Lambda - Azure Functions - Microsoft Excel - Amazon Aurora - Azure SQL Database - Google Cloud SQL - Kafka Streams - OAuth2 - Git - Docker - Amazon VPC - Apache Beam - Google BigQuery - Amazon EMR - SQL - Google Kubernetes Engine - Google Cloud Dataproc - Confluent Platform - Delta Lake - Great Expectations - Collibra - Bash - Apache Parquet - Informatica PowerCenter - Power BI - Apache Kafka To contact Patel, message them from this profile with a Himalayas employer account: [Hire on Himalayas](https://himalayas.app/hire). ## People also viewed - [Hanish User](https://himalayas.app/@hanishuser): Senior Data Engineer, Rogers Communications - [Ravi Dutt R](https://himalayas.app/@raviduttr): Azure Data Engineer, Markel - [Unnathi Shetty](https://himalayas.app/@unnathishetty): Azure Data Engineer, Capgemini - [Parth Anshu](https://himalayas.app/@parthanshu): Senior Data Engineer, Deloitte - [Parth Kumar](https://himalayas.app/@parthkumar2): Senior Data Engineer, Amaris Consulting - [Peter Michael](https://himalayas.app/@petermichael2): Senior Data Engineer, EY - [Kartik Patel](https://himalayas.app/@kartikpatel4): Senior Data Engineer, Deloitte - [Kumar Dharmil](https://himalayas.app/@kumardharmil): Senior Data Engineer, Rogers Communications - [Chandana Sri](https://himalayas.app/@chandanasri): Senior Data Engineer, Rogers Communications - [Dharmil Patel](https://himalayas.app/@dharmilpatel): Senior Data Engineer, EY