Looking for a job

Patel Kartik

@patelkartik

Senior Data Engineer at EY building HIPAA-compliant Azure lakehouse pipelines that cut data processing latency by 45%.

At EY, I build Azure lakehouse solutions for healthcare data, transforming claims into analytics-ready datasets with Delta Lake and Azure Databricks. My work reduced processing latency by 45% while protecting PHI.

Previously, at Toyota Motors, I developed telecom data pipelines on GCP, including BigQuery workloads that reduced query execution time by 67%. I also worked on ETL and data integration at Capgemini, and hold Azure, AWS, and Google Cloud data engineering certifications.

Experience

Work history, roles, and key accomplishments

Current

Senior Data Engineer

Current

Aug 2024 - Present (2 years 1 month)

Engineered robust data pipelines using Azure Data Factory and Apache Airflow, architected lakehouse solutions with Delta Lake, and developed real-time streaming workflows with Kafka and Event Hubs. Implemented data quality frameworks, CI/CD pipelines, and multi-cloud data platforms across AWS, Azure, and GCP.

Azure Data Factory Airflow Azure Data Lake Storage Azure Databricks Delta Lake Kafka Azure Event Hubs PySpark Apache Spark Azure Synapse SQL Scala Python DBT Snowflake Azure SQL Database Power BI GitHub Actions Terraform Azure Functions IBM DataStage Azure Kubernetes Service Docker Informatica PowerCenter PostgreSQL Azure Machine Learning R azure monitor Log Analytics KQL S3 AWS Glue Amazon EMR Amazon Redshift AWS Lambda Google Cloud Storage BigQuery Google Cloud Dataflow Google Cloud Dataproc Google Cloud Pub Sub Apache Beam Azure Key Vault Apache NiFi SFTP Hive HBase Kafka Connect API Alation Azure OpenAI Azure Bot Service Azure Cognitive Search Azure Form Recognizer ELK Stack Kibana Azure Virtual Machines Azure Blob Storage Cognitive Services Azure AI Speech Azure AI Vision Hadoop HDFS SSIS E R Studio Confluence HIPAA HITRUST HL7 FHIR Agile CI CD Data Governance Data Quality Data Lineage ETL ELT Batch Processing Real Time Data Streaming Dimensional Modeling Kimball Modelling Methodology Medallion Architecture At Rest Encryption Data in Transit Encryption RBAC

Current

Senior Data Engineer

Current

Aug 2024 - Present (2 years 1 month)

Engineered robust data pipelines using Azure Data Factory and Apache Airflow, architected lakehouse solutions with Delta Lake on Azure Databricks, and developed real-time streaming workflows with Kafka and Azure Event Hubs. Implemented data quality frameworks, CI/CD pipelines, and multi-cloud data platforms across AWS, Azure, and GCP.

Data Engineer

Toyota Motors

Nov 2021 - Aug 2024 (2 years 9 months)

Engineered end-to-end data pipelines using Apache Beam and Dataflow, developed real-time streaming architectures with Pub/Sub and Kafka, and migrated legacy Teradata warehouse to Snowflake. Optimized BigQuery queries, built monitoring dashboards, and implemented data governance and quality frameworks.

Data Engineer

Toyota Motors

Nov 2021 - Aug 2024 (2 years 9 months)

Engineered end-to-end data pipelines using Apache Beam and Dataflow, developed real-time streaming architectures with Pub/Sub and Kafka, and migrated legacy Teradata warehouse to Snowflake. Implemented data governance, optimized BigQuery queries, and built monitoring dashboards in Looker.

ETL Developer

Capgemini

Sep 2018 - Nov 2021 (3 years 2 months)

Engineered end-to-end data pipelines on GCP, developed dimensional models, and orchestrated batch workflows with Informatica PowerCenter. Built real-time ingestion with Kafka and performed statistical analysis using R and SQL.