Open to opportunities

Kalyan Kumar

@kalyankumar1

Message

Experienced Senior Data Engineer specializing in scalable cloud-native data platforms.

Canada

Message

What I'm looking for

I am seeking a senior data engineering role building scalable, secure cloud data platforms with strong CI/CD, streaming, and cross-functional collaboration.

I am a Senior Data Engineer with 6+ years of hands-on experience designing and operating scalable data pipelines across Azure, AWS, and GCP to drive actionable business insights.

I have built and optimized data lakes and warehouses using Azure Data Lake, Synapse, Databricks, Amazon Redshift, Snowflake, and BigQuery, and I regularly leverage PySpark, Python, SQL, and ETL tools to transform large heterogeneous datasets.

My background includes real-time streaming and ingestion with Kafka, Flume, and Pub/Sub, big data ecosystem tools (Hadoop, HDFS, Hive, Impala), and automation using Apache Airflow, CI/CD, and DevOps practices to ensure robust, secure production deployments.

I collaborate effectively with cross-functional teams, emphasize data quality, governance, and security, and continuously seek to improve performance and cost-efficiency in enterprise data architectures.

Experience

Work history, roles, and key accomplishments

Current

Azure Data Engineer

Current

Ford

Nov 2024 - Present (1 year 4 months)

Built and optimized scalable data pipelines using Azure Data Lake, Synapse Analytics, and Databricks to centralize multi-source data and deliver enterprise reports and analytics for supply chain insights.

Data Lake Azure Synapse Databricks Pyspark SQL Power BI Apache Kafka Apache Airflow Azure DevOps

AWS Data Engineer

Hopper

Sep 2021 - Nov 2024 (3 years 2 months)

Designed and optimized scalable ETL pipelines on AWS (S3, Redshift, EMR) and Snowflake to process insurance datasets, enabling real-time streaming and improved analytics performance.

AWS S3 Amazon Redshift EMR Pyspark Python Kafka Snowflake Jenkins Hadoop

Data Engineer

TCS

Jul 2019 - Sep 2021 (2 years 2 months)

Implemented scalable data pipelines on GCP using BigQuery, Dataflow, and Pub/Sub to support real-time and batch analytics for inventory and supply chain optimization.