Open to opportunities

chaitanya chaitanya

@chaitanyachaitanya

Message

Senior Data Engineer with 6+ years building scalable cloud and big-data pipelines.

Canada

Message

What I'm looking for

I seek a senior data engineering role building scalable cloud-native data platforms, emphasizing real-time pipelines, data governance, performance tuning, and cross-functional collaboration.

I am a results-driven Senior Data Engineer with over six years of experience designing, building, and optimizing large-scale data platforms across AWS, Azure, and GCP. I have led end-to-end data projects including real-time streaming, ETL orchestration, cloud data lakes, warehousing (Redshift, Synapse, BigQuery, Snowflake), and implemented fraud-detection and ML feature pipelines that improved detection and processing efficiency.

I specialize in PySpark/Scala/Java development, Apache Spark, Kafka, AWS Glue, Databricks, Airflow, and data modeling with strong DevOps practices (CI/CD, Docker, Kubernetes). I prioritize data quality, governance, and performance tuning, and have delivered measurable improvements such as 30–50% gains in processing and query performance while maintaining high availability and security.

Experience

Work history, roles, and key accomplishments

Current

Senior Data Engineer

Current

Bell

Sep 2024 - Present (1 year 3 months)

Built real-time fraud detection and large-scale ETL pipelines using Kafka, AWS Glue, Spark and Redshift, improving ingestion efficiency by 30% and reducing batch processing times by 40%. Led data warehousing and ML feature pipelines that increased fraud detection accuracy by 45% and ETL uptime to 99.9%.

AWS Glue Apache Kafka Apache Spark Scala Amazon S3 Amazon Redshift Apache NiFi AWS Cloudwatch

Data Engineer

Mitel Networks

Nov 2021 - Sep 2024 (2 years 10 months)

Designed billing and payments pipelines on GCP using Dataflow, Pub/Sub and BigQuery, building 50+ streaming and batch pipelines that cut data processing time by 35% and improved forecasting accuracy by 25%. Implemented secure, automated ETL orchestration and CI/CD for GKE deployments.

Google Cloud Platform Dataflow Cloud Pub Sub BigQuery Apache Beam Terraform Kubernetes TensorFlow

ETL Developer

TCS

Aug 2019 - Nov 2021 (2 years 3 months)

Built and deployed scalable ETL pipelines with Informatica, Talend and Python to ingest transactional and NoSQL data into Amazon Redshift and S3, improving data processing efficiency and enabling integrated analytics with Tableau.