Open to opportunities

Adyasha Pattanayak

@adyashapattanayak

Message

Data Engineer building scalable AWS ETL, CDC pipelines, and distributed architectures.

India

Message

What I'm looking for

I’m looking for a data engineering role where I can own scalable AWS ETL/CDC pipelines, build distributed data architectures, and partner with teams on performance, reliability, and automation—while continuing to modernize legacy systems.

I’m a Data Engineer with 2+ years of experience building scalable ETL pipelines and distributed data architectures on AWS. I focus on production-grade CDC-based migrations and high-volume batch/streaming processing—handling 10M+ records daily—with monitoring, alerting, and CI/CD integration.

In my recent work, I led the modernization of a legacy SIP platform by migrating to Yugabyte, improving I/O performance and reducing operational effort by 75%. I’ve also designed Spark-based replication pipelines that continuously sync data from an S3 data lake into Snowflake for near-real-time analytics, and I’ve automated end-to-end ingestion from MSSQL to S3 using AWS DMS to accelerate reporting performance.

Experience

Work history, roles, and key accomplishments

Senior Data Engineer

KFin Technologies Ltd

Apr 2025 - May 2026 (1 year 1 month)

Led migration of a legacy SIP platform to a Yugabyte distributed architecture, improving I/O performance and reducing operational effort by 75%. Built scalable batch ETL pipelines with AWS Glue and Apache Spark, processing 10M+ records per day and implementing monitoring, data quality checks, and real-time alerts via CloudWatch and SNS.

AWS Glue Apache Spark ETL Data Modeling Amazon S3 Parquet Cloudwatch SNS CI CD

Data Engineer

KFin Technologies Ltd

Jul 2023 - Mar 2025 (1 year 8 months)

Developed Spark-based batch and streaming pipelines on AWS EMR to enable CDC replication from S3 to Snowflake. Orchestrated workflows using AWS Step Functions with Airflow-style DAG patterns and automated reconciliation, failure analysis, and alerting using Lambda, Glue, and SNS.

Apache Spark CDC Amazon S3 Snowflake AWS Step Functions AWS Lambda AWS Glue SNS

Data Engineering Intern

KFin Technologies Ltd

Jun 2022 - Jun 2023 (1 year)

Built Spark-based data warehouse pipelines on AWS EMR with automated monitoring and alerts. Migrated MSSQL data to Amazon S3 using AWS DMS with CDC for incremental ingestion and reduced report generation time by 50% via optimized Python automation.