Shashwat Nath

I’m a Big Data Software Engineer and Data Engineer focused on building high-throughput ETL pipelines and highly distributed backend SaaS systems for Fortune 500 clients. I bring hands-on expertise across performance tuning, Medallion Architecture, and complex migrations in cloud-native big data platforms.

At LTIMindtree (Dec 2024–Present), I built and deployed pipelines using Apache Spark and AWS Glue with Medallion Architecture and incremental CDC to process 1M+ daily transactions. I also reduced a banking batch job from 40 to 8 minutes by applying Broadcast Hash Joins, DataFrame caching, predicate pushdowns, and optimized DPU sizing to meet SLAs.

I’ve delivered serverless, event-driven ingestion by developing microservices with AWS Lambda, SQS, and SNS—cutting legacy infrastructure costs by 40%. I’ve also managed enterprise-grade workflows using Delta Live Tables (DLT) with Databricks Jobs, AWS Step Functions, and Stonebranch to support data-to-BI transformations and AI features.

I’m comfortable taking ownership of migration and reliability: I migrated 180+ tables from MSSQL to Aurora PostgreSQL using AWS SCT and DMS while maintaining 99% system availability and meeting strict migration SLAs. I enjoy pairing engineering rigor with experimentation—currently developing high-performance Scala/Spark modules in the Hadoop ecosystem for a fintech wallet project.