At KFin Technologies Limited, I led the design and delivery of SIP pre-endorsement pipelines using PySpark on AWS Glue and EMR. I automated the communication lifecycle through email and SMS integrations, reaching 10K+ investors daily with zero manual intervention and improving data accuracy by 40%.
On the Statement of Accounts platform, I designed and built Spark-Scala ETL pipelines on EMR for month-end statements, achieving a 6× speedup. I extended the platform to three additional funds and led the team while mentoring junior engineers.
I also tuned EMR workloads to cut compute costs by 25% and increase throughput by 35%. My work includes data quality checks, AWS orchestration and monitoring, and Jenkins CI/CD.
