At INFOSYS LIMITED, I optimize production PySpark and Spark pipelines for a US financial services client. I reduced a pipeline processing 5M+ records from 11 hours to 5 minutes and cut Spark SQL execution time by 90%.
Earlier, I built data integrations and analytics pipelines, including REST API pipelines processing 10K+ daily account transactions. Before focusing on data engineering, I developed Python and Django applications for AnyTable, Intrinsik OMS, and KACYBER.

