At Impetus Technologies, I migrated approximately 25 ETL pipelines from legacy BDL to Databricks MIDAS for the BlueStream digital insurance data platform, using PySpark and Spark SQL transformations with reconciliation and validation.
I contributed to onboarding more than 250 data feeds from MongoDB, Oracle, PostgreSQL, SFTP, and Amazon SQS. The work used Multi-Hop Architecture to process Parquet, CSV, and JSON data through layered transformations.
As an Associate Software Engineer, I improved the New Transaction Type framework for RQB processing and client-portal activity tracking. These query optimization and ETL improvements contributed to 37% lower compute costs and 40% faster execution across a platform processing more than 5TB of daily claims and policy data.
I also developed AWS ingestion pipelines during my internship and implemented validation and error-handling checks. I'm a Databricks Certified Data Engineer Professional and Associate.

