At RelevantZ Technologies Services, I architected an Amazon S3 data lake with Raw, Curated, Reject, and Archive layers for the Issuer Service project. I also developed AWS Glue and PySpark pipelines to ingest and transform insurance policy and claims data.
I improved Glue processing efficiency through worker selection, partitioning, and Spark optimization. I used Amazon Athena for data validation and troubleshooting, and developed Python automation for SharePoint-to-S3 file ingestion.
At Nallas Software Solutions Private Limited, I developed ETL solutions for Verisk’s Stat Implementation System, including an AWS ingestion framework using AWS Lambda, Amazon S3, Amazon Athena, and Amazon Aurora DB. I also maintained Pentaho Data Integration transformations for insurance datasets and downstream reporting.
I supported data migration, validation, production releases, and operational issue resolution at Nallas. I led an offshore team of three engineers, coordinating sprint work and providing technical guidance.
