At CPP Investments, I developed Python data pipelines that bring legal and compliance data from APIs and file servers into an OpenSearch-based data lake. I also led development of a company-wide entity-search and conflict-of-interest detection system.
I built CI/CD pipelines with GitHub Actions, automated infrastructure provisioning with Terraform, and managed orchestration through AWS MWAA (Airflow). I also created a local development framework to make onboarding and data product development faster.
At Ness Digital Engineering (Niyuj), I architected a metadata-driven data platform for Out of the Blue’s North Star project. Its Kedro pipelines processed millions of records per hourly batch to support analytics and reporting.
Earlier, I built APIs and scheduling systems for machine-learning model training and deployment at Pivotchain Solutions, and developed web crawling and data extraction systems at Innoplexus & Meditab.
