At Acuity Knowledge Partners, I design and implement Databricks ETL pipelines for CECL credit risk calculations using PySpark and SQL. I build ingestion pipelines for multi-source financial datasets and reusable modules for data cleaning and business-rule transformations.
I developed a rule-driven data quality framework for validation, mismatch detection, and automated exception reporting. I also configured Databricks Workflows for CECL data refreshes and created Delta Lake tables with schema evolution, versioning, and ZORDER optimization.
I optimize PySpark transformations and SQL queries, resolve production pipeline failures, and work with client and QA teams to validate CECL reporting. My contributions have been recognized with the Employee of the Month and Rising Star awards.
