At Incedo Inc., I own end-to-end data pipelines processing 300GB+ of daily financial data from AWS S3 and Fivetran into Snowflake, supporting more than five downstream analytics teams.
I designed dimensional models across 140+ tables, trimming pipeline latency by 15%. I also optimized Snowflake warehouses to improve query performance by 20% while lowering compute resource usage.
I built a Python and YAML config-driven validation framework that generated 2,100+ SQL test cases and cut manual regression testing effort by 90%. I also implemented data quality checks and monitoring with dbt and Python.
I maintain 10+ production Airflow DAGs and automated version-controlled releases with GitHub Actions. In a personal project, I designed a streaming and batch pipeline using Kafka, PySpark, Airflow, and Snowflake.
