At Jefferson Bank, I assist in building data pipelines that improve data quality and support changing user requirements. I’ve integrated Hugging Face Transformers and OpenAI APIs for demand forecasting and supply chain risk analysis, and built GenAI applications with LangChain and Azure Data Lake.
I’ve designed end-to-end ETL pipelines with Azure Data Factory, SSIS, and HDInsight, and used Azure Databricks and PySpark to transform and curate data. I also built real-time streaming pipelines with Kafka and Spark Structured Streaming.
At Magellan Health, I implemented Delta Lake strategies for evolving healthcare datasets and designed secure Azure Data Lake Storage Gen2 architecture. Earlier, at Caterpillar Financials, I developed AWS data pipelines and supported the migration of a data warehouse to Snowflake.
