Shweta Soman

At Tredence, I build Medallion lakehouse architectures for major healthcare claims and payor datasets, moving fragmented data handling into governed Azure Databricks platforms. I own delivery from AWS S3 ingestion and Bronze-to-Silver transformations through Gold-layer reporting readiness.

I led the data-pipeline side of a Cloudera-to-Databricks migration for Point32 Health, building incremental and batch ingestion with Autoloader, Delta tables, and validation frameworks for completeness, accuracy, and reconciliation. For Banner Health, I built Delta Live Tables pipelines and automated quality monitoring that prevented anomalies from reaching downstream reporting; using LLM tools for code generation and validation scripting increased engineering throughput by around 40%.

My earlier data quality and validation work at Data Axle and HCL Technologies continues to shape how I build pipelines: with business-rule checks, root-cause analysis, and reliable production releases at every layer.