Open to opportunities

sathya User

@sathyauser2

Senior Python Data Engineer building scalable cloud data platforms, real-time streaming pipelines, and production-grade data quality.

United States

Message

What I'm looking for

I’m looking for a role where I can own end-to-end data architecture and build production-ready lakehouses, real-time pipelines, and strong data quality/observability—partnering with cross-functional teams to deliver reliable, auditable analytics with tight SLA adherence.

I’m an accomplished Senior Python Data Engineer with 5 years of experience designing scalable data platforms, automating ETL/ELT, and architecting cloud-native data lakes and warehouses across healthcare and fintech. I focus on end-to-end ownership—pipeline orchestration, dimensional modeling, schema governance, and reliable production analytics.

Recently, I architected and built a HIPAA-compliant Python-first lakehouse on AWS using S3 + Delta Lake (delta-rs), ingesting 5TB+ daily HL7/FHIR JSON with async workers, automatic schema evolution, and Pydantic v2 data contracts. I also built high-throughput Kafka-based real-time processing, delivering ACID-backed Delta outputs with sub-300ms end-to-end latency.

I’m hands-on with quality and observability: I’ve implemented Great Expectations and Pandera-backed validation across pipeline layers, integrated lineage with Open Lineage/Marquez, and used Open Telemetry structured logging to shorten incident MTTR. I’ve also migrated and optimized pipelines (dbt models on Snowflake, Airflow → Task Flow API, EMR → EMR Serverless), and I mentor engineers through strong Python standards and automated testing.

Experience

Work history, roles, and key accomplishments

Current

Senior Python Data Engineer

Current

NovaCare Health Analytics

Feb 2024 - Present (2 years 5 months)

Architected and built a HIPAA-compliant Python-first clinical data lakehouse on AWS (S3 + Delta Lake) with async ingestion, schema evolution, and Pydantic v2 data contract validation. Delivered real-time Kafka processing, production dbt transformations on Snowflake, Airflow DAG modernization, data quality automation, and a FastAPI internal data catalog with end-to-end observability.

Python SQL AWS S3 Delta Lake Delta PySpark Kafka AsyncIO AIOHTTP Pydantic DBT Airflow Snowflake Snowpark fastAPI SQLAlchemy Great Expectations Pandera OpenTelemetry Terraform Kinesis Lake Formation Asyncpg Pyarrow

Python Data Engineer

PayEdge Financial Technologies

Jun 2020 - Jul 2022 (2 years 1 month)

Built and owned a core Python-based transaction data platform on Azure Databricks using PySpark structured streaming and Delta Lake bronze/silver/gold layers. Developed real-time fraud scoring with Faust/Kafka Streams, orchestrated pipelines with Prefect 2, delivered FastAPI analytics services with PostgreSQL and Redis caching, and implemented automated data quality and CI/CD using testing and inf