# sathya User

sathya User is a remote worker on Himalayas, Senior Python Data Engineer at NovaCare Health Analytics, based in United States.

Source: https://himalayas.app/@sathyauser2

```text
Senior Python Data Engineer building scalable cloud data platforms, real-time streaming pipelines, and production-grade data quality.
```

| Detail | Value |
| --- | --- |
| Availability | Open to opportunities |
| Location | United States |
| Authorized to work in | United States |
| Job categories | Senior Python Engineer, Data Engineer, Data Platform Engineer, Data Pipeline Engineer, Data Warehouse Engineer, Streaming Data Engineer, Data Quality Engineer, Python Data Engineer, Senior Data Engineering |
| Skills | Python, Python 3, Type Hints, Mypy, AsyncIO, AIOHTTP, Pydantic, Dataclasses, Python Multiprocessing, PySpark, Spark Structured Streaming, Pandas, Polars, NumPy, Dask, Ray, Pyarrow, DBT, Dbt Macros, Apache Beam, Alembic, Airflow, DAGs, Prefect, Dagster, Celery, Flask, REST APIs, GraphQL, WebSockets, gRPC, S3, AWS Lambda, AWS Glue, Amazon EMR, AWS Kinesis, AWS MWAA, Amazon Redshift, Amazon Athena, Lake Formation, AWS Step Functions, Azure ADLS Gen2, Azure Databricks, Azure Functions, Azure Synapse, BigQuery, Confluent Cloud, Faust, RabbitMQ, Redis, Snowflake, Delta Lake, Apache Iceberg, Apache Hudi, Databricks Unity Catalog, Parquet, ORC, Avro, MySQL 8 Internals, MongoDB, Elasticsearch, DynamoDB, Cassandra, Great Expectations, Pytest, Hypothesis Development, Pandera, Lineage, Marquez, Grafana, Prometheus, Cloudwatch, Datadog, ELK Stack, Docker, Helm, Terraform, GitHub Actions, Jenkins, Ruff, Telemetry, Apache Hive, Kubernetes, Salesforce, Jupyter, MySQL, Databricks, Pulumi, JSON, scikit learn, MLFlow, PagerDuty, Serverless, GitHub, S3 Lambda, SQL, XGBoost, LightGBM, PostgreSQL, Kafka, Kafka Streams, Pre Commit, Meltano, Feast, SoDA, Beam, Vaex, Unity Catalog, UV развертка, Matrix, Pika |

## What I'm looking for

```text
I’m looking for a role where I can own end-to-end data architecture and build production-ready lakehouses, real-time pipelines, and strong data quality/observability—partnering with cross-functional teams to deliver reliable, auditable analytics with tight SLA adherence.
```

## About

```text
I’m an accomplished Senior Python Data Engineer with 5 years of experience designing scalable data platforms, automating ETL/ELT, and architecting cloud-native data lakes and warehouses across healthcare and fintech. I focus on end-to-end ownership—pipeline orchestration, dimensional modeling, schema governance, and reliable production analytics.

Recently, I architected and built a HIPAA-compliant Python-first lakehouse on AWS using S3 + Delta Lake (delta-rs), ingesting 5TB+ daily HL7/FHIR JSON with async workers, automatic schema evolution, and Pydantic v2 data contracts. I also built high-throughput Kafka-based real-time processing, delivering ACID-backed Delta outputs with sub-300ms end-to-end latency.

I’m hands-on with quality and observability: I’ve implemented Great Expectations and Pandera-backed validation across pipeline layers, integrated lineage with Open Lineage/Marquez, and used Open Telemetry structured logging to shorten incident MTTR. I’ve also migrated and optimized pipelines (dbt models on Snowflake, Airflow → Task Flow API, EMR → EMR Serverless), and I mentor engineers through strong Python standards and automated testing.
```

## Experience

### Senior Python Data Engineer (current)

NovaCare Health Analytics. Feb 2024 - Present

```text
Architected and built a HIPAA-compliant Python-first clinical data lakehouse on AWS (S3 + Delta Lake) with async ingestion, schema evolution, and Pydantic v2 data contract validation. Delivered real-time Kafka processing, production dbt transformations on Snowflake, Airflow DAG modernization, data quality automation, and a FastAPI internal data catalog with end-to-end observability.
```

Skills: Python, SQL, AWS, S3, Delta-Lake, Delta, PySpark, Kafka, AsyncIO, AIOHTTP, Pydantic, DBT, Airflow, Snowflake-Snowpark, fastAPI, SQLAlchemy, Great-Expectations, Pandera, OpenTelemetry, Terraform, Kinesis, Lake-Formation, Asyncpg, Pyarrow

### Python Data Engineer

PayEdge Financial Technologies. Jun 2020 - Jul 2022

```text
Built and owned a core Python-based transaction data platform on Azure Databricks using PySpark structured streaming and Delta Lake bronze/silver/gold layers. Developed real-time fraud scoring with Faust/Kafka Streams, orchestrated pipelines with Prefect 2, delivered FastAPI analytics services with PostgreSQL and Redis caching, and implemented automated data quality and CI/CD using testing and inf
```

Skills: Python, PySpark, Azure-Databricks, Delta-Lake, Kafka, Faust, Kafka-Streams, Prefect, fastAPI, SQLAlchemy, PostgreSQL, Asyncpg, Redis, Great-Expectations, Openpyxl, Pandas, Polars, Terraform, GitHub-Actions, Pytest, Mypy, Ruff, DBT

## Education

### New Jersey Institute of Technology

Master of Science, Computer Science

```text
Earned a Master of Science in Computer Science from New Jersey Institute of Technology, completed in 2024.
```

### B. S. Abdur Rahman University

Bachelor of Technology, Computer Science & Engineering

```text
Earned a Bachelor of Technology (B.Tech) in Computer Science & Engineering from B. S. Abdur Rahman University, completed in 2021.
```

## Tech stack

- Amazon Redshift
- Azure Synapse
- Apache Hive
- GitHub
- Kubernetes
- Jenkins
- GitHub Actions
- Salesforce
- Jupyter
- NumPy
- Pandas
- PySpark
- Dask
- dbt
- MySQL
- PostgreSQL
- MongoDB
- Cassandra
- Databricks
- pre-commit
- Redis
- Terraform
- Pulumi
- JSON
- MLflow
- scikit-learn
- Kafka
- RabbitMQ
- AIOHTTP
- asyncio
- PagerDuty
- Grafana
- Prometheus
- Datadog
- GraphQL
- gRPC
- Elasticsearch
- Avro
- Serverless
- Azure Functions
- Kafka Streams
- pytest
- Airflow
- Apache Beam
- s3-lambda
- SQL
- XGBoost
- LightGBM
- Dagster
- Apache Iceberg
- Meltano
- Polars
- Pydantic
- Feast
- Ray
- Soda
- Delta Lake
- Great Expectations
- Apache Hudi
- Marquez
- Ruff
- Vaex
- uv
- Unity Catalog
- Beam
- Matrix
- Pika
- X++

To contact sathya, message them from this profile with a Himalayas employer account: [Hire on Himalayas](https://himalayas.app/hire).

## People also viewed

- [Saujan Baniya](https://himalayas.app/@saujanbaniya): Senior Data Engineer, Pfizer
- [ANISH BARAL](https://himalayas.app/@anishbaral1): Senior Data Engineer, Cardinal Health
- [Hasi Iqbal](https://himalayas.app/@hasiiqbal1): Senior Data Engineer, NimerTech
- [Ashutosh Khanal](https://himalayas.app/@ashutoshkhanal): Senior Data Engineer, Elevance Health
- [Bishal Bhattarai](https://himalayas.app/@bishalbhattarai1): Senior Data Engineer, Elevance Health
- [Azran Mehrosh](https://himalayas.app/@azranmehrosh): Senior Data Engineer, Oznolo
- [Kushal User](https://himalayas.app/@kushaluser3): Senior Data Engineer, HCA HealthCare
- [Zulfiqar Ali Zaidi](https://himalayas.app/@zulfiqaralizaidi): Data & Solution Architect, ApTask
- [Atif Akbar User](https://himalayas.app/@atifakbaruser): Lead Data Engineer, Techverx
- [Dhruv Patel](https://himalayas.app/@dhruvpatel17): Senior Data and Platform Engineer, Nutanix
