# Abdul Sufy

Abdul Sufy is a remote worker on Himalayas, Lead Data Engineer at 1upHealth, based in United States.

Source: https://himalayas.app/@abdulsufy

```text
Lead Data Engineer at 1upHealth building a clinical and claims lakehouse that processes 6TB+ of daily data.
```

| Detail | Value |
| --- | --- |
| Availability | Looking for a job |
| Location | United States |
| Authorized to work in | United States |
| Salary expectations | 130k+ USD |
| Job categories | Data Engineer |
| Skills | Data Engineering, Lakehouse Architecture, Apache Spark, Databricks, Delta Lake, Kafka, PySpark, Python, SQL, Snowflake, DBT, Airflow, AWS, Azure, Google Cloud Platform |

## About

```text
At 1upHealth, I architected a clinical and claims lakehouse on AWS and Databricks Delta Lake that processes 6TB+ of daily data. I reduced source-to-curated latency from 8 hours to 2 and cut annual cloud compute spend by 32%.

I also eliminated streaming backpressure and sustained 99.99% pipeline uptime for FHIR/HL7 feeds. Previously, at Finix, I helped evolve a payment platform handling 25M+ daily events, and at Radius Intelligence I modernized financial reporting by migrating 40+ legacy ETL pipelines to Snowflake.
```

## Experience

### Lead Data Engineer (current)

[1upHealth](https://himalayas.app/companies/1uphealth). Nov 2024 - Present

```text
Architected a Bronze/Silver/Gold medallion lakehouse processing 6TB+ of daily clinical and claims data, reducing source-to-curated latency from 8 hours to 2 hours. Reduced annual cloud compute overhead by 32% and sustained 99.99% pipeline uptime.
```

Skills: AWS, Azure, Databricks, Delta-Lake, PySpark, Kafka, Snowflake, FHIR, HL7, X12, DBT, Airflow, Great-Expectations, Unity-Catalog, Terraform, CI-CD, HIPAA, HITRUST

### Senior Data Engineer

[Finix](https://himalayas.app/companies/finix-payments). Aug 2021 - Oct 2024

```text
Led evolution of a fault-tolerant transaction processing platform handling 25M+ daily events, strengthening idempotent Kafka producers and resilient PySpark streaming consumers. Improved settlement architecture to process peak loads of 8,000+ TPS and accelerated reconciliation from T+2 days to under 5 minutes.
```

Skills: Kafka, PySpark, Snowflake, Snowpipe, DBT, PostgreSQL, AWS, Airflow, PCI-DSS, SOC2, Schema-Registry, Dead-Letter-Queues, Transactional-Outboxes

### Data & ETL Engineer

[Radius Intelligence](https://himalayas.app/companies/radius-limited). Nov 2016 - Jul 2021

```text
Modernized financial reporting by migrating 40+ legacy ETL pipelines to Snowflake, reducing analytical query runtimes by 45%. Standardized 60+ Apache Airflow DAGs and enabled self-service reporting for 100+ analysts.
```

Skills: Snowflake, Python, SQL, Airflow, PostgreSQL, AWS, DBT, Dimensional-Modeling, CI-CD

## Education

### University of Rochester

Bachelor of Science, Computer Science

```text
Bachelor of Science in Computer Science.
```

## Tech stack

- Snowflake
- Airbyte
- Apache Spark
- AWS Glue
- Talend
- Alation
- Looker
- Metabase
- Google Cloud Platform
- Bedrock
- Kubernetes
- Helm
- GitHub Actions
- PySpark
- Debezium
- dbt
- MySQL
- PostgreSQL
- MongoDB
- Oracle
- Hadoop
- Databricks
- Redis
- Terraform
- Azure DevOps
- Jira
- React
- Flux
- JavaScript
- Python
- Java
- Ruby
- Kotlin
- Go
- PowerShell
- Scala
- Kafka
- RabbitMQ
- Grafana
- Prometheus
- OpenTelemetry
- Stripe
- Gemini
- Elasticsearch
- TypeScript
- Keycloak
- Git
- Docker
- Airflow
- Atlantis
- SQL
- Dagster
- DuckDB
- Polars
- Hex
- Delta Lake
- StarRocks
- Great Expectations
- Trino
- GitHub Copilot
- PgBouncer
- Argo CD
- Bash
- Benthos
- Microsoft Fabric
- Unity Catalog
- Claude Code
- Strimzi
- CloudNativePG
- Square
- AWS
- Claude
- Azure
- Angular

To contact Abdul, message them from this profile with a Himalayas employer account: [Hire on Himalayas](https://himalayas.app/hire).

## People also viewed

- [Hass Yunas](https://himalayas.app/@hassyunas): Staff Data Engineer, Healthix
- [Stuti Paudel](https://himalayas.app/@stutipaudel1): Senior Data Engineer, UnitedHealth Group
- [Digdarshan Subedi](https://himalayas.app/@digdarshansubedi): Data Engineer
- [wajid shazalvi](https://himalayas.app/@wajidshazalvi): Senior Data Engineer, Optum
- [Esa Khatiwada](https://himalayas.app/@esakhatiwada): Senior Data Engineer, Cardinal Health
- [Puneeth Ravilla](https://himalayas.app/@puneethravilla): Senior Data Engineer, CVS Health
- [sreya p](https://himalayas.app/@sreyap): Senior Data Engineer, Tenet Healthcare
- [Eric Cao](https://himalayas.app/@ericcao): Senior Data Engineer, Databricks
- [Sandeep Suresh](https://himalayas.app/@sandeepsuresh): Software Engineer, Data, Intuit
- [Vajih Ahmer](https://himalayas.app/@vajihahmer): Senior Data Engineer, Quantifi
