Aatif Ahsan
@aatifahsan
I build governed cloud data platforms and healthcare lakehouses that turn complex data into trusted analytics.
What I'm looking for
At Spark Advisors, I architect enterprise healthcare data platforms that unite 25+ EHR, claims, laboratory, pharmacy, and operational sources for clinical, operational, and analytical use cases.
I've delivered HIPAA-compliant ETL/ELT pipelines with Azure Data Factory, Databricks, Python, SQL, and Palantir Foundry, automating millions of healthcare records. My lakehouse architecture improved analytics scalability by 35%, while pipeline tuning delivered 25–30% faster execution and reduced healthcare data latency from hours to minutes.
Previously, I built 100+ automated ETL/ELT workflows at LangChain and high-volume Kafka pipelines that cut analytics latency by 50%. At SentiLink and ReversingLabs, I engineered distributed Spark pipelines, cloud data lakes, integrations, and production deployment practices for large-scale enterprise data.
I combine hands-on engineering with architectural ownership, building governed data products with lineage, quality controls, PHI/PII protection, and reliable access for reporting, analytics, and machine learning. I also mentor engineers and translate healthcare and business requirements into production-ready cloud data solutions.
Experience
Work history, roles, and key accomplishments
Lead Data Engineer
Spark Advisors
Nov 2022 - Present (3 years 10 months)
Architect enterprise healthcare data platforms integrating 25+ EHR, claims, laboratory, pharmacy, and operational sources into a unified ecosystem. Deliver HIPAA-compliant ETL/ELT pipelines with Azure Data Factory, Databricks, Python, SQL, and Palantir Foundry, and implement scalable lakehouse architecture for multi-terabyte workloads.
Education
Degrees, certifications, and relevant coursework
Bachelor of Science in Computer Science
Bachelor of Science, Computer Science
Bachelor of Science in Computer Science.
Tech stack
Software and tools used professionally
Amazon Redshift
Matillion
Azure Synapse
Apache Spark
AWS Glue
Apache Flink
Talend
GitHub
GitLab
Kubernetes
Jenkins
GitHub Actions
GitLab CI
PySpark
Debezium
dbt
MySQL
PostgreSQL
MongoDB
Cassandra
InfluxDB
HBase
Databricks
Neo4j
Terraform
Pulumi
Jira
Java
JSON
MLflow
Kafka
Apache NiFi
Elasticsearch
Avro
Ansible
Kafka Streams
Apache Storm
Airflow
Apache Beam
SQL
Mode Analytics
Apache Iceberg
LangChain
Foundry
Delta Lake
Great Expectations
ArgoCD
Apache Hudi
Bash
Microsoft Fabric
Palantir Foundry
Unity Catalog
Factory
Beam
SentiLink
Availability
Location
Authorized to work in
Job categories
Skills
Interested in hiring Aatif?
You can contact Aatif and 90k+ other talented remote workers on Himalayas.
Message AatifGet matched with your dream remote job
Sign up now and join over 250,000+ remote workers who receive personalized job alerts, curated job matches, and more for free!
