Atif Akbar User
@atifakbaruser
Lead Data Engineer with 11+ years building secure lakehouse and streaming data platforms that drive trusted analytics.
What I'm looking for
I’m a Lead Data Engineer with 11+ years of experience designing, building, and modernizing enterprise data platforms across healthcare, FinTech, and SaaS. I lead end to end data engineering initiatives—cloud migrations, lakehouse/warehouse solutions, real time processing, and governance frameworks—to deliver scalable, reliable, analytics-ready datasets.
In my most recent role, I led cloud-native healthcare platforms using Azure, Databricks, Snowflake, and Delta Lake, improving enterprise reporting performance by 60% and reducing manual data processing by 65%. I built real-time and batch ingestion pipelines with Kafka, Spark Structured Streaming, REST APIs, and CDC, and I developed dimensional models and Data Vault architecture to improve data consistency and accelerate self-service reporting.
I’m also focused on engineering excellence and compliance-ready data. I implement automated quality validation and metadata management with Microsoft Purview, Unity Catalog, and Great Expectations (including HIPAA compliance), while driving CI/CD and infrastructure automation with Git, Azure DevOps, Docker, Kubernetes, and Terraform—improving deployment reliability by 45%. I mentor teams, run architecture reviews and code reviews, and partner with cross-functional stakeholders to raise platform quality and team productivity.
Experience
Work history, roles, and key accomplishments
Lead Data Engineer
Techverx
Sep 2022 - Present (3 years 10 months)
Led design of cloud-native healthcare data platforms on Azure, Databricks, Snowflake, and Delta Lake, improving enterprise reporting performance by 60%. Built ETL/ELT and real-time/batch ingestion pipelines using Python, PySpark, Airflow, dbt, Kafka, Spark Structured Streaming, and CDC, and implemented governance with Microsoft Purview/Unity Catalog and automated quality validation.
Data Platform Engineer
Geomotiv
Feb 2018 - Aug 2022 (4 years 6 months)
Engineered a cloud-native data platform using Databricks, Snowflake, and AWS, improving reporting performance by 55% across enterprise financial systems. Developed ETL/ELT and real-time streaming pipelines with Python, PySpark, Airflow, dbt, Kafka, Spark Structured Streaming, and Debezium, and implemented governance with Microsoft Purview/Unity Catalog and Great Expectations.
Data Engineer
Modo Labs
Feb 2014 - Jan 2018 (3 years 11 months)
Developed scalable ETL/ELT pipelines for a SaaS environment using Python, SQL, PySpark, Apache Airflow, and dbt, integrating application telemetry, customer events, and API data for business reporting. Built batch and real-time ingestion pipelines with Kafka, Spark Structured Streaming, REST APIs, and CDC, and improved reliability using automated validation, CI/CD, monitoring, and metadata managem
Education
Degrees, certifications, and relevant coursework
Atif Akbar hasn't added their education
Don't worry, there are 90k+ talented remote workers on Himalayas
Tech stack
Software and tools used professionally
Azure Synapse
Apache Spark
GitHub
GitLab
Kubernetes
Jenkins
GitHub Actions
NumPy
Pandas
PySpark
Debezium
dbt
DB
MySQL
PostgreSQL
MongoDB
Hadoop
Gmail
Databricks
Redis
Terraform
Azure DevOps
Java
PowerShell
Kafka
Amazon Kinesis
Avro
Airflow
Apache Beam
Root Cause
SQL
Modo
Apache Iceberg
Delta Lake
Great Expectations
Apache Hudi
Cosmos
Bash
Microsoft Fabric
Unity Catalog
Factory
Beam
Microsoft Purview
Availability
Location
Authorized to work in
Job categories
Skills
Interested in hiring Atif Akbar?
You can contact Atif Akbar and 90k+ other talented remote workers on Himalayas.
Message Atif AkbarGet matched with your dream remote job
Sign up now and join over 250,000+ remote workers who receive personalized job alerts, curated job matches, and more for free!
