Farooq User
@farooquser
Principal Data Engineer | Lead Data Engineer | Senior Data Engineer
What I'm looking for
Senior Data Solution Architect and Principal Data Engineer with 10+ years of experience architecting and delivering enterprise-scale cloud-native data platforms, real-time analytics solutions, and AI-ready data ecosystems. Deep expertise in modern data architectures including Lakehouse, Delta Lake, Medallion Architecture, and event-driven streaming systems, leveraging Databricks, Snowflake, Apache spark, dbt, and Kafka across AWS, Azure, and GCP. Proven ability to design highly scalable data pipelines processing billions of records daily, optimize analytical workloads reducing query times by up to 70%, and enable production-grade machine learning platforms. Strong background in data governance, HIPAA and GDPR compliance, and leading cross-functional engineering teams to deliver high-impact solutions aligned with business strategy.
Experience
Work history, roles, and key accomplishments
Data Architect
Stanford Health Care
Apr 2021 - Present (5 years 1 month)
Architected and maintained enterprise-scale Lakehouse platforms supporting clinical, financial, and operational analytics for millions of healthcare records. Led scalable ETL/ELT and streaming pipelines with Databricks/Spark, Delta Lake, and Kafka, improving distributed processing performance and reducing execution time and operational overhead.
Principal Data Engineer
Stanford Health Care
Apr 2021 - Present (5 years 1 month)
Architected and led enterprise-scale data platforms using Databricks, Spark, Python, SQL, Snowflake, and Azure, optimizing pipelines that process millions of healthcare records and improving release velocity with CI/CD automation.
Principal Big Data Engineer
Stanford Health Care
Apr 2021 - Present (5 years 1 month)
Architected and maintained an enterprise Lakehouse platform supporting clinical, financial, and operational analytics; optimized distributed pipelines with Databricks and Spark to improve performance and reliability while enforcing HIPAA-compliant governance.
Data Engineering Lead
Mac Repair SF
Mar 2018 - Mar 2021 (3 years)
Designed a cloud-native Snowflake data warehouse integrating AWS and Azure, consolidating data from 25+ heterogeneous sources and building scalable ETL/ELT pipelines processing 10+ TB/day. Implemented real-time Kafka/Kinesis streaming, improved reporting performance 55%, reduced monthly cloud costs by $45K, and cut production incidents 70% through DataOps CI/CD and automated testing.
Staff Data Engineer
MacRepairSF
Mar 2018 - Mar 2021 (3 years)
Designed and maintained high-performance ETL/ELT pipelines integrating relational and NoSQL sources, APIs, and cloud storage in Azure, improving pipeline reliability, scalability, and analytics readiness.
Staff Data Engineer
Mac Repair SF
Mar 2018 - Mar 2021 (3 years)
Designed and developed enterprise ETL/ELT pipelines integrating APIs, relational databases, cloud storage platforms, and NoSQL systems. Built scalable cloud-based data warehouses using Azure, Snowflake, SQL Server, and Databricks, and implemented batch and real-time workflows with Spark, Python, SQL, and Airflow plus automated monitoring, logging, and data-quality validation.
Lead Data Engineer
Mac Repair SF
Mar 2018 - Mar 2021 (3 years)
Designed and built scalable ETL/ELT pipelines and cloud data warehouses in Azure to improve analytics performance and operational efficiency, while implementing monitoring and CI/CD to increase deployment reliability.
Senior Data Engineer
Wiztec
Nov 2016 - Feb 2018 (1 year 3 months)
Built and maintained enterprise-scale data pipelines with Python, SQL, Spark, and Databricks, improving data extraction, transformation, and delivery for analytics and production workloads.
ETL Engineer
Software KC
Jan 2015 - Oct 2016 (1 year 9 months)
Built and maintained ETL pipelines in Python and SQL to support enterprise reporting and analytics systems. Performed extraction, transformation, cleansing, validation, and reconciliation, monitored batch processing jobs, and created automated reporting workflows with supporting documentation.
Data Engineer
SoftwareKC
Jan 2014 - Oct 2016 (2 years 9 months)
Assisted in building and maintaining ETL pipelines using Python and SQL, performing data validation, cleansing, reconciliation, and operational monitoring to support enterprise analytics.
Data Engineer
Software KC
Jan 2014 - Oct 2016 (2 years 9 months)
Built and maintained ETL pipelines using Python and SQL to support enterprise reporting, performing extraction, transformation, validation, and batch job monitoring to ensure data accuracy and reliability.
ETL Developer
Software KC
Jan 2014 - Oct 2016 (2 years 9 months)
Built and maintained ETL pipelines using Python and SQL supporting enterprise reporting and analytics. Performed data extraction, transformation, cleansing, validation, and reconciliation; monitored batch processing jobs; and created automated reporting and data-integration workflows with supporting documentation and operational procedures.
Education
Degrees, certifications, and relevant coursework
Unknown Institution
Bachelor of Science, Computer Science
Bachelor of Science in Computer Science completed; focused on foundational computer science and software engineering principles.
Not specified
Bachelor of Science, Computer Science
Completed a Bachelor of Science in Computer Science.
Tech stack
Software and tools used professionally
Fivetran
Azure Synapse
Apache Spark
AWS Glue
Talend
Microsoft Azure
AWS Step Functions
GitHub
GitLab
Bitbucket
Kubernetes
Jenkins
CircleCI
GitHub Actions
GitLab CI
Salesforce
PySpark
dbt
MySQL
PostgreSQL
MongoDB
Cassandra
Gmail
Databricks
Redis
Terraform
Java
JSON
F#
XML
TensorFlow
PyTorch
MLflow
scikit-learn
Kafka
Datadog
GraphQL
Avro
Ansible
Airflow
Time Analytics
Root Cause
Amazon Web Services (AWS)
SQL
Delta Lake
Bash
Enhance
Unity Catalog
Factory
Seaborn
Availability
Location
Authorized to work in
Website
mohfarooq.techSocial media
Job categories
Skills
Interested in hiring Farooq?
You can contact Farooq and 90k+ other talented remote workers on Himalayas.
Message FarooqFind your dream job
Sign up now and join over 100,000 remote workers who receive personalized job alerts, curated job matches, and more for free!
