Mohammed Shakheel Pasha
@mohammedshakheelpash
Senior data engineer specializing in cloud-native, scalable data platforms and real-time pipelines.
What I'm looking for
I am a Senior Data & Analytics Engineer with deep expertise building and modernizing cloud-native data platforms, data warehouses, and real-time streaming pipelines. I have owned production-grade BigQuery and Snowflake environments, led platform modernization efforts, and delivered multi-month data engineering initiatives from design through production with full ownership.
I design and optimize ETL/ELT architectures using tools such as dbt, Airflow, Spark, Kafka, and Databricks, and I mentor engineers while enforcing engineering standards, data governance, observability, and cost-performance optimizations to enable analytics, ML, and business decision-making.
Experience
Work history, roles, and key accomplishments
Senior Data & Analytics Engineer
HUB International
Aug 2023 - Present (2 years 5 months)
Designed and deployed scalable batch and real-time data pipelines and AI/ML systems, reducing pipeline failures and optimizing BigQuery and Databricks workloads for high-throughput healthcare analytics. Owned end-to-end data platform quality, governance, and cost optimizations across BigQuery, Snowflake, Databricks, and cloud native lakehouse architectures.
Senior Data Engineer
Vanguard
Nov 2021 - Jul 2023 (1 year 8 months)
Executed large-scale migrations to cloud data lakes and built ELT/ETL pipelines and enterprise data lake architectures, improving analytics readiness and Snowflake/Databricks performance for financial and healthcare datasets. Implemented data validation, governance, and CI/CD for reliable analytics delivery.
Architected and implemented scalable Azure and Databricks pipelines and Spark streaming solutions, modernizing ETL/ELT processes and enabling high-throughput Snowflake analytics for product and BI use cases. Improved data availability and reduced reporting latency through optimized transformations and orchestration.
Built an enterprise data lake on AWS and developed ETL and streaming pipelines with Glue, Spark, and Kafka to support financial reporting and real-time ML workflows, improving data quality and analytics delivery. Implemented automated data quality and orchestration frameworks for reliable production pipelines.
Education
Degrees, certifications, and relevant coursework
Osmania University
Bachelor of Science, Computer Science
Completed a Bachelor of Science in Computer Science focusing on foundational computing principles and software development practices.
Tech stack
Software and tools used professionally
Postman
Fivetran
Azure HDInsight
Azure Synapse
Apache Spark
AWS Glue
Talend
Superset
QlikView
ggplot2
Azure Storage
AWS Step Functions
GitHub
GitLab
SonarQube
Kubernetes
GitHub Actions
Jupyter
PySpark
Debezium
dbt
DB
Sqoop
MySQL
PostgreSQL
MongoDB
Cassandra
Hadoop
HBase
Gmail
Rollout
Django
Spring Boot
Yarn
Databricks
Terraform
Visual Studio
PyCharm
Azure DevOps
Java
JSON
Perl
PowerShell
Azure Machine Learning
TensorFlow
PyTorch
MLflow
Kafka
RabbitMQ
Apache Pulsar
Django REST framework
Grafana
Prometheus
Zookeeper
Ubuntu
CentOS
Linux
Red Hat Enterprise Linux
macOS
Windows
Datadog
Amazon Kinesis
NATS
Checkmarx
Avro
KSQL
Redpanda
Airflow
GuardRails
Google BigQuery
Luigi
SQL
Azure Blob Storage
Hugging Face
Dagster
Delta Lake
Trino
Cosmos
Bash
Make
Bridge
Durable
Factory
Availability
Location
Authorized to work in
Job categories
Skills
Interested in hiring Mohammed Shakheel?
You can contact Mohammed Shakheel and 90k+ other talented remote workers on Himalayas.
Message Mohammed ShakheelFind your dream job
Sign up now and join over 100,000 remote workers who receive personalized job alerts, curated job matches, and more for free!
