Rahul Anand
@rahulanand_bigdata
Data Platform Architect & Principal Data Engineer | BigQuery · dbt · Airflow · Kafka | GCP & AWS | BigData | Medallion · Lakehouse · Streaming Arct
What I'm looking for
Principal Data Engineer with 11+ years of experience architecting cloud data platforms, data Lakehouse ecosystems, streaming pipelines, and executive analytics products across Google Cloud Platform, Amazon Web Services, BigQuery, dbt, Apache Kafka, Apache Spark, and Looker. Trusted by enterprise clients including Broadcom, Cornerstone OnDemand, EdCast, Beekin, UKW, TortExperts, Host Hotels, and Regions Bank to turn fragmented data estates into reliable, AI-ready platforms with measurable speed, cost, compliance, and business impact.
• Cloud data architecture: Designs production-grade GCP/AWS data ecosystems from ingestion through curated medallion layers, analytics marts, BI semantic models, and ML-ready feature layers.
• Performance engineering: Re-architects expensive BigQuery and Looker workloads through partitioning, clustering, materialized dbt models, query-plan reduction, and shift-left transformation design.
• Real-Time Streaming & CDC: Builds event-driven architectures using Confluent Kafka, CDC connectors, Cloud Functions, and BigQuery streaming — delivering sub-3-minute reporting refresh cycles for platforms processing millions of events daily.
• Performance Optimization & FinOps: Specialized in BigQuery performance engineering — partitioning, clustering, materialization, and Shift-Left pre-computation strategies that have cut query times from 150+ seconds to under 5 seconds, reduced bytes scanned by 90%, and slashed cloud compute costs by 60%+.
• Enterprise delivery: Leads concurrent client engagements across technology, EdTech, LegalTech, real estate, hospitality, and financial services with strong ownership of reliability, governance, and stakeholder outcomes.
• Data Modernization & Migration: Leads full-stack cloud migrations, from legacy SSIS/Oracle/SQL to modern Data Lakehouse architectures on GCP and AWS, with automated schema evolution, idempotent pipelines, and zero-downtime cutover.
Experience
Work history, roles, and key accomplishments
Principal Data Engineer
SquareShift Technologies Pvt. Ltd
Nov 2021 - Present (4 years 10 months)
Serve as lead Data Platform Architect across enterprise client programs, owning ingestion, transformation, semantic
Education
Degrees, certifications, and relevant coursework
Indian Institute of Management Indore
Executive Programme, Business Analytics
Grade: CGPA 4/4.33 (96.7%)
Executive Programme in Business Analytics with a CGPA of 4/4.33 (96.7%).
Manipal University Jaipur
Master of Technology, Computer Science and Engineering
Grade: GPA 7.4/10
M.Tech in Computer Science and Engineering with a GPA of 7.4/10.
Rajasthan Technical University
Bachelor of Technology, Electronics and Communication Engineering
Grade: 71%
B.Tech in Electronics and Communication Engineering with 71% marks.
Tech stack
Software and tools used professionally
Amazon Redshift
Snowflake
Cloudera Enterprise
Azure HDInsight
Apache Spark
Apache Hive
Amazon Redshift Spectrum
Looker
Dataform
DOMO
Google Cloud Platform
Amazon S3
Google Cloud Storage
Bitbucket
PySpark
AWS Data Pipeline
Google BigQuery Data Transf...
dbt
Sqoop
PostgreSQL
Hadoop
Google Cloud Spanner
Google Analytics
Databricks
Python
Kafka
Cloud Firestore
jFrog
Azure Database for PostgreSQL
Google Cloud Dataflow
Fanout
Elasticsearch
Cloud Functions for Firebase
Azure SQL Database
Firebase Authentication
Docker
Airflow
Google BigQuery
Amazon Athena
SQL
Google Cloud Run
Google Cloud Dataproc
EdCast
Instructor
Availability
Location
Authorized to work in
Salary expectations
Social media
Job categories
Skills
Interested in hiring Rahul?
You can contact Rahul and 90k+ other talented remote workers on Himalayas.
Message RahulGet matched with your dream remote job
Sign up now and join over 250,000+ remote workers who receive personalized job alerts, curated job matches, and more for free!
