Harish Rajoori
@harishrajoori
Staff Data Engineer specializing in 10 Years Architecting Cloud-Native Pipelines, lakehouse platforms and data governance
What I'm looking for
I’m a Staff Data Engineer with 10 years of experience architecting scalable, cloud-native data platforms, specializing in the AWS ecosystem, Apache Iceberg, and Snowflake. I focus on building source-of-truth data lakes and high-throughput backend services using Spark Streaming, dbt, and EMR, with a strong emphasis on data governance and infrastructure optimization.
In my recent work, I architected a centralized data abstraction layer to eliminate fragmented application-specific data silos, and spearheaded an enterprise lakehouse migration into a unified storage layer powered by Apache Iceberg. I’ve also delivered measurable platform outcomes—leading migrations that reduced pipeline runtime from 24+ hours to 4 hours, scaling metrics from 9 to 50+, and ingesting 10M+ daily events for identity stitching and re-attribution—while improving attribution accuracy by 8% and reducing infrastructure costs by 20%. I bring a track record of performance in regulated sectors like Finance and Healthcare, and I aim to keep data platforms reliable, governable, and cost-efficient.
Experience
Work history, roles, and key accomplishments
Architected a centralized data abstraction layer to decouple applications from source systems and reduce fragmented data silos. Spearheaded enterprise lakehouse ingestion into Apache Iceberg and implemented storage optimization for multi-tenant query performance.
Led migration of a fragmented SQL experimentation system to a parallelized AWS EMR and Starburst ecosystem, reducing pipeline runtime. Implemented Apache Iceberg for ACID compliance and schema evolution, and modernized infrastructure and CI/CD for production deployments.
Senior Data Engineer
Intersoft DataLabs
Oct 2021 - Mar 2023 (1 year 5 months)
Designed a scalable lakehouse using AWS S3 and Redshift for high-performance serving. Built serverless ETL with Python, AWS Glue, and optimized PySpark jobs, and automated workflows with Airflow on Kubernetes to ensure data integrity and lineage.
Developed a proprietary framework using Java Spring Boot to orchestrate sensitive financial data workflows. Automated validation of financial records to support regulatory compliance and data privacy.
Data Engineer
SureIT Solutions
Oct 2019 - Aug 2021 (1 year 10 months)
Designed REST APIs and ingestion layers for a computer vision platform to support real-time UI/AI communication. Built services to handle batch image prediction requests across GPU servers for low-latency inference.
Migrated clinical trial data to AWS Redshift using serverless Python with AWS Lambda and AWS Glue pipelines. Refactored retail data pipelines using Apache Spark to reduce execution runtime.
Developed automated Oozie workflows and HiveQL scripts for credit risk reporting and financial data modeling. Delivered ETL in an Agile environment.
Education
Degrees, certifications, and relevant coursework
J.N.T. University
Bachelor of Technology, Electrical and Electronics Engineering
Bachelor of Technology in Electrical and Electronics Engineering from J.N.T. University, Hyderabad (2013).
Tech stack
Software and tools used professionally
Snowflake
Apache Spark
Apache Hive
Google Cloud Storage
Jupyter
MySQL WorkBench
dbt
Microsoft SQL Server
Django
Spring Boot
Google Analytics
Databricks
Terraform
Python
Java
Kafka
Apache NiFi
Django REST framework
Amazon RDS for PostgreSQL
Google Cloud SQL
Docker
Airflow
Google BigQuery
Amazon Web Services (AWS)
SQL
Google Cloud Dataproc
Apache Iceberg
Trino
Availability
Location
Authorized to work in
Salary expectations
Social media
Job categories
Interested in hiring Harish?
You can contact Harish and 90k+ other talented remote workers on Himalayas.
Message HarishGet matched with your dream remote job
Sign up now and join over 250,000+ remote workers who receive personalized job alerts, curated job matches, and more for free!
