Open to opportunities

shubham bijalwan

@shubhambijlwan

Data Architect at JAS Worldwide building the Lakehouse foundation for Benji and optimizing CDC across 200+ Delta tables.

India

Message

At JAS Worldwide, I’m driving the Databricks Lakehouse foundation for Benji, the company’s internal AI product. I designed CDC-enabled ingestion and serving layers across 200+ Delta tables, with curated Gold models for logistics analytics and AI workloads.

I also built lineage and observability capabilities using Unity Catalog and Delta Live Tables, and reduced monthly Databricks DBU spend by 15% through job-cluster and compute-cost optimization.

Previously, at Omnicom Media Group (Annalect), I architected AWS and Snowflake data platforms for advertising and media data, including incremental ingestion and a warehouse migration that reduced query latency by 45%. Earlier, I worked on healthcare streaming pipelines at Health Ark Insights and cloud data engineering at Status Neo.

Experience

Work history, roles, and key accomplishments

Current

Senior Analytical Engineer

Current

JAS Worldwide

Jun 2025 - Present (1 year 3 months)

Designed and owned the enterprise Databricks Lakehouse architecture spanning 200+ Delta tables, architected CDC emulation framework, and led cost engineering initiatives reducing DBU spend by 15%.

Databricks Delta Live Tables Delta Lake Unity Catalog CDC Spark SQL Python Power BI GitLab Duo Databricks Genie Microsoft Copilot

Senior Consultant

Status Neo

Jan 2025 - May 2025 (4 months)

Designed and delivered cloud-native data engineering pipelines on AWS ECS, architected graph-to-relational model migration, and enforced TDD and code quality standards.

AWS AWS ECS Lambda S3 PySpark PostgreSQL RDS Test Driven Development Cloudwatch Splunk

Lead Reporting & Insights

Omnicom Media Group

Sep 2023 - Jan 2025 (1 year 4 months)

Architected end-to-end big data ETL platform on AWS processing 100-150TB daily, implemented watermark-based CDC, and led on-premise to Snowflake migration.

AWS Glue Redshift Snowflake Snowpipe Great Expectations GitHub Actions PySpark SQL

Analytics Consultant

Health Ark Insights

May 2022 - Sep 2023 (1 year 4 months)

Led team of 4 engineers designing petabyte-scale data pipelines on AWS EMR, implemented real-time streaming with Kafka and Spark Structured Streaming, and applied advanced Spark optimization techniques.

AWS EMR Spark Kafka Debezium Terraform PySpark SQL

Data Analyst

Xapotech Systems Pvt. Ltd.

Dec 2019 - May 2022 (2 years 5 months)

Monitored and managed end-to-end data pipelines across 200-node Hadoop cluster, led cloud migration to AWS, and built Sigma Computing dashboards and reports.

Hadoop HDFS Yarn MapReduce AWS S3 EMR Glue Lambda MongoDB HBase Kafka Spark Streaming Sigma Computing Snowflake Redshift SQL

MIS Analyst

Kiran Udyog Pvt. Ltd.

Apr 2017 - Dec 2019 (2 years 8 months)

Designed and maintained MIS dashboards and automated reporting systems using SQL Server and Excel, and performed data wrangling and predictive inventory forecasting.

SQL Server Excel SQL Data Wrangling Forecasting