Looking for a job

Monishankar Baruah

@monishankarbaruah

Message

I build scalable batch and streaming data platforms for reliable analytics.

India

Message

What I'm looking for

I'm looking to build scalable, reliable data platforms and high-volume batch and streaming pipelines that turn business requirements into analytics-ready datasets.

At Infosys, I led Databricks Delta Lake pipelines ingesting approximately 10 TB per day, improving data accuracy to 99.9% through systematic deduplication and quality checks.

I built a Kafka and Spark Structured Streaming fraud-detection pipeline with 250 ms latency, migrated Hive workloads to Delta Lake, and reduced query times by 40%. I also helped extend Infosys Arena Data Governance with metadata-capture REST APIs and automated Java testing.

Previously at Zaloni, I delivered 50+ ETL pipelines into a 1.2 PB Hadoop lake, published curated data to Snowflake, and improved SLA adherence to 99%. I enjoy building dependable data platforms across Azure, Databricks, Spark, Kafka, and Hadoop.

Experience

Work history, roles, and key accomplishments

Senior Software Engineer, Data Engineering

Infosys

Sep 2023 - Nov 2024 (1 year 2 months)

Led Databricks Delta Lake pipelines ingesting ~10 TB/day, built a fraud detection pipeline on Kafka and Spark, and migrated legacy Hive jobs to Delta Lake. Co-developed a Python data validation utility and extended the Infosys Arena Data Governance product.

Databricks Delta Lake Kafka Spark Python Flask Java REST APIs Data Governance

Software Engineer, Professional Services

Zaloni

Feb 2022 - Aug 2023 (1 year 6 months)

Delivered 50+ Sqoop/Airflow ETL pipelines, tuned Spark and Hive settings, orchestrated a data centre migration, and administered a 30-node Hadoop cluster. Automated ingestion and transformation workflows with Airflow.