# Monishankar Baruah

Monishankar Baruah is a remote worker on Himalayas, Senior Software Engineer, Data Engineering at Infosys, based in India.

Source: https://himalayas.app/@monishankarbaruah

```text
I build scalable batch and streaming data platforms for reliable analytics.
```

| Detail | Value |
| --- | --- |
| Availability | Looking for a job |
| Location | India |
| Authorized to work in | India |
| Salary expectations | 1333k+ INR |
| Job categories | Data Engineer, Data Architect, Software Engineer |
| Skills | Data Engineering, Data Architecture, Hadoop, HDFS, Yarn, Hive, HBase, Azure Databricks, Delta Lake, PySpark, Kafka, Airflow, Azure Data Factory, ADLS Gen2, Unity Catalog, Snowflake, AWS, Amazon EMR, S3, EC2, Amazon MSK (Kafka), Docker, GitHub, Python, SQL, Java, Flask, Spark Structured Streaming, Sqoop, Kerberos, REST APIs, XGBoost, Prophet, Deep Learning, Time series Forecasting |
| LinkedIn | https://linkedin.com/in/monisankar-baruah |

## What I'm looking for

```text
I'm looking to build scalable, reliable data platforms and high-volume batch and streaming pipelines that turn business requirements into analytics-ready datasets.
```

## About

```text
At Infosys, I led Databricks Delta Lake pipelines ingesting approximately 10 TB per day, improving data accuracy to 99.9% through systematic deduplication and quality checks.

I built a Kafka and Spark Structured Streaming fraud-detection pipeline with 250 ms latency, migrated Hive workloads to Delta Lake, and reduced query times by 40%. I also helped extend Infosys Arena Data Governance with metadata-capture REST APIs and automated Java testing.

Previously at Zaloni, I delivered 50+ ETL pipelines into a 1.2 PB Hadoop lake, published curated data to Snowflake, and improved SLA adherence to 99%. I enjoy building dependable data platforms across Azure, Databricks, Spark, Kafka, and Hadoop.
```

## Experience

### Senior Software Engineer, Data Engineering

[Infosys](https://himalayas.app/companies/infosys-limited). Sep 2023 - Nov 2024

```text
Led Databricks Delta Lake pipelines ingesting ~10 TB/day, built a fraud detection pipeline on Kafka and Spark, and migrated legacy Hive jobs to Delta Lake. Co-developed a Python data validation utility and extended the Infosys Arena Data Governance product.
```

Skills: Databricks, Delta-Lake, Kafka, Spark, Python, Flask, Java, REST-APIs, Data-Governance

### Software Engineer, Professional Services

Zaloni. Feb 2022 - Aug 2023

```text
Delivered 50+ Sqoop/Airflow ETL pipelines, tuned Spark and Hive settings, orchestrated a data centre migration, and administered a 30-node Hadoop cluster. Automated ingestion and transformation workflows with Airflow.
```

Skills: Sqoop, Airflow, Hadoop, HDFS, Yarn, Hive, Spark, Snowflake, Kerberos, Automation

## Education

### SRM Institute of Science & Technology

B.Tech, Computer Science Engineering

```text
Completed a Bachelor of Technology in Computer Science Engineering in 2020.
```

## Tech stack

- Snowflake
- Amazon EC2
- Amazon S3
- GitHub
- PySpark
- Sqoop
- Hadoop
- HBase
- Yarn
- Python
- Java
- Kafka
- Flask
- Docker
- Airflow
- Amazon EMR
- SQL
- XGBoost
- Delta Lake
- Unity Catalog
- Apache Kafka

To contact Monishankar, message them from this profile with a Himalayas employer account: [Hire on Himalayas](https://himalayas.app/hire).

## People also viewed

- [Saptarshi Acharyya 18](https://himalayas.app/@saptarshiacharyya18): Data Engineer, Infosys Ltd.
- [Kalash Jindal](https://himalayas.app/@kalashjindal): Senior Data Engineer, NASDAQ
- [Fayaz shaik](https://himalayas.app/@fayazshaik): Data Engineer, Infosys
- [Madhan Lingareddy](https://himalayas.app/@madhanreddy575): Senior Data Engineer, Procore Technologies
- [naik ashok](https://himalayas.app/@naikashok): Software Engineer – Data Engineering, IBM India Pvt. Ltd.
- [Pravin Singh](https://himalayas.app/@pbxr): Senior Data Engineer, Apexon
- [Mitesh Shah](https://himalayas.app/@miteshshah): Senior Analyst (Senior Data Engineer), Accenture Technology Services
- [Shraddha Shetty](https://himalayas.app/@shraddhashetty2): Data Engineer, Infosys Limited
- [Sai Nagendra Pavan Kumar Pilli](https://himalayas.app/@sainagendrapavankuma): Sr Software Engineer, Ascendion
- [Ankit Pandey](https://himalayas.app/@ankitpandey15): Senior Associate Consultant Data Engineer, Infosys Limited
