# Dipankar Kalita

Dipankar Kalita is a remote worker on Himalayas, Data Engineer at Smartbeings Software Innovation, based in India.

Source: https://himalayas.app/@dipankarkalita

```text
Data Engineer | Expert in Big Data, AWS, Spark, Kafka, Airflow |Building Scalable Data Pipelines
```

| Detail | Value |
| --- | --- |
| Availability | Looking for a job |
| Location | India |
| Authorized to work in | India |
| Job categories | Big Data Architect, Software Engineer, Data Architect, Data Engineer, Data Platform Engineer, ETL Developer, Big Data Engineer, Data Pipeline Engineer, Data Engineering, Cloud Data Engineer, DataOps Engineer, Data Engineering Manager, Lead Data Engineer |
| Skills | Python, SQL, PySpark, Kafka, AWS, Glue, MongoDB, Data Warehouse, Hadoop, S3 Lambda, Apache Spark, Apache NiFi, Redshift, EMR, Athena, Linux, GitHub, Jira, Git, Hive, AWS Glue, Amazon EMR, Cloudwatch, Parquet, HDFS, FTP, Relational Databases, IAM, Airflow, Amazon Redshift, S3 |
| LinkedIn | https://https://www.linkedin.com/in/dpunkaar/ |

## What I'm looking for

```text
I’m seeking a challenging role in data engineering that allows me to work with large-scale systems, contribute to building efficient data pipelines, and continue developing my skills in cloud technologies while driving business impact.
```

## About

```text
I am a Data Engineer with 4 years of experience in designing and implementing scalable, end-to-end data pipelines for both real-time and batch processing systems. My core expertise lies in Python, SQL, PySpark, Apache Spark, and Kafka, with hands-on experience in cloud platforms like AWS (Glue, EMR, Redshift, S3).

I’ve led data engineering efforts on e-commerce and banking projects, leveraging tools like Apache Airflow, Apache NiFi, and AWS services to build robust ETL frameworks. I focus on improving data quality, optimizing performance, and ensuring secure data workflows.

I am passionate about working with cutting-edge big data technologies, contributing to open-source projects, and continuously learning.

Let’s connect if you're looking for a reliable and enthusiastic data engineer who thrives in dynamic, fast-paced environments.
```

## Experience

### Data Engineer (current)

Smartbeings Software Innovation. Oct 2022 - Present

```text
Delivered a fully automated and reliable data platform by designing end-to-end ETL pipelines with Apache Airflow, AWS Glue, and PySpark on EMR. Ingested large-scale data from RDBMS and FTP into S3 and Redshift, improved quality with cleaning, validation, and fraud detection, and optimized performance using CloudWatch and EMR, reducing costs while ensuring security and compliance.
```

Skills: Python, SQL, Apache-Spark, Hive, MongoDB, GitHub, Jira, Linux, Cloudwatch, Athena, EMR, Redshift, Airflow, Hadoop

### Trainee Engineer

Smartbeings Software Innovation. Apr 2022 - Oct 2022

```text
As a trainee engineer, contributed to building a high-throughput system for real-time financial data by developing scalable pipelines with Kafka and Spark on HDFS. Assisted in PySpark jobs for data cleaning and enrichment, optimized storage in Parquet/DBs, and supported secure, low-latency data workflows using SFTP.
```

Skills: Python, SQL, Communication-Skills, AWS, Hadoop, Hive, Spark, Kafka, GitHub, Linux, MongoDB

## Education

### Gauhati University

Bachelor of Commerce, Management. 2015 - 2018

```text
Completed a Bachelor of Commerce (Management) program focusing on management and commerce fundamentals from 2015 to 2018.
```

## Tech stack

- Amazon Redshift
- Apache Spark
- AWS Glue
- Apache Hive
- Amazon CloudWatch
- Amazon S3
- GitHub
- PySpark
- AWS Data Pipeline
- DB
- MySQL
- MongoDB
- Hadoop
- Gmail
- Jira
- Python
- Kafka
- Apache NiFi
- Linux
- Git
- Airflow
- Amazon Web Services (AWS)
- Amazon Athena
- SQL
- Dynamic

To contact Dipankar, message them from this profile with a Himalayas employer account: [Hire on Himalayas](https://himalayas.app/hire).

## People also viewed

- [Vipul Lalwani](https://himalayas.app/@lalwanivipul): Senior Data Engineer, DataGrokr Analytics Pvt. Ltd.
- [Abhishek M](https://himalayas.app/@abhishekm): Associate Data Engineer, Cognizant Technology Solutions Pvt. Ltd.
- [PRANAV ACHARYA](https://himalayas.app/@pranavacharya): Cloud Data Engineer, Deloitte Touche Tohmatsu India LLP
- [BHUMIKA SHARMA](https://himalayas.app/@bhumikasharma): Data Engineer, Quantiphi
- [Vinutha Vishwanatha Devadiga](https://himalayas.app/@vinuthavishwanathade): Senior Data Engineer, FIS
- [Afjal Ahamad](https://himalayas.app/@afjalahamad): AWS Data Engineer, Systems Plus Technologies
- [Riyas P K](https://himalayas.app/@riyaspk): Senior Data Engineer, Continental Automotive
- [Himanshu Saroj](https://himalayas.app/@himanshusaroj): Sales Data Analytics Engineer, Russell Investments
- [Kalash Jindal](https://himalayas.app/@kalashjindal): Senior Data Engineer, NASDAQ
- [Ritika Lahariya](https://himalayas.app/@ritikalahariya): Data Engineer, Globant
