Looking for a job

shatadru majumdar

@shatadrumajumdar

Message

Software Engineer 2 at Goldman Sachs with 2.5+YOE in highly Distributed and Scalable Systems.

India

Message

What I'm looking for

I am looking to build large scale distributed systems, developing the core Backend, creating APIs, picking the right choice of Databases and developing the systems end-to-end

Software Engineer 2 at Goldman Sachs with 2.5+YOE in highly scalable, distributed systems.
Key Technical Skills :
Java, Spring Boot, Hibernate, Python, Distributed Systems, Spark, Hadoop, Kafka, AWS S3, SQL, NoSQL, MongoDB, Docker.
Niche skills :
Concurrency, Multithreading
Technical Interests :
Problem Solving, Data Structures and Algorithms, Low Level Design, OOP, Design Patterns, High Level Design, Microservices.
Love to read Engineering Blogs.

Experience

Work history, roles, and key accomplishments

Current

Software Engineer 2

Current

Goldman Sachs

Jan 2024 - Present (1 year 4 months)

• Added custom hashing logic in ETL for restricted data columns with Python, Spark,
AWS Secrets Manager, Databricks updating 170 Million+ rows in Snowflake.
• Analyzed data flows and reduced data latency by 30% by doing experimental Spark application parameter tuning and changing partitioning and clustering logic.

Python SQL Java Hadoop Distributed Systems

Software Engineer 1

Goldman Sachs

Aug 2021 - Dec 2023 (2 years 4 months)

• Contributed 1000+ lines of code to building in-house data
streaming platform using Java, Spark, Mockito, JUnit, SQL
• Contributed 6000+ lines of code to create Big Data Extract-Transform-Load (ETL) pipelines processing 700 Million+ rows across 27 tables with Python,
PySpark, Pytest.
• Built data flows from Kafka to AWS S3 and Snowflake using Hadoop, HDFS, MapReduce, HBase, Spark, Hive, YARN