Looking for a job

SAMADRITA CHATTERJEE

@samadritachatterjee

Message

Data Engineer at Capgemini building PySpark pipelines for manufacturing data and automating schema validation.

India

Message

At Capgemini, I architect PySpark ETL pipelines that transform manufacturing data into Unity Catalog Delta Lake tables for Databricks SQL dashboards. I also deployed MES and MWS scrap-reduction mechanisms that increased overall manufacturing throughput by 15%.

I’ve engineered Kafka-to-Oracle data workflows and automated CI/CD pipelines with Spinnaker, Jenkins, and Apache Airflow. I also programmed custom GitHub Copilot skills using OpenCode for schema validation, reducing manual data-cleaning script preparation time by 70%.

Experience

Work history, roles, and key accomplishments

Current

Associate Consultant

Current

Capgemini

Dec 2023 - Present (2 years 10 months)

Architected scalable PySpark ETL pipelines for manufacturing data, deployed scrap-reduction mechanisms, and orchestrated CI/CD pipelines. Streamlined backend operations and ensured production reliability during legacy system migration.

PySpark Spark PostgreSQL Azure Databricks Delta Lake Unity Catalog Datadog Airflow GitHub Co Pilot

Software Trainee

L&T Construction

May 2023 - Jul 2023 (2 months)

Assisted the data engineering team in building PySpark pipelines on Databricks and contributed to automated regression analysis workflows. Optimized Spark SQL aggregate tables to accelerate Tableau dashboard performance.

Spark Scala Spark SQL PySpark Databricks Tableau