Looking for a job

Siddhant User

@siddhantuser2

Senior Software Engineer (Data Engineering) at Capri Global Capital Limited, contributing to data systems centralizing 550+ database tables.

India

Message

What I'm looking for

I'm looking for opportunities to implement innovative solutions to complex problems.

At Capri Global Capital Limited, I contribute to the development and maintenance of a centralized data replication system that brings data from 550+ database tables into an AWS S3 data lake. I also migrated gold loan data pipelines to Apache Airflow, reducing process time by around 60%.

I’ve engineered and maintained batch, microbatch, and real-time ETL pipelines, and implemented change data capture from MongoDB and MySQL using Kafka Connect and Debezium. I was part of the core team for a published patent on optimizing turnaround time in banking functions.

Experience

Work history, roles, and key accomplishments

Current

Senior Software Engineer (Data Engineering)

Current

Capri Global Capital Limited

Jul 2026 - Present (3 months)

Contributed to development and maintenance of a highly distributed centralized Data Replication System using Medallion Architecture, collecting data from all sources to a centralized data lake in AWS S3. Migrated data pipelines to Apache Airflow, reducing process time by around 60%.

Python PySpark AWS Lambda AWS Glue AWS EventBridge DynamoDB Redshift Terraform Airflow Kafka Kafka Connect API KSQL Debezium Apache Iceberg Databricks SQL NoSQL Medallion Architecture Change Data Capture (CDC)

Software Engineer (Data Engineering)

Capri Global Capital Limited

Jun 2023 - Jul 2026 (3 years 1 month)

Engineered and maintained 500+ batch, microbatch and real-time ETL pipelines processing multiple TBs of data daily. Implemented Change Data Capture for real-time data replication of MongoDB and MySQL, and developed monitoring systems for AWS Redshift.