Skip to main content
Soham KatkarSK
Open to opportunities

Soham Katkar

@sohamkatkar1

I build reliable cloud data pipelines that turn transactional data into analytics-ready insights.

Zimbabwe
Message

At Thaddeus Resource Center, I architect and manage GCP and Apache Airflow workflows ingesting over 1TB of daily ERP data into BigQuery with 99.9% uptime. I also built dbt incremental-loading patterns and Pydantic-based validation checks that improved performance by 30% and reduced downstream anomalies by 50%.

Previously at HSBC Technology, I developed PySpark ELT pipelines processing 5M+ daily transactions and supporting insights that identified $2M+ in revenue opportunities. I build across Python, SQL, Spark, Airflow, dbt, Snowflake, AWS, Azure, and GCP, and have also developed RAG applications using Llama 3, LangChain, ChromaDB, and Streamlit.

Experience

Work history, roles, and key accomplishments

TC
Current

Data Engineer

Thaddeus Resource Center

Jul 2025 - Present (1 year 1 month)

Architected and managed automated cloud workflows using Apache Airflow and GCP to ingest over 1TB of daily transactional and customer records from varied ERP systems into BigQuery, maintaining 99.9% uptime for downstream BI and analytics. Spearheaded the development of incremental loading patterns via dbt and Apache Airflow enhancing performance by 30% and minimizing latency.

HT

Data Engineer

Aug 2021 - Dec 2023 (2 years 4 months)

Developed scalable PySpark ELT pipelines processing 5M+ daily transactions, powering gold layer data insights that identified $2M+ in new revenue opportunities. Automated troubleshooting via Shell script and Jenkins, cutting setup time by 40% and enhancing reliability for Power BI developers.

IL

Junior Data Analyst

Incentius Solutions Pvt. Ltd.

Feb 2021 - Jul 2021 (5 months)

Designed enterprise star schemas and optimized SQL queries, improving query performance by 40% for executive dashboards. Delivered clean datasets for BI developers using Tableau and Google Analytics, increasing stakeholder engagement by 50% across 6 European markets by successfully onboarding 12+ new executive dashboards.

Education

Degrees, certifications, and relevant coursework

University of Maryland, Baltimore County logoUC

University of Maryland, Baltimore County

Master of Science, Information Systems

2024 -

Grade: 3.63/4.0

Pursuing a Master of Science in Information Systems with a GPA of 3.63/4.0.

Savitribai Phule Pune University logoSU

Savitribai Phule Pune University

Bachelor of Engineering, Electronics & Computer Engineering

2017 - 2021

Grade: 3.30/4.0

Earned a Bachelor of Engineering in Electronics & Computer Engineering with a GPA of 3.30/4.0.

Get matched with your dream remote job

Sign up now and join over 250,000+ remote workers who receive personalized job alerts, curated job matches, and more for free!

Sign up
Himalayas profile for an example user named Frankie Sullivan