Open to opportunities

sandeep paruchuri

@sandeepparuchuri

Message

Data Engineer with expertise in Python, SQL, and cloud technologies.

United States

Message

What I'm looking for

I am looking for a role that fosters innovation, encourages collaboration, and offers opportunities for professional growth in data engineering.

I am a Data Engineer with over 4 years of experience in designing and maintaining low-latency, high-throughput data pipelines in cloud-native environments. My expertise lies in Python, SQL, and various cloud technologies, allowing me to build scalable, real-time data systems that enhance operational efficiency.

Currently, I work at Novartis, where I have successfully built ETL pipelines that improved ingestion speed by 40% and reduced claims validation latency from 24 hours to under 2 minutes. My passion for market microstructure drives me to optimize crypto data pipelines for scale and reliability, ensuring compliance with regulatory standards.

Experience

Work history, roles, and key accomplishments

Current

Data Engineer

Current

Novartis

Apr 2023 - Present (2 years 3 months)

Built scalable, real-time ETL pipelines using PySpark, Kafka, and Delta Lake, improving ingestion speed by 40%. Deployed Spark Structured Streaming pipelines to reduce latency from 24 hours to under 2 minutes and tuned Databricks clusters for cost-efficient EDI data ingestion, cutting costs by 30%.

Pyspark Kafka Delta Lake Spark Structured Streaming Databricks HIPAA HITRUST

Data Analyst

KMB Software Solutions Pvt. Ltd.

Aug 2021 - Sep 2022 (1 year 1 month)

Created and maintained daily and ad-hoc financial reports using SQL and Power BI for executive decision-making and compliance tracking. Reconciled external broker data with internal systems to support trade validation, improving transaction matching accuracy. Built Excel-based financial models and automated reporting tasks using VBA macros to support rapid turnaround on audit requests.

SQL Power BI Excel Financial Reporting Compliance Reporting

Data Engineer Intern

VS Tech Worlds Pvt. Ltd.

Dec 2020 - May 2021 (5 months)

Processed and transformed large-scale trade datasets in AWS and Hadoop environments for risk and pricing analysis. Supported data quality checks on clearing transactions and P&L validation using Python scripts and SQL queries. Learned core principles of financial reporting, reconciliation, and fund tracking across multiple platforms.

AWS Hadoop Python SQL Data Quality Financial Reporting