Open to opportunities

Siddhartha Varanasi

@siddharthavaranasi

Message

Data engineer and analyst specializing in cloud data platforms, ETL, and AI-ready analytics.

United States

Message

What I'm looking for

I seek a collaborative, Agile team role building scalable cloud data platforms and AI-ready pipelines, with opportunities for impact, mentorship, and growth.

I am a data engineer and analyst with 3.5+ years designing and modernizing cloud and on-prem analytics solutions, specializing in Azure, Snowflake, PySpark, and automation to deliver performant, governed data platforms. I have driven measurable outcomes—reducing storage costs by 25%, cutting deployment cycles by 40%, and improving data consistency and query performance across enterprise environments.

I build scalable ETL pipelines, AI-ready datasets, and interactive dashboards while partnering with cross-functional teams in Agile environments to translate business needs into KPI-driven solutions. I am committed to continuous learning in AI-driven data solutions and applying best practices in CI/CD, data governance, and performance tuning.

Experience

Work history, roles, and key accomplishments

Data Engineer

Bright Mind Enrichment and Schooling

Dec 2024 - May 2025 (5 months)

Designed scalable ETL pipelines using PySpark on Azure Databricks to ingest and transform 200K+ daily records into Snowflake, reducing storage costs by 25% and enabling AI-ready datasets for predictive models.

Python Pyspark Databricks Snowflake ADLS Azure Blob Storage DBT Power BI

Data Engineer

Tata Consultancy Services

Jun 2020 - Jul 2023 (3 years 1 month)

Delivered enterprise ETL solutions using Azure Data Factory, Informatica, and PySpark to integrate Salesforce, DB2, and Oracle into Snowflake, improving data consistency by 35% and cutting end-to-end latency by 35%.

Azure Data Factory Pyspark Snowflake Informatica SQL DBT Azure DevOps azure monitor