Open to opportunities

Pavan sai Beeshetti

@pavansaibeeshetti

Message

Azure Data Engineer specializing in scalable ETL, Spark optimization, and cost-efficient cloud pipelines.

India

Message

What I'm looking for

I am seeking a mid-level Azure data engineering role where I can build scalable, cost-efficient ETL pipelines, improve performance, and drive data governance and automation in a collaborative team.

I am an Azure Data Engineer with three years of hands-on experience designing, building, and operating production-grade data pipelines using Azure Data Factory, Databricks, PySpark, SQL, and Python. I handle high-volume ingestion (100M+ records/day) and own pipelines end-to-end from ingestion and modeling to monitoring and production support.

I have delivered measurable improvements including ~40% runtime reduction and ~20% cost savings through Spark tuning, Delta Lake optimization, and cluster right-sizing, and implemented metadata-driven data validation, Unity Catalog governance, and CI/CD automation with Azure DevOps. I have built reusable ingestion patterns, SCD logic, and standardized connectors for APIs, SharePoint, and file sources.

I seek to drive reliable, performant data platforms and enable analytics teams with well-governed, observable data products, emphasizing cost efficiency, automation, and scalable architectures.

Experience

Work history, roles, and key accomplishments

Current

Azure Data Engineer

Current

Wissen Infotech

Mar 2025 - Present (9 months)

Designed and maintained ADF + Databricks pipelines processing 100M+ records/day, delivering ~40% runtime reduction and ~20% Databricks cost savings through Spark tuning, Delta Lake optimization, and cluster right-sizing.

Azure Data Factory Databricks Pyspark Delta Lake Azure DevOps SQL Data Modeling

Data Engineer

Wissen Infotech

Sep 2024 - Mar 2025 (6 months)

Built Python ETL pipelines ingesting SharePoint, ServiceNow and REST APIs into Azure, implemented SCD loading and table-level validations, and improved observability with logging, alerting, and Airflow orchestration.

Python ETL SharePoint ServiceNow REST APIs Airflow Azure SQL Data Quality

Data Engineer

Wissen Infotech

Feb 2023 - Aug 2024 (1 year 6 months)

Implemented scalable ingestion frameworks with ADF, Databricks and PySpark, created reusable incremental/full-load patterns reducing development effort ~30%, and optimized Delta tables to improve query performance and cut cloud costs ~20%.