Pavan sai Beeshetti
@pavansaibeeshetti
Azure Data Engineer specializing in scalable ETL, Spark optimization, and cost-efficient cloud pipelines.
IndiaWhat I'm looking for
I am an Azure Data Engineer with three years of hands-on experience designing, building, and operating production-grade data pipelines using Azure Data Factory, Databricks, PySpark, SQL, and Python. I handle high-volume ingestion (100M+ records/day) and own pipelines end-to-end from ingestion and modeling to monitoring and production support.
I have delivered measurable improvements including ~40% runtime reduction and ~20% cost savings through Spark tuning, Delta Lake optimization, and cluster right-sizing, and implemented metadata-driven data validation, Unity Catalog governance, and CI/CD automation with Azure DevOps. I have built reusable ingestion patterns, SCD logic, and standardized connectors for APIs, SharePoint, and file sources.
I seek to drive reliable, performant data platforms and enable analytics teams with well-governed, observable data products, emphasizing cost efficiency, automation, and scalable architectures.
Experience
Work history, roles, and key accomplishments
Azure Data Engineer
Wissen Infotech
Mar 2025 - Present (1 year 3 months)
Designed and maintained ADF + Databricks pipelines processing 100M+ records/day, delivering ~40% runtime reduction and ~20% Databricks cost savings through Spark tuning, Delta Lake optimization, and cluster right-sizing.
Data Engineer
Wissen Infotech
Sep 2024 - Mar 2025 (6 months)
Built Python ETL pipelines ingesting SharePoint, ServiceNow and REST APIs into Azure, implemented SCD loading and table-level validations, and improved observability with logging, alerting, and Airflow orchestration.
Data Engineer
Wissen Infotech
Feb 2023 - Aug 2024 (1 year 6 months)
Implemented scalable ingestion frameworks with ADF, Databricks and PySpark, created reusable incremental/full-load patterns reducing development effort ~30%, and optimized Delta tables to improve query performance and cut cloud costs ~20%.
Education
Degrees, certifications, and relevant coursework
Raghu Engineering College
Bachelor of Technology, Mechanical Engineering
2018 - 2022
Grade: 74%
Completed a Bachelor of Technology in Mechanical Engineering with a cumulative grade of 74%.
Tech stack
Software and tools used professionally
Availability
Location
IndiaAuthorized to work in
Job categories
Interested in hiring Pavan sai?
You can contact Pavan sai and 90k+ other talented remote workers on Himalayas.
Message Pavan saiFind your dream job
Sign up now and join over 250,000+ remote workers who receive personalized job alerts, curated job matches, and more for free!
