srivarsha User
@srivarshauser1
Data Engineer with 3+ years building scalable Azure data pipelines and analytics with PySpark, SQL, and lakehouse architectures.
What I'm looking for
I’m a Data Engineer with 3+ years of experience designing and implementing scalable, cloud-based data pipelines and analytics solutions. I focus on Azure lakehouse and warehousing patterns, using Azure Databricks, Data Factory, and data lake architectures to turn raw data into reliable, data-driven insights.
I’ve migrated legacy systems to cloud platforms, including DB2, on-prem SQL, and Oracle, and improved efficiency while maintaining performance and reliability. I’ve built and optimized data processing with PySpark and Spark SQL, including SCD table loading, upsert logic for large datasets, and performance improvements (including a reported 30% boost in data load performance).
I enjoy end-to-end delivery—supervising ADF pipelines and Control-M jobs, driving production deployments, and supporting governance by documenting PII columns and mapping source-to-target tables for compliance. I also lead KT sessions to accelerate onboarding and knowledge transfer in Agile environments.
Experience
Work history, roles, and key accomplishments
Designed and loaded Microsoft Fabric warehouse tables using SCD types and built scalable data lakes on ADLS for analytics integration. Improved data load performance by 30% via PySpark optimization, developed Databricks notebooks for API ingestion, and implemented PySpark upsert logic for large datasets.
Migrated legacy systems (DB2, on-prem SQL, Oracle) to cloud platforms, achieving up to 70% cost savings while maintaining performance and reliability. Built ADF pipelines to process 100+ TB of client data into Delta/Parquet/CSV, implemented PySpark/Spark SQL business logic, and documented PII mappings for governance and audit readiness.
Education
Degrees, certifications, and relevant coursework
IIIT Nuzvid (RGUKT)
Bachelor of Technology (B.Tech)
2018 - 2022
Earned a Bachelor of Technology (B.Tech) from IIIT Nuzvid (RGUKT) between 2018 and 2022.
Tech stack
Software and tools used professionally
Availability
Location
Authorized to work in
Job categories
Interested in hiring srivarsha?
You can contact srivarsha and 90k+ other talented remote workers on Himalayas.
Message srivarshaFind your dream job
Sign up now and join over 100,000 remote workers who receive personalized job alerts, curated job matches, and more for free!
