Venkata Siva Narayana Challa
@venkatasivanarayanac
Azure Data Engineer building scalable ETL/ELT pipelines on Azure.
IndiaWhat I'm looking for
I’m a results-driven Azure Data Engineer with 4 years of experience building scalable ETL/ELT pipeline development, cloud data engineering, and big data processing across Energy and enterprise domains. I specialize in Azure Data Factory (ADF), Azure Databricks, PySpark, and SQL to deliver analytics-ready data platforms for cross-functional stakeholders.
I’ve designed parameterized ingestion pipelines onboarding datasets from Snowflake, Azure Data Lake Gen2, sftp, Salesforce, and REST APIs into structured raw and trusted zones. I implement Medallion Architecture (Bronze-Silver-Gold), Unity Catalog governance, incremental loading, metadata-driven pipelines, and strong data validation/data quality checks to ensure production readiness.
Dual-certified as a Databricks professional (Data Engineer Associate and Generative AI Engineer Associate), I also bring hands-on GenAI and Databricks Assistant experience, including LLM integration fundamentals. I focus on performance optimization, workflow automation, reliable monitoring, and production support—delivering robust pipelines with strong uptime and SLA adherence.
Experience
Work history, roles, and key accomplishments
Designed and implemented scalable, parameterized Azure ingestion and ELT pipelines to onboard datasets from Snowflake, ADLS Gen2, SFTP, Salesforce, and REST APIs into raw and trusted zones. Implemented Unified ELT with Medallion Architecture and enforced Unity Catalog governance (RBAC, lineage, fine-grained permissions) while deploying repeatable CI/CD for Databricks and ADF across environments.
Built end-to-end parameterized ETL pipelines in Azure Data Factory to extract and load data from Azure Blob storage, network folders, and on-prem SQL sources into ADLS Gen2 for energy asset reporting. Developed Databricks/PySpark transformations using Medallion Architecture, optimized Snowflake workloads, and maintained 99%+ pipeline uptime through monitoring, RCA, and resilient error-handling/ret
Education
Degrees, certifications, and relevant coursework
Jawaharlal Nehru Technological University Kakinada (JNTUK)
Bachelor of Technology (B.Tech), Electronics and Communication Engineering (ECE)
2017 - 2021
Grade: GPA: 8.2/10
Completed a B.Tech in Electronics and Communication Engineering (ECE) at JNTUK from 2017 to 2021, scoring a GPA of 8.2/10.
Tech stack
Software and tools used professionally
Availability
Location
IndiaAuthorized to work in
Job categories
Skills
Interested in hiring Venkata Siva Narayana?
You can contact Venkata Siva Narayana and 90k+ other talented remote workers on Himalayas.
Message Venkata Siva NarayanaFind your dream job
Sign up now and join over 250,000+ remote workers who receive personalized job alerts, curated job matches, and more for free!
