Shankar P
@shankarp
Data Engineer focused on scalable Azure ELT pipelines, event-driven ingestion, and high-integrity analytics-ready data.
IndiaWhat I'm looking for
I’m a Data Engineer specializing in scalable ELT pipelines, event-driven workflows, and high-integrity data platforms on Azure. I’ve owned end-to-end pipelines processing 1M+ records/day, built near real-time ingestion for faster analytics delivery, and improved availability by 40%.
I bring strong data engineering discipline—data quality frameworks (schema checks, anomaly detection), cleansing/normalization/deduplication, and governance—to ensure reliable datasets for BI and analytics. From building PySpark pipelines in Databricks to designing Bronze–Silver–Gold Delta Lake architectures, I translate business requirements into production-grade systems and optimize performance and cloud costs.
Experience
Work history, roles, and key accomplishments
Junior Data Engineer
ARCAP REIT
Jul 2025 - Present (11 months)
Owned end-to-end ELT pipelines processing 1M+ records/day from APIs, CRM, and databases, improving availability by 40%. Built event-driven/near real-time workflows in Azure Data Factory and developed SQL & PySpark transformations with data validation frameworks, improving accuracy by 30% and reducing PostgreSQL query latency by 25%.
Data Engineer
Sodexo
Sep 2020 - Oct 2021 (1 year 1 month)
Designed scalable ELT pipelines integrating CRM, APIs, and enterprise datasets into Azure and built PySpark/Databricks pipelines that improved processing efficiency by 35%. Implemented data validation and cleansing/normalization, dimensional star-schema models for BI reporting, and optimized Spark workloads (partitioning/caching) to reduce processing time by 30%.
Education
Degrees, certifications, and relevant coursework
Osmania University
Master of Business Administration, Finance
Completed an MBA with a focus on Finance at Osmania University.
MLR Institute of Technology
Bachelor of Engineering, Mechanical Engineering
Completed a Bachelor of Engineering in Mechanical Engineering from MLR Institute of Technology.
Tech stack
Software and tools used professionally
Availability
Location
IndiaAuthorized to work in
Job categories
Interested in hiring Shankar?
You can contact Shankar and 90k+ other talented remote workers on Himalayas.
Message ShankarFind your dream job
Sign up now and join over 250,000+ remote workers who receive personalized job alerts, curated job matches, and more for free!
