Abbas User
@abbasuser1
Azure Data Engineer with 5.7 years building governed, scalable data platforms on Microsoft Azure for enterprise analytics.
What I'm looking for
I’m an Azure Data Engineer with 5.7 years of hands-on experience designing, building, and operating scalable data platforms on Microsoft Azure. I specialize in end-to-end ETL/ELT pipelines that process millions of records daily and support analytics and reporting across healthcare, banking, and enterprise analytics.
I bring strong data governance and security fundamentals, using Unity Catalog and RBAC to deliver lineage visibility and secure access management. In a healthcare data modernization effort, I enforced enterprise governance across 400+ analytical tables and 80+ consumers, while also improving query performance by 40% through a layered Delta Lake lakehouse model.
I’m focused on reliability, cost efficiency, and operational excellence. I introduced automated data reliability mechanisms (validation rules, anomaly detection, health checks) to reduce persistent data reliability issues by 25%, and I streamlined CI/CD and deployment workflows with Azure DevOps to cut deployment time by 40% while reducing pipeline execution costs by 20%.
Beyond the Azure core, I’ve delivered platform capabilities for real-world analytics—building an IPL analytics pipeline with Python and Apache Cassandra, and delivering Spark-based customer behavior analytics on large transactional datasets. I also collaborate closely with business stakeholders and engineering teams to implement monitoring, data quality controls, and observability dashboards that reduced data-related production incidents by 35%.
Experience
Work history, roles, and key accomplishments
Banking Recommendation Engine
YES Bank
Delivered Spark-based data pipelines for customer behavior analytics processing 8–12 TB of transactional data using Azkaban-orchestrated workflows. Tuned Spark SQL to reduce critical BI dashboard query latency by 35% while improving governance/metadata and security controls, reducing data quality issues by 20% and exposure risk by 25%.
IPL Analytics Platform
Mumbai Indians
Engineered a centralized IPL analytics platform with Python and Apache Cassandra to manage 15+ seasons of cricket data and deliver player/team/tournament statistics. Developed ETL workflows and optimized SQL/analytics models, reducing report generation time by 40% and supporting 10,000+ API requests per day.
Education
Degrees, certifications, and relevant coursework
Rajeev Gandhi Memorial College of Engineering & Technology
Bachelor of Technology (B.Tech) / Bachelor of Engineering (B.E.), Mechanical Engineering
Completed a B.Tech/B.E in Mechanical Engineering at Rajeev Gandhi Memorial College of Engineering & Technology in 2019.
Tech stack
Software and tools used professionally
Availability
Location
Authorized to work in
Job categories
Skills
Interested in hiring Abbas?
You can contact Abbas and 90k+ other talented remote workers on Himalayas.
Message AbbasFind your dream job
Sign up now and join over 250,000+ remote workers who receive personalized job alerts, curated job matches, and more for free!
