Manal Agrawal
@manalagrawal
Data Engineer & Data Quality Specialist delivering reliable ETL with Azure.
What I'm looking for
I’m a detail-oriented Data Engineer & Data Quality Specialist with 10+ years of experience in ETL, Azure Databricks, SQL/Hive queries, data validation, Power BI reporting, and large-scale data transformations across Insurance, Banking, Healthcare, and Retail. I build and troubleshoot data pipelines end-to-end, with a strong focus on data modeling, reconciliation, and automation frameworks that keep datasets trustworthy for analytics and BI teams.
At Markel, I’ve performed large-scale source-to-target data reconciliation using BITS Automation, developed Azure Databricks notebooks to validate transformations and business rules, and wrote Databricks SQL for data quality checks. I also built and automated Power BI dashboards (including Power Query shaping and scheduled refresh pipelines) and joined root cause analysis to address data quality issues and pipeline failures. Earlier, I validated DataLake ingestion across layers, executed Jenkins-driven testing, supported SAS 9.2 to AWS Hadoop migration, and delivered provider data ETL validation through Informatica mappings—backed by multiple “On the Spot” awards at TCS and a published Learning Object (LO) on Ultimatix Prime.
Experience
Work history, roles, and key accomplishments
Performed large-scale source-to-target data reconciliation using automated workflows and investigated data quality issues and pipeline failures. Built Azure Databricks notebooks and Databricks SQL checks to validate transformations and business rules, and delivered scheduled Power BI dashboards for self-service analytics.
Validated a data lake’s ingestion, transformation, and consumption layers by verifying schemas and transformation outputs. Created Databricks notebooks for transformation verification, tracked defects in JIRA, and produced Power BI summaries to report test progress and validation results.
QA Analyst - Retail
Apex
Mar 2020 - Mar 2023 (3 years)
Executed functional, regression, and integration testing for data-driven retail applications. Automated and monitored Jenkins pipelines, analyzed backend logs with Splunk and Azure logs to validate data flows, and delivered Power BI dashboards for execution metrics and sprint KPIs.
QA Analyst - Data Migration
Royal Bank of Scotland
Aug 2018 - Apr 2019 (8 months)
Supported data migration from SAS 9.2 to the AWS Hadoop ecosystem by validating migration accuracy. Performed data masking and encryption validation using Pricchaa and used SQL and UNIX scripting for verification.
Developed SQL scripts to validate provider data and performed data quality checks. Designed Informatica mappings, executed unit testing for ETL workflows, automated schedules using Dollar Universe, and produced audit reports and monthly data quality summaries.
Education
Degrees, certifications, and relevant coursework
KIET Group of Institutions
Master of Computer Applications, Computer Applications
Grade: 81%
Completed a Master of Computer Applications (MCA) at KIET Ghaziabad in 2014 with 81%.
GLA University
Bachelor of Computer Applications, Computer Applications
Grade: 80%
Completed a Bachelor of Computer Applications (BCA) at GLA Mathura in 2011 with 80%.
Tech stack
Software and tools used professionally
Availability
Location
Authorized to work in
Job categories
Interested in hiring Manal?
You can contact Manal and 90k+ other talented remote workers on Himalayas.
Message ManalFind your dream job
Sign up now and join over 100,000 remote workers who receive personalized job alerts, curated job matches, and more for free!
