Abdul Haziq
@abdulhaziq
Software QA Analyst specializing in PySpark ETL, Delta Lake, and large-scale data validation.
What I'm looking for
I am a Software QA Analyst with five years of experience validating large-scale ETL and Big Data pipelines, specializing in PySpark, Delta Lake versioning, and cloud data migrations. I architect and implement automated validation frameworks, integrate continuous validation into CI/CD, and ensure data integrity across raw-to-gold layers for multi-terabyte datasets.
I collaborate closely with data engineering and product teams in Agile environments to troubleshoot pipeline failures, optimize performance, and align testing with business requirements. My work includes designing test strategies across AWS S3, Databricks, Postgres, and Elasticsearch, and delivering reusable validation libraries and dashboards to reduce manual effort and proactively detect anomalies.
Experience
Work history, roles, and key accomplishments
QA Analyst
Altrata
May 2021 - Present (4 years 8 months)
Validated a large-scale cloud data migration and architected end-to-end QA for Databricks PySpark ETL pipelines, improving data reliability across raw-to-gold layers for multi-terabyte datasets.
Software QA Engineer
Securemetric Bhd.
May 2018 - May 2021 (3 years)
Performed functional and non-functional testing across web, mobile and OS platforms, logged and tracked defects in JIRA, and monitored server activity using PowerShell to ensure product quality.
Education
Degrees, certifications, and relevant coursework
Universiti Teknologi PETRONAS
Bachelor of Technology (Honours), Information and Communication Technology
Bachelor of Technology (Honours) in Information and Communication Technology focused on ICT principles and applied technologies.
Tech stack
Software and tools used professionally
Availability
Location
Authorized to work in
Portfolio
haziqmatlan.github.io/data-pipelineJob categories
Interested in hiring Abdul?
You can contact Abdul and 90k+ other talented remote workers on Himalayas.
Message AbdulFind your dream job
Sign up now and join over 100,000 remote workers who receive personalized job alerts, curated job matches, and more for free!
