Arshia Shahidiany
@arshiashahidiany
Data Engineer with expertise in cloud platforms and data governance.
What I'm looking for
I am a Data Engineer with hands-on experience in various sectors, including logistics and finance. My journey began at the University of Sheffield, where I earned a BSc in Mathematics. Since then, I have worked with esteemed organizations like Royal Bank of Canada, Shell PLC, and Virgin Atlantic, focusing on data governance, CI/CD integration, and customer-centric solutions.
At the Royal Bank of Canada, I designed robust alerting mechanisms for data pipelines, significantly improving operational reliability and generating substantial cost savings. My role as a Data Engineering Consultant at Kubrick Group allowed me to work on diverse projects, including migrating data storage solutions and developing CI/CD frameworks that streamline workflows. I am passionate about leveraging data technologies to drive business growth and enhance client satisfaction.
Experience
Work history, roles, and key accomplishments
Data Platform Operations Specialist
Royal Bank of Canada
Sep 2024 - Present (10 months)
Designed and implemented robust alerting mechanisms for data pipelines using Azure Monitor and Logic Apps, enabling proactive issue identification and faster resolution. Performed detailed root cause analysis on pipeline failures, reducing downtime and improving operational reliability. Streamlined and optimized Databricks notebook code, leading to significant cost savings in cloud compute resourc
Data Engineer
Virgin Atlantic
Apr 2024 - Sep 2024 (5 months)
Successfully migrated current systems from Hive Metastore to Unity Catalog, ensuring reproducible code across enterprise workspace environments. Developed a CI/CD framework to streamline workflows, introduce automated testing, and establish testing and staging environments. Championed the adoption of proper software development practices to eliminate manual code transfers.
Data Engineer
Kubrick PLC
Jan 2024 - Apr 2024 (3 months)
Created a data Lakehouse architecture within the Databricks platform to identify suitable tech roles for consultants in key markets. Processed and cleaned data from various third-party sources using SparkSQL and PySpark to derive meaningful insights. Developed a sophisticated analysis system to pinpoint in-demand tech roles, guiding business strategy and client satisfaction.
Data Engineer
Shell Plc
Jun 2022 - Dec 2023 (1 year 6 months)
Addressed data quality concerns related to duplication by automating the identification and rectification process. Devised a meticulous solution involving advanced data processing, regular expressions, and Python code. Implemented sophisticated fuzzy matching algorithms, drastically reducing manual checks and optimizing resource utilization.
Data Engineer
Shell Plc
Jun 2022 - Dec 2023 (1 year 6 months)
Created data pipelines to facilitate insightful dashboards and analytics tools for logistics trade and supply, enhancing distribution operations. Utilized Azure Databricks (PySpark, Spark SQL) for data processing and reverse engineering, storing processed data in a data warehouse. Developed and implemented conceptual and logical data models, ensuring accurate representation of business requirement
Education
Degrees, certifications, and relevant coursework
University of Sheffield
BSc Mathematics, Mathematics
Tech stack
Software and tools used professionally
Availability
Location
Authorized to work in
Job categories
Interested in hiring Arshia?
You can contact Arshia and 90k+ other talented remote workers on Himalayas.
Message ArshiaFind your dream job
Sign up now and join over 100,000 remote workers who receive personalized job alerts, curated job matches, and more for free!
