# Arshia Shahidiany

Arshia Shahidiany is a remote worker on Himalayas, Data Platform Operations Specialist at Royal Bank of Canada, based in Zimbabwe.

Source: https://himalayas.app/@arshiashahidiany

```text
Data Engineer with expertise in cloud platforms and data governance.
```

| Detail | Value |
| --- | --- |
| Availability | Open to opportunities |
| Location | Zimbabwe |
| Authorized to work in | Zimbabwe |
| Job categories | Data Engineer, Data Analyst, Data Scientist, DevOps Engineer |
| Skills | SQL, Python, Azure, Databricks, Data Factory, Azure DevOps, Git, Logic Apps, PySpark, SparkSQL, azure monitor, The Hive |

## What I'm looking for

```text
I am seeking a role that fosters innovation, collaboration, and growth opportunities in data engineering.
```

## About

```text
I am a Data Engineer with hands-on experience in various sectors, including logistics and finance. My journey began at the University of Sheffield, where I earned a BSc in Mathematics. Since then, I have worked with esteemed organizations like Royal Bank of Canada, Shell PLC, and Virgin Atlantic, focusing on data governance, CI/CD integration, and customer-centric solutions.

At the Royal Bank of Canada, I designed robust alerting mechanisms for data pipelines, significantly improving operational reliability and generating substantial cost savings. My role as a Data Engineering Consultant at Kubrick Group allowed me to work on diverse projects, including migrating data storage solutions and developing CI/CD frameworks that streamline workflows. I am passionate about leveraging data technologies to drive business growth and enhance client satisfaction.
```

## Experience

### Data Platform Operations Specialist (current)

Royal Bank of Canada. Sep 2024 - Present

```text
Designed and implemented robust alerting mechanisms for data pipelines using Azure Monitor and Logic Apps, enabling proactive issue identification and faster resolution. Performed detailed root cause analysis on pipeline failures, reducing downtime and improving operational reliability. Streamlined and optimized Databricks notebook code, leading to significant cost savings in cloud compute resourc
```

Skills: azure-monitor, Logic-Apps, Databricks, Azure-Data-Factory, DevOps, SQL, Python, Root-Cause-Analysis

### Data Engineer

Virgin Atlantic. Apr 2024 - Sep 2024

```text
Successfully migrated current systems from Hive Metastore to Unity Catalog, ensuring reproducible code across enterprise workspace environments. Developed a CI/CD framework to streamline workflows, introduce automated testing, and establish testing and staging environments. Championed the adoption of proper software development practices to eliminate manual code transfers.
```

Skills: Unity-Catalog, SQL, Python, CI-CD, Testing-Automation

### Data Engineer

Kubrick PLC. Jan 2024 - Apr 2024

```text
Created a data Lakehouse architecture within the Databricks platform to identify suitable tech roles for consultants in key markets. Processed and cleaned data from various third-party sources using SparkSQL and PySpark to derive meaningful insights. Developed a sophisticated analysis system to pinpoint in-demand tech roles, guiding business strategy and client satisfaction.
```

Skills: Databricks, SparkSQL, PySpark, Data-Cleaning, Data-Normalization, Data-Processing, Business-Intelligence

### Data Engineer

Shell Plc. Jun 2022 - Dec 2023

```text
Created data pipelines to facilitate insightful dashboards and analytics tools for logistics trade and supply, enhancing distribution operations. Utilized Azure Databricks (PySpark, Spark SQL) for data processing and reverse engineering, storing processed data in a data warehouse. Developed and implemented conceptual and logical data models, ensuring accurate representation of business requirement
```

Skills: Databricks, PySpark, Azure-Data-Factory, DevOps, Data-Modeling, Stakeholder-Management, Data-Warehouse

### Data Engineer

Shell Plc. Jun 2022 - Dec 2023

```text
Addressed data quality concerns related to duplication by automating the identification and rectification process. Devised a meticulous solution involving advanced data processing, regular expressions, and Python code. Implemented sophisticated fuzzy matching algorithms, drastically reducing manual checks and optimizing resource utilization.
```

Skills: Data-Quality, Python, Fuzzy-Matching-Algorithms, Automation, Root-Cause-Analysis, Data-Management

## Education

### University of Sheffield

BSc Mathematics, Mathematics

## Tech stack

- PySpark
- Databricks
- Azure DevOps
- Azure Monitor
- The Hive
- Root Cause
- SQL

To contact Arshia, message them from this profile with a Himalayas employer account: [Hire on Himalayas](https://himalayas.app/hire).

## People also viewed

- [Litan User](https://himalayas.app/@litanuser): Data Engineer, Tata Consultancy Services
- [tilaw09 User](https://himalayas.app/@tilaw09user): Consulting Databricks Data Engineer, Bank of Oklahoma
- [Mallikarjuna k](https://himalayas.app/@mallikarjunak): Senior Data Engineer, IRIS
- [Bhavya Budda](https://himalayas.app/@bhavyabudda): Senior Data Engineer, Amazon
- [Ammanolla Shirisha](https://himalayas.app/@ammanollashirisha): Data Engineer, TTEC Digital
- [debora harizi](https://himalayas.app/@deboraharizi): Junior Data Engineer, KIS Solutions
- [Ropafadzo Maganga](https://himalayas.app/@ropafadzomaganga): Monitoring & Evaluation Intern, Ministry of Health and Child Care
- [gayathri challagundla](https://himalayas.app/@gayathrichallagundla): Business Analyst Intern, Advantum Health
- [Mohit Chaudhari](https://himalayas.app/@Mohit_Chaudhari): Data Engineer, Accenture Solutions Pvt. Ltd.
- [Aaftab Gowani](https://himalayas.app/@aaftabgowani): Senior Data Engineer, Charter Communications
