# Alfie Pan

Alfie Pan is a remote worker on Himalayas, Data Engineer at TEKsystems, based in China.

Source: https://himalayas.app/@alfiepan

```text
Data Engineer at TEKsystems who built shared components reused by ~90 credit data pipelines across 40 countries.
```

| Detail | Value |
| --- | --- |
| Availability | Looking for a job |
| Location | China |
| Authorized to work in | China |
| Salary expectations | 30k+ USD |
| Job categories | Data Engineer, Delivery Lead, Big Data Engineer, Software Engineer |
| Skills | Data Engineering, Data Warehouse, ETL ELT, Batch Processing, Stream Processing, Dimensional Modeling, Data Migration, Data Reconciliation, Data Validation, Spark, Spark SQL, Hive, Apache Hive, Hadoop, HDFS |
| GitHub | https://github.com/alfieym |

## About

```text
At TEKsystems, I migrated a global credit data warehouse from SAS to Spark and Hive. After running the POC, I built a shared component layer reused by ~90 pipelines across 40 countries.

I owned the MENA and US work end to end, from design and build through validation and consolidation. I also built reconciliation controls so each region could sign off only when Spark output matched the SAS baseline.

At Epro Software, I was a Big Data Engineer / Delivery Lead, supporting a small team on two-week sprints. I migrated an IoT compliance warehouse to Hadoop and Spark, cutting storage cost by 50% and reducing a full export from 72 hours to 3 hours; the work achieved 100% MIIT compliance across 80+ metrics.
```

## Experience

### Data Engineer (current)

[TEKsystems](https://himalayas.app/companies/teksystems). May 2025 - Present

```text
Migrated the credit data warehouse from SAS to Spark/Hive, building shared components reused by ~90 pipelines across 40 countries. Owned MENA and US end-to-end delivery, including design, build, validation, and consolidation.
```

Skills: Spark, Hive, SAS, PySpark, Scala, Prophecy, Cloud-Composer, Jenkins, Data-Migration, Data-Warehouse

### Big Data Engineer / Delivery Lead

Epro Software. May 2022 - May 2025

```text
Led a small team on 2-week sprints, handling allocation, design review, and risk escalation. Migrated a legacy Oracle warehouse to Hadoop/Spark for MIIT audits, reducing storage cost by 50% and full export time from 72h to 3h.
```

Skills: Spark, Hive, Hadoop, Oracle, SQL, Data-Migration, Delivery-Management, Agile, Scrum

### Data Engineer

Shanghai Haiding Information Technology. Apr 2021 - Nov 2021

```text
Built an offline user-behaviour warehouse using HDFS, Hive, and Kafka, and improved query performance by 30% through Hive UDF/UDTF work.
```

Skills: HDFS, Hive, Kafka, UDF, UDTF, SQL, Data-Warehouse

### Software Engineer

eFuture (Beijing). Sep 2019 - Apr 2021

```text
Worked on group-level retail warehouse and user-behaviour analytics, focusing on Spark tuning and custom comparators.
```

Skills: Spark, Java, Data-Analysis, Performance-Optimization

## Education

### Nanfang College of Sun Yat-sen University

Bachelor of Engineering, Computer Science and Technology. 2015 - 2019

```text
Bachelor of Engineering in Computer Science and Technology from Nanfang College of Sun Yat-sen University, completed in 2019.
```

## Tech stack

- Apache Hive
- SAS
- Jenkins
- PySpark
- Oracle
- Hadoop
- Java
- Scala
- Kafka
- Git
- Airflow
- SQL
- Prophecy

To contact Alfie, message them from this profile with a Himalayas employer account: [Hire on Himalayas](https://himalayas.app/hire).

## People also viewed

- [roger li](https://himalayas.app/@rogerli): Director of IT Team, Huixiang
- [Jiapeng Xia](https://himalayas.app/@jiapengxia): Data Analyst, Data Engineer, Dun & Bradstreet
- [la wang](https://himalayas.app/@lawang): CTO / Tech Partner, Shanghai Qichu E commerce Co., Ltd.
- [W User](https://himalayas.app/@wuser1): Senior Data Platform Infra Eng, Ola
- [Phoenix WU](https://himalayas.app/@phoenixwu): Development Team Lead, Osram Lighting
- [Zhang Jiaxin](https://himalayas.app/@JiaxinZhang): LLM Data Engineering Lead, AI Assisted Web Fiction Content Data Platform
- [peng User](https://himalayas.app/@penguser): Senior Big Data Engineer, Tongdun Technology
- [Lei Shi](https://himalayas.app/@leishi): Senior Data Engineer / Data Team Lead, Mercaso
- [ethan li](https://himalayas.app/@ethanli): Senior Software Engineer, Tencent
- [Zefeng Zhi](https://himalayas.app/@zefengzhi): Software Engineer II, EnterpriseDB
