# Paulo Portela

Paulo Portela is a remote worker on Himalayas, Data Engineer at Diconium, based in Portugal.

Source: https://himalayas.app/@pauloportela

```text
Data Engineer focused on scalable AWS pipelines, data quality, and governed analytics.
```

| Detail | Value |
| --- | --- |
| Availability | Open to opportunities |
| Location | Portugal |
| Authorized to work in | Portugal |
| Job categories | Data Engineer, Software Engineer, Machine Learning Engineer, Data Platform Engineer, Data Engineering, Data Engineering Specialist, Data Engineering Positions, Backend Engineer, Data Data Engineering |
| Skills | AWS Glue, Amazon Athena, AWS Lambda, AWS Backup, AWS CDK, AWS Step Functions, ETL, Data Lake, PySpark, Airbyte, Airflow, Databricks, Jupyter Notebooks, Terraform, Redshift, Amazon Quicksight, Kafka, MLlib, Docker, Git, GitHub, Gitlab CI, Azure DevOps, AWS CodePipeline, AWS CodeBuild, AWS CodeDeploy, DBT, Pytest, PostgreSQL, MySQL, Oracle, SQL Server, Amazon RDS, DynamoDB, SQLite, BigQuery, REST APIs, Swagger, Parquet, JSON, CSV, Apache Iceberg, Matplotlib, SeaBorn, Plotly, scikit learn, XGBoost, LightGBM, Column, Dyn, Gitlab, Jupyter, Linux, NumPy, Pandas, Postman, SQL, Serverless, Time Analytics, Ubuntu, Windows, S3, Cloudwatch, AWS Sagemaker |
| LinkedIn | https://https://www.linkedin.com/in/pportela2000/ |

## What I'm looking for

```text
I want to keep building scalable AWS data platforms with strong data quality, governance, and observability. I’m looking for a role where I can automate pipelines, improve performance/costs, and collaborate closely with engineering and business teams.
```

## About

```text
I build data-driven solutions and data pipelines that help teams make reliable decisions. I develop and operate AWS-aligned systems that prioritize data quality, reliability, scalability, and performance across services like Glue, S3, and Athena.

My work also covers ETL and Data Processing with PySpark, incremental processing and snapshot management to optimize performance and costs, and data lake organization with partitioning strategies. I strengthen governance and observability using Glue Crawlers, Data Catalog, Lake Formation, and CloudWatch, while automating validation and resilience with Lambda, AWS Backup, and Infrastructure as Code.
```

## Experience

### Data Engineer (current)

[Diconium](https://himalayas.app/companies/diconium). Dec 2025 - Present

```text
Developed and operated AWS data pipelines for VWGDS, implementing ETL with AWS Glue and PySpark, incremental processing, and S3-based data lake layering. Managed metadata and governance with Glue Crawlers, Glue Data Catalog, and AWS Lake Formation, and ensured observability and resilience using CloudWatch and AWS Backup.
```

Skills: AWS, AWS-Glue, Amazon-Athena, PySpark, ETL, Data-Lake, Partitioning, Data-Governance, Glue-Crawlers, Glue-Data-Catalog, AWS-Lambda, Cloudwatch, AWS-Backup, AWS-CDK, Infrastructure-as-Code, S3

### Data Engineer

Openvia Mobility. Jun 2024 - Nov 2025

```text
Built data ingestion, transformation, and normalization pipelines from multiple sources using Airbyte, Python, SQL, and PySpark. Designed batch and streaming ETL orchestration with Airflow, Spark, Databricks, and AWS Step Functions, and supported KPI delivery through AWS data lake services and QuickSight.
```

Skills: Airbyte, Python, SQL, PySpark, ETL, Data-Normalization, Kafka, Airflow, Apache-Spark, Databricks, AWS-Step-Functions, AWS-Glue, Amazon-Athena, Amazon-Redshift, AWS-Lambda, Amazon-Quicksight, Data-Lake, Lake-Formation, Terraform, CI-CD, Azure-DevOps, Docker, AWS-CodePipeline, DBT, Pytest, Sagemaker, MLlib, Real-Time-Analytics, Forecasting, S3, Anomaly-Detection

### Software Engineer

[Claranet](https://himalayas.app/companies/claranet). Sep 2021 - May 2024

```text
Performed requirements engineering and full-stack development with automated testing (JUnit 5, Postman, Selenium) and supported modernization of SharePoint from on-premises to SharePoint Online with automated workflows. Implemented AWS automation pipelines using Lambda, S3, and CodePipeline, and developed REST APIs with Swagger documentation and Docker containerization.
```

Skills: Requirements-Engineering, Full-Stack-Developer, Junit, Postman, Selenium, SharePoint, SharePoint-Online, AWS-Lambda, AWS-CodePipeline, REST-APIs, Swagger, Docker, CI-CD, Git, Azure-DevOps, S3

## Education

### Faculty of Engineering, University of Porto

Master's Degree in Data Engineering and Science, Data Engineering and Science. 2022 - 2024. Grade: 18/20

```text
Master's thesis on improving speech prosody assessment through AI, using neural networks (CNNs, LSTMs) and ProsoVR for healthcare/clinical speech analysis. Graduated with thesis grade 18/20.
```

### Universidade Portucalense Infante D. Henrique

Bachelor's Degree in Computer Science, Computer Science. 2018 - 2021. Grade: 15/20

```text
Bachelor's degree in Computer Science, completed with a final grade of 15/20.
```

## Tech stack

- Postman
- Airbyte
- AWS Glue
- Amazon Quicksight
- AWS Step Functions
- GitHub
- GitLab
- AWS CodePipeline
- GitLab CI
- Jupyter
- NumPy
- Pandas
- PySpark
- dbt
- DB
- MySQL
- PostgreSQL
- SQLite
- Gmail
- Databricks
- Terraform
- Azure DevOps
- JSON
- scikit-learn
- Kafka
- Ubuntu
- Linux
- Windows
- AWS Lambda
- Serverless
- Amazon RDS
- pytest
- Airflow
- Time Analytics
- AWS Backup
- SQL
- XGBoost
- LightGBM
- Dyn
- Apache Iceberg
- Column
- Seaborn

To contact Paulo, message them from this profile with a Himalayas employer account: [Hire on Himalayas](https://himalayas.app/hire).

## People also viewed

- [WAQAS AHMAD](https://himalayas.app/@waqasahmad): Sr. Data Engineer, Amazon
- [Pedro Mouta](https://himalayas.app/@pedromouta): Senior Data Engineer, Devoteam
- [alberto junior](https://himalayas.app/@albertojunior): Data Engineer, Kuehne Nagel
- [Nuno Miguel](https://himalayas.app/@nunomiguel): Senior Data Engineer, OLX Portugal
- [Abdul Mateen](https://himalayas.app/@abdulmateen4): Senior Data Engineer, Pictet Technologies
- [Alexsander Siqueira](https://himalayas.app/@alexsandersiqueira): Data Architect, Nortal
- [Renata Costa](https://himalayas.app/@renatacm): Platform Engineer, Reply
- [Diogo Couto](https://himalayas.app/@diogocouto): Data Engineer, Contractor
- [Farman Ahmed](https://himalayas.app/@farmanahmed1): Senior Data Platform Engineer, PayPal
- [Farman Ali](https://himalayas.app/@farmanali5): Senior Data Platform Engineer, PayPal
