Open to opportunities

Paulo Portela

@pauloportela

Message

Data Engineer focused on scalable AWS pipelines, data quality, and governed analytics.

Portugal

Message

What I'm looking for

I want to keep building scalable AWS data platforms with strong data quality, governance, and observability. I’m looking for a role where I can automate pipelines, improve performance/costs, and collaborate closely with engineering and business teams.

I build data-driven solutions and data pipelines that help teams make reliable decisions. I develop and operate AWS-aligned systems that prioritize data quality, reliability, scalability, and performance across services like Glue, S3, and Athena.

My work also covers ETL and Data Processing with PySpark, incremental processing and snapshot management to optimize performance and costs, and data lake organization with partitioning strategies. I strengthen governance and observability using Glue Crawlers, Data Catalog, Lake Formation, and CloudWatch, while automating validation and resilience with Lambda, AWS Backup, and Infrastructure as Code.

Experience

Work history, roles, and key accomplishments

Current

Data Engineer

Current

Diconium

Dec 2025 - Present (7 months)

Developed and operated AWS data pipelines for VWGDS, implementing ETL with AWS Glue and PySpark, incremental processing, and S3-based data lake layering. Managed metadata and governance with Glue Crawlers, Glue Data Catalog, and AWS Lake Formation, and ensured observability and resilience using CloudWatch and AWS Backup.

AWS AWS Glue Amazon S3 Amazon Athena Pyspark ETL Data Lake Partitioning Data Governance Glue Crawlers Glue Data Catalog AWS Lambda Cloudwatch AWS Backup AWS CDK Infrastructure as Code

Data Engineer

Openvia Mobility

Jun 2024 - Nov 2025 (1 year 5 months)

Built data ingestion, transformation, and normalization pipelines from multiple sources using Airbyte, Python, SQL, and PySpark. Designed batch and streaming ETL orchestration with Airflow, Spark, Databricks, and AWS Step Functions, and supported KPI delivery through AWS data lake services and QuickSight.

Software Engineer

Claranet

Sep 2021 - May 2024 (2 years 8 months)

Performed requirements engineering and full-stack development with automated testing (JUnit 5, Postman, Selenium) and supported modernization of SharePoint from on-premises to SharePoint Online with automated workflows. Implemented AWS automation pipelines using Lambda, S3, and CodePipeline, and developed REST APIs with Swagger documentation and Docker containerization.

Requirements Engineering Full Stack Developer Junit Postman Selenium SharePoint SharePoint Online AWS Lambda Amazon S3 AWS CodePipeline REST APIs Swagger Docker CI CD Git Azure DevOps

Education

Degrees, certifications, and relevant coursework

Faculty of Engineering, University of Porto

Master's Degree in Data Engineering and Science, Data Engineering and Science

2022 - 2024

Grade: 18/20

Master's thesis on improving speech prosody assessment through AI, using neural networks (CNNs, LSTMs) and ProsoVR for healthcare/clinical speech analysis. Graduated with thesis grade 18/20.