# Diogo Couto

Diogo Couto is a remote worker on Himalayas, Data Engineer at Contractor, based in Portugal.

Source: https://himalayas.app/@diogocouto

```text
Data Engineer at Contractor, migrating production databases from PostgreSQL to BigQuery with data integrity maintained.
```

| Detail | Value |
| --- | --- |
| Availability | Looking for a job |
| Location | Portugal |
| Authorized to work in | Portugal |
| Salary expectations | 55k+ EUR |
| Job categories | Data Engineer, Software Engineer, Machine Learning Engineer |
| Skills | Data Engineering, ETL, BigQuery, Google Cloud Platform, PySpark, Python, SQL, PostgreSQL, Oracle Database, Apache Spark, Kafka, Airflow, Google Cloud Dataflow, Vertex AI, CI CD |
| LinkedIn | https://linkedin.com/in/diogo--couto |

## About

```text
At Contractor, I led the migration of production databases from PostgreSQL to Google BigQuery, redesigning schemas and maintaining data integrity while minimizing downtime.

I also implemented CI/CD pipelines with Cloud Build and ArgoCD, and developed tests to validate data accuracy and consistency throughout the migration.

At Capgemini, I optimized a real-time PySpark ETL pipeline, reducing processing time by 75%. I also created a Dataflow pipeline that loaded data into BigQuery and fed a VertexAI model.

At Spotlite, I improved and maintained an ETL pipeline using Python and distributed computing with Dask. My academic work includes evaluating GANs for InSAR phase unwrapping and contributing to a publication comparing YOLO with DETR.
```

## Experience

### Data Engineer (current)

Contractor. Oct 2025 - Present

```text
Led end-to-end migration of production databases from PostgreSQL to Google BigQuery, redesigning schemas for optimal performance. Designed CI/CD pipelines using Cloud Build and ArgoCD, and developed testing frameworks ensuring data accuracy.
```

Skills: PostgreSQL, BigQuery, Cloud-Build, ArgoCD, CI-CD, Data-Migration, Schema-Design, Testing, Query-Optimization, Partitioning

### Data Engineer

[Capgemini](https://himalayas.app/companies/capgemini-technology-services). Nov 2024 - Sep 2025

```text
Maintained and optimized ETL pipelines using Oracle, Python, Spark, and Kafka, reducing processing time by 75%. Implemented real-time alerts, developed dashboards, and created GCP Dataflow pipelines feeding BigQuery and VertexAI models.
```

Skills: Oracle, Python, Spark, Kafka, Kibana, PySpark, GCP-Dataflow, BigQuery, Vertex-AI, Airflow, Streamlit, ETL

### Data Engineer

Spotlite. Jun 2022 - Nov 2024

```text
Improved, expanded, and maintained ETL pipelines using Python, Pandas, Polars, Dask, Docker, and Parquet. Converted workflows from bash to Python, parallelized code with Dask, and implemented CI/CD with GitHub Actions.
```

Skills: Python, Pandas, Polars, Dask, Docker, Parquet, AWS, GitHub-Actions, CI-CD, ETL

### Software Developer (Internship)

Auditor. Apr 2017 - May 2017

```text
Developed a MySQL database and interface for a beverage dispenser system, including login, data registration, and visualization. Implemented mechanisms to view and update saved data.
```

Skills: MySQL, Interface-Design, Login-System, Data-Management

## Education

### University of Trás-os-Montes and Alto Douro

Master's in Informatics Engineering, Informatics Engineering. 2021 - 2023

```text
Master's in Informatics Engineering with focus on ML and data processing. Thesis on Phase Unwrapping using ML methods.
```

### University of Trás-os-Montes and Alto Douro

Bachelor's in Informatics Engineering, Informatics Engineering. 2018 - 2021

```text
Bachelor's in Informatics Engineering from the University of Trás-os-Montes and Alto Douro.
```

### Escola Secundaria de Valongo

Technician in Management and Programming of Computer Systems, Management and Programming of Computer Systems. 2014 - 2017

```text
Technician in Management and Programming of Computer Systems from Escola Secundaria de Valongo.
```

## Tech stack

- Apache Spark
- Google Cloud Platform
- Kubernetes
- GitHub Actions
- Pandas
- PySpark
- Dask
- MySQL
- PostgreSQL
- Node.js
- JavaScript
- Python
- HTML5
- Java
- CSS 3
- XML
- TensorFlow
- Keras
- Streamlit
- Kafka
- Kibana
- Google Cloud Dataflow
- Docker
- Airflow
- Google BigQuery
- SQL
- Polars
- ArgoCD
- Apache Kafka

To contact Diogo, message them from this profile with a Himalayas employer account: [Hire on Himalayas](https://himalayas.app/hire).

## People also viewed

- [WAQAS AHMAD](https://himalayas.app/@waqasahmad): Sr. Data Engineer, Amazon
- [Pedro Mouta](https://himalayas.app/@pedromouta): Senior Data Engineer, Devoteam
- [alberto junior](https://himalayas.app/@albertojunior): Data Engineer, Kuehne Nagel
- [Wallison Campanelli](https://himalayas.app/@wallisoncampanelli): PhD Researcher – PT CERN Fellowship, LIP / University of Lisbon
- [João Coelho](https://himalayas.app/@joaocoelho): Senior Data Engineer, Sky Technology Centre Portugal
- [PAULA BARBOSA](https://himalayas.app/@paulabarbosa1): Data Analytics Engineer, LCG Consulting
- [Carolina Rei](https://himalayas.app/@carolinarei): Data Engineer, Capgemini
- [Cesar Roma](https://himalayas.app/@cesarroma): Data Engineer, Leonteq
- [Arthur Lopes](https://himalayas.app/@arthurlopes): Data Engineer, Diconium
- [Guilherme Padinha](https://himalayas.app/@guilhermepadinha): Consultant, Neyond
