# Paulo Eduardo dos Santos

Paulo Eduardo dos Santos is a remote worker on Himalayas, Data Engineer at BRQ, based in Brazil.

Source: https://himalayas.app/@paulo_eduardo

```text
Senior Data Engineer with 9 years designing and operating large-scale data platforms for banks, payments, telecom, healthcare, and e-commerce
```

| Detail | Value |
| --- | --- |
| Availability | Looking for a job |
| Location | Brazil |
| Authorized to work in | Brazil |
| Salary expectations | 79k+ USD |
| Job categories | Data Engineer, Backend Engineer, Data Architect, Big Data Engineer |
| Skills | Data Engineering, ETL, Data Pipelines, Airflow, Python, PySpark, Apache Spark, DBT, Data Lake Architecture, Data Warehouse, Data Quality, Data Governance, REST API Design, fastAPI, Flask |
| Website | https://viralanalyzer.com.br |
| LinkedIn | https://linkedin.com/in/paulo--eduardo |
| GitHub | https://github.com/Pauloeduspbr |

## About

```text
At BRQ, I build Python and PySpark pipelines for RD Saúde’s Customer360 platform, consolidating clinical, CRM, and scheduling data across a Bronze/Silver/Gold lake. I also orchestrate Airflow DAGs and implemented data-quality, observability, and PII/LGPD governance frameworks.

At Stefanini, I built Python REST APIs and dbt pipelines for AmericaNet, automating processes that reduced manual intervention by 70%. For Cielo, I led the migration of payment data and developed transformations and dimensional models with row-level reconciliation.

I founded and serve as the sole engineer of Vereditum and ViralAnalyzer, two SaaS products in production. Vereditum processes documents and audio for legal analysis using OCR, RAG, and cascading LLM providers; ViralAnalyzer collects, enriches, and serves data from external sources through a Python and FastAPI platform.
```

## Experience

### Data Engineer (current)

BRQ. Jul 2025 - Present

```text
Built ingestion and transformation pipelines in Python/PySpark over a Bronze/Silver/Gold lake, orchestrated Airflow DAGs, and implemented data-quality and governance frameworks.
```

Skills: Python, PySpark, Apache-Iceberg, S3, Airflow, Kubernetes, Data-Quality, Observability, PII-LGPD, HashiCorp-Vault, KMS, Fernet

### Senior Big Data Specialist / Data Engineer

[Stefanini](https://himalayas.app/companies/stefanini). Jun 2023 - Jun 2025

```text
Built Python REST APIs and dbt ELT pipelines, processed terabyte-scale data with SparkSQL on Databricks, led multi-cloud migrations, and sustained production clusters at high availability.
```

Skills: Python, Flask, DBT, SparkSQL, Databricks, PySpark, Snowflake, AWS, Azure, GCP, Data-Quality, Automation

### Senior Data Engineer

Natura & Co. Feb 2022 - Jun 2023

```text
Migrated legacy data to BigQuery, built Azure Data Factory pipelines, and developed EMR Serverless ETL and Airflow DAGs for e-commerce analytics.
```

Skills: BigQuery, Azure-Data-Factory, PySpark, EMR-Serverless, Airflow, Parquet, Delta, CDC, NiFi

### Data Engineer

Enel. May 2021 - Feb 2022

```text
Migrated the corporate data warehouse from Impala to Redshift, optimized queries, documented ETL processes, and trained business teams.
```

Skills: Impala, Redshift, SQL, ETL, Documentation, Training

### Big Data Solutions Architect

Banco do Nordeste. Jan 2021 - May 2021

```text
Designed a layered data lake for banking credit systems, extended the Hive/HBase ingestion framework, and integrated enterprise scheduling.
```

Skills: Data-Lake, Hive, HBase, Ingestion, Scheduling, Architecture

### Big Data Architect / Engineer

Hospital Sírio-Libanês. Mar 2019 - Dec 2020

```text
Built automated Airflow ETL pipelines on AWS, containerized with Docker/Kubernetes, and implemented SSO with AWS Cognito and Azure AD.
```

Skills: Airflow, AWS, S3, Athena, EMR, Kinesis, Lambda, Docker, Kubernetes, SSO, Amazon-Cognito, Azure-AD, Kerberos, Ranger, Grafana

### Big Data Technical Lead

Claro Brasil. Sep 2017 - Mar 2019

```text
Operated production clusters, optimized Spark/Hive workloads for 50% faster processing, secured clusters with Kerberos, and mentored engineers.
```

Skills: Spark, Hive, Kerberos, Cluster-Operations, Performance-Optimization, Mentorship

### Big Data Analyst

Vivo. Jun 2017 - Sep 2017

```text
Performed Hadoop migration, built PySpark ETL pipelines, managed HBase persistence, and ensured cluster high availability.
```

Skills: Hadoop, PySpark, HBase, ETL, High-Availability

## Education

### Anhembi Morumbi University

Associate Degree, Big Data and Data Intelligence

```text
Associate Degree in Big Data and Data Intelligence, expected to complete in 2026.
```

### FMU

Artificial Intelligence, Artificial Intelligence

```text
Artificial Intelligence course currently in progress.
```

### Garre Training

RedHat Certified System Administrator (RHCSA), Big Data Engineering

```text
RedHat Certified System Administrator (RHCSA) and Big Data Engineering certification, 160 hours.
```

### UNIP

Bachelor of Science, Information Systems

```text
Bachelor of Science in Information Systems from UNIP, completed in 2006.
```

## Tech stack

- Snowflake
- Azure Synapse
- Apache Spark
- AWS Glue
- Apache Hive
- Kubernetes
- Docker Compose
- GitHub Actions
- PySpark
- dbt
- PostgreSQL
- MongoDB
- SQLite
- Cassandra
- Oracle
- Redis
- Terraform
- Python
- Apache NiFi
- Flask
- FastAPI
- Grafana
- SQLAlchemy
- Stripe
- AWS Lambda
- Shell
- TypeScript
- pytest
- Docker
- Airflow
- Apache Ranger
- SQL
- AWS KMS
- Apache Iceberg
- Cloudflare Workers
- Playwright
- Pydantic
- Delta Lake
- Vitest
- CodeQL
- Apache Parquet
- AWS

To contact Paulo, message them from this profile with a Himalayas employer account: [Hire on Himalayas](https://himalayas.app/hire).

## People also viewed

- [Luan Pieri](https://himalayas.app/@luanpieri): Senior Data Engineer, Guidance
- [André Mossinato](https://himalayas.app/@andrmossinato): Senior Data Engineer, Tesorio
- [Guilbert Santurião de Araújo](https://himalayas.app/@guilbertsanturiodear): Data & Insight Engineer, UOL EdTech
- [Murilo Biss](https://himalayas.app/@murilobiss): Senior Data Engineer, Tarmac.IO
- [Leonardo Santos](https://himalayas.app/@leonardosantosdev): Senior Data Engineer, Capgemini
- [Mateus Morais](https://himalayas.app/@mateusmorais): Senior Data Engineer, DataEX
- [Alisson Correia](https://himalayas.app/@alissoncorreia1): Senior Data Engineer, Cheesecake Labs
- [Marton Padilha](https://himalayas.app/@martonpadilha): Specialist Data Engineer, iFood
- [Andre Barros](https://himalayas.app/@andrebarros): Data Engineer, Marlabs Brasil
- [Guilherme Almeida dos Santos](https://himalayas.app/@guilhermealmeidadoss): Data Engineer, Marlabs
