# Jonathan Gonsalves

Jonathan Gonsalves is a remote worker on Himalayas, Senior Data Engineer and Associate Director at BTG Pactual, based in Brazil.

Source: https://himalayas.app/@jonathangonsalves

```text
I'm a Senior Data Engineer and Associate Director based in Brazil working for BTG Pactual
```

| Detail | Value |
| --- | --- |
| Availability | Open to opportunities |
| Location | Brazil |
| Authorized to work in | Brazil |
| Salary expectations | 70k-90k USD |
| Job categories | Data Entry Specialist, Data Architect |
| Skills | Python, SQL, AWS, Apache Spark, Scala, Airflow |
| LinkedIn | https://linkedin.com/in/jonathangonsalves |
| GitHub | https://github.com/jonathangonsalves |

## What I'm looking for

```text
I'm looking for a challenging and dynamic work environment that allows me to grow and learn new skills as also opportunities for career advancement and professional development.
```

## About

```text
Hello, I'm Jonathan but you can call me John! I'm a Senior Data Engineer and Tech Teacher with a BS in Computer Engineering from Positivo University in Curitiba, Brazil.

I have worked for several companies, including e-commerces and fintechs, and currently I work at BTG Pactual Bank, the largest invesment banking in Latin America as an Associate Director and leader of two squads.

I have experience with several programming languages, including Python, and Scala and knowledge on AWS services like DynamoDB, Redshift, EMR, Glue, and others.

I'm also a Learning Facilitator on a Data Engineering boot camp, teaching classes on ingestion and processing pipelines, Apache Airflow, Apache Spark, AWS, Data lakes, and other subjects.
```

## Experience

### Senior Data Engineer and Associate Director (current)

[BTG Pactual](https://himalayas.app/companies/btg-pactual). Aug 2021 - Present

```text
• Leader of two squads: Transactional and Clients Data.
• Responsible for the comunication beetween IT Software teams and Business Managers.
• Built data processing and ingestion pipelines from several data sources (including SNS, RabbitMQ, Relational Databases and others)
• Built Spark Data Quality pipelines using Deequ.
• Developed near-real time pipelines using Spark Streaming
```

Skills: Apache-NiFi, PySpark, SparkSQL, Apache-Spark, Amazon-SQS, NiFi, AWS-Kinesis, Amazon-EMR, Python, SQL, AWS, Amazon-SNS, Airflow

### Data Engineer

Banco Bari. Sep 2020 - Aug 2021

```text
• Developed and maintained ETLs using Apache Spark on AWS EMR on EKS orchestrated by Apache Airflow.
• Leader of the data engineering team
• Assisted Data and Analytics Data Lake infrastructure using Terraform, Kubernetes and AWS Services
```

Skills: EMR, Python, SQL, Amazon-EKS, PySpark, SparkSQL, Apache-Spark, Terraform, Airflow

### Data Engineer

Madeira Madeira. Nov 2019 - Sep 2020

```text
• Developed and maintained ETLs and micro services.
• Built the batch side for the data lake using AWS EMR (Apache Spark and Sqoop) clusters to process the data orchestrated with Apache
Airflow.
• Built an automated financial dataset using Python (processing), AWS S3 (storage), AWS Athena (visualization), Apache Airflow (orchestration) running in a docker container on an AWS EC2.
```

Skills: Python, SQL, AWS, Amazon-EMR, Sqoop, PySpark, SparkSQL, Airflow, EC2

### Data Engineering Intern

Madeira Madeira. Aug 2019 - Nov 2019

```text
• Developed automated financial reports using Pentaho Data Integration and auxiliary Python services, automating data extractions
and loads into analytical Excel/CSV spreadsheets.
• Also received training in Data Warehouses, Data Lakes and database modeling
```

Skills: Python, SQL, AWS, Pentaho

### Software Development Intern

Korp ERP. Jul 2018 - Oct 2018

```text
Worked as a back-end developer mainly solving production bugs. Used technologies: Delphi, Microsoft SQL Server, Pascal, Git.
```

Skills: GitHub, Microsoft-SQL-Server

## Tech stack

- Apache Spark
- AWS Glue
- Amazon EC2
- Amazon S3
- PySpark
- Python
- Scala
- Kafka
- Amazon SQS
- Amazon DynamoDB
- AWS Lambda
- Amazon RDS
- Kafka Streams
- Airflow
- Amazon Web Services (AWS)
- Amazon EMR

To contact Jonathan, message them from this profile with a Himalayas employer account: [Hire on Himalayas](https://himalayas.app/hire).

## People also viewed

- [Luan Pieri](https://himalayas.app/@luanpieri): Senior Data Engineer, Guidance
- [Brunno Soares da Silva](https://himalayas.app/@brunnosoaresdasilva): Analytics Specialist, Acelera Educacional
- [Diogo Toledo](https://himalayas.app/@diogotoledo): Data Engineer, Extractta
- [Samuel Alves Tavares](https://himalayas.app/@samuelalvestavares): Senior Data Engineer, Qubika
- [Luis Gustavo de Paula Correa](https://himalayas.app/@luisgustavodepaulaco): Databricks Data Engineer, Santander Bank
- [Herick Almeida de Souza](https://himalayas.app/@herickalmeidadesouza): Senior Data Engineer, DBC Company
- [Gustavo Alves de Oliveira](https://himalayas.app/@gustavoalvesdeolivei): Director of Marketing, APyB
- [Lucas Barros](https://himalayas.app/@lucasoutor): Data Engineer, Pantheon Inc
- [Diego Machado](https://himalayas.app/@diegomachado): Technology & Ops Analyst, Santander Brasil
- [Ray De Souza](https://himalayas.app/@raydesouza): Senior Data Engineer, Fullstack San Antonio
