Open to opportunities

Jonathan Gonsalves

@jonathangonsalves

Message

I'm a Senior Data Engineer and Associate Director based in Brazil working for BTG Pactual

Brazil

Message

What I'm looking for

I'm looking for a challenging and dynamic work environment that allows me to grow and learn new skills as also opportunities for career advancement and professional development.

Hello, I'm Jonathan but you can call me John! I'm a Senior Data Engineer and Tech Teacher with a BS in Computer Engineering from Positivo University in Curitiba, Brazil.

I have worked for several companies, including e-commerces and fintechs, and currently I work at BTG Pactual Bank, the largest invesment banking in Latin America as an Associate Director and leader of two squads.

I have experience with several programming languages, including Python, and Scala and knowledge on AWS services like DynamoDB, Redshift, EMR, Glue, and others.

I'm also a Learning Facilitator on a Data Engineering boot camp, teaching classes on ingestion and processing pipelines, Apache Airflow, Apache Spark, AWS, Data lakes, and other subjects.

Experience

Current

Senior Data Engineer and Associate Director

Current

BTG Pactual

Aug 2021 - Present (2 years 9 months)

• Leader of two squads: Transactional and Clients Data.
• Responsible for the comunication beetween IT Software teams and Business Managers.
• Built data processing and ingestion pipelines from several data sources (including SNS, RabbitMQ, Relational Databases and others)
• Built Spark Data Quality pipelines using Deequ.
• Developed near-real time pipelines using Spark Streaming

Apache NiFi Pyspark SparkSQL Apache Spark Amazon SQS NiFi AWS Kinesis Amazon EMR Python SQL AWS Amazon SNS Apache Airflow

Data Engineer

Madeira Madeira

Nov 2019 - Sep 2020 (10 months)

• Developed and maintained ETLs and micro services.
• Built the batch side for the data lake using AWS EMR (Apache Spark and Sqoop) clusters to process the data orchestrated with Apache
Airflow.
• Built an automated financial dataset using Python (processing), AWS S3 (storage), AWS Athena (visualization), Apache Airflow (orchestration) running in a docker container on an AWS EC2.

Python SQL AWS Amazon EMR Sqoop Pyspark SparkSQL AWS EC2 Apache Airflow Airflow

Data Engineer

Banco Bari

Sep 2020 - Aug 2021 (11 months)

• Developed and maintained ETLs using Apache Spark on AWS EMR on EKS orchestrated by Apache Airflow.
• Leader of the data engineering team
• Assisted Data and Analytics Data Lake infrastructure using Terraform, Kubernetes and AWS Services

EMR Python SQL Apache Airflow Amazon EKS Pyspark SparkSQL Apache Spark Terraform

Software Development Intern

Korp ERP

Jul 2018 - Oct 2018 (3 months)

Worked as a back-end developer mainly solving production bugs. Used technologies: Delphi, Microsoft SQL Server, Pascal, Git.

GitHub Microsoft SQL Server

Data Engineering Intern

Madeira Madeira

Aug 2019 - Nov 2019 (3 months)

• Developed automated financial reports using Pentaho Data Integration and auxiliary Python services, automating data extractions
and loads into analytical Excel/CSV spreadsheets.
• Also received training in Data Warehouses, Data Lakes and database modeling

Python SQL AWS Pentaho