Looking for a job

Yuri Olive

@yuriolive

Message

Lead Software Engineer with vast experience on building production applications and data pipelines.

Brazil

Message

What I'm looking for

I love working with hard technical problems, building apps and data pipelines.

I'm a Lead Software and Data engineer with vast experience in building applications and data pipelines using Python and Typescript on major Cloud providers (AWS, Google Cloud) using Cloud Native (BigQuery, AWS Redshift, Azure Data Factory, ...) and Cloud Agnostic tools (Snowflake, Databricks, Airflow, ...).

Experience

Work history, roles, and key accomplishments

Current

Lead / Staff Data & Software Engineer

Current

Authority

Feb 2022 - Present (3 years 3 months)

I have been working and leading the construction of the end-to-end data pipeline: dbt to materialize in Snowflake the dimensionally modeled data, Airflow DAGs using Python and Kubernetes to orchestrate the pipeline, infrastructure using Terraform Typescript CDK in GCP, web scrapers using Python (Scrapy), TypeScript GraphQL API using Prisma and Apollo Server, frontend using NextJS and ReactJS.

Python Data Engineering DBT Snowflake Terraform

Senior Software & Data Engineer

TRACTIAN

Sep 2021 - Feb 2022 (5 months)

Worked on complete reestructuring the data applications and pipelines. Some technologies used: Python, Flask, AWS ECS, Atlas MongoDB, Blue/Green deployment using AWS CodeDeploy, AstraDB by Datastax (managed Cassandra), AWS MSK (managed Kafka), AWS IAM, AWS SSO, AWS Client VPN.

Cassandra Data Engineering Python Kafka AWS MongoDB MongoDB Atlas

Data Engineer

McKinsey & Company

Apr 2020 - Sep 2021 (1 year 5 months)

Worked in many projects on digital transformation and analytics. The projects were diversified on all major clouds (AWS, GCP and Azure), languagues (Python and Scala) and tech stacks (Airflow, Databricks, BigQuery, Azure Data Factory, Kedro).

Data Engineering Scala Databricks Python Google Cloud Terraform

Data Specialist

Stone Pagamentos

Jul 2019 - Apr 2020 (9 months)

• Worked on building the company data lake in BigQuery, extracting and consolidating the data using Apache Airflow.
• Worked on refactoring the old SQL Server data warehouse to Snowflake using Terraform and Alembic.
• Helped the financial team with the data needed to build the company reports and KPIs.