I love working with hard technical problems, building apps and data pipelines.
Yuri Olive
@yuriolive
Lead Software Engineer with vast experience on building production applications and data pipelines.
BrazilWhat I'm looking for
I'm a Lead Software and Data engineer with vast experience in building applications and data pipelines using Python and Typescript on major Cloud providers (AWS, Google Cloud) using Cloud Native (BigQuery, AWS Redshift, Azure Data Factory, ...) and Cloud Agnostic tools (Snowflake, Databricks, Airflow, ...).
Experience
Lead / Staff Data & Software Engineer
Authority
Feb 2022 - Present (2 years 3 months)
I have been working and leading the construction of the end-to-end data pipeline: dbt to materialize in Snowflake the dimensionally modeled data, Airflow DAGs using Python and Kubernetes to orchestrate the pipeline, infrastructure using Terraform Typescript CDK in GCP, web scrapers using Python (Scrapy), TypeScript GraphQL API using Prisma and Apollo Server, frontend using NextJS and ReactJS.
Data Engineer
McKinsey & Company
Apr 2020 - Sep 2021 (1 year 5 months)
Worked in many projects on digital transformation and analytics. The projects were diversified on all major clouds (AWS, GCP and Azure), languagues (Python and Scala) and tech stacks (Airflow, Databricks, BigQuery, Azure Data Factory, Kedro).
Senior Software & Data Engineer
TRACTIAN
Sep 2021 - Feb 2022 (5 months)
Worked on complete reestructuring the data applications and pipelines. Some technologies used: Python, Flask, AWS ECS, Atlas MongoDB, Blue/Green deployment using AWS CodeDeploy, AstraDB by Datastax (managed Cassandra), AWS MSK (managed Kafka), AWS IAM, AWS SSO, AWS Client VPN.
Data Specialist
Stone Pagamentos
Jul 2019 - Apr 2020 (9 months)
• Worked on building the company data lake in BigQuery, extracting and consolidating the data using Apache Airflow.
• Worked on refactoring the old SQL Server data warehouse to Snowflake using Terraform and Alembic.
• Helped the financial team with the data needed to build the company reports and KPIs.
Tech stack
Learn about the tools and technologies that Yuri likes to use.
Snowflake
Apache Spark
Amazon EC2
Google Cloud Platform
Amazon S3
Google Cloud Storage
Cloudflare
PySpark
dbt
MongoDB
Cassandra
Databricks
Terraform
Python
Kafka
Amazon SQS
MongoDB Atlas
Google App Engine
Amazon RDS for PostgreSQL
Google Cloud Pub/Sub
Amazon RDS
Google Cloud SQL
TypeScript
Amazon VPC
Amazon Managed Apache Cassa...
Google BigQuery
Amazon Web Services (AWS)
Google Cloud Run
Amazon EBS
Availability
Location
Authorized to work in
Social media
Job categories
Interested in hiring Yuri?
You can contact Yuri and thousands of other talented remote workers on Himalayas.
Message YuriFind your dream job
Sign up now and join thousands of other remote workers who receive personalized job alerts, curated job matches, and more for free!