Skip to main content
Joao SousaJS
Open to opportunities

Joao Sousa

@joaosousa1

Senior Data Engineer at Kantar Worldpanel who cut Spark processing from 52 hours to 1 hour and monthly platform costs by over 80%.

Portugal
Message

At Kantar Worldpanel, I optimized legacy Spark pipelines, cutting processing time from 52 hours to 1 hour and monthly platform costs from $30,000 to $5,000. I also refactored the cloud data architecture, reducing storage costs by 70%.

At DEUS, I architected and migrated legacy infrastructure to a Medallion data platform on AWS and Databricks. I engineered ingestion pipelines for terabyte-scale data and established data governance with Unity Catalog and Delta Sharing.

At BMW GROUP, I designed an API ingestion framework that processed 2.5 million requests and introduced Apache Iceberg to the project. Earlier, as a Data Analyst at Continental Mabor, I developed Power BI reports and used statistical analysis to identify root causes of tire defects.

Experience

Work history, roles, and key accomplishments

KW
Current

Senior Data Engineer

Kantar Worldpanel

Feb 2025 - Present (1 year 8 months)

Optimized legacy Spark pipelines, reducing processing times from 52 hours to 1 hour and monthly platform costs from $30,000 to $5,000. Refactored cloud data architecture, reducing storage costs by 70% while maintaining high data availability.

BMW Group logoBG

Data Engineer

May 2023 - Jan 2024 (8 months)

Designed and implemented a high-throughput API ingestion framework using OOP Python and AWS, processing 2.5 million requests at scale. Engineered scalable data pipelines from BMW Data Mesh and introduced Apache Iceberg for optimized storage.

ME

Data Engineer

Metyis

Aug 2022 - Apr 2023 (8 months)

Completed intensive Azure Data Engineering training and delivered foundational data projects. Designed and implemented end-to-end data pipelines for an e-commerce consulting client using Python, SQL, Databricks, and PySpark.

CM

Data Analyst

Continental Mabor

Feb 2022 - Jul 2022 (5 months)

Developed automated Power BI reports and dashboards using SQL and Python to monitor manufacturing quality KPIs. Conducted statistical analysis to identify root causes of tire defects.

Education

Degrees, certifications, and relevant coursework

IA

ISEP Academy

AWS Solutions Architect Training Course, Cloud Architecture

2023 - 2023

AWS Solutions Architect Training Course completed in 2023.

Universidade do Minho logoUM

Universidade do Minho

Integrated Master's, Industrial Engineering and Management

2017 - 2022

Integrated Master's in Industrial Engineering and Management from Universidade do Minho, completed in 2022.

Interested in hiring Joao?

You can contact Joao and 90k+ other talented remote workers on Himalayas.

Message Joao

People also viewed

View all talent

Get matched with your dream remote job

Sign up now and join over 250,000+ remote workers who receive personalized job alerts, curated job matches, and more for free!

Sign up
Himalayas profile for an example user named Frankie Sullivan