
Guilherme Almeida dos Santos
@guilhermealmeidadoss
Data Engineer at Marlabs, developing Scala and Spark pipelines for XML and semi-structured data in cloud data lakes.
What I'm looking for
At Marlabs, I develop Scala and Spark ingestion pipelines for XML and semi-structured data. I also maintain Java endpoints and work with Spark Streaming, Delta Lake, and EMR to support data processing and business use.
At LM Soluções de Mobilidade, I built and deployed an AWS data lake architecture spanning ingestion, processing, orchestration, and analytical layers. I developed PySpark workflows to transform, validate, and version data across silver and gold layers.
Across roles at Compass UOL, MaisTODOS, Kroton, and Semantix, I’ve worked on data pipelines, cloud workflows, data quality, and governance. I use tools including Python, SQL, Spark, Airflow, Terraform, and dbt to make data more reliable and useful for analytical consumption.
Experience
Work history, roles, and key accomplishments
Developed data ingestion pipelines using Scala and Spark to process XML files and semi-structured data. Built and maintained Java endpoints and created reports to support data processing and business consumption. Developed features to support alphanumeric CNPJ processing rules and adapt pipelines to regulatory data changes. Worked with Spark Streaming for data ingestion and processing workflows. U
Data Engineer
LM Soluções de Mobilidade
Oct 2024 - Jun 2025 (8 months)
Built and deployed the company’s data lake architecture on AWS, covering ingestion, processing, orchestration and analytical layers.
Implemented daily data replication using AWS DMS, organizing raw data into structured layers for downstream processing.
Developed PySpark pipelines to transform, validate and version data across silver and gold layers.
Helped define the data architecture and technica
Data Engineer
Compass UOL
Jan 2024 - Oct 2024 (9 months)
Data Engineering / Big Data Processing:
Developed data pipelines using Spark and Delta Lake, focused on processing large volumes of data for analytical use cases.
Built automated ingestion mechanisms using custom Python classes, reducing manual effort and improving data availability.
Worked with AWS services such as S3 and DynamoDB to store data, metadata and dynamic pipeline configurations.
Impl
Data Engineer
MaisTODOS
Jan 2023 - Nov 2023 (10 months)
Data Platform / Data Governance:
Worked on the implementation and management of data quality and data catalog initiatives, supporting better data reliability and discoverability.
Developed SQL-based statistical processes to evaluate data quality and monitor consistency across data assets.
Helped keep data catalog and incident management systems synchronized, improving visibility over data issues
Data Engineer
Kroton
Jun 2020 - Nov 2022 (2 years 5 months)
Data Pipelines / Analytics Engineering:
Developed and maintained data pipelines using Python, Spark and SQL, supporting the creation of analytical datasets for business teams.
Monitored Airflow DAGs and helped ensure the stability of scheduled data processes.
Converted business rules and SQL logic into PySpark jobs for scalable data processing.
Contributed to data modeling activities, including e
Engenheiro de dados
Semantix
Jan 2018 - Apr 2019 (1 year 3 months)
Big Data / Hadoop Ecosystem:
Worked on data engineering projects for large clients in the financial and retail sectors.
Built and maintained batch data pipelines using PySpark and Hive in Hadoop-based environments.
Processed raw data from structured and semi-structured sources, preparing it for analytical consumption.
Developed scripts for batch processing, data validation and client-specific bus
Durante meu estágio na Vivo, tive o primeiro contato real com o universo de dados em grande escala. Trabalhei com rotinas de ingestão, limpeza e transformação de dados, atuando diretamente no suporte e manutenção de pipelines internos da área de Business Analytics.
Acompanhava a movimentação de grandes volumes de dados com scripts em SQL e Python, além de gerar relatórios recorrentes para áreas d
Education
Degrees, certifications, and relevant coursework
Uninove - Universidade Nove de Julho
Bachelor's degree, System Information
2015 - 2018
Tech stack
Software and tools used professionally
Airbyte
Apache Spark
AWS Glue
Amazon EC2
Amazon S3
AWS Step Functions
GitHub
GitLab
SonarQube
GitHub Actions
PySpark
dbt
PostgreSQL
Oracle
Hadoop
Databricks
Terraform
AWS CloudFormation
Jira
Python
JSON
Scala
Amazon SQS
Amazon DynamoDB
Confluence
AWS Lambda
Git
Docker
Amazon VPC
Amazon EMR
Amazon Athena
SQL
Amazon ECR
Delta Lake
OpenMetadata
AWS
REST APIs
Availability
Location
Authorized to work in
Salary expectations
Social media
Job categories
Interested in hiring Guilherme?
You can contact Guilherme and 600K+ other talented remote workers on Himalayas.
Message GuilhermeGet matched with your dream remote job
Sign up now and join over 1,000,000+ remote workers who receive personalized job alerts, curated job matches, and more for free!
