Engenharia de Dados PL/SR - 131289

A Data Engineering PL/SR professional will design, build and maintain scalable and resilient data pipelines, working with large volumes of structured and unstructured data. The role requires experience with data engineering in distributed environments, knowledge of Apache Spark and Scala, and experience with AWS, including Glue, S3, EMR, Athena, and Redshift.

Requirements

• Experience with data engineering in distributed environments
• Knowledge of Apache Spark and Scala
• Experience with AWS (Glue, S3, EMR, Athena, Redshift etc.)
• Knowledge of data modeling, ETL/ELT and data pipelines
• Familiarity with relational and NoSQL databases
• Experience with batch and streaming processing
• Experience with Apache Kafka or Amazon MSK
• Knowledge of modernization of legacy systems
• Experience with Delta Lake, Apache Hudi or Iceberg
• Familiarity with data CI/CD (dbt, Airflow, Terraform)

Benefits

• None mentioned