Senior Data Engineer - Contractor

Senior Data Engineer

Beyond is a technology consultancy helping organizations thrive in a rapidly changing world.

We build, modernize, scale, and operationalize technology, creating Cloud and AI solutions to unlock productivity and drive growth for our customers.

Role Overview

Beyond is seeking a highly skilled and motivated Senior Data Engineer to join our team in Europe.

You will be part of a team of Machine Learning, MLOps, and Data Engineers, working on an exciting project to develop a real-time data analytics platform.

Responsibilities:

• Data Pipeline Architecture: Design and implement scalable and efficient data pipelines to handle large volumes of real-time data.
• Data Ingestion and Processing: Develop and maintain robust data ingestion and processing frameworks using Kafka Connect, Kafka, and Clickhouse.
• Data Modeling and Storage: Design and implement appropriate data models and storage solutions to support real-time analytics and AI.
• Performance Optimization: Continuously monitor and optimize data pipelines for performance, scalability, and reliability.
• Collaboration: Work closely with Machine Learning Engineers and Data Analysts to ensure seamless integration of data pipelines with AI/ML models and visualisation tools.

Required Skills and Experience:

• Technologies:

• Data Streaming: Kafka Connect, Kafka, Pulsar
• Data Warehousing: Clickhouse, Snowflake, BigQuery, BigTable, Cassandra
• AI Analytics: Vertex AI, bicycle.ai, Cosmos.ai or similar tools
• Data Visualization: Looker, Tableau, Power BI
• Cloud Computing: Google Cloud Platform, AWS, Azure
• Programming Languages Frameworks: Python, Spark, Flink, Scala, SQL
• Data Modeling: Dimensional modeling, data warehousing methodologies

• Professional and Soft Skills:

• Experience: Minimum of 5 years of experience in data engineering roles, with a strong focus on real-time data analytics.
• Communication Skills: High proficiency in English (both written and oral).
• Agile Development: Familiarity with agile development methodologies, such as Scrum or Kanban, is helpful for working in a fast-paced, iterative environment.
• Education: Bachelor's degree in Computer Science, Engineering, or a related field. A Master's degree is highly desirable.
• Problem-Solving Skills: Strong capability in identifying issues and formulating effective solutions.
• Certifications: Relevant certifications in data engineering and cloud technologies are highly desirable.

Having been named among Sunday Times Best 100 Companies, we believe culture plays a large role in what we offer as an organization. We actively promote diversity in all its forms across our Studios and we proudly, passionately, and proactively strive to create a culture of inclusivity and openness for all our employees.

Beyond is committed to welcoming everyone, regardless of gender identity, orientation, or expression. Our mission is to remove exclusivity and barriers and encourage new thinking and perceptions, in a space of belonging. It is not about race, gender, or age, it is about people. And without our people being their most creative and innovative selves, we are nothing.