Senior Data Engineer

• Working with stakeholders to grow the amount and kinds of customer-defined targetings we can calculate in real-time
• Develop new features for our in-house streaming key/value DBs
• Improve resource utilization across all stages of our data pipelines, from validation and ingestion to storage to dynamic queries
• Collaborate with developers and stakeholders to design services in order to meet product and business requirements

Requirements

• Fluent in Go, C++ or similar languages
• You have significant exposure to Kafka as data processing system
• Strong experience in working within distributed, event-driven system with a focus on real-time processing and observability
• Handled several high-dimensional, high-cardinality, from high-level entity modeling and pipeline design to low-level problems of representation and query access patterns
• You have seen through an entire program development lifecycle, from feature conception to deployment and monitoring

We use the following tech-stack:

• Spark and HDFS on Cloudera
• Java 11+ and Go services running via on-prem Kubernetes
• protobuf and gRPC
• Kafka 3, with Kafka Streams and Sarama
• LSM-based key/value stores e.g. RocksDB
• OLAP-focused relational stores e.g. ClickHouse

Benefits

• A chance to be a part of a casual but professional environment where you will have a safe place to try, fail and learn
• Have full ownership over your code
• Coaching from our tech leads to advance your soft and technical skills and set your own development path
• Defined and organized the onboarding process for both, the company and the project
• Competitive compensation depending on experience and skills
• Private pension and medical insurance for you and your family. Also, maternity and sick leave are 100% paid
• Sport clubs – from fishing to basketball, whatever rocks your boat
• Awesome referral fees - because great people know great people
• Work-life balance – this is the company that really supports your professional, family and personal goals
• Freedom to decide how you want to work - partly or fully remote or from our offices.