As a Data Platform Engineer, you will design and implement a solution that: Periodically indexes Atlan metadata assets into Glean, runs on a configurable schedule (hourly/daily), is production-ready, observable, and maintainable by our DevOps team after handover.
Moreover, ensure compliance and data governance at the appropriate level in line with the company's standards.
Requirements
Platform Engineer (Senior)
Required skills:
Python - advanced
System & Data Integration - advanced
System design - advanced
Kubernetes - regular
Infrastructure mindset - regular
English - advanced
What we expect in general:
We’re looking for a Data Platform Engineer with experience in data platforms and system design at scale. We expect a track record in designing integration architectures for external systems and streamlining data migration/ingestion.
Strong experience with Python (preferred) or Go (acceptable).
Experience with Kubernetes – running, deploying, and operating services in k8s.
Experience building APIs / connectors/integrations between services.
Infrastructure mindset – experience working with and setting up observability.
Background in process automation and scheduled jobs (e.g. Airflow).
Technical writing skills (no AI-generated slop).
Excellent communication skills and a pragmatic approach to problem-solving
Don’t worry if you don’t meet all the requirements. We are looking for mature engineers who are transitioning/navigating between Software Engineering and Data domains. This is a customer-facing role that often requires interactions with stakeholders and multiple teams (presentations, design docs, and coordination).
