India onlyWe are looking for a Mid-level Data Engineer to join a small, focused team building and maintaining a production-grade financial data processing platform for the Abu Dhabi Securities Exchange (ADX).
Requirements
- Build and maintain ETL pipelines that ingest daily Excel/CSV trade files, transform and validate the data, and persist it to PostgreSQL
- Design and evolve database schemas using SQLAlchemy ORM and Alembic migrations
- Implement business logic services: shareholder balance tracking, sharebook reconciliation, movement detection, classification rules
- Maintain and extend Elasticsearch sync services (incremental and full resync workflows)
- Support business stakeholders with data questions using the ELK stack — writing and running queries, interpreting results, and surfacing relevant data from Kibana
- Parse and process structured financial data files (Excel, CSV) using Pandas, including data validation and deduplication
- Write robust, type-safe Python following project standards (mypy strict mode, Black, isort)
- Write and maintain automated tests with pytest — unit tests, repository mocks, snapshot tests
- Collaborate with the CTO on data flow design and review migration strategies before deployment
Benefits
- Health insurance
Kuwait