Senior Data Engineer

G2i is working a SR Data Engineer with a three months contract for Hudson Labs, a fast-growing Y-Combinator backed startup working at the intersection of AI and finance. Their main product is an investment research web platform catering to institutional investors, with current customers that include some of the world’s largest hedge funds and pension funds.

We are hiring an experienced Senior Data Engineer on a 3 month contract to help design, implement, and scale our data pipelines. The Data Engineer will play a crucial role in facilitating new feature development and scaling up our operations.

What we need from you -

1. Collaborate with the CTO to design and architect robust and scalable data pipelines.

2. Build real-time streaming and batch systems for data ingestion.

3. Build infrastructure for search systems

4. Scale up existing data transformation pipelines

5. Build developer tools and utility functions

Requirements -

1. Highly experienced in Python programming. Strong fundamentals in data structures and algorithms

2. Experience in PySpark, Airflow, MLFlow or equivalent tools.

3. Familiarity with the AWS ecosystem

4. Strong technical communication skills

5. Experience in building search systems (Optional)

What we provide:

1. Open, low-ego, flexible, and friendly work environment

2. Exposure to cutting edge artificial intelligence research and development

3. Exposure to the world of capital markets and securities regulations.