Lead Data Pipeline Engineer

At Two Six Technologies, we build, deploy, and implement innovative products that solve the world’s most complex challenges today. Through unrivaled collaboration and unwavering trust, we push the boundaries of what’s possible to empower our team and support our customers in building a safer global future.

Lead Data Pipeline Engineer

Would you like to use your engineering skills and your experience with machine learning (ML) and large language models (LLMs) to help policy makers, corporate leaders, and operators make sense of increasingly complex information spaces? Are you excited by the possibilities of generative and agentic artificial intelligence? Because Two Six Technologies uses these technologies to provide Information Advantage to Government, Military, and private sector customers tasked with mission critical decision making.

Our products collect, synthesize, and enrich huge quantities of publicly available data, then serve that data to be queried by our expert analysts and to be used in machine learning analytics. As a data pipeline engineer you will work with product engineering teams, data scientists, devops, and architects to integrate data science into our products.

As a top candidate for this role, you are an experienced server-side Python engineer with a history of building products or platforms with integrated ML capabilities. You are very comfortable working with AWS, Linux, and using technologies like Docker and Kubernetes. You also have worked as a member of remote engineering teams in Agile software development environments. You are a good fit if you want to continue to grow your career in the ML space by taking data science and making it available to end users in fast, scalable, and secure applications. This role is right for you if you have managed before, or if you have been a team lead or senior engineer before and are interested in managing a small team of data pipeline engineers while also being a hands-on data pipeline engineer yourself.

Most importantly you share our passion for applying technology to solve hard problems and finding innovative ways to derive insights from high-volume data.

Responsibilities:

Developing and enhancing high-volume data pipelines where data is enriched using ML and NLP functionality, and then used to feed additional machine learning and data science
Integrating models that data science creates into applications that are fast and scalable
Building and enhancing user-facing applications that use generative AI and LLMs to help our customers gain insights from data faster
Operating in a collaborative, agile environment, with a focus on taking action and working closely with peers to enable team success
Creating proofs-of-concept and prototypes to quickly test ideas, as well as designing and building scalable, production-ready solutions
Considering security best practices at every phase of software development

Continuously learning and improving

Working in a fully remote team with a diverse set of skills and experiences
Independently identifying and solving problems, and questioning assumptions in pursuit of the right solutions
Actively participating in the peer code review process
Creating and executing both manual and automated testing
Managing a small team of data pipeline engineers

Qualifications:

Experience building scalable server-side applications and data pipelines using Python
Experience working with ML, LLMs, and collaborating closely with data science teams
Experience with Elastic or similar data stores, as well as with SQL database technologies, ideally Postgres
Experience with AWS or similar cloud-based infrastructure
Experience with the design, development, testing, and support of scalable, data-driven applications deployed to production SaaS environments
Experience working independently and as a part of an Agile team

Optional Skills / Domain Experience

Prior experience as a platform engineer or ML Ops engineer
Experience with processing, storaging, and querying of data in multiple natural languages

Elastic certification

AWS certification

Two Six Technologies is committed to providing competitive and comprehensive compensation packages that reflect the value we place on our employees and their contributions. We believe in rewarding skills, experience, and performance. Our offerings include but are not limited to, medical, dental, and vision insurance, life and disability insurance, retirement benefits, paid leave, tuition assistance and professional development.

The projected salary range listed for this position is annualized. This is a general guideline and not a guarantee of salary. Salary is one component of our total compensation package and the specific salary offered is determined by various factors, including, but not limited to education, experience, knowledge, skills, geographic location, as well as contract specific affordability and organizational requirements.

Looking for other great opportunities? Check out Two Six Technologies Opportunities for all our Company’s current openings!

Ready to make the first move towards growing your career? If so, check out the Two Six Technologies Candidate Journey! This will give you step-by-step directions on applying, what to expect during the application process, information about our rich benefits and perks along with our most frequently asked questions. If you are undecided and would like to learn more about us and how we are contributing to essential missions, check out our Two Six Technologies News page! We share information about the tech world around us and how we are making an impact! Still have questions, no worries! You can reach us at Contact Two Six Technologies. We are happy to connect and cover the information needed to assist you in reaching your next career milestone.

Two Six Technologies is an Equal Opportunity Employer and does not discriminate in employment opportunities or practices based on race (including traits historically associated with race, such as hair texture, hair type and protective hair styles (e.g., braids, twists, locs and twists)), color, religion, national origin, sex (including pregnancy, childbirth or related medical conditions and lactation), sexual orientation, gender identity or expression, age (40 and over), marital status, disability, genetic information, and protected veteran status or any other characteristic protected by applicable federal, state, or local law.

If you are an individual with a disability and would like to request reasonable workplace accommodation for any part of our employment process, please send an email to [email protected]. Information provided will be kept confidential and used only to the extent required to provide needed reasonable accommodations.

Additionally, please be advised that this business uses E-Verify in its hiring practices.

By submitting the following application, I hereby certify that to the best of my knowledge, the information provided is true and accurate.