Senior AI Engineer

Abacus Insights is a mission-driven technology company focused on transforming the healthcare data industry, ultimately creating a more personalized patient experience, improving health outcomes, and lowering the overall cost of healthcare. Abacus Insights provides a flexible, efficient, and secure platform that organizes and exchanges healthcare data from various sources and formats, allowing our customers to uncover differentiated insights. In addition, our employees know that they play an active role in keeping our customers' data safe and are responsible for ensuring that our comprehensive policies and practices are met.

With our deep expertise in cloud-enabled technologies and knowledge of the healthcare industry, we have built an innovative data integration and management platform that allows healthcare payers access to data that has been historically siloed and inaccessible. Through our platform, these healthcare organizations can ingest and manage all the data they need to transform their business by supporting their analytical, operational, and financial needs.

Since our founding in 2017, Abacus has built a highly successful SaaS business, raising more than $81 Million from leading VC firms with deep expertise in the healthcare and technology industries. We are solving problems of massive scale and complexity in a sector that is not only ready for disruption. We're growing quickly and would love for you to be a part of it!

About the Team Role :

As a Senior AI Engineer, you will help architect, build and implement our AI platforms, working closely with data quality engineers, data/software engineers, platform engineers, DevOps, product owners and business. You provide technical leadership for multiple, diverse, and geographically distributed teams. You will coach and guide teams to enable future success. Also be a partner with engineering managers, directors and VP on strategic initiatives and future business growth opportunities especially around AI and ensuring the engineering organization can scale to meet the need.

As a member of the engineering team, you are responsible for coaching, mentoring, and driving change to enable us to better deliver and innovate in an agile environment.

You Will:

• Help shape the direction of our applied AI areas and intelligence features in our products. Drive the deployment of state-of-the-art AI models and systems that directly impacts on the capabilities and performance of Abacus’s products and services (e.g., Abacus Agents, MCP, SQL and RAG agents and tools, etc.)
• Develop novel data collection, fine-tuning, and LLM technologies that achieve optimal performance on specific tasks and domains
• Design and implement ML/AI pipelines for data preprocessing, feature engineering, model training, hyperparameter tuning, and model evaluation, enabling rapid experimentation, iteration and self-healing
• Work closely with cross-functional teams, including AI engineers, data engineers, and product teams, to deliver impactful AI solutions that enhance user productivity and satisfaction
• Build scalable, reusable backend systems to support GenAI products across the company. Develop robust logging, telemetry, and evaluation harnesses to ensure reliable model and GenAI system performance
• Skillful at driving critical projects (e.g. AI and data engineering Innovation, Development Productivity and Benchmarking)
• Meaningful experience in the world of Data and AI
• Capable of credible customer interactions
• Mentoring development team members to ensure delivered solutions adhere to the software architecture strategy, coding standards, and established organizational policies and procedures
• Participating in software architectural discussions, influencing decisions, and collaborating with peers to maintain consistency across the organization
• Identifying people and process improvement strategies for the Agile/Scrum team(s), especially for AI projects/teams where innovation and iteration are critical
• Communicate organizational updates to ensure teams adhere to the established policies and procedures
• Ensure projects are completed on time and according to our quality standards
• Facilitates communication upward around architecture, design, and implementation objectives
• Proven experience in leading software development teams or projects
• Excellent knowledge of software development design, QA and test automation, and experience with agile development methodologies
• Demonstrated knowledge of Cloud Architecture, AI Architecture, Agents/Agentic systems, Massive Parallel Processing (MPP) compute frameworks for Data+AI platforms, Security, and MCP/API based services
• Good understanding of Incident Management, Configuration Management, Operational efficiency and Customer Escalation Management preferred. Can manage the balance of deliveries on our roadmap commitments while dealing with interruptions and client escalations
• Good experience with open source
• Coach and mentor software and AI developers, develop staff skills, provide continuous feedback
• Has relentlessly high standards (is never satisfied with the status quo)
• Responsible for protecting, securing, and proper handling of all confidential data held by Abacus to ensure against unauthorized access, improper transmission, and/or unapproved disclosure of information that could result in harm to Abacus or our clients.

What we're looking for:

• Minimum of 3 years of ML/AI engineering experience in high-velocity, high-growth companies. Alternatively, a strong background in relevant ML/AI research in academia will be considered as contributing qualification
• Minimum of 3 years of experience as a software developer at some point in career
• Minimum of 2 years of experience with Databricks, Mosaic AI Gateway and associated technologies in Databricks stack related to Data and AI engineering
• Strong track record of working with language modeling technologies and GenAI. This could include the following: Developing generative and embedding techniques, modern model architectures, fine tuning / pre-training datasets, evaluation benchmarks, Agents and Agentic workflows (e.g. orchestration, workflow management, observability, debugging), RAG, SQL Agents, MCP, etc.
• Proficiency in Python, TensorFlow/PyTorch, and scalable ML/AI architecture
• Ability to drive end-to-end model and system development, from research and prototyping to deployment and monitoring
• Strong analytical and problem-solving skills, with a passion for improving AI-driven user experiences
• Strong coding and software engineering skills, and familiarity with software engineering principles around testing, code reviews and deployment
• Experience and good understanding of designing scalable, distributed systems for running small to medium scale data processing applications and services (10s – 100s of TBs of data)
• Possesses a level of breadth and depth of software and AI development experience that allows for influence and competence in technical discussions with internal and external stakeholders
• Solid understanding of roles adjacent to the software development (product management, project management, client delivery, operations etc.). Ability to adapt to these roles as defined at Abacus and work with others in these roles
• Proven record of success of driving and/or leading engineering teams/projects towards developing production grade systems supporting customers

Nice to Have:

• Snowflake, FHIR, Healthcare Data exposure

Equal Opportunity Employer

As a mission-led technology company helping to drive better healthcare outcomes, Abacus Insights believes that the best innovation and value we can bring to our customers comes from diverse ideas, thoughts, experiences, and perspectives. Therefore, we dedicate resources to building diverse teams and providing equal employment opportunities to all applicants. Abacus prohibits discrimination and harassment regarding race, color, religion, age, sex, national origin, disability status, genetics, protected veteran status, sexual orientation, gender identity or expression, or any other characteristic protected by federal, state, or local laws.