Senior Infrastructure Engineer - AI/ML

At Mitratech, we are a team of technocrats focused on building world-class products that simplify operations in the Legal, Risk, Compliance, and HR functions. We are a close-knit, globally dispersed team that thrives in an ecosystem that supports individual excellence and takes pride in its diverse and inclusive work culture centered around great people practices, learning opportunities, and having fun! Our culture is the ideal blend of entrepreneurial spirit and enterprise investment, enabling the chance to move at a rapid pace with some of the most complex, leading-edge technologies available.For over 35 years, the experts at Mitratech have been focused on solving the complex needs. Today, we serve 20,000 client companies of all sizes globally, representing 30% of the Fortune 500 and over 500,000 users in over 160 countries.As we continue to grow, we’re always looking for resourceful, enthusiastic, and fresh perspectives. Join our global team and see what makes Mitratech a truly exceptional place to work!

Given our continued growth, we always have room for more intellect, energy, and enthusiasm - join our global team and see why it's so special to be a part of Mitratech!

Job Overview

Responsibilities

• Design, deploy, and maintain scalable and secure infrastructure supporting AI and ML workloads.

• Build and maintain AWS cloud environments for compute (EC2, ECS/EKS, Lambda), storage (S3, EFS, FSx), and networking (VPC, Transit Gateway, PrivateLink, Route 53, load balancers).

• Implement security best practices using IAM, KMS, Secrets Manager, GuardDuty, and Security Hub.

• Support and optimize AI/ML workloads across AWS services (SageMaker, Bedrock, Batch, Step Functions).

• Develop and maintain Infrastructure as Code (IaC) using Terraform, AWS CDK, and CloudFormation.

• Manage containerized workloads and orchestration platforms (Docker, EKS, Fargate), including GPU scheduling and scaling.

• Set up and maintain monitoring and observability frameworks using CloudWatch and OpenTelemetry.

• Build and manage CI/CD pipelines (CircleCI, GitHub Actions, GitLab CI) for infrastructure automation and ML/Gen AI deployments.

• Collaborate with ML and Generative AI teams to scale models, optimize performance, and design efficient prompt or inference pipelines.

• Develop runbooks and SOPs for AI service deployment, troubleshooting, and performance optimization.

• Ensure security, compliance, and data protection across AI datasets and environments.

Required Skills & Experience

• Strong proficiency in Linux administration and systems-level troubleshooting.

• Deep expertise in AWS cloud services, with experience in compute, storage, networking, and security domains.

• Proficiency in container orchestration (Kubernetes/EKS) and infrastructure automation tools.

• Hands-on experience with IaC tools such as Terraform, AWS CDK, or CloudFormation.

• Familiarity with monitoring, logging, and observability stacks (Prometheus, Grafana, OpenTelemetry).

• Experience implementing CI/CD pipelines for automated deployment and testing.

• Understanding of AI/ML concepts, including model deployment, inference scaling, and LLM performance tuning.

• Working knowledge of security best practices, IAM roles, encryption, and compliance controls.

• Excellent collaboration and communication skills to partner with ML engineers, data scientists, and product teams.

Education:

• A Master’s degree in Machine Learning, Computer Science with a preference for specialization in the NLP domain.

We are an equal-opportunity employer that values diversity at all levels. All qualified applicants will receive consideration for employment without regard to race, color, religion, gender, national origin, age, sexual orientation, gender identity, disability, or veteran status.