DevOps Engineer - Ruby

Taraki is a Pakistani recruitment technology platform that connects job seekers with employers through an AI-powered marketplace and digital identity tools.

Taraki

Employee count: 11-50

United States only

Stay safe on Himalayas

Never send money to companies. Jobs on Himalayas will never require payment from applicants.

[b][u]Role Overview [/u][/b]As our DevOps Engineer, you will own the infrastructure that powers Ruby AI’s products. You’ll work closely with backend, frontend, and AI engineering teams to build reliable, secure, and scalable systems. This is a hands-on role where you’ll set up infrastructure from the ground up, establish CI/CD practices, implement monitoring, and ensure our payment and data systems meet security and compliance standards. [b][u]Key Responsibilities[/u][/b][b]Infrastructure Setup & Scaling [/b]• Design, provision, and manage AWS infrastructure (EC2, ECS/EKS, VPC, IAM, Lambda, S3) for all Ruby AI services. • Implement Infrastructure as Code (IaC) using Terraform, CloudFormation, or AWS CDK for repeatable, version-controlled provisioning. • Architect auto-scaling strategies to handle variable workloads, particularly around LLM API traffic patterns. • Manage and optimize Cassandra clusters and PostgreSQL (with pgvector) for performance, replication, and high availability. [b]Security & Compliance [/b]• Harden infrastructure security including network segmentation, firewall rules, and least-privilege IAM policies. • Implement secrets management (AWS Secrets Manager, HashiCorp Vault, or Sealed Secrets) for LLM API keys and payment credentials. • Ensure PCI-DSS compliance considerations for the payment system, including encryption at rest and in transit. • Conduct regular security audits and vulnerability assessments of deployed infrastructure.[b]Monitoring & Observability[/b]• Build a comprehensive observability stack (Prometheus, Grafana, ELK/Loki, CloudWatch) covering all services and databases. • Set up alerting for critical metrics: API latency, database health, LLM API error rates, cost anomalies, and payment system uptime. • Implement distributed tracing to debug performance issues across microservices. • Create dashboards for LLM API usage tracking and cost monitoring across OpenAI, Gemini, and Anthropic. [b]CI/CD & Deployment Automation[/b]• Design and maintain CI/CD pipelines (GitHub Actions, GitLab CI, or Jenkins) for backend, frontend, and AI services. • Implement blue-green or canary deployment strategies for zero-downtime releases. • Containerize services using Docker and manage orchestration with Kubernetes or ECS. • Manage environment separation (development, staging, production) with automated promotion workflows[b]Collaboration & Reliability[/b]• Work with backend, frontend, and AI engineers to establish deployment workflows and release governance. • Build and maintain disaster recovery plans, backup strategies, and runbooks for incident response. • Drive on-call culture and incident management processes as the team scales.[b]Required Qualifications[/b] • 3–5 years of hands-on DevOps, SRE, or Infrastructure Engineering experience. • Strong AWS expertise: VPC, EC2, ECS/EKS, IAM, Lambda, CloudWatch, S3, RDS. • Proficiency with Infrastructure as Code: Terraform, CloudFormation, or AWS CDK. • Solid experience with Docker and container orchestration (Kubernetes preferred). • Experience managing relational databases (PostgreSQL) and distributed databases (Cassandra, DynamoDB, or similar). • Hands-on experience building CI/CD pipelines with GitHub Actions, GitLab CI, or Jenkins. • Strong knowledge of monitoring and logging tools: Prometheus, Grafana, ELK stack, or similar. • Understanding of networking: VPC design, subnetting, load balancers, DNS, and SSL/TLS. • Familiarity with secrets management and security best practices. • Strong Linux administration and scripting skills (Bash, Python)[b]Nice to Have[/b] • Experience with pgvector or vector database operations for AI/ML workloads. • Familiarity with LLM API integration patterns, rate limiting, and cost optimization. • Experience with GPU instance management or ML model serving infrastructure. • Exposure to service mesh technologies (Istio, Linkerd). • Experience with payment system infrastructure and PCI-DSS compliance. • Cassandra cluster management experience (repair, compaction, replication tuning)[b]What We Offer[/b] • Work with founders who have seen it all from idea to IPO, being early at Snowflake. Built multiple venture backed startups with exits to Snowflake and Private Equity funds. • The company is backed by tier 1 funds like Flybridge and Inovia Capital. • Focus on craft: We value curiosity, clarity, and craft — and we’re looking for engineers who care about solving real problems with elegant, reliable code. • Make an impact: You’ll be part of a small team and have an outsized impact. • Be valued: We offer highly market-competitive compensation

Apply now

Please let Taraki know you found this job on Himalayas. This helps us grow!

Apply now

About the job

Apply before

May 24, 2026

Posted on

Mar 25, 2026

Job type

Full Time

Experience level

Mid-level

Experience

3 years minimum

Location requirements

United States

Hiring timezones

United States +/- 0 hours

About Taraki

Learn more about Taraki and their company culture.

View company profile

Taraki is a recruitment technology company and job marketplace headquartered in Lahore, Pakistan. Founded in 2021, the company operates a digital platform designed to modernize the hiring process for both employers and job seekers within the region. Taraki's primary mission is to bridge the gap between talent and opportunity by replacing traditional, manual recruitment methods with efficient, technology-driven solutions. The platform caters to a diverse range of industries, facilitating connections for semi-skilled workers as well as white-collar professionals.

The company utilizes a suite of digital tools, including an AI-powered matching engine, to streamline candidate discovery and evaluation. For job seekers, Taraki offers features such as digital identity creation and professional networking capabilities, allowing individuals to build verified profiles and apply for positions with greater ease. For employers and recruiters, the platform provides an applicant tracking system (ATS) and recruitment marketing tools to manage pipelines, screen applicants, and reduce time-to-hire. By leveraging artificial intelligence and a user-centric design, Taraki aims to create a ubiquitous career and HR ecosystem that enhances economic mobility and workforce efficiency across Pakistan.

Tech stack

Learn about the tools and technologies that Taraki uses to build, market, and sell its products.

View tech stack

Node.js

SQL

React

Framer

Bubble

Webflow

Taraki employees can create an account to update this tech stack.

Employee benefits

Learn about the employee benefits and perks provided at Taraki.

View benefits

Casual dress code

A casual wear policy is in place for the office environment.

Hybrid work model

The company supports a mix of work-from-home and in-office work.

Internship programs

Opportunities for internships in software development and other fields.

Co-working space

The team operates out of a co-working space, providing a collaborative environment.

View Taraki's employee benefits

Apply now

Please let Taraki know you found this job on Himalayas. This helps us grow!

Apply now