Backend Engineer - AI-Powered Search & Applications

This position is posted by Jobgether on behalf of a partner company. We are currently looking for a Backend Engineer - AI-Powered Search & Applications in India.

This role is ideal for a highly skilled engineer passionate about building scalable backend systems for AI-driven applications. You will design, develop, and optimize microservices and APIs that support large-scale AI products, working closely with ML engineers and data scientists. Your work will ensure fast, cost-efficient, and reliable inference pipelines for LLMs, RAG systems, and multimodal models. Collaborating across global teams, you will deliver robust, production-grade solutions while maintaining high availability, fault tolerance, and operational excellence. This position offers autonomy, technical leadership opportunities, and direct impact on AI products used by millions of users worldwide.

Accountabilities:

• Design, develop, and maintain scalable microservices powering AI-driven search and discovery systems.
• Build backend services and APIs to productionize LLMs, RAG pipelines, and multimodal models.
• Optimize inference pipelines for latency, throughput, and cost efficiency using techniques like batching, caching, and token budgeting.
• Take ownership of end-to-end backend projects, from system design and implementation to deployment and monitoring.
• Collaborate with ML engineers, data scientists, and Product Managers to translate business requirements into technical solutions.
• Implement rigorous testing, fault-tolerant practices, and clear documentation to ensure operational smoothness.
• Perform performance tuning, root cause analysis, and incident response for production services.
• Mentor junior engineers and contribute to a high-performance, collaborative engineering culture.

Requirements

• Bachelor’s or Master’s degree in Computer Science or a related field.
• 4–6 years of backend development experience, ideally with AI or large-scale data systems.
• Proficiency in Java, Golang, or Python, with strong coding and system design fundamentals.
• Experience designing and scaling distributed systems at production scale.
• Exposure to LLM inference setups (e.g., vLLM, Hugging Face Inference, Triton).
• Strong debugging, profiling, and performance tuning skills for latency-sensitive applications.
• Knowledge of storage systems, query optimization, and caching strategies.
• Hands-on experience with AWS (preferred), Kafka, and CI/CD pipelines.
• Ability to work autonomously in fast-paced environments and deliver high-impact solutions.
• Passion for mentoring engineers and fostering a collaborative, growth-oriented culture.

Benefits

• Work on cutting-edge AI problems impacting global sports, media, and entertainment platforms.
• Competitive compensation aligned with global markets.
• Remote-first flexibility with a global engineering culture.
• Annual global off-sites and collaboration with teams from San Francisco, Dubai, and India.
• High autonomy, ownership, and direct accountability in shipping AI systems at scale.
• Opportunity to mentor, grow, and influence technical direction across teams.

Jobgether is a Talent Matching Platform that partners with companies worldwide to efficiently connect top talent with the right opportunities through AI-driven job matching.

When you apply, your profile goes through our AI-powered screening process designed to identify top talent efficiently and fairly.
🔍 Our AI evaluates your CV and LinkedIn profile thoroughly, analyzing your skills, experience, and achievements.
📊 It compares your profile to the job’s core requirements and past success factors to determine your match score.
🎯 Based on this analysis, we automatically shortlist the 3 candidates with the highest match to the role.
🧠 When necessary, our human team may perform an additional manual review to ensure no strong profile is missed.

The process is transparent, skills-based, and free of bias — focusing solely on your fit for the role.
Once the shortlist is completed, we share it directly with the company that owns the job opening. The final decision and next steps (such as interviews or additional assessments) are then made by their internal hiring team.

Thank you for your interest!