Assistant Manager - AI Research

Role Overview: We are hiring an LLMOps Engineer to join our AI Research team, a highly technical group working on cutting-edge advancements in the AI industry. The team focuses on building scalable, production-grade LLM systems, fine-tuning strategies, evaluation frameworks, and next-generation deployment architectures.

This role requires hands-on experience operating LLMs beyond simple API integration. The ideal candidate understands the architectural, operational, and evaluation complexities that differentiate LLMOps from traditional MLOps.

Responsibilities:- 

1. Manage the end-to-end lifecycle of LLMs: registry, packaging, versioning, deployment, monitoring, and rollback.
2. Deploy and operate self-hosted / open-source LLMs (not limited to OpenAI API usage).
3. Design and manage scalable inference infrastructure, including GPU-aware deployments.
4. Implement CI/CD pipelines for LLM deployment and continuous evaluation.
5. Monitor system performance including latency, throughput, token usage, cost, drift (model and data), and hallucinations.
6. Ensure secure, compliant, and resilient cloud-based model deployments.
7. Collaborate with research and engineering for deployments.

Skills:-

1. Strong hands-on experience with LLM handling, hosting, and operationalization.
2. Clear understanding of how LLMOps differs from traditional MLOps (prompt management, non-deterministic outputs, semantic evaluation, token economics, guardrails etc.).
3. Experience with Kubernetes, Docker, and containerized deployments.
4. Cloud expertise (AWS / Azure / GCP) including compute, storage, IAM, networking, and monitoring.
5. Experience building scalable inference and model-serving architectures.
6. Familiarity with tools such as MLflow, Kubeflow etc. (good to have).
7. Understanding of vector databases, RAG systems, and evaluation frameworks (preferred).
8. Knowledge of GenAI security considerations (prompt injection, data leakage prevention).

Qualifications

1. Bachelor’s degree in Computer Science, Engineering, or related field.DevOps certification (e.g., AWS DevOps Engineer, Azure DevOps, or equivalent).
2. 3–5 years of experience in MLOps, LLMOps, ML Engineering, or related roles.
3. Bachelor’s or master’s degree in computer science, Artificial Intelligence, Data Science, or a related technical field.
4. Demonstrated experience deploying ML/LLM systems in production environments.