Senior Backend Engineer, ML Indexing Platform (Go/Python/Kubernetes)

About Us

Gramian Consultancy is a boutique consultancy specializing in IT professional services and engineering talent solutions. With a strong background in software engineering and leadership, we help companies build high-performing teams by matching them with professionals who truly fit their needs.

Role overview

We're seeking a talented Senior Backend Engineer to join our Indexing Platform team within the ML organization. In this role, you'll design, build, and maintain high-performance indexing systems that process vast amounts of candidate data in real-time or batch modes—scaling to support large-scale B2C applications with 10M+ daily active users. You'll power critical features like search, ranking, and content understanding, collaborating with backend engineers and MLEs to deliver low-latency, product-focused solutions that drive seamless user experiences.

About the Team

The Indexing Team is part of the ML organization, specializing in indexing: processing massive datasets to enable ranking, search, and more. We handle real-time event processing and asynchronous batch jobs from diverse sources.

We partner closely with backend and ML teams to integrate our Indexing Platform with ML services, ensuring frictionless index creation and top-tier customer experiences.

Our platform fuels high-impact features: enterprise search, user feed ranking, and content understanding— all at B2C scale (10M+ DAU).

Key Responsibilities

• System design. This requires a good understanding of how the systems work, with particular focus on latency and scalability.
• Development. Indexing Platform works mainly with Go and some Python. Skills in testing, SOLID and design patterns are a must.
• Systems architecture. Indexing Platform makes extensive use of Kubernetes, Kafka, Redis and Postgres, and many internal and third party APIs, with focus on resilience, monitoring and alerting, and automation.

Requirements

• Proficiency in Python and Go, OOP, design patterns, and writing clear, testable code.

• Strong expertise in testing (unit, integration, etc.).
• Hands-on experience with Kubernetes, Kafka, Redis (user/admin level).
• Familiarity with AWS and/or Google Cloud for deployment and scaling.
• Experience working on the backends of large-scale B2C applications (10M+ daily active users), optimizing for high throughput and reliability.
• Product engineering experience, with a track record of delivering end-to-end features from design to production.