AI Evaluation Product Manager
Plaud AI is hiring AI Evaluation Product Manager
Location: Singapore
About Plaud Inc.
Plaud is building the world's most trusted AI work companion for professionals to elevate productivity and performance through note-taking solutions, loved by over 1,000,000 users worldwide since 2023. With a mission to amplify human intelligence, Plaud is building the next-generation intelligence infrastructure and interfaces to capture, extract, and utilize what you say, hear, see, and think.
Plaud Inc. is a Delaware-incorporated, San Francisco-based company pushing the boundary of human–AI intelligence through a hardware–software combination. With ISO 27001, ISO 27701, GDPR, SOC 2, HIPAA, and EN 18031 compliance, Plaud is committed to the highest standards of data security and privacy protection.
To learn more about Plaud, please visit https://www.plaud.ai and follow along on Instagram, X, Facebook, LinkedIn, and YouTube
Why You Should Join Us
Plaud is building the next generation intelligence infrastructure and interfaces to capture, extract, and utilize intelligence from what people say, hear, see, and think.
Plaud is a bootstrapped, skyrocketing, profitable company with a $250M revenue run rate achieved in just three years.
Define the next-gen paradigm for human-AI interaction.
Gain exposure to cutting-edge AI for Pro tools and play a direct role in our global expansion.
Work with passionate teammates who value innovation, collaboration, and customer success.
Grow your career in a culture that champions continuous learning and fast career development.
Market-competitive compensation, global exposure, and a vibrant, creativity-fueled work atmosphere.
What You Will Do
Plaud is building the future of AI-native productivity — where meetings, conversations, and knowledge become an extension of your memory. As the first dedicated owner of Memory Evaluation, you will shape how AI understands, stores and recalls human knowledge for millions of users worldwide.
Define how 'AI memory quality' should be measured for the industry. Turn product goals and real user scenarios into measurable evaluation criteria, evaluation frameworks and reproducible test cases.
Build the global memory evaluation system from the ground up. Create evaluation standards, test pipelines, and datasets across markets (US, EU, Japan, China), working with real multilingual and multimodal data.
Run continuous quality evaluations across Summary, Ask Plaud and other memory-enabled experiences, combining scalable automated workflows with targeted human checks when precision matters.
Become the source of truth for ‘is memory working?’ Your analysis will directly influence product decisions, launch readiness, and go-to-market.
Benchmark against global AI meeting and knowledge products (Otter, Notion AI, NotebookLM, etc.) to extract best practices in memory accuracy, retrieval reliability, and user trust — and convert these insights into scientific evaluation methodology.
Minimum Qualifications
Master's degree or above, preferably in Computer Science, Data Science, AI, or related fields.
3+ years of product experience, with at least 1 year working on AI or LLM-related products or features.
Solid analytical skills and familiarity with data processing (SQL/Python preferred).
Ability to communicate clearly in English and collaborate across product, engineering, and operations.
Strong ownership, structured problem solving, and willingness to learn quickly.
Understanding of English-speaking user scenarios, product expectations, or cultural differences.
Preferred Qualifications
Hands-on experience designing test plans, evaluation standards, or datasets for LLM or AI features.
Familiarity with evaluation of memory-related behaviors (extraction, retrieval, contextual usage), or prior work on summary/Ask AI products.
Experience reviewing real user data and translating findings into actionable product improvements.
Disclaimer: Plaud is and will continue to be an equal opportunity employer. We do not discriminate on the basis of race, religion, color, national origin, sex, sexual orientation, age, veteran status, disability, genetic information, or other applicable legally protected characteristics.