Senior Psychometrician
About the Science Team
At the heart of Maki People, the Science team is shaping the future of hiring through innovation, rigour, and collaboration. Led by our Head of Science, Aiden Loe, and working closely with our COO, Paul-Louis Caylar, this team drives the development of high-quality content that sets our platform apart.
We don’t just create and validate assessments—we innovate. Our work spans:
Expanding a cutting-edge library of tests and tools.
Designing bespoke activities and experiences for clients.
Evaluating and refining AI-driven scoring algorithms and large language models (LLMs) to ensure fairness, accuracy, and transparency.
Leveraging psychometric expertise to build reliable, valid, and impactful assessments.
Developing tools that analyze candidate and job data to predict performance and potential with precision.
Supporting clients in using assessment data to optimize their workforce strategies, from talent acquisition to development and retention.
Leading original studies to explore emerging psychological and technological trends and sharing insights through publications, presentations, and client reports.
Collaborating with regulatory bodies and industry leaders to establish new standards in ethical AI use and hiring practices.
Equipping internal teams and clients with the knowledge and skills needed to understand and apply psychological and AI-driven insights effectively.
As Maki continues to grow, the Science team is central to understanding user experiences, refining assessments, and driving broader adoption—all while upholding the highest scientific standards.
Your impact as a Senior Psychometrician will go beyond day-to-day responsibilities— you’ll be a key partner in shaping the future of recruitment while driving exceptional outcomes for our clients.
About the Role
Design, create and validate psychometric assessments optimised for AI integration, ensuring tools are scientifically rigorous and actionable.
Exploring new ways of generating and evaluating assessments by integrating psychometrics with machine learning algorithms.
Perform complex analyses, focusing on item calibration, test equating, norming, distractor analysis, fairness evaluation, reliability and validation studies.
Develop and refine automated scoring algorithms to provide precise and unbiased candidate evaluations.
Monitor assessments for potential bias and ensure adherence to ethical guidelines and best practices.
Conduct research to identify novel psychometric solutions that enhance the functionality and effectiveness of AI-driven talent assessments.
Implement improvements to existing assessments, leveraging the latest psychometric advancements to enhance candidate engagement and experience.
Serve as a thought leader in integrating AI and psychometrics, keeping the team informed about the latest innovations and industry trends.
Develop documentation, including test manuals, technical reports, and white papers, to communicate the scientific foundations, methodologies, and validity evidence of assessments to external stakeholders.
Contribute to developing resources and educational materials that help clients understand AI-enhanced assessments and their implications.
Publish innovative research in high-impact academic journals, and represent Maki People by presenting findings at key conferences.
Collaborate with cross-functional teams, including I/O psychologists, AI researchers, and software developers, to seamlessly embed assessments into our platform.
Translate complex psychometric findings into clear, actionable insights for clients and external partners.
Our Ideal Candidate
Proven academic publication record in psychometrics or related fields, advancing assessment methodologies.
Experience in test design for diverse applications, including custom solutions tailored to client needs.
Ability to design, develop, and implement automated scoring systems, ensuring accuracy and fairness.
Expertise in conducting complex statistical analyses.
Deep knowledge of psychometric methods such as factor analysis, SEM, CTT, IRT, CAT, and test equating.
Experience in AI/ML applications for assessment, such as prediction modelling and person-job fit analysis.
Strong technical documentation and research writing skills.
Robust validation study expertise, ensuring assessment reliability, validity, and practical relevance.
Proficiency in automated item generation and recalibration, optimising item pools.
Strong knowledge on integrating emerging technologies like large language models (LLMs) into psychometric assessment practices
Experience with programming languages such as R, Python, Julia, or similar, and proficiency in statistical software like SPSS, SAS, JASP, Mplus, or equivalent tools.
Good working knowledge of working with cloud databases, such as BigQuery, with expertise in extracting and analysing relevant data.
Additional Expertise
Strong understanding of ethical considerations in data governance, AI fairness, and compliance.
A proven track record in multi-team collaboration, particularly with software developers and content teams.
Skilled in data visualisation and reporting, turning statistical insights into actionable recommendations.
Demonstrated ability to present complex concepts persuasively in business discussions.
Application Process
Stage 1 - Screening assessment (20 mins)
Stage 2 - Hiring manager interview (45 min)
Stage 3 - Power skill assessment with our AI agent (15 min)
Stage 4 - Executive interview (45 min)
Stage 5 - Deep-dive technical interview (60 min)
Stage 6 - Interview with Co-founder (30 min)