Software Engineer (AI Tooling and Evaluation)
About Pangram Labs
Pangram Labs’ mission is to protect authenticity by building the world’s best AI detection systems. We publish research on state-of-the-art AI detection techniques and algorithms, and build products to bring our technology into people's daily lives.
We are looking for high agency, mission-driven, and passionate builders to join our team. All roles are in person in Brooklyn, New York.
About the Role
Pangram Labs is hiring an AI Tooling and Evaluation Engineer to join our AI research team. You’ll work directly with AI research scientists and engineers to build internal tools, platforms, and systems that power the model development lifecycle: from data collection and annotation through evaluation and deployment monitoring.
This is a full-stack software engineering role with a research support focus. You will spend most of your time building web applications, APIs, and data pipelines, but you’ll need enough ML fluency to understand what the research team needs and why.
Roles and Responsibilities:
Build evaluation infrastructure for standardized model assessments and sign-off, including dashboards and reporting tools to track performance over time
Maintain Label Studio deployment for data annotation campaigns
Build browser based interfaces for exploratory data analysis on training datasets
Build research support systems to monitor customer usage of the platform
Improve upon and support synthetic data generation workflows
Requirements
B.S. / M.S. equivalent in Computer Science or a related domain
3+ years of experience as a software engineer, with strong full-stack skills
Proficiency in Python and at least 1 modern frontend framework
Experience building internal tools, admin panels, and dashboards
Comfortable with databases, REST APIs, and basic DevOps
Familiarity with ML concepts
Ability to work autonomously and translate ambiguous research needs into concrete software solutions
Nice to have
Experience with ML experiment tracking tools such as Weights & Biases
Experience with Label Studio or other annotation platforms
Background in AI/NLP research
Experience with data visualization libraries
Experience with evaluation and/or QA of large scale ML systems
What we offer
In-person role in our Downtown Brooklyn office, occasional remote work is okay
Flexible hours
About the Team
We are a small, tight-knit team of researchers and engineers who care deeply about our work and each other. We believe that a small group of highly talented, empowered, and efficient people can outperform teams many times their size. Everyone on the team has meaningful ownership over the technical and strategic direction of the company.
Pangram is primarily an in-person company. We are high-touch, high-energy, and extremely collaborative by nature and choose to spend time together to do our best thinking and innovation.