Dashboard
Checked on their board 16 Nov

cleara Hiring now

Research Engineer, Benchmarks

Builds tests that check how AI agents do real work. You'd design benchmarks with domain experts and run them at scale.

$100K–$170K a yearSingapore, SingaporeFull-timePosted 5 days ago

About the role

From cleara's posting on Ashby, as they wrote it

About the Role

Join a small, technical AI evaluation team building rigorous benchmarks for frontier AI agents. You will own the design and implementation of domain-specific evaluations that help research teams and customers understand how agents perform on realistic workflows.

What You'll Do

  • Design, implement, and maintain internal benchmarks for evaluating frontier agents on domain-specific tasks.
  • Partner with subject-matter experts to translate real-world workflows into benchmark tasks and evaluation criteria.
  • Build reliable infrastructure to run models and agents against benchmark tasks at scale.
  • Develop metrics and analyses to assess benchmark difficulty, reliability, and failure modes.
  • Validate whether benchmark results align with real-world evaluations and user needs.
  • Write clear technical documentation and reports explaining benchmark methods and results.

What We're Looking For

  • Two to four years of experience in software engineering, machine learning engineering, or research engineering, including at least two years building AI benchmarks, evaluation infrastructure, or agent environments.
  • Technical education or strong fundamentals in a technical field.
  • Proficiency with Python, Docker, and Linux for research or production infrastructure.
  • Hands-on experience designing and operating evaluations or environments for AI agents or large language models.
  • Experience building reliable model or agent execution infrastructure, developing evaluation metrics or statistical analyses, and validating benchmark performance.
  • Ability to work with subject-matter experts and understand workflows across technical or business domains.
  • Strong technical writing, attention to detail, independent problem-solving, and comfort in an early-stage environment.
  • Published research or technical writing on AI benchmarks, evaluation methods, or model failure modes is valued. Reinforcement learning pipelines, data generation, and agent evaluation experience are also relevant.

Compensation & Benefits

Base salary: $100,000 to $170,000 USD annually. Visa sponsorship is available.

Location

On-site in Singapore, Singapore.

Live on cleara's board as of 16 Nov. We check it every day.

Apply on Ashby ↗

Usually 5 stages over about 21 days at tech companies with more than 200 people. The hiring manager is the one to reach first.

  1. Stage 1RecruiterRecruiter Screen · 30 min
  2. Stage 2Hiring managerHiring Manager Screen · 45 min
  3. Stage 3Senior IC or tech leadTechnical Interview · 60 min
  4. Stage 4Multiple team membersPanel Interview · 90 min
  5. Stage 5VP or DirectorExecutive/Final Round · 45 min

More roles at cleara

All 147 roles →

The company

About cleara

Similar roles