xAI

xAI

Posted via Greenhouse

Software Engineer - Evals

Posted Aug 5, 2026

Role at a glance

Salary
$175K – $275K/yr
Location
Palo Alto, California, United States
Work arrangement
On-site
Employment
Full-time

Spotted an issue?

We’ll check it against the original posting.

Log in to report

Role Summary

AI-generated

The role owns and elevates SpaceXAI’s mission-critical research platform for the evals team, which measures model capabilities and behaviors, supports dataset cleaning and experiment feedback, and tracks growth throughout training. The engineer will build systems used by researchers and engineers to diagnose agent failures and improve AI systems.

What You'll Do

  • Design, build, and ship mission-critical research platform systems
  • Create and execute instruments for measuring model capabilities and behaviors
  • Use evaluation instruments to clean datasets and provide feedback for experiments
  • Track model growth throughout training
  • Diagnose why agents fail and identify short- and long-term improvements
  • Manage execution infrastructure and design datasets and grading schemes

Generated from the employer's posting. Verify important details before applying.

View full posting

Qualifications

Software engineering proficiency; 3+ years of experience actively writing code; track record of shipping high quality projects; strong sense of urgency; exceptional product taste; ability to translate quality, helpfulness, truthfulness, and safety into concrete, measurable criteria; strong attention to detail.

Required

  • Software engineering proficiency
  • 3+ years of experience actively writing code
  • Track record of shipping high quality projects
  • Strong sense of urgency
  • Exceptional product taste
  • Ability to translate quality, helpfulness, truthfulness, and safety into concrete, measurable criteria
  • Strong attention to detail

Preferred

  • Previously founded a startup or joined a fast-growing early-stage startup
  • Familiarity with AI/ML workflows, annotation tools, or evals
  • Experience creating and maintaining component libraries, design systems, or internal tools

Original job description

Content provided by the employer

SpaceXAI’s mission is to create AI systems that can accurately understand the universe and aid humanity in its pursuit of knowledge. Our team is small, highly motivated, and focused on engineering excellence. This organization is for individuals who appreciate challenging themselves and thrive on curiosity. We operate with a flat organizational structure. All employees are expected to be hands-on and to contribute directly to the company’s mission. Leadership is given to those who show initiative and consistently deliver excellence. Work ethic and strong prioritization skills are important. All employees are expected to have strong communication skills. They should be able to concisely and accurately share knowledge with their teammates.

You will own and elevate our mission-critical research platform that directly accelerates SpaceXAI's frontier work.

The evals team creates and executes instruments for measuring model capabilities and behaviors. These instruments are used to clean datasets, provide feedback for experiments, and track growth throughout training. The evals team also diagnoses why agents fail and how to make improvements both short and long term. We manage the execution infrastructure, design data sets and grading schemes.

You will design, build, and ship delightful and bulletproof systems that engineers love to use every day. This role values a strong attention to details, first principles reasoning, and great taste.  

We are open to all levels from new grads to senior engineers.

Requirements

  • Software engineering proficiency and 3+ years of experience actively writing code.
  • A track record of shipping high quality projects and a strong sense of urgency.
  • Exceptional product taste -  you have a sharp sense for what “good” looks like in outputs, and you can translate fuzzy notions of quality, helpfulness, truthfulness, and safety into concrete, measurable criteria.
  • Strong attention to detail.

Bonus Points

  • Previously founded a startup or joined a fast-growing early-stage startup.
  • Familiarity with AI/ML workflows, annotation tools, or evals.
  • Experience creating and maintaining component libraries, design systems, or internal tools.

COMPENSATION AND BENEFITS:

$175,000 - $275,000 USD

Base salary is just one part of our total rewards package at SpaceXAI, which also includes equity, comprehensive medical, vision, and dental coverage, access to a 401(k) retirement plan, short & long-term disability insurance, life insurance, and various other discounts and perks.

SpaceXAI is an equal opportunity employer. For details on data processing, view our Recruitment Privacy Notice.

xAI

About the company

xAI

Large Enterprise

xAI is a cutting-edge technology company focused on developing advanced artificial intelligence solutions to enhance human capabilities and optimize decision-making processes. Founded by a team of leading experts in AI and machine learning, xAI aims to address complex challenges across various industries, including healthcare, finance, and transportation. By prioritizing ethical AI development, the company is committed to creating innovative tools that empower organizations to harness the full potential of artificial intelligence while ensuring transparency and accountability.