Synced from Ashby · Mar 31

AI / Eval Engineer

Vera HealthSan FranciscoPosted Mar 31, 2026
AI EngineerOn-siteMid
Apply nowSave & get alerts

Mirrored from Vera Health's own Ashby careers system · refreshed hourly

10
Other open Vera Health roles
Mar 31
Posted
Ashby
Applicant system
Job description

About Vera Health

Vera is the fastest-growing clinical app for healthcare professionals in the world. Five people built it.

We’re already operating at a scale most teams never reach, with a team most people would think is too small to pull it off. That’s by design. Everyone here runs at a level that compresses what would normally take entire teams. We keep it that way by only hiring people who raise the standard the moment they join.

We’re building the founding team. The people who join now will define how this company operates for the next decade, and shape the future of healthcare.

We move at a pace that feels unreasonable to most, and completely natural to the right people. If that pace feels natural to you, you belong here.

The Role

You can’t improve what you can’t measure.

Every answer on Vera is a clinical decision being made by a clinician. That’s the bar. Not “mostly correct,” not “good on average.” We need to know exactly how the Vera behaves, where it holds up, where it breaks, and why. Think of the system like a chessboard with millions of different combinations. Different models, prompts, retrieval strategies, ranking, parameters, all interacting at once. Your job is to understand that space and push it in the right direction by optimizing every part of it, down to the smallest parameter.

This isn’t about writing eval scripts and calling it done. It’s about going a step further, understanding how the system behaves across specialties, clinical contexts, and edge cases, and improving it so that answers hold up no matter the setting.

You’ll be working on a complex search and reasoning engine, where the goal is simple but hard: make it better for every question, every specialty, every clinical setting.

We’re building something that doesn’t exist yet.

What You’ll Do

  • Optimize every layer of the system, from model behavior to retrieval to ranking to the smallest parameters

  • Take a system with thousands of moving parts and figure out which ones actually drive better answers

  • Push performance forward by testing, breaking, and refining how outputs are generated

  • Go deep on failures, not just what went wrong, but what pattern it reveals

  • Tune how the system behaves across different specialties, question types, and edge cases

  • Work directly with the founders on the highest-leverage improvements

  • Work with leading healthcare institutions to validate how the system performs in practice

What We’re Looking For

  • You don’t trust outputs you can’t explain

  • You care about being right, not just being close

  • You like working in messy spaces where there’s no obvious path

  • You move fast, but you don’t compromise when the stakes are high

  • You have strong technical depth in LLMs, search, or similar systems

  • You’re excited to work at the edge of what’s currently being done

How we work

Ship, then improve. We get things in front of users fast and let real feedback drive iteration. A feature in production teaches you more than a month of planning.

Own it completely. There's no handoff culture here. You take a problem and see it through, from first principles to production.

Always look out for the user. Every decision comes back to the clinician on the other end. If it doesn't make their day better, it doesn't ship.

Why Vera

  • Rocketship traction: 100%+ MoM growth, built by a team of 5

  • Real impact: Every feature you build helps clinicians make better decisions and save lives

  • Best time to join: We’ve just raised our Series A and are entering the most important phase of the company, where a small team defines everything that comes next

Details

  • Location: San Francisco (strongly preferred). For exceptional candidates, remote or relocation support (O-1A / H-1B sponsorship) available.

  • Compensation: Competitive salary + meaningful early-stage equity. Details shared in process.

  • Employment: Full-time

View original posting on Ashby

What applying to Vera Health usually looks like

Based on publicly available information, candidates applying through Ashby can generally expect a structured and relatively streamlined process, as this ATS commonly supports organized application tracking, automated acknowledgments, and standardized candidate communications. For roles such as those at Vera Health, applicants may encounter an initial application review, followed by recruiter or hiring manager screening, and the process may include multiple stages such as technical or role-specific assessments, panel interviews, and final conversations with leadership, depending on the position. Response times vary and are not guaranteed by the platform itself. Candidates should typically ensure their resumes are well-formatted and tailored, as Ashby's system often parses resumes for keyword matching. Communication is commonly delivered via email, and applicants may be asked to complete supplementary forms or work samples depending on the role type.

Based on publicly available information. LandEarly does not verify interview process details.

Land this one early - before the req fills.

LandEarly tailors your resume and screening answers to each posting, submits while the role is still new, and tracks every application in one place.

Set up in minutes · Cancel anytime · No contract

Keep exploring

What this role pays, where else it is open, and how to write the application.

AI / Eval Engineer
Vera Health · San Francisco
Apply