differentiable

Backlinks

why give evals a different name than just tests?

The thing you're testing, though it is closely tied to AI functionality, is likely a compound system and the evals, if they're not pass-fail, may be differentiable and could act as a sort of loss function on that compound system.

see in context