non-determinism

Backlinks

LLMs are like pure functions

^ link not tracked are like link not trackeds (except that they have non-determinism)

see in context
Nondeterministic Idempotence - NDI

^ non-determinism idempotence

see in context
deterministic

Opposite of non-determinism

see in context
why give evals a different name than just tests?

The subtle ways in which things fail requires more examples than typical tests. You can only gain real confidence with scale.
...
non-determinism

see in context