⇩ Markdown

diff - pre-deploy evals vs. online monitoring

link not tracked vs. online monitoring

Pre-deploy evals

link not tracked are evals that are run during product development and testing. Ideally they would be link not tracked as part of a deploy-checking process (with the ability to bypass if you want to hurry up the deploy, or if you "know better" and it doesn't seem worthwhile. We could also run these before link not tracked

Online monitoring

online monitoring is a bit of a link not tracked.

It is comprised of operational metrics like cost, latency, etc. However, ideally we would double-check those as part of link not tracked as well.

There are link not tracked like link not tracked and link not tracked