diff - pre-deploy evals vs. online monitoring
link not tracked vs. online monitoring
Pre-deploy evals
link not tracked are evals that are run during product development and testing. Ideally they would be link not tracked as part of a deploy-checking process (with the ability to bypass if you want to hurry up the deploy, or if you "know better" and it doesn't seem worthwhile. We could also run these before link not tracked
Online monitoring
online monitoring is a bit of a link not tracked.
It is comprised of operational metrics like cost, latency, etc. However, ideally we would double-check those as part of link not tracked as well.
There are link not tracked like link not tracked and link not tracked