Benchmark
A standardized test set for comparing models (MMLU, SWE-bench, GPQA). Useful directionally, but contaminated by training data often enough that your own eval set is the only score that matters.
A standardized test set for comparing models (MMLU, SWE-bench, GPQA). Useful directionally, but contaminated by training data often enough that your own eval set is the only score that matters.