Needle in a haystack
The eval that hides a fact in a long context and asks the model to find it. Vendors ace the synthetic version; real-world long-context recall remains messier.
The eval that hides a fact in a long context and asks the model to find it. Vendors ace the synthetic version; real-world long-context recall remains messier.