Discussion about this post

User's avatar
Abhishek Pan's avatar

Kimi going from 3 points behind to 12 just because the index leaned harder on held-out tests is a good reason to keep a private set of your own. A few hundred real production prompts that never end up in a prompt example or a fine-tune will tell you more before a model switch than any public leaderboard.

Ready for more?