New on Noahbench ™
GPT 6.1 Sol comes in 1st on the benches.
HOWEVER, i will not be switching to this even though its high on benches. Heres why:
Theres a concept I've been toying with behind "talent" and "smart". Its an odd one but it can be simply understood as "talent is the ability to mechanically perform", "smart is the ability to mechanically perform and understand *why* something is being done".
I think that 6.1 sol is a wonderful refinement on top of 6, however it has not increased its base smarts.
Talented models are the absolute perfect workhorses though, these models are the ones who are cheap to run, can do something when the thinking is done for them, and accomplish the goals.
I am pleased with the release but will not be defaulting to it. Hats off openai!