you are viewing a single comment's thread
view the rest of the comments
[–] 40 points 1 week ago (1 child)

oh wait, is this this THE sol 5.6? The most amazing model ever with trust me bro benchmarks? The model that is observed cheating more than any previous model? surprised_pikachu.jpg

In all seriousness it never should have production creds anyway. But the fact this is soul sucking openai's newest flagship model with thinking cranked up is the cherry on top. The company that is literally cheating and shortcutting its way ahead produces models in its own image, the sci fi story writes itself.

  • source
  • hideshow 2 child comments
  • [–] 15 points 1 week ago (2 children)

    What evaluation setup lets the thing being tested see the test results and gives access to the test source code?!

    Slop evaluating slop.

  • source
  • parent
  • hideshow 4 child comments