you are viewing a single comment's thread
view the rest of the comments
[–] 13 points 1 month ago (1 child)

I tried it, had to VPN in to do so but I tried it. I gave it 5 tasks, it succeeded in 2 of them, rest were hallucinations. so...yeah...guess it's much better than Opus.

  • source
  • parent
  • hideshow 2 child comments
  • [–] 0 points 1 month ago (1 child)

    rest were hallucinations

    I'm having trouble parsing whatcha mean here if they were coding tasks. The code didn't run? Ran but had 0 functionality? If they were non-coding tasks, then agreed, I didn't notice it being significantly more accurate. Though I did appreciate the larger vocab. I wasn't gonna be able to afford to keep using it once it went to API pricing anyway.

  • source
  • parent
  • hideshow 2 child comments
  • [–] 6 points 1 month ago

    sorry should have been more specific. it was a mix of coding and non-coding. 1 coding task ran fine, another one just didn't work at all. one was a basic walk through tutorial type task that was accurate, the others were hallucinations.

  • source
  • parent