you are viewing a single comment's thread
view the rest of the comments
[–] -3 points 2 years ago (2 children)

The local versions I've tested out today are absolutely garbage. It frustrated me over simple questions.

  • source
  • hideshow 4 child comments
  • [–] 3 points 2 years ago* (1 child)

    I know it's not DeepSeek, but this is what I got out of the Reasoner V1 model in GPT4All ("Based on Qwen2.5-Coder 7B"). Use local models with care!

  • source
  • parent
  • hideshow 2 child comments
  • [–] 1 point 2 years ago (1 child)

    Such convincing gaslighting. I’m too lazy to look, but was Gomer Pyle a cameo/guest on that episode of the simpsons? or is it just total hallucination?

  • source
  • parent
  • hideshow 2 child comments
  • [–] 3 points 2 years ago

    I wouldn't call it gaslighting or even hallucination, but just getting things mixed up. I described Bart Simpson and asked if it could tell me which character from which show I meant. There is a Gomer Pyle who appears in several episodes of the Simpsons and does have pointy hair. I'm pretty sure he doesn't wear a helmet and bandana. But Gomer Pyle is also a figure in the Andy Griffith Show and Gomer Pyle USMC, which aired in the 60s.

  • source
  • parent
  • [–] 2 points 2 years ago (1 child)

    Why is that? I mean why does the locally run version suck?

  • source
  • parent
  • hideshow 2 child comments
  • [–] 1 point 2 years ago

    Because it has fewer parameters and (in some cases) it's quantized. The hardware needed to run local inference on the full model is not really feasible to most people. Though, the release of it will probably still make a wide impact on the quality of other upcoming smaller models being distilled from it, or trained on synthetic data from it, or merged with it, etc.

  • source
  • parent