351
The AI bubble is so big it's propping up the US economy (for now) (www.bloodinthemachine.com)
submitted 1 year ago by to c/technology@lemmy.world
124 comments fedilink hide all child comments
you are viewing a single comment's thread
view the rest of the comments
[–] 2 points 1 year ago* (1 child)

It's too small.

IDK what your platform is, but have you tried Qwen3 A3B? Or smallthinker 21B?

https://huggingface.co/PowerInfer/SmallThinker-21BA3B-Instruct

The speed should be somewhat similar.

  • permalink
  • fedilink
  • source
  • parent
  • hideshow 2 child comments
    •
  • [–] 1 point 1 year ago (1 child)

    Qwen3 8B sorry, Idiot spelling. I use it to talk about problems when I have no internet or maxed out on Claude. I can rarely trust it with anything reasoning related, it's faster and easier to do most things myself.

  • permalink
  • fedilink
  • source
  • parent
  • hideshow 2 child comments
    •
  • [–] 3 points 1 year ago*

    Yeah, 7B models are just not quite there.

    There are tons of places to get free access to bigger models. I'd suggest Jamba, Kimi, Deepseek Chat, and Google AI Studio, and the new GLM chat app: https://chat.z.ai/

    And depending on your hardware, you can probably run better MoEs at the speed of 8Bs. Qwen3 30B is so much smarter its not even funny, and faster on CPU.

  • permalink
  • fedilink
  • source
  • parent