cross-posted from: https://lemm.ee/post/53805638

you are viewing a single comment's thread
view the rest of the comments
[–] 2 points 2 years ago (1 child)

That's becoming less true. The cost of inference has been rising with bigger models, and even more so with "reasoning models".

Regardless, at the scale of 100M users, big one-off costs start looking small.

  • source
  • parent
  • hideshow 2 child comments