Technology

hideshow 4 child comments

parent

[–] QuadratureSurfer@lemmy.world 15 points 2 years ago (1 child)

I've got it running with a 3090 and 32GB of RAM.

There are some models that let you run with hybrid system RAM and VRAM (it will just be slower than running it exclusively with VRAM).

hideshow 2 child comments

parent

[–] Deceptichum@kbin.social 16 points 2 years ago (1 child)

Yeah but damn does it get slow.

I always find it interesting how text is so much slower than image generation. I can do a 1024x1024 in probably 20s, but I get like 1 word a second with text.

hideshow 2 child comments

parent

[–] aBundleOfFerrets@sh.itjust.works 5 points 2 years ago

Languages are complex and, more importantly, much less forgiving to error

parent

[–] DarkThoughts@fedia.io 1 point 2 years ago (2 children)

Hopefully we see more specific hardware for this. Like extension cards with pretty much just tensor cores and their own ram.

hideshow 4 child comments

parent

[–] topinambour_rex@lemmy.world 1 point 2 years ago

Graphic cards without video connection exists since a while.

parent

[–] Deceptichum@kbin.social 1 point 2 years ago (2 children)

I’d love to see some consumer level AI stuff, sadly it all seems to be designed for server farms and by the time it ages out into consumer prices it’s so obsolete there’s no point in getting it.