Someone made a GPT-like chatbot that runs locally on Raspberry Pi, and you can too
(www.xda-developers.com)
Sorry, I'm just curious in general how fast these local LLMs are. Maybe someone else can give some rough info.
Sorry, I'm just curious in general how fast these local LLMs are. Maybe someone else can give some rough info.