http://www.orangepi.org/html/hardWare/computerAndMicrocontrollers/details/Orange-Pi-6-Plus.html

https://www.notebookcheck.net/Orange-Pi-6-vs-Raspberry-Pi-45-TOPS-AI-dual-2-5-Gbit-LAN-LPDDR5-and-dual-PCIe-4-SSDs.1323900.0.html

Maybe something like this could work for you? (If you actually can find it in stock anywhere lol)

Ai on arm is getting better and better, ive tried it on a radxa 5b and got almost ok chat speed for an 8b model, and that is only 6 tops