5
LLM with Web Search functionality (lemmy.ml)
submitted 1 month ago by to c/selfhost@lemmy.ml
33 comments fedilink hide all child comments
 

Conducting deep web searches and gathering sources is one of the main things I've been using LLMs for. How far away are we from being able to self-host something like Claude's web search capabilities? Or even just a service where I'd pay with my money instead of my data?

you are viewing a single comment's thread
view the rest of the comments
[–] 2 points 1 month ago

Thank you so so much for pointing out ROCmFP4. I have been tinkering with my RDNA 3 framework on llama. I was struggling with ROCm llama.cpp and have been using vulcan in the meantime. I know there’s some issues on the llama.cpp github to try and fix my issue (UMA stuff), but haven’t come across this specific project. Gonna try it out

  • permalink
  • fedilink
  • source
  • parent