Im trying to figure out how online search funkcion works… Didnt have much luck for now. And also general discusion about the app would be wery helpfull for eweryone.
Im trying to figure out how online search funkcion works… Didnt have much luck for now. And also general discusion about the app would be wery helpfull for eweryone.
Taking advantage of the fact that this thread became popular, question to all of you guys: do you recommend some other open source LLM front ends?
https://anythingllm.com/
LM Studio is by far my favorite. Supports all GPUs out of the box on Linux and has tons of options.
LM studio is not open source at all.
Looks like you’re right.
I switched to it when Alpaca stopped working on AMD GPUs and was under the impression it is open source.
The engine is, the UI isn’t. Easy to make the mistake.
Depending on how you had it installed, Alpaca split support in the Flatpaks.
If you want AMD support, you need to install
com.jeffser.Alpaca.Plugins.AMDDoesn’t work for me unfortunately, always falls back to CPU ever since the packages were split up.
I was using LibreChat for a while
I have made good experiences with GPT4ALL
So far i’ve really liked just using ollama in the terminal since it just spits out text anyway.
ofc I could even send raw api requests, but sometimes it’s good to have a nice GUI that “just works”.
Specifically I’m looking for something that could handle not only text responses, but also attachments, speech recognition and MCP support.
Yeah in that case you probably want something else. So far i’ve only ever used it for text based questions. I think i remember seeing that there is also a webui out there but i don’t remember the name.