52

Uses for local AI?

posted
by
Avatar
smeeps@lemmy.mtate.me.uk
in
Avatar
selfhosted@lemmy.world
55 comments
hidereport

Im using Ollama on my server with the WebUI. It has no GPU so its not quick to reply but not too slow either.

Im thinking about removing the VM as i just dont use it, are there any good uses or integrations into other apps that might convince me to keep it?

Sort:
HotTopControversialNewOld
You are viewing a single thread.
View all comments View context
Avatar
dwindling7373@feddit.it
3 points

There are a huge number of vastly better solutions to get that…

permalink
report
parent
reply
Avatar
Aquila@sh.itjust.works
1 point

Such as…?

permalink
report
parent
reply
Avatar
dwindling7373@feddit.it
7 points

A privacy respecting search engine.

permalink
report
parent
reply
Avatar
AustralianSimon@lemmy.world
1 point

Duckduckgo or SearX

permalink
report
parent
reply
Avatar
umami_wasabi@lemmy.ml
3 points

IMO LLMs are ok to get a head start of searching. Like got a vague idea of something but don’t know the exact keywords. LLMs can help and use the output on whatever search engine you like. This saves a lots of time tinkering the right keywords.

permalink
report
parent
reply
Avatar
dwindling7373@feddit.it
0 points

Sure, or you could send an email to the leading international institution on the matter to get a very accurate answer!

Is it the most reasonable course of action? No. Is it more reasonable than waste a gazillion Watt so you can maybe get some better keywords to then paste in a search engine? Yes.

permalink
report
parent
reply
Avatar
kitnaht@lemmy.world
1 point

Once the model is trained, the electricity that it uses is trivial. LLMs can run on a local GPU. So you’re completely wrong.

permalink
report
parent
reply
Show more comments

Selfhosted

!selfhosted@lemmy.world

Create post

A place to share alternatives to popular online services that can be self-hosted without giving up privacy or locking you into a service you don’t control.

Rules:

  1. Be civil: we’re here to support and learn from one another. Insults won’t be tolerated. Flame wars are frowned upon.

  2. No spam posting.

  3. Posts have to be centered around self-hosting. There are other communities for discussing hardware or home computing. If it’s not obvious why your post topic revolves around selfhosting, please include details to make it clear.

  4. Don’t duplicate the full text of your blog or github here. Just post the link for folks to click.

  5. Submission headline should match the article title (don’t cherry-pick information from the title to fit your agenda).

  6. No trolling.

Resources:

Any issues on the community? Report it using the report flag.

Questions? DM the mods!

Community stats

  • 3.4K

    Monthly active users

  • 1.6K

    Posts

  • 14K

    Comments

Community moderators