480

Offline version of Chat GPT(lemmy.ml)

posted
by
Avatar
lidd1ejimmy@lemmy.ml
in
Avatar
memes@lemmy.ml
27 comments
hidereport
Sort:
HotTopControversialNewOld
You are viewing a single thread.
View all comments View context
Avatar
Ignotum@lemmy.world
8 points

70b model taking 1.5GB? So 0.02 bit per parameter?

Are you sure you’re not thinking of a heavily quantised and compressed 7b model or something? Ollama llama3 70b is 40GB from what i can find, that’s a lot of DVDs

permalink
report
parent
reply
Avatar
Steve@startrek.website
5 points

For some reason, triple layer writable blu-ray exists. 100GB each

https://www.verbatim.com/prod/optical-media/blu-ray/bd-r-xl-tl/bd-r-xl-tl/

permalink
report
parent
reply
Avatar
9point6@lemmy.world
7 points

Less than half of a BDXL though! The dream still breathes

permalink
report
parent
reply
Avatar
NoiseColor @lemmy.world
9 points

Ah yes probably the Smaler version, your right. Still, a very good llm better than gpt 3

permalink
report
parent
reply

Memes

!memes@lemmy.ml

Create post

Rules:

  1. Be civil and nice.
  2. Try not to excessively repost, as a rule of thumb, wait at least 2 months to do it if you have to.

Community stats

  • 12K

    Monthly active users

  • 5.7K

    Posts

  • 37K

    Comments

Community moderators