14 points
*
It’s available through ollama already. i am running the 8b model on my little server with it’s 3070 as of right now.
It’s really impressive for a 8b model
1 point
Yup, 8GB card
Its my old one from the gaming PC after switching to AMD.
It now serves as my little AI hub and whisper server for home assistant
1 point
What the heck is whisper? Ive been fooling around with hass for ages, haven’t heard of it even after at least two minutes of searching. Is it openai affiliated hardwae?