Hey everyone, I’ve been parsing through the Huggingface website and am having a bit of trouble picking out an LLM inference to help me parse through legal documents. I am not a lawyer, but I would like to understand my rights and how to search for answers to legal questions with concrete answers using an inference.

I have heard a multitude of things around Llama being a privacy nightmare and something about Gerganov ML files? GGMU is also a nebulous term to me and I understand the basics about how a model is trained and validated, but not how to pick one for personal use that isn’t GPT-4.

Any suggestions or things to add on to the discussion?