MaziyarPanahi

/

mistral-7b-finetuned-orca-dpo-v2-Mistral-7B-Instruct-v0.2-slerp-GGUF

like 5

what RAG software you use ?
all i tryed is GPT4all and privateGPT, the superbooga extention in obadooga dont work.
you have any suggestion, but i dont want use any accesses or keys and it would be nice if it had a small GUI.

btw all these based models have the knowledge of at least "wiki", so why is it so complicate to add some PDF books to any model, give it a simple way ?

another question, you have any idea what embedings models for RAG are and how the pytorch model is quantized to gguf ?