LM Studio

#1
by drugzncrime - opened

How do i implement the changes to get this running correctlyl in LM Studio?

Lewdiculous's superb gguf version, thank you for your conscientious and responsible dedication.
https://huggingface.co/LWDCLS/DarkIdol-Llama-3.1-8B-Instruct-1.2-Uncensored-GGUF-IQ-Imatrix-Request
mradermacher's superb gguf version, thank you for your conscientious and responsible dedication.
https://huggingface.co/mradermacher/DarkIdol-Llama-3.1-8B-Instruct-1.2-Uncensored-i1-GGUF
https://huggingface.co/mradermacher/DarkIdol-Llama-3.1-8B-Instruct-1.2-Uncensored-GGUF

123.png

124.png

aifeifei798 changed discussion status to closed

Usage
If you are unsure how to use GGUF files, refer to one of TheBloke's READMEs for more details, including on how to concatenate multi-part files.
https://huggingface.co/TheBloke/KafkaLM-70B-German-V0.1-GGUF

hey @aifeifei798 what's the recommended prompt format?

default or LLAMA3 v2

Sign up or log in to comment