Add more quants

README.md

@@ -7,17 +7,18 @@ tags:
 - mergekit
 - merge
 license: cc-by-nc-4.0
+pipeline_tag: text-generation
 ---
 # kuno-kunoichi-v1-DPO-v2-SLERP-7B-GGUF
 
-This is a Q8_0 GGUF quant of [kuno-kunoichi-v1-DPO-v2-SLERP-7B](https://huggingface.co/grimjim/kuno-kunoichi-v1-DPO-v2-SLERP-7B).
+This repo contains GGUF quants of [kuno-kunoichi-v1-DPO-v2-SLERP-7B](https://huggingface.co/grimjim/kuno-kunoichi-v1-DPO-v2-SLERP-7B).
 
 kuno-kunoichi-v1-DPO-v2-SLERP-7B is a merge of pre-trained language models created using [mergekit](https://github.com/cg123/mergekit).
-I'm hoping that the result is more robust against errors or when merging due to "denseness", as the two models likely implement comparable reasoning at least somewhat differently.
+The expectation is that the result is more robust against errors or when merging due to "denseness", as the two models likely implement comparable reasoning at least somewhat differently.
 
-I've performed some testing with ChatML format prompting using temperature=1.1 and minP=0.03. The model also supports Alpaca format prompts.
+Tested lightly with ChatML instruct format prompting using temperature=1.1 and minP=0.03. The model natively supports Alpaca format prompts.
 
-[GGUF-IQ-Imatrix quants helpfully provided by Lewdiculous.](https://huggingface.co/Lewdiculous/kuno-kunoichi-v1-DPO-v2-SLERP-7B-GGUF-IQ-Imatrix)
+- [GGUF-IQ-Imatrix quants helpfully provided by Lewdiculous.](https://huggingface.co/Lewdiculous/kuno-kunoichi-v1-DPO-v2-SLERP-7B-GGUF-IQ-Imatrix)
 
 ## Merge Details
 ### Merge Method

kuno-kunoichi-v1-DPO-v2-SLERP-7B.Q4_K_M.gguf

@@ -0,0 +1,3 @@
+version https://git-lfs.github.com/spec/v1
+oid sha256:c078fe9f13144262977eb171e10ea7fe7e76a7e16958b4f4966724848dc9302a
+size 4368439040

kuno-kunoichi-v1-DPO-v2-SLERP-7B.Q5_K_M.gguf

@@ -0,0 +1,3 @@
+version https://git-lfs.github.com/spec/v1
+oid sha256:1e3f5182fc815f7f7ac7a23af7d15e807de4564a2ad861e0cc3bbad9621821f0
+size 5131409152

kuno-kunoichi-v1-DPO-v2-SLERP-7B.Q6_K.gguf

@@ -0,0 +1,3 @@
+version https://git-lfs.github.com/spec/v1
+oid sha256:6c111adef3b639c923179f9a8f981a4411b90a8fd42573fc190bae55ebc1e5d0
+size 5942064896

kuno-kunoichi-v1-DPO-v2-SLERP-7B.Q8_0.gguf

@@ -1,3 +1,3 @@
 version https://git-lfs.github.com/spec/v1
-oid sha256:a39bb5da986ec3c5566fa43fe00323a408ebbcb3c4e82db4acd92dfea00e048c
+oid sha256:865e4c2d55c8c293b6c718218c90ca2748ccb16174b445c585959990afa492d7
 size 7695857376