nisten
/

quad-mixtrals-gguf

Model card Files Files and versions Community

quad-mixtrals-gguf / README.md

nisten's picture

Update README.md

9768c6c 9 months ago

|

No virus

185 Bytes

	---
	license: apache-2.0
	---

	Experimental quants of 4 headed mixtrals in various GGUF formats.

	Goal is to have the best performing MoE < 16 Gig .

	They still need training/finetuning