---
license: apache-2.0
---

Experimental quants of 4 headed mixtrals in various GGUF formats. 

Goal is to have the best performing MoE < 16 Gig . 

They still need training/finetuning