I made a couple more models just for fun. I can’t vouch for the quality, since I didn’t do any tests. Link to the original model and the script with which I created these models:

Himitsui/KuroMitsu-11B: https://huggingface.co/Himitsui/KuroMitsu-11B
FantasiaFoundry/GGUF-Quantization-Script: https://huggingface.co/FantasiaFoundry/GGUF-Quantization-Script

Downloads last month: 19

GGUF

Model size

10.7B params

Architecture

llama

4-bit

5-bit

Inference Examples

Text Generation

Inference API (serverless) is not available, repository is disabled.