GGUF?
#2
by
idling117
- opened
Will there be a GGUF version like v1.0?
yes, quants are ready, enjoy: TeeZee/DarkForest-20B-v2.0-GGUF
Just a heads up I also uploaded a few weighted importance matrix quants for this model. Not meant to replace existing GGUFs but increment with the new types.
https://huggingface.co/InferenceIllusionist/DarkForest-20B-v2.0-iMat-GGUF
awesome, thank you!