Which formats and contexts are available?
#2
by
deleted
- opened
Unfortunately, the 128k gguf has been buggy and I haven't gotten around to making it yet. So right now it's just bf16. I'm working on a project to improve this.