how to use it?
#1
by
milan-terawe
- opened
how to use it with llama.cpp or LMstudio, or Jan?
This is just the LLM part of the model. The actual speech part is another model, and it requires special inferencing to get the two to work. Not even sure why there's quants of this model.