TheBloke

/

zephyr-7B-alpha-GGUF

like 138

Good day,

Thank you for sharing your interesting work! I was following the code example for ctranfomers but couldn't get the LLM to generate due to this error: " CUDA error 222 at D:\a\ctransformers\ctransformers\models\ggml\ggml-cuda.cu:6045: the provided PTX was compiled with an unsupported toolchain."

I've asked on the ctransformers github but got no responses so far :( Would you have any suggestions?

Thanks so much!