grimulkan
/

lzlv-longLORA-70b-rope8-32k-6bpw-h8-exl2

Text Generation

text-generation-inference

Inference Endpoints

Model card Files Files and versions Community

Edit model card

This is an EXL2 6-bit quantization of lzlv-longLORA-70b-rope8-32k-fp16

Downloads last month: 5

Inference Examples

Text Generation

Inference API (serverless) is not available, repository is disabled.