TheBloke
/

Mixtral-8x7B-Instruct-v0.1-GPTQ

Text Generation

text-generation-inference

4-bit precision

Model card Files Files and versions Community

fix config.json, "modules_in_block_to_quantize" array close syntax

#16

by sandeshrajx - opened Mar 28

base: refs/heads/main

←

from: refs/pr/16

Discussion Files changed

This PR is in draft mode

Files changed (0) hide show