instructlab
/

granite-7b-lab-GGUF

text-generation-inference

Inference Endpoints

Model card Files Files and versions Community

granite-7b-lab-GGUF / config.json

xukai92's picture

feat: 4-bit quantized model

1344fef 5 months ago

history blame contribute delete

No virus

30 Bytes

	{
	"model_type": "llama"
	}