Edit model card

LocalAI-Llama3.1-8b-Function-Call-v0.3

local-ai-banner.png

LocalAIFCALL

This model is a fine-tune on a custom dataset + glaive to work specifically and leverage all the LocalAI features of constrained grammar.

Specifically, the model once enters in tools mode will always reply with JSON.

Downloads last month
7
Safetensors
Model size
8.03B params
Tensor type
BF16
·
Inference Examples
Inference API (serverless) is not available, repository is disabled.

Model tree for mudler/LocalAI-Llama3.1-8b-Function-Call-v0.3

Quantizations
2 models