pszemraj
/

Mistral-7B-v0.3-prune6

Text Generation

text-generation-inference

Inference Endpoints

Model card Files Files and versions Community

Mistral-7B-v0.3-prune6 / mergekit_config.yml

pszemraj's picture

Upload folder using huggingface_hub

ee294e9 verified 4 months ago

No virus

196 Bytes

	dtype: bfloat16
	merge_method: passthrough
	slices:
	- sources:
	- layer_range: [0, 22]
	model: mistralai/Mistral-7B-v0.3
	- sources:
	- layer_range: [28, 32]
	model: mistralai/Mistral-7B-v0.3