what is the right tokenizer should I use for llama 3.1 8B?

#19

by calebl - opened Jul 23

calebl

Jul 23

what is the right tokenizer should I use for llama 3.1 8B?

kmtao

Jul 23

use meta-llama/Meta-Llama-3.1-8B-Instruct, tested on my machine.

Jul 24

it seems that the apply_chat_template for the tokenizer is weird, it seems to add on extra assistant response indicator

Upload images, audio, and videos by dragging in the text input, pasting, or clicking here.

Tap or paste here to upload images

· Sign up or log in to comment