internlm2-chat-20b-sft / tokenization_internlm2_fast.py

Commit History

fast tokenizer and stream_chat fix
b81b872
verified

x54-729 commited on