llm2vec-da-mntp / tokenizer_config.json

Commit History

Changed EOS token to end_of_text to follow LLM2Vec
447ce2b
verified

jealk commited on

Updated padding side to "left"
fc6f018
verified

jealk commited on

Training in progress, step 2
eaf4fcb
verified

jealk commited on

Updated EOS token to left padding and <end_of_text>
5096219
verified

jealk commited on

tokenizer config from llama-swe last training
3f022f7
verified

jealk commited on