Xiaomi-Robotics-U0 / tokenizer_config.json
sakuta-mai's picture
Add files using upload-large-folder tool
b1cae36 verified
Raw
History Blame Contribute Delete
186 Bytes
{
"model_max_length": 1000000000000000000,
"tokenizer_class": "UNISTokenizer",
"auto_map": {
"AutoTokenizer": [
"tokenization_unis.UNISTokenizer",
null
]
}
}