o 4ѹg’ã@s$ddlmZe dd¡dd„ƒZdS)é)ÚtablesZtokenizer_classesÚHuggingfaceTokenizercKs(zddlm}WnY| |¡}|S)Nr)Ú AutoTokenizer)Z transformersrZfrom_pretrained)Zinit_param_pathÚkwargsrÚ tokenizer©rúa/Users/admin/.pyenv/versions/3.10.0/lib/python3.10/site-packages/funasr/tokenizer/hf_tokenizer.pyrs  N)Zfunasr.registerrÚregisterrrrrrÚs