Commit Graph
1 Commits
Author SHA1 Message Date
Aiden LiuandGitHub c4211a0b09 feat: enable search optimized tokenizer for Chinese (#370)
* feat: enable search optimized tokenizer for Chinese

* docs: update readme on CJK support
2024-05-07 17:58:01 +02:00