Commit Graph
2 Commits
Author SHA1 Message Date
YuNing Chen 095e5f841d Change the order of tokenizing text. (#267)
A Chinese user may also have english notes, but previous implementation can not handle hyphens and camel case

This commit should fix by changing the order of how tokens are generated
2023-08-02 09:59:30 +02:00
YuNing Chen 2d01cd29ea 1.14.1 (#246) 2023-05-28 08:47:04 +02:00