Commit Graph

3 Commits

Author SHA1 Message Date
PAB
8087e97a07
MNT Separated vocab file from other files generated (#22) 2023-07-30 23:21:31 +02:00
PAB
5daa570cf2
MNT Add CIs (#20) 2023-07-30 22:26:53 +02:00
PAB
deec6f39e7
MNT Unit tests tokenizer (#18) 2023-07-30 18:04:07 +02:00