3 Commits

Author	SHA1	Message	Date
PAB	8087e97a07	MNT Separated vocab file from other files generated (#22)	2023-07-30 23:21:31 +02:00
PAB	5daa570cf2	MNT Add CIs (#20)	2023-07-30 22:26:53 +02:00
PAB	deec6f39e7	MNT Unit tests tokenizer (#18)	2023-07-30 18:04:07 +02:00