4 Commits

Author	SHA1	Message	Date
leejet	2e79a82f85	refactor: reorganize code and use c api (#133)	2024-01-01 16:22:18 +08:00
leejet	8f6b4a39d6	fix: enhance the tokenizer's handing of Unicode (#120)	2023-12-21 00:22:03 +08:00
Kreijstal	9842a3f819	fix: add support for int32_t on other compilers (#114)	2023-12-11 23:32:39 +08:00
leejet	d7af2c2ba9	feat: load weights from safetensors and ckpt (#101)	2023-12-03 15:47:20 +08:00