root
/
tabby
mirror of https://gitee.com/zhang_1334717033/tabby.git
1
0
Fork 0
Code Issues Packages Projects Releases Wiki Activity
tabby/crates/tabby-download/src
History
Meng Zhang 296342efd8
refactor: use llama.cpp tokenizer (#683) 
* refactor: switch to llama.cpp tokenizer to simplify implementation

* refactor: remove tokenizer dependency from tabby

* refactor: renaming decoding to stop condition

* refactor: remove tokenizer dependency

* refactor: remove submodule

* chore: update formatting

* move tokenization to c++
 		2023-10-31 22:16:09 +00:00
..
registry feat: support ModelScope for model registry downloading (#477) 2023-09-26 11:52:11 -07:00
cache_info.rs feat: support ModelScope for model registry downloading (#477) 2023-09-26 11:52:11 -07:00
lib.rs refactor: use llama.cpp tokenizer (#683) 2023-10-31 22:16:09 +00:00