5 Commits (nightly)

Author	SHA1	Message	Date
Meng Zhang	296342efd8	refactor: use llama.cpp tokenizer (#683) ... * refactor: switch to llama.cpp tokenizer to simplify implementation * refactor: remove tokenizer dependency from tabby * refactor: renaming decoding to stop condition * refactor: remove tokenizer dependency * refactor: remove submodule * chore: update formatting * move tokenization to c++	2023-10-31 22:16:09 +00:00
Meng Zhang	c8339a2912	refactor: use TabbyML/llama.cpp submodule	2023-09-03 12:38:54 +08:00
Meng Zhang	d4137463ef	remove llama.cpp submodule	2023-09-03 10:04:26 +08:00
Meng Zhang	3573d4378e	feat: llama.cpp for metal support [TAB-146] (#391) ... * feat: init commit adding llama-cpp-bindings * add llama.cpp submodule * add LlamaEngine to hold llama context / llama model * add cxxbridge * add basic greedy sampling * move files * make compile success * connect TextGeneration with LlamaEngine * experimental support llama.cpp * add metal device * add Accelerate * fix namespace for llama-cpp-bindings * fix lint * move stepping logic to rust * add stop words package * use stop-words in ctranslate2-bindings * use raw string for regex * use Arc<Tokenizer> for sharing tokenizers * refactor: remove useless stop_words_encoding_offset * switch to tokenizers 0.13.4-rc.3 * fix lints in cpp * simplify implementation of greedy decoding * feat: split metal feature for llama backend * add ci * update ci * build tabby bin in ci build	2023-09-03 09:59:07 +08:00
Meng Zhang	a2476af373	add ctranslate2-bindings / tabby rust packages (#146) ... * add ctranslate2-bindings * add fixme for linux build * turn off shared lib * add tabby-cli	2023-05-25 14:05:28 -07:00