tabby

Commit Graph

Author	SHA1	Message	Date
Meng Zhang	1731c3075e	chore: Update version to 0.2.0	2023-10-03 13:32:21 -07:00
Meng Zhang	692c2fe0fd	Release 0.2.0-rc.0 ctranslate2-bindings@0.2.0-rc.0 http-api-bindings@0.2.0-rc.0 llama-cpp-bindings@0.2.0-rc.0 tabby@0.2.0-rc.0 tabby-common@0.2.0-rc.0 tabby-download@0.2.0-rc.0 tabby-inference@0.2.0-rc.0 tabby-scheduler@0.2.0-rc.0 Generated by cargo-workspaces	2023-10-02 19:14:12 -07:00
Meng Zhang	486e507079	fix: correct Decoding behavior in incremental manner (#491 ) * feat: implement IncrementalDecoding * refactor: use IncrementalDecoding for ctranslate2 * refactor: rename StopWords to DecodingFactory * refactor: move decoding logic to tabby-inference * feat: optimize decoding range * cleanup	2023-09-29 13:06:47 +00:00
Meng Zhang	44f013f26e	feat: add /generate and /generate_streaming (#482 ) * feat: add generate_stream interface * extract engine::create_engine * feat add generate::generate * support streaming in llama.cpp * support streaming in ctranslate2 * update * fix formatting * refactor: extract helpers functions	2023-09-28 17:20:50 +00:00
Meng Zhang	b0074d7e30	feat: support cancellation in llama backend [TAB-146] (#392 ) * feat: support cancellation in llama backend * fix lint	2023-09-03 02:15:54 +00:00
Meng Zhang	3573d4378e	feat: llama.cpp for metal support [TAB-146] (#391 ) * feat: init commit adding llama-cpp-bindings * add llama.cpp submodule * add LlamaEngine to hold llama context / llama model * add cxxbridge * add basic greedy sampling * move files * make compile success * connect TextGeneration with LlamaEngine * experimental support llama.cpp * add metal device * add Accelerate * fix namespace for llama-cpp-bindings * fix lint * move stepping logic to rust * add stop words package * use stop-words in ctranslate2-bindings * use raw string for regex * use Arc<Tokenizer> for sharing tokenizers * refactor: remove useless stop_words_encoding_offset * switch to tokenizers 0.13.4-rc.3 * fix lints in cpp * simplify implementation of greedy decoding * feat: split metal feature for llama backend * add ci * update ci * build tabby bin in ci build	2023-09-03 09:59:07 +08:00

6 Commits (0f8ee7f5897808c28ff903ee1800c13392cebe6d)