tabby/crates/llama-cpp-bindings
Meng Zhang 44f013f26e
feat: add /generate and /generate_streaming (#482)
* feat: add generate_stream interface

* extract engine::create_engine

* feat add generate::generate

* support streaming in llama.cpp

* support streaming in ctranslate2

* update

* fix formatting

* refactor: extract helpers functions
2023-09-28 17:20:50 +00:00
..
include feat: implement input truncation for llama-cpp-bindings (#416) 2023-09-09 00:20:51 +08:00
llama.cpp@31e7f3c20e feat: update llama.cpp to fetch latest starcoder support (#452) 2023-09-16 03:41:49 +00:00
src feat: add /generate and /generate_streaming (#482) 2023-09-28 17:20:50 +00:00
Cargo.toml feat: add /generate and /generate_streaming (#482) 2023-09-28 17:20:50 +00:00
build.rs feat: add cargo test to github actions and run only unit tests in ci [TAB-185] (#390) 2023-09-03 05:04:52 +00:00