tabby/crates/ctranslate2-bindings
Meng Zhang 44f013f26e
feat: add /generate and /generate_streaming (#482)
* feat: add generate_stream interface

* extract engine::create_engine

* feat add generate::generate

* support streaming in llama.cpp

* support streaming in ctranslate2

* update

* fix formatting

* refactor: extract helpers functions
2023-09-28 17:20:50 +00:00
..
CTranslate2@8bcbeb6ff9 feat: bump ctranslate2 to HEAD 2023-09-16 02:40:23 +08:00
cmake support static linking of ctranslate2 (#148) 2023-05-26 21:34:31 -07:00
include feat: support set compute_type through commandline arguments 2023-06-13 12:04:07 -07:00
src feat: add /generate and /generate_streaming (#482) 2023-09-28 17:20:50 +00:00
.gitignore support static linking of ctranslate2 (#148) 2023-05-26 21:34:31 -07:00
CMakeLists.txt chore: build with ruy (cpu only) on static mode for linux. (#378) 2023-08-30 18:04:40 +08:00
Cargo.toml feat: add /generate and /generate_streaming (#482) 2023-09-28 17:20:50 +00:00
build.rs fix: switch default running backend to openblas on x86 linux (#380) 2023-08-30 14:19:35 +00:00