root
/
tabby
mirror of https://gitee.com/zhang_1334717033/tabby.git
1
0
Fork 0
Code Issues Packages Projects Releases Wiki Activity
tabby/crates/tabby-inference
History
Meng Zhang 44f013f26e
feat: add /generate and /generate_streaming (#482) 
* feat: add generate_stream interface

* extract engine::create_engine

* feat add generate::generate

* support streaming in llama.cpp

* support streaming in ctranslate2

* update

* fix formatting

* refactor: extract helpers functions
 		2023-09-28 17:20:50 +00:00
..
src feat: add /generate and /generate_streaming (#482) 2023-09-28 17:20:50 +00:00
Cargo.toml feat: add /generate and /generate_streaming (#482) 2023-09-28 17:20:50 +00:00