Meng Zhang
|
0d6840e372
|
feat: support request level stop words (#492)
|
2023-09-29 18:21:57 +00:00 |
|
Meng Zhang
|
44f013f26e
|
feat: add /generate and /generate_streaming (#482)
* feat: add generate_stream interface
* extract engine::create_engine
* feat add generate::generate
* support streaming in llama.cpp
* support streaming in ctranslate2
* update
* fix formatting
* refactor: extract helpers functions
|
2023-09-28 17:20:50 +00:00 |
|
Meng Zhang
|
1ccf9b2323
|
refactor: run make fix
|
2023-09-11 12:58:38 +08:00 |
|
leiwen83
|
e3c4a77fff
|
feat: add support fastchat http bindings (#421)
* feat: add support fastchat http bindings
Signed-off-by: Lei Wen <wenlei03@qiyi.com>
Co-authored-by: Lei Wen <wenlei03@qiyi.com>
|
2023-09-10 22:17:58 +08:00 |
|
Meng Zhang
|
f0ed366420
|
feat: add support vertex-ai http bindings (#419)
* feat: add support vertex-ai http bindings
* support prefix / suffix
|
2023-09-09 11:22:58 +00:00 |
|
Meng Zhang
|
17397c8c8c
|
feat: add http api bindings (#410)
* feat: add http-api-bindings
* feat: add http-api-bindings
* hand max_input_length
* rename
* update
* update
* add examples/simple.rs
* update
* add default value for stop words
* update
* fix lint
* update
|
2023-09-09 03:59:42 +00:00 |