8 Commits (63612d5a676c205c20175efb034352e2b8b65597)

Author	SHA1	Message	Date
Meng Zhang	f05dd3a2f6	refactor: cleanup chat api make it message oriented (#497) ... * refactor: refactor into /chat/completions api * Revert "feat: support request level stop words (#492)" This reverts commit 0d6840e372. * feat: adjust interface * switch interface in tabby-playground * move to chat/prompt, add unit test * update interface	2023-10-02 15:39:15 +00:00
Meng Zhang	0d6840e372	feat: support request level stop words (#492)	2023-09-29 18:21:57 +00:00
Meng Zhang	44f013f26e	feat: add /generate and /generate_streaming (#482) ... * feat: add generate_stream interface * extract engine::create_engine * feat add generate::generate * support streaming in llama.cpp * support streaming in ctranslate2 * update * fix formatting * refactor: extract helpers functions	2023-09-28 17:20:50 +00:00
Meng Zhang	d42942c379	feat: support ModelScope for model registry downloading (#477) ... * feat: update cache info file after each file got downloaded * refactor: extract Downloader for model downloading logic * refactor: extract HuggingFaceRegistry * refactor: extract serde_json to workspace dependency * feat: add ModelScopeRegistry * refactor: extract registry to its sub dir. * feat: add scripts to mirror hf model to modelscope	2023-09-26 11:52:11 -07:00
Meng Zhang	1ccf9b2323	refactor: run make fix	2023-09-11 12:58:38 +08:00
leiwen83	e3c4a77fff	feat: add support fastchat http bindings (#421) ... * feat: add support fastchat http bindings Signed-off-by: Lei Wen <wenlei03@qiyi.com> Co-authored-by: Lei Wen <wenlei03@qiyi.com>	2023-09-10 22:17:58 +08:00
Meng Zhang	f0ed366420	feat: add support vertex-ai http bindings (#419) ... * feat: add support vertex-ai http bindings * support prefix / suffix	2023-09-09 11:22:58 +00:00
Meng Zhang	17397c8c8c	feat: add http api bindings (#410) ... * feat: add http-api-bindings * feat: add http-api-bindings * hand max_input_length * rename * update * update * add examples/simple.rs * update * add default value for stop words * update * fix lint * update	2023-09-09 03:59:42 +00:00