2 Commits (56b7b850af78c6d9cc446d4323d8c7f83f36619f)

Author	SHA1	Message	Date
Meng Zhang	44f013f26e	feat: add /generate and /generate_streaming (#482) ... * feat: add generate_stream interface * extract engine::create_engine * feat add generate::generate * support streaming in llama.cpp * support streaming in ctranslate2 * update * fix formatting * refactor: extract helpers functions	2023-09-28 17:20:50 +00:00
Meng Zhang	b8308b7118	refactor: extract TextGeneration trait (#324) ... * add tabby-inference * extract TextGeneration trait * format * Rename TextInferenceEngine to CTranslate2Engine	2023-08-02 06:12:51 +00:00