tabby/crates
Meng Zhang ad3b974d5c
feat: implement input truncation for llama-cpp-bindings (#416)
* feat: implement input truncation for llama-cpp-bindings

* set max input length to 1024

* fix: batching tokens with n_batches

* fix batching
2023-09-09 00:20:51 +08:00
..
ctranslate2-bindings feat: implement input truncation with options.max_input_length (#415) 2023-09-08 10:01:03 +00:00
llama-cpp-bindings feat: implement input truncation for llama-cpp-bindings (#416) 2023-09-09 00:20:51 +08:00
rust-cxx-cmake-bridge
stop-words
tabby feat: implement input truncation with options.max_input_length (#415) 2023-09-08 10:01:03 +00:00
tabby-common feat: add ggml fp16 / q8_0 files (#407) 2023-09-06 17:12:29 +00:00
tabby-download feat: add ggml fp16 / q8_0 files (#407) 2023-09-06 17:12:29 +00:00
tabby-inference feat: implement input truncation with options.max_input_length (#415) 2023-09-08 10:01:03 +00:00
tabby-scheduler