tabby/crates
Meng Zhang ad3b974d5c
feat: implement input truncation for llama-cpp-bindings (#416)
* feat: implement input truncation for llama-cpp-bindings

* set max input length to 1024

* fix: batching tokens with n_batches

* fix batching
2023-09-09 00:20:51 +08:00
..
ctranslate2-bindings feat: implement input truncation with options.max_input_length (#415) 2023-09-08 10:01:03 +00:00
llama-cpp-bindings feat: implement input truncation for llama-cpp-bindings (#416) 2023-09-09 00:20:51 +08:00
rust-cxx-cmake-bridge refactor: rust nightly format (#197) 2023-06-05 14:17:07 -07:00
stop-words feat: llama.cpp for metal support [TAB-146] (#391) 2023-09-03 09:59:07 +08:00
tabby feat: implement input truncation with options.max_input_length (#415) 2023-09-08 10:01:03 +00:00
tabby-common feat: add ggml fp16 / q8_0 files (#407) 2023-09-06 17:12:29 +00:00
tabby-download feat: add ggml fp16 / q8_0 files (#407) 2023-09-06 17:12:29 +00:00
tabby-inference feat: implement input truncation with options.max_input_length (#415) 2023-09-08 10:01:03 +00:00
tabby-scheduler feat: add cargo test to github actions and run only unit tests in ci [TAB-185] (#390) 2023-09-03 05:04:52 +00:00