tabby/crates/llama-cpp-bindings/include
Meng Zhang ad3b974d5c
feat: implement input truncation for llama-cpp-bindings (#416)
* feat: implement input truncation for llama-cpp-bindings

* set max input length to 1024

* fix: batching tokens with n_batches

* fix batching
2023-09-09 00:20:51 +08:00
..
engine.h feat: implement input truncation for llama-cpp-bindings (#416) 2023-09-09 00:20:51 +08:00