tabby/crates/llama-cpp-bindings
Meng Zhang e93a971d0e
feat: tune llama metal backend performance (#393)
* feat: support eos based stop

* feat: print performance stats after each inference

* update llama.cpp

* update commits
2023-09-05 10:14:29 +08:00
..
include feat: tune llama metal backend performance (#393) 2023-09-05 10:14:29 +08:00
llama.cpp@06fc4020de feat: tune llama metal backend performance (#393) 2023-09-05 10:14:29 +08:00
src feat: tune llama metal backend performance (#393) 2023-09-05 10:14:29 +08:00
Cargo.toml feat: support cancellation in llama backend 2023-09-03 09:59:40 +08:00
build.rs feat: add cargo test to github actions and run only unit tests in ci [TAB-185] (#390) 2023-09-03 05:04:52 +00:00