tabby/crates/llama-cpp-bindings/src
Meng Zhang e93a971d0e
feat: tune llama metal backend performance (#393)
* feat: support eos based stop

* feat: print performance stats after each inference

* update llama.cpp

* update commits
2023-09-05 10:14:29 +08:00
..
engine.cc feat: tune llama metal backend performance (#393) 2023-09-05 10:14:29 +08:00
lib.rs feat: tune llama metal backend performance (#393) 2023-09-05 10:14:29 +08:00