tabby/crates/llama-cpp-bindings/include
Meng Zhang e93a971d0e
feat: tune llama metal backend performance (#393)
* feat: support eos based stop

* feat: print performance stats after each inference

* update llama.cpp

* update commits
2023-09-05 10:14:29 +08:00
..
engine.h feat: tune llama metal backend performance (#393) 2023-09-05 10:14:29 +08:00