138b7459c5
* feat: add LLAMA_CPP_N_THREADS and LLAMA_CPP_N_THREADS_BATCH envs * apply format * improve: use LLAMA_CPP_N_THREADS for both n_threads and n_threads_batch * Update crates/llama-cpp-bindings/src/engine.cc --------- Co-authored-by: Meng Zhang <meng@tabbyml.com> |
||
|---|---|---|
| .. | ||
| http-api-bindings | ||
| llama-cpp-bindings | ||
| tabby | ||
| tabby-common | ||
| tabby-download | ||
| tabby-inference | ||
| tabby-scheduler | ||