root
/
tabby
mirror of https://gitee.com/zhang_1334717033/tabby.git
1
0
Fork 0
Code Issues Packages Projects Releases Wiki Activity
tabby/crates/llama-cpp-bindings/src
History
Meng Zhang 8ab35b2639
feat: add --parallelism to control throughput and vram usage (#727) 
* feat: add --parallelism to control throughput and vram usage

* update default

* Revert "update default"

This reverts commit 349792c0d48d913dcd8be4ce1c9d7ce887918f29.

* cargo fmt
 		2023-11-08 18:31:22 +00:00
..
engine.cc feat: add --parallelism to control throughput and vram usage (#727) 2023-11-08 18:31:22 +00:00
lib.rs feat: add --parallelism to control throughput and vram usage (#727) 2023-11-08 18:31:22 +00:00
llama.rs fix: deadlock between background job and requests (#720) 2023-11-07 13:11:28 -08:00
utils.rs fix: when there's an error happens in background inference loop, it should exit the process (#713) 2023-11-06 20:41:49 +00:00