tabby/crates
Meng Zhang 7bd99d14c0
feat: support continuous batching in llama.cpp backend (#659)
* refactor: switch back to llama batch interface

* feat: support cont batching
2023-10-28 23:37:05 -07:00
..
ctranslate2-bindings Update CMakeLists.txt 2023-10-27 15:40:52 -07:00
http-api-bindings Release 0.5.0-dev 2023-10-24 13:05:33 -07:00
llama-cpp-bindings feat: support continuous batching in llama.cpp backend (#659) 2023-10-28 23:37:05 -07:00
rust-cxx-cmake-bridge Release 0.5.0-dev 2023-10-24 13:05:33 -07:00
tabby feat: support continuous batching in llama.cpp backend (#659) 2023-10-28 23:37:05 -07:00
tabby-common Revert "feat: supports PHP (#634)" 2023-10-28 23:02:10 -07:00
tabby-download feat: upgrade llama.cpp (#645) 2023-10-27 12:18:46 -07:00
tabby-inference Release 0.5.0-dev 2023-10-24 13:05:33 -07:00
tabby-scheduler Revert "feat: supports PHP (#634)" 2023-10-28 23:02:10 -07:00