tabby/crates
Meng Zhang 7bd99d14c0
feat: support continuous batching in llama.cpp backend (#659)
* refactor: switch back to llama batch interface

* feat: support cont batching
2023-10-28 23:37:05 -07:00
..
ctranslate2-bindings Update CMakeLists.txt 2023-10-27 15:40:52 -07:00
http-api-bindings
llama-cpp-bindings feat: support continuous batching in llama.cpp backend (#659) 2023-10-28 23:37:05 -07:00
rust-cxx-cmake-bridge
tabby feat: support continuous batching in llama.cpp backend (#659) 2023-10-28 23:37:05 -07:00
tabby-common Revert "feat: supports PHP (#634)" 2023-10-28 23:02:10 -07:00
tabby-download feat: upgrade llama.cpp (#645) 2023-10-27 12:18:46 -07:00
tabby-inference
tabby-scheduler Revert "feat: supports PHP (#634)" 2023-10-28 23:02:10 -07:00