Meng Zhang 7bd99d14c0 feat: support continuous batching in llama.cpp backend (#659) ... * refactor: switch back to llama batch interface * feat: support cont batching		2023-10-28 23:37:05 -07:00
..
serve	feat: support continuous batching in llama.cpp backend (#659)	2023-10-28 23:37:05 -07:00
download.rs	feat: support continuous batching in llama.cpp backend (#659)	2023-10-28 23:37:05 -07:00
main.rs	feat: implement /v1beta/search interface (#516)	2023-10-06 18:54:12 +00:00