Commit Graph

29 Commits (474833131e094107bbc602191a48006a14000606)

Author SHA1 Message Date
Meng Zhang 474833131e
fix: rust build caused by 1.74.0 release (#819) 2023-11-17 15:21:47 -08:00
Meng Zhang 6f1a3039b0 chore: fix ci.yml rust toolchain 2023-11-12 15:25:27 -08:00
Meng Zhang 52793304c0 chore: remove format / clippy / machette check as they're in autofix.yml 2023-11-12 14:59:39 -08:00
Meng Zhang 56ec7c05f6 chore(ci): update cis for tabby-webserver 2023-11-12 13:03:39 -08:00
Meng Zhang 00e0c4fddc
chore: add machete check to ensure no unused dependencies (#701)
* refactor: remove useless dependencies

* add machete
2023-11-05 02:48:05 +00:00
Meng Zhang bdd9e6c18a
chore: up ci.yml to mac-latest 2023-11-03 18:29:57 -07:00
Meng Zhang 0ed4289958 chore: only run release-binary on non PR 2023-11-01 23:06:25 -07:00
Meng Zhang 23bd542cec
feat: switch cuda backend to llama.cpp (#656)
* feat: switch cuda backend to llama.cpp

* fix

* fix
2023-10-27 13:41:22 -07:00
Meng Zhang 1a4c2aa71f
feat: swtich cpu backend to llama.cpp (#638)
* feat: swtich Cpu backend to llama.cpp

* feat: switch cpu serving to ggml

* fix cargo.toml

* use optional dependency

* fix compliation

* update ci target
2023-10-25 15:40:11 -07:00
Meng Zhang 5f1359cb77
chore: Update ci.yml 2023-09-08 09:53:35 +08:00
Meng Zhang daeba63540
chore: Update ci.yml 2023-09-08 09:52:02 +08:00
Meng Zhang 426047b04a chore: build release binary for nightly tag 2023-09-07 10:36:47 +08:00
Meng Zhang a207520571
feat: turn on metal device by default on macosx / aarch64 devices (#398) 2023-09-05 13:03:49 +08:00
vodkaslime 3c7c8d9293
feat: add cargo test to github actions and run only unit tests in ci [TAB-185] (#390)
* feat: add cargo test to github actions

* chore: fix lint

* chore: add openblas dependency

* chore: update build dependency

* chore: resolve comments

* chore: fix lint

* chore: fix lint

* chore: test installing dependencies

* chore: refactor integ test

* update ci

* cleanup

---------

Co-authored-by: Meng Zhang <meng@tabbyml.com>
2023-09-03 05:04:52 +00:00
Meng Zhang 3573d4378e
feat: llama.cpp for metal support [TAB-146] (#391)
* feat: init commit adding llama-cpp-bindings

* add llama.cpp submodule

* add LlamaEngine to hold llama context / llama model

* add cxxbridge

* add basic greedy sampling

* move files

* make compile success

* connect TextGeneration with LlamaEngine

* experimental support llama.cpp

* add metal device

* add Accelerate

* fix namespace for llama-cpp-bindings

* fix lint

* move stepping logic to rust

* add stop words package

* use stop-words in ctranslate2-bindings

* use raw string for regex

* use Arc<Tokenizer> for sharing tokenizers

* refactor: remove useless stop_words_encoding_offset

* switch to tokenizers 0.13.4-rc.3

* fix lints in cpp

* simplify implementation of greedy decoding

* feat: split metal feature for llama backend

* add ci

* update ci

* build tabby bin in ci build
2023-09-03 09:59:07 +08:00
Meng Zhang c76edeaa80 Revert "chore: add RELEASE_NOTES.md"
This reverts commit cfa0e66c45.
2023-08-31 10:11:29 +08:00
Meng Zhang cfa0e66c45 chore: add RELEASE_NOTES.md 2023-08-31 09:43:46 +08:00
Meng Zhang 41046f8324 chore: turn off binary release for pushes to main 2023-08-31 09:04:01 +08:00
Meng Zhang 2b5152f734 chore: trigger ci / docker workflows for v* tags 2023-08-31 08:57:06 +08:00
Meng Zhang e3d33141e1 fix: don't remove v prefix in release action 2023-08-31 00:09:16 +08:00
Meng Zhang 4c7cd84df1 chore: change latest tag to 2023-08-30 23:56:27 +08:00
Meng Zhang 8248a7fd54
chore: support tag in release (#382) 2023-08-30 23:42:17 +08:00
Meng Zhang 054aefaf15
chore: add linux static build (#379)
* chore: add linux static build

* add touch

* update build env

* add sudo

* fix: protobuf ubuntu target
2023-08-30 18:45:05 +08:00
Meng Zhang 7ed5dd584d
feat: experiment ctags support in scheduler (#207)
* experiment ctags support

* add document.rs

* extract Document to common

* integrate tags into dataset builder

* skip if none

* do not add scheduler in client binary

* fix fmt
2023-06-21 19:48:13 -07:00
Meng Zhang de546b03fe
feat: add otlp-endpoint for OpenTelemetry support [TAB-67] (#227)
* feat: add otlp-endpoint for OpenTelemetry support

* set default log level for axum tracing to INFO

* update build enviornment

* update
2023-06-10 22:46:25 -07:00
Meng Zhang 9eec9eae5d chore: update ci 2023-06-06 04:23:16 -07:00
Meng Zhang 1d0fe5ad76
docs: add demo.gif to website (#206)
* docs: add demo.gif to website

* add changes filter
2023-06-06 04:21:30 -07:00
Meng Zhang 272dde9769
refactor: rust nightly format (#197)
* chore: turn on group format

* turn on nightly fmt
2023-06-05 14:17:07 -07:00
Meng Zhang b1f910b727
chore: refactor ci (#196) 2023-06-05 11:30:52 -07:00