Commit Graph

72 Commits (a6fa940406190a83fae532d9d72f5b5f3f63b97a)

Author SHA1 Message Date
Meng Zhang a6fa940406 fix: correct name for nightly.yml 2023-09-07 10:22:42 +08:00
Meng Zhang 9b87b657f0 chore: add nightly branch sync 2023-09-07 10:19:30 +08:00
Meng Zhang a207520571
feat: turn on metal device by default on macosx / aarch64 devices (#398) 2023-09-05 13:03:49 +08:00
vodkaslime 3c7c8d9293
feat: add cargo test to github actions and run only unit tests in ci [TAB-185] (#390)
* feat: add cargo test to github actions

* chore: fix lint

* chore: add openblas dependency

* chore: update build dependency

* chore: resolve comments

* chore: fix lint

* chore: fix lint

* chore: test installing dependencies

* chore: refactor integ test

* update ci

* cleanup

---------

Co-authored-by: Meng Zhang <meng@tabbyml.com>
2023-09-03 05:04:52 +00:00
Meng Zhang 3573d4378e
feat: llama.cpp for metal support [TAB-146] (#391)
* feat: init commit adding llama-cpp-bindings

* add llama.cpp submodule

* add LlamaEngine to hold llama context / llama model

* add cxxbridge

* add basic greedy sampling

* move files

* make compile success

* connect TextGeneration with LlamaEngine

* experimental support llama.cpp

* add metal device

* add Accelerate

* fix namespace for llama-cpp-bindings

* fix lint

* move stepping logic to rust

* add stop words package

* use stop-words in ctranslate2-bindings

* use raw string for regex

* use Arc<Tokenizer> for sharing tokenizers

* refactor: remove useless stop_words_encoding_offset

* switch to tokenizers 0.13.4-rc.3

* fix lints in cpp

* simplify implementation of greedy decoding

* feat: split metal feature for llama backend

* add ci

* update ci

* build tabby bin in ci build
2023-09-03 09:59:07 +08:00
Meng Zhang ffa87dbfe5 chore: switch to semver for docker.yml 2023-08-31 10:27:21 +08:00
Meng Zhang c76edeaa80 Revert "chore: add RELEASE_NOTES.md"
This reverts commit cfa0e66c45.
2023-08-31 10:11:29 +08:00
Meng Zhang b3fe375aff chore: turn off automatic latest tag 2023-08-31 10:00:19 +08:00
Meng Zhang fe3e73c512 chore: fix indent error in docker.yml 2023-08-31 09:50:50 +08:00
Meng Zhang cfa0e66c45 chore: add RELEASE_NOTES.md 2023-08-31 09:43:46 +08:00
Meng Zhang 26fc0e7e64 chore: improve tags with docker/metadata action 2023-08-31 09:36:09 +08:00
Meng Zhang 41046f8324 chore: turn off binary release for pushes to main 2023-08-31 09:04:01 +08:00
Meng Zhang 2b5152f734 chore: trigger ci / docker workflows for v* tags 2023-08-31 08:57:06 +08:00
Meng Zhang e3d33141e1 fix: don't remove v prefix in release action 2023-08-31 00:09:16 +08:00
Meng Zhang 4c7cd84df1 chore: change latest tag to 2023-08-30 23:56:27 +08:00
Meng Zhang 8248a7fd54
chore: support tag in release (#382) 2023-08-30 23:42:17 +08:00
Meng Zhang 054aefaf15
chore: add linux static build (#379)
* chore: add linux static build

* add touch

* update build env

* add sudo

* fix: protobuf ubuntu target
2023-08-30 18:45:05 +08:00
Meng Zhang 0eb489b9ca
chore: strip `v` prefix in tag name when tagging docker image 2023-08-30 15:40:40 +08:00
Meng Zhang 104fea61ad
fix: ref name in docker.yml (#377) 2023-08-30 15:28:50 +08:00
Meng Zhang f3c20bdf2c
chore: add tag name to image built (#376) 2023-08-30 15:11:09 +08:00
Meng Zhang 7ed5dd584d
feat: experiment ctags support in scheduler (#207)
* experiment ctags support

* add document.rs

* extract Document to common

* integrate tags into dataset builder

* skip if none

* do not add scheduler in client binary

* fix fmt
2023-06-21 19:48:13 -07:00
Meng Zhang 5ab286814a chore: set push to true 2023-06-11 15:14:22 -07:00
Meng Zhang de546b03fe
feat: add otlp-endpoint for OpenTelemetry support [TAB-67] (#227)
* feat: add otlp-endpoint for OpenTelemetry support

* set default log level for axum tracing to INFO

* update build enviornment

* update
2023-06-10 22:46:25 -07:00
Meng Zhang b184fae2c9
chore: Update gh-pages.yml 2023-06-06 16:32:51 -07:00
Meng Zhang 787e195359
chore: update gh-pages.yml 2023-06-06 16:25:08 -07:00
Meng Zhang 9eec9eae5d chore: update ci 2023-06-06 04:23:16 -07:00
Meng Zhang 1d0fe5ad76
docs: add demo.gif to website (#206)
* docs: add demo.gif to website

* add changes filter
2023-06-06 04:21:30 -07:00
Meng Zhang 0c290f18c3
Update gh-pages.yml (#202) 2023-06-05 18:50:45 -07:00
Meng Zhang b3a9363b82
Update gh-pages.yml 2023-06-05 18:48:34 -07:00
Meng Zhang 892bad5f8a
Update gh-pages.yml (#201) 2023-06-05 18:47:14 -07:00
Meng Zhang 23e8795ff6
Create gh-pages.yml 2023-06-05 18:39:49 -07:00
Meng Zhang 272dde9769
refactor: rust nightly format (#197)
* chore: turn on group format

* turn on nightly fmt
2023-06-05 14:17:07 -07:00
Meng Zhang b1f910b727
chore: refactor ci (#196) 2023-06-05 11:30:52 -07:00
Meng Zhang 63ca6225ba
cleanup: remove outdated deployment / development dirs (#193) 2023-06-04 19:46:13 -07:00
Meng Zhang b4eaf543b1
Update docker.rust.yml 2023-06-01 18:24:02 -07:00
Meng Zhang 1974168bc0
chore: add release job (#182)
* chore: add release job

* fix tab

* update
2023-06-01 18:01:29 -07:00
Meng Zhang 378f8fa3d5 chore: remove clippy and test is macosx target 2023-06-01 17:25:44 -07:00
Meng Zhang 3cac2607e7
refactor: improve error handlings, fix clippy warnings (#181)
* refactor: minor improvements on error handling

* refactor: cleanup error handlings

* update

* update

* fix

* add clippy / test workflow

* fix clippy

* fix clippy

* update
2023-06-01 17:23:05 -07:00
Meng Zhang 5aa2370e19
feat: switch default docker image to rust based (#175)
* chore: change rust docker image to default

* update README for rust core

* improve doc

* Update README.md

* update

* Update README.md
2023-05-31 23:27:55 +00:00
Meng Zhang 5c0c1463de
chore: set concurrency in workflow (#174) 2023-05-30 23:36:34 -07:00
Zhiming Ma f516b8024c
Update github actions docker.rust.yml to ignore clients changes. (#167) 2023-05-29 20:37:02 -07:00
Meng Zhang 80d1dd1ca6
Add admin panel (behand --experimental-admin-panel) (#156)
* add admin

* add feature:admin_panel

* update

* add dist directory

* update
2023-05-28 01:17:32 -07:00
Meng Zhang b8309d98cc
Switch to sccache (#154)
* fix fmt

* fix

* fix test

* fix clippy

* switch to sc cache

* fix

* update

* update

* update

* fix

* add test

* remove clippy

* update

* disable incremental

* update

* simply
2023-05-27 16:20:17 -07:00
Meng Zhang 0000312460
Add download_model.py. Adjust ctranslate2 backend model structure (#153)
* adjust

* update

* update
2023-05-27 14:51:12 -07:00
Meng Zhang 734957d1de
build mac binary in ci (#152)
* build mac binary in ci

* update

* update

* turn on verbose

* fix cross compile

* update

* update

* update

* update

* update

* update

* update
2023-05-27 14:31:27 -07:00
Meng Zhang 3788710882 update Dockerfile.rust 2023-05-26 11:24:18 -07:00
Meng Zhang 484e754bc4
Update docker.rust.yml 2023-05-25 20:56:44 -07:00
Meng Zhang ed0b2af837 Update docker.rust.yml 2023-05-25 20:00:12 -07:00
Meng Zhang f5d8bc23c1 fix: checkout submodules in rust ci 2023-05-25 18:53:55 -07:00
Meng Zhang c937a5056a fix docker build 2023-05-25 18:25:34 -07:00