Commit Graph

124 Commits (a90db708ddfe40224b23fc805f1dba6733a860b4)

Author SHA1 Message Date
Meng Zhang 66bc979aa9 chore: switch to update tag for nightly job 2023-09-07 10:38:50 +08:00
Meng Zhang 426047b04a chore: build release binary for nightly tag 2023-09-07 10:36:47 +08:00
Meng Zhang 74a2b0add6 fix: update permission of nightly job 2023-09-07 10:34:22 +08:00
Meng Zhang c73501100f chore: update nightly.yml 2023-09-07 10:32:33 +08:00
Meng Zhang a6fa940406 fix: correct name for nightly.yml 2023-09-07 10:22:42 +08:00
Meng Zhang 9b87b657f0 chore: add nightly branch sync 2023-09-07 10:19:30 +08:00
Meng Zhang a207520571
feat: turn on metal device by default on macosx / aarch64 devices (#398) 2023-09-05 13:03:49 +08:00
vodkaslime 3c7c8d9293
feat: add cargo test to github actions and run only unit tests in ci [TAB-185] (#390)
* feat: add cargo test to github actions

* chore: fix lint

* chore: add openblas dependency

* chore: update build dependency

* chore: resolve comments

* chore: fix lint

* chore: fix lint

* chore: test installing dependencies

* chore: refactor integ test

* update ci

* cleanup

---------

Co-authored-by: Meng Zhang <meng@tabbyml.com>
2023-09-03 05:04:52 +00:00
Meng Zhang 3573d4378e
feat: llama.cpp for metal support [TAB-146] (#391)
* feat: init commit adding llama-cpp-bindings

* add llama.cpp submodule

* add LlamaEngine to hold llama context / llama model

* add cxxbridge

* add basic greedy sampling

* move files

* make compile success

* connect TextGeneration with LlamaEngine

* experimental support llama.cpp

* add metal device

* add Accelerate

* fix namespace for llama-cpp-bindings

* fix lint

* move stepping logic to rust

* add stop words package

* use stop-words in ctranslate2-bindings

* use raw string for regex

* use Arc<Tokenizer> for sharing tokenizers

* refactor: remove useless stop_words_encoding_offset

* switch to tokenizers 0.13.4-rc.3

* fix lints in cpp

* simplify implementation of greedy decoding

* feat: split metal feature for llama backend

* add ci

* update ci

* build tabby bin in ci build
2023-09-03 09:59:07 +08:00
Meng Zhang ffa87dbfe5 chore: switch to semver for docker.yml 2023-08-31 10:27:21 +08:00
Meng Zhang c76edeaa80 Revert "chore: add RELEASE_NOTES.md"
This reverts commit cfa0e66c45.
2023-08-31 10:11:29 +08:00
Meng Zhang b3fe375aff chore: turn off automatic latest tag 2023-08-31 10:00:19 +08:00
Meng Zhang fe3e73c512 chore: fix indent error in docker.yml 2023-08-31 09:50:50 +08:00
Meng Zhang cfa0e66c45 chore: add RELEASE_NOTES.md 2023-08-31 09:43:46 +08:00
Meng Zhang 26fc0e7e64 chore: improve tags with docker/metadata action 2023-08-31 09:36:09 +08:00
Meng Zhang 41046f8324 chore: turn off binary release for pushes to main 2023-08-31 09:04:01 +08:00
Meng Zhang 2b5152f734 chore: trigger ci / docker workflows for v* tags 2023-08-31 08:57:06 +08:00
Meng Zhang e3d33141e1 fix: don't remove v prefix in release action 2023-08-31 00:09:16 +08:00
Meng Zhang 4c7cd84df1 chore: change latest tag to 2023-08-30 23:56:27 +08:00
Meng Zhang 8248a7fd54
chore: support tag in release (#382) 2023-08-30 23:42:17 +08:00
Meng Zhang 054aefaf15
chore: add linux static build (#379)
* chore: add linux static build

* add touch

* update build env

* add sudo

* fix: protobuf ubuntu target
2023-08-30 18:45:05 +08:00
Meng Zhang 0eb489b9ca
chore: strip `v` prefix in tag name when tagging docker image 2023-08-30 15:40:40 +08:00
Meng Zhang 104fea61ad
fix: ref name in docker.yml (#377) 2023-08-30 15:28:50 +08:00
Meng Zhang f3c20bdf2c
chore: add tag name to image built (#376) 2023-08-30 15:11:09 +08:00
Meng Zhang 7ed5dd584d
feat: experiment ctags support in scheduler (#207)
* experiment ctags support

* add document.rs

* extract Document to common

* integrate tags into dataset builder

* skip if none

* do not add scheduler in client binary

* fix fmt
2023-06-21 19:48:13 -07:00
Meng Zhang 5ab286814a chore: set push to true 2023-06-11 15:14:22 -07:00
Meng Zhang de546b03fe
feat: add otlp-endpoint for OpenTelemetry support [TAB-67] (#227)
* feat: add otlp-endpoint for OpenTelemetry support

* set default log level for axum tracing to INFO

* update build enviornment

* update
2023-06-10 22:46:25 -07:00
Meng Zhang b184fae2c9
chore: Update gh-pages.yml 2023-06-06 16:32:51 -07:00
Meng Zhang 787e195359
chore: update gh-pages.yml 2023-06-06 16:25:08 -07:00
Meng Zhang 9eec9eae5d chore: update ci 2023-06-06 04:23:16 -07:00
Meng Zhang 1d0fe5ad76
docs: add demo.gif to website (#206)
* docs: add demo.gif to website

* add changes filter
2023-06-06 04:21:30 -07:00
Meng Zhang 0c290f18c3
Update gh-pages.yml (#202) 2023-06-05 18:50:45 -07:00
Meng Zhang b3a9363b82
Update gh-pages.yml 2023-06-05 18:48:34 -07:00
Meng Zhang 892bad5f8a
Update gh-pages.yml (#201) 2023-06-05 18:47:14 -07:00
Meng Zhang 23e8795ff6
Create gh-pages.yml 2023-06-05 18:39:49 -07:00
Meng Zhang 272dde9769
refactor: rust nightly format (#197)
* chore: turn on group format

* turn on nightly fmt
2023-06-05 14:17:07 -07:00
Meng Zhang b1f910b727
chore: refactor ci (#196) 2023-06-05 11:30:52 -07:00
Meng Zhang 63ca6225ba
cleanup: remove outdated deployment / development dirs (#193) 2023-06-04 19:46:13 -07:00
Meng Zhang b4eaf543b1
Update docker.rust.yml 2023-06-01 18:24:02 -07:00
Meng Zhang 1974168bc0
chore: add release job (#182)
* chore: add release job

* fix tab

* update
2023-06-01 18:01:29 -07:00
Meng Zhang 378f8fa3d5 chore: remove clippy and test is macosx target 2023-06-01 17:25:44 -07:00
Meng Zhang 3cac2607e7
refactor: improve error handlings, fix clippy warnings (#181)
* refactor: minor improvements on error handling

* refactor: cleanup error handlings

* update

* update

* fix

* add clippy / test workflow

* fix clippy

* fix clippy

* update
2023-06-01 17:23:05 -07:00
Meng Zhang 5aa2370e19
feat: switch default docker image to rust based (#175)
* chore: change rust docker image to default

* update README for rust core

* improve doc

* Update README.md

* update

* Update README.md
2023-05-31 23:27:55 +00:00
Meng Zhang 5c0c1463de
chore: set concurrency in workflow (#174) 2023-05-30 23:36:34 -07:00
Zhiming Ma f516b8024c
Update github actions docker.rust.yml to ignore clients changes. (#167) 2023-05-29 20:37:02 -07:00
Meng Zhang 80d1dd1ca6
Add admin panel (behand --experimental-admin-panel) (#156)
* add admin

* add feature:admin_panel

* update

* add dist directory

* update
2023-05-28 01:17:32 -07:00
Meng Zhang b8309d98cc
Switch to sccache (#154)
* fix fmt

* fix

* fix test

* fix clippy

* switch to sc cache

* fix

* update

* update

* update

* fix

* add test

* remove clippy

* update

* disable incremental

* update

* simply
2023-05-27 16:20:17 -07:00
Meng Zhang 0000312460
Add download_model.py. Adjust ctranslate2 backend model structure (#153)
* adjust

* update

* update
2023-05-27 14:51:12 -07:00
Meng Zhang 734957d1de
build mac binary in ci (#152)
* build mac binary in ci

* update

* update

* turn on verbose

* fix cross compile

* update

* update

* update

* update

* update

* update

* update
2023-05-27 14:31:27 -07:00
Meng Zhang 3788710882 update Dockerfile.rust 2023-05-26 11:24:18 -07:00
Meng Zhang 484e754bc4
Update docker.rust.yml 2023-05-25 20:56:44 -07:00
Meng Zhang ed0b2af837 Update docker.rust.yml 2023-05-25 20:00:12 -07:00
Meng Zhang f5d8bc23c1 fix: checkout submodules in rust ci 2023-05-25 18:53:55 -07:00
Meng Zhang c937a5056a fix docker build 2023-05-25 18:25:34 -07:00
Meng Zhang 0acc975618
Support linux ctranslate2 cuda build (#147)
* Support linux build

* add <memory> to fix build error in linux

* add Dockerfile.tabby

* update

* update

* add rust docker image pipeline

* add docker.rust.yml
2023-05-25 18:18:22 -07:00
Meng Zhang ac6637bdbb
Update docker.yml 2023-04-14 13:09:01 +08:00
Meng Zhang e9ccbff3b9
Update docker.yml 2023-04-14 13:00:55 +08:00
Meng Zhang f4b3e15dfc
Update docker.yml 2023-04-14 12:35:49 +08:00
Meng Zhang 72563365d2
Update docker.yml 2023-04-14 11:55:29 +08:00
Meng Zhang 5256779ffe
Update docker.yml 2023-04-14 09:33:38 +08:00
Meng Zhang a453907075
Update docker.yml 2023-04-14 09:10:06 +08:00
Meng Zhang d5f5bed4b9 chore: only trigger docker build if tabby/ changes 2023-04-09 20:26:36 +08:00
Meng Zhang 7c4ee1b6ca chore: do not run docker build on PR 2023-04-09 20:21:25 +08:00
Meng Zhang e28877fbbb
chore: add pre-commit workflow (#72)
* chore: add pre-commit workflow

* fix pre-commit
2023-04-09 20:17:56 +08:00
Meng Zhang 69d49d01c5 chore: update docker hub description in workflow 2023-04-09 18:11:37 +08:00
Meng Zhang 53c77c4609 Add pages 2023-04-06 18:48:26 +08:00
Meng Zhang e5e571ff07
Update docker.yml 2023-04-05 23:55:44 +08:00
Meng Zhang b0031b1f87
Update docker.yml 2023-04-05 23:49:14 +08:00
Meng Zhang 95cdca9b43
Update docker.yml 2023-04-05 23:22:51 +08:00
Meng Zhang db77d7f267
feat: support single container (#46)
* docs: update readme

* fix: do not exclude peft

* Free disk space before docker building

* fix: fix docker-compose

* fix: dockercompose user to 1000

* fix dockerfile

* fix: cachedir ownership
2023-04-05 20:19:43 +08:00
Meng Zhang 8cf533016a
Move python code under tabby/ (#8)
* Add tabby config file

* Rename train.yaml to trainer.yaml

* Change server to relative import

* Move source files into tabby

* Rename conf
2023-03-25 12:20:29 +08:00
Meng Zhang 6433286fe9
Update docker.yml 2023-03-22 23:59:40 +08:00
Meng Zhang fc31ea2bd2
Update docker.yml 2023-03-22 23:27:12 +08:00
Meng Zhang 9a0ed9050a Add docker build workflow 2023-03-22 23:21:42 +08:00