Commit Graph

42 Commits (aa7ed053ecba01459a558840585c91f07e11b00c)

Author SHA1 Message Date
Meng Zhang 05f6fcf413 Fix app dir 2023-04-05 23:00:58 +08:00
Meng Zhang db77d7f267
feat: support single container (#46)
* docs: update readme

* fix: do not exclude peft

* Free disk space before docker building

* fix: fix docker-compose

* fix: dockercompose user to 1000

* fix dockerfile

* fix: cachedir ownership
2023-04-05 20:19:43 +08:00
Zhiming Ma 0d89a1221a
VSCode extension: add language field in completion request. (#45)
* vsode ext: add language field in completion request.

* Add comment: language identifier link.

* Add comment: language id link.
2023-04-05 14:27:23 +08:00
Meng Zhang 7c80ef3221
feat: support language field in CompletionRequest (#43)
* feat: support language in preset

* fix: add language in admin monaco editor

* fix: set unknown max length to 128
2023-04-05 12:10:58 +08:00
Meng Zhang 2fb462d514 feat: add vector / dagu server 2023-04-04 20:17:19 +08:00
Meng Zhang 0584f8e88e fix: remove sinks.all_event 2023-04-04 20:06:17 +08:00
Meng Zhang 658a1f1c24 refactor: move vector.toml to tabby/config
fix
2023-04-04 20:02:56 +08:00
Meng Zhang 6da7c17f67
refactor: switch to /v1/events endpoint (#42)
* refactor: Add EventType enum for validation

* refactor: use /v1/events in monaco components

* refactor: use /v1/events in vscode client

* refactor: remove unused api endpoint

* refactor: improve api endpoint type check
2023-04-04 19:42:57 +08:00
Meng Zhang 82bcd9b1df
feat: improve logging for build dataset jobs (#41)
* feat: move preprocess to build_dataset

* Improve logging for jobs in update_dataset

* improve logging
2023-04-04 14:15:51 +08:00
Meng Zhang 79585cc2a4
feat: improve events system (#40)
* feat: improve events system

* docs: add Events.md for Event sub system.

* Link vector.toml
2023-04-04 13:22:16 +08:00
Meng Zhang 75a8c7f439 fix: make collect_tabby_server_logs job succeed when there's no log file exists 2023-04-04 12:04:52 +08:00
Meng Zhang a60e765a1d fix: handle metrics without data 2023-04-03 23:38:26 +08:00
Meng Zhang c358859e28 refactor: move presets into function 2023-04-03 23:35:03 +08:00
Meng Zhang 59bbe0391b fix: consistent metric naming for accept rate 2023-04-03 23:28:28 +08:00
Meng Zhang 500466aca9 Improve charting for admin 2023-04-03 23:19:25 +08:00
Meng Zhang 350b719db9
feat: add a few default options in admin/Home (#39) 2023-04-03 17:19:52 +08:00
Meng Zhang 1c61ef3944
feat: integrate projects / dataset information in admin. (#38)
* feat: add projects page in admin

* feat: integrate update_dataset job

* feat: display dataset info in projects
2023-04-03 13:04:04 +08:00
Meng Zhang 6877a071ec Cleanup environment variable in tabby.server 2023-04-02 12:11:49 +08:00
Meng Zhang 0a30165862 feat: support load_in_8bits in python backend 2023-04-02 11:54:28 +08:00
Meng Zhang 82103e7280 style: stopwords -> stop_words 2023-04-02 11:26:43 +08:00
Meng Zhang 78280d44bf
Revert stop words implementation in python
#33
2023-03-30 14:52:04 +08:00
Meng Zhang be7894a5e6
feat: support stopping words in python backend. (#32)
* Improve python backend

* Update lockfile

* Support stop words in python backend

* Support LanguagePresets for triton

* Update pre-commit
2023-03-29 20:23:11 +08:00
Meng Zhang e0b85c82d7 Rename duckdb to analytic 2023-03-29 16:38:59 +08:00
Meng Zhang 20801bbe8c
Cleanup environment variable (#30)
* Remove EVENTS_LOG_DIR

* Rename supervisord.sh -> tabby.sh
2023-03-29 16:33:00 +08:00
Meng Zhang bf7d149a27
Add supervisord to support a single docker run deployment (#29)
* Add suppervisord in dockerfile

* Create supervisord

* Update README.md

* Update README.md
2023-03-29 12:57:03 +08:00
Meng Zhang 03f70c8466
move vscode clients (#27) 2023-03-28 20:35:59 +08:00
Meng Zhang d966f05abd
Add Completion Events & Acceptance Rate in metrics panel. (#26)
* Add duckdb

* Add basic Metrics w/duckdb
2023-03-28 20:12:03 +08:00
Meng Zhang 2f8714e6fe
Add vector logging for tabby-server events. (#25)
* Switch to dagu for init job

* Add processed logging
2023-03-28 16:32:35 +08:00
Meng Zhang 92eb2d54f5
Add LoRA Fine-tuning for private code repository (#22)
* Add bitandsands

* Fix cudart in Dockerfile

* Add ConstantLengthDataset in trainer

* Add train_lora

* Remove bnb

* Remove useless imports
2023-03-28 15:57:13 +08:00
Zhiming Ma e992a0144b
Add client: VSCode. (#21) 2023-03-28 15:53:57 +08:00
Meng Zhang d5d58fbbec
Improve documentations. (#20)
* Improve help message of model preload

* Update development/scripts/triton.sh

* Improve documents

* Update deployment.md

* Update deployment.md
2023-03-27 11:46:18 +08:00
Meng Zhang 9d92821cf5
Add gptj converter (#19)
* Rename deployment-next to development

* Add GPTJ converter
2023-03-27 11:12:52 +08:00
Meng Zhang 9739683fba
Switch default deploy model (#18) 2023-03-27 01:10:15 +08:00
Meng Zhang d209e89b72
Log view / select event in admin monaco editor (#17)
* Add view event

* Trigger view event and select event in monaco editor

* Set view / select event in tabby server
2023-03-26 23:31:47 +08:00
Meng Zhang 1c3ec20f93
Prepare public release with a minimal deployment setup (#16)
* Move deployment to deployment-next

* Add deployment setup

* Update deployment-next

* Remove vector label

* update README.md
2023-03-26 22:44:15 +08:00
Meng Zhang 562b8d9e7e
Cleanup tabby component (#14)
* Rename tabby to monaco

* Switch to javascript

* Rename st_monaco
2023-03-26 19:47:41 +08:00
Meng Zhang d76ed403c3
Fix tokenizer with \n\n (#15) 2023-03-26 19:47:32 +08:00
Meng Zhang e6bf16711f
Fix misc mistakes (#13)
* Fix misc

* Fix docker-compose
2023-03-25 21:37:38 +08:00
Meng Zhang d8f2d03636
Add monaco editor for streamlit (#12)
* Init monaco component

* Add monaco editor
2023-03-25 19:13:42 +08:00
Meng Zhang b622bd6762
use TabbyML/NeoX-70M for minimal e2e deployment (#10)
* use TabbyML/NeoX-70M for minimal e2e deployment

* Use python3 of triton image
2023-03-25 17:39:40 +08:00
Meng Zhang 8144e4f83a
Add tabby.tools.repository.updater for easier git repository synchronization. (#9)
* Move dags to tabby.tasks

* Add repository syncer

* Follow redirect for curl
2023-03-25 14:44:46 +08:00
Meng Zhang 8cf533016a
Move python code under tabby/ (#8)
* Add tabby config file

* Rename train.yaml to trainer.yaml

* Change server to relative import

* Move source files into tabby

* Rename conf
2023-03-25 12:20:29 +08:00