Meng Zhang
b76cd1557f
fix: update cmake version to 3.17+
2023-11-05 12:12:16 -08:00
Meng Zhang
50066b1a76
fix: runtime version
2023-11-05 11:49:15 -08:00
Meng Zhang
789b1f727b
feat: set CUDA_VERSION to be 11.2.2
2023-11-05 11:42:13 -08:00
Meng Zhang
c3e7b470e5
fix: Update Dockerfile
2023-10-27 16:11:10 -07:00
Meng Zhang
23bd542cec
feat: switch cuda backend to llama.cpp ( #656 )
...
* feat: switch cuda backend to llama.cpp
* fix
* fix
2023-10-27 13:41:22 -07:00
Meng Zhang
28b5ea3c09
fix: set safe.directory in Dockerfile ( #571 )
...
to avoid dubious ownership warning for git
2023-10-16 14:21:09 -07:00
Meng Zhang
61ade26545
feat: Update Dockerfile to ctranslate 3.20.0 ( #460 )
2023-09-19 14:12:35 +08:00
Meng Zhang
d51336847b
fix: docker build hangs due to interactive tzdata
2023-09-08 10:23:57 +08:00
Meng Zhang
2311adc3f3
fix: add cmake in docker environment
2023-09-07 10:21:46 +08:00
vodkaslime
f847cb20a3
fix: git information in health API response [TAB-177] ( #375 )
...
* fix: add git information to health API response
* chore: use gitcl
2023-08-29 18:19:54 +08:00
vodkaslime
2a91a21787
feat: add gpu info to health state [TAB-162] ( #364 )
...
* feat: add gpu info to health response
* chore: error handling
* chore: refactor cpu manager code
* chore: typo
* chore: fix context mutability
* chore: fix context mutability
* feat: add link to NVML lib
* chore: refactor
* lint
* chore: resolve comments
* chore: fix typo
* chore: fix
* chore: resolve comments
* chore: fix
* chore: resolve comments
2023-08-21 18:06:38 +08:00
Meng Zhang
b990781c9f
feat: upgrade ctranslate2 to v3.17.1 ( #326 )
2023-08-02 15:03:24 +08:00
Meng Zhang
06ac9f594e
chore: add git dependency, for purpose of using scheduler in container
2023-06-24 09:24:02 -07:00
Meng Zhang
de546b03fe
feat: add otlp-endpoint for OpenTelemetry support [TAB-67] ( #227 )
...
* feat: add otlp-endpoint for OpenTelemetry support
* set default log level for axum tracing to INFO
* update build enviornment
* update
2023-06-10 22:46:25 -07:00
Meng Zhang
007a40c582
feat: support early stop [TAB-51] ( #208 )
...
* bump ctranslate2 to v3.15.0
* enable early stop
* support early stop
2023-06-06 12:46:17 +00:00
Meng Zhang
b1f910b727
chore: refactor ci ( #196 )
2023-06-05 11:30:52 -07:00
Meng Zhang
63ca6225ba
cleanup: remove outdated deployment / development dirs ( #193 )
2023-06-04 19:46:13 -07:00
Meng Zhang
d452488c4b
Remove FLAGS_enable_meilisearch and FLAGS_rewrite_prompt_with_search_snippet ( #122 )
2023-05-01 15:06:06 +08:00
Meng Zhang
aa5608fcb3
feat: integrate with meilisearch for snippet retrieval ( #85 )
...
* feat: extract json dump for dataset building
* feat: integrate with meilisearch for code index
* condition changes for meili with FLAG
2023-04-12 13:18:50 +08:00
Meng Zhang
ef483564fe
feat: integrate caddy, re-org paths ( #49 )
...
* integrate caddy
* address comments
2023-04-06 17:02:10 +08:00
Meng Zhang
e36ddbac6b
refactor: move scripts to tabby/ ( #48 )
2023-04-06 00:44:10 +08:00
Meng Zhang
db77d7f267
feat: support single container ( #46 )
...
* docs: update readme
* fix: do not exclude peft
* Free disk space before docker building
* fix: fix docker-compose
* fix: dockercompose user to 1000
* fix dockerfile
* fix: cachedir ownership
2023-04-05 20:19:43 +08:00
Meng Zhang
658a1f1c24
refactor: move vector.toml to tabby/config
...
fix
2023-04-04 20:02:56 +08:00
Meng Zhang
20801bbe8c
Cleanup environment variable ( #30 )
...
* Remove EVENTS_LOG_DIR
* Rename supervisord.sh -> tabby.sh
2023-03-29 16:33:00 +08:00
Meng Zhang
bf7d149a27
Add supervisord to support a single docker run deployment ( #29 )
...
* Add suppervisord in dockerfile
* Create supervisord
* Update README.md
* Update README.md
2023-03-29 12:57:03 +08:00
Meng Zhang
92eb2d54f5
Add LoRA Fine-tuning for private code repository ( #22 )
...
* Add bitandsands
* Fix cudart in Dockerfile
* Add ConstantLengthDataset in trainer
* Add train_lora
* Remove bnb
* Remove useless imports
2023-03-28 15:57:13 +08:00
Meng Zhang
9d92821cf5
Add gptj converter ( #19 )
...
* Rename deployment-next to development
* Add GPTJ converter
2023-03-27 11:12:52 +08:00
Meng Zhang
8144e4f83a
Add tabby.tools.repository.updater for easier git repository synchronization. ( #9 )
...
* Move dags to tabby.tasks
* Add repository syncer
* Follow redirect for curl
2023-03-25 14:44:46 +08:00
Meng Zhang
8cf533016a
Move python code under tabby/ ( #8 )
...
* Add tabby config file
* Rename train.yaml to trainer.yaml
* Change server to relative import
* Move source files into tabby
* Rename conf
2023-03-25 12:20:29 +08:00
Meng Zhang
bcce00794e
Add admin panel (w/ streamlit) and logging (w/ vectordev) ( #4 )
2023-03-22 23:18:12 +08:00
Meng Zhang
8683ded66c
Update Dockerfile
2023-03-22 02:52:41 +08:00
Meng Zhang
f177fab951
Add docker compose ( #3 )
...
* Add docker-compose.yaml
* Update docker-compose
2023-03-22 02:42:47 +08:00