Meng Zhang
edd33a326d
feat(loadtest): add loadtest tools ( #906 )
...
* add loadtest tools
* update
* [autofix.ci] apply automated fixes
* add readme
* cleanup legacy loadtest
---------
Co-authored-by: autofix-ci[bot] <114827586+autofix-ci[bot]@users.noreply.github.com>
2023-11-28 14:34:00 +08:00
Meng Zhang
d8e83d0610
refactor: extract run_app function ( #843 )
...
* refactor: extract run_app function
* lint
* change route to /metrics
* refactor
2023-11-20 01:00:35 +00:00
Jonathan Poisson
6dabecc3ee
feat: add Prometheus support to Tabby. ( #838 )
...
* Added Prometheus support to Tabby.
1) Added `axum-prometheus` to Cargo.toml
2) Added `metrics.rs` as a simple route to produce a metrics endpoint with prometheus-formatted events
3) Added `/v1/metrics` endpoint with API doc entry
4) Added the `PrometheusLayer` to the root layers.
This change effectively allows for external Prometheus to scrape metrics from Tabby during execution in order to monitor operations (resources, timings and overall usage).
* changed application/text to text/plain to adhere to rfc1341
* Update Makefile
* Update Makefile
* Update Makefile
* Update Makefile
* Update Makefile
* Update Makefile
* - Reworked code to fit upstream changes
- Added Prometheus layer and handle to worker.rs
* Update CHANGELOG.md
* [autofix.ci] apply automated fixes
* Simplified worker metrics route definition
* [autofix.ci] apply automated fixes
* [autofix.ci] apply automated fixes (attempt 2/3)
---------
Co-authored-by: Meng Zhang <meng@tabbyml.com>
Co-authored-by: autofix-ci[bot] <114827586+autofix-ci[bot]@users.noreply.github.com>
2023-11-19 15:40:57 -08:00
Meng Zhang
530e142d63
fix: keep only direct dependency, clean up path ( #827 )
2023-11-18 08:50:16 +00:00
Meng Zhang
e521f0637c
feat: add worker command worker::completion and worker::chat ( #778 )
2023-11-13 23:21:57 +00:00
Meng Zhang
febfa18e4a
refactor: move code api to tabby/serve ( #771 )
2023-11-12 22:58:15 +00:00
Meng Zhang
4d6dc626c0
chore: switch cargo clippy to nightly
2023-11-12 13:49:42 -08:00
Meng Zhang
15f768a971
feat: add tabby-webserver as distribution layer of tabby #769
2023-11-12 13:07:07 -08:00
Meng Zhang
2ee5dbfd4f
chore: move tabby-ui under ee license. ( #667 )
...
* chore: introduce tabby-ui EE license.
* update
2023-10-29 15:56:57 -07:00
Meng Zhang
14d03b6826
fix(ui): handle invalid semver error
2023-10-28 23:30:35 -07:00
Meng Zhang
9ecbf9031f
refactor: rename tabby-playground to tabby-ui ( #639 )
2023-10-25 23:05:11 +00:00
Meng Zhang
1d31b33ccc
chore(eval): move tabby-python-client to eval dir
2023-10-21 16:10:36 -07:00
Meng Zhang
82a94f28d3
chore: add update-python-client to Makefile
2023-10-21 15:49:18 -07:00
Meng Zhang
8a5be05253
chore: remove deprecated field in api doc
2023-10-21 15:40:38 -07:00
Meng Zhang
3f0342ccdf
chore: add update-openapi-doc to Makefile
2023-10-21 15:33:37 -07:00
Meng Zhang
98761c2a79
chore: adjust loadtest value based on release v0.3.0 ( #572 )
...
* chore: adjust loadtest value based on release v0.3.0
* Update default.loadtest.js
2023-10-16 15:13:26 -07:00
Meng Zhang
c5b2d8a074
chore: update bump-version for main branch
2023-10-13 17:53:06 -07:00
Meng Zhang
05038d8b7e
force all packages in release branch
2023-10-13 11:43:09 -07:00
Meng Zhang
2385b4a67b
chore: add bump-version and bump-release-version in Makefile
2023-10-13 11:28:29 -07:00
Meng Zhang
eb15933255
feat: add tabby playground for q&a use case ( #493 )
...
* init commit
* support chat
* add theme toggle
* limit message to 2 lines
* update
* update formatting
* update
* update
* update
* fix formatting
* update
2023-09-29 15:51:54 -07:00
Meng Zhang
2983f70d22
feat: build index from dataset ( #234 )
2023-06-12 19:21:27 +00:00
Meng Zhang
fcf9b4345f
refactor: cleanup unused dotfiles ( #198 )
2023-06-05 12:54:40 -07:00
Meng Zhang
614d993344
test: support TABBY_API_HOST in k6 tests
2023-04-04 11:14:22 +08:00
Meng Zhang
a241c08fc3
test: add loadtest
2023-04-02 21:27:08 +08:00
Meng Zhang
796ce8154e
test: add smoke tests
2023-04-02 21:26:58 +08:00
Meng Zhang
a5afed584f
Only install pre-commit in setup-development-environment
2023-03-29 17:04:10 +08:00
Meng Zhang
1c3ec20f93
Prepare public release with a minimal deployment setup ( #16 )
...
* Move deployment to deployment-next
* Add deployment setup
* Update deployment-next
* Remove vector label
* update README.md
2023-03-26 22:44:15 +08:00
Meng Zhang
b622bd6762
use TabbyML/NeoX-70M for minimal e2e deployment ( #10 )
...
* use TabbyML/NeoX-70M for minimal e2e deployment
* Use python3 of triton image
2023-03-25 17:39:40 +08:00
Meng Zhang
8cf533016a
Move python code under tabby/ ( #8 )
...
* Add tabby config file
* Rename train.yaml to trainer.yaml
* Change server to relative import
* Move source files into tabby
* Rename conf
2023-03-25 12:20:29 +08:00
Meng Zhang
3407253882
Improve Makefile flags
2023-03-25 00:11:53 +08:00
Meng Zhang
1038bb39a1
Add dagu for data processing job orchestration ( #7 )
...
* Install dagu
* Move dagu install to first stage
* Fix metrics
* Add DAGs for create dataset from code repository
2023-03-25 00:05:47 +08:00
Meng Zhang
edb3a72ad6
Move python scripts into tasks
2023-03-24 09:58:48 +08:00
Meng Zhang
a0b438da06
Add python transformer backend for tabby (mainly used for local dev / test in non-cuda environment) ( #6 )
...
* Add python backend
* Split docker-compose.triton.yml
* update makefile
2023-03-23 14:14:33 +08:00
Meng Zhang
df149fad61
Reduce repo size ( #5 )
...
* Remove binary files from git
* Add Makefile
* update
2023-03-23 13:10:59 +08:00
Meng Zhang
e24155fb3a
Add pre-commit
2023-03-16 17:56:09 +08:00
Meng Zhang
cf27c1a504
Add project preprocessing
2023-03-16 17:26:43 +08:00