34 lines
1.2 KiB
Markdown
34 lines
1.2 KiB
Markdown
<div align="center">
|
|
|
|
# 🐾 Tabby
|
|
|
|
[](https://opensource.org/licenses/Apache-2.0)
|
|
[](https://github.com/psf/black)
|
|

|
|
|
|

|
|
|
|
</div>
|
|
|
|
> **Warning**
|
|
> Tabby is still in the alpha phrase
|
|
|
|
An opensource / on-prem alternative to GitHub Copilot.
|
|
|
|
## Features
|
|
|
|
* Self-contained, with no need for a DBMS or cloud service
|
|
* Web UI for visualizing and configuration models and MLOps.
|
|
* OpenAPI interface, easy to integrate with existing infrastructure (e.g Cloud IDE).
|
|
* Consumer level GPU supports (FP-16 weight loading with various optimization).
|
|
|
|
## Getting started
|
|
To get started with Tabby, see the [docs/deployment](./docs/deployment.md).
|
|
|
|
## TODOs
|
|
|
|
* [ ] Fine-tuning models on private code repository.
|
|
* [ ] Plot metrics in admin panel (e.g acceptance rate).
|
|
* [ ] Production ready (Open Telemetry, Prometheus metrics).
|
|
* [ ] Token streaming using Server-Sent Events (SSE)
|