root
/
tabby
mirror of https://gitee.com/zhang_1334717033/tabby.git
1
0
Fork 0
Code Issues Packages Projects Releases Wiki Activity
643 Commits
39 Branches
72 Tags
22 MiB
Rust 73.6%
Python 20.6%
C++ 3.1%
Shell 0.7%
Dockerfile 0.6%
Other 1.4%
 
 
 
 
 
 
Go to file
Meng Zhang 486e507079
fix: correct Decoding behavior in incremental manner (#491) 
* feat: implement IncrementalDecoding

* refactor: use IncrementalDecoding for ctranslate2

* refactor: rename StopWords to DecodingFactory

* refactor: move decoding logic to tabby-inference

* feat: optimize decoding range

* cleanup
 		2023-09-29 13:06:47 +00:00
.github feat(intellij): update tabby-agent to 0.3.1. (#490) 2023-09-29 03:06:47 -07:00
ci Revert "chore: add RELEASE_NOTES.md" 2023-08-31 10:11:29 +08:00
clients feat(intellij): update tabby-agent to 0.3.1. (#490) 2023-09-29 03:06:47 -07:00
crates fix: correct Decoding behavior in incremental manner (#491) 2023-09-29 13:06:47 +00:00
experimental fix: make sure modelscope README.md is longer than 200 characters 2023-09-26 21:56:01 -07:00
python/tabby feat: cleanup trainer with new data format 2023-06-13 12:48:27 -07:00
tests test: support TABBY_API_HOST in k6 tests 2023-04-04 11:14:22 +08:00
website docs: add default social image 2023-09-22 00:29:00 +08:00
.dockerignore fix: git information in health API response [TAB-177] (#375) 2023-08-29 18:19:54 +08:00
.gitattributes Add docker compose (#3) 2023-03-22 02:42:47 +08:00
.gitignore refactor: 💡 Add some .gitignore rules 2023-09-11 09:58:47 +08:00
.gitmodules refactor: use TabbyML/llama.cpp submodule 2023-09-03 12:38:54 +08:00
.rustfmt.toml refactor: rust nightly format (#197) 2023-06-05 14:17:07 -07:00
Cargo.lock fix: correct Decoding behavior in incremental manner (#491) 2023-09-29 13:06:47 +00:00
Cargo.toml fix: correct Decoding behavior in incremental manner (#491) 2023-09-29 13:06:47 +00:00
Dockerfile feat: Update Dockerfile to ctranslate 3.20.0 (#460) 2023-09-19 14:12:35 +08:00
LICENSE Create LICENSE 2023-03-16 17:28:10 +08:00
MODEL_SPEC.md docs: add model spec (unstable) version (#457) 2023-09-18 15:48:03 +08:00
Makefile feat: build index from dataset (#234) 2023-06-12 19:21:27 +00:00
README.md docs: add archived section in what's new 2023-09-26 12:10:57 -07:00
package.json refactor(agent): agent http request and cancellation flow. (#446) 2023-09-15 11:05:46 +08:00
yarn.lock Refactor completion request statistics (#474) 2023-09-26 03:01:38 -07:00

README.md

🐾 Tabby

build status Docker pulls License Slack Community

Tabby is a self-hosted AI coding assistant, offering an open-source and on-premises alternative to GitHub Copilot. It boasts several key features:

  • Self-contained, with no need for a DBMS or cloud service.
  • OpenAPI interface, easy to integrate with existing infrastructure (e.g Cloud IDE).
  • Supports consumer-grade GPUs.

Open in Playground

Demo

🔥 What's New

  • 09/21/2023 We've hit 10K stars 🌟 on GitHub! 🚀🎉👏
  • 09/18/2023 Apple's M1/M2 Metal inference support has landed in v0.1.1!
  • 08/31/2023 Tabby's first stable release v0.0.1 🥳.
Archived

👋 Getting Started

The easiest way to start a Tabby server is by using the following Docker command:

docker run -it \
  --gpus all -p 8080:8080 -v $HOME/.tabby:/data \
  tabbyml/tabby \
  serve --model TabbyML/SantaCoder-1B --device cuda

For additional options (e.g inference type, parallelism), please refer to the documentation at https://tabbyml.github.io/tabby.

🤝 Contributing

Get the Code

git clone --recurse-submodules https://github.com/TabbyML/tabby
cd tabby

If you have already cloned the repository, you could run the git submodule update --recursive --init command to fetch all submodules.

Build

  1. Set up the Rust environment by following this tutorial.

  2. Install the required dependencies:

# For MacOS
brew install protobuf

# For Ubuntu / Debian
apt-get install protobuf-compiler libopenblas-dev
  1. Now, you can build Tabby by running the command cargo build.

Start Hacking!

... and don't forget to submit a Pull Request

🌟 Star History

Star History Chart