root
/
tabby
mirror of https://gitee.com/zhang_1334717033/tabby.git
1
0
Fork 0
Code Issues Packages Projects Releases Wiki Activity

docs: improve tabby blogpost

release-0.2
Meng Zhang 2023-09-17 17:46:15 +08:00
parent ac057f8a2f
commit 05106889d9
2 changed files with 11 additions and 1 deletions
Show Stats Download Patch File Download Diff File Expand all files Collapse all files

9
website/blog/2023-09-18-release-0-1-1-metal/index.md
View File

@ -1,9 +1,16 @@
---
authors: [ meng ]
---
# Highlights of Tabby v0.1.1: Apple M1/M2 Support
# Tabby v0.1.1: Metal inference and StarCoder supports in llama.cpp!
We are thrilled to announce the release of Tabby [v0.1.1](https://github.com/TabbyML/tabby/releases/tag/v0.1.1) 👏🏻.
<center>
![Staring tabby riding on llama.cpp](./staring-tabby-on-llama-cpp.png)
</center>
Apple M1/M2 Tabby users can now harness Metal inference support on Apple's M1 and M2 chips by using the `--device metal` flag, thanks to [llama.cpp](https://github.com/ggerganov/llama.cpp)'s awesome metal support.
The Tabby team made a [contribution](https://github.com/ggerganov/llama.cpp/pull/3187) by adding support for the StarCoder series models (1B/3B/7B) in llama.cpp, enabling more appropriate model usage on the edge for completion use cases.

3
website/blog/2023-09-18-release-0-1-1-metal/staring-tabby-on-llama-cpp.png Normal file
View File

@ -0,0 +1,3 @@
version https://git-lfs.github.com/spec/v1
oid sha256:6353801e36b9a36aa37936aef0b92f7105d837764f05b93ff8aea8bbb3ce9715
size 518921