root
/
tabby
mirror of https://gitee.com/zhang_1334717033/tabby.git
1
0
Fork 0
Code Issues Packages Projects Releases Wiki Activity

docs: fix title for the decoding blog

add-llama-model-converter
Meng Zhang 2023-10-26 06:02:30 -07:00 committed by GitHub
parent e08a08b566
commit 6e59aa8d81
No known key found for this signature in database
GPG Key ID: 4AEE18F83AFDEB23
1 changed files with 2 additions and 2 deletions
Show Stats Download Patch File Download Diff File Expand all files Collapse all files

2
website/blog/2023-10-21-incremental-decoding/index.md
View File

@ -5,7 +5,7 @@ tags: [tech design]
image: ./twitter-decoding.png
---
# Decoding the Decoding in Tabby
# Decode the Decoding in Tabby
In the context of the Transformer model, which is widely used across LLMs, ***decoding*** refers to the process of generating an output sequence from an encoded input. Tabby recenty [implemented ***incremental decoding***](https://github.com/TabbyML/tabby/pull/491) as part of the greedy search. This blog will explain our thoughts behind this 🛠️💡.