tabby/README.md

839 B

🐾 Tabby

License Code style: black

Warning This repository is undering heavy construction, everything changes fast.

Contents

  • server: API server for completion requests. It also provides APIs for logging users' selections, which could be used for RLHF.
  • tabformer: NOT RELEASED Distributed trainer for tabby models.
  • preprocess: Preprocess files into datasets
  • converter: Converts a transformers causal LM model into TensorRT / FasterTransformer serving formats.