Meng Zhang fd1baff8d5 feat: support stop sequences [TAB-52] (#212) ... * refactor: pass step and string token to callback * add token to callback * add stop regexp * implement stop words logic * pass token_ids from inference * improve effiency of regexp match with reversed regex * fmt * add typescript and javascript stop words * add cache for stop words regexp		2023-06-06 23:28:58 +00:00
..
ctranslate2.h	feat: support stop sequences [TAB-52] (#212)	2023-06-06 23:28:58 +00:00