Code

Add with_sequence for decode stream#1725

Code

Draft

ArthurZucker wants to merge 7 commits intomainhuggingface/tokenizers:mainfrom update-streamhuggingface/tokenizers:update-streamCopy head branch name to clipboard

+39-24

Commits

Commits on Jan 21, 2025

• nits

  ArthurZucker

  committed
  b7947d1

  Copy full SHA for b7947d1

• with

  ArthurZucker

  committed
  2ce721b

  Copy full SHA for 2ce721b

• update

  ArthurZucker

  committed
  46be059

  Copy full SHA for 46be059

• update

  ArthurZucker

  committed
  69206e2

  Copy full SHA for 69206e2

• zut

  ArthurZucker

  committed
  24d1068

  Copy full SHA for 24d1068

• & bad

  ArthurZucker

  committed
  3e19357

  Copy full SHA for 3e19357

• stub

  ArthurZucker

  committed
  d1a7c66

  Copy full SHA for d1a7c66