Code

mixeval evaluator#106

Code

Open

sordonia wants to merge 13 commits intomainmicrosoft/mttl:mainfrom mixevalmicrosoft/mttl:mixevalCopy head branch name to clipboard

+246-9

Commits

Commits on Sep 1, 2024

• mixeval evaluator

  

  Alessandro Sordoni

  committed
  21481c0

  Copy full SHA for 21481c0

• inject model

  

  Alessandro Sordoni

  committed
  54faf2c

  Copy full SHA for 54faf2c

• inject model by threading.local instead of using the args

  

  Alessandro Sordoni

  committed
  e7b2882

  Copy full SHA for e7b2882

• provide mixevalconfig

  

  Alessandro Sordoni

  committed
  530e22a

  Copy full SHA for 530e22a

• mixeval config

  

  Alessandro Sordoni

  committed
  dce1483

  Copy full SHA for dce1483

• gpt-4o by default

  

  Alessandro Sordoni

  committed
  bdd0562

  Copy full SHA for bdd0562

• gpt-4o-mini by default

  

  Alessandro Sordoni

  committed
  de5173b

  Copy full SHA for de5173b

• return value fix

  

  Alessandro Sordoni

  committed
  a71c7b0

  Copy full SHA for a71c7b0

• guard task-names

  

  Alessandro Sordoni

  committed
  25987ed

  Copy full SHA for 25987ed

• raise only if context is defined

  

  Alessandro Sordoni

  committed
  8888803

  Copy full SHA for 8888803

Commits on Sep 3, 2024

• recompute flag

  

  Alessandro Sordoni

  committed
  09a5688

  Copy full SHA for 09a5688

Commits on Sep 23, 2024

• add base_url_api

  shuishen112

  committed
  07b0e65

  Copy full SHA for 07b0e65

Commits on Sep 25, 2024

• Merge branch 'main' into mixeval

  shuishen112

  committed
  18ca89a

  Copy full SHA for 18ca89a