Code

Adding inference endpoints models#12

Code

Merged

clefourrier merged 18 commits intomainhuggingface/lighteval:mainfrom adding_inference_endpointshuggingface/lighteval:adding_inference_endpointsCopy head branch name to clipboardFeb 7, 2024

+940-415

Commits

Commits on Feb 2, 2024

• wip

  clefourrier

  committed
  246b581

  Copy full SHA for 246b581

Commits on Feb 5, 2024

• add base model + wrap up inference endpoint model

  clefourrier

  committed
  9579f9e

  Copy full SHA for 9579f9e

• added config

  clefourrier

  committed
  601ac95

  Copy full SHA for 601ac95

• add configs + main launcher

  clefourrier

  committed
  6075955

  Copy full SHA for 6075955

• endpoints must be lowercase, added a timeout

  clefourrier

  committed
  eb28208

  Copy full SHA for eb28208

Commits on Feb 6, 2024

• use requests in datasets

  clefourrier

  committed
  3583071

  Copy full SHA for 3583071

• finished making the endpoints work! héhé

  clefourrier

  committed
  1cd850b

  Copy full SHA for 1cd850b

• simplification part 1

  clefourrier

  committed
  e74ae0a

  Copy full SHA for e74ae0a

• Merge branch 'main' into adding_inference_endpoints

  clefourrier

  committed
  203692a

  Copy full SHA for 203692a

• fix model type

  clefourrier

  committed
  5cfeb9a

  Copy full SHA for 5cfeb9a

• wip, need to debug tests

  clefourrier

  committed
  e3cbe24

  Copy full SHA for e3cbe24

Commits on Feb 7, 2024

• fix suite 1

  clefourrier

  committed
  d9b262f

  Copy full SHA for d9b262f

• fix test suite 2

  clefourrier

  committed
  cc1e7dd

  Copy full SHA for cc1e7dd

• pass 1 after code review

  clefourrier

  committed
  9b0fe54

  Copy full SHA for 9b0fe54

• Update src/lighteval/models/base_model.py

  Show description for dc454fd
  

  clefourrier

  and

  NathanHB

  authored
  dc454fd

  Copy full SHA for dc454fd

• revert name + add import fix

  clefourrier

  committed
  827488e

  Copy full SHA for 827488e

• Merge branch 'main' into adding_inference_endpoints

  clefourrier

  committed
  b13b302

  Copy full SHA for b13b302

• add comment back

  clefourrier

  committed
  2c650c9

  Copy full SHA for 2c650c9