Code

sync master#7

Code

Merged

tc-mb merged 47 commits intoprepare-PR-of-minicpm-v2.5OpenBMB/llama.cpp:prepare-PR-of-minicpm-v2.5from prepare-PROpenBMB/llama.cpp:prepare-PRCopy head branch name to clipboardMay 28, 2024

+3,613-570

Commits

Commits on May 23, 2024

• readme : add GPT-NeoX + Pythia to the list of supported models (ggerganov#7491)

  felladrin

  authored
  dacfceb

  Copy full SHA for dacfceb

• ci : use Pythia models instead of OpenLlama (ggerganov#7470)

  Show description for 55ac3b7
  ggerganov

  authored
  55ac3b7

  Copy full SHA for 55ac3b7

• llama : add getters for n_threads/n_threads_batch (ggerganov#7464)

  Show description for 3015851
  danbev

  authored
  3015851

  Copy full SHA for 3015851

• readme : add Bunny in supported models [no ci] (ggerganov#7469)

  criminact

  authored
  8b94e79

  Copy full SHA for 8b94e79

• Fix phi3 chat template confusion with zephyr (ggerganov#7449)

  Show description for 007489e
  

  tristandruyen

  and

  ngxson

  authored
  007489e

  Copy full SHA for 007489e

• ggml : silence UB sanitizer error during iq2_xxs quantization (#0)

  ggerganov

  committed
  1debe72

  Copy full SHA for 1debe72

• readme : remove trailing space (ggerganov#7469)

  ggerganov

  committed
  74f33ad

  Copy full SHA for 74f33ad

Commits on May 24, 2024

• add build shared lib in win release package (ggerganov#7438)

  arthw

  authored
  0df0aa8

  Copy full SHA for 0df0aa8

• Add support for ArcticForCausalLM (ggerganov#7020)

  Show description for fbca2f2
  

  fairydreaming

  and

  sszymczy

  authored
  fbca2f2

  Copy full SHA for fbca2f2

• docker.yml: disable light-intel and server-intel test (ggerganov#7515)

  Show description for 27891f6
  mofosyne

  authored
  27891f6

  Copy full SHA for 27891f6

• flake.lock: Update (ggerganov#7232)

  Show description for d041d2c
  

  ggerganov

  and

  github-actions[bot]

  authored
  d041d2c

  Copy full SHA for d041d2c

Commits on May 25, 2024

• gguf-py : fix and simplify quantized shape round-trip (ggerganov#7483)

  Show description for b83bab1
  compilade

  authored
  b83bab1

  Copy full SHA for b83bab1

• Make tokenize CLI tool have nicer command line arguments. (ggerganov#6188)

  Show description for 5768433
  

  3 peopleauthored
  5768433

  Copy full SHA for 5768433

• fix missing slash in fs_get_cache_directory() (ggerganov#7503)

  Show description for 902184d
  ngxson

  authored
  902184d

  Copy full SHA for 902184d

• android : module (ggerganov#7502)

  Show description for 9791f40
  eltonkola

  authored
  9791f40

  Copy full SHA for 9791f40

• ggml: aarch64: SVE kernels for q8_0_q8_0, q4_0_q8_0 vector dot (ggerganov#7433)

  Show description for faa0e69
  msy-kato

  authored
  faa0e69

  Copy full SHA for faa0e69

• main : don't print special tokens with --grammar (ggerganov#6923)

  Show description for 00c6390
  

  jart

  and

  mofosyne

  authored
  00c6390

  Copy full SHA for 00c6390

• labeler: added Apple Metal detector (+Kompute) (ggerganov#7529)

  Show description for 3cbd23e
  mofosyne

  authored
  3cbd23e

  Copy full SHA for 3cbd23e

• train : change default FA argument (ggerganov#7528)

  ggerganov

  committed
  9588f19

  Copy full SHA for 9588f19

Commits on May 26, 2024

• SimpleChat Completion Mode flexibility and cleanup, Settings gMe, Optional sliding window (ggerganov#7480)

  Show description for b9adcbb
  hanishkvc

  authored
  b9adcbb

  Copy full SHA for b9adcbb

• Readme: add akx/ggify to tools (ggerganov#1484)

  akx

  authored
  9146d36

  Copy full SHA for 9146d36

• llama : add Smaug 70B support (ggerganov#7402)

  bartowski1182

  authored
  c429b33

  Copy full SHA for c429b33

• Fix aya-23 conversion scripts (ggerganov#7539)

  Galunid

  authored
  32a2821

  Copy full SHA for 32a2821

• main: replace --no-special with --special (ggerganov#7534)

  Show description for d298382
  mofosyne

  authored
  d298382

  Copy full SHA for d298382

• flake.lock: Update (ggerganov#7540)

  Show description for dff451c
  

  ggerganov

  and

  github-actions[bot]

  authored
  dff451c

  Copy full SHA for dff451c

Commits on May 27, 2024

• github: add self sorted issue ticket forms (ggerganov#7543)

  Show description for d6ef0e7
  mofosyne

  authored
  d6ef0e7

  Copy full SHA for d6ef0e7

• llama : add comments about experimental flags (ggerganov#7544)

  ggerganov

  authored
  eaf6e03

  Copy full SHA for eaf6e03

• metal : disable FA kernel for HS=256 (ggerganov#7556)

  Show description for 62bfef5
  ggerganov

  authored
  62bfef5

  Copy full SHA for 62bfef5

• metal : add GGML_OP_REPEAT kernels (ggerganov#7557)

  Show description for 1d8fca7
  ggerganov

  authored
  1d8fca7

  Copy full SHA for 1d8fca7

• Add freq factors (ggerganov#7495)

  AidanBeltonS

  authored
  5487593

  Copy full SHA for 5487593

• Fix q_xxs using mul_mat_q (ggerganov#7459)

  AidanBeltonS

  authored
  95f84d5

  Copy full SHA for 95f84d5

• Allow multiple copy function pointers for CUDA graph kernel param updates (ggerganov#7565)

  Show description for 197c006
  agray3

  authored
  197c006

  Copy full SHA for 197c006

• make: add --device-debug to NVCC debug flags (ggerganov#7542)

  JohannesGaessler

  authored
  10b1e45

  Copy full SHA for 10b1e45

• adding in x64 targets to cmake presets (ggerganov#7574)

  kunnis

  authored
  0136966

  Copy full SHA for 0136966

• update HIP_UMA ggerganov#7399 (ggerganov#7414)

  Show description for 852aafb
  

  Djip007

  and

  slaren

  authored
  852aafb

  Copy full SHA for 852aafb

Commits on May 28, 2024

• llava : update clip.h (ggerganov#7580)

  Show description for 74b239b
  eltociear

  authored
  74b239b

  Copy full SHA for 74b239b

• Markdownish code block fix (ggerganov#7571)

  Show description for c417671
  nathan-sixnines

  authored
  c417671

  Copy full SHA for c417671

• server: do not remove whitespace at the start of a completion chunk (ggerganov#7524)

  mgroeber9110

  authored
  9335b96

  Copy full SHA for 9335b96

• ggml : generalize GGML_OP_CONCAT (ggerganov#7563)

  Show description for 0548a41
  ggerganov

  authored
  0548a41

  Copy full SHA for 0548a41

• [SYCL]fix ggml_sycl_mul_mat_id() to match the change of api (ggerganov#7436)

  Show description for e2b0650
  arthw

  authored
  e2b0650

  Copy full SHA for e2b0650

• github: add refactor to issue template (ggerganov#7561)

  Show description for 271ff3f
  mofosyne

  authored
  271ff3f

  Copy full SHA for 271ff3f

• llama : handle unknown utf8 bytes (ggerganov#7588)

  ggerganov

  authored
  8b99e2a

  Copy full SHA for 8b99e2a

• tests : fix test-tokenizer-0.sh

  ggerganov

  committed
  edc2943

  Copy full SHA for edc2943

• Add support for DeepseekV2ForCausalLM (ggerganov#7519)

  Show description for ee3dff6
  

  fairydreaming

  and

  sszymczy

  authored
  ee3dff6

  Copy full SHA for ee3dff6

• rpc : resource management rework (ggerganov#7562)

  Show description for 2b737ca
  rgerganov

  authored
  2b737ca

  Copy full SHA for 2b737ca

• vulkan: properly initialize vulkan devices for LLAMA_SPLIT_MODE_NONE (ggerganov#7552)

  Adriankhl

  authored
  56411a9

  Copy full SHA for 56411a9

• Merge branch 'prepare-PR-of-minicpm-v2.5' into prepare-PR

  tc-mb

  authored
  8767ce2

  Copy full SHA for 8767ce2