Models are not downloaded

[mrwsl]

A follow-up issue from a discussion over at nextcloud AIO.

The examples provided for the models.yaml are not working as in: they are not getting downloaded. To my knowledge this is because there are merges happening in localai's index.yaml. One work around is to create a complete entry for a chosen model like:

curl -s https://raw.githubusercontent.com/mudler/LocalAI/refs/heads/master/gallery/index.yaml | yq '.[] | select(.name == "whisper-large-q5_0")' -y

resulting in something like this

- url: github:mudler/LocalAI/gallery/[email protected]
  name: whisper-large-q5_0
  icon: https://avatars.githubusercontent.com/u/14957082
  license: MIT
  urls:
    - https://github.com/ggerganov/whisper.cpp
    - https://huggingface.co/ggerganov/whisper.cpp
  overrides:
    parameters:
      model: ggml-model-whisper-large-q5_0.bin
  files:
    - filename: ggml-model-whisper-large-q5_0.bin
      uri: https://ggml.ggerganov.com/ggml-model-whisper-large-q5_0.bin
      sha256: 3a214837221e4530dbc1fe8d734f302af393eb30bd0ed046042ebf4baf70f6f2
  description: "Port of OpenAI's Whisper model in C/C++

    "

It is important to change @master to a version like done above, or else localai will complain about missing configuration.

So this is a weird one since this seems to be an issue for localai. It still might be worth providing an instruction or examples to get the community container working.