Only while deployed, Config file YAML format is invalid: ENOENT: no such file or directory, open './librechat.yaml'

[chip-davis]

What happened?

Only while I am deployed, my config file is not being loaded.

Here is my config:

# For more information, see the Configuration Guide:
# https://www.librechat.ai/docs/configuration/librechat_yaml

# Configuration version (required)
version: 1.0.9

# Cache settings: Set to true to enable caching
cache: true

# Custom interface configuration
interface:
  # Privacy policy settings
  privacyPolicy:
    externalUrl: 'https://librechat.ai/privacy-policy'
  openNewTab: true
  # Terms of service
  termsOfService:
    externalUrl: 'https://librechat.ai/tos'
    openNewTab: true
fileConfig:
  openAI:
    disabled: false
  default:
    totalSizeLimit: 20

modelSpecs:
  enforce: true
  prioritize: true
  list:
    - name: "data analyze"
      label: "Data Analysis Test"

      preset:
        default: true
        endpoint: "assistants"
        assistant_id: "asst_id"

Here is my deploy-compose.yml:

version: "3.8"
services:
  api:
    # build:
    #   context: .
    #   dockerfile: Dockerfile.multi
    #   target: api-build
    image: ghcr.io/danny-avila/librechat-dev-api:latest
    container_name: LibreChat-API
    ports:
      - 3080:3080
    depends_on:
      - mongodb
      - rag_api
    restart: always
    extra_hosts:
    - "host.docker.internal:host-gateway"
    env_file:
      - .env
    environment:
      - HOST=0.0.0.0
      - NODE_ENV=production
      - MONGO_URI=mongodb://mongodb:27017/LibreChat
      - MEILI_HOST=http://meilisearch:7700
      - RAG_PORT=${RAG_PORT:-8000}
      - RAG_API_URL=http://rag_api:${RAG_PORT:-8000}
    volumes:
      - type: bind
        source: ./librechat.yaml
        target: /app/librechat.yaml
      - ./images:/app/client/public/images
      - ./logs:/app/api/logs
  client:
    build:
      context: .
      dockerfile: Dockerfile.multi
      target: prod-stage
    container_name: LibreChat-NGINX
    ports:
      - 80:80
      - 443:443
    depends_on:
      - api
    restart: always
    volumes:
      - ./client/nginx.conf:/etc/nginx/conf.d/default.conf
  mongodb:
    container_name: chat-mongodb
    # ports:  # Uncomment this to access mongodb from outside docker, not safe in deployment
    #   - 27018:27017
    image: mongo
    restart: always
    volumes:
      - ./data-node:/data/db
    command: mongod --noauth
  meilisearch:
    container_name: chat-meilisearch
    image: getmeili/meilisearch:v1.7.3
    restart: always
    # ports: # Uncomment this to access meilisearch from outside docker
    #   - 7700:7700 # if exposing these ports, make sure your master key is not the default value
    env_file:
      - .env
    environment:
      - MEILI_HOST=http://meilisearch:7700
      - MEILI_NO_ANALYTICS=true
    volumes:
      - ./meili_data_v1.7:/meili_data
  vectordb:
    image: ankane/pgvector:latest
    environment:
      POSTGRES_DB: mydatabase
      POSTGRES_USER: myuser
      POSTGRES_PASSWORD: mypassword
    restart: always
    volumes:
      - pgdata2:/var/lib/postgresql/data
  rag_api:
    image: ghcr.io/danny-avila/librechat-rag-api-dev-lite:latest
    environment:
      - DB_HOST=vectordb
      - RAG_PORT=${RAG_PORT:-8000}
    restart: always
    depends_on:
      - vectordb
    env_file:
      - .env

volumes:
  pgdata2:

When I exec into the container, I can see the config file inside of it. The same exact file works locally.

Steps to Reproduce

See above

What browsers are you seeing the problem on?

No response

Relevant log output

No response

Screenshots

No response

Code of Conduct

• I agree to follow this project's Code of Conduct

[danny-avila]

is the file at the root of the project, same location as deploy-compose.yml?

Can you run docker compose -f ./deploy-compose.yml down

followed by docker compose -f ./deploy-compose.yml up ?

[chip-davis]

Additional info: Latest version of Librechat, running on Ubuntu 20.04 on Azure. By the way, amazing app :)

I checked file permissions and gave it 777 but that still did not work. Defaulting back to the original file does nothing.
Output of tree:

azureuser@librechat-vm:~/LibreChat$ tree -La 1
.
├── .devcontainer
├── .dockerignore
├── .env
├── .env.example
├── .eslintrc.js
├── .git
├── .github
├── .gitignore
├── .husky
├── .nx.fong.swp
├── Dockerfile
├── Dockerfile.multi
├── LICENSE
├── README.md
├── api
├── bun.lockb
├── client
├── config
├── data-node
├── deploy-compose.yml
├── docker-compose.override.yml.example
├── docker-compose.yml
├── e2e
├── images
├── index.html
├── librechat.example.yaml
├── librechat.yaml
├── logs
├── meili_data_v1.7
├── package-lock.json
├── package.json
├── packages
├── prettier.config.js
├── rag.yml
└── utils

14 directories, 21 files

Docker compose up and exec into container:

azureuser@librechat-vm:~/LibreChat$ docker-compose -f ./deploy-compose.yml up --build -d
WARN[0000] /home/azureuser/LibreChat/deploy-compose.yml: `version` is obsolete
[+] Building 0.5s (7/7) FINISHED                                                                                                      docker:default
 => [client internal] load build definition from Dockerfile.multi                                                                               0.0s
 => => transferring dockerfile: 1.32kB                                                                                                          0.0s
 => [client internal] load metadata for docker.io/library/nginx:1.21.1-alpine                                                                   0.2s
 => [client internal] load .dockerignore                                                                                                        0.0s
 => => transferring context: 248B                                                                                                               0.0s
 => [client internal] load build context                                                                                                        0.0s
 => => transferring context: 2.80kB                                                                                                             0.0s
 => [client prod-stage 1/2] FROM docker.io/library/nginx:1.21.1-alpine@sha256:bfe377bdeb9ff37a62b49e149ac12c67a18089699bb844ce917fe3dbb834abed  0.0s
 => CACHED [client prod-stage 2/2] COPY ./client/nginx.conf /etc/nginx/conf.d/default.conf                                                      0.0s
 => [client] exporting to image                                                                                                                 0.0s
 => => exporting layers                                                                                                                         0.0s
 => => writing image sha256:4ea1025b4f077245719b31f1a82e0303997cb1aabaa21c0533a140b5c9aec9f2                                                    0.0s
 => => naming to docker.io/library/librechat-client                                                                                             0.0s
[+] Running 6/6
 ✔ Container librechat-vectordb-1  Started                                                                                                      0.0s
 ✔ Container chat-mongodb          Started                                                                                                      0.0s
 ✔ Container chat-meilisearch      Started                                                                                                      0.0s
 ✔ Container librechat-rag_api-1   Started                                                                                                      0.0s
 ✔ Container LibreChat-API         Started                                                                                                      0.0s
 ✔ Container LibreChat-NGINX       Started                                                                                                      0.0s
azureuser@librechat-vm:~/LibreChat$ docker exec -it LibreChat-API /bin/sh
/app/api # ls
add-balance.js      connect.js          install.js          loader.js           package-lock.json   stop-backend.js     update.js
app                 create-user.js      jest.config.js      login-logs.log      package.json        strategies          upgrade.js
ban-user.js         delete-user.js      jsconfig.json       logs                packages.js         test                user-stats.js
cache               deployed-update.js  lib                 models              prepare.js          translations        utils
config              helpers.js          list-balances.js    node_modules        server              typedefs.js
/app/api # cd ..
/app # ls
api             client          librechat.yaml
/app # cat librechat.yaml
# For more information, see the Configuration Guide:
# https://www.librechat.ai/docs/configuration/librechat_yaml

# Configuration version (required)
version: 1.0.9

# Cache settings: Set to true to enable caching
cache: true

# Custom interface configuration
interface:
  # Privacy policy settings
  privacyPolicy:
    externalUrl: 'https://librechat.ai/privacy-policy'
  openNewTab: true
  # Terms of service
  termsOfService:
    externalUrl: 'https://librechat.ai/tos'
    openNewTab: true
fileConfig:
  openAI:
    disabled: false
  default:
    totalSizeLimit: 20

modelSpecs:
  enforce: true
  prioritize: true
  list:
    - name: "data analyze"
      label: "Data Analysis Test""
      preset:
        default: true
        endpoint: "assistants"
        assistant_id: "asst_id"

# endpoints:
#   assistants:
#     disableBuilder: true
#     # Use either `supportedIds` or `excludedIds` but not both
#     supportedIds: ["asst_jCNHAyt0oSha6v80qHRcx8Lv"]
#     # excludedIds: ["asst_excludedAssistantId"]
#     # `privateAssistants` do not work with `supportedIds` or `excludedIds`
#     # privateAssistants: false
#     # (optional) Models that support retrieval, will default to latest known OpenAI models that support the feature
#     # retrievalModels: ["gpt-4-turbo-preview"]
#     # (optional) Assistant Capabilities available to all users. Omit the ones you wish to exclude. Defaults to list below.
#     # capabilities: ["code_interpreter", "retrieval", "actions", "tools", "image_vision"]
/app #

[danny-avila]

Thanks!

I'm not sure why, but it looks like the librechat.yaml file is outside of the ./api directory within the container. it should be inside of ./api

from your logs:

/app # ls
api             client          librechat.yaml
/app # cat librechat.yaml

I'm also a bit confused with your setup, because you're building the image, which looks to be the default docker-compose.yml image, but the deploy-compose file is referencing the remote image.

I run the deploy-compose file on a remote server, and here's what i get when i enter the container

root@librechat:~/LibreChat# docker exec -it LibreChat-API /bin/sh
/app/api # ls
add-balance.js      delete-user.js      list-balances.js    package.json        translations
app                 deployed-update.js  loader.js           packages.js         typedefs.js
ban-user.js         helpers.js          login-logs.log      prepare.js          update.js
cache               install.js          logs                server              upgrade.js
config              jest.config.js      models              stop-backend.js     user-stats.js
connect.js          jsconfig.json       node_modules        strategies          utils
create-user.js      lib                 package-lock.json   test

[danny-avila]

actually nevermind, i see it at /app root as well, but it's working on my end

root@librechat:~/LibreChat# docker exec -it LibreChat-API /bin/sh
/app/api # ls
add-balance.js      delete-user.js      list-balances.js    package.json        translations
app                 deployed-update.js  loader.js           packages.js         typedefs.js
ban-user.js         helpers.js          login-logs.log      prepare.js          update.js
cache               install.js          logs                server              upgrade.js
config              jest.config.js      models              stop-backend.js     user-stats.js
connect.js          jsconfig.json       node_modules        strategies          utils
create-user.js      lib                 package-lock.json   test
/app/api # cd ..
/app # ls
api             client          librechat.yaml
/app # cd ..

2024-06-07T20:04:58.575Z info: Custom config file loaded:
2024-06-07T20:04:58.576Z info: {

[chip-davis]

So weird, I am using the default deploy-compose. I just added this line
- ./librechat.yaml:/app/api/librechat.yaml
to the volumes section and it was able to load up the file! Thanks for the quick help 👍

[danny-avila]

hmm i wonder if that's something specific to azure, because my log outputs were identical to yours except the file would correctly load. glad that move to app/api worked for you and might try to prove this theory out soon

[RAPHCVR]

I have actually the same error message, but running docker in local, both on my Windows pc and Raspberry Pi 4

[RAPHCVR]

It seems I don't have at all this file, except for the librechat.example.yml

[chip-davis]

It seems I don't have at all this file, except for the librechat.example.yml

That's by design. You need to copy it or delete the example part and fill out the configurations that you need. There's a bunch of different options explained in the docs 😀

[rgknight]

I am getting the same error on Windows WSL after following the docker quickstart guide. I cloned the repo today.

I'm not intending to customize anything with the librechat.yml file. I converted the default librechat.example.yml file to librechat.yml and took the container down and up, but am getting the same error.

This is what I get in my logs when making a request to OpenAI with a valid api key:

{"code":"ENOENT","errno":-2,"level":"error","message":"Config file YAML format is invalid: ENOENT: no such file or directory, open '/app/librechat.yaml'","path":"/app/librechat.yaml","stack":"Error: ENOENT: no such file or directory, open '/app/librechat.yaml'\n    at Object.readFileSync (node:fs:448:20)\n    at loadYaml (/app/api/utils/loadYaml.js:6:27)\n    at loadCustomConfig (/app/api/server/services/Config/loadCustomConfig.js:36:20)\n    at AppService (/app/api/server/services/AppService.js:20:25)\n    at startServer (/app/api/server/index.js:36:9)\n    at process.processTicksAndRejections (node:internal/process/task_queues:95:5)","syscall":"open"}
{"level":"error","message":"Failed to fetch models from OpenAI API\nThe request either timed out or was unsuccessful. Error message:\n Cannot read properties of undefined (reading 'status')","stack":"TypeError: Cannot read properties of undefined (reading 'status')\n    at /app/packages/data-provider/dist/index.js:1:46338\n    at /app/packages/data-provider/dist/index.js:1:1930\n    at Object.next (/app/packages/data-provider/dist/index.js:1:2035)\n    at /app/packages/data-provider/dist/index.js:1:951\n    at new Promise (<anonymous>)\n    at x (/app/packages/data-provider/dist/index.js:1:696)\n    at /app/packages/data-provider/dist/index.js:1:46208\n    at process.processTicksAndRejections (node:internal/process/task_queues:95:5)\n    at async Axios.request (/app/node_modules/axios/dist/node/axios.cjs:3872:14)\n    at async fetchModels (/app/api/server/services/ModelService.js:68:17)\n    at Axios.request (/app/node_modules/axios/dist/node/axios.cjs:3877:41)\n    at process.processTicksAndRejections (node:internal/process/task_queues:95:5)\n    at async fetchModels (/app/api/server/services/ModelService.js:68:17)\n    at async fetchOpenAIModels (/app/api/server/services/ModelService.js:132:14)\n    at async getOpenAIModels (/app/api/server/services/ModelService.js:205:10)\n    at async loadDefaultModels (/app/api/server/services/Config/loadDefaultModels.js:22:22)\n    at async loadModels (/app/api/server/controllers/ModelController.js:26:31)\n    at async modelController (/app/api/server/controllers/ModelController.js:36:23)"}
{"level":"error","message":"Failed to fetch models from OpenAI API\nThe request either timed out or was unsuccessful. Error message:\n Cannot read properties of undefined (reading 'status')","stack":"TypeError: Cannot read properties of undefined (reading 'status')\n    at /app/packages/data-provider/dist/index.js:1:46338\n    at /app/packages/data-provider/dist/index.js:1:1930\n    at Object.next (/app/packages/data-provider/dist/index.js:1:2035)\n    at /app/packages/data-provider/dist/index.js:1:951\n    at new Promise (<anonymous>)\n    at x (/app/packages/data-provider/dist/index.js:1:696)\n    at /app/packages/data-provider/dist/index.js:1:46208\n    at process.processTicksAndRejections (node:internal/process/task_queues:95:5)\n    at async Axios.request (/app/node_modules/axios/dist/node/axios.cjs:3872:14)\n    at async fetchModels (/app/api/server/services/ModelService.js:68:17)\n    at Axios.request (/app/node_modules/axios/dist/node/axios.cjs:3877:41)\n    at process.processTicksAndRejections (node:internal/process/task_queues:95:5)\n    at async fetchModels (/app/api/server/services/ModelService.js:68:17)\n    at async fetchOpenAIModels (/app/api/server/services/ModelService.js:132:14)\n    at async getOpenAIModels (/app/api/server/services/ModelService.js:205:10)\n    at async loadDefaultModels (/app/api/server/services/Config/loadDefaultModels.js:27:22)\n    at async loadModels (/app/api/server/controllers/ModelController.js:26:31)\n    at async modelController (/app/api/server/controllers/ModelController.js:36:23)"}
{"cause":{"code":"ENOENT","errno":"ENOENT","message":"request to https://api.openai.com/v1/chat/completions failed, reason: connect ENOENT openAI","type":"system"},"level":"error","message":"[handleAbortError] AI response error; aborting request: Connection error.","stack":"Error: Connection error.\n    at OpenAI.makeRequest (/app/api/node_modules/openai/core.js:292:19)\n    at process.processTicksAndRejections (node:internal/process/task_queues:95:5)\n    at async ChatCompletionStream._createChatCompletion (/app/api/node_modules/openai/lib/ChatCompletionStream.js:53:24)\n    at async ChatCompletionStream._runChatCompletion (/app/api/node_modules/openai/lib/AbstractChatCompletionRunner.js:314:16)"}

[rgknight]

On a second look -- the OpenAI errors appear unrelated to the librechat.yaml file issues. I was able to mount the librechat.yaml file as a volume following the instructions for the docker-compose.override.yml, but the OpenAI connection errors persist.

I'm a little confused that I'm not getting an HTTP error in the error report, which is why I thought it was something related to the system not loading files:

{"cause":{"code":"ENOENT","errno":"ENOENT","message":"request to https://api.openai.com/v1/chat/completions failed, reason: connect ENOENT openAI","type":"system"},"level":"error","message":"[handleAbortError] AI response error; aborting request: Connection error.","stack":"Error: Connection error.\n    at OpenAI.makeRequest (/app/api/node_modules/openai/core.js:292:19)\n    at process.processTicksAndRejections (node:internal/process/task_queues:95:5)\n    at async ChatCompletionStream._createChatCompletion (/app/api/node_modules/openai/lib/ChatCompletionStream.js:53:24)\n    at async ChatCompletionStream._runChatCompletion (/app/api/node_modules/openai/lib/AbstractChatCompletionRunner.js:314:16)"}

[rgknight]

Update: The issue seems to be that I was running LibreChat from inside of wsl on Windows, and it wasn't able to access the network for some wsl / docker reason.

Loading the code to the Windows file system made everything work perfectly.

Thanks for an amazing project.

[danny-avila]

Update: The issue seems to be that I was running LibreChat from inside of wsl on Windows, and it wasn't able to access the network for some wsl / docker reason.

Loading the code to the Windows file system made everything work perfectly.

Thanks for an amazing project.

Thank you and thanks for sharing your findings!

[gerroon]

I have the same issue under Windows WSL. I tried mounting it in the volume section as mentioned and I see no solution result.

Has anyone find a real solution?

 Config file YAML format is invalid: ENOENT: no such file or directory, open '/app/librechat.yaml'

yyamlint says there are no errors after I deleted all the commented sections

yamllint librechat.yaml                                                                                                                                                            librechat.yaml
  1:1       warning  missing document start "---"  (document-start)
  37:23     warning  too few spaces before comment  (comments)
  44:21     warning  too few spaces before comment  (comments)
  48:24     warning  too few spaces before comment  (comments)
  50:34     warning  too few spaces before comment  (comments)
  52:36     warning  too few spaces before comment  (comments)

  volumes:
      - type: bind
        source: ./.env
        target: /app/.env
      - ./images:/app/client/public/images
      - ./logs:/app/api/logs
      - ./librechat.yaml:/app/api/librechat.yaml