myMPD WebUI very slow in the Browse tab #1305

991jo · 2024-06-04T07:59:31Z

991jo
Jun 4, 2024

Hi!

I am running myMPD as a satelite setup on a Raspberry Pi 4 and the music is mounted via webDAV. My music library is rather large:

# mpc stats
Artists:   6335
Albums:    8134
Songs:    97574

Play Time:    0 days, 0:00:00
Uptime:       73 days, 0:27:27
DB Updated:   Thu May 30 05:56:28 2024
DB Play Time: 293 days, 7:53:34

I have the issue, that when I am using the browse tab. Usually I have it set to 100 items per page and it takes several seconds to load all the covers. Also switching to the next page takes several seconds, if the covers are not loaded yet.
The same goes for searching.

Is this expected? Is there anything I can do to find out where the bottleneck is? Any known options to tweak?

jcorporation · 2024-06-04T15:25:42Z

jcorporation
Jun 4, 2024
Maintainer

MPD database size shouldn’t matter. Is only the fetching of the covers slow? Please post your mpd config.

0 replies

991jo · 2024-06-05T05:29:58Z

991jo
Jun 5, 2024
Author

This is the config on the Raspberry Pi running mpd as a satelite an which is also running myMPD.

music_directory "https://someuser:[email protected]/"

playlist_directory		"/var/lib/mpd/playlists"
state_file			"/var/lib/mpd/state"

sticker_file                   "/var/lib/mpd/sticker.sql"
#
###############################################################################



user				"mpd"
bind_to_address			"localhost"

database {
       plugin "proxy"
       host "localhost"
       port "6601"
}

input {
        plugin "curl"
}

audio_output {
	type 	"alsa"
	device	"hw:0,0"
	name	"HifiBerry"
	mixer_control "Digital"
	mixer_device "hw:0"
	mixer_index "0"
}

audio_output {
    type        "httpd"
    name        "HTTP Stream"
    encoder     "lame" #to support safari on ios
    port        "8000"
    bitrate     "128"
    format      "44100:16:1"
    always_on   "yes"
    tags        "yes"
}

decoder {
        plugin                  "hybrid_dsd"
        enabled                 "no"
#       gapless                 "no"
}
decoder {
        plugin        "wildmidi"
        enabled       "no"
        #config_file "/etc/timidity/timidity.cfg"
}

filesystem_charset		"UTF-8"

The database is connecting to localhost, because there is an SSH tunnel in place to add proper authentication and encryption to the database connection and to not expose the other end directly to the internet.

Generally only loading the covers is slow, however while it is loading covers many other things are slow, e.g. Searching, showing only a single album, appending tracks to the playlist, ...
An other effect that I can observe sometimes is that when loading covers and clicking on the pause button it takes some time to stop the music. It might also increase the progress bar of the currently playing track while the covers are still loading.
An other observation is that the albums which don't have a cover get their "no cover" image usually after all others have loaded.

Reducing the amount of items loaded reduces those loading times.

10 replies

jcorporation Jun 9, 2024
Maintainer

There is no planed release date, but it is feature complete. I will merge it after some tests next week into the devel branch. I think it could be released this month.

991jo Jul 1, 2024
Author

v16 is out now, so I updated and executed the script, however it fails.

I turned up logging to debug, here is the output:

Jul 01 10:35:35 raspberrypi mympd[115598]: DEBUG    scripts_workerQueue "script_worker_queue": 0 entries
Jul 01 10:35:35 raspberrypi mympd[115598]: DEBUG    scripts_workerGot response: {"jsonrpc":"2.0","id":3485584268,"result":{"method":"INTERNAL_API_SCRIPT_INIT","facility":"script","severity":"info","message":"ok","data":{}}}
Jul 01 10:35:35 raspberrypi mympd[115598]: DEBUG    scripts_worker"default": Populating global lua table mympd_state
Jul 01 10:35:35 raspberrypi mympd[115598]: DEBUG    mympdapi  Queue event
Jul 01 10:35:35 raspberrypi mympd[115598]: DEBUG    mympdapi  Queue "mympd_api_queue": 0 entries
Jul 01 10:35:35 raspberrypi mympd[115598]: DEBUG    mympdapi  "default": Queue event
Jul 01 10:35:35 raspberrypi mympd[115598]: DEBUG    mympdapi  "default": Leaving mpd idle mode
Jul 01 10:35:35 raspberrypi mympd[115598]: DEBUG    mympdapi  "default": Handle API request "MYMPD_API_DATABASE_ALBUM_LIST"
Jul 01 10:35:35 raspberrypi mympd[115598]: DEBUG    mympdapi  "default": MYMPD API request (0)(4139596415) MYMPD_API_DATABASE_ALBUM_LIST: {"jsonrpc":"2.0","id":0,"method":"MYMPD_API_DATABASE_ALBUM_LIST","params":{"sort":"Title","sortdesc":false,"limit":10000,"offset":0,"expression":"","fields":[]}}
Jul 01 10:35:35 raspberrypi mympd[115598]: DEBUG    mympdapi  Push response to script_worker_queue for thread 4139596415: {"jsonrpc":"2.0","id":4139596415,"result":{"method":"MYMPD_API_DATABASE_ALBUM_LIST","data":[{"Type": "album","AlbumId":"efed36ab-a344-409d-8cf6-0b231fb2e194","Duration":4437,"Last-Modified":1547580984,"uri":"Boys Noize/Oi Oi Oi/01 & Down.mp3","Discs":1,"SongCount":15,"FirstSongUri":"Boys Noize/Oi Oi Oi/01 & Down.mp3"},{"Type": "album","AlbumId":"e8195419-f0f0-4971-a923-d6277edd1032","Duration":3738,"Last-Modified":1549794874,"uri":"Compilations/Step Up/01 'Bout It.mp3","Discs":1,"SongCount":16,"FirstSongUri":"Compilations/Step Up/01 'Bout It.mp3"},{"Type": "album","AlbumId":"8145746a-b931-4f69-849d-19523317eb67","Duration":1492,"Last-Modified":1548120651,"uri":"Scoldt/Back to Mudd/01 'Til the End 2.0.mp3","Discs":1,"SongCount":6,"FirstSongUri":"Scoldt/Back to Mudd/01 'Til the End 2.0.mp3"},{"Type": "album","AlbumId":"8c8bde92-4c33-39dc-be53-e5109d3ff846","Duration":3973,"Last-Modified":1547587675,"uri":"Slipknot/Iowa/01 (515).mp...
Jul 01 10:35:35 raspberrypi mympd[115598]: DEBUG    scripts_workerQueue "script_worker_queue": 0 entries
Jul 01 10:35:35 raspberrypi mympd[115598]: DEBUG    mympdapi  "default": Entering mpd idle mode
Jul 01 10:35:36 raspberrypi mympd[115598]: DEBUG    scripts_workerGot response: {"jsonrpc":"2.0","id":4139596415,"result":{"method":"MYMPD_API_DATABASE_ALBUM_LIST","data":[{"Type": "album","AlbumId":"efed36ab-a344-409d-8cf6-0b231fb2e194","Duration":4437,"Last-Modified":1547580984,"uri":"Boys Noize/Oi Oi Oi/01 & Down.mp3","Discs":1,"SongCount":15,"FirstSongUri":"Boys Noize/Oi Oi Oi/01 & Down.mp3"},{"Type": "album","AlbumId":"e8195419-f0f0-4971-a923-d6277edd1032","Duration":3738,"Last-Modified":1549794874,"uri":"Compilations/Step Up/01 'Bout It.mp3","Discs":1,"SongCount":16,"FirstSongUri":"Compilations/Step Up/01 'Bout It.mp3"},{"Type": "album","AlbumId":"8145746a-b931-4f69-849d-19523317eb67","Duration":1492,"Last-Modified":1548120651,"uri":"Scoldt/Back to Mudd/01 'Til the End 2.0.mp3","Discs":1,"SongCount":6,"FirstSongUri":"Scoldt/Back to Mudd/01 'Til the End 2.0.mp3"},{"Type": "album","AlbumId":"8c8bde92-4c33-39dc-be53-e5109d3ff846","Duration":3973,"Last-Modified":1547587675,"uri":"Slipknot/Iowa/01 (515).mp3","Discs":1,"SongCount":14,"FirstSongUri"...
Jul 01 10:35:37 raspberrypi mympd[115598]: DEBUG    scripts_workerSetting dns server to udp://172.21.100.1:53
Jul 01 10:35:37 raspberrypi mympd[115598]: DEBUG    scripts_workerHTTP client connecting to "http://172.21.100.115:80/albumart?offset=0&uri=Boys%20Noize/Oi%20Oi%20Oi/01%20%26%20Down.mp3"
Jul 01 10:35:37 raspberrypi mympd[115598]: INFO     webserver Redirecting to https://172.21.100.115
Jul 01 10:35:37 raspberrypi mympd[115598]: DEBUG    webserver Sending 302 Found "https://172.21.100.115" to 3621
Jul 01 10:35:37 raspberrypi mympd[115598]: DEBUG    scripts_workerHTTP client response code "302"
Jul 01 10:35:37 raspberrypi mympd[115598]: INFO     webserver Connection "3621" closed
Jul 01 10:35:37 raspberrypi mympd[115598]: DEBUG    scripts_workerHTTP client connecting to "https://172.21.100.115"
Jul 01 10:35:37 raspberrypi mympd[115598]: DEBUG    webserver New connection id "3622" from [0:0:0:0:0:ffff:ac15:6473], connections: 7
Jul 01 10:35:37 raspberrypi mympd[115598]: DEBUG    webserver Init tls with cert "/var/lib/mympd/ssl/server.pem" and key "/var/lib/mympd/ssl/server.key" for connection "3622"
Jul 01 10:35:37 raspberrypi mympd[115598]: INFO     webserver HTTP request (3622): GET /
Jul 01 10:35:37 raspberrypi mympd[115598]: DEBUG    webserver Set connection 3622 to is_draining
Jul 01 10:35:37 raspberrypi mympd[115598]: INFO     webserver HTTP connection "3622" closed
Jul 01 10:35:37 raspberrypi mympd[115598]: DEBUG    scripts_workerHTTP client response code "200"
Jul 01 10:35:37 raspberrypi mympd[115598]: WARN     scripts_workerCould not determine mime type from bytes "1F8B0800000000000203EC3D"
Jul 01 10:35:37 raspberrypi mympd[115598]: WARN     scripts_workerNo extension found for mime_type "application/octet-stream"
Jul 01 10:35:37 raspberrypi mympd[115598]: INFO     scripts_worker"default": CovercachePrepopulate: Covercache: 1.0
Jul 01 10:35:37 raspberrypi mympd[115598]: DEBUG    scripts_workerSetting dns server to udp://172.21.100.1:53

<--- snip --->

Jul 01 10:35:49 raspberrypi mympd[115598]: DEBUG    scripts_workerHTTP client connecting to "https://172.21.100.115"
Jul 01 10:35:49 raspberrypi mympd[115598]: DEBUG    webserver New connection id "4808" from [0:0:0:0:0:ffff:ac15:6473], connections: 7
Jul 01 10:35:49 raspberrypi mympd[115598]: DEBUG    webserver Init tls with cert "/var/lib/mympd/ssl/server.pem" and key "/var/lib/mympd/ssl/server.key" for connection "4808"
Jul 01 10:35:49 raspberrypi mympd[115598]: INFO     webserver HTTP request (4808): GET /
Jul 01 10:35:49 raspberrypi mympd[115598]: DEBUG    webserver Set connection 4808 to is_draining
Jul 01 10:35:49 raspberrypi mympd[115598]: INFO     webserver HTTP connection "4808" closed
Jul 01 10:35:49 raspberrypi mympd[115598]: DEBUG    scripts_workerHTTP client response code "200"
Jul 01 10:35:49 raspberrypi mympd[115598]: WARN     scripts_workerCould not determine mime type from bytes "1F8B0800000000000203EC3D"
Jul 01 10:35:49 raspberrypi mympd[115598]: WARN     scripts_workerNo extension found for mime_type "application/octet-stream"
Jul 01 10:35:49 raspberrypi mympd[115598]: INFO     scripts_worker"default": CovercachePrepopulate: Covercache: 1.0
Jul 01 10:35:49 raspberrypi mympd[115598]: DEBUG    scripts_workerSetting dns server to udp://172.21.100.1:53
Jul 01 10:35:49 raspberrypi mympd[115598]: DEBUG    scripts_workerHTTP client connecting to "http://172.21.100.115:80/albumart?offset=0&uri=Strike%20Anywhere/To%20Live%20in%20Discontent/01%20Asleep.mp3"
Jul 01 10:35:49 raspberrypi mympd[115598]: INFO     webserver Redirecting to https://172.21.100.115
Jul 01 10:35:49 raspberrypi mympd[115598]: DEBUG    webserver Sending 302 Found "https://172.21.100.115" to 4809
Jul 01 10:35:49 raspberrypi mympd[115598]: DEBUG    scripts_workerHTTP client response code "302"
Jul 01 10:35:49 raspberrypi mympd[115598]: INFO     webserver Connection "4809" closed
Jul 01 10:35:49 raspberrypi mympd[115598]: DEBUG    scripts_workerHTTP client connecting to "https://172.21.100.115"
Jul 01 10:35:49 raspberrypi mympd[115598]: DEBUG    webserver New connection id "4810" from [0:0:0:0:0:ffff:ac15:6473], connections: 7
Jul 01 10:35:49 raspberrypi mympd[115598]: DEBUG    webserver Init tls with cert "/var/lib/mympd/ssl/server.pem" and key "/var/lib/mympd/ssl/server.key" for connection "4810"
Jul 01 10:35:49 raspberrypi mympd[115598]: INFO     webserver HTTP request (4810): GET /
Jul 01 10:35:49 raspberrypi mympd[115598]: DEBUG    webserver Set connection 4810 to is_draining
Jul 01 10:35:49 raspberrypi mympd[115598]: INFO     webserver HTTP connection "4810" closed
Jul 01 10:35:49 raspberrypi mympd[115598]: DEBUG    scripts_workerHTTP client response code "200"
Jul 01 10:35:49 raspberrypi mympd[115598]: WARN     scripts_workerCould not determine mime type from bytes "1F8B0800000000000203EC3D"
Jul 01 10:35:49 raspberrypi mympd[115598]: WARN     scripts_workerNo extension found for mime_type "application/octet-stream"
Jul 01 10:35:49 raspberrypi mympd[115598]: INFO     scripts_worker"default": CovercachePrepopulate: Covercache: 1.0
Jul 01 10:35:49 raspberrypi mympd[115598]: DEBUG    scripts_workerSetting dns server to udp://172.21.100.1:53
Jul 01 10:35:49 raspberrypi mympd[115598]: DEBUG    scripts_workerHTTP client connecting to "http://172.21.100.115:80/albumart?offset=0&uri=The%20Orb/Assassin/01%20Assassin%20%28The%20Oasis%20of%20Rhythms%20mix%29.mp3"
Jul 01 10:35:49 raspberrypi mympd[115598]: INFO     webserver Redirecting to https://172.21.100.115
Jul 01 10:35:49 raspberrypi mympd[115598]: DEBUG    webserver Sending 302 Found "https://172.21.100.115" to 4811
Jul 01 10:35:49 raspberrypi mympd[115598]: DEBUG    scripts_workerHTTP client response code "302"
Jul 01 10:35:49 raspberrypi mympd[115598]: INFO     webserver Connection "4811" closed
Jul 01 10:35:49 raspberrypi mympd[115598]: DEBUG    scripts_workerHTTP client connecting to "https://172.21.100.115"
Jul 01 10:35:49 raspberrypi mympd[115598]: DEBUG    webserver New connection id "4812" from [0:0:0:0:0:ffff:ac15:6473], connections: 7
Jul 01 10:35:49 raspberrypi mympd[115598]: DEBUG    webserver Init tls with cert "/var/lib/mympd/ssl/server.pem" and key "/var/lib/mympd/ssl/server.key" for connection "4812"
Jul 01 10:35:49 raspberrypi mympd[115598]: INFO     webserver HTTP request (4812): GET /
Jul 01 10:35:49 raspberrypi mympd[115598]: DEBUG    webserver Set connection 4812 to is_draining
Jul 01 10:35:49 raspberrypi mympd[115598]: INFO     webserver HTTP connection "4812" closed
Jul 01 10:35:49 raspberrypi mympd[115598]: DEBUG    scripts_workerHTTP client response code "200"
Jul 01 10:35:49 raspberrypi mympd[115598]: WARN     scripts_workerCould not determine mime type from bytes "1F8B0800000000000203EC3D"
Jul 01 10:35:49 raspberrypi mympd[115598]: WARN     scripts_workerNo extension found for mime_type "application/octet-stream"
Jul 01 10:35:49 raspberrypi mympd[115598]: INFO     scripts_worker"default": CovercachePrepopulate: Covercache: 1.0
Jul 01 10:35:49 raspberrypi mympd[115598]: ERROR    scripts_workerLua - caches_update_mtime: Invalid number of arguments
Jul 01 10:35:49 raspberrypi mympd[115598]: DEBUG    scripts_workerEnd script
Jul 01 10:35:49 raspberrypi mympd[115598]: DEBUG    scripts_workerLua script returns 1 values
Jul 01 10:35:49 raspberrypi mympd[115598]: DEBUG    scripts_worker"default": Push websocket notify to queue: "{"jsonrpc":"2.0","method":"notify","params":{"facility":"script","severity":"error","message":"Error executing script %{script}: %{msg}","data":{"script":"CovercachePrepopulate","msg":"Unknown error: Invalid number of arguments"}}}"
Jul 01 10:35:49 raspberrypi mympd[115598]: ERROR    scripts_worker"default": Error executing script CovercachePrepopulate: Unknown error: Invalid number of arguments
Jul 01 10:35:49 raspberrypi mympd[115598]: DEBUG    webserver Queue "web_server_queue": 0 entries
Jul 01 10:35:49 raspberrypi mympd[115598]: DEBUG    webserver "default": Sending notify to conn_id "27": {"jsonrpc":"2.0","method":"notify","params":{"facility":"script","severity":"error","message":"Error executing script %{script}: %{msg}","data":{"script":"CovercachePrepopulate","msg":"Unknown error: Invalid number of arguments"}}}

The messages shown here repeat themselves many hundred times.

jcorporation Jul 1, 2024
Maintainer

myMPD does not recognize the filetype of the images. ~~Which filetype have your cover images?~~

1F8B means gzip compressed, is there a compressing proxy between? Compression of images is mostly useless.

Commit 25ca73c (devel branch) adds an "Accept-Encoding: none" header to http client requests.

I also updated the script itself to fix a logging bug.

991jo Jul 8, 2024
Author

There is no proxy in front of the mympd server. However the music directory is served via rclone server and a caddy webserver in front of that.

I updated to the current version that includes the encoding header and updated the script. The gzipped cover images appear to be regular images, the ones I checked appear to be jpegs.

The script now runs and returns:

Jul 08 21:06:40 raspberrypi mympd[140000]: DEBUG    scripts_worker  End script
Jul 08 21:06:40 raspberrypi mympd[140000]: DEBUG    scripts_worker  Lua script returns 1 values
Jul 08 21:06:40 raspberrypi mympd[140000]: DEBUG    scripts_worker  "default": Push websocket notify to queue: "{"jsonrpc":"2.0","method":"notify","params":{"facility":"script","severity":"info","message":"Existing: 155, Downloaded: 8229, Errors: 0","data":{}}}"

However there are only ~800 covers in the covercache directory now. I expected there to be way more since each of the albums without a cover should get the fallback .svg cover. However there are now .svg files in the covercache directory.

jcorporation Jul 8, 2024
Maintainer

The script writes no placeholder image if the mympd.cache_cover_write function returns an error.

I pushed an updates version to the script repository.

Provide feedback

Saved searches

Use saved searches to filter your results more quickly

myMPD WebUI very slow in the Browse tab #1305

{{title}}

Replies: 2 comments 10 replies

{{title}}

{{title}}

{{title}}

{{title}}

{{title}}

{{editor}}'s edit

{{editor}}'s edit

{{title}}

{{title}}

Select a reply

myMPD WebUI very slow in the Browse tab #1305

991jo Jun 4, 2024

Replies: 2 comments · 10 replies

jcorporation Jun 4, 2024 Maintainer

991jo Jun 5, 2024 Author

jcorporation Jun 9, 2024 Maintainer

991jo Jul 1, 2024 Author

jcorporation Jul 1, 2024 Maintainer

991jo Jul 8, 2024 Author

jcorporation Jul 8, 2024 Maintainer

991jo
Jun 4, 2024

Replies: 2 comments 10 replies

jcorporation
Jun 4, 2024
Maintainer

991jo
Jun 5, 2024
Author

jcorporation Jun 9, 2024
Maintainer

991jo Jul 1, 2024
Author

jcorporation Jul 1, 2024
Maintainer

991jo Jul 8, 2024
Author

jcorporation Jul 8, 2024
Maintainer