Allow multiple AIO instances on the same server

[marcatsmci]

All in the title : how to achieve this ?

[ghost]

I would like that too

[johnnyq]

I second this as well

[ghost]

but please independent of each other that means that different domains are used for each instance and also stun and turn server etc run over the different domains

[johnnyq]

@R7JANV1 Technically the Turn and Stun server would have to be shared amongst the Nextcloud instances if running from the same public IP but I could be wrong

[johnnyq]

I actually requested this before see #49
But would be super useful

[szaimen]

Since there seems to be some demand regarding this feature, I'll leave this open. But it is far down the priority list and will probably take a long time to be implemented.

Pull requests are welcome!

[marcatsmci]

Maybe to be merged with #72 ?

[szaimen]

Maybe to be merged with #72 ?

Not really the same issue since two instances on the same server would additionally need different container ids for the different instances apart from other things...

[ghost]

I am currently facing a use case where I could use this function. @szaimen Will this be included if so when can you expect it? I find this function would simplify many things and has in my opinion many applications.

[szaimen]

Definitely nothing for the first stable release

[szaimen]

It might be possible to define a prefix via environmental variable which then needs to be prefixed everywhere where we use the string nextcloud-aio but this will be a lot of effort (87 lines):

see the list

./Containers/apache/nextcloud.conf:        SetHandler "proxy:fcgi://nextcloud-aio-nextcloud:9000"
./Containers/mastercontainer/start.sh:if ! sudo -u www-data docker ps | grep -q "nextcloud-aio-mastercontainer"; then
./readme.md:    --name nextcloud-aio-mastercontainer \
./readme.md:    --name nextcloud-aio-mastercontainer \
./readme.md:--name nextcloud-aio-mastercontainer ^
./readme.md:Simply run the following: `sudo docker exec -it nextcloud-aio-nextcloud php occ your-command`. Of course `your-command` needs to be exchanged with the command that you want to run.
./readme.md:Simply run the following command: `sudo docker exec -it nextcloud-aio-nextcloud php occ config:system:set default_phone_region --value="yourvalue"`. Of course you need to modify `yourvalue` based on your location. Examples are `DE`, `EN` and `GB`. See this list for more codes: https://en.wikipedia.org/wiki/ISO_3166-1_alpha-2#Officially_assigned_code_elements
./readme.md:After you are done modifying/adding/deleting files/folders, don't forget to apply the correct permissions by running: `sudo chown -R 33:0 /var/lib/docker/volumes/nextcloud_aio_nextcloud_data/_data/*` and rescan the files with `sudo docker exec -it nextcloud-aio-nextcloud php occ files:scan --all`.
./readme.md:If you want to define a custom skeleton directory, you can do so by putting your skeleton files into `/var/lib/docker/volumes/nextcloud_aio_nextcloud_data/_data/skeleton/`, applying the correct permissions with `sudo chown -R 33:0 /var/lib/docker/volumes/nextcloud_aio_nextcloud_data/_data/skeleton` and setting the skeleton directory option with `sudo docker exec -it nextcloud-aio-nextcloud php occ config:system:set skeletondirectory --value="/mnt/ncdata/skeleton"`. You can read further on this option here: [click here](https://docs.nextcloud.com/server/stable/admin_manual/configuration_server/config_sample_php_parameters.html?highlight=skeletondir#:~:text=adding%20%3Fdirect%3D1-,'skeletondirectory',-%3D%3E%20'%2Fpath%2Fto%2Fnextcloud)
./docker-compose.yml:    container_name: nextcloud-aio-mastercontainer
./reverse-proxy.md:--name nextcloud-aio-mastercontainer \
./reverse-proxy.md:--name nextcloud-aio-mastercontainer \
./reverse-proxy.md:--name nextcloud-aio-mastercontainer ^
./migration.md:1. Run `sudo docker exec -it nextcloud-aio-nextcloud php occ files:scan-app-data && sudo docker exec -it nextcloud-aio-nextcloud php occ files:scan --all` in order to scan all files in the datadirectory.
./migration.md:1. Now run `sudo docker exec -it nextcloud-aio-nextcloud php occ maintenance:data-fingerprint`.
./php/src/Controller/DockerController.php:    private const TOP_CONTAINER = 'nextcloud-aio-apache';
./php/src/Controller/DockerController.php:        if ($id === 'nextcloud-aio-database') {
./php/src/Controller/DockerController.php:        if (str_starts_with($id, 'nextcloud-aio-')) {
./php/src/Controller/DockerController.php:        $id = 'nextcloud-aio-borgbackup';
./php/src/Controller/DockerController.php:        $id = 'nextcloud-aio-borgbackup';
./php/src/Controller/DockerController.php:        $id = 'nextcloud-aio-borgbackup';
./php/src/Controller/DockerController.php:        $id = 'nextcloud-aio-borgbackup';
./php/src/Controller/DockerController.php:        $id = 'nextcloud-aio-watchtower';
./php/src/Controller/DockerController.php:        $id = 'nextcloud-aio-domaincheck';
./php/src/Controller/DockerController.php:        $id = 'nextcloud-aio-domaincheck';
./php/src/ContainerDefinitionFetcher.php:            if ($entry['identifier'] === 'nextcloud-aio-clamav') {
./php/src/ContainerDefinitionFetcher.php:            } elseif ($entry['identifier'] === 'nextcloud-aio-onlyoffice') {
./php/src/ContainerDefinitionFetcher.php:            } elseif ($entry['identifier'] === 'nextcloud-aio-collabora') {
./php/src/ContainerDefinitionFetcher.php:            } elseif ($entry['identifier'] === 'nextcloud-aio-talk') {
./php/src/ContainerDefinitionFetcher.php:                if ($value === 'nextcloud-aio-clamav') {
./php/src/ContainerDefinitionFetcher.php:                } elseif ($value === 'nextcloud-aio-onlyoffice') {
./php/src/ContainerDefinitionFetcher.php:                } elseif ($value === 'nextcloud-aio-collabora') {
./php/src/ContainerDefinitionFetcher.php:                } elseif ($value === 'nextcloud-aio-talk') {
./php/src/ContainerDefinitionFetcher.php:            if ($container->GetIdentifier() === 'nextcloud-aio-borgbackup') {
./php/src/ContainerDefinitionFetcher.php:            } elseif ($container->GetIdentifier() === 'nextcloud-aio-watchtower' && $container->GetRunningState() === RunningState::class) {
./php/src/Cron/cron.php:$id = 'nextcloud-aio-nextcloud';
./php/src/Docker/DockerActionManager.php:        if ($container->GetIdentifier() === 'nextcloud-aio-borgbackup') {
./php/src/Docker/DockerActionManager.php:        $id = 'nextcloud-aio-apache';
./php/src/Docker/DockerActionManager.php:        $containerName = 'nextcloud-aio-mastercontainer';
./php/src/Docker/DockerActionManager.php:        $containerName = 'nextcloud-aio-mastercontainer';
./php/src/Docker/DockerActionManager.php:        $this->ConnectContainerIdToNetwork('nextcloud-aio-mastercontainer');
./php/src/Docker/DockerActionManager.php:        $containerName = 'nextcloud-aio-borgbackup';
./php/src/Docker/DockerActionManager.php:        $containerName = 'nextcloud-aio-database';
./php/src/Docker/DockerActionManager.php:        $id = 'nextcloud-aio-apache';
./php/templates/containers.twig:            {% if container.GetIdentifier() not in ['nextcloud-aio-domaincheck', 'nextcloud-aio-borgbackup', 'nextcloud-aio-watchtower'] and class(container.GetRunningState()) == 'AIO\\Container\\State\\RunningState' %}
./php/templates/containers.twig:            {% if container.GetIdentifier() not in ['nextcloud-aio-domaincheck', 'nextcloud-aio-borgbackup', 'nextcloud-aio-watchtower'] and class(container.GetRestartingState()) == 'AIO\\Container\\State\\RestartingState' %}
./php/templates/containers.twig:            {% if container.GetIdentifier() == 'nextcloud-aio-watchtower' and class(container.GetRunningState()) == 'AIO\\Container\\State\\RunningState' %}
./php/templates/containers.twig:            {% if container.GetIdentifier() == 'nextcloud-aio-apache' and class(container.GetStartingState()) == 'AIO\\Container\\State\\StartingState' %}
./php/templates/containers.twig:            {% if container.GetIdentifier() == 'nextcloud-aio-borgbackup' and class(container.GetRunningState()) == 'AIO\\Container\\State\\RunningState' %}
./php/templates/containers.twig:            You are currently running the {{ current_channel }} channel. (<a href="/api/docker/logs?id=nextcloud-aio-mastercontainer">Logs</a>)<br><br>
./php/templates/containers.twig:                                <span class="status error"></span> Last {{ borg_backup_mode }} failed! (<a href="/api/docker/logs?id=nextcloud-aio-borgbackup">Logs</a>)<br /><br />
./php/templates/containers.twig:                                <span class="status success"></span> Last {{ borg_backup_mode }} successful! (<a href="/api/docker/logs?id=nextcloud-aio-borgbackup">Logs</a>)<br /><br />
./php/templates/containers.twig:                                <span class="status error"></span> Last restore failed! (<a href="/api/docker/logs?id=nextcloud-aio-borgbackup">Logs</a>)<br /><br />
./php/templates/containers.twig:                            {% if container.GetIdentifier() not in ['nextcloud-aio-borgbackup', 'nextcloud-aio-watchtower', 'nextcloud-aio-domaincheck'] %}
./php/templates/containers.twig:                                <span class="status error"></span> Last {{ borg_backup_mode }} failed! (<a href="/api/docker/logs?id=nextcloud-aio-borgbackup">Logs</a>)<br /><br />
./php/templates/containers.twig:                                    <span class="status success"></span> Last {{ borg_backup_mode }} successful on {{ last_backup_time }}! (<a href="/api/docker/logs?id=nextcloud-aio-borgbackup">Logs</a>)<br /><br />
./php/templates/containers.twig:                                    <span class="status success"></span> Last {{ borg_backup_mode }} successful! (<a href="/api/docker/logs?id=nextcloud-aio-borgbackup">Logs</a>)<br /><br />
./php/templates/containers.twig:                            <span class="status running"></span> Backup container currently running. (<a href="/api/docker/logs?id=nextcloud-aio-borgbackup">Logs</a>)<br /><br />
./php/templates/login.twig:                You can unblock the login by running 'sudo docker stop nextcloud-aio-apache'.</p>
./php/containers.json:        "nextcloud-aio-onlyoffice",
./php/containers.json:        "nextcloud-aio-collabora",
./php/containers.json:        "nextcloud-aio-clamav",
./php/containers.json:        "nextcloud-aio-talk",
./php/containers.json:        "nextcloud-aio-nextcloud"
./php/containers.json:      "identifier": "nextcloud-aio-apache",
./php/containers.json:        "NEXTCLOUD_HOST=nextcloud-aio-nextcloud",
./php/containers.json:        "COLLABORA_HOST=nextcloud-aio-collabora",
./php/containers.json:        "TALK_HOST=nextcloud-aio-talk",
./php/containers.json:        "ONLYOFFICE_HOST=nextcloud-aio-onlyoffice"
./php/containers.json:      "identifier": "nextcloud-aio-database",
./php/containers.json:        "nextcloud-aio-database",
./php/containers.json:        "nextcloud-aio-redis"
./php/containers.json:      "identifier": "nextcloud-aio-nextcloud",
./php/containers.json:        "POSTGRES_HOST=nextcloud-aio-database",
./php/containers.json:        "REDIS_HOST=nextcloud-aio-redis",
./php/containers.json:        "CLAMAV_HOST=nextcloud-aio-clamav",
./php/containers.json:        "ONLYOFFICE_HOST=nextcloud-aio-onlyoffice"
./php/containers.json:      "identifier": "nextcloud-aio-redis",
./php/containers.json:      "identifier": "nextcloud-aio-collabora",
./php/containers.json:      "identifier": "nextcloud-aio-talk",
./php/containers.json:      "identifier": "nextcloud-aio-borgbackup",
./php/containers.json:      "identifier": "nextcloud-aio-watchtower",
./php/containers.json:        "CONTAINER_TO_UPDATE=nextcloud-aio-mastercontainer"
./php/containers.json:      "identifier": "nextcloud-aio-domaincheck",
./php/containers.json:      "identifier": "nextcloud-aio-clamav",
./php/containers.json:      "identifier": "nextcloud-aio-onlyoffice",
./develop.md:--name nextcloud-aio-mastercontainer \

[szaimen]

plus 71 lines prefixing the volumes with nextcloud_aio_:

click here to show lines

./Containers/borgbackup/backupscript.sh:VOLUME_DIRS="$(find /nextcloud_aio_volumes -mindepth 1 -maxdepth 1 -type d)"
./Containers/borgbackup/backupscript.sh:    touch "/nextcloud_aio_volumes/nextcloud_aio_database_dump/backup-is-running"
./Containers/borgbackup/backupscript.sh:    if ! [ -f "/nextcloud_aio_volumes/nextcloud_aio_mastercontainer/data/configuration.json" ]; then
./Containers/borgbackup/backupscript.sh:    elif ! [ -f "/nextcloud_aio_volumes/nextcloud_aio_nextcloud/config/config.php" ]; then
./Containers/borgbackup/backupscript.sh:    elif ! [ -f "/nextcloud_aio_volumes/nextcloud_aio_database_dump/database-dump.sql" ]; then
./Containers/borgbackup/backupscript.sh:    if [ -f "/nextcloud_aio_volumes/nextcloud_aio_database_dump/export.failed" ]; then
./Containers/borgbackup/backupscript.sh:        if [ -f "/nextcloud_aio_volumes/nextcloud_aio_mastercontainer/data/borg.config" ]; then
./Containers/borgbackup/backupscript.sh:        rm -f "/nextcloud_aio_volumes/nextcloud_aio_mastercontainer/data/borg.config"
./Containers/borgbackup/backupscript.sh:        if ! cp "$BORG_BACKUP_DIRECTORY/config" "/nextcloud_aio_volumes/nextcloud_aio_mastercontainer/data/borg.config"; then
./Containers/borgbackup/backupscript.sh:    if ! borg create "${BORG_OPTS[@]}" "$BORG_BACKUP_DIRECTORY::$CURRENT_DATE-nextcloud-aio" "/nextcloud_aio_volumes/"; then
./Containers/borgbackup/backupscript.sh:    rm -f "/nextcloud_aio_volumes/nextcloud_aio_nextcloud_data/skip.update"
./Containers/borgbackup/backupscript.sh:    AIO_PASSWORD="$(grep -oP '"password":"[a-zA-Z0-9 ]+"' /nextcloud_aio_volumes/nextcloud_aio_mastercontainer/data/configuration.json)"
./Containers/borgbackup/backupscript.sh:    BORG_LOCATION="$(grep -oP '"borg_backup_host_location":"[\\/a-zA-Z0-9 ]+"' /nextcloud_aio_volumes/nextcloud_aio_mastercontainer/data/configuration.json)"
./Containers/borgbackup/backupscript.sh:    --exclude "nextcloud_aio_mastercontainer/session/"** \
./Containers/borgbackup/backupscript.sh:    --exclude "nextcloud_aio_mastercontainer/certs/"** \
./Containers/borgbackup/backupscript.sh:    /tmp/borg/nextcloud_aio_volumes/ /nextcloud_aio_volumes; then
./Containers/borgbackup/backupscript.sh:    touch "/nextcloud_aio_volumes/nextcloud_aio_nextcloud_data/skip.update"
./Containers/borgbackup/backupscript.sh:    chmod 777 "/nextcloud_aio_volumes/nextcloud_aio_nextcloud_data/skip.update"
./Containers/borgbackup/backupscript.sh:    sed -i 's/"backup-mode":"[a-z]\+"/"backup-mode":"restore"/g' /nextcloud_aio_volumes/nextcloud_aio_mastercontainer/data/configuration.json
./Containers/borgbackup/backupscript.sh:    sed -i "s/\"password\":\"[a-zA-Z0-9 ]\+\"/\"password\":\"$AIO_PASSWORD\"/g" /nextcloud_aio_volumes/nextcloud_aio_mastercontainer/data/configuration.json
./Containers/borgbackup/backupscript.sh:        if [ -n "$(grep -oP '"borg_backup_host_location":"[\\/a-zA-Z0-9 ]+"' /nextcloud_aio_volumes/nextcloud_aio_mastercontainer/data/configuration.json)" ]; then
./Containers/borgbackup/backupscript.sh:            sed -i "s/\"borg_backup_host_location\":\"[\\/a-zA-Z0-9 ]\+\"/\"borg_backup_host_location\":\"$BORG_LOCATION\"/g" /nextcloud_aio_volumes/nextcloud_aio_mastercontainer/data/configuration.json
./Containers/borgbackup/start.sh:rm -f "/nextcloud_aio_volumes/nextcloud_aio_database_dump/backup-is-running"
./Containers/borgbackup/start.sh:borg list "$BORG_BACKUP_DIRECTORY" | grep "nextcloud-aio" | awk -F " " '{print $1","$3,$4}' > "/nextcloud_aio_volumes/nextcloud_aio_mastercontainer/data/backup_archives.list"
./Containers/borgbackup/start.sh:chmod +r "/nextcloud_aio_volumes/nextcloud_aio_mastercontainer/data/backup_archives.list"
./Containers/borgbackup/start.sh:        touch "/nextcloud_aio_volumes/nextcloud_aio_nextcloud_data/skip.update"
./Containers/borgbackup/start.sh:        chmod 777 "/nextcloud_aio_volumes/nextcloud_aio_nextcloud_data/skip.update"
./Containers/mastercontainer/start.sh:elif ! sudo -u www-data docker volume ls | grep -q "nextcloud_aio_mastercontainer"; then
./readme.md:    --volume nextcloud_aio_mastercontainer:/mnt/docker-aio-config \
./readme.md:    --volume nextcloud_aio_mastercontainer:/mnt/docker-aio-config \
./readme.md:--volume nextcloud_aio_mastercontainer:/mnt/docker-aio-config ^
./readme.md:The files and folders that you add to Nextcloud are by default stored in the following directory: `/var/lib/docker/volumes/nextcloud_aio_nextcloud_data/_data/` on the host. If needed, you can modify/add/delete files/folders there but **ATTENTION**: be very careful when doing so because you might corrupt your AIO installation! Best is to create a backup using the built-in backup solution before editing/changing files/folders in there because you will then be able to restore your instance to the backed up state.
./readme.md:After you are done modifying/adding/deleting files/folders, don't forget to apply the correct permissions by running: `sudo chown -R 33:0 /var/lib/docker/volumes/nextcloud_aio_nextcloud_data/_data/*` and rescan the files with `sudo docker exec -it nextcloud-aio-nextcloud php occ files:scan --all`.
./readme.md:You can edit Nextclouds config.php file directly from the host with your favorite text editor. E.g. like this: `sudo nano /var/lib/docker/volumes/nextcloud_aio_nextcloud/_data/config/config.php`. Make sure to not break the file though which might corrupt your Nextcloud instance otherwise. In best case, create a backup using the built-in backup solution before editing the file.
./readme.md:If you want to define a custom skeleton directory, you can do so by putting your skeleton files into `/var/lib/docker/volumes/nextcloud_aio_nextcloud_data/_data/skeleton/`, applying the correct permissions with `sudo chown -R 33:0 /var/lib/docker/volumes/nextcloud_aio_nextcloud_data/_data/skeleton` and setting the skeleton directory option with `sudo docker exec -it nextcloud-aio-nextcloud php occ config:system:set skeletondirectory --value="/mnt/ncdata/skeleton"`. You can read further on this option here: [click here](https://docs.nextcloud.com/server/stable/admin_manual/configuration_server/config_sample_php_parameters.html?highlight=skeletondir#:~:text=adding%20%3Fdirect%3D1-,'skeletondirectory',-%3D%3E%20'%2Fpath%2Fto%2Fnextcloud)
./docker-compose.yml:  nextcloud_aio_mastercontainer:
./docker-compose.yml:    name: nextcloud_aio_mastercontainer
./docker-compose.yml:      - nextcloud_aio_mastercontainer:/mnt/docker-aio-config
./reverse-proxy.md:--volume nextcloud_aio_mastercontainer:/mnt/docker-aio-config \
./reverse-proxy.md:--volume nextcloud_aio_mastercontainer:/mnt/docker-aio-config \
./reverse-proxy.md:--volume nextcloud_aio_mastercontainer:/mnt/docker-aio-config ^
./migration.md:1. Restore the datadirectory of your former instance into the following directory: `/var/lib/docker/volumes/nextcloud_aio_nextcloud_data/_data/`
./migration.md:1. Next, run `sudo chown -R 33:0 /var/lib/docker/volumes/nextcloud_aio_nextcloud_data/_data/*` to apply the correct permissions
./migration.md:    sudo rm /var/lib/docker/volumes/nextcloud_aio_database_dump/_data/database-dump.sql
./migration.md:    sudo cp database-dump.sql /var/lib/docker/volumes/nextcloud_aio_database_dump/_data/
./migration.md:    sudo chmod 777 /var/lib/docker/volumes/nextcloud_aio_database_dump/_data/database-dump.sql
./migration.md:    sudo rm -r /var/lib/docker/volumes/nextcloud_aio_database/_data/*
./migration.md:1. If the commands above were executed successfully, restore the datadirectory of your former instance into the following directory: `/var/lib/docker/volumes/nextcloud_aio_nextcloud_data/_data/`
./migration.md:1. Next, run `sudo chown -R 33:0 /var/lib/docker/volumes/nextcloud_aio_nextcloud_data/_data/*` to apply the correct permissions
./migration.md:1. Edit the Nextcloud AIO config.php file that is stored in `/var/lib/docker/volumes/nextcloud_aio_nextcloud/_data/config/config.php` and modify only `passwordsalt`, `secret`, `instanceid` and set it to the old values that you used on your old installation. If you are brave, feel free to modify further values e.g. add your old LDAP config or S3 storage config. (Some things like Mail server config can be added back using Nextcloud's webinterface later on).
./php/src/Data/ConfigurationManager.php:        $defaultValue = 'nextcloud_aio_nextcloud_data';
./php/containers.json:          "name": "nextcloud_aio_nextcloud",
./php/containers.json:          "name": "nextcloud_aio_apache",
./php/containers.json:          "name": "nextcloud_aio_database",
./php/containers.json:          "name": "nextcloud_aio_database_dump",
./php/containers.json:          "name": "nextcloud_aio_nextcloud",
./php/containers.json:          "name": "nextcloud_aio_backup_cache",
./php/containers.json:          "name": "nextcloud_aio_nextcloud",
./php/containers.json:          "location": "/nextcloud_aio_volumes/nextcloud_aio_nextcloud",
./php/containers.json:          "location": "/nextcloud_aio_volumes/nextcloud_aio_nextcloud_data",
./php/containers.json:          "name": "nextcloud_aio_database",
./php/containers.json:          "location": "/nextcloud_aio_volumes/nextcloud_aio_database",
./php/containers.json:          "name": "nextcloud_aio_database_dump",
./php/containers.json:          "location": "/nextcloud_aio_volumes/nextcloud_aio_database_dump",
./php/containers.json:          "name": "nextcloud_aio_apache",
./php/containers.json:          "location": "/nextcloud_aio_volumes/nextcloud_aio_apache",
./php/containers.json:          "name": "nextcloud_aio_mastercontainer",
./php/containers.json:          "location": "/nextcloud_aio_volumes/nextcloud_aio_mastercontainer",
./php/containers.json:          "name": "nextcloud_aio_clamav",
./php/containers.json:          "name": "nextcloud_aio_onlyoffice",
./develop.md:--volume nextcloud_aio_mastercontainer:/mnt/docker-aio-config \

[dkebler]

Just realized my question is the same as this one #517. Prefix is a good/workable solution, but understood bunch of lower priority work. I'm handy with bash scripts so might fiddle with.

[szaimen]

After thinking about this a bit more, I doubt that this will ever be implemented as it is just too much work to fix all the places that would need to be adjusted. And it is not only the naming but a lot more that would need to be changed.

My recommendation for all of you if you need multiple instances is to run AIO in VMs and use a reverse proxy (e.g. caddy) that routes the traffic correctly to each instance.

[szaimen]

However there is this: #557 that might allow you to run multiple instances on the same server by setting it up manually yourself.

This is now implemented. See https://github.com/nextcloud/all-in-one/tree/main/manual-install

[szaimen]

Hi all, I just discovered that multiple instances will be possible by using docker rootless and multiple users. Each instance will be namespaced then so that it is possible to use multiple AIO instances. See #854 where I already pointed out some steps and made a POC.

[johnnyq]

Fantastic! Thanks @szaimen

[szaimen]

See https://github.com/nextcloud/all-in-one/blob/main/multiple-instances.md

[rallisf1]

Has anyone tried sharing containers between instances? AFAIK office and talk backends should work out of the box, but what about things like clamav or elasticsearch?