Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Test autoscaling #50

Open
zonca opened this issue Jan 21, 2021 · 0 comments
Open

Test autoscaling #50

zonca opened this issue Jan 21, 2021 · 0 comments
Assignees

Comments

@zonca
Copy link
Collaborator

zonca commented Jan 21, 2021

Autoscaling support for our deployment from the official project is still very far away, see zonca#34

So I implemented a hacked-up script myself, see https://zonca.dev/2021/01/autoscaling_script_kubespray_jupyterhub.html, I tested on a sample deployment and worked just fine.

Now I would like to deploy on CDMS (after #48), the main issue is that scaling up is very slow, it takes about 20 min to get another node up.

  1. So to maximize savings we could just keep the master running which supports 1 user (with 5 GB memory), a second concurrent user trying to connect will have to wait 20 min for their session to start
  2. We keep master + 1 node always running, so only after those are full (or someone asks for a full node) we trigger autoscaling

@pibion what do you think? We could also try a couple of weeks with 1 and then decide.
I would like to set this up only after the redeploy (#48), so there is lots of time to discuss this.

@zonca zonca self-assigned this Jan 21, 2021
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Labels
None yet
Projects
None yet
Development

No branches or pull requests

1 participant