Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Services lose "endpoints" #1979

Open
CiraciNicolo opened this issue Jul 24, 2024 · 2 comments
Open

Services lose "endpoints" #1979

CiraciNicolo opened this issue Jul 24, 2024 · 2 comments
Labels

Comments

@CiraciNicolo
Copy link

CiraciNicolo commented Jul 24, 2024

What happened?

With different Ingress Controller, such as Traefik and Nginx, the service used to route traffic "lose" endpoints. This results in Ingresses not working:

Service "harbor-system/harbor-portal" does not have any active Endpoint

What did you expect to happen?

Services should not lose endpoints

How can we reproduce it (as minimally and precisely as possible)?

  • Deploy a VCluster
  • Deploy an Ingress Controller inside vCluster
  • Expose some services

Anything else we need to know?

No response

Host cluster Kubernetes version

Server Version: version.Info{Major:"1", Minor:"29", GitVersion:"v1.29.0", GitCommit:"3f7a50f38688eb332e2a1b013678c6435d539ae6", GitTreeState:"clean", BuildDate:"2023-12-13T08:45:03Z", GoVersion:"go1.21.5", Compiler:"gc", Platform:"linux/amd64"}

vcluster version

vcluster version 0.19.6

VCluster Config

---
sync:
  persistentvolumes:
    enabled: true
  pods:
    ephemeralContainers: true
    status: true
  secrets:
    all: true
  configmaps:
    all: true
  nodes:
    nodeSelector: sync=true
    enabled: true
    enableScheduler: true

syncer:
  replicas: 3

etcd:
  replicas: 3

coredns:
  replicas: 3
  config: |
    .:1053 {
      errors
      health
      ready
      rewrite name regex .*\.nodes\.vcluster\.com kubernetes.default.svc.cluster.local
      kubernetes cluster.local in-addr.arpa ip6.arpa {
          pods insecure
          fallthrough in-addr.arpa ip6.arpa
      }
      hosts /etc/NodeHosts {
          ttl 60
          reload 15s
          fallthrough
      }
      prometheus :9153
      forward . 1.1.1.1
      cache 30
      loop
      reload
      loadbalance
      whoami
    }
    
    import /etc/coredns/custom/*.server

isolation:
  enabled: true

  podSecurityStandard: baseline

  resourceQuota:
    enabled: true
    quota:
      requests.cpu: 10
      requests.memory: 20Gi
      requests.storage: 100Gi
      requests.ephemeral-storage: 100Gi
      limits.cpu: 40
      limits.memory: 40Gi
      limits.ephemeral-storage: 300Gi
      services.nodeports: 0
      services.loadbalancers: 0
      count/endpoints: 40
      count/pods: 40
      count/services: 40
      count/secrets: 100
      count/configmaps: 100
      count/persistentvolumeclaims: 20
    scopeSelector:
      matchExpressions:
    scopes:

  networkPolicy:
    enabled: false

telemetry:
  disabled: true
Copy link
Contributor

What command do you use to start your vcluster?

@CiraciNicolo
Copy link
Author

CiraciNicolo commented Aug 5, 2024

Hi! The one from the documentation:

vcluster create foo -f foo.yaml --distro k8s --connect=false -n foo

Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Labels
Projects
None yet
Development

No branches or pull requests

2 participants