upgrade vlab test-connectivity failure: 127.0.0.1:6443: read: connection reset by peer

[pau-hedgehog]

Observed CI failures before testing connectivity in: https://github.com/githedgehog/fabricator/actions/runs/12827713477/job/35770461179

11:38:25 INF Running on-ready command command=test-connectivity
11:38:25 INF Testing server to server and server to external connectivity
11:38:25 ERR Unhandled Error logger=UnhandledError err="pkg/mod/k8s.io/[email protected]/tools/cache/reflector.go:243: Failed to watch *v1beta1.IPv4Namespace: client rate limiter Wait returned an error: context canceled - error from a previous attempt: EOF"
11:38:25 ERR Unhandled Error logger=UnhandledError err="pkg/mod/k8s.io/[email protected]/tools/cache/reflector.go:243: Failed to watch *v1beta1.VPCAttachment: client rate limiter Wait returned an error: context canceled - error from a previous attempt: read tcp 127.0.0.1:35114->127.0.0.1:6443: read: connection reset by peer"
11:38:25 ERR Unhandled Error logger=UnhandledError err="pkg/mod/k8s.io/[email protected]/tools/cache/reflector.go:243: Failed to watch *v1beta1.Server: client rate limiter Wait returned an error: context canceled - error from a previous attempt: read tcp 127.0.0.1:35138->127.0.0.1:6443: read: connection reset by peer"
11:38:25 ERR Unhandled Error logger=UnhandledError err="pkg/mod/k8s.io/[email protected]/tools/cache/reflector.go:243: Failed to watch *v1beta1.VPC: client rate limiter Wait returned an error: context canceled - error from a previous attempt: EOF"
11:38:25 ERR Unhandled Error logger=UnhandledError err="pkg/mod/k8s.io/[email protected]/tools/cache/reflector.go:243: Failed to watch *v1beta1.Agent: client rate limiter Wait returned an error: context canceled - error from a previous attempt: EOF"
11:38:25 ERR Unhandled Error logger=UnhandledError err="pkg/mod/k8s.io/[email protected]/tools/cache/reflector.go:243: Failed to watch *v1beta1.Connection: client rate limiter Wait returned an error: context canceled - error from a previous attempt: read tcp 127.0.0.1:35136->127.0.0.1:6443: read: connection reset by peer"
11:38:25 ERR Unhandled Error logger=UnhandledError err="pkg/mod/k8s.io/[email protected]/tools/cache/reflector.go:243: Failed to watch *v1beta1.VLANNamespace: client rate limiter Wait returned an error: context canceled - error from a previous attempt: read tcp 127.0.0.1:35104->127.0.0.1:6443: read: connection reset by peer"
11:38:25 ERR Unhandled Error logger=UnhandledError err="pkg/mod/k8s.io/[email protected]/tools/cache/reflector.go:243: Failed to watch *v1beta1.Switch: client rate limiter Wait returned an error: context canceled - error from a previous attempt: read tcp 127.0.0.1:35122->127.0.0.1:6443: read: connection reset by peer"
11:38:35 WRN Error running on-ready commands err="testing connectivity: listing switches: failed to get API group resources: unable to retrieve the complete list of server APIs: wiring.githedgehog.com/v1beta1: Get \"[https://127.0.0.1:6443/apis/wiring.githedgehog.com/v1beta1\](https://127.0.0.1:6443/apis/wiring.githedgehog.com/v1beta1/)": read tcp 127.0.0.1:35772->127.0.0.1:6443: read: connection reset by peer - error from a previous attempt: EOF"

[pau-hedgehog]

New hit, on a different on-ready command now (command=inspect): https://github.com/githedgehog/fabricator/actions/runs/13070506705/job/36471259713

@Frostman I see a panic here:

	panic: kube controller runtime cache: failed to watch: the server is currently unable to handle the request (get switches.wiring.githedgehog.com) - error from a previous attempt: read tcp 127.0.0.1:53948->127.0.0.1:6443: read: connection reset by peer

Maybe it's because it's tearing down, but we should add show-tech capture somewhere but I'm not sure how deep in the code. Usually calling just from vlabrunner

[pau-hedgehog]

Duplicate of #332