TestResourceStatusMetrics: Condition never satisfied

[inFocus7]

Which tests failed?

TestGlooGatewayEdgeGatewayClearMetrics/PrometheusMetrics/TestResourceStatusMetrics

2025-02-24T07:35:40.3796840Z === RUN   TestGlooGatewayEdgeGatewayClearMetrics/PrometheusMetrics
2025-02-24T07:35:40.3796930Z namespace/nginx created
2025-02-24T07:35:40.3797012Z service/nginx created
2025-02-24T07:35:40.3797114Z configmap/nginx-conf created
2025-02-24T07:35:40.3797192Z pod/nginx created
2025-02-24T07:35:40.3797288Z GLOO_CLEAR_STATUS_METRICS: true
2025-02-24T07:35:40.3797583Z === RUN   TestGlooGatewayEdgeGatewayClearMetrics/PrometheusMetrics/TestResourceStatusMetrics
2025-02-24T07:35:40.3797710Z upstream.gloo.solo.io/nginx-upstream created
2025-02-24T07:35:40.3797847Z virtualservice.gateway.solo.io/example-vs created
2025-02-24T07:35:40.3797974Z     edge.go:124: 
2025-02-24T07:35:40.3799228Z         	Error Trace:	/home/runner/work/gloo/gloo/test/kubernetes/e2e/features/metrics/edge.go:129
2025-02-24T07:35:40.3800446Z         	            				/opt/hostedtoolcache/go/1.24.0/x64/src/runtime/asm_amd64.s:1700
2025-02-24T07:35:40.3815028Z         	Error:      	map[string]*io_prometheus_client.MetricFamily{"api_gloo_solo_io_translator_resources":(*io_prometheus_client.MetricFamily)(0xc003b614a0), "api_gloosnapshot_gloo_solo_io_emitter_resources_in":(*io_prometheus_client.MetricFamily)(0xc003b61500), "api_gloosnapshot_gloo_solo_io_emitter_snap_in":(*io_prometheus_client.MetricFamily)(0xc003b61560), "api_gloosnapshot_gloo_solo_io_emitter_snap_missed":(*io_prometheus_client.MetricFamily)(0xc003b61620), "api_gloosnapshot_gloo_solo_io_emitter_snap_out":(*io_prometheus_client.MetricFamily)(0xc003b61680), "api_gloosnapshot_gloo_solo_io_sync_time_sec":(*io_prometheus_client.MetricFamily)(0xc003b61740), "eds_gloo_solo_io_emitter_resources_in":(*io_prometheus_client.MetricFamily)(0xc003b617a0), "eds_gloo_solo_io_emitter_snap_in":(*io_prometheus_client.MetricFamily)(0xc003b61980), "eds_gloo_solo_io_emitter_snap_out":(*io_prometheus_client.MetricFamily)(0xc003b619e0), "eds_gloo_solo_io_sync_time_sec":(*io_prometheus_client.MetricFamily)(0xc003b61a40), "gloo_edge_translation_time_sec":(*io_prometheus_client.MetricFamily)(0xc003b61aa0), "gloo_solo_io_namespaces_watched":(*io_prometheus_client.MetricFamily)(0xc003b61b00), "gloo_solo_io_sanitizer_routes_replaced":(*io_prometheus_client.MetricFamily)(0xc003b61b60), "gloo_solo_io_setups_run":(*io_prometheus_client.MetricFamily)(0xc003b61bc0), "kube_events_count":(*io_prometheus_client.MetricFamily)(0xc003b61c20), "kube_lists_count":(*io_prometheus_client.MetricFamily)(0xc003b61c80), "kube_req_in_flight":(*io_prometheus_client.MetricFamily)(0xc003b61ce0), "kube_watches_count":(*io_prometheus_client.MetricFamily)(0xc003b61d40), "runtime_goroutines":(*io_prometheus_client.MetricFamily)(0xc003b61da0), "setup_gloo_solo_io_emitter_resources_in":(*io_prometheus_client.MetricFamily)(0xc003b61e00), "setup_gloo_solo_io_emitter_snap_in":(*io_prometheus_client.MetricFamily)(0xc003b61e60), "setup_gloo_solo_io_emitter_snap_out":(*io_prometheus_client.MetricFamily)(0xc003b61ec0), "setup_gloo_solo_io_sync_time_sec":(*io_prometheus_client.MetricFamily)(0xc003b61f20), "validation_gateway_solo_io_certificate_reload_success":(*io_prometheus_client.MetricFamily)(0xc001804000), "validation_gateway_solo_io_gateway_config_status":(*io_prometheus_client.MetricFamily)(0xc001804060), "validation_gateway_solo_io_resources_accepted":(*io_prometheus_client.MetricFamily)(0xc0018040c0), "validation_gateway_solo_io_valid_config":(*io_prometheus_client.MetricFamily)(0xc001804120), "validation_gateway_solo_io_virtual_service_config_status":(*io_prometheus_client.MetricFamily)(0xc0018041e0), "xds_responses":(*io_prometheus_client.MetricFamily)(0xc001804240)} does not contain "validation_gateway_solo_io_upstream_config_status"
2025-02-24T07:35:40.3815514Z         	Messages:   	metrics does not contain validation_gateway_solo_io_upstream_config_status
2025-02-24T07:35:40.3815643Z     edge.go:124: 
2025-02-24T07:35:40.3816152Z         	Error Trace:	/home/runner/work/gloo/gloo/test/kubernetes/e2e/features/metrics/edge.go:124
2025-02-24T07:35:40.3816357Z         	Error:      	Condition never satisfied
2025-02-24T07:35:40.3816860Z         	Test:       	TestGlooGatewayEdgeGatewayClearMetrics/PrometheusMetrics/TestResourceStatusMetrics
2025-02-24T07:35:40.3816997Z upstream.gloo.solo.io "nginx-upstream" deleted
2025-02-24T07:35:40.3817146Z virtualservice.gateway.solo.io "example-vs" deleted
2025-02-24T07:35:40.3817855Z Error from server (NotFound): error when deleting "/home/runner/work/gloo/gloo/test/kubernetes/e2e/features/metrics/testdata/edge-gateway-nginx.yaml": upstreams.gloo.solo.io "nginx-upstream" not found
2025-02-24T07:35:40.3818574Z Error from server (NotFound): error when deleting "/home/runner/work/gloo/gloo/test/kubernetes/e2e/features/metrics/testdata/edge-gateway-nginx.yaml": virtualservices.gateway.solo.io "example-vs" not found
2025-02-24T07:35:40.3818670Z namespace "nginx" deleted
2025-02-24T07:35:40.3818754Z service "nginx" deleted
2025-02-24T07:35:40.3818853Z configmap "nginx-conf" deleted
2025-02-24T07:35:40.3819051Z pod "nginx" deleted
2025-02-24T07:35:40.3819503Z Test failed. Dumping state from default, gloo-gateway-edge-test, istio-system, kube-node-lease, kube-public, kube-system, local-path-storage...
2025-02-24T07:35:40.3819981Z Finished writing Docker and process state information to the "/home/runner/work/gloo/gloo/_test/bug_report/cluster-one/gloo-gateway-edge-test" directory.
2025-02-24T07:35:40.3820448Z Finished writing Kubernetes state information to the "/home/runner/work/gloo/gloo/_test/bug_report/cluster-one/gloo-gateway-edge-test" directory.
2025-02-24T07:35:40.3820570Z no gloo=gloo pods found in namespace default
2025-02-24T07:35:40.3820687Z no gloo=gloo pods found in namespace default
2025-02-24T07:35:40.3820802Z found controller pods: gloo-789c658c98-kxls8
2025-02-24T07:35:40.3821404Z Finished writing Gloo Gateway controller state information to the "/home/runner/work/gloo/gloo/_test/bug_report/cluster-one/gloo-gateway-edge-test" directory.

Initial Investigation

<TODO: was unable to find the referenced metrics tests in gloo or solo-projects main branches>

Additional Information

https://github.com/solo-io/gloo/actions/runs/13491159968/job/37689520587