[system test]: Optimize execution time in Azure Pipelines

[see-quick]

Related problem

“Currently, in Azure Pipelines, there is a time execution imbalance (e.g., the Regression I. pipeline takes 5 hours and 30 minutes, while the Regression III. pipeline takes only 3 hours and 13 minutes).

Suggested solution

We should make adjustments to optimize all pipelines and avoid these imbalances. See [1].”

[1] -

Alternatives

No response

Additional context

No response

[im-konge]

What adjustments would you like to do? I mean, the pipelines are logically split based on the packages and the resources they are testing. Only thing that can be done is to move oauth to security. But it will not fix imbalance with the other pipelines.

[im-konge]

Also, it can be different for ZK regression:

Or you want to solve the imbalance only in the regular regression?

[see-quick]

Well we mainly running regular regressions so for this issue is target to solve that.

the pipelines are logically split based on the packages and the resources

Yeah, but maybe we can find a tests that should be somewhere else or for instance move like you said oauth to security, which would partially fix that problem but that's progress at least.

[im-konge]

Triaged on 31.10.2024: It makes sense to have a look at it. @see-quick volunteered to have a look at this.