[BUG] Conformance check for scs-0211-v1 (and v2) is broken

[martinmo]

• the standard v1 doesn't require a default storage class
• but the script will fail if it doesn't exist (so it already does what we intend to do in v2 [Standard] KaaS default StorageClass v2 (scs-0211-v2) #658)

[martinmo]

I reviewed and tested the script, unfortunately it appears to be broken in more ways, therefore I broadened the scope of this issue:

• it uses packages not specified in requirements.txt
• it doesn't yet check what CSI provider is used, to make an informed decision if the storage is local/ephemeral or not (e.g., using a simple local-path provisionar like kind sets up already satisfies the script)
• it requires some sonobuoy result file which isn't mentioned anywhere else

[fraugabel]

after recompiling requirements and deleting gen_sonobuoy function and function calls i could successfully test my kind cluster with the default "storageClassName":"standard" . I will now try to provoke errors to see, if it still needs debugging

[fraugabel]

There are problems as soon as errors occur. In the event of an error, the test-pvc is not removed, which leads to errors when the test is repeated. So i will have a look into the clean-up-part

[fraugabel]

I am back on this issue and wonder, whether i should dig deeper into that problem, meaning (write a cleanup bypass part for cleaning up, when errors occur) or port it to sonobuoy right a way?

[mbuechse]

I'm afraid I can't tell what's happening here. Does this have a (non-) associated PR that I could look at?

[fraugabel]

@mbuechse right now there is no PR but a branch you can look at. What i am currently working on (from tomorrow on) is the error handling (the exceptions need to be in the right block to get a usable log)
https://github.com/SovereignCloudStack/standards/tree/issue/662_default_storage_class

[mbuechse]

It would be great to have a PR. You can open it as draft.

[mbuechse]

What is happening here? Of course, there is a PR, and has been since Sep 9?!
#745