Merge pull request #18900 from serathius/robustness-track-record

Add robustness track record section to make tracking easier

tests/robustness/README.md

@@ -6,6 +6,34 @@ The purpose of these tests is to rigorously validate that etcd maintains its [KV
 [KV API guarantees]: https://etcd.io/docs/v3.6/learning/api_guarantees/#kv-apis
 [watch API guarantees]: https://etcd.io/docs/v3.6/learning/api_guarantees/#watch-apis
 
+## Robustness track record
+
+| Correctness / Consistency issue                                 | Report   | Introduced in   | Discovered by | Reproducible by robustness test                 | Command                           |
+|-----------------------------------------------------------------|----------|-----------------|---------------|-------------------------------------------------|-----------------------------------|
+| Inconsistent revision caused by crash during high load [#13766] | Mar 2022 | v3.5            | User          | Yes, report preceded robustness tests           | `make test-robustness-issue13766` |
+| Single node cluster can loose a write on crash [#14370]         | Aug 2022 | v3.4 or earlier | User          | Yes, report preceded robustness tests           | `make test-robustness-issue14370` |
+| Enabling auth can lead to inconsistency [#14571]                | Oct 2022 | v3.4 or earlier | User          | No, authorization is not covered.               |                                   |
+| Inconsistent revision caused by crash during defrag [#14685]    | Nov 2022 | v3.5            | Robustness    | Yes, after covering defragmentation.            | `make test-robustness-issue14685` |
+| Watch progress notification not synced with steam [#15220]      | Jan 2023 | v3.4 or earlier | User          | Yes, after covering watch progress notification |                                   |
+| Watch traveling back in time after network partition [#15271]   | Feb 2023 | v3.4 or earlier | Robustness    | Yes, after covering network partitions          | `make test-robustness-issue15271` |
+| Duplicated watch event due to bug in TXN caching [#17247]       | Jan 2024 | main branch     | Robustness    | Yes, prevented regression in v3.6               |                                   |
+| Watch events lost during stream starvation [#17529]             | Mar 2024 | v3.4 or earlier | User          | Yes, after covering of slow watch               | `make test-robustness-issue17529` |
+| Revision decreasing caused by crash during compaction [#17780]  | Apr 2024 | v3.4 or earlier | Robustness    | Yes, after covering compaction                  |                                   |
+| Watch dropping an event when compacting on delete [#18089]      | May 2024 | v3.4 or earlier | Robustness    | Yes, after covering of compaction               |                                   |
+| Inconsistency when reading compacted revision in TXN [#18667]   | Oct 2024 | v3.4 or earlier | User          |                                                 |                                   |
+
+[#13766]: https://github.com/etcd-io/etcd/issues/13766
+[#14370]: https://github.com/etcd-io/etcd/issues/14370
+[#14571]: https://github.com/etcd-io/etcd/issues/14571
+[#14685]: https://github.com/etcd-io/etcd/pull/14685
+[#15220]: https://github.com/etcd-io/etcd/issues/15220
+[#15271]: https://github.com/etcd-io/etcd/issues/15271
+[#17247]: https://github.com/etcd-io/etcd/issues/17247
+[#17529]: https://github.com/etcd-io/etcd/issues/17529
+[#17780]: https://github.com/etcd-io/etcd/issues/17780
+[#18089]: https://github.com/etcd-io/etcd/issues/18089
+[#18667]: https://github.com/etcd-io/etcd/issues/18667
+
 ## How Robustness Tests Work
 
 Robustness tests compare etcd cluster behavior against a simplified model of its expected behavior.