diff --git a/tests/robustness/README.md b/tests/robustness/README.md index b8b532e3967..f8915a85d0c 100644 --- a/tests/robustness/README.md +++ b/tests/robustness/README.md @@ -6,6 +6,34 @@ The purpose of these tests is to rigorously validate that etcd maintains its [KV [KV API guarantees]: https://etcd.io/docs/v3.6/learning/api_guarantees/#kv-apis [watch API guarantees]: https://etcd.io/docs/v3.6/learning/api_guarantees/#watch-apis +## Robustness track record + +| Correctness / Consistency issue | Report | Introduced in | Discovered by | Reproducible by robustness test | Command | +|-----------------------------------------------------------------|----------|-----------------|---------------|-------------------------------------------------|-----------------------------------| +| Inconsistent revision caused by crash during high load [#13766] | Mar 2022 | v3.5 | User | Yes, report preceded robustness tests | `make test-robustness-issue13766` | +| Single node cluster can loose a write on crash [#14370] | Aug 2022 | v3.4 or earlier | User | Yes, report preceded robustness tests | `make test-robustness-issue14370` | +| Enabling auth can lead to inconsistency [#14571] | Oct 2022 | v3.4 or earlier | User | No, authorization is not covered. | | +| Inconsistent revision caused by crash during defrag [#14685] | Nov 2022 | v3.5 | Robustness | Yes, after covering defragmentation. | `make test-robustness-issue14685` | +| Watch progress notification not synced with steam [#15220] | Jan 2023 | v3.4 or earlier | User | Yes, after covering watch progress notification | | +| Watch traveling back in time after network partition [#15271] | Feb 2023 | v3.4 or earlier | Robustness | Yes, after covering network partitions | `make test-robustness-issue15271` | +| Duplicated watch event due to bug in TXN caching [#17247] | Jan 2024 | main branch | Robustness | Yes, prevented regression in v3.6 | | +| Watch events lost during stream starvation [#17529] | Mar 2024 | v3.4 or earlier | User | Yes, after covering of slow watch | `make test-robustness-issue17529` | +| Revision decreasing caused by crash during compaction [#17780] | Apr 2024 | v3.4 or earlier | Robustness | Yes, after covering compaction | | +| Watch dropping an event when compacting on delete [#18089] | May 2024 | v3.4 or earlier | Robustness | Yes, after covering of compaction | | +| Inconsistency when reading compacted revision in TXN [#18667] | Oct 2024 | v3.4 or earlier | User | | | + +[#13766]: https://github.com/etcd-io/etcd/issues/13766 +[#14370]: https://github.com/etcd-io/etcd/issues/14370 +[#14571]: https://github.com/etcd-io/etcd/issues/14571 +[#14685]: https://github.com/etcd-io/etcd/pull/14685 +[#15220]: https://github.com/etcd-io/etcd/issues/15220 +[#15271]: https://github.com/etcd-io/etcd/issues/15271 +[#17247]: https://github.com/etcd-io/etcd/issues/17247 +[#17529]: https://github.com/etcd-io/etcd/issues/17529 +[#17780]: https://github.com/etcd-io/etcd/issues/17780 +[#18089]: https://github.com/etcd-io/etcd/issues/18089 +[#18667]: https://github.com/etcd-io/etcd/issues/18667 + ## How Robustness Tests Work Robustness tests compare etcd cluster behavior against a simplified model of its expected behavior.