Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Increase the number of acounts used in randomized tests #4661

Merged
merged 1 commit into from
Apr 3, 2024

Conversation

bitdivine
Copy link
Member

@bitdivine bitdivine commented Mar 25, 2024

Motivation

As part of the security review with @roelstorms, it was considered that we probably want to increase the number of accounts used in randomized migration testing.

The number of accounts is a random number in the range 0..40. If we migrate 20 accounts per step (increased from 10), half the time the entire migration is completed in one step. (Plus a second step to point the switch at the new database.) This gives insufficient opportunity for the test to find any bugs.

Changes

  • Increase the number of accounts in randomized migration tests to a random number in the range 0..100.

Tests

  • See CI

Todos

  • Add entry to changelog (if necessary).

@bitdivine bitdivine marked this pull request as ready for review March 25, 2024 15:39
@bitdivine bitdivine requested a review from a team as a code owner March 25, 2024 15:39
@bitdivine bitdivine added this pull request to the merge queue Apr 3, 2024
Merged via the queue into main with commit 0f68cf0 Apr 3, 2024
50 checks passed
@bitdivine bitdivine deleted the bump-test-size branch April 3, 2024 23:00
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Labels
None yet
Projects
None yet
Development

Successfully merging this pull request may close these issues.

2 participants