Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

WNMGDS-3037 Adds script to compute percentage of nightly tests that pass #3320

Draft
wants to merge 3 commits into
base: main
Choose a base branch
from

Conversation

tamara-corbalt
Copy link
Collaborator

@tamara-corbalt tamara-corbalt commented Nov 15, 2024

Summary

This script analyzes jenkins nightly build data to compute a general pass rate and outputs a list of failed builds for manual inspection.
Note: Includes a placeholder fetchBuildData function. Currently we're mocking the output for testing.

// Sample output for a range of builds
% npx ts-node get-nightly-build-pass-rate.ts 100 5  
Analyzing builds from 96 to 100...
Pass Count: 3
Fail Count: 2
Pass-to-Fail Rate: 60.00%
Failed Builds: 97, 99

// Sample output for a single build:
% npx ts-node get-nightly-build-pass-rate.ts 101 1
Build #101: Fail

Jira ticket

How to test

  • Pull down the branch
  • Navigate to scripts directory:cd scripts
  • Run npx ts-node get-nightly-build-pass-rate.ts <build number> <numberOfDays>
    • Replace with the latest jenkins build number you want to inspect.
    • Replace with the range of days to analyze (optional; defaults to 1 if omitted).

Checklist

  • Prefixed the PR title with the Jira ticket number as [WNMGDS-####] Title or [NO-TICKET] if this is unticketed work.
  • Selected appropriate Type (only one) label for this PR, if it is a breaking change, label should only be Type: Breaking
  • Selected appropriate Impacts, multiple can be selected.
  • Selected appropriate release milestone

@tamara-corbalt tamara-corbalt added Type: Internal This item relates to internal tooling/maintenance Type: Added Indicates a new feature. labels Nov 15, 2024
@tamara-corbalt tamara-corbalt added this to the 12.1.0 milestone Nov 15, 2024
@tamara-corbalt tamara-corbalt marked this pull request as draft November 15, 2024 19:27
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Labels
Type: Added Indicates a new feature. Type: Internal This item relates to internal tooling/maintenance
Projects
None yet
Development

Successfully merging this pull request may close these issues.

1 participant