Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

Sign up for GitHub

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Jump to bottom

Add benchmark cases #159

Merged
merged 2 commits into from
Feb 16, 2024
Merged

Add benchmark cases #159

merged 2 commits into from
Feb 16, 2024

Conversation

thearyadev
Copy link
Owner

This PR adds benchmark cases
Heroes missing from the benchmarks: Junkrat, Reaper, Symmetra, Torbjorn.
Previous testing shows no accuracy issues; heroes will be added at a later date.

Results:

PASS DAMAGE_S8_P2_AMERICAS
        ['Sojourn', 'Widowmaker', 'Tracer'] == ['Sojourn', 'Widowmaker', 'Tracer']
PASS DAMAGE_S8_P2_AMERICAS
        ['Sojourn', 'Widowmaker', 'Tracer'] == ['Sojourn', 'Widowmaker', 'Tracer']
PASS DAMAGE_S8_P2_AMERICAS
        ['Sojourn', 'Widowmaker', 'Tracer'] == ['Sojourn', 'Widowmaker', 'Tracer']
PASS DAMAGE_S8_P2_AMERICAS
        ['Tracer', 'Genji', 'Echo'] == ['Tracer', 'Genji', 'Echo']
PASS DAMAGE_S8_P2_AMERICAS
        ['Sojourn', 'Hanzo', 'Ashe'] == ['Sojourn', 'Hanzo', 'Ashe']
PASS DAMAGE_S8_P2_AMERICAS
        ['Tracer', 'Sojourn', 'Widowmaker'] == ['Tracer', 'Sojourn', 'Widowmaker']
PASS DAMAGE_S8_P2_AMERICAS
        ['Genji', 'Tracer', 'Echo'] == ['Genji', 'Tracer', 'Echo']
PASS DAMAGE_S8_P2_AMERICAS
        ['Tracer', 'Sojourn', 'Ashe'] == ['Tracer', 'Sojourn', 'Ashe']
PASS DAMAGE_S8_P2_AMERICAS
        ['Soldier 76', 'Sojourn', 'Ashe'] == ['Soldier 76', 'Sojourn', 'Ashe']
PASS DAMAGE_S8_P2_AMERICAS
        ['Tracer', 'Echo', 'Genji'] == ['Tracer', 'Echo', 'Genji']
PASS TANK_S8_P2_AMERICAS
        ['Mauga', 'Wrecking Ball', 'Ramattra'] == ['Mauga', 'Wrecking Ball', 'Ramattra']
PASS TANK_S8_P2_AMERICAS
        ['Mauga', 'Sigma', 'Zarya'] == ['Mauga', 'Sigma', 'Zarya']
PASS TANK_S8_P2_AMERICAS
        ['Junker Queen', 'Zarya', 'Sigma'] == ['Junker Queen', 'Zarya', 'Sigma']
PASS TANK_S8_P2_AMERICAS
        ['Junker Queen', 'Zarya', 'Sigma'] == ['Junker Queen', 'Zarya', 'Sigma']
PASS TANK_S8_P2_AMERICAS
        ['Roadhog', 'Sigma', 'Junker Queen'] == ['Roadhog', 'Sigma', 'Junker Queen']
PASS TANK_S8_P2_AMERICAS
        ['Roadhog', 'Sigma', 'Junker Queen'] == ['Roadhog', 'Sigma', 'Junker Queen']
PASS TANK_S8_P2_AMERICAS
        ['Junker Queen', 'Roadhog', 'Ramattra'] == ['Junker Queen', 'Roadhog', 'Ramattra']
PASS TANK_S8_P2_AMERICAS
        ['Roadhog', 'Blank', 'Blank'] == ['Roadhog', 'Blank', 'Blank']
PASS TANK_S8_P2_AMERICAS
        ['Mauga', 'Junker Queen', 'Sigma'] == ['Mauga', 'Junker Queen', 'Sigma']
PASS TANK_S8_P2_AMERICAS
        ['Zarya', 'Ramattra', 'D.Va'] == ['Zarya', 'Ramattra', 'D.Va']
PASS DAMAGE_S8_P4_AMERICAS
        ['Bastion', 'Blank', 'Blank'] == ['Bastion', 'Blank', 'Blank']
PASS DAMAGE_S8_P4_AMERICAS
        ['Genji', 'Sojourn', 'Echo'] == ['Genji', 'Sojourn', 'Echo']
PASS DAMAGE_S8_P4_AMERICAS
        ['Genji', 'Blank', 'Blank'] == ['Genji', 'Blank', 'Blank']
PASS DAMAGE_S8_P4_AMERICAS
        ['Sojourn', 'Widowmaker', 'Hanzo'] == ['Sojourn', 'Widowmaker', 'Hanzo']
PASS DAMAGE_S8_P4_AMERICAS
        ['Sojourn', 'Tracer', 'Genji'] == ['Sojourn', 'Tracer', 'Genji']
PASS DAMAGE_S8_P4_AMERICAS
        ['Sojourn', 'Ashe', 'Tracer'] == ['Sojourn', 'Ashe', 'Tracer']
PASS DAMAGE_S8_P4_AMERICAS
        ['Genji', 'Sojourn', 'Echo'] == ['Genji', 'Sojourn', 'Echo']
PASS DAMAGE_S8_P4_AMERICAS
        ['Tracer', 'Sojourn', 'Genji'] == ['Tracer', 'Sojourn', 'Genji']
PASS DAMAGE_S8_P4_AMERICAS
        ['Sojourn', 'Widowmaker', 'Tracer'] == ['Sojourn', 'Widowmaker', 'Tracer']
PASS DAMAGE_S8_P4_AMERICAS
        ['Genji', 'Tracer', 'Sojourn'] == ['Genji', 'Tracer', 'Sojourn']
PASS DAMAGE_S8_P1_AMERICAS
        ['Pharah', 'Sojourn', 'Echo'] == ['Pharah', 'Sojourn', 'Echo']
PASS DAMAGE_S8_P1_AMERICAS
        ['Sojourn', 'Pharah', 'Echo'] == ['Sojourn', 'Pharah', 'Echo']
PASS DAMAGE_S8_P1_AMERICAS
        ['Sojourn', 'Widowmaker', 'Genji'] == ['Sojourn', 'Widowmaker', 'Genji']
PASS DAMAGE_S8_P1_AMERICAS
        ['Sojourn', 'Ashe', 'Tracer'] == ['Sojourn', 'Ashe', 'Tracer']
PASS DAMAGE_S8_P1_AMERICAS
        ['Sojourn', 'Ashe', 'Soldier 76'] == ['Sojourn', 'Ashe', 'Soldier 76']
PASS DAMAGE_S8_P1_AMERICAS
        ['Tracer', 'Genji', 'Echo'] == ['Tracer', 'Genji', 'Echo']
PASS DAMAGE_S8_P1_AMERICAS
        ['Tracer', 'Sojourn', 'Echo'] == ['Tracer', 'Sojourn', 'Echo']
PASS DAMAGE_S8_P1_AMERICAS
        ['Soldier 76', 'Sojourn', 'Ashe'] == ['Soldier 76', 'Sojourn', 'Ashe']
PASS DAMAGE_S8_P1_AMERICAS
        ['Widowmaker', 'Tracer', 'Cassidy'] == ['Widowmaker', 'Tracer', 'Cassidy']
PASS DAMAGE_S8_P1_AMERICAS
        ['Sojourn', 'Ashe', 'Sombra'] == ['Sojourn', 'Ashe', 'Sombra']
PASS DAMAGE_S8_P3_AMERICAS
        ['Tracer', 'Sojourn', 'Genji'] == ['Tracer', 'Sojourn', 'Genji']
PASS DAMAGE_S8_P3_AMERICAS
        ['Tracer', 'Hanzo', 'Widowmaker'] == ['Tracer', 'Hanzo', 'Widowmaker']
PASS DAMAGE_S8_P3_AMERICAS
        ['Tracer', 'Sojourn', 'Genji'] == ['Tracer', 'Sojourn', 'Genji']
PASS DAMAGE_S8_P3_AMERICAS
        ['Tracer', 'Sojourn', 'Widowmaker'] == ['Tracer', 'Sojourn', 'Widowmaker']
PASS DAMAGE_S8_P3_AMERICAS
        ['Sojourn', 'Widowmaker', 'Hanzo'] == ['Sojourn', 'Widowmaker', 'Hanzo']
PASS DAMAGE_S8_P3_AMERICAS
        ['Tracer', 'Sojourn', 'Mei'] == ['Tracer', 'Sojourn', 'Mei']
PASS DAMAGE_S8_P3_AMERICAS
        ['Sojourn', 'Tracer', 'Echo'] == ['Sojourn', 'Tracer', 'Echo']
PASS DAMAGE_S8_P3_AMERICAS
        ['Sojourn', 'Tracer', 'Hanzo'] == ['Sojourn', 'Tracer', 'Hanzo']
PASS DAMAGE_S8_P3_AMERICAS
        ['Sojourn', 'Sombra', 'Widowmaker'] == ['Sojourn', 'Sombra', 'Widowmaker']
PASS DAMAGE_S8_P3_AMERICAS
        ['Sojourn', 'Sombra', 'Widowmaker'] == ['Sojourn', 'Sombra', 'Widowmaker']
PASS SUPPORT_S8_P4_AMERICAS
        ['Lucio', 'Brigitte', 'Baptiste'] == ['Lucio', 'Brigitte', 'Baptiste']
PASS SUPPORT_S8_P4_AMERICAS
        ['Kiriko', 'Baptiste', 'Lucio'] == ['Kiriko', 'Baptiste', 'Lucio']
PASS SUPPORT_S8_P4_AMERICAS
        ['Ana', 'LifeWeaver', 'Illari'] == ['Ana', 'LifeWeaver', 'Illari']
PASS SUPPORT_S8_P4_AMERICAS
        ['Kiriko', 'Baptiste', 'Ana'] == ['Kiriko', 'Baptiste', 'Ana']
PASS SUPPORT_S8_P4_AMERICAS
        ['Ana', 'Kiriko', 'Zenyatta'] == ['Ana', 'Kiriko', 'Zenyatta']
PASS SUPPORT_S8_P4_AMERICAS
        ['Baptiste', 'Lucio', 'Ana'] == ['Baptiste', 'Lucio', 'Ana']
PASS SUPPORT_S8_P4_AMERICAS
        ['Kiriko', 'Baptiste', 'Ana'] == ['Kiriko', 'Baptiste', 'Ana']
PASS SUPPORT_S8_P4_AMERICAS
        ['Kiriko', 'Lucio', 'Baptiste'] == ['Kiriko', 'Lucio', 'Baptiste']
PASS SUPPORT_S8_P4_AMERICAS
        ['Kiriko', 'Brigitte', 'Zenyatta'] == ['Kiriko', 'Brigitte', 'Zenyatta']
PASS SUPPORT_S8_P4_AMERICAS
        ['Baptiste', 'Ana', 'Kiriko'] == ['Baptiste', 'Ana', 'Kiriko']
PASS SUPPORT_S8_P2_AMERICAS
        ['Kiriko', 'Ana', 'Baptiste'] == ['Kiriko', 'Ana', 'Baptiste']
PASS SUPPORT_S8_P2_AMERICAS
        ['Ana', 'Baptiste', 'Kiriko'] == ['Ana', 'Baptiste', 'Kiriko']
PASS SUPPORT_S8_P2_AMERICAS
        ['Lucio', 'Brigitte', 'Baptiste'] == ['Lucio', 'Brigitte', 'Baptiste']
PASS SUPPORT_S8_P2_AMERICAS
        ['Baptiste', 'Kiriko', 'Ana'] == ['Baptiste', 'Kiriko', 'Ana']
PASS SUPPORT_S8_P2_AMERICAS
        ['Brigitte', 'Blank', 'Blank'] == ['Brigitte', 'Blank', 'Blank']
PASS SUPPORT_S8_P2_AMERICAS
        ['Kiriko', 'Baptiste', 'Zenyatta'] == ['Kiriko', 'Baptiste', 'Zenyatta']
PASS SUPPORT_S8_P2_AMERICAS
        ['Ana', 'Kiriko', 'Illari'] == ['Ana', 'Kiriko', 'Illari']
PASS SUPPORT_S8_P2_AMERICAS
        ['Ana', 'Kiriko', 'Illari'] == ['Ana', 'Kiriko', 'Illari']
PASS SUPPORT_S8_P2_AMERICAS
        ['Lucio', 'Zenyatta', 'Ana'] == ['Lucio', 'Zenyatta', 'Ana']
PASS SUPPORT_S8_P2_AMERICAS
        ['Kiriko', 'Mercy', 'Moira'] == ['Kiriko', 'Mercy', 'Moira']
PASS TANK_S8_P3_AMERICAS
        ['Junker Queen', 'Sigma', 'Mauga'] == ['Junker Queen', 'Sigma', 'Mauga']
PASS TANK_S8_P3_AMERICAS
        ['Doomfist', 'Sigma', 'Roadhog'] == ['Doomfist', 'Sigma', 'Roadhog']
PASS TANK_S8_P3_AMERICAS
        ['Sigma', 'Winston', 'Junker Queen'] == ['Sigma', 'Winston', 'Junker Queen']
PASS TANK_S8_P3_AMERICAS
        ['Mauga', 'Winston', 'Sigma'] == ['Mauga', 'Winston', 'Sigma']
PASS TANK_S8_P3_AMERICAS
        ['Junker Queen', 'Sigma', 'Zarya'] == ['Junker Queen', 'Sigma', 'Zarya']
PASS TANK_S8_P3_AMERICAS
        ['Sigma', 'Junker Queen', 'Mauga'] == ['Sigma', 'Junker Queen', 'Mauga']
PASS TANK_S8_P3_AMERICAS
        ['Doomfist', 'Junker Queen', 'Winston'] == ['Doomfist', 'Junker Queen', 'Winston']
PASS TANK_S8_P3_AMERICAS
        ['Ramattra', 'Junker Queen', 'Sigma'] == ['Ramattra', 'Junker Queen', 'Sigma']
PASS TANK_S8_P3_AMERICAS
        ['Mauga', 'Ramattra', 'Winston'] == ['Mauga', 'Ramattra', 'Winston']
PASS TANK_S8_P3_AMERICAS
        ['Sigma', 'Ramattra', 'Junker Queen'] == ['Sigma', 'Ramattra', 'Junker Queen']
PASS TANK_S8_P1_AMERICAS
        ['Ramattra', 'Sigma', 'Junker Queen'] == ['Ramattra', 'Sigma', 'Junker Queen']
PASS TANK_S8_P1_AMERICAS
        ['Mauga', 'Junker Queen', 'Roadhog'] == ['Mauga', 'Junker Queen', 'Roadhog']
PASS TANK_S8_P1_AMERICAS
        ['Junker Queen', 'Sigma', 'Mauga'] == ['Junker Queen', 'Sigma', 'Mauga']
PASS TANK_S8_P1_AMERICAS
        ['Roadhog', 'Mauga', 'Doomfist'] == ['Roadhog', 'Mauga', 'Doomfist']
PASS TANK_S8_P1_AMERICAS
        ['Orisa', 'Junker Queen', 'Zarya'] == ['Orisa', 'Junker Queen', 'Zarya']
PASS TANK_S8_P1_AMERICAS
        ['Sigma', 'Junker Queen', 'Ramattra'] == ['Sigma', 'Junker Queen', 'Ramattra']
PASS TANK_S8_P1_AMERICAS
        ['Mauga', 'Ramattra', 'Roadhog'] == ['Mauga', 'Ramattra', 'Roadhog']
PASS TANK_S8_P1_AMERICAS
        ['Roadhog', 'Sigma', 'Zarya'] == ['Roadhog', 'Sigma', 'Zarya']
PASS TANK_S8_P1_AMERICAS
        ['Junker Queen', 'Mauga', 'Roadhog'] == ['Junker Queen', 'Mauga', 'Roadhog']
PASS TANK_S8_P1_AMERICAS
        ['Junker Queen', 'Roadhog', 'Ramattra'] == ['Junker Queen', 'Roadhog', 'Ramattra']
PASS SUPPORT_S8_P3_AMERICAS
        ['Kiriko', 'Mercy', 'Moira'] == ['Kiriko', 'Mercy', 'Moira']
PASS SUPPORT_S8_P3_AMERICAS
        ['Ana', 'Baptiste', 'Kiriko'] == ['Ana', 'Baptiste', 'Kiriko']
PASS SUPPORT_S8_P3_AMERICAS
        ['Lucio', 'Brigitte', 'Kiriko'] == ['Lucio', 'Brigitte', 'Kiriko']
PASS SUPPORT_S8_P3_AMERICAS
        ['Ana', 'Baptiste', 'Kiriko'] == ['Ana', 'Baptiste', 'Kiriko']
PASS SUPPORT_S8_P3_AMERICAS
        ['Baptiste', 'Kiriko', 'Ana'] == ['Baptiste', 'Kiriko', 'Ana']
PASS SUPPORT_S8_P3_AMERICAS
        ['Lucio', 'Kiriko', 'Ana'] == ['Lucio', 'Kiriko', 'Ana']
PASS SUPPORT_S8_P3_AMERICAS
        ['Kiriko', 'Lucio', 'Brigitte'] == ['Kiriko', 'Lucio', 'Brigitte']
PASS SUPPORT_S8_P3_AMERICAS
        ['Mercy', 'Lucio', 'Zenyatta'] == ['Mercy', 'Lucio', 'Zenyatta']
PASS SUPPORT_S8_P3_AMERICAS
        ['Kiriko', 'Ana', 'Baptiste'] == ['Kiriko', 'Ana', 'Baptiste']
PASS SUPPORT_S8_P3_AMERICAS
        ['Lucio', 'Brigitte', 'Baptiste'] == ['Lucio', 'Brigitte', 'Baptiste']
PASS TANK_S8_P4_AMERICAS
        ['Mauga', 'Sigma', 'Doomfist'] == ['Mauga', 'Sigma', 'Doomfist']
PASS TANK_S8_P4_AMERICAS
        ['Sigma', 'Junker Queen', 'Winston'] == ['Sigma', 'Junker Queen', 'Winston']
PASS TANK_S8_P4_AMERICAS
        ['Sigma', 'Ramattra', 'Junker Queen'] == ['Sigma', 'Ramattra', 'Junker Queen']
PASS TANK_S8_P4_AMERICAS
        ['Sigma', 'Ramattra', 'Junker Queen'] == ['Sigma', 'Ramattra', 'Junker Queen']
PASS TANK_S8_P4_AMERICAS
        ['Mauga', 'Zarya', 'Ramattra'] == ['Mauga', 'Zarya', 'Ramattra']
PASS TANK_S8_P4_AMERICAS
        ['Junker Queen', 'Ramattra', 'Reinhardt'] == ['Junker Queen', 'Ramattra', 'Reinhardt']
PASS TANK_S8_P4_AMERICAS
        ['Mauga', 'Blank', 'Blank'] == ['Mauga', 'Blank', 'Blank']
PASS TANK_S8_P4_AMERICAS
        ['Sigma', 'Junker Queen', 'Ramattra'] == ['Sigma', 'Junker Queen', 'Ramattra']
PASS TANK_S8_P4_AMERICAS
        ['Roadhog', 'Mauga', 'Sigma'] == ['Roadhog', 'Mauga', 'Sigma']
PASS TANK_S8_P4_AMERICAS
        ['Junker Queen', 'Sigma', 'D.Va'] == ['Junker Queen', 'Sigma', 'D.Va']
PASS SUPPORT_S8_P1_AMERICAS
        ['Ana', 'Kiriko', 'Zenyatta'] == ['Ana', 'Kiriko', 'Zenyatta']
PASS SUPPORT_S8_P1_AMERICAS
        ['Baptiste', 'Kiriko', 'Ana'] == ['Baptiste', 'Kiriko', 'Ana']
PASS SUPPORT_S8_P1_AMERICAS
        ['Ana', 'Kiriko', 'Baptiste'] == ['Ana', 'Kiriko', 'Baptiste']
PASS SUPPORT_S8_P1_AMERICAS
        ['Baptiste', 'Kiriko', 'Ana'] == ['Baptiste', 'Kiriko', 'Ana']
PASS SUPPORT_S8_P1_AMERICAS
        ['Kiriko', 'Baptiste', 'Ana'] == ['Kiriko', 'Baptiste', 'Ana']
PASS SUPPORT_S8_P1_AMERICAS
        ['Ana', 'Baptiste', 'Kiriko'] == ['Ana', 'Baptiste', 'Kiriko']
PASS SUPPORT_S8_P1_AMERICAS
        ['Ana', 'Kiriko', 'Brigitte'] == ['Ana', 'Kiriko', 'Brigitte']
PASS SUPPORT_S8_P1_AMERICAS
        ['Kiriko', 'Baptiste', 'Ana'] == ['Kiriko', 'Baptiste', 'Ana']
PASS SUPPORT_S8_P1_AMERICAS
        ['Lucio', 'Brigitte', 'Kiriko'] == ['Lucio', 'Brigitte', 'Kiriko']
PASS SUPPORT_S8_P1_AMERICAS
        ['Lucio', 'Brigitte', 'Kiriko'] == ['Lucio', 'Brigitte', 'Kiriko']



Total tests: 120
Passed tests: 120
Failed tests: 0
Success rate: 100.0%
Heroes not present in answer set: {'Junkrat', 'Torbjorn', 'Symmetra', 'Reaper'}
Time taken: 2.6054737409576774 seconds

@thearyadev thearyadev linked an issue Feb 16, 2024 that may be closed by this pull request
add benchmark cases #154
Closed
@thearyadev
Copy link
Owner Author

#158 resolved in this pr

@thearyadev thearyadev merged commit d04e87f into main Feb 16, 2024
5 checks passed
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Reviewers
No reviews
Assignees
No one assigned
Labels
None yet
Projects
None yet
Milestone
No milestone
Development

Successfully merging this pull request may close these issues.

add benchmark cases
1 participant
@thearyadev