Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Implement flexible bottom tab bar #49539

Merged
merged 499 commits into from
Feb 12, 2025

Conversation

adamgrzybowski
Copy link
Contributor

@adamgrzybowski adamgrzybowski commented Sep 20, 2024

Details

Motivation

This PR started with this feature request: Use persistent bottom tabs in Settings to improve Workspace Editor UX. We realized that the current structure of navigators isn't well-suited to handle features requiring conditional placement of the bottom tab bar. Additionally, after many iterations and discussions about navigation, we had an idea for a structure that meets current needs more effectively and is easier to develop and maintain.

Problem

Currently, the first route in the root navigator is always the BottomTabNavigator. This setup means all screens needing the bottom tab bar are nested inside it. All other screens and navigators are stacked on top. This configuration also makes the root navigator responsible for the split view, causing two major issues:

  • a) Limited flexibility for deciding which screens should have a bottom tab bar.
  • b) The root navigator is too coupled with the split view functionality, which can slow down development and cause bugs.

Solution

a) Flexible Bottom Tab Bar

We decided to detach the bottom tab bar from the bottom tab navigator. The bottom tab navigator no longer exists. Now, we can render the bottom tab bar on any screen that requires it, even conditionally like on the workspace list page where it should be visible only for the narrow layout.

b) Separating Root Navigator and Split Functionality

We have extracted the logic responsible for managing the split view into a separate custom SplitNavigator. Better separation makes it easier to develop new screens and adapt different navigation patterns that don’t follow the usual rules.

Other Changes

We've used this opportunity to address other pain points and bugs in the current navigation implementation. In addition to cleaning up old helpers and reorganizing the directory structure, there are a few notable changes:

getAdaptedState

Thanks to the new split navigators managing their own initial state, we were able to simplify the function that generates the initial global state from a link.

linkTo

This function has grown complex over multiple iterations. Small changes could cause hard to detect bugs. We've simplified it significantly and moved much of the logic to the routers of the custom navigators to improve readability and separation of responsibility.

goBack

With the new structure, we've taken the opportunity to rethink the implementation of this function, making it more bulletproof and eliminating some old hard to fix bugs.

tests

To ensure that resolved bugs remain fixed, we've created manual test cases in NAVIGATION.md and automated tests in tests/navigation/. These tests also help communicate how the navigation should behave, especially in cases that are exemptions from standard rules.

MOBILE-EXPENSIFY:13395

Fixed Issues

$ #44242

Other fixed issues:
$ #53478

Tests

  • Verify that no errors appear in the JS console

Offline tests

QA Steps

  • Verify that no errors appear in the JS console

There should be a proper report under attachment screen after reload

  1. Open any report with image attachment on narrow layout.
  2. Open attachment.
  3. Reload the page.
  4. Verify that after pressing back arrow in the header you are on the report where you sent the attachment.

There is a proper split navigator under RHP with a sidebar screen only for screens that can be opened from the sidebar

  1. Open the browser on narrow layout with url /settings/profile/status.
  2. Reload the page.
  3. Verify that after pressing back arrow in the header you are on the settings root page.

There is a proper split navigator under the overlay after refreshing page with RHP/LHP on wide screen

  1. Open the browser on wide screen with url /settings/profile/display-name.
  2. Verify that you can see settings profile page under the overlay of RHP.

There is a proper split navigator under the overlay after deeplinking to page with RHP/LHP on wide screen

  1. Open the browser on wide screen.
  2. Open any report.
  3. Send message with url /settings/profile/display-name.
  4. Press the sent link
  5. Verify that the settings profile screen is now visible under the overlay

The Workspace list page is displayed (SCREENS.SETTINGS.WORKSPACES) after clicking the Settings tab from the Workspace settings screen

  1. Open any workspace settings (Settings → Workspaces → Select any workspace)
  2. Click the Settings button on the bottom tab.
  3. Verify that the Workspace list is displayed (/settings/workspaces)
  4. Select any workspace again.
  5. Reload the page.
  6. Click the Settings button on the bottom tab.
  7. Verify that the Workspace list is displayed (/settings/workspaces)

The last visited screen in the settings tab is saved when switching between tabs

  1. Open the app.
  2. Go to the settings tab.
  3. Open the workspace list.
  4. Select any workspace.
  5. Switch between tabs and open the settings tabs again.
  6. Verify that the last visited page in this tab is displayed.

The Workspace selected in the application is reset when you select a chat that does not belong to the current policy

  1. Open the home page.
  2. Click on the Expensify icon in the upper left corner.
  3. Select any workspace.
  4. Click on the magnifying glass above the list of available chats.
  5. Select a chat that does not belong to the workspace selected in the third step.
  6. Verify if the chat is opened and the global workspace is selected.

The selected workspace is saved between Search and Inbox tabs

  1. Open the Inbox tab.
  2. Change the workspace using the workspace switcher.
  3. Switch to the Search tab and verify if the workspace selected in the second step is also selected in the Search.
  4. Change the workspace once again.
  5. Go back to the Inbox.
  6. Verify if the workspace selected in the fourth step is also selected in the Inbox tab.

Going up to the workspace list page after refreshing on the workspace settings and pressing the up button

  1. Open the workspace settings from the deep link (use a link in format: /settings/workspaces/:policyID:/profile)
  2. Click the app’s back button.
  3. Verify if the workspace list is displayed.

Going up to the RHP screen provided in the backTo parameter in the url

  1. Open the settings tab.
  2. Go to the Profile page.
  3. Click the Address button.
  4. Click the Country button.
  5. Reload the page.
  6. Click the app’s back button.
  7. Verify if the Profile address page is displayed (/settings/profile/address)

There is proper split navigator under the overlay after refreshing page in RHP that includes valid reportID in params

wide layout :

  1. Open any report.
  2. Open report details (press the chat header).
  3. Reload the app.
  4. Verify that the report under the overlay is the same as the one opened in report details.

narrow layout :

  1. Open any report
  2. Open report details (press the chat header).
  3. Reload the app.
  4. Verify that after pressing back arrow in the header you are on the report previously seen in the details page.

Navigating back to the Workspace Switcher from the created workspace

  1. Open the app and go to the Inbox tab.
  2. Open the workspace switcher (Click on the button in the upper left corner).
  3. Create a new workspace by clicking on the + button.
  4. Navigate back using the back button in the app.
  5. Verify if the workspace switcher is displayed with the report screen below it

Going up to the sidebar screen

Linked issue: #44138

  1. Go to Subscription page in the settings tab.
  2. Click on Request refund button
  3. Verify that modal shown
  4. Next click Downgrade...
  5. Verify that modal got closed, your account is downgraded and the Home page is opened.

Navigating back from the Search page with invalid query parameters

  1. Open the search page with invalid query parameters (e.g /search?q=from%3a)
  2. Press the app's back button on the not found page.
  3. Verify that the Search page with default query parameters is displayed.

Navigating to the chat from the link in the thread

  1. Open any chat.
  2. If there are no messages in the chat, send a message.
  3. Press reply in thread.
  4. Press the "From" link in the displayed header.
  5. Verify if the link correctly redirects to the chat opened in the first step.

Expense - App does not open destination report after submitting expense

Linked issue: #49539 (comment)

  1. Launch the app.
  2. Open FAB > Submit expense > Manual.
  3. Submit a manual expense to any user (as long as the user is not the currrently opened report and the receiver is not workspace chat).
  4. Verify if the destination report is opened after submitting expense.

QBO - Preferred exporter/Export date tab do not auto-close after value selected

Linked issue: #49539 (comment)

Precondition: Workspace with QBO integration connected.

  1. Go to Workspace > Accounting.
  2. Click on Export > Preferred exporter (or Export date).
  3. Click on value.
  4. Verify if the value chosen in the third step is selected and the app redirects to the Export page.

Web - Hold - App flickers after entering reason and saving it when holding expense

Linked issue: #49539 (comment)

  1. Launch the app.
  2. Open DM with any user.
  3. Submit two expenses to them.
  4. Click on the expense preview to go to expense report.
  5. Click on any preview to go to transaction thread.
  6. Go back to expense report.
  7. Right click on the expense preview in Step 5 > Hold.
  8. Enter a reason and save it.
  9. Verify if the app does not flicker after entering reason and saving it.

Group - App returns to group settings page after saving group name

Linked issue: #49539 (comment)

  1. Launch the app.
  2. Create a group chat.
  3. Go to group chat.
  4. Click on the group chat header.
  5. Click Group name field.
  6. Click Save.
  7. Verify if the app returs to group details RHP after saving group name.

Going up to a screen with any params

Linked issue: #49539 (comment)

  1. Press the FAB.
  2. Select "Book travel".
  3. Press "Book travel" in the new RHP pane.
  4. Press "Country".
  5. Select any country.
  6. Verify that the country you selected is actually visible in the form.

Change params of existing attachments screens instead of pushing new screen on the stack

Linked issue: #49539 (comment)

  1. Open any chat.
  2. Send at least two images.
  3. Open attachment by pressing on image.
  4. Press arrow on the side of attachment modal to navigate to the second image.
  5. Close the modal with X in the corner.
  6. Verify that the modal is now fully closed.

Navigate instead of push for reports with same reportID

Linked issue: #49539 (comment)

  1. Open app on wide layout web.
  2. Go to report A (any report).
  3. Go to report B (any report with message).
  4. Press reply in thread.
  5. Press on header subtitle.
  6. Press on the report B in the sidebar.
  7. Verify that the message you replied to is no longer highlighted.
  8. Press the browsers back button.
  9. Verify that you are on the A report.

Don't push the default full screen route if not necessary.

  1. Open app on wide layout web.
  2. Open search tab.
  3. Press track expense.
  4. Verify that the split navigator hasn't changed under the overlay.

BA - Back button on connect bank account modal opens incorporation state modal

Linked issue: #49539 (comment)

Precondition: Use staging server (it can be set in Settings >> Troubleshoot)

  1. Launch the app.
  2. Navigate to Settings >> Workspaces >> Workspace >> Workflows.
  3. Select Connect with Plaid option.
  4. Go through the Plaid flow (Added Wells Fargo details).
  5. Complete the Personal info, Company info & agreements section.
  6. Note user redirected to page with the header Connect bank account and the option to disconnect your now set up bank account.
  7. Tap back button on connect bank account modal.
  8. Verify if the connect bank account modal is closed and the Workflows page is opened with the bank account added.

App opens room details page when tapping RHP back button after saving Private notes in DM

Linked issue: #49539 (comment)

  1. Launch the app.
  2. Open DM with any user that does not have content in Private notes.
  3. Click on the chat header.
  4. Click Private notes.
  5. Enter anything and click Save.
  6. Click on the RHP back button.
  7. Verify if the Profile RHP Page is opened (URL in the format /a/:accountID).

Opening particular onboarding pages from a link and going back

Linked issue: #50177

  1. Sign in as a new user.
  2. Select Something else from the onboarding flow.
  3. Reopen/refresh the app.
  4. Verify the Personal detail step is shown.
  5. Go back.
  6. Verify you are navigated back to the Purpose step.
  7. Select Manage my team.
  8. Choose the employee size.
  9. Reopen/refresh the app.
  10. Verify the connection integration step is shown.
  11. Go back.
  12. Verify you are navigated back to the employee size step.
  13. Go back.
  14. Verify you are navigated back to the Purpose step.

PR Author Checklist

  • I linked the correct issue in the ### Fixed Issues section above
  • I wrote clear testing steps that cover the changes made in this PR
    • I added steps for local testing in the Tests section
    • I added steps for the expected offline behavior in the Offline steps section
    • I added steps for Staging and/or Production testing in the QA steps section
    • I added steps to cover failure scenarios (i.e. verify an input displays the correct error message if the entered data is not correct)
    • I turned off my network connection and tested it while offline to ensure it matches the expected behavior (i.e. verify the default avatar icon is displayed if app is offline)
    • I tested this PR with a High Traffic account against the staging or production API to ensure there are no regressions (e.g. long loading states that impact usability).
  • I included screenshots or videos for tests on all platforms
  • I ran the tests on all platforms & verified they passed on:
    • Android: Native
    • Android: mWeb Chrome
    • iOS: Native
    • iOS: mWeb Safari
    • MacOS: Chrome / Safari
    • MacOS: Desktop
  • I verified there are no console errors (if there's a console error not related to the PR, report it or open an issue for it to be fixed)
  • I followed proper code patterns (see Reviewing the code)
    • I verified that any callback methods that were added or modified are named for what the method does and never what callback they handle (i.e. toggleReport and not onIconClick)
    • I verified that comments were added to code that is not self explanatory
    • I verified that any new or modified comments were clear, correct English, and explained "why" the code was doing something instead of only explaining "what" the code was doing.
    • I verified any copy / text shown in the product is localized by adding it to src/languages/* files and using the translation method
      • If any non-english text was added/modified, I used JaimeGPT to get English > Spanish translation. I then posted it in #expensify-open-source and it was approved by an internal Expensify engineer. Link to Slack message:
    • I verified all numbers, amounts, dates and phone numbers shown in the product are using the localization methods
    • I verified any copy / text that was added to the app is grammatically correct in English. It adheres to proper capitalization guidelines (note: only the first word of header/labels should be capitalized), and is either coming verbatim from figma or has been approved by marketing (in order to get marketing approval, ask the Bug Zero team member to add the Waiting for copy label to the issue)
    • I verified proper file naming conventions were followed for any new files or renamed files. All non-platform specific files are named after what they export and are not named "index.js". All platform-specific files are named for the platform the code supports as outlined in the README.
    • I verified the JSDocs style guidelines (in STYLE.md) were followed
  • If a new code pattern is added I verified it was agreed to be used by multiple Expensify engineers
  • I followed the guidelines as stated in the Review Guidelines
  • I tested other components that can be impacted by my changes (i.e. if the PR modifies a shared library or component like Avatar, I verified the components using Avatar are working as expected)
  • I verified all code is DRY (the PR doesn't include any logic written more than once, with the exception of tests)
  • I verified any variables that can be defined as constants (ie. in CONST.ts or at the top of the file that uses the constant) are defined as such
  • I verified that if a function's arguments changed that all usages have also been updated correctly
  • If any new file was added I verified that:
    • The file has a description of what it does and/or why is needed at the top of the file if the code is not self explanatory
  • If a new CSS style is added I verified that:
    • A similar style doesn't already exist
    • The style can't be created with an existing StyleUtils function (i.e. StyleUtils.getBackgroundAndBorderStyle(theme.componentBG))
  • If the PR modifies code that runs when editing or sending messages, I tested and verified there is no unexpected behavior for all supported markdown - URLs, single line code, code blocks, quotes, headings, bold, strikethrough, and italic.
  • If the PR modifies a generic component, I tested and verified that those changes do not break usages of that component in the rest of the App (i.e. if a shared library or component like Avatar is modified, I verified that Avatar is working as expected in all cases)
  • If the PR modifies a component related to any of the existing Storybook stories, I tested and verified all stories for that component are still working as expected.
  • If the PR modifies a component or page that can be accessed by a direct deeplink, I verified that the code functions as expected when the deeplink is used - from a logged in and logged out account.
  • If the PR modifies the UI (e.g. new buttons, new UI components, changing the padding/spacing/sizing, moving components, etc) or modifies the form input styles:
    • I verified that all the inputs inside a form are aligned with each other.
    • I added Design label and/or tagged @Expensify/design so the design team can review the changes.
  • If a new page is added, I verified it's using the ScrollView component to make it scrollable when more elements are added to the page.
  • I added unit tests for any new feature or bug fix in this PR to help automatically prevent regressions in this user flow.
  • If the main branch was merged into this PR after a review, I tested again and verified the outcome was still expected according to the Test steps.

Screenshots/Videos

Android: Native
Android: mWeb Chrome
androidWeb.mp4
iOS: Native
ios.mp4
iOS: mWeb Safari
iosWeb.mp4
MacOS: Chrome / Safari
web.mp4
MacOS: Desktop
desktop.mp4

This comment has been minimized.

@mountiny
Copy link
Contributor

trim.EDC2126F-EA24-40D4-87A4-E252B86DA87A.MOV

There are no page animations in the settings stack

@JmillsExpensify
Copy link

I took this for a quick spin on Chrome/web and it worked fairly well, including properly accounting for the browser back case. One thing I noticed, though I'm not sure if it's related to this PR or not: I occasionally experienced performance issues, where the responsiveness of the page would slow down and almost freeze up for a second or two. I saw this on the Settings pages. I can do a profile trace if helpful, just let me know.

@mountiny
Copy link
Contributor

Definitely performance is something we need to keep in mind

@adamgrzybowski
Copy link
Contributor Author

@mountiny If I understand correctly this is something that we want. Those screens have the bottom tab bar. Other bottom tab screens don't have animations from the beginning.

@JmillsExpensify we are still working on adjusting performance tricks for these changes. Please point us to flows that feels slower than before so we can investigate it 🙇

@mountiny
Copy link
Contributor

If I understand correctly this is something that we want. Those screens have the bottom tab bar. Other bottom tab screens don't have animations from the beginning.

Hmm, I dont think we want that, going deeper in the settings should have animations, same as going to a report from LHN has animation @Expensify/design @trjExpensify @JmillsExpensify

@mountiny
Copy link
Contributor

@adamgrzybowski Wanted to report here as well that I think the performance on web for me is gradually getting worse and this morning it's noticeably slow, you can see it here as well which I have recorded for a different bug

Screen.Recording.2024-09-25.at.10.12.04.mp4

@adamgrzybowski
Copy link
Contributor Author

Hmm, I dont think we want that, going deeper in the settings should have animations, same as going to a report from LHN has animation

Screen.Recording.2024-09-25.at.11.52.59.mov

But doesn't that look weird? You can see how one bottom tab bar covers the previous one with animation.

cc: @mountiny

@trjExpensify
Copy link
Contributor

trjExpensify commented Sep 25, 2024

Yeah, I think that does look weird. The bottom tab bar feels like it's part of page being animated in, rather than persisting across the different pages.

@dubielzyk-expensify
Copy link
Contributor

Yeah that looks a bit off. The view should go over the bottom navigation instead. Though there's another issue to put the bottom navigation on top in workspaces.

Which should give us this:

CleanShot.2024-09-26.at.11.06.21.mp4

@mountiny
Copy link
Contributor

I agree that the bottom tab should not animate if it's staying on another page, too. I would defer to @dubielzyk-expensify and the design team to see how we want to handle this.

@dannymcclain
Copy link
Contributor

The video that Jon shared is what I would expect and prefer. But if that's not technically feasible at the moment, I would rather have the bottom tabs than the animation.

@adamgrzybowski
Copy link
Contributor Author

#49539 (comment) is what I would expect and prefer. But if that's not technically feasible at the moment, I would rather have the bottom tabs than the animation.

That's the problem. It may be tough to implement and if that's okay I would investigate this as follow-up. But let me explain why this is problematic at all.

Previously, we had a navigator that displayed a bottom tab bar over every screen within itself. This approach did not allow us to place the bottom tab bar on every screen in the app. Only on screens in this particular navigator. And it definitely did not allow us to display the bottom tab bar conditionally, as in the "Workspaces screen" case.

We decided to render the bottom on every screen that requires it instead. This approach gives us a lot of flexibility.

We did know that we couldn't create an animation of sliding screen with the bottom tab onto another screen with the bottom tab. But we assumed that as in current use cases, we won't animate screens with the bottom tab so that's not a problem.

Let's assume that we want to have this animation and we won't display it on every page but we will figure out a way to do it smarter.

#49539 (comment)

All screens that you can open from the menu visible in the video above are on the same level. Screen containing this menu is also on the same level. If that doesn't make sense, please consider the fact that we also need to handle the wide layout with this structure.

That means they are rendered with one <StackView />. In the case of workspaces screen and settings root we would need to render the bottom tab bar on top of this stack view. For other screens, we would need to render it somewhere between these cards to have proper animation. But we can't really put anything between these cards. The task will be even harder given the incoming which leaves us with even less wiggle room.

I am not saying it is impossible. I just want to give you context on how complex is adding this little animation. I have a few tricks in my mind but I would rather focus on this after migrating to the new structure.

@adamgrzybowski
Copy link
Contributor Author

When it comes to performance. I started digging and couldn't reproduce the laggy RHP that you filmed @mountiny. I might have to try the high traffic account or something like that.

However, I discovered a different issue when switching to the "Reports" tab.

What you can notice in our POC is that you can't see the skeleton loading. The first render of the report screen is delayed in comparison to the main.

before.mp4

It doesn't look like a big delay but it feels laggy when you click it yourself.

I investigate that and it looks like this doesn't happen on the main only by coincidence. I figured out a solution for that and tomorrow I will work on PR that we could merge to the main. It should help with the initial render of heavy screens in general and improve the user experience.

Below you can see the test result

after.mp4

@mountiny
Copy link
Contributor

I am fine exploring the animation later

@adamgrzybowski, you should definitely test with a high-traffic account at least; you could even try the heavy performance testing account we provided to SWM. Testing with a fresh account is not representative of the users we care about the most.

@adamgrzybowski
Copy link
Contributor Author

FYI: I played around with a solution I found yesterday regarding performance, and it may need more work and investigation. For now, I'll focus on other work left for this PR and get back to perf closer to review.

@mountiny mountiny self-requested a review October 7, 2024 12:33
Copy link
Contributor

github-actions bot commented Oct 8, 2024

@WojtekBoman
Copy link
Contributor

Hey! Here's a little update from me and Adam :)

Tasks we have accomplished recently:

  • new simplified Navigation.goBack has been merged to our feature branch, now we are focused on comparing whether it works the same way as on the main branch and fixing bugs
  • we started working on cleaning up the code to fix checks in our PR
  • Tests section has been added to the NAVIGATION.md. It's still in progress but first tests are ready to check. We are working on preparing further tests, but we also believe that bugs reported in this PR can be a source of knowledge for us, so feel free to test and report us what you find 🐛
  • Adam worked on polishing performance, one of the planned improvements has already been added to the feature branch
  • many resolved conflicts 😄

@mountiny
Copy link
Contributor

Thanks for the update! I think the performance is the critical part to nail down. Also deeplinks, those are often a can of worms

@shawnborton
Copy link
Contributor

Let us know when you want us to fire up another test build so we can take it for a spin!

@adamgrzybowski
Copy link
Contributor Author

@shawnborton Great timing 😄 we just improved performance and fixed some regressions we found. I think it's time to use your help with testing. 🙇

cc: @mountiny

Copy link
Contributor

Copy link
Contributor

🧪🧪 Use the links below to test this adhoc build on Android, iOS, Desktop, and Web. Happy testing! 🧪🧪

Android 🤖 iOS 🍎
https://ad-hoc-expensify-cash.s3.amazonaws.com/android/49539/index.html ❌ FAILED ❌
Android The QR code can't be generated, because the iOS build failed
Desktop 💻 Web 🕸️
https://ad-hoc-expensify-cash.s3.amazonaws.com/desktop/49539/NewExpensify.dmg https://49539.pr-testing.expensify.com
Desktop Web

👀 View the workflow run that generated this build 👀

@shawnborton
Copy link
Contributor

shawnborton commented Oct 18, 2024

Testing now - one quick thing I noticed: when I am on the Search page, the bottom tab for Search is not getting the "active" state:
CleanShot 2024-10-18 at 17 31 33@2x

I am also seeing a weird behavior where if I go to Settings, then Workspaces, then into a Workspace, then go back to Search, then Inbox, then Search, then when I try to go back to Settings, the bottom tab does not work or navigate me anywhere.

CleanShot.2024-10-18.at.17.35.42.mp4

Copy link
Contributor

Copy link

melvin-bot bot commented Feb 12, 2025

@mountiny looks like this was merged without a test passing. Please add a note explaining why this was done and remove the Emergency label if this is not an emergency.

@mountiny
Copy link
Contributor

Not emergency, explained above

@mountiny
Copy link
Contributor

Draft straight revert PR here #56713

@OSBotify
Copy link
Contributor

✋ This PR was not deployed to staging yet because QA is ongoing. It will be automatically deployed to staging after the next production release.

@github-actions github-actions bot added the DeployBlockerCash This issue or pull request should block deployment label Feb 12, 2025
Copy link
Contributor

Performance Comparison Report 📊

Significant Changes To Duration

Name Duration
Chat opening Chat TTI 276.639 ms → 654.942 ms (+378.303 ms, +136.8%) 🔴🔴
Show details
Name Duration
Chat opening Chat TTI Baseline
Mean: 276.639 ms
Stdev: 13.462 ms (4.9%)
Runs: 246.43570999987423 247.08699600026011 252.5112310005352 252.9375 253.02632699999958 254.64957699924707 263.2222910001874 264.3896890003234 264.4593909997493 264.47387700062245 266.9675289997831 269.4291179999709 270.7355960002169 271.2637120001018 272.1518560005352 272.94128399994224 274.5313720004633 274.8757319999859 275.15319800004363 275.2824299996719 275.3194169998169 275.4225669996813 275.97461000084877 276.4395350003615 276.8859050003812 277.1903079999611 278.0955819999799 279.1234130002558 279.7405190002173 279.78625500015914 280.18155900016427 281.0232339994982 281.2942310003564 282.728190000169 283.4331060005352 283.7895510001108 284.61197900027037 284.7114260001108 285.1322020003572 285.34305900055915 286.4171959999949 287.449543999508 287.8523359997198 288.33349699992687 289.99934900086373 291.3503419999033 291.66939300019294 295.74511700030416 309.2600100003183 311.10705600026995

Current
Mean: 654.942 ms
Stdev: 25.374 ms (3.9%)
Runs: 590.4167080000043 600.751058999449 604.8874920001253 617.3407399998978 619.0065509993583 620.8763840002939 624.8175459997728 627.2158610001206 627.2536220001057 627.5216479999945 629.3878990001976 631.9818120002747 636.7041830001399 640.8340260004625 641.1297610001639 641.5188400000334 643.7099210005254 644.9796150000766 646.4602049998939 646.7240400006995 649.4582930002362 652.359944999218 653.0211600000039 653.144817000255 654.3231609994546 654.6362310005352 657.0112310005352 658.9363609999418 659.5299880001694 659.7145190006122 659.9734299993142 660.5199790000916 660.6030689999461 663.2579760001972 663.3936769999564 663.4189450005069 663.947835999541 664.0789399994537 669.0305180000141 670.7869880003855 671.0223799999803 672.2317709997296 672.5640460001305 674.531086999923 676.1597499996424 677.8788659991696 680.1787520004436 681.8992109997198 682.5363360000774 684.1656090002507 686.459799000062 691.1850589998066 696.9278979999945 709.3089190004393 710.1045740004629

Meaningless Changes To Duration

Show entries
Name Duration
App start time nativeLaunch 23.891 ms → 23.864 ms (-0.027 ms, ±0.0%)
App start time nativeLaunchEnd_To_appCreationStart 80.508 ms → 80.117 ms (-0.392 ms, ±0.0%)
App start time contentAppeared_To_screenTTI 533.032 ms → 530.331 ms (-2.701 ms, -0.5%)
App start time appCreation 69.533 ms → 70.467 ms (+0.933 ms, +1.3%)
App start time runJsBundle 316.667 ms → 315.683 ms (-0.983 ms, ±0.0%)
App start time appCreationEnd_To_contentAppeared 554.404 ms → 563.424 ms (+9.020 ms, +1.6%)
App start time regularAppStart 0.021 ms → 0.020 ms (-0.001 ms, -4.9%)
App start time TTI 1269.432 ms → 1281.732 ms (+12.300 ms, +1.0%)
App start time (CPU) 142.490 % → 143.737 % (+1.247 %, +0.9%)
App start time (FPS) 60.000 FPS → 60.000 FPS
App start time (RAM) 338.504 MB → 342.350 MB (+3.845 MB, +1.1%)
App start time (CPU/JS) 0.000 % → 0.000 %
App start time (CPU/UI) 23.450 % → 24.933 % (+1.483 %, +6.3%)
Open search router TTI Open Search Router TTI 1076.612 ms → 1044.918 ms (-31.694 ms, -2.9%)
Open search router TTI Load Search Options 164.997 ms → 163.288 ms (-1.709 ms, -1.0%)
Open search router TTI (CPU) 146.819 % → 146.488 % (-0.331 %, ±0.0%)
Open search router TTI (FPS) 57.975 FPS → 58.264 FPS (+0.289 FPS, ±0.0%)
Open search router TTI (RAM) 368.305 MB → 371.463 MB (+3.157 MB, +0.9%)
Open search router TTI (CPU/JS) 0.000 % → 0.000 %
Open search router TTI (CPU/UI) 24.055 % → 26.029 % (+1.974 %, +8.2%)
Report typing Composer typing rerender count 1.000 renders → 1.000 renders
Report typing Message sent 435.819 ms → 441.162 ms (+5.343 ms, +1.2%)
Report typing (CPU) 97.037 % → 97.390 % (+0.354 %, ±0.0%)
Report typing (FPS) 60.000 FPS → 60.000 FPS
Report typing (RAM) 432.550 MB → 435.806 MB (+3.256 MB, +0.8%)
Report typing (CPU/JS) 0.000 % → 0.000 %
Report typing (CPU/UI) 23.037 % → 23.062 % (+0.024 %, ±0.0%)
Chat opening (CPU) 167.067 % → 159.766 % (-7.301 %, -4.4%)
Chat opening (FPS) 58.424 FPS → 58.277 FPS (-0.147 FPS, ±0.0%)
Chat opening (RAM) 376.496 MB → 374.028 MB (-2.467 MB, -0.7%)
Chat opening (CPU/JS) 0.000 % → 0.000 %
Chat opening (CPU/UI) 30.316 % → 29.941 % (-0.375 %, -1.2%)
Show details
Name Duration
App start time nativeLaunch Baseline
Mean: 23.891 ms
Stdev: 2.060 ms (8.6%)
Runs: 21 21 21 21 21 22 22 22 22 22 22 22 22 22 23 23 23 23 23 23 23 23 23 23 23 23 23 23 24 24 24 24 24 24 24 24 24 24 25 25 25 25 25 25 25 26 26 26 27 27 27 28 28 29 30

Current
Mean: 23.864 ms
Stdev: 2.361 ms (9.9%)
Runs: 21 21 21 21 21 21 21 22 22 22 22 22 22 22 22 22 22 22 22 22 22 22 22 23 23 23 23 23 23 23 23 23 24 24 24 24 24 24 25 25 25 25 25 25 25 26 26 26 26 26 27 27 27 27 28 28 29 29 31
App start time nativeLaunchEnd_To_appCreationStart Baseline
Mean: 80.508 ms
Stdev: 9.112 ms (11.3%)
Runs: 66 67 68 68 68 69 70 71 71 72 72 72 72 72 72 74 74 74 74 74 75 76 76 76 77 77 77 78 78 79 80 80 81 81 81 81 82 84 84 85 86 86 86 87 87 88 88 89 91 91 91 93 94 96 96 96 98 99 100

Current
Mean: 80.117 ms
Stdev: 10.637 ms (13.3%)
Runs: 59 62 63 64 67 67 68 68 69 69 69 70 71 71 71 72 72 72 74 75 75 76 77 77 78 78 79 79 79 79 79 80 80 80 81 83 83 83 84 84 84 85 85 86 86 86 88 88 89 89 91 92 93 95 96 96 99 99 106 107
App start time contentAppeared_To_screenTTI Baseline
Mean: 533.032 ms
Stdev: 57.111 ms (10.7%)
Runs: 406.8182430001907 408.97210300015286 417.2152880001813 433.65694499993697 446.56214600009844 461.1731369998306 467.6661399998702 471.0069249998778 473.82001399993896 482.4125819997862 487.65447300020605 490.3664029999636 490.7295510000549 494.12387199979275 494.184712999966 495.7017390001565 501.5367470001802 501.61975099984556 511.617738999892 515.7208400000818 515.8355589997955 517.2759560002014 517.3645669999532 520.0357209998183 524.5589499999769 524.6897970000282 526.1758139999583 526.6135109998286 528.92057200009 529.4648119998164 530.8342160000466 532.64617000008 533.7839110000059 535.6276520001702 535.790384999942 535.9730429998599 536.2306409999728 537.4131900002249 538.7498010001145 542.7528220000677 546.7254940001294 547.5521559999324 557.4736159997992 560.1500019999221 569.4014989999123 572.8479579999112 573.2612140001729 573.6835179999471 600.0682819997892 602.9006420001388 611.2814259999432 613.296827999875 615.7627059998922 617.4727929998189 618.2004329999909 619.680015000049 628.2228009998798 633.6820080000907 635.8551730001345 641.1230729999952

Current
Mean: 530.331 ms
Stdev: 34.192 ms (6.4%)
Runs: 443.31864099996164 452.2473559998907 458.73147400002927 465.09218800021335 478.69075600011274 484.8405260001309 491.53467800002545 499.16265100007877 500.3200819999911 501.40097599988803 502.81085299979895 504.6645769998431 508.5317429997958 509.47721999976784 510.90549799986184 511.3715249998495 512.5989720001817 515.6916589997709 517.766756999772 523.9428940000944 526.5070989998057 529.8391370000318 530.1457210001536 533.9698379999027 536.7335780002177 537.9381690002047 538.5886699999683 538.6094200001098 538.8714430001564 540.4353900002316 541.3161349999718 543.7473229998723 545.1110140001401 545.480506000109 545.5586459999904 546.0069090002216 546.2259459998459 546.6624619998038 547.8954770001583 552.2583159999922 552.5482200002298 553.7024900000542 554.281442000065 558.306762999855 559.417987999972 562.0782780000009 562.7286180001684 568.9672420001589 569.7805780000053 571.2906940001994 592.6963470000774 595.1839870000258 601.5704379999079
App start time appCreation Baseline
Mean: 69.533 ms
Stdev: 10.984 ms (15.8%)
Runs: 52 53 54 55 55 55 56 56 58 58 58 59 60 61 62 62 62 64 64 64 64 64 64 65 65 65 66 66 67 67 68 68 69 69 69 70 70 70 71 73 73 74 76 77 78 78 81 81 81 82 83 83 83 84 85 86 86 91 91 101

Current
Mean: 70.467 ms
Stdev: 8.940 ms (12.7%)
Runs: 50 56 58 59 59 59 59 60 60 60 61 62 63 63 64 65 65 65 65 66 66 66 67 67 68 68 68 68 69 69 70 70 70 70 70 72 72 74 74 74 75 75 76 77 77 77 77 78 79 80 81 82 82 83 84 84 85 85 87 93
App start time runJsBundle Baseline
Mean: 316.667 ms
Stdev: 26.112 ms (8.2%)
Runs: 256 256 256 256 264 264 268 268 270 270 279 279 288 288 291 291 293 293 298 298 299 299 300 300 300 300 301 301 302 302 302 302 303 303 304 304 304 304 305 305 306 306 306 306 306 306 308 308 309 309 309 309 310 310 311 311 314 314 314 314 315 315 315 315 317 317 320 320 322 322 323 323 323 323 323 323 325 325 327 327 329 329 331 331 333 333 334 334 337 337 337 337 339 339 341 341 342 342 344 344 344 344 345 345 347 347 350 350 354 354 355 355 362 362 362 362 363 363 365 365

Current
Mean: 315.683 ms
Stdev: 28.043 ms (8.9%)
Runs: 258 258 260 260 268 268 271 271 273 273 275 275 277 277 286 286 287 287 289 289 292 292 294 294 296 296 297 297 298 298 298 298 300 300 304 304 304 304 305 305 305 305 305 305 306 306 306 306 306 306 307 307 307 307 307 307 308 308 309 309 310 310 310 310 313 313 313 313 313 313 314 314 317 317 318 318 319 319 322 322 327 327 333 333 342 342 343 343 343 343 344 344 344 344 345 345 348 348 351 351 351 351 351 351 354 354 354 354 356 356 357 357 358 358 359 359 364 364 370 370
App start time appCreationEnd_To_contentAppeared Baseline
Mean: 554.404 ms
Stdev: 44.957 ms (8.1%)
Runs: 452 470 474 477 488 495 500 511 519 520 521 522 522 523 524 529 529 531 531 532 534 536 537 538 544 547 553 555 556 556 557 560 560 563 564 564 566 572 573 576 578 579 580 585 587 589 591 594 596 605 611 614 616 632 648 654 661

Current
Mean: 563.424 ms
Stdev: 55.125 ms (9.8%)
Runs: 441 466 467 490 498 499 500 504 512 515 521 523 528 529 532 533 533 533 533 536 536 537 537 541 545 546 548 552 556 556 557 563 565 565 574 574 574 574 574 575 578 580 581 584 587 597 599 603 605 616 630 642 653 657 663 674 675 682 694
App start time regularAppStart Baseline
Mean: 0.021 ms
Stdev: 0.003 ms (15.5%)
Runs: 0.014934000093489885 0.017210999969393015 0.017253000289201736 0.017538000363856554 0.017700999975204468 0.01794400019571185 0.018107000272721052 0.018352000042796135 0.0185139998793602 0.018554000183939934 0.018554000183939934 0.018554999958723783 0.018554999958723783 0.0186769999563694 0.0188400000333786 0.01887999987229705 0.01904299994930625 0.019084000028669834 0.01912399986758828 0.019165000412613153 0.0195720000192523 0.019652999937534332 0.0197350000962615 0.019938999786973 0.019939000252634287 0.019979000091552734 0.020141000393778086 0.020508000161498785 0.02066999999806285 0.020711000077426434 0.020752000156790018 0.020874000154435635 0.02103699976578355 0.021159000229090452 0.021484000142663717 0.02164700021967292 0.021688000299036503 0.02172800013795495 0.021972000133246183 0.022216999903321266 0.022745000198483467 0.02278600027784705 0.02282699989154935 0.023111999966204166 0.023397000040858984 0.023681999649852514 0.024902000091969967 0.025717000011354685 0.026082000229507685 0.02620500000193715 0.028687000274658203 0.028808000031858683 0.02954100025817752 0.029785000253468752

Current
Mean: 0.020 ms
Stdev: 0.002 ms (8.2%)
Runs: 0.01688600005581975 0.017048999667167664 0.017212000209838152 0.017455999739468098 0.018269999884068966 0.018391999881714582 0.018432000186294317 0.018473000265657902 0.0185139998793602 0.0185139998793602 0.018554999958723783 0.018757999874651432 0.01875800034031272 0.018798999954015017 0.018920999951660633 0.019084000028669834 0.019286999944597483 0.019286999944597483 0.01932799955829978 0.01932799955829978 0.019410000182688236 0.019450000021606684 0.0195720000192523 0.019694000016897917 0.019694000016897917 0.019694000016897917 0.01977499993517995 0.019816000014543533 0.020018999930471182 0.020060000009834766 0.020142000168561935 0.020264000166207552 0.020507999695837498 0.020548000000417233 0.020548999775201082 0.02066999999806285 0.020671000238507986 0.02075199969112873 0.02075199969112873 0.020834000315517187 0.020874000154435635 0.021077999845147133 0.021240000147372484 0.021443000063300133 0.021687999833375216 0.02172800013795495 0.02209499990567565 0.022095000371336937 0.022379999980330467 0.022420000284910202 0.022500999737530947 0.0226239999756217 0.023275000043213367 0.025349999777972698
App start time TTI Baseline
Mean: 1269.432 ms
Stdev: 74.240 ms (5.8%)
Runs: 1104.1238719997928 1133.729551000055 1135.4125819997862 1141.7208400000818 1146.617738999892 1153.820013999939 1165.0069249998778 1178.654473000206 1184.6661399998702 1187.3664029999636 1194.184712999966 1206.261214000173 1217.3645669999532 1218.8182430001907 1225.6197509998456 1227.2306409999728 1227.5367470001802 1236.6897970000282 1238.558949999977 1240.2759560002014 1241.1731369998306 1244.0357209998183 1244.2152880001813 1256.0682819997892 1258.1758139999583 1259.783911000006 1259.790384999942 1260.5521559999324 1265.64617000008 1271.4014989999123 1273.8479579999112 1274.150001999922 1277.97304299986 1285.6276520001702 1285.7528220000677 1286.656944999937 1288.7498010001145 1289.4131900002249 1291.92057200009 1293.9721030001529 1295.6135109998286 1297.7017390001565 1299.7254940001294 1310.8355589997955 1312.296827999875 1314.9006420001388 1321.5621460000984 1333.8342160000466 1337.683517999947 1347.2814259999432 1349.4648119998164 1359.2004329999909 1360.680015000049 1368.4736159997992 1371.472792999819 1372.6820080000907 1385.2228009998798 1388.8551730001345 1431.1230729999952 1434.7627059998922

Current
Mean: 1281.732 ms
Stdev: 56.252 ms (4.4%)
Runs: 1159.5346780000255 1165.5070989998057 1168.1626510000788 1184.6907560001127 1184.9428940000944 1191.6645769998431 1220.0069090002216 1225.810852999799 1229.400975999888 1230.2432740000077 1238.9381690002047 1239.5886699999683 1242.8714430001564 1246.766756999772 1249.7335780002177 1250.6963470000774 1252.4772199997678 1258.9698379999027 1265.1457210001536 1266.6916589997709 1270.5586459999904 1271.6094200001098 1271.7286180001684 1276.3623029999435 1276.5848059998825 1276.7024900000542 1277.6624619998038 1277.9054979998618 1278.480506000109 1279.3161349999718 1283.2473559998907 1285.840526000131 1291.306762999855 1292.5989720001817 1297.8954770001583 1301.2583159999922 1301.5704379999079 1301.7805780000053 1302.8391370000318 1305.1110140001401 1306.9672420001589 1308.7473229998723 1310.417987999972 1311.281442000065 1316.3186409999616 1317.5482200002298 1321.2259459998459 1330.0921880002134 1330.1839870000258 1344.0782780000009 1349.592776000034 1380.8372320001945 1384.1060739997774 1384.6869540000334 1387.4353900002316 1387.7314740000293 1395.2906940001994
App start time (CPU) Baseline
Mean: 142.490 %
Stdev: 7.638 % (5.4%)
Runs: 124.97205454951938 129 129.88822399468782 130.62520377571553 131.23293172690762 131.7890610059285 131.95841716968476 132.80502964237905 133.45875251509054 135.54239330530797 135.99086473580402 137.2204146807055 137.3078686629054 137.3120995442562 137.8738077473735 137.87624750499006 137.91128072878826 138.62579028987238 138.805542808508 138.82912602792123 139.4669901772787 140.066241059857 140.26227184121922 140.50539628203305 140.72908366533864 140.9625638502554 141.1220198570797 141.32287827246824 141.45863342896718 141.7321118657231 141.89162215462252 141.91330868909134 141.92838846196682 142.15631262525048 143.2865731462926 143.49680761735772 143.7125748502995 143.87540020279607 144.55062927568017 145.24070571131384 146.74478181014118 147.4366566391106 147.57139108237715 147.6188246677747 147.75298804780883 147.88931609458734 149.0227720996952 149.35139661035788 151.0480054090602 151.5196698236993 152.0859817404369 152.62826174071037 152.6803607214429 152.93600728117252 153.75298804780883 154.26191741981216 155.8762475049901 158.0284451995253 159.9859105318775

Current
Mean: 143.737 %
Stdev: 7.448 % (5.2%)
Runs: 126.68986083499007 131.97448969549046 132.71526543053088 132.88023952095813 133.02034428794994 133.68452304218573 135.33737812170804 135.52224787696164 136.41942519577307 136.69454555558644 136.6989532515512 136.8330464716007 136.90328864901122 137.50341170507272 138.58703322137234 138.81905293145016 139.64582398712938 140.41890689668512 140.59331536130932 140.8314278455285 140.9232808245974 140.96287229702165 141.03864791960092 141.3078149920255 141.71656686626753 141.76663466097207 141.871392186764 141.9415235494663 142.82128514056228 142.99551145759506 143 143.02845040994774 143.5917562291189 143.5944333996024 144.0294995781138 144.528661282962 144.67644967354062 145.57339504258417 145.8094281889463 145.94320486815414 146.11433782940534 146.2299694581834 146.29258517034066 146.69507298989376 147.93203883495144 148.0970571590266 148.29659318637272 148.64734337350967 149.17471192774832 149.77768215720027 152.90627294556572 153.0151204255235 153.8542914171657 154.1131371736428 154.6906187624751 156.97601749863296 158.39791222583023 159.63855421686753 159.74103585657375 160.7450199203188
App start time (FPS) Baseline
Mean: 60.000 FPS
Stdev: 0.000 FPS (0.0%)
Runs: 60 60 60 60 60 60 60 60 60 60 60 60 60 60 60 60 60 60 60 60 60 60 60 60 60 60 60 60 60 60 60 60 60 60 60 60 60 60 60 60 60 60 60 60 60 60 60 60 60 60 60 60 60 60 60

Current
Mean: 60.000 FPS
Stdev: 0.000 FPS (0.0%)
Runs: 60 60 60 60 60 60 60 60 60 60 60 60 60 60 60 60 60 60 60 60 60 60 60 60 60 60 60 60 60 60 60 60 60 60 60 60 60 60 60 60 60 60 60 60 60 60 60 60 60 60 60 60 60 60 60 60
App start time (RAM) Baseline
Mean: 338.504 MB
Stdev: 11.096 MB (3.3%)
Runs: 319.3828125 320.06640625 320.5234375 320.705078125 320.994140625 321.431640625 322.53125 323.642578125 324.208984375 325.216796875 325.326171875 325.501953125 325.5390625 325.751953125 328.609375 330.0078125 330.376953125 331.2890625 331.830078125 332.380859375 332.802734375 334.248046875 334.97265625 335.673828125 336.865234375 337.564453125 338.92578125 338.947265625 339.462890625 339.630859375 339.853515625 340.6171875 341.03125 341.15234375 341.546875 342.77734375 342.97265625 343.00390625 343.291015625 343.396484375 344.51953125 345.015625 345.16015625 345.6953125 348.12890625 348.484375 348.556640625 349.3671875 349.646484375 349.6484375 351.208984375 351.85546875 352.544921875 353.708984375 354.3984375 354.6640625 354.80859375 355.041015625 356.056640625 357.69921875

Current
Mean: 342.350 MB
Stdev: 9.873 MB (2.9%)
Runs: 322.021484375 322.619140625 324.818359375 324.884765625 324.966796875 325.21484375 327.3125 328.91015625 329.234375 332.1171875 332.162109375 332.98046875 333.080078125 333.419921875 333.490234375 333.921875 333.935546875 334 335.359375 336.02734375 338.66796875 340.560546875 341.98828125 342.5078125 343.666015625 344.63671875 344.912109375 344.93359375 344.984375 345.19921875 345.34375 345.65625 345.896484375 345.908203125 346.1171875 346.1640625 346.314453125 346.580078125 346.787109375 346.80078125 346.904296875 347.5390625 348.9375 349.1458333333333 349.263671875 349.5078125 349.62890625 349.6953125 350.5703125 352.38671875 352.404296875 352.92578125 354.46484375 355.421875 355.654296875 356.125 356.380859375 356.396484375 356.396484375 357.119140625
App start time (CPU/JS) Baseline
Mean: 0.000 %
Stdev: 0.000 % (NaN%)
Runs: 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0

Current
Mean: 0.000 %
Stdev: 0.000 % (NaN%)
Runs: 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0
App start time (CPU/UI) Baseline
Mean: 23.450 %
Stdev: 4.274 % (18.2%)
Runs: 14 15.8 16.1 16.3 18 18 18.9 19 19 19.1 19.2 20 20 20 20.1 21 21 21 21 21 21 21.2 22 22 22.1 22.1 22.2 22.2 23 23 23 23 23 23.1 24 24 24.2 25 25.9 26 26 26.1 26.2 26.2 26.3 27 27 27.1 27.1 27.1 27.4 27.9 28.5 28.8 28.9 31 31 32.1 32.3 32.5

Current
Mean: 24.933 %
Stdev: 3.757 % (15.1%)
Runs: 19 19.2 20 20.1 20.8 20.9 20.9 20.9 21 21.1 21.1 21.9 22 22 22 22 22.1 22.1 22.6 22.9 22.9 23 23 23 23 23 23.3 24 24 24 24.1 24.8 25 25.1 25.4 25.9 26 26.1 26.1 26.1 26.1 26.2 27 27 27 27.1 27.1 27.2 27.2 27.2 27.6 28.3 29 31.1 31.5 32.9 33.1 33.2 33.8 34
Open search router TTI Open Search Router TTI Baseline
Mean: 1076.612 ms
Stdev: 32.992 ms (3.1%)
Runs: 981.3579110000283 1001.7395839998499 1007.4385179998353 1014.6792810000479 1032.5802009999752 1036.288166999817 1036.7432450000197 1037.0550539996475 1047.2535809995607 1047.893106999807 1048.660442000255 1049.4079599995166 1054.8682459993288 1054.8727219998837 1055.1395270004869 1055.5171719994396 1058.584025000222 1058.618815000169 1060.3009439995512 1060.7762860003859 1062.1694339998066 1066.1939709996805 1068.8231210000813 1069.1111660003662 1070.1994639998302 1070.938762000762 1071.5390630001202 1072.1807460002601 1072.7272949991748 1078.0873620007187 1078.8175060003996 1084.502971000038 1086.232177999802 1086.7567549999803 1087.5793050006032 1089.9493410000578 1090.0774739999324 1093.2531750006601 1093.7097579999827 1098.7631440004334 1098.9082440007478 1099.2832849994302 1099.4895430002362 1103.3588870000094 1103.851156000048 1105.8447270002216 1106.8511969996616 1108.6504319999367 1108.8745129993185 1109.21875 1110.7457280000672 1115.3710540002212 1115.9191899998114 1116.571655999869 1118.9646820006892 1120.3461509998888 1125.955485000275 1128.2515070000663 1132.265746999532

Current
Mean: 1044.918 ms
Stdev: 66.838 ms (6.4%)
Runs: 884.5137940002605 897.4172369996086 904.514038999565 921.697387999855 922.8175459997728 946.8294279994443 952.2012949995697 956.8128669997677 958.6515299994498 959.6228439998813 967.8636890002526 969.8926189998165 974.1374110002071 977.775797999464 990.4032809995115 1004.2753510000184 1009.8354089995846 1014.5887049995363 1026.7324630003422 1029.700032999739 1031.8574230000377 1041.384766000323 1042.5549320001155 1043.0594890005887 1043.4417730001733 1045.1752119995654 1050.482788999565 1051.952351999469 1053.1071790000424 1056.488688999787 1059.2780769998208 1061.0596930002794 1062.7975260000676 1066.5744229992852 1068.6409919997677 1069.4231779994443 1072.4787200000137 1075.2848719991744 1075.6243089996278 1077.3817549999803 1080.5047610001639 1085.4184990003705 1085.6194669995457 1090.6313080005348 1093.947103999555 1099.287924000062 1099.5155440000817 1104.137085000053 1104.4816490001976 1106.3255620002747 1108.322266000323 1114.2141930004582 1114.7745770001784 1114.7972820000723 1115.2909349994734 1116.4170340001583 1121.067913000472 1124.1650809999555 1125.2353109996766 1141.2583829993382 1176.2424320001155
Open search router TTI Load Search Options Baseline
Mean: 164.997 ms
Stdev: 6.703 ms (4.1%)
Runs: 149.16320800036192 153.18119299970567 153.29386400058866 153.8931889999658 154.0190030001104 154.2426350004971 154.40091900061816 154.81766800023615 154.94897500053048 155.30517499987036 156.49902400001884 159.3972570002079 159.82377099990845 160.7598880007863 161.19283000007272 162.05196100007743 162.15966800041497 162.40637199953198 162.66536400001496 162.9298499999568 163.27848299965262 163.83801199961454 163.93591399956495 164.54817700013518 164.73811899963766 165.20906599983573 165.42468299996108 165.49100799951702 165.67606600001454 165.91548600047827 166.37809299957007 167.05810500029474 167.05839099921286 167.39322900027037 167.39400200080127 168.12028000038117 168.13037099968642 168.3591310000047 168.71354100015014 169.22204599995166 169.46256500016898 169.50622599944472 169.61975099984556 169.73990899976343 170.12451099976897 170.27425100002438 170.62898799963295 170.80668100062758 170.84859200008214 170.90934299957007 171.3423259994015 172.77217600028962 172.96651200018823 173.36173500027508 173.61372900009155 174.46521000005305 177.03454599995166 179.3046469995752

Current
Mean: 163.288 ms
Stdev: 8.134 ms (5.0%)
Runs: 147.40722599998116 149.7114669997245 150.04447400011122 150.41528299916536 150.64139799959958 150.81656899955124 151.37691199965775 152.51212599966675 152.65860999934375 153.02640799991786 154.78658100031316 155.3127030003816 155.79907199926674 157.47969499975443 158.33683299925178 158.39632200077176 158.4951990004629 158.6949869999662 158.8611660003662 159.578125 159.62544800061733 159.6638589994982 159.71598299965262 160.16092900000513 160.65592500008643 160.67024700064212 161.22216799948364 161.2756350003183 161.58223500009626 163.65885400027037 163.7747809998691 164.24312299955636 165.51802599988878 165.6177980005741 165.80187999922782 166.02575699985027 166.03963300026953 166.1167800007388 166.30338599998504 166.5244959993288 166.73763000033796 167.49837299995124 167.53523800009862 167.62207000004128 168.22139499988407 168.25252300035208 168.8454599995166 169.0662850001827 169.45507800020278 169.82922400068492 171.1984049999155 171.22749800048769 173.32780000008643 173.33951800037175 173.89375799987465 174.0482590002939 175.27034500055015 176.63684100005776 178.23681600019336 180.72522000037134 181.02563499938697
Open search router TTI (CPU) Baseline
Mean: 146.819 %
Stdev: 6.741 % (4.6%)
Runs: 133.24074990507322 134.48231217987885 136.1044181227329 136.5694618730667 138.30902415845938 138.85608826663574 139.12031446044156 139.59465457064493 139.62530285706055 139.62979097526403 140.37067670265256 140.57509193114666 140.67950025164487 140.9169353178108 141.55149191096785 141.56938354695572 141.80757128098006 142.1635725534758 142.53695051911188 142.60467113581612 142.6423969948532 142.69821291335572 143.55685191821013 143.9523137949836 144.0099477999064 144.180397306261 144.37104508674685 145.3014136356207 145.9029715251623 145.9636974347531 146.06987311796993 146.1801730697818 147.69545645700805 148.846784546457 149.30089412478844 149.38032013983462 149.60159353890003 149.67509571827554 149.82451892272334 150.2448735238642 150.63539129268014 150.68090976144887 151.07297912889882 151.31462175251096 151.36372102606583 151.69828918447314 152.37228373781434 152.79065002531854 153.19361277445125 153.4843814846857 153.5629956873827 153.6194950376692 154.15091845987578 156.5126981733306 156.694643688167 157.17105453943773 157.5506211677826 159.17487847755385 159.61028517506344 162.7906930765512

Current
Mean: 146.488 %
Stdev: 4.752 % (3.2%)
Runs: 136.50994527099164 137.65757951954905 137.73933189182586 137.77047131249927 140.2389868909387 140.3167201853102 140.823741532315 141.06291837361988 141.55358593946303 141.8806121487166 142.420830020335 142.4981054440836 142.64768359219195 142.82785077869693 142.95882518200253 143.13140745988687 143.25135757779645 143.7441876640495 143.76426270645328 144.0479365186408 144.45935102685746 144.52210538497235 144.88899918149394 145.0161625454071 145.04573577875482 145.34890057804293 145.4749063812815 145.84443065005067 145.97941902900013 146.08547168722487 146.1067701828976 146.31265089759984 146.4073278868961 146.4583891809151 146.75718578023418 147.4924176404438 147.74273695504328 148.18847485895537 148.21163113026032 148.25693117237984 148.70951116677298 148.7624750499003 148.76543942756285 150.17921928367963 150.23714207578257 150.2840238470583 150.51354129885777 150.53962798588438 150.59191159756736 151.3315927700882 151.62256469854938 151.83732534930144 152.33832335329353 152.50820043897016 153.55820024803452 153.97227319385513 154.0389268954773 155.0741438769208 155.36324638348296 157.62875232596804
Open search router TTI (FPS) Baseline
Mean: 57.975 FPS
Stdev: 1.541 FPS (2.7%)
Runs: 54.477797917891806 54.68520979981538 54.807982855947216 54.86471900584981 55.410619039121784 55.54795352681032 55.695173965102676 55.85459991513443 56.03555646257422 56.25904944114171 56.47336709782314 56.52181186319359 56.806900940405086 56.88356511362519 56.898338936678435 56.9547634042534 57.23540545213081 57.253477790509486 57.32508497562999 57.426980402943634 57.69023786728691 57.768757338314245 58.02903072165708 58.04853340953698 58.24470243938634 58.27950023603091 58.31070332357143 58.32985357032012 58.333571325277184 58.40781377711014 58.42386804016841 58.46798472335114 58.49022461881755 58.52715029227597 58.53087418133306 58.727770710331846 58.744895206914954 58.850664700906066 58.85985970445925 58.90954904211533 58.931122265119704 58.976735133866015 59.00033342464858 59.35509983568396 59.48111695917056 59.50211226475315 59.5034728816083 59.537848832303624 59.65027869609949 59.72944414151651 59.797057375374926 59.82833586075017 59.90063630129469 60 60 60 60

Current
Mean: 58.264 FPS
Stdev: 1.949 FPS (3.3%)
Runs: 53.661766577170155 53.841739313624906 54.19944411264572 54.45587283167297 54.64810771948213 54.78145082296801 54.83979289132416 55.44067387696216 55.6402820868038 56.025136522869445 56.087338447211096 56.358871451130526 56.539979658861995 57.31632105276048 57.517791388072496 57.63818063631828 57.6418496076249 57.6691240611356 57.95803866186175 57.96682437296422 58.20951273075113 58.23026395357372 58.24992680517666 58.255689198271995 58.26654173432466 58.31278115755994 58.435613804017486 58.553543805564274 58.65587561634597 58.67106836051977 58.6779141255151 59.387006015307094 59.66999279311487 59.73067418115165 59.75551556735202 59.869239721545206 59.908852725471576 60 60 60 60 60 60 60 60 60 60 60 60 60 60 60 60 60 60 60 60
Open search router TTI (RAM) Baseline
Mean: 368.305 MB
Stdev: 8.567 MB (2.3%)
Runs: 349.375 350.8251953125 353.0888671875 353.509765625 353.5537109375 354.01171875 354.7099609375 357.8232421875 359.0078125 359.3623046875 359.3779296875 359.65234375 360.177734375 361.17578125 361.62109375 361.7041015625 362.72890625 363.07421875 363.1142578125 364.81640625 365.24609375 365.5361328125 365.9140625 366.39296875 367.22109375 367.40625 367.61640625 368.501953125 369.02734375 369.478515625 371.0888671875 371.2138671875 371.28125 371.373046875 371.4296875 372.03984375 372.09765625 372.134375 372.6943359375 372.72890625 373.3421875 373.67109375 373.821875 373.9384765625 374.153125 374.5537109375 375.3427734375 375.5341796875 375.89453125 376.138671875 376.74453125 377.6484375 377.85546875 378.6806640625 379.821875 379.9578125 380.94453125 381.771875 382.0859375 383.2921875

Current
Mean: 371.463 MB
Stdev: 6.633 MB (1.8%)
Runs: 357.888671875 359.1337890625 359.48046875 360.29296875 360.830078125 361.4052734375 361.5009765625 363.5576171875 364.9404296875 365.0888671875 367.4443359375 367.923828125 368.4 368.53125 368.580078125 368.591796875 368.619140625 369.03515625 369.4814453125 369.66015625 369.71171875 369.7703125 369.896875 370.096875 370.10859375 370.7373046875 371.0458984375 371.18046875 371.5875 371.8330078125 371.92734375 371.96171875 373.0791015625 373.12578125 373.2880859375 373.875 374.107421875 374.1845703125 375.2373046875 375.32109375 375.7799479166667 375.8328125 376.15625 376.1625 376.615234375 376.6203125 378.294921875 380.30390625 380.5640625 381.60234375 381.83203125 384.721875 384.734375 387.30703125
Open search router TTI (CPU/JS) Baseline
Mean: 0.000 %
Stdev: 0.000 % (NaN%)
Runs: 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0

Current
Mean: 0.000 %
Stdev: 0.000 % (NaN%)
Runs: 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0
Open search router TTI (CPU/UI) Baseline
Mean: 24.055 %
Stdev: 1.760 % (7.3%)
Runs: 20.5 20.9 20.9 21.4 21.5 21.6 22 22.2 22.2 22.3 22.4 22.4 22.7 22.8 22.8 22.8 22.8 22.8 22.9 23.1 23.1 23.3 23.4 23.4 23.5 23.6 23.6 24 24 24.1 24.1 24.1 24.3 24.4 24.5 24.5 24.6 24.7 24.7 24.8 24.9 25 25.1 25.1 25.2 25.4 25.4 25.4 25.4 25.5 25.5 25.5 26 26.2 26.4 26.6 26.8 27 28.3 28.9

Current
Mean: 26.029 %
Stdev: 1.458 % (5.6%)
Runs: 23 23.4 23.9 23.9 24 24 24 24.2 24.3 24.4 24.4 24.5 24.7 24.9 24.9 25.1 25.3 25.3 25.4 25.4 25.4 25.5 25.6 25.7 25.7 25.8 25.9 25.9 26 26.2 26.2 26.2 26.3 26.4 26.4 26.4 26.4 26.4 26.4 26.5 26.6 26.7 26.7 26.7 26.8 27.1 27.1 27.2 27.5 27.5 27.5 27.9 27.9 28 28 28.5 28.7 29.5 29.5
Report typing Composer typing rerender count Baseline
Mean: 1.000 renders
Stdev: 0.000 renders (0.0%)
Runs: 1 1 1 1 1 1 1 1 1 1 1 1 1 1 1 1 1 1 1 1 1 1 1 1 1 1 1 1 1 1 1 1 1 1 1 1 1 1 1 1 1 1 1 1 1 1 1 1 1 1 1 1 1 1 1 1 1 1 1 1

Current
Mean: 1.000 renders
Stdev: 0.000 renders (0.0%)
Runs: 1 1 1 1 1 1 1 1 1 1 1 1 1 1 1 1 1 1 1 1 1 1 1 1 1 1 1 1 1 1 1 1 1 1 1 1 1 1 1 1 1 1 1 1 1 1 1 1 1 1 1 1 1 1 1 1 1 1 1 1
Report typing Message sent Baseline
Mean: 435.819 ms
Stdev: 42.362 ms (9.7%)
Runs: 359.943521999754 368.40214000083506 368.4829509994015 370.3645829996094 373.3285320000723 376.3360590003431 380.9465330000967 381.18481499981135 386.84956900030375 395.1492109997198 396.80179900024086 398.9946699999273 402.8985190000385 404.547201000154 405.25292999949306 406.410442000255 406.49560599960387 407.3084319997579 408.46561700012535 408.6900230003521 408.71472200006247 409.54321299958974 411.65356499981135 412.5758459996432 415.6593430005014 417.6574299996719 418.6039230003953 419.6965340003371 421.22167999949306 425.3430580003187 432.2316079996526 433.490559999831 437.2604580000043 437.5457759993151 446.76383499987423 448.5390219995752 450.7030840003863 454.786987000145 455.2560629993677 458.1588139999658 460.11104299966246 462.43921000044793 463.30151399970055 463.6478270003572 473.6639000000432 478.7190350005403 482.64355499949306 484.8507890002802 485.95682800002396 488.2396250003949 492.94323800038546 493.3816739991307 494.69999200012535 494.88732900004834 497.6502689998597 498.17618800047785 498.52128100022674 501.322224999778 504.48343999963254 507.22159800026566

Current
Mean: 441.162 ms
Stdev: 39.692 ms (9.0%)
Runs: 368.87141999974847 370.9527179999277 373.64526399970055 376.95585099980235 382.64599699992687 384.5089109996334 389.8642180003226 391.1625570002943 395.00618600007147 397.9398600002751 399.0848390003666 400.13350399956107 405.3353679999709 408.0961100002751 408.27771000005305 408.609659999609 409.97526099998504 410.5554609997198 410.8452150002122 418.03210399951786 419.20695000048727 422.52608199976385 422.8684900002554 423.8864750005305 424.5760089997202 426.5950520001352 427.0185140008107 428.11775800026953 435.32474799919873 440.0946860006079 445.5671790000051 449.60453299991786 451.3178709996864 452.15311700012535 453.6236979998648 454.63883499987423 457.1958820000291 460.2532150000334 461.65348399989307 462.08325200062245 466.09753399994224 472.6028650002554 475.23246300034225 476.8402110002935 479.1148269996047 480.040853000246 480.47485399991274 480.8823650004342 488.03710999991745 488.552327000536 488.80098500009626 490.593708999455 491.1807049997151 491.55997700057924 492.58890799991786 496.1947839995846 498.25317399948835 498.4897459996864 502.39721800014377 502.9680180000141
Report typing (CPU) Baseline
Mean: 97.037 %
Stdev: 2.906 % (3.0%)
Runs: 92.10621812956802 92.47680961090037 92.63678764066618 92.99079095034311 93.34530550309016 93.56749608135532 93.6976239723832 93.73898989899537 93.86888380296692 93.98851722279251 94.0192188186375 94.1232712309528 94.17486936772934 94.43935441028862 94.45982957255694 94.521853851782 94.94007552988191 95.12890393970869 95.18968195447515 95.19307492434444 95.24662178649035 95.35004470658146 95.707617663176 95.78379860845307 95.9833542839809 95.99671734643073 96.08656411030424 96.15808443606522 96.28288570170234 96.5735052571726 96.68842735550476 96.9050160238655 96.97586390923863 96.9803093628929 97.34153384975505 97.49500989133287 97.53790313463067 97.59143237440927 98.04446815544448 98.51706406511151 98.90080227289336 98.93331412609572 98.9357025785817 99.03889926175655 99.04280803510781 99.34837732856916 99.58126051692295 99.9033828110259 100.05631478755596 100.28149879158246 100.46556129440494 100.85792339294005 101.14440088928596 101.16765724199402 101.18787253992376 101.25518520834072 101.84711693136488 101.86009211716271 102.16054632143361 104.38506403188211

Current
Mean: 97.390 %
Stdev: 2.990 % (3.1%)
Runs: 91.59894672932253 91.81845904624778 93.6099594339211 93.80718337936331 93.89082383339031 94.1015224587585 94.13382436662077 94.20666032892603 94.26197043245607 94.30264283711429 94.35320142871768 94.76203711952155 94.82162975768442 95.05455130972759 95.1051205200246 95.25362560595839 95.25672086177029 95.33141430234689 95.44167281052079 95.55023376205033 95.58561433357295 95.74396701424351 95.86445859493907 95.94581677059293 95.98392266852586 96.34713793042005 96.42450486628393 96.53243067267216 96.68363112181729 96.70394327398085 96.86105718730761 96.9867561481506 97.41955917972918 97.6079239916417 97.71431830274625 97.9451308323691 97.95841539853643 97.96075584701852 98.01990970460557 98.02013036683287 98.86231927918617 98.8882237963029 99.02506802301019 99.19963991937934 99.23858706707942 99.69678843500246 99.8343707859232 99.94325310496173 99.9620545627776 100.08179586120727 100.94586065481793 101.09004000890542 101.20362052762192 101.24751194299013 101.71418374996347 102.51080440960757 102.90454031381003 103.78983440745603 103.90410771849001 104.40564303533269
Report typing (FPS) Baseline
Mean: 60.000 FPS
Stdev: 0.000 FPS (0.0%)
Runs: 60 60 60 60 60 60 60 60 60 60 60 60 60 60 60 60 60 60 60 60 60 60 60 60 60 60 60 60 60 60 60 60 60 60 60 60 60 60 60 60 60 60 60 60 60 60 60 60 60 60 60 60 60 60

Current
Mean: 60.000 FPS
Stdev: 0.000 FPS (0.0%)
Runs: 60 60 60 60 60 60 60 60 60 60 60 60 60 60 60 60 60 60 60 60 60 60 60 60 60 60 60 60 60 60 60 60 60 60 60 60 60 60 60 60 60 60 60 60 60 60 60 60 60 60 60 60 60 60 60 60
Report typing (RAM) Baseline
Mean: 432.550 MB
Stdev: 3.663 MB (0.8%)
Runs: 422.89013671875 425.499755859375 425.68994140625 425.800537109375 426.738037109375 427.00390625 427.04443359375 427.81103515625 428.61474609375 428.648193359375 428.69775390625 428.900390625 428.93603515625 429.138427734375 430.21240234375 430.297119140625 430.30224609375 430.6015625 430.6181640625 430.773193359375 431.4384765625 431.5539981617647 431.892822265625 432.11376953125 432.14501953125 432.29931640625 432.66773897058823 432.7685546875 432.963134765625 432.96630859375 433.120361328125 433.12086397058823 433.33740234375 433.77458639705884 433.91130514705884 434.02294921875 434.03564453125 434.078857421875 434.718994140625 434.75988051470586 434.979736328125 435.1283854166667 435.19921875 435.281982421875 435.429443359375 435.588623046875 435.6455078125 435.69873046875 435.76796875 435.991943359375 435.992919921875 436.193115234375 436.37841796875 436.548583984375 436.6630859375 436.9169921875 437.3678768382353 438.3232421875 438.681396484375 439.309375

Current
Mean: 435.806 MB
Stdev: 3.721 MB (0.9%)
Runs: 428.32861328125 428.541748046875 429.014892578125 429.039794921875 429.26416015625 429.51318359375 430.93175551470586 431.014404296875 431.019775390625 431.1982421875 432.015380859375 432.366455078125 432.368408203125 432.40625 432.697998046875 432.932373046875 433.133056640625 433.40739889705884 434.279052734375 434.318603515625 434.333740234375 434.510986328125 434.629150390625 435.17138671875 435.257568359375 435.71142578125 435.92626953125 436.066162109375 436.473388671875 436.50634765625 436.50732421875 436.55419921875 436.62132352941177 436.641357421875 436.749755859375 436.8920036764706 436.915771484375 436.96630859375 437.244140625 437.498046875 438.534423828125 438.604248046875 438.7294921875 438.729736328125 438.819091796875 438.987060546875 439.0322265625 439.302734375 439.4619140625 439.46438419117646 439.762939453125 439.90257352941177 440.174560546875 440.3407628676471 440.62545955882354 440.70947265625 440.842041015625 441.547607421875 441.769287109375 442.024169921875
Report typing (CPU/JS) Baseline
Mean: 0.000 %
Stdev: 0.000 % (NaN%)
Runs: 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0

Current
Mean: 0.000 %
Stdev: 0.000 % (NaN%)
Runs: 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0
Report typing (CPU/UI) Baseline
Mean: 23.037 %
Stdev: 0.683 % (3.0%)
Runs: 21.7 21.7 21.7 21.8 21.9 21.9 22.1 22.1 22.1 22.2 22.3 22.4 22.5 22.6 22.7 22.7 22.7 22.8 22.8 22.8 22.9 22.9 22.9 22.9 23 23 23 23 23.1 23.1 23.2 23.2 23.2 23.2 23.2 23.3 23.3 23.3 23.3 23.4 23.4 23.4 23.4 23.4 23.5 23.6 23.6 23.6 23.6 23.6 23.7 23.7 23.8 23.8 23.9 24 24.1 24.4 24.8

Current
Mean: 23.062 %
Stdev: 0.802 % (3.5%)
Runs: 21.3 21.4 21.8 21.8 21.8 21.9 21.9 22 22 22.2 22.2 22.5 22.5 22.5 22.6 22.7 22.7 22.7 22.7 22.7 22.7 22.8 22.8 22.8 22.8 22.8 22.8 22.8 22.9 23 23.1 23.1 23.1 23.2 23.2 23.3 23.3 23.4 23.4 23.4 23.4 23.4 23.5 23.6 23.8 23.8 23.8 23.8 23.8 23.9 23.9 24 24 24 24.1 24.2 24.3 24.4 24.7 24.7
Chat opening (CPU) Baseline
Mean: 167.067 %
Stdev: 5.019 % (3.0%)
Runs: 156.5454197743355 157.81118662604493 158.01741612848764 159.08211884204638 159.4172114532312 160.93756201854308 161.16233471284718 161.52620271279557 162.1943399841912 162.19521912350604 162.932135728543 163.08002308154303 163.27141274946152 163.7498103777275 163.82016210424865 164.2189659693809 164.62340621720406 164.72059143291997 164.75883818674234 165.14256284251928 165.2806839256771 165.34338756402656 165.5025989790837 165.59624986717844 166.02362858469206 166.18297980150325 166.30640759541177 166.39033837117762 166.7263834331344 167.03662745770797 167.07572833665344 167.18602315658737 167.29752898733267 167.3037232020608 167.34387104755197 168.47561088668968 168.61161392264626 168.7091766811065 168.84248534167781 169.09295629980082 169.09633486475266 169.2385229540919 169.63012436665136 169.66338243086574 169.85728542914177 170.21992990496352 170.26788625175445 170.91981444665336 171.34634108216687 171.5863785540723 173.43863805227565 173.63752594545272 174.34330522243957 175.15869874593508 177.31457546400256 177.67761918448045 178.31995138839042 178.6431169095395

Current
Mean: 159.766 %
Stdev: 6.080 % (3.8%)
Runs: 148.81332590936728 150.3091160140335 150.36404349893203 151.49059179771578 151.88480257551583 152.1356583620847 152.15689673110595 153.61883756575864 153.74152620385763 154.12547548996054 154.6109557792686 154.67992249322774 155.09482593082294 155.29725735231173 155.38465120124545 155.79129144652714 155.96639210368448 156.28257854582122 156.59590864602333 156.91457677814543 157.11939995121554 157.22096779174413 157.25449101796409 157.2549958742534 157.63393514011858 157.67245842231284 157.70294855307475 157.88927443335817 158.22240673395896 158.3158682634731 158.43816532226361 158.92045705375077 159.3787567555628 159.50012264831267 159.5486965231524 160.2172628447965 160.95994188180316 161.17189521927463 161.26738617626418 161.389553299261 162.0311396003426 163.1845401666493 163.71877701808378 164.06247577024104 164.50863089246457 164.73825372016412 165.15113002933907 165.87269103103822 166.55203707285347 167.81195979367263 168.28512596161775 170.29362095685636 170.46600750030677 170.7101868918699 171.14513213999183 171.36313088109497 172.03581507304114 172.16990914587402
Chat opening (FPS) Baseline
Mean: 58.424 FPS
Stdev: 1.231 FPS (2.1%)
Runs: 55.4406305558189 55.78287309108524 56.47452424991593 56.61538209865564 56.626643397095286 56.64946474475228 56.67615769400977 56.67973604888524 57.02178055386266 57.13909842117001 57.237882142486725 57.381298319864854 57.39934682730153 57.48287065395904 57.548821638943764 57.58233941933394 57.613626681364444 57.651931091206336 57.821160132308194 57.83501823388736 57.88982105732439 58.08696699043981 58.20285216871786 58.20590285161904 58.238288118981515 58.51848051300165 58.58330680675672 58.59309334451418 58.63232105758724 58.71481675479841 58.72376405585656 58.92282473187304 58.990795109487706 59.1106404648828 59.20179140751416 59.255116225480336 59.28705195876124 59.362983607408154 59.43839224170082 59.46397299795528 59.53168379123428 59.58179680089052 59.62351491478027 59.62537523289001 59.63223389574847 59.75013253424969 59.757710565293934 59.76691620788908 59.96167842498351 60 60 60 60 60 60

Current
Mean: 58.277 FPS
Stdev: 1.325 FPS (2.3%)
Runs: 54.25991342985402 55.393780411114044 55.65493345005656 56.01318807881663 56.09948024039457 56.30284008519814 56.71824213049697 56.75933504280696 57.01716877700494 57.03099289246192 57.08140520541831 57.186291244816 57.345424072475396 57.49267234869769 57.55970935968858 57.607593857653406 57.820869083780174 58.02250916024282 58.07531605619496 58.10534618948752 58.110169617381494 58.149672638069255 58.27736908564811 58.31331379401729 58.33599668968143 58.34956377246925 58.403880251008616 58.433414634783844 58.44423998714636 58.459947680364095 58.4629044606749 58.58497318835459 58.59499723924079 58.71949176652795 58.72046115105652 58.787842722115464 58.80836205023824 58.86807115369232 58.978615991644176 58.98027862920602 59.1512236335743 59.3313479951983 59.60711533358484 59.63166233581105 59.660097933307924 59.66846515048593 59.920605740321626 59.92877780640336 60 60 60 60 60 60 60
Chat opening (RAM) Baseline
Mean: 376.496 MB
Stdev: 4.418 MB (1.2%)
Runs: 368.6591796875 370.1357421875 370.4794921875 370.5221354166667 370.5615234375 370.5693359375 370.7509765625 371.1748046875 372.09375 372.1904296875 372.2096354166667 372.4739583333333 372.8020833333333 372.802734375 372.8291015625 373.09765625 373.25390625 373.4482421875 373.4775390625 373.6123046875 373.8896484375 374.2578125 374.40234375 374.587890625 374.658203125 374.7861328125 374.84765625 374.9423828125 374.9775390625 375.140625 377.4189453125 377.4384765625 378.69921875 378.837890625 378.8544921875 379.486328125 379.5224609375 379.7099609375 379.8037109375 380.0390625 380.2174479166667 380.2509765625 380.4228515625 380.470703125 380.5615234375 380.568359375 380.662109375 380.8623046875 381.1315104166667 382.08984375 382.3151041666667 382.7783203125 383.0263671875 383.0810546875 385.0634765625 386.8193359375

Current
Mean: 374.028 MB
Stdev: 5.218 MB (1.4%)
Runs: 362.748046875 364.23046875 364.9713541666667 365.5390625 366.1533203125 366.8720703125 367.2373046875 367.4697265625 368.3896484375 368.66015625 369.08203125 369.3056640625 370.1015625 370.23046875 370.4283854166667 370.458984375 370.4677734375 370.943359375 371.0537109375 371.1435546875 371.37109375 371.4443359375 371.515625 371.7314453125 372.19921875 372.8056640625 374.4404296875 374.4892578125 374.5302734375 374.6630859375 375.1298828125 375.2529296875 375.4244791666667 375.681640625 375.8216145833333 376.0224609375 376.224609375 376.4013671875 376.583984375 376.8837890625 377.6302083333333 377.8662109375 377.984375 378.005859375 378.078125 378.25390625 378.4462890625 379.029296875 379.056640625 379.60546875 379.8037109375 379.904296875 380.4375 381.251953125 381.4716796875 382.923828125 384.7060546875 385.091796875
Chat opening (CPU/JS) Baseline
Mean: 0.000 %
Stdev: 0.000 % (NaN%)
Runs: 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0

Current
Mean: 0.000 %
Stdev: 0.000 % (NaN%)
Runs: 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0
Chat opening (CPU/UI) Baseline
Mean: 30.316 %
Stdev: 1.784 % (5.9%)
Runs: 26.9 27 27.3 27.5 27.9 28.3 28.3 28.4 28.5 28.5 28.8 28.8 29 29.2 29.3 29.4 29.4 29.4 29.5 29.6 29.7 29.7 29.7 29.8 29.9 30 30 30.2 30.2 30.2 30.3 30.4 30.5 30.5 30.5 30.5 30.9 30.9 30.9 31 31.2 31.2 31.2 31.5 31.6 31.7 31.8 31.9 32 32 32.4 32.5 32.5 33.1 34.5 34.9 35.2

Current
Mean: 29.941 %
Stdev: 2.914 % (9.7%)
Runs: 25.7 25.8 25.9 26.4 26.7 26.8 26.8 26.9 26.9 27 27 27 27 27.2 27.2 27.4 27.5 27.8 28 28 28.3 28.4 28.4 28.5 28.5 28.6 28.8 28.9 28.9 29.2 29.3 29.5 29.5 29.8 30.2 30.3 30.3 30.6 31 31.4 31.6 31.7 31.8 32.5 32.5 32.9 33.1 33.3 33.4 33.6 33.8 33.9 34 34.2 34.3 35 35.7 35.9 35.9

⚠️ Some tests did not pass successfully, so some results are omitted from final report: Linking

Copy link
Contributor

@Expensify/mobile-deployers 📣 Please look into this performance regression as it's a deploy blocker.

@mountiny
Copy link
Contributor

will retry the test, that might be flaky

Copy link
Contributor

Performance Comparison Report 📊

Significant Changes To Duration

Name Duration
Chat opening Chat TTI 311.524 ms → 638.768 ms (+327.244 ms, +105.0%) 🔴🔴
Show details
Name Duration
Chat opening Chat TTI Baseline
Mean: 311.524 ms
Stdev: 37.414 ms (12.0%)
Runs: 251.76843199972063 254.78719099983573 254.98457900015637 257.53511600010097 257.9154460001737 262.4033200000413 263.43477400019765 263.73046899959445 263.83687299955636 267.4099929998629 270.3176270001568 273.5370279997587 277.45210800040513 278.35294599924237 280.22566800005734 282.25423199962825 284.01542200054973 287.2134199999273 288.137898999732 289.19364399975166 291.5533039998263 296.1059579998255 299.8826089994982 301.0547690000385 301.7052819998935 302.3601480005309 307.0332439998165 308.0766599997878 310.98783400002867 311.1493730004877 312.76908400002867 314.94840499944985 320.6088460003957 321.62325100041926 325.36633399967104 333.92704300023615 336.41800899989903 341.3975419998169 341.5090740006417 343.0462239999324 343.78731300029904 345.02559399977326 345.03727299999446 345.0423590000719 346.7881269995123 346.9984539998695 349.8774830000475 354.78796399990097 356.06876699998975 356.88887599948794 357.0036220001057 357.28621400054544 361.582317000255 380.2159829996526 380.2581380000338 388.69197599962354

Current
Mean: 638.768 ms
Stdev: 30.619 ms (4.8%)
Runs: 575.5108639998361 583.4758709999733 588.5177410002798 592.8057859996334 596.5184729998 597.0288900006562 597.4738369998522 597.5720629999414 601.5787769993767 603.0782470004633 603.4343269998208 604.5138349998742 608.5740970000625 609.1369629995897 612.2345780003816 620.7493500001729 620.7631029998884 621.1357019999996 624.2930910000578 624.6205660002306 627.4820970003493 630.2856850000098 630.5504159997217 630.9886070005596 634.5873220004141 634.6531170001253 637.1356609999202 640.3361409995705 640.8582770004869 646.0714520001784 646.1724040005356 646.4293220001273 647.050782000646 648.5364990001544 648.7893469999544 649.0113119995221 650.2093100002967 652.8382169995457 654.2145180003718 654.3819580003619 654.6805830001831 656.0450439993292 658.4991460000165 660.0666510006413 660.3670660005882 661.5148930000141 662.3175059994683 665.7745769992471 665.7834479995072 670.5866299998015 675.2044270001352 678.1175939999521 683.5768229998648 684.4536950001493 686.2583419997245 688.3798829996958 695.2084149997681 708.1352130006999

Meaningless Changes To Duration

Show entries
Name Duration
App start time nativeLaunchEnd_To_appCreationStart 85.267 ms → 79.767 ms (-5.500 ms, -6.5%)
App start time appCreation 74.233 ms → 75.900 ms (+1.667 ms, +2.2%)
App start time appCreationEnd_To_contentAppeared 561.373 ms → 553.780 ms (-7.593 ms, -1.4%)
App start time nativeLaunch 25.714 ms → 25.518 ms (-0.196 ms, -0.8%)
App start time runJsBundle 322.034 ms → 319.867 ms (-2.167 ms, -0.7%)
App start time contentAppeared_To_screenTTI 539.689 ms → 543.819 ms (+4.129 ms, +0.8%)
App start time TTI 1289.489 ms → 1296.855 ms (+7.365 ms, +0.6%)
App start time regularAppStart 0.021 ms → 0.022 ms (+0.001 ms, +5.2%)
App start time (CPU) 140.857 % → 142.207 % (+1.349 %, +1.0%)
App start time (FPS) 60.000 FPS → 60.000 FPS
App start time (RAM) 346.251 MB → 344.877 MB (-1.374 MB, ±0.0%)
App start time (CPU/JS) 0.000 % → 0.000 %
App start time (CPU/UI) 22.407 % → 22.435 % (+0.028 %, ±0.0%)
Open search router TTI Open Search Router TTI 1084.807 ms → 1067.766 ms (-17.041 ms, -1.6%)
Open search router TTI Load Search Options 163.821 ms → 160.486 ms (-3.335 ms, -2.0%)
Open search router TTI (CPU) 143.633 % → 145.778 % (+2.145 %, +1.5%)
Open search router TTI (FPS) 58.186 FPS → 58.074 FPS (-0.112 FPS, ±0.0%)
Open search router TTI (RAM) 377.509 MB → 379.213 MB (+1.704 MB, ±0.0%)
Open search router TTI (CPU/JS) 0.000 % → 0.000 %
Open search router TTI (CPU/UI) 25.083 % → 26.743 % (+1.660 %, +6.6%)
Report typing Composer typing rerender count 1.000 renders → 1.000 renders
Report typing Message sent 456.981 ms → 443.978 ms (-13.003 ms, -2.8%)
Report typing (CPU) 100.256 % → 101.238 % (+0.982 %, +1.0%)
Report typing (FPS) 60.000 FPS → 60.000 FPS
Report typing (RAM) 451.410 MB → 454.458 MB (+3.048 MB, +0.7%)
Report typing (CPU/JS) 0.000 % → 0.000 %
Report typing (CPU/UI) 23.717 % → 23.902 % (+0.185 %, +0.8%)
Chat opening (CPU) 166.345 % → 159.236 % (-7.110 %, -4.3%)
Chat opening (FPS) 57.937 FPS → 57.802 FPS (-0.134 FPS, ±0.0%)
Chat opening (RAM) 378.790 MB → 379.097 MB (+0.307 MB, ±0.0%)
Chat opening (CPU/JS) 0.000 % → 0.000 %
Chat opening (CPU/UI) 31.112 % → 30.017 % (-1.095 %, -3.5%)
Show details
Name Duration
App start time nativeLaunchEnd_To_appCreationStart Baseline
Mean: 85.267 ms
Stdev: 11.852 ms (13.9%)
Runs: 66 68 69 69 70 71 72 72 72 74 74 74 75 75 76 76 77 78 78 79 79 79 79 79 81 81 81 82 82 83 84 84 84 85 86 86 86 86 87 88 90 90 91 92 92 93 94 94 97 97 101 103 103 104 105 105 106 109 111 112

Current
Mean: 79.767 ms
Stdev: 11.386 ms (14.3%)
Runs: 57 60 64 64 64 65 66 67 69 69 69 69 70 70 71 72 73 73 73 73 73 74 74 74 75 77 77 77 78 78 79 80 81 81 81 82 83 83 83 84 84 85 85 87 87 87 87 89 90 90 91 91 92 95 97 101 101 104 105 106
App start time appCreation Baseline
Mean: 74.233 ms
Stdev: 12.358 ms (16.6%)
Runs: 51 54 55 55 58 59 59 61 61 62 63 63 64 64 64 65 66 66 66 67 69 69 69 69 69 69 72 72 73 73 73 74 75 76 77 77 77 78 78 78 78 79 80 81 81 81 84 84 86 87 89 89 90 90 91 93 94 96 104 107

Current
Mean: 75.900 ms
Stdev: 11.915 ms (15.7%)
Runs: 55 57 57 58 58 60 61 61 62 63 64 65 65 66 67 67 69 69 69 70 71 71 72 73 73 74 74 74 74 75 75 75 75 76 76 77 77 77 78 78 80 81 82 82 83 83 85 86 87 91 92 92 93 93 94 95 97 98 100 102
App start time appCreationEnd_To_contentAppeared Baseline
Mean: 561.373 ms
Stdev: 48.697 ms (8.7%)
Runs: 454 473 476 482 491 493 501 503 507 508 519 520 520 520 525 533 534 536 536 536 538 540 549 554 559 559 560 561 562 562 563 567 567 567 568 570 575 579 580 581 582 586 586 587 594 598 601 602 603 605 610 613 614 629 633 654 661 667 668

Current
Mean: 553.780 ms
Stdev: 35.744 ms (6.5%)
Runs: 476 483 485 496 504 505 509 510 514 519 521 528 529 529 532 533 535 536 537 539 539 540 540 542 543 544 546 549 550 551 551 553 554 554 554 560 562 563 570 576 580 580 583 584 584 585 586 586 588 588 592 593 594 595 600 610 624 627 633
App start time nativeLaunch Baseline
Mean: 25.714 ms
Stdev: 3.075 ms (12.0%)
Runs: 21 21 21 22 22 22 22 23 23 23 23 23 23 24 24 24 24 24 24 24 24 24 24 25 25 25 25 25 25 25 25 25 25 26 26 26 27 27 27 27 27 28 28 28 28 28 28 29 29 29 31 31 32 32 33 34

Current
Mean: 25.518 ms
Stdev: 2.854 ms (11.2%)
Runs: 21 21 22 22 22 22 22 22 22 23 23 23 23 23 23 23 23 24 24 24 24 24 24 24 25 25 25 25 26 26 26 26 26 26 26 27 27 27 27 27 27 27 27 27 28 28 28 28 29 29 29 30 31 31 32 33
App start time runJsBundle Baseline
Mean: 322.034 ms
Stdev: 27.236 ms (8.5%)
Runs: 264 264 276 276 277 277 278 278 278 278 284 284 285 285 285 285 286 286 290 290 294 294 295 295 296 296 300 300 300 300 302 302 304 304 304 304 305 305 311 311 313 313 315 315 315 315 315 315 319 319 319 319 319 319 320 320 321 321 322 322 322 322 324 324 327 327 328 328 329 329 332 332 335 335 336 336 338 338 338 338 340 340 343 343 343 343 343 343 343 343 343 343 345 345 347 347 348 348 348 348 349 349 351 351 355 355 362 362 362 362 363 363 366 366 373 373 375 375

Current
Mean: 319.867 ms
Stdev: 24.842 ms (7.8%)
Runs: 274 274 276 276 277 277 278 278 283 283 283 283 285 285 287 287 289 289 291 291 291 291 293 293 295 295 296 296 298 298 302 302 303 303 303 303 304 304 306 306 307 307 307 307 308 308 309 309 313 313 314 314 317 317 319 319 320 320 322 322 325 325 327 327 329 329 332 332 332 332 333 333 334 334 334 334 334 334 334 334 335 335 337 337 337 337 337 337 338 338 338 338 340 340 341 341 342 342 342 342 346 346 346 346 347 347 349 349 350 350 353 353 355 355 361 361 364 364 370 370
App start time contentAppeared_To_screenTTI Baseline
Mean: 539.689 ms
Stdev: 53.769 ms (10.0%)
Runs: 422.65829399996437 430.03587000002153 430.1174600000959 442.67812699999195 466.8591389999492 475.59809099999256 478.03141799999867 483.4913050000323 489.97913200000767 491.14771599997766 491.3540590000339 493.4381280000089 495.55094800004736 496.8958939999575 500.4281079999637 511.2263680000324 511.3552980000386 514.124732999946 514.4799649999477 515.858738000039 519.458702999982 519.6193800000474 520.3929670000216 523.086988999974 525.792500999989 527.1422780000139 528.9863650000188 533.0808820000384 534.3152560000308 534.4135450000176 535.1253169999691 535.3661950000096 537.0198670000536 538.5487479999429 539.3601639999542 539.7003450000193 541.9132209999952 544.3130929999752 549.0243090000004 549.6668089999584 556.7614159999648 557.9339209999889 571.1158450000221 587.3061809999635 588.1379970000125 590.3578149999958 590.806455999962 596.4542280000169 599.8184119999642 601.5847239999566 604.582435999997 607.0678769999649 614.0653920000186 615.0488210000331 617.9480980000226 618.4045400000177 620.3302380000241 631.0732159999898 635.3422440000577 645.5913500000024

Current
Mean: 543.819 ms
Stdev: 27.265 ms (5.0%)
Runs: 476.7351689999923 498.97234700003173 502.1963449999457 512.0804579999531 512.1235810000217 516.6002790000057 516.6990790000418 518.3233649999602 520.0005309999688 520.5508109999355 520.6947919999948 522.5732220000355 524.3086630000034 526.1264769999543 527.1786729999585 528.1477090000408 531.8914899999509 533.0691469999729 533.4241230000043 533.9135300000198 535.3084840000374 535.37331299996 536.4543060000287 537.3821699999971 537.632576999953 538.9137020000489 539.0935299999546 539.3386170000304 543.2479990000138 549.409227999975 549.9795239999657 550.6756570000434 550.8538199999603 550.9405849999748 553.549544999958 554.446660000016 554.659878000035 557.9776500000153 558.6981069999747 561.3338369999547 561.8346090000123 562.5609529999783 563.7327240000013 567.3132210000185 572.528047000058 574.9598009999609 576.3754539999645 576.7000969999935 579.286286000046 591.1194110000506 617.053322999971 624.2241859999485
App start time TTI Baseline
Mean: 1289.489 ms
Stdev: 75.591 ms (5.9%)
Runs: 1117.4381280000089 1154.0314179999987 1154.1477159999777 1162.0358700000215 1163.3540590000339 1178.5509480000474 1181.858738000039 1195.792500999989 1196.2263680000324 1199.4913050000323 1205.115845000022 1211.0808820000384 1218.3130929999752 1226.8958939999575 1229.4281079999637 1229.6582939999644 1231.8591389999492 1240.3929670000216 1249.3601639999542 1252.117460000096 1259.3552980000386 1262.9132209999952 1272.7003450000193 1275.9791320000077 1277.5980909999926 1285.6193800000474 1292.1379970000125 1298.086988999974 1298.125316999969 1298.4135450000176 1298.7614159999648 1298.933920999989 1301.124732999946 1306.4542280000169 1309.0198670000536 1311.3152560000308 1319.4799649999477 1322.4045400000177 1322.678126999992 1332.582435999997 1334.3661950000096 1335.6668089999584 1336.5847239999566 1339.048821000033 1340.3061809999635 1342.5487479999429 1348.806455999962 1370.5913500000024 1374.8184119999642 1377.458702999982 1377.9863650000188 1378.142278000014 1380.3422440000577 1383.3578149999958 1386.067876999965 1395.9480980000226 1399.0732159999898 1401.0243090000004 1406.330238000024 1420.0653920000186

Current
Mean: 1296.855 ms
Stdev: 45.414 ms (3.5%)
Runs: 1181.1786729999585 1182.6990790000418 1219.6947919999948 1242.0691469999729 1242.3233649999602 1245.5732220000355 1252.0935299999546 1252.9723470000317 1257.3084840000374 1259.1235810000217 1260.632576999953 1263.37331299996 1269.6981069999747 1271.1477090000408 1271.659878000035 1274.6756570000434 1274.7327240000013 1275.7000969999935 1276.1508249999024 1276.9776500000153 1278.549544999958 1282.8914899999509 1283.9795239999657 1292.9135300000198 1293.4241230000043 1295.3086630000034 1296.3754539999645 1298.6002790000057 1298.913702000049 1299.409227999975 1300.528047000058 1301.3821699999971 1302.0005309999688 1303.5609529999783 1304.2479990000138 1309.5508109999355 1310.1194110000506 1311.9405849999748 1315.8538199999603 1317.3132210000185 1320.286286000046 1325.5895810000366 1326.053322999971 1326.4543060000287 1335.3386170000304 1335.8346090000123 1339.3338369999547 1342.446660000016 1345.3839779999107 1356.2241859999485 1361.9491550000384 1373.9598009999609 1382.5531409999821 1400.941050000023 1408.008460000041
App start time regularAppStart Baseline
Mean: 0.021 ms
Stdev: 0.002 ms (11.4%)
Runs: 0.016967999981716275 0.01782199996523559 0.017902999999932945 0.018066999968141317 0.01818799995817244 0.018188000074587762 0.018228999921120703 0.018472999799996614 0.01855399995110929 0.018595000030472875 0.0186769999563694 0.018718000035732985 0.018757999991066754 0.01879900007043034 0.0188400000333786 0.0188400000333786 0.018880000105127692 0.018920999951660633 0.01904299994930625 0.019205000018700957 0.019287000061012805 0.019328000023961067 0.019449999905191362 0.01953200006391853 0.0195720000192523 0.019653999945148826 0.01989799994044006 0.019939000019803643 0.019978999975137413 0.02010099997278303 0.020345000084489584 0.020386000047437847 0.020426000002771616 0.020589000079780817 0.020671000005677342 0.020710999961011112 0.020752000040374696 0.02083299995865673 0.020913999993354082 0.0209969999268651 0.021240000030957162 0.021483999909833074 0.021850999910384417 0.022176000056788325 0.022379999980330467 0.022867999970912933 0.022867999970912933 0.022868000087328255 0.023234999971464276 0.023274999926798046 0.02384499995969236 0.024250999907962978 0.0244140001013875 0.026123000076040626 0.027018000022508204 0.027953999931924045

Current
Mean: 0.022 ms
Stdev: 0.004 ms (20.3%)
Runs: 0.016805000021122396 0.01684599998407066 0.017008999944664538 0.017089999979361892 0.017577999969944358 0.01761800004169345 0.01774100004695356 0.017985000042244792 0.01802499999757856 0.01802499999757856 0.01810700003989041 0.018228999921120703 0.018228999921120703 0.01823000004515052 0.01831099996343255 0.01851399999577552 0.01851399999577552 0.01871700002811849 0.0188400000333786 0.01936899998690933 0.0195720000192523 0.019816000014543533 0.019896999932825565 0.01993800001218915 0.019978999975137413 0.020019000046886504 0.02010100008919835 0.020141999935731292 0.020222999970428646 0.020223000086843967 0.020344999968074262 0.020386000047437847 0.020711999968625605 0.02087399992160499 0.02087399992160499 0.020913999993354082 0.020915000000968575 0.021850999910384417 0.0224609998986125 0.022501999977976084 0.02274600008968264 0.022949000005610287 0.02331599988974631 0.02388500003144145 0.0242510000243783 0.02510600001551211 0.025756999966688454 0.02604199992492795 0.027547999983653426 0.028442999930121005 0.028889999957755208 0.029703999985940754 0.03039500000886619 0.03182000003289431 0.03344699996523559 0.03511499997694045
App start time (CPU) Baseline
Mean: 140.857 %
Stdev: 7.200 % (5.1%)
Runs: 125.77689243027886 128.28404669260703 131.14028056112224 131.60730332164357 131.84926048705856 132.69100743745767 132.7917574796909 133.4875170491609 133.90425999121655 133.92604518265543 134.20444360583048 134.45958063987896 134.76057482758762 134.85002744127965 134.97652582159625 135.01077930373683 135.68289660832602 135.91924885627827 135.9517505148573 136.27254509018033 137.00428408599618 137.1556029403513 137.9806617482674 138.31552517563944 138.79326831134063 139.0618244703848 139.60396039603967 139.83314209217826 139.88534838601504 139.89586813676357 139.91528874482032 140.4130109562188 140.4382470119522 141.05691056910575 141.69350670006764 141.8212243759588 142.32151257248802 143.22925930756978 144.00431638809684 144.06539444267008 144.58276911998377 144.86435653033251 144.8662674650699 145.39804930256906 146.84860298895387 147.07242678574985 147.37823694089207 150.1980198019802 150.3861386138614 150.38833664678586 150.63223189788866 150.8756201063894 151.33946818093438 152.00927788955963 152.38348396243134 152.83998931271327 156.37910415307678 157.23523712808307

Current
Mean: 142.207 %
Stdev: 6.646 % (4.7%)
Runs: 126.37917514831331 131.81034036263384 131.81542367603734 131.90524475245311 132.87845887204418 133.4825379062948 133.58995218159095 133.60252250532812 133.82231660139368 133.99385643874618 134.37712891522364 135.7705470583314 136.46067705543194 136.5621697780908 137.63729393505164 137.89682539682542 138.4646214529193 138.65579047708346 138.77360041973705 138.83499013885302 139 139.5052596975674 139.7011952191235 141.43426294820722 141.80528716855594 141.88336833028612 142.1657434647727 142.30522088353413 142.5944333996024 142.71868472688138 142.81132338585977 143.30808080808083 143.31019012187704 143.57650303895315 144.06207827260457 144.15631262525048 144.51751032267939 144.59666051184308 144.60231660231656 145.0863213811422 145.46031746031747 145.71032296413705 145.7330677290837 145.90768641165064 146.19678572006018 146.53658348290975 146.82598954443608 147.41270575582527 147.72111553784868 147.86704383614324 148.58976343266707 148.91973460442173 151.03720859237163 151.89742033868532 153.9174846980189 153.9177742076823 154.21225554926744 155.4889336016097 156.98043806356802
App start time (FPS) Baseline
Mean: 60.000 FPS
Stdev: 0.000 FPS (0.0%)
Runs: 60 60 60 60 60 60 60 60 60 60 60 60 60 60 60 60 60 60 60 60 60 60 60 60 60 60 60 60 60 60 60 60 60 60 60 60 60 60 60 60 60 60 60 60 60 60 60 60 60 60 60 60 60

Current
Mean: 60.000 FPS
Stdev: 0.000 FPS (0.0%)
Runs: 60 60 60 60 60 60 60 60 60 60 60 60 60 60 60 60 60 60 60 60 60 60 60 60 60 60 60 60 60 60 60 60 60 60 60 60 60 60 60 60 60 60 60 60 60 60 60 60 60 60 60 60
App start time (RAM) Baseline
Mean: 346.251 MB
Stdev: 12.271 MB (3.5%)
Runs: 328.322265625 328.560546875 329.783203125 330.734375 330.765625 330.77734375 332.513671875 332.525390625 333.14453125 333.5078125 334.04296875 335.369140625 335.57421875 335.69140625 335.888671875 335.919921875 336.09375 336.1015625 336.138671875 336.533203125 336.689453125 337.92578125 338.46484375 339.1171875 339.24609375 340.94921875 341.103515625 342.1796875 342.791015625 343.673828125 345.015625 345.396484375 346.103515625 347.126953125 347.5377604166667 351.18359375 351.658203125 352.755859375 353.169921875 353.87890625 354.11328125 354.41796875 354.5 354.619140625 355.44921875 355.69921875 356.3671875 357.03125 357.580078125 359.236328125 359.82421875 359.982421875 360.76171875 362.087890625 362.85546875 362.99609375 363.63671875 367.115234375 370.76171875 382.09765625

Current
Mean: 344.877 MB
Stdev: 10.062 MB (2.9%)
Runs: 328.677734375 330.833984375 331.583984375 331.642578125 332.99609375 333.392578125 333.646484375 333.724609375 333.919921875 334.03125 334.138671875 334.267578125 334.32421875 334.75 334.994140625 335.0390625 335.205078125 335.41015625 335.513671875 335.689453125 336.52734375 336.919921875 337.423828125 338.54296875 339.248046875 342.078125 342.1640625 344.0234375 344.552734375 345.13671875 345.5859375 346.38671875 346.853515625 347.287109375 347.59765625 347.76171875 348.0872395833333 349.818359375 350.013671875 350.6432291666667 351.994140625 352.548828125 352.783203125 352.8046875 353.583984375 353.693359375 353.8619791666667 354.63671875 355.013671875 355.1953125 355.33203125 356.32421875 356.486328125 357.41015625 357.8203125 358.236328125 359.765625 360.1953125 366.24609375 368.263671875
App start time (CPU/JS) Baseline
Mean: 0.000 %
Stdev: 0.000 % (NaN%)
Runs: 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0

Current
Mean: 0.000 %
Stdev: 0.000 % (NaN%)
Runs: 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0
App start time (CPU/UI) Baseline
Mean: 22.407 %
Stdev: 4.096 % (18.3%)
Runs: 12.9 13 15 16 16 17 17 17 18 18.1 19 19 19.1 19.9 19.9 19.9 20.1 21 21.1 21.1 21.1 21.9 22 22 22 22 22 22.1 22.1 22.1 22.1 23 23 23 23 23 23.1 23.8 23.8 24 24 24 24.9 24.9 25.8 25.8 26 26 26.1 26.1 26.5 26.8 26.9 27.9 28 28.1 28.9 31.4 32.7

Current
Mean: 22.435 %
Stdev: 3.050 % (13.6%)
Runs: 13.9 17 18 18.9 18.9 19 19 19.9 20 20 20 20 20 20.1 20.1 20.1 20.8 20.9 21 21 21 21 21.1 21.1 21.8 21.8 21.9 21.9 22 22 22.1 22.2 22.9 22.9 23 23.2 23.9 23.9 23.9 24 24 24 24.1 24.1 24.8 25 25.1 25.3 25.5 26 26 26.7 26.9 27.1 28 30 30
Open search router TTI Open Search Router TTI Baseline
Mean: 1084.807 ms
Stdev: 22.148 ms (2.0%)
Runs: 1041.4620769999456 1046.439250000054 1046.899617999792 1049.435710000107 1058.703980000224 1059.8113609999418 1061.2339280000888 1061.776205000002 1062.1587729998864 1063.8564859998878 1068.3951420001686 1069.3170170001686 1070.8643400003202 1070.896280999994 1071.0343430000357 1071.5544030000456 1074.0317389999982 1074.5874850000255 1074.7703050002456 1075.0091969999485 1075.6797289999668 1076.291666999925 1076.3940429999493 1077.9417730001733 1078.3077800001483 1078.8222660000902 1078.9228930000681 1079.1896979999729 1079.8655610000715 1080.0701089999638 1080.1443290000316 1080.3610839999747 1081.3447680000681 1082.8365080000367 1083.8288579999935 1085.0422370000742 1085.0560710001737 1090.7077639999334 1094.0095629999414 1095.93542600004 1096.4490570002235 1097.9401040000375 1098.8153490000404 1101.2611090000719 1102.0705979997292 1103.2643239996396 1105.027425999986 1105.4638269999996 1110.7748219999485 1115.3057460000273 1119.2369800000452 1121.2933759998996 1122.4457199999597 1126.8953449998517 1129.7952069998719 1132.3894050000235 1132.5982270000968

Current
Mean: 1067.766 ms
Stdev: 27.528 ms (2.6%)
Runs: 1006.2310389999766 1007.9040939998813 1015.9665529998019 1018.4572760001756 1028.8088380000554 1032.0336919999681 1037.9783950001001 1039.7587489997968 1043.6418869998306 1044.3765060000587 1049.8024100000039 1050.5217290001456 1050.679443999892 1051.9113369998522 1052.2292479998432 1054.7144780000672 1057.019857000094 1057.2902829998638 1057.9423430003226 1060.383627000032 1061.959433000069 1062.2863770001568 1062.5163580002263 1063.3248700001277 1065.8433030000888 1067.4278979999945 1067.705933000194 1067.9729830003344 1069.1221109998878 1070.944540000055 1071.0519210000057 1072.400878999848 1074.5299480000976 1075.2760009998456 1077.9154459999409 1078.7416190002114 1079.9630539999343 1080.1477459999733 1085.4171150000766 1087.9995530000888 1091.1775730000809 1092.9694830002263 1094.0886649999302 1100.2644449998625 1103.0568029999267 1106.450359000126 1106.5548920000438 1110.1126719999593 1110.4521080001723 1110.9210210000165 1117.9989830001723 1119.590089000063
Open search router TTI Load Search Options Baseline
Mean: 163.821 ms
Stdev: 3.645 ms (2.2%)
Runs: 158.80712899984792 159.40942399995402 159.78926600003615 160.32023200020194 160.40612800000235 160.4313560000155 160.46659299964085 160.4673260001 160.58028200012632 160.65625099977478 160.68294299999252 160.78141299961135 160.82609100011177 160.93452999996953 160.94559699995443 161.0650639999658 161.16361499996856 161.22859699977562 161.25874800002202 161.3163250000216 161.41890499996953 161.50484199961647 161.64046299969777 161.64925100002438 161.6979580000043 161.83085199980997 161.86433900007978 161.94462099997327 162.0420330001507 162.09309900039807 162.11494899983518 162.2884919999633 162.48677599988878 162.76582899992354 163.11482800007798 163.92362500005402 164.25907399971038 164.31009900011122 164.44336000015028 164.8380940000061 165.20186399994418 165.5350750000216 166.37451200000942 166.49837299995124 166.62914999993518 166.80936700012535 167.39640299999155 167.76932800002396 168.11210099980235 168.12585500022396 168.2323000000324 168.26949000009336 168.62756299995817 169.2087809999939 171.0244140001014 171.03796399990097 171.14514199993573 172.44356299983338 173.23409099970013

Current
Mean: 160.486 ms
Stdev: 1.824 ms (1.1%)
Runs: 156.91394099988975 157.46354099968448 157.54850300005637 157.68839599983767 157.7410070002079 158.23026500013657 158.44205700000748 158.5103349997662 158.51509699970484 158.6523440000601 158.68013500003144 158.72228999994695 158.77921600011177 158.8515629998874 159.0040690000169 159.0849609998986 159.1623130000662 159.18196600000374 159.69950400013477 159.71801800001413 159.7362870001234 159.7792559999507 159.88431800017133 159.95833300007507 160.12508099991828 160.18566899979487 160.30464700004086 160.31990600004792 160.46158799994737 160.48905500001274 160.54956099996343 160.61132899997756 160.66585300001316 160.86112500005402 160.97493499983102 161.00081399991177 161.11539699998684 161.20174100017175 161.24031599983573 161.2953690001741 161.33870399999432 161.37304700003006 161.56791199976578 161.64827499981038 161.71862800000235 161.72395799984224 161.8837890001014 161.9661860000342 161.99422199977562 162.3974609998986 162.93554700003006 163.00565600022674 163.16573099978268 163.24072299990803 163.3737380001694 164.19079599995166 164.61433900007978 164.68188500008546
Open search router TTI (CPU) Baseline
Mean: 143.633 %
Stdev: 4.516 % (3.1%)
Runs: 135.11324379296244 135.7162245770248 136.16363571396204 136.34339684228763 136.53484182348987 136.80852055751512 137.75429748861265 137.902133279536 138.4806831680168 138.92482372315183 140.13133494789483 140.25514111495562 140.34877754854995 140.37565473487908 140.4995112619296 140.52851539208194 140.54909966539498 140.5863340188156 140.59670014330482 140.74303924259758 140.86659600503387 141.2321071628528 141.3709873664167 141.44234923675168 141.5023509603008 141.67128312382292 142.38317087381702 142.5293963158948 143.30359232397612 143.30857388527102 143.55589671935206 143.83860950206463 144.05718290654227 144.442183910454 144.90324654530505 144.92399274357405 144.94833351378793 145.2654915333714 145.29341260758227 145.9473288571901 146.2919345854356 146.70224119295364 146.7276476946317 146.89489403086213 147.51610971048382 147.51703546809333 147.61134336869642 147.73485477564054 148.04364255905642 148.10697535145957 148.28764292938462 148.37701070359978 148.4929389136237 149.80902773437023 150.53164033875143 151.1391751825516 151.22001136631056 151.79405629806004 151.88804026807432 152.15802869544737

Current
Mean: 145.778 %
Stdev: 4.123 % (2.8%)
Runs: 137.7324870755761 138.27056137043806 138.77187104191609 138.96282441893104 140.10856646740726 140.2737232385216 141.19746939669494 141.28782526197642 141.69178564599338 141.90094794053198 142.04933123383992 142.1601071179944 142.2797630721607 142.31869089204793 142.37596943644812 142.38107453354064 142.5447162775787 142.57805953034256 143.09828908089287 143.4543522565199 143.95751918430057 144.35520051279764 144.46511146935612 144.50110010629672 144.51788437135943 144.6012430450701 144.74379677237755 144.78723972538717 144.88165120770574 144.96099173014676 145.0563860928914 145.7405388721902 145.7775615387871 145.7846564786697 146.57605241426165 146.85678421343977 147.06549814071394 147.25800337617682 147.3320378300451 147.73150201295977 147.92470164134258 148.03240786024128 148.41116213288535 148.43871100818671 148.56435094611618 148.8215765809012 148.94687730257786 149.14494996581948 149.28974577878964 149.76276413998374 150.06043643937423 150.3822891513358 151.74342806163062 151.7573756993683 152.31551414826316 152.31662293811775 153.1537428813573 153.18924248277636 153.314897886851 154.7232380781079
Open search router TTI (FPS) Baseline
Mean: 58.186 FPS
Stdev: 1.724 FPS (3.0%)
Runs: 54.86667333441541 55.011932159200704 55.02997084326709 55.365246381059386 55.5192543133365 55.712624946277366 55.74400707540442 56.07060427345768 56.09590047511208 56.19887995254228 56.20874022291449 56.234817406888354 56.37654294983031 56.420078462472176 56.82231119633974 56.877206379642416 56.98208878630383 57.00286101456103 57.030803217931656 57.06678871273873 57.18290452753469 57.44107794076418 57.514872240458814 57.533658158734085 57.623098587596814 57.66769223913627 57.67441931468214 57.749232753988316 57.886896498127406 58.06621787920546 58.177646312150884 58.314231100139196 58.402995239706684 59.13435441199797 59.42071032127156 59.46898975733079 59.71105579970949 59.8055161869277 59.826800802957365 59.9387356146818 59.982565098130934 60 60 60 60 60 60 60 60 60 60 60 60 60 60 60 60 60 60 60

Current
Mean: 58.074 FPS
Stdev: 1.811 FPS (3.1%)
Runs: 54.19196128156246 54.19958830535229 54.93878906982578 55.176946600319965 55.45180156758903 55.45537153244294 56.02358015505647 56.166999550952525 56.19093038907397 56.239464692740384 56.24781882268246 56.27988692356278 56.36396776897983 56.37404434307359 56.59427451748993 56.63285957935409 56.71818886497675 56.95181101602071 57.10309702624583 57.1174816950622 57.13823853173973 57.17092987828678 57.1826761233397 57.44836667283602 57.51856056737006 57.541580745635144 57.666243758338545 57.84995287645991 57.85060290971873 58.176879171896424 58.22971629191252 58.77504023978865 58.98657916679369 59.01348337447196 59.64439521695628 59.8042254373701 59.86726328127336 59.93819083113472 60 60 60 60 60 60 60 60 60 60 60 60 60 60 60 60 60 60 60
Open search router TTI (RAM) Baseline
Mean: 377.509 MB
Stdev: 6.410 MB (1.7%)
Runs: 361.43359375 361.5859375 363.4853515625 370.403125 370.47890625 370.966796875 371.69296875 372.30234375 372.73046875 372.90625 373.24765625 373.3734375 373.3837890625 373.49375 373.6734375 374.21171875 374.912109375 375.0986328125 375.4484375 375.787109375 375.95546875 376.0400390625 376.0546875 376.14296875 376.86484375 376.9365234375 377.14296875 377.2046875 377.2125 377.24609375 377.48125 377.5921875 378.03359375 378.13828125 378.568359375 378.6240234375 378.947265625 379.27734375 379.88203125 380.77890625 381.021875 381.6923828125 382.2859375 382.39609375 383.44921875 384.1203125 384.57421875 385.37578125 386.60078125 388.86484375 388.8921875 389.88046875 390.78984375 390.80234375

Current
Mean: 379.213 MB
Stdev: 8.649 MB (2.3%)
Runs: 359.80078125 362.513671875 363.9404296875 364.99609375 365.470703125 366.3017578125 367.8876953125 368.046875 368.5419921875 369.09375 370.1083984375 371.04140625 372.0140625 372.84296875 372.85078125 373.45703125 374.396484375 375.72265625 375.8671875 376.53046875 376.82578125 377.0537109375 377.1552734375 377.1765625 377.24140625 377.52421875 377.80390625 378.1609375 379.165625 379.2625 379.4578125 379.4716796875 379.9546875 380.46484375 380.75390625 380.940625 381.25 381.3890625 381.6765625 382.267578125 382.61015625 382.8447265625 383.02109375 383.29453125 385.7234375 386.28671875 387.08515625 387.63359375 388.06015625 388.38359375 389.1375 389.3421875 391.1390625 392.0328125 392.58046875 392.7765625 393.1578125 393.4890625 393.809375 393.9703125
Open search router TTI (CPU/JS) Baseline
Mean: 0.000 %
Stdev: 0.000 % (NaN%)
Runs: 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0

Current
Mean: 0.000 %
Stdev: 0.000 % (NaN%)
Runs: 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0
Open search router TTI (CPU/UI) Baseline
Mean: 25.083 %
Stdev: 1.507 % (6.0%)
Runs: 22 22.1 22.4 22.8 22.9 23.1 23.1 23.3 23.4 23.4 23.5 23.6 23.7 23.9 23.9 24 24.3 24.3 24.4 24.4 24.4 24.4 24.5 24.7 24.7 24.7 24.7 24.8 25.1 25.1 25.2 25.4 25.5 25.5 25.8 25.8 25.8 25.9 25.9 25.9 26 26 26 26 26.1 26.2 26.2 26.3 26.3 26.4 26.4 26.5 26.8 26.9 27.1 27.5 28 28 28.9

Current
Mean: 26.743 %
Stdev: 1.451 % (5.4%)
Runs: 23.5 23.7 23.9 24.3 24.3 25.1 25.2 25.3 25.3 25.4 25.4 25.5 25.5 25.6 25.8 25.8 25.9 25.9 26 26.2 26.2 26.2 26.3 26.3 26.3 26.4 26.4 26.4 26.4 26.5 26.5 26.8 26.9 26.9 27.1 27.3 27.4 27.5 27.5 27.5 27.5 27.5 27.6 27.6 27.6 27.6 27.6 27.7 27.9 27.9 28 28.4 28.6 28.8 29 29.1 29.2 29.2 29.4 30
Report typing Composer typing rerender count Baseline
Mean: 1.000 renders
Stdev: 0.000 renders (0.0%)
Runs: 1 1 1 1 1 1 1 1 1 1 1 1 1 1 1 1 1 1 1 1 1 1 1 1 1 1 1 1 1 1 1 1 1 1 1 1 1 1 1 1 1 1 1 1 1 1 1 1 1 1 1 1 1 1 1 1 1 1 1 1

Current
Mean: 1.000 renders
Stdev: 0.000 renders (0.0%)
Runs: 1 1 1 1 1 1 1 1 1 1 1 1 1 1 1 1 1 1 1 1 1 1 1 1 1 1 1 1 1 1 1 1 1 1 1 1 1 1 1 1 1 1 1 1 1 1 1 1 1 1 1 1 1 1 1 1 1 1 1 1
Report typing Message sent Baseline
Mean: 456.981 ms
Stdev: 59.866 ms (13.1%)
Runs: 307.1672780001536 368.3022459996864 375.3897300004028 376.1211350001395 380.7577309999615 384.69742899993435 387.1461999998428 387.25903399987146 388.0545660001226 394.32861399976537 395.54329499974847 398.4991460000165 400.3426109999418 402.747599999886 403.09725000010803 403.8730069999583 412.5853680004366 413.3809009999968 414.3079840000719 415.4162600003183 416.5975750000216 418.5081380000338 426.297322999686 427.30692499969155 427.93916799966246 430.8666179999709 431.71826199954376 437.2336840000935 442.1742349998094 445.81258199969307 446.46431499999017 449.96142599964514 451.17989100003615 452.67024799995124 454.5366209996864 458.6431479998864 460.2497969996184 461.28629599977285 461.6427009999752 462.4208169998601 469.19527200004086 470.88663800014183 472.2859700000845 473.05546100018546 473.1117349998094 474.6348069999367 483.02490200009197 486.5181479998864 487.21118099987507 490.19128399994224 490.42757100006565 490.53389499988407 494.1147460001521 499.5292149996385 500.41809100005776 508.19417300028726 508.63948500016704 511.0782070001587 511.19828299991786 518.9089359999634 573.6267099999823 573.6267099999823 573.6267099999823 573.6267099999823 573.6267099999823 573.6267099999823 573.6267099999823 573.6267099999823

Current
Mean: 443.978 ms
Stdev: 41.385 ms (9.3%)
Runs: 375.6657709996216 377.77091499976814 380.8437899998389 381.77640799991786 382.87902799993753 382.9404299999587 384.57584699988365 388.26648000022396 392.21057099988684 395.04166600015014 396.21866800030693 398.9119470003061 403.26867699995637 404.43505899980664 407.14888500003144 409.17012600041926 410.45621800003573 412.8551030000672 414.3725590002723 414.977945999708 417.62923199962825 420.96545400004834 425.02852400019765 427.31986499996856 432.7283129999414 437.1014000000432 439.2052009999752 439.81384300021455 441.6697189998813 441.72953299991786 442.2010089997202 450.8104249997996 452.97139499988407 454.2363279997371 455.56742400024086 457.3037109998986 458.09753399994224 459.1324470001273 461.1134839998558 465.7443850003183 471.7637129998766 477.3399249999784 480.1261809999123 481.08809399977326 482.7000740002841 486.1969820000231 486.2327069998719 486.7703459998593 488.50842300010845 489.1701250001788 492.6698810001835 494.30957099981606 495.2692060000263 498.50500500015914 499.9501549997367 500.1138510000892 504.1415609996766 507.42834500037134 508.96903500007465 513.2537839999422
Report typing (CPU) Baseline
Mean: 100.256 %
Stdev: 2.865 % (2.9%)
Runs: 93.49333295634891 94.77148277094786 95.58834974068317 96.38012064058354 96.41670822977889 96.49609488712213 96.64898869545418 96.72419324993523 96.85205962674426 97.05435407804558 97.18604336065567 97.639634173466 97.68825768389407 98.27512727988403 98.33271153709585 98.36215204314057 98.52336248886829 98.61010865837538 98.81122059439173 98.85303688386011 98.85412261621754 98.95381558352928 99.07484578869172 99.11688848375499 99.2348251292927 99.44648151567361 99.49393949377179 99.5566243809619 100.01823452605723 100.04535629241552 100.05585353276533 100.09509400246306 100.49484609187239 100.84109611501228 101.26601420247887 101.41850360593222 101.47909626938308 101.78726222882531 101.92987540549997 102.01633543724212 102.04845890739482 102.14203700816091 102.15245829194163 102.34133226371931 102.46891643574018 102.68788483701424 102.9770811955511 103.0553255824353 103.13523366959436 103.65125490685901 103.67025879980832 103.67551953655779 104.0372203996396 104.05817913293586 104.22013551568836 104.37435423953916 104.87739777824856 105.06361514499194 106.59111048930329

Current
Mean: 101.238 %
Stdev: 2.895 % (2.9%)
Runs: 96.40979377798307 96.9466652019878 96.98695209193079 97.4022259481596 97.7952237125843 97.88548774441047 97.94719443366385 98.02214782349473 98.0646441194992 98.06499535542844 98.15909306575507 98.20079505075886 98.2771052959746 98.91288534506577 99.04089271921342 99.17844550435252 99.18433580061529 99.1849341694811 99.38554915990751 99.42608691353908 99.69183517794363 99.73383386458092 99.88934945917134 99.92111392037718 100.13983499797659 100.15033067663369 100.16451361737292 100.19136830983048 100.20761168646422 100.33747129823095 100.38480334969212 100.68000306558817 100.79818411420695 101.04630252557106 101.2529057878781 101.60952904346398 101.81843566501554 102.3656529561367 102.7869484751847 102.83403987604939 102.9671336599007 103.21043720262864 103.52855546371661 103.57397593832015 103.57704134959641 104.2131980453706 104.4519287759841 104.53433993760949 104.66479111602008 104.71529289626902 105.17512331025357 105.27398614134427 105.52490294273302 105.53567199659055 105.82377221426833 106.13621526344924 106.17768264172099 106.48054997037171 107.02200199331766
Report typing (FPS) Baseline
Mean: 60.000 FPS
Stdev: 0.000 FPS (0.0%)
Runs: 60 60 60 60 60 60 60 60 60 60 60 60 60 60 60 60 60 60 60 60 60 60 60 60 60 60 60 60 60 60 60 60 60 60 60 60 60 60 60 60 60 60 60 60 60 60 60 60 60 60 60 60 60 60

Current
Mean: 60.000 FPS
Stdev: 0.000 FPS (0.0%)
Runs: 60 60 60 60 60 60 60 60 60 60 60 60 60 60 60 60 60 60 60 60 60 60 60 60 60 60 60 60 60 60 60 60 60 60 60 60 60 60 60 60 60 60 60 60 60 60 60 60 60 60 60 60
Report typing (RAM) Baseline
Mean: 451.410 MB
Stdev: 4.643 MB (1.0%)
Runs: 443.72265625 443.84619140625 444.463623046875 444.873779296875 445.0322265625 445.517333984375 445.5225183823529 445.5579044117647 445.5810546875 445.7119140625 446.80583639705884 446.9423828125 447.1780790441176 447.6083984375 448.033203125 448.32835477941177 448.36328125 448.52918198529414 448.56884765625 448.698974609375 448.80491727941177 449.01611328125 449.154541015625 449.15602022058823 449.30859375 449.7236328125 449.72863051470586 450.48092830882354 450.6374080882353 450.8235294117647 451.2984834558824 451.4130859375 451.8616727941176 452.24793198529414 452.743408203125 452.994873046875 453.37890625 453.42302389705884 453.509033203125 453.8069852941176 453.9349724264706 453.991943359375 454.22702205882354 454.61443014705884 454.984375 455.20849609375 455.5767463235294 456.1025390625 456.2313878676471 456.37548828125 457.05859375 457.2274816176471 458.0944393382353 458.1187959558824 458.47265625 458.6187959558824 458.803955078125 460.0850183823529 463.04733455882354

Current
Mean: 454.458 MB
Stdev: 4.413 MB (1.0%)
Runs: 444.960693359375 445.435546875 446.26953125 446.4296875 446.893310546875 448.179443359375 448.224609375 448.48069852941177 448.576904296875 449.5962775735294 449.979736328125 450.00896139705884 450.1353400735294 450.557861328125 451.546630859375 451.63327205882354 451.922607421875 451.9921875 452.110107421875 452.4303768382353 452.67141544117646 452.70818014705884 453.64499080882354 453.74103860294116 454.4147518382353 454.60546875 454.716552734375 454.916015625 455.146484375 455.31456801470586 455.43359375 455.9522058823529 456.0381433823529 456.17922794117646 456.21766493055554 456.4391084558824 456.6702665441176 456.72150735294116 456.83386948529414 456.94508272058823 456.96852022058823 457.10179227941177 457.13235294117646 457.43704044117646 457.7766544117647 458.11374080882354 458.2398897058824 458.29150390625 458.59420955882354 458.74195772058823 459.0406709558824 459.05583639705884 459.4131433823529 459.678955078125 460.06824448529414 460.2216796875 460.85986328125 462.25045955882354 463.366455078125
Report typing (CPU/JS) Baseline
Mean: 0.000 %
Stdev: 0.000 % (NaN%)
Runs: 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0

Current
Mean: 0.000 %
Stdev: 0.000 % (NaN%)
Runs: 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0
Report typing (CPU/UI) Baseline
Mean: 23.717 %
Stdev: 0.873 % (3.7%)
Runs: 22 22.3 22.3 22.4 22.4 22.5 22.5 22.6 22.6 22.7 22.8 22.8 22.9 22.9 23 23.1 23.3 23.3 23.3 23.3 23.4 23.5 23.5 23.5 23.6 23.6 23.6 23.7 23.7 23.7 23.7 23.7 23.8 23.9 24 24 24.1 24.2 24.2 24.2 24.2 24.3 24.3 24.3 24.3 24.4 24.4 24.4 24.4 24.4 24.4 24.5 24.8 24.8 24.8 25 25.1 25.8 26.1

Current
Mean: 23.902 %
Stdev: 0.820 % (3.4%)
Runs: 22.4 22.6 22.6 22.7 22.8 22.8 22.8 22.8 22.9 22.9 23.1 23.1 23.2 23.3 23.4 23.4 23.5 23.5 23.5 23.6 23.6 23.6 23.6 23.7 23.8 23.8 23.8 23.8 23.8 23.8 23.9 23.9 24 24 24 24 24 24.1 24.2 24.2 24.3 24.3 24.3 24.3 24.3 24.5 24.5 24.5 24.5 24.7 24.7 24.8 24.9 24.9 25.2 25.5 25.6 25.9 26
Chat opening (CPU) Baseline
Mean: 166.345 %
Stdev: 6.219 % (3.7%)
Runs: 156.507175279466 157.26447105788426 157.36784205781473 157.46198419536523 157.79623894248098 157.99269280180042 158.24098048075734 159.16328237766123 159.36180578889267 159.55699525342473 159.9211158211644 160.03733949762125 160.1717888740575 160.71714213844538 161.02289351308193 161.28343140464202 161.33917900061857 161.68688916986756 161.794530784485 161.829354890571 162.54906581983113 162.82689133100106 163.54525204057066 163.80634575924762 163.81615422605282 164.3799304694663 164.4066797158861 164.61950876857262 164.90433063356164 165.8448541161335 165.88508822560024 166.51787575444183 166.96931387725556 167.57566602573198 168.07110735535386 168.17626656934684 168.60715658555884 168.64511681950637 168.79224244654867 169.39251980906573 169.75257562179576 169.95675487178858 170.0603668823711 170.23162945167354 170.44286967089542 170.7955010746485 171.5872447095248 172.14162989105603 172.4860743891511 172.74185059523603 172.91704999705166 172.99483689998235 173.2234557657685 173.96469789545145 175.56650931987812 177.32367003087685 177.57387569604322 177.90939225392563 179.36512870664777 179.84266655053298

Current
Mean: 159.236 %
Stdev: 4.504 % (2.8%)
Runs: 149.56672856671935 151.4020744043691 151.773670651078 152.19124130451448 152.54789503246516 153.1945785666105 154.16026321102018 154.5564728215694 154.58924883084148 154.76656403499786 154.9161492405237 155.26086712483786 155.44408897317498 155.45768317015126 155.58029711780068 155.7855202906974 156.0165316416609 156.03772641734562 156.2688942934563 156.4441373916314 156.49660246965743 156.78612258525422 157.17507465912328 158.22391677333255 158.4374075683335 158.5952872404042 158.83803515293752 158.84076930143425 158.94272146709332 159.01790389794814 159.34478398801306 159.48595292344464 159.5015899959814 160.2613757052164 160.29898640340306 160.495812434069 160.65289245356115 160.65876178426706 160.88752779371904 161.46905301754765 161.67131474103587 161.81518896567198 161.93626906241033 162.03165041116853 162.85571677117971 163.1493247743796 163.4055988617838 163.60795443271067 164.0764031744524 164.1599414737269 164.2489621896785 164.5282807958864 164.73059934611453 165.05947631845757 165.85385142216597 166.1044168929151 167.4763159052637 168.30272186297503 169.5326744855232
Chat opening (FPS) Baseline
Mean: 57.937 FPS
Stdev: 1.342 FPS (2.3%)
Runs: 55.507119398591705 55.70571751485122 55.723201885978156 55.81182476309702 56.00112883370146 56.04803954743271 56.09836566392232 56.15314548611943 56.18986449969498 56.261389869249314 56.28506172665497 56.47114260841768 56.59064541680516 56.64819990886397 56.81554428555543 56.87783038082219 56.91973961853003 56.933648293016034 56.94311840047919 57.07341200169749 57.22352909701487 57.39140981904674 57.555213847082676 57.61108179320796 57.63455796327249 57.66377808099061 57.832723615168554 57.83817095416488 57.91485194201048 57.94709440389424 58.00420460222462 58.056164732908044 58.2190832951167 58.26941306500797 58.31179352072211 58.41508115435233 58.46154603286796 58.513696263891056 58.52516288401948 58.55209404297294 58.72544618818897 58.744464832517515 58.75322371490013 58.812330427198745 59.104697887240086 59.18052381550737 59.240397542422414 59.348946846408126 59.437547695360436 59.472047450277955 59.581331161870125 59.638115207091104 59.67829991821668 59.70603128661239 59.80265897523299 59.98316587960885 60 60 60 60

Current
Mean: 57.802 FPS
Stdev: 1.745 FPS (3.0%)
Runs: 53.20888592892478 54.209828338062366 54.349476090748794 54.61605516778929 55.15258891892068 55.28596926393559 55.70179123519296 55.71890004762659 55.88846696330367 55.90542503317392 55.94074505714661 56.4252749348435 56.46746311427799 56.647250580019985 56.806766728460964 56.80687098851469 57.049590811145514 57.09405867583149 57.19832060946864 57.23335587350007 57.280916900157536 57.311005784630176 57.31672317745055 57.32743153376889 57.43002128337619 57.44028608481983 57.77723190864912 57.89109347845411 57.90001565574206 57.927085409164775 57.93125567187459 57.99964855972104 58.25076567963624 58.2809944169248 58.542545751307124 58.638816711348866 58.75416905600592 58.83571518008217 58.89945506692405 59.06245716380622 59.09144530604046 59.22019822205796 59.33513811764473 59.3602528408406 59.62296396609935 59.744750402854834 59.85366614120273 60 60 60 60 60 60 60 60 60 60
Chat opening (RAM) Baseline
Mean: 378.790 MB
Stdev: 6.828 MB (1.8%)
Runs: 364.8837890625 366.517578125 368.14453125 368.8779296875 369.947265625 370.017578125 370.7451171875 370.9423828125 371.421875 371.634765625 371.7041015625 372.5947265625 372.7978515625 373.06640625 373.341796875 373.521484375 373.65625 374.015625 374.216796875 374.431640625 374.6015625 374.8994140625 375.013671875 375.4921875 376.177734375 376.3466796875 376.3671875 377.134765625 378.1904296875 378.21484375 378.45703125 378.525390625 379.791015625 380.255859375 380.4169921875 380.4677734375 381.2578125 382.3544921875 383.193359375 383.2607421875 383.8525390625 384.193359375 384.62890625 384.9853515625 385.1689453125 385.3564453125 385.3603515625 385.8330078125 386.1611328125 386.357421875 386.9296875 387.0205078125 387.3798828125 387.5439453125 388.0146484375 389.8515625 390.5673828125 390.7958984375 391.7265625

Current
Mean: 379.097 MB
Stdev: 5.617 MB (1.5%)
Runs: 367.9609375 369.140625 369.92578125 370.1484375 370.212890625 370.28125 370.66015625 371.41015625 371.4755859375 371.8212890625 372.7744140625 373.1455078125 373.5791015625 374.166015625 374.236328125 374.4306640625 375.375 375.755859375 376.10546875 376.1240234375 376.681640625 377.0556640625 377.849609375 378.2666015625 378.4875 378.541015625 378.5615234375 378.759765625 378.7703125 379.3359375 379.5048828125 379.7861328125 380.5 380.833984375 380.834375 381.509765625 382.28125 382.888671875 383.0654296875 383.1708984375 383.275390625 383.3173828125 383.7529296875 384.310546875 384.5224609375 384.7177734375 384.837890625 384.9296875 384.9560546875 385.048828125 385.4453125 385.46484375 385.71875 385.72265625 385.8564453125 386.033203125 386.7861328125 388.1904296875 388.4208984375
Chat opening (CPU/JS) Baseline
Mean: 0.000 %
Stdev: 0.000 % (NaN%)
Runs: 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0

Current
Mean: 0.000 %
Stdev: 0.000 % (NaN%)
Runs: 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0
Chat opening (CPU/UI) Baseline
Mean: 31.112 %
Stdev: 1.807 % (5.8%)
Runs: 27 27.9 28.5 28.6 28.7 28.8 28.9 29.1 29.2 29.4 29.4 29.4 29.5 29.6 29.7 29.7 29.7 29.7 29.8 29.9 30 30.3 30.4 30.5 30.6 30.6 30.6 30.7 31 31 31.2 31.2 31.4 31.5 31.5 31.9 31.9 32 32.2 32.2 32.2 32.2 32.3 32.3 32.3 32.4 32.5 32.5 32.8 33 33.2 33.5 33.6 33.7 34.2 34.2 34.3 34.3 34.9

Current
Mean: 30.017 %
Stdev: 1.552 % (5.2%)
Runs: 26 26.5 27.4 27.9 27.9 28 28 28.2 28.2 28.3 28.4 28.5 28.8 28.9 29 29 29.1 29.3 29.4 29.5 29.6 29.7 29.8 29.8 29.8 29.8 29.8 29.9 29.9 29.9 29.9 30 30.3 30.3 30.4 30.4 30.4 30.5 30.5 30.5 30.6 30.8 31 31.3 31.3 31.5 31.5 31.6 31.6 31.7 31.8 31.8 31.9 31.9 32.1 32.2 32.5 33.1 33.3

⚠️ Some tests did not pass successfully, so some results are omitted from final report: Linking

Copy link
Contributor

@Expensify/mobile-deployers 📣 Please look into this performance regression as it's a deploy blocker.

Copy link
Contributor

🚀 Deployed to staging by https://github.com/mountiny in version: 9.0.98-0 🚀

platform result
🤖 android 🤖 success ✅
🖥 desktop 🖥 success ✅
🍎 iOS 🍎 success ✅
🕸 web 🕸 success ✅
🤖🔄 android HybridApp 🤖🔄 success ✅
🍎🔄 iOS HybridApp 🍎🔄 success ✅

@IuliiaHerets
Copy link

IuliiaHerets commented Feb 13, 2025

This PR is failing because of issues #56816, #56820 and #56823

Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Projects
None yet
Development

Successfully merging this pull request may close these issues.