Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

stable and devel snapshot testing #235

Merged
merged 24 commits into from
Mar 12, 2024
Merged

stable and devel snapshot testing #235

merged 24 commits into from
Mar 12, 2024

Conversation

pawelru
Copy link
Contributor

@pawelru pawelru commented Mar 6, 2024

Fundamental changes:

  • remove -as-cran to enable snapshot testing. Currently, we render the whole book during the testing setup but we don't actually run the snapshot tests. This is a buggy behaviour that needs to be fixed.
  • in order to run both devel and stable tests, we need to have separate snapshot files. Otherwise one of the profile would be most likely failing because it would compare to the snapshot coming from the other one.
    • for this, we need to make sure to render the book during test setup using appropriate profile. This is achieved by setting QUARTO_PROFILE env var in the workflow definition. This will be then picked up by Quarto itself.
    • as a direct consequence - all the existing snapshots needs to be recreated using both stable and devel profiles. Luckily, git recognizes changes as file rename (instead of remove & add).
    • Unfortunately, testthat does not support multi-levels directory name to store snapshot file. It does not support custom names either. (I created tickets - let's see what they say). Therefore we need to collapse this structure into a single string. I was thinking about the naming convention. It would be great to have {variant}/path/{id}.md but not possible :( I ran this using {path}_{variant}/snaps.md but I am happy to change it to something else.

Enhancements:

  • use full path of the article (including {tables/listings/graphs} / {subcategory}, e.g. tables/ADA/adat01.qmd instead of adat.qmd) in the .Rds file path (created by knitr hooks inside testthat/_data) as well as snapshot file (variant argument of testthat::test_snapshot() inside _snaps directory). Previously it was based on the basename of an article only (e.g. adat01) which is not super robust - there might be articles of the same basename in a separate directories.
  • simplify the main testing function - see package/tests/testthat/test-snaps.R file. I changed this to a simple for loop through the articles. I think it's easier to follow and it saves from redundant steps of e.g. removing ".rds" parts and adding this back soon after.
  • Currently we have two test files for markdown and graphs respectively. This results in a different naming convention of resulting files. Additionally, some parts are repeated. Last but not the least, graphs tests are skipped for some reasons. I have combined this all into a single test-snaps.R file assuming future work for graphs type of tests.

Other comments / thoughts - just for a record:

  • I have been thinking whether we actually need both stable and devel snapshot testing from the perspective of what's the value. I believe these are needed for potential updates of articles - a single article must be tested against both profiles and a developer should be notified whether changes results in output changes.
    It's a little bit more complicated from the perspective of reverse-dependency-checks from within e.g. tern. There, we need to limit only to development profile most likely. But I left this problem for the future
  • Currently, we have a single test file test-snaps.R that does for loop for each article. This implies that the snapshot file name snaps.md - this is impossible to change right now (I have reporter this feature request separately). We enhanced this a little using variant argument so that it is {variant}/snaps.md. An alternative approach would be to have a separate file for each article. This would create snapshot file in accordance to the name of the testing file. Together with variant could have {stable/devel}/table_ada/adat01.md. This would be much more convenient for browsing as well as this would follow recommendations.
    I have been thinking about this and decided to keep it as is. The main rationale would be to make it super easy to include article in the regression testing. Currently it's enough to change the article code. The recommended way would also include additional step of adding a new test file - something that I would like to avoid.
    On the other hand, the structure is pretty much stable and I personally don't foresee any significant changes. Therefore I think it should be ok to have separate test file for each article. Also, it's not a big deal if it will be missing - no test file means no test so nothing will fail. If done properly, this could also unblock devtools::test(filter = "adat01") type of things - however I am not sure if devs are using this. I'm interested in hearing your thoughts on this.

@pawelru
Copy link
Contributor Author

pawelru commented Mar 6, 2024

@insightsengineering/nest-sme please kindly have a look and share your thoughts on the debatable stuff I outlined above.

I'll keep it as a draft until we got an agreement of the way forward.

I would also appreciate if you can double-check the snapshots that I got. Docker is complaining for some reason and this is a result of a local install and run. I'm not super sure about this one.

@edelarua
Copy link
Contributor

edelarua commented Mar 6, 2024

@pawelru regarding graph testing: the SME team (in discussion with the IDR team) agreed to utilize skip_on_ci() to ignore differences in graph snapshots during integration tests, and only run these checks locally as needed for testing purposes.

This is because, aside from the differences that come from different local setups, there are extremely small differences in placement coordinates for different elements of the graph snapshots that are detected when integration tests are run. The IDR team suggested that it would be easier to just ignore these tests during checks, since there is currently no way to enable a tolerance for these minor differences with the format of the image files returned.

@Melkiades
Copy link
Contributor

@pawelru what is docker complaining about? I think it is very good; as far as it is possible to check where the snapshots come from somehow smoothly, it is fine with me. As Emily wrote, the graphs for now should be skipped on ci

@pawelru
Copy link
Contributor Author

pawelru commented Mar 7, 2024

  • Currently, we have a single test file test-snaps.R that does for loop for each article. This implies that the snapshot file name snaps.md - this is impossible to change right now (I have reporter this feature request separately). We enhanced this a little using variant argument so that it is {variant}/snaps.md. An alternative approach would be to have a separate file for each article. This would create snapshot file in accordance to the name of the testing file. Together with variant could have {stable/devel}/table_ada/adat01.md. This would be much more convenient for browsing as well as this would follow recommendations.
    I have been thinking about this and decided to keep it as is. The main rationale would be to make it super easy to include article in the regression testing. Currently it's enough to change the article code. The recommended way would also include additional step of adding a new test file - something that I would like to avoid.
    On the other hand, the structure is pretty much stable and I personally don't foresee any significant changes. Therefore I think it should be ok to have separate test file for each article. Also, it's not a big deal if it will be missing - no test file means no test so nothing will fail. If done properly, this could also unblock devtools::test(filter = "adat01") type of things - however I am not sure if devs are using this. I'm interested in hearing your thoughts on this.

I have tried the alternative approach of separate test file for each article and this is quite nice. As a result we have:

  • better structure of files inside _snaps
❯ tree tests/testthat/_snaps
tests/testthat/_snaps
├── development
│   ├── listings-ADA-adal02.md
│   ├── listings-ECG-egl01.md
│   ├── (...)
└── stable
    ├── listings-ADA-adal02.md
    ├── listings-ECG-egl01.md
    ├── (...)
  • better test() output:
r$> devtools::test()
ℹ Testing tlg.catalog.pkg
✔ | F W  S  OK | Context
✔ |          1 | listings-ADA-adal02                                                                                         
✔ |          1 | listings-adverse-events-ael01_nollt                                                                         
(...)
  • possibility to call devtools::test(filter = ...)

The drawback is that every time we move articles around or create a new one - we need to create appropriate test directory. I have submitted a helper script that does it automatically. I hope devs will be able to find and use it if needed.

@pawelru
Copy link
Contributor Author

pawelru commented Mar 7, 2024

OK I think this is ready for review now!

@pawelru pawelru marked this pull request as ready for review March 7, 2024 16:46
The rationale:
Each modification of an article should be tested against both stable and
devel in the feature branch before the merge. Currently this is
happening only after merge.

Key changes:
- moved `r-cmd-stable` from "docs" workflow into "check"
- `r-cmd-stable` will inherit triggers from that workflow and became
executed in the PR
- removed `r-cmd-stable-notification` as `r-cmd-stable` will be executed
in the PR
UPDATE: actually I think it's incorrect. We might also need
`r-cmd-stable` (alongside notifications) to be executed on a schedule.
- `publish-stable` job (which renders and publish catalog) is
unconditional to `r-cmd-stable`. This is good because `r-cmd-stable` is
covered already inside PR.

Small enhancements:
- remove `enforce-note-blocklist` with its `note-blocklist` because this
is a simple and dummy package

I was also thinking about renaming existing `r-cmd` into `r-cmd-devel`
but decided to keep it as is.

Please note this PR targets a feature branch and not main.
Copy link
Contributor

github-actions bot commented Mar 7, 2024

Unit Tests Summary

338 tests     0 ✅  55s ⏱️
136 suites  338 💤
  1 files      0 ❌

Results for commit 52b286e.

♻️ This comment has been updated with latest results.

Copy link
Contributor

github-actions bot commented Mar 7, 2024

Unit Test Performance Difference

Test suite performance difference
Test Suite $Status$ Time on main $±Time$ $±Tests$ $±Skipped$ $±Failures$ $±Errors$
graph-snaps 💀 $4.22$ $-4.22$ $-42$ $-42$ $0$ $0$
graphs-efficacy-fstg01 👶 $+2.41$ $+7$ $+7$ $0$ $0$
graphs-efficacy-fstg02 👶 $+0.51$ $+7$ $+7$ $0$ $0$
graphs-efficacy-kmg01 👶 $+0.12$ $+6$ $+6$ $0$ $0$
graphs-efficacy-mmrmg01 👶 $+0.38$ $+6$ $+6$ $0$ $0$
graphs-efficacy-mmrmg02 👶 $+0.16$ $+3$ $+3$ $0$ $0$
graphs-other-brg01 👶 $+0.53$ $+9$ $+9$ $0$ $0$
graphs-other-bwg01 👶 $+1.08$ $+9$ $+9$ $0$ $0$
graphs-other-cig01 👶 $+0.20$ $+5$ $+5$ $0$ $0$
graphs-other-ippg01 👶 $+0.05$ $+2$ $+2$ $0$ $0$
graphs-other-ltg01 👶 $+0.19$ $+7$ $+7$ $0$ $0$
graphs-other-mng01 👶 $+0.23$ $+7$ $+7$ $0$ $0$
graphs-pharmacokinetic-pkcg01 👶 $+0.05$ $+2$ $+2$ $0$ $0$
graphs-pharmacokinetic-pkcg02 👶 $+0.05$ $+2$ $+2$ $0$ $0$
graphs-pharmacokinetic-pkcg03 👶 $+0.26$ $+2$ $+2$ $0$ $0$
graphs-pharmacokinetic-pkpg01 👶 $+0.06$ $+2$ $+2$ $0$ $0$
graphs-pharmacokinetic-pkpg02 👶 $+0.07$ $+2$ $+2$ $0$ $0$
graphs-pharmacokinetic-pkpg03 👶 $+0.04$ $+1$ $+1$ $0$ $0$
graphs-pharmacokinetic-pkpg04 👶 $+0.05$ $+1$ $+1$ $0$ $0$
graphs-pharmacokinetic-pkpg06 👶 $+0.08$ $+4$ $+4$ $0$ $0$
listings-ADA-adal02 👶 $+0.04$ $+1$ $+1$ $0$ $0$
listings-ECG-egl01 👶 $+0.05$ $+1$ $+1$ $0$ $0$
listings-adverse-events-ael01 👶 $+0.03$ $+1$ $+1$ $0$ $0$
listings-adverse-events-ael01_nollt 👶 $+0.03$ $+1$ $+1$ $0$ $0$
listings-adverse-events-ael02 👶 $+0.05$ $+1$ $+1$ $0$ $0$
listings-adverse-events-ael02_ed 👶 $+0.05$ $+1$ $+1$ $0$ $0$
listings-adverse-events-ael03 👶 $+0.05$ $+1$ $+1$ $0$ $0$
listings-adverse-events-ael04 👶 $+0.04$ $+1$ $+1$ $0$ $0$
listings-concomitant-medications-cml01 👶 $+0.05$ $+1$ $+1$ $0$ $0$
listings-concomitant-medications-cml02a_gl 👶 $+0.03$ $+1$ $+1$ $0$ $0$
listings-concomitant-medications-cml02b_gl 👶 $+0.04$ $+1$ $+1$ $0$ $0$
listings-development-safety-update-report-dsur4 👶 $+0.03$ $+1$ $+1$ $0$ $0$
listings-disposition-dsl01 👶 $+0.03$ $+1$ $+1$ $0$ $0$
listings-disposition-dsl02 👶 $+0.04$ $+1$ $+1$ $0$ $0$
listings-efficacy-oncl01 👶 $+0.04$ $+1$ $+1$ $0$ $0$
listings-exposure-exl01 👶 $+0.04$ $+1$ $+1$ $0$ $0$
listings-lab-results-lbl01 👶 $+0.04$ $+1$ $+1$ $0$ $0$
listings-lab-results-lbl01_rls 👶 $+0.04$ $+1$ $+1$ $0$ $0$
listings-lab-results-lbl02a 👶 $+0.04$ $+1$ $+1$ $0$ $0$
listings-lab-results-lbl02a_rls 👶 $+0.06$ $+1$ $+1$ $0$ $0$
listings-lab-results-lbl02b 👶 $+0.04$ $+1$ $+1$ $0$ $0$
listings-medical-history-mhl01 👶 $+0.05$ $+1$ $+1$ $0$ $0$
listings-pharmacokinetic-pkcl01 👶 $+0.04$ $+1$ $+1$ $0$ $0$
listings-pharmacokinetic-pkcl02 👶 $+0.06$ $+1$ $+1$ $0$ $0$
listings-pharmacokinetic-pkpl01 👶 $+0.04$ $+1$ $+1$ $0$ $0$
listings-pharmacokinetic-pkpl02 👶 $+0.04$ $+1$ $+1$ $0$ $0$
listings-pharmacokinetic-pkpl04 👶 $+0.06$ $+1$ $+1$ $0$ $0$
listings-vital-signs-vsl01 👶 $+0.06$ $+1$ $+1$ $0$ $0$
markdown-snaps 💀 $52.33$ $-52.33$ $-253$ $-253$ $0$ $0$
tables-ADA-adat01 👶 $+0.21$ $+1$ $+1$ $0$ $0$
tables-ADA-adat02 👶 $+0.07$ $+1$ $+1$ $0$ $0$
tables-ADA-adat03 👶 $+0.30$ $+1$ $+1$ $0$ $0$
tables-ADA-adat04a 👶 $+0.17$ $+1$ $+1$ $0$ $0$
tables-ADA-adat04b 👶 $+0.16$ $+1$ $+1$ $0$ $0$
tables-ECG-egt01 👶 $+0.54$ $+1$ $+1$ $0$ $0$
tables-ECG-egt02 👶 $+0.14$ $+2$ $+2$ $0$ $0$
tables-ECG-egt03 👶 $+1.30$ $+2$ $+2$ $0$ $0$
tables-ECG-egt04 👶 $+0.17$ $+1$ $+1$ $0$ $0$
tables-ECG-egt05_qtcat 👶 $+0.28$ $+1$ $+1$ $0$ $0$
tables-adverse-events-aet01 👶 $+0.43$ $+4$ $+4$ $0$ $0$
tables-adverse-events-aet01_aesi 👶 $+0.61$ $+4$ $+4$ $0$ $0$
tables-adverse-events-aet02 👶 $+1.78$ $+13$ $+13$ $0$ $0$
tables-adverse-events-aet02_smq 👶 $+0.15$ $+2$ $+2$ $0$ $0$
tables-adverse-events-aet03 👶 $+0.34$ $+1$ $+1$ $0$ $0$
tables-adverse-events-aet04 👶 $+3.56$ $+8$ $+8$ $0$ $0$
tables-adverse-events-aet04_pi 👶 $+1.43$ $+8$ $+8$ $0$ $0$
tables-adverse-events-aet05 👶 $+0.10$ $+2$ $+2$ $0$ $0$
tables-adverse-events-aet05_all 👶 $+0.12$ $+2$ $+2$ $0$ $0$
tables-adverse-events-aet06 👶 $+1.85$ $+5$ $+5$ $0$ $0$
tables-adverse-events-aet06_smq 👶 $+0.31$ $+3$ $+3$ $0$ $0$
tables-adverse-events-aet07 👶 $+0.09$ $+2$ $+2$ $0$ $0$
tables-adverse-events-aet09 👶 $+0.31$ $+2$ $+2$ $0$ $0$
tables-adverse-events-aet09_smq 👶 $+0.14$ $+2$ $+2$ $0$ $0$
tables-adverse-events-aet10 👶 $+0.17$ $+2$ $+2$ $0$ $0$
tables-concomitant-medications-cmt01 👶 $+0.38$ $+4$ $+4$ $0$ $0$
tables-concomitant-medications-cmt01a 👶 $+0.69$ $+4$ $+4$ $0$ $0$
tables-concomitant-medications-cmt01b 👶 $+0.79$ $+3$ $+3$ $0$ $0$
tables-concomitant-medications-cmt02_pt 👶 $+0.08$ $+1$ $+1$ $0$ $0$
tables-deaths-dtht01 👶 $+0.47$ $+4$ $+4$ $0$ $0$
tables-demography-dmt01 👶 $+0.75$ $+5$ $+5$ $0$ $0$
tables-disclosures-disclosurest01 👶 $+0.66$ $+6$ $+6$ $0$ $0$
tables-disclosures-eudrat01 👶 $+0.14$ $+1$ $+1$ $0$ $0$
tables-disclosures-eudrat02 👶 $+0.08$ $+1$ $+1$ $0$ $0$
tables-disposition-dst01 👶 $+0.36$ $+3$ $+3$ $0$ $0$
tables-disposition-pdt01 👶 $+0.15$ $+1$ $+1$ $0$ $0$
tables-disposition-pdt02 👶 $+0.07$ $+1$ $+1$ $0$ $0$
tables-efficacy-aovt01 👶 $+0.57$ $+1$ $+1$ $0$ $0$
tables-efficacy-aovt02 👶 $+0.18$ $+1$ $+1$ $0$ $0$
tables-efficacy-aovt03 👶 $+1.00$ $+1$ $+1$ $0$ $0$
tables-efficacy-cfbt01 👶 $+0.20$ $+1$ $+1$ $0$ $0$
tables-efficacy-cmht01 👶 $+2.12$ $+2$ $+2$ $0$ $0$
tables-efficacy-coxt01 👶 $+0.40$ $+4$ $+4$ $0$ $0$
tables-efficacy-coxt02 👶 $+0.13$ $+2$ $+2$ $0$ $0$
tables-efficacy-dort01 👶 $+1.16$ $+4$ $+4$ $0$ $0$
tables-efficacy-lgrt02 👶 $+0.58$ $+4$ $+4$ $0$ $0$
tables-efficacy-mmrmt01 👶 $+0.52$ $+3$ $+3$ $0$ $0$
tables-efficacy-onct05 👶 $+0.47$ $+4$ $+4$ $0$ $0$
tables-efficacy-ratet01 👶 $+0.26$ $+1$ $+1$ $0$ $0$
tables-efficacy-rbmit01 👶 $+0.11$ $+1$ $+1$ $0$ $0$
tables-efficacy-rspt01 👶 $+0.94$ $+6$ $+6$ $0$ $0$
tables-efficacy-ttet01 👶 $+1.97$ $+6$ $+6$ $0$ $0$
tables-exposure-ext01 👶 $+0.62$ $+3$ $+3$ $0$ $0$
tables-lab-results-lbt01 👶 $+0.21$ $+1$ $+1$ $0$ $0$
tables-lab-results-lbt02 👶 $+0.16$ $+1$ $+1$ $0$ $0$
tables-lab-results-lbt03 👶 $+0.28$ $+2$ $+2$ $0$ $0$
tables-lab-results-lbt04 👶 $+0.07$ $+1$ $+1$ $0$ $0$
tables-lab-results-lbt05 👶 $+0.38$ $+3$ $+3$ $0$ $0$
tables-lab-results-lbt06 👶 $+0.72$ $+2$ $+2$ $0$ $0$
tables-lab-results-lbt07 👶 $+0.16$ $+1$ $+1$ $0$ $0$
tables-lab-results-lbt08 👶 $+0.14$ $+1$ $+1$ $0$ $0$
tables-lab-results-lbt09 👶 $+0.51$ $+2$ $+2$ $0$ $0$
tables-lab-results-lbt10 👶 $+0.12$ $+2$ $+2$ $0$ $0$
tables-lab-results-lbt10_bl 👶 $+0.13$ $+2$ $+2$ $0$ $0$
tables-lab-results-lbt11 👶 $+0.49$ $+3$ $+3$ $0$ $0$
tables-lab-results-lbt11_bl 👶 $+0.47$ $+3$ $+3$ $0$ $0$
tables-lab-results-lbt12 👶 $+0.14$ $+1$ $+1$ $0$ $0$
tables-lab-results-lbt12_bl 👶 $+0.09$ $+1$ $+1$ $0$ $0$
tables-lab-results-lbt13 👶 $+3.08$ $+5$ $+5$ $0$ $0$
tables-lab-results-lbt14 👶 $+1.80$ $+5$ $+5$ $0$ $0$
tables-lab-results-lbt15 👶 $+0.20$ $+2$ $+2$ $0$ $0$
tables-medical-history-mht01 👶 $+0.47$ $+4$ $+4$ $0$ $0$
tables-pharmacokinetic-pkct01 👶 $+1.10$ $+3$ $+3$ $0$ $0$
tables-pharmacokinetic-pkpt02 👶 $+0.22$ $+2$ $+2$ $0$ $0$
tables-pharmacokinetic-pkpt03 👶 $+1.75$ $+3$ $+3$ $0$ $0$
tables-pharmacokinetic-pkpt04 👶 $+0.27$ $+2$ $+2$ $0$ $0$
tables-pharmacokinetic-pkpt05 👶 $+0.24$ $+2$ $+2$ $0$ $0$
tables-pharmacokinetic-pkpt06 👶 $+0.12$ $+2$ $+2$ $0$ $0$
tables-pharmacokinetic-pkpt07 👶 $+0.14$ $+2$ $+2$ $0$ $0$
tables-pharmacokinetic-pkpt08 👶 $+0.12$ $+1$ $+1$ $0$ $0$
tables-pharmacokinetic-pkpt11 👶 $+0.06$ $+1$ $+1$ $0$ $0$
tables-risk-management-plan-rmpt01 👶 $+0.05$ $+1$ $+1$ $0$ $0$
tables-risk-management-plan-rmpt03 👶 $+0.16$ $+2$ $+2$ $0$ $0$
tables-risk-management-plan-rmpt04 👶 $+0.05$ $+1$ $+1$ $0$ $0$
tables-risk-management-plan-rmpt05 👶 $+0.06$ $+1$ $+1$ $0$ $0$
tables-risk-management-plan-rmpt06 👶 $+0.44$ $+4$ $+4$ $0$ $0$
tables-safety-enrollment01 👶 $+2.47$ $+4$ $+4$ $0$ $0$
tables-vital-signs-vst01 👶 $+0.31$ $+1$ $+1$ $0$ $0$
tables-vital-signs-vst02 👶 $+0.23$ $+2$ $+2$ $0$ $0$
Additional test case details
Test Suite $Status$ Time on main $±Time$ Test Case
graph-snaps 💀 $0.17$ $-0.17$ unnamed
graph-snaps 💀 $3.25$ $-3.25$ plot_v1
graph-snaps 💀 $0.39$ $-0.39$ plot_v2
graph-snaps 💀 $0.09$ $-0.09$ plot_v3
graph-snaps 💀 $0.09$ $-0.09$ plot_v4
graph-snaps 💀 $0.07$ $-0.07$ plot_v5
graph-snaps 💀 $0.07$ $-0.07$ plot_v6
graph-snaps 💀 $0.03$ $-0.03$ plot_v7
graph-snaps 💀 $0.03$ $-0.03$ plot_v8
graph-snaps 💀 $0.03$ $-0.03$ plot_v9
graphs-efficacy-fstg01 👶 $+0.06$ graphs_efficacy_fstg01.qmd_height_development
graphs-efficacy-fstg01 👶 $+0.04$ graphs_efficacy_fstg01.qmd_plot_v1_development
graphs-efficacy-fstg01 👶 $+0.02$ graphs_efficacy_fstg01.qmd_plot_v2_development
graphs-efficacy-fstg01 👶 $+0.01$ graphs_efficacy_fstg01.qmd_plot_v3_development
graphs-efficacy-fstg01 👶 $+0.01$ graphs_efficacy_fstg01.qmd_plot_v4_development
graphs-efficacy-fstg01 👶 $+0.01$ graphs_efficacy_fstg01.qmd_plot_v5_development
graphs-efficacy-fstg01 👶 $+2.24$ graphs_efficacy_fstg01.qmd_width_development
graphs-efficacy-fstg02 👶 $+0.01$ graphs_efficacy_fstg02.qmd_height_development
graphs-efficacy-fstg02 👶 $+0.01$ graphs_efficacy_fstg02.qmd_plot_v1_development
graphs-efficacy-fstg02 👶 $+0.01$ graphs_efficacy_fstg02.qmd_plot_v2_development
graphs-efficacy-fstg02 👶 $+0.01$ graphs_efficacy_fstg02.qmd_plot_v3.width_development
graphs-efficacy-fstg02 👶 $+0.01$ graphs_efficacy_fstg02.qmd_plot_v3_development
graphs-efficacy-fstg02 👶 $+0.01$ graphs_efficacy_fstg02.qmd_plot_v4_development
graphs-efficacy-fstg02 👶 $+0.42$ graphs_efficacy_fstg02.qmd_width_development
graphs-efficacy-kmg01 👶 $+0.05$ graphs_efficacy_kmg01.qmd_plot_v1_development
graphs-efficacy-kmg01 👶 $+0.01$ graphs_efficacy_kmg01.qmd_plot_v2_development
graphs-efficacy-kmg01 👶 $+0.01$ graphs_efficacy_kmg01.qmd_plot_v3_development
graphs-efficacy-kmg01 👶 $+0.01$ graphs_efficacy_kmg01.qmd_plot_v4_development
graphs-efficacy-kmg01 👶 $+0.01$ graphs_efficacy_kmg01.qmd_plot_v5_development
graphs-efficacy-kmg01 👶 $+0.01$ graphs_efficacy_kmg01.qmd_plot_v6_development
graphs-efficacy-mmrmg01 👶 $+0.31$ graphs_efficacy_mmrmg01.qmd_plot_v1_development
graphs-efficacy-mmrmg01 👶 $+0.01$ graphs_efficacy_mmrmg01.qmd_plot_v2_development
graphs-efficacy-mmrmg01 👶 $+0.02$ graphs_efficacy_mmrmg01.qmd_plot_v3_development
graphs-efficacy-mmrmg01 👶 $+0.02$ graphs_efficacy_mmrmg01.qmd_plot_v4_development
graphs-efficacy-mmrmg01 👶 $+0.01$ graphs_efficacy_mmrmg01.qmd_plot_v5_development
graphs-efficacy-mmrmg01 👶 $+0.01$ graphs_efficacy_mmrmg01.qmd_plot_v6_development
graphs-efficacy-mmrmg02 👶 $+0.01$ graphs_efficacy_mmrmg02.qmd_plot_v1_development
graphs-efficacy-mmrmg02 👶 $+0.01$ graphs_efficacy_mmrmg02.qmd_plot_v2_development
graphs-efficacy-mmrmg02 👶 $+0.13$ graphs_efficacy_mmrmg02.qmd_width_development
graphs-other-brg01 👶 $+0.14$ graphs_other_brg01.qmd_plot_v1_development
graphs-other-brg01 👶 $+0.01$ graphs_other_brg01.qmd_plot_v2_development
graphs-other-brg01 👶 $+0.01$ graphs_other_brg01.qmd_plot_v3_development
graphs-other-brg01 👶 $+0.01$ graphs_other_brg01.qmd_plot_v4_development
graphs-other-brg01 👶 $+0.01$ graphs_other_brg01.qmd_plot_v5_development
graphs-other-brg01 👶 $+0.01$ graphs_other_brg01.qmd_plot_v6_development
graphs-other-brg01 👶 $+0.01$ graphs_other_brg01.qmd_plot_v7_development
graphs-other-brg01 👶 $+0.01$ graphs_other_brg01.qmd_plot_v8_development
graphs-other-brg01 👶 $+0.31$ graphs_other_brg01.qmd_plot_v9_development
graphs-other-bwg01 👶 $+0.98$ graphs_other_bwg01.qmd_plot_v1_development
graphs-other-bwg01 👶 $+0.01$ graphs_other_bwg01.qmd_plot_v2_development
graphs-other-bwg01 👶 $+0.01$ graphs_other_bwg01.qmd_plot_v3_development
graphs-other-bwg01 👶 $+0.01$ graphs_other_bwg01.qmd_plot_v4_development
graphs-other-bwg01 👶 $+0.01$ graphs_other_bwg01.qmd_plot_v5_development
graphs-other-bwg01 👶 $+0.01$ graphs_other_bwg01.qmd_plot_v6_development
graphs-other-bwg01 👶 $+0.01$ graphs_other_bwg01.qmd_plot_v7_development
graphs-other-bwg01 👶 $+0.01$ graphs_other_bwg01.qmd_plot_v8_development
graphs-other-bwg01 👶 $+0.01$ graphs_other_bwg01.qmd_plot_v9_development
graphs-other-cig01 👶 $+0.01$ graphs_other_cig01.qmd_plot_v1_and_v2_development
graphs-other-cig01 👶 $+0.01$ graphs_other_cig01.qmd_plot_v3_development
graphs-other-cig01 👶 $+0.01$ graphs_other_cig01.qmd_plot_v4_development
graphs-other-cig01 👶 $+0.01$ graphs_other_cig01.qmd_plot_v5_development
graphs-other-cig01 👶 $+0.15$ graphs_other_cig01.qmd_table_v6_development
graphs-other-ippg01 👶 $+0.04$ graphs_other_ippg01.qmd_plots_v1_development
graphs-other-ippg01 👶 $+0.01$ graphs_other_ippg01.qmd_plots_v2_development
graphs-other-ltg01 👶 $+0.11$ graphs_other_ltg01.qmd_plot_v1_development
graphs-other-ltg01 👶 $+0.01$ graphs_other_ltg01.qmd_plot_v2_development
graphs-other-ltg01 👶 $+0.01$ graphs_other_ltg01.qmd_plot_v3_development
graphs-other-ltg01 👶 $+0.01$ graphs_other_ltg01.qmd_plot_v4_development
graphs-other-ltg01 👶 $+0.01$ graphs_other_ltg01.qmd_plot_v51_development
graphs-other-ltg01 👶 $+0.01$ graphs_other_ltg01.qmd_plot_v52_development
graphs-other-ltg01 👶 $+0.01$ graphs_other_ltg01.qmd_plot_v53_development
graphs-other-mng01 👶 $+0.16$ graphs_other_mng01.qmd_plot_v1_development
graphs-other-mng01 👶 $+0.01$ graphs_other_mng01.qmd_plot_v2_development
graphs-other-mng01 👶 $+0.01$ graphs_other_mng01.qmd_plot_v3_development
graphs-other-mng01 👶 $+0.01$ graphs_other_mng01.qmd_plot_v4_development
graphs-other-mng01 👶 $+0.01$ graphs_other_mng01.qmd_plot_v5_development
graphs-other-mng01 👶 $+0.01$ graphs_other_mng01.qmd_plot_v6_development
graphs-other-mng01 👶 $+0.01$ graphs_other_mng01.qmd_plot_v7_development
graphs-pharmacokinetic-pkcg01 👶 $+0.03$ graphs_pharmacokinetic_pkcg01.qmd_plot_v1_development
graphs-pharmacokinetic-pkcg01 👶 $+0.01$ graphs_pharmacokinetic_pkcg01.qmd_plot_v2_development
graphs-pharmacokinetic-pkcg02 👶 $+0.04$ graphs_pharmacokinetic_pkcg02.qmd_plot_v1_development
graphs-pharmacokinetic-pkcg02 👶 $+0.01$ graphs_pharmacokinetic_pkcg02.qmd_plot_v2_development
graphs-pharmacokinetic-pkcg03 👶 $+0.25$ graphs_pharmacokinetic_pkcg03.qmd_plot_v1_development
graphs-pharmacokinetic-pkcg03 👶 $+0.01$ graphs_pharmacokinetic_pkcg03.qmd_plot_v2_development
graphs-pharmacokinetic-pkpg01 👶 $+0.05$ graphs_pharmacokinetic_pkpg01.qmd_plot_v1_development
graphs-pharmacokinetic-pkpg01 👶 $+0.01$ graphs_pharmacokinetic_pkpg01.qmd_plot_v2_development
graphs-pharmacokinetic-pkpg02 👶 $+0.06$ graphs_pharmacokinetic_pkpg02.qmd_plot_v1_development
graphs-pharmacokinetic-pkpg02 👶 $+0.01$ graphs_pharmacokinetic_pkpg02.qmd_plot_v2_development
graphs-pharmacokinetic-pkpg03 👶 $+0.04$ graphs_pharmacokinetic_pkpg03.qmd_plot_v1_development
graphs-pharmacokinetic-pkpg04 👶 $+0.05$ graphs_pharmacokinetic_pkpg04.qmd_plot_v1_development
graphs-pharmacokinetic-pkpg06 👶 $+0.04$ graphs_pharmacokinetic_pkpg06.qmd_plot_v1_development
graphs-pharmacokinetic-pkpg06 👶 $+0.01$ graphs_pharmacokinetic_pkpg06.qmd_plot_v2_development
graphs-pharmacokinetic-pkpg06 👶 $+0.01$ graphs_pharmacokinetic_pkpg06.qmd_plot_v3_development
graphs-pharmacokinetic-pkpg06 👶 $+0.01$ graphs_pharmacokinetic_pkpg06.qmd_plot_v4_development
listings-ADA-adal02 👶 $+0.04$ listings_ADA_adal02.qmd_lsting_development
listings-ECG-egl01 👶 $+0.05$ listings_ECG_egl01.qmd_lsting_development
listings-adverse-events-ael01 👶 $+0.03$ listings_adverse_events_ael01.qmd_lsting_development
listings-adverse-events-ael01_nollt 👶 $+0.03$ listings_adverse_events_ael01_nollt.qmd_lsting_development
listings-adverse-events-ael02 👶 $+0.05$ listings_adverse_events_ael02.qmd_lsting_development
listings-adverse-events-ael02_ed 👶 $+0.05$ listings_adverse_events_ael02_ed.qmd_lsting_development
listings-adverse-events-ael03 👶 $+0.05$ listings_adverse_events_ael03.qmd_lsting_development
listings-adverse-events-ael04 👶 $+0.04$ listings_adverse_events_ael04.qmd_lsting_development
listings-concomitant-medications-cml01 👶 $+0.05$ listings_concomitant_medications_cml01.qmd_lsting_development
listings-concomitant-medications-cml02a_gl 👶 $+0.03$ listings_concomitant_medications_cml02a_gl.qmd_lsting_development
listings-concomitant-medications-cml02b_gl 👶 $+0.04$ listings_concomitant_medications_cml02b_gl.qmd_lsting_development
listings-development-safety-update-report-dsur4 👶 $+0.03$ listings_development_safety_update_report_dsur4.qmd_lsting_development
listings-disposition-dsl01 👶 $+0.03$ listings_disposition_dsl01.qmd_lsting_development
listings-disposition-dsl02 👶 $+0.04$ listings_disposition_dsl02.qmd_lsting_development
listings-efficacy-oncl01 👶 $+0.04$ listings_efficacy_oncl01.qmd_lsting_development
listings-exposure-exl01 👶 $+0.04$ listings_exposure_exl01.qmd_lsting_development
listings-lab-results-lbl01 👶 $+0.04$ listings_lab_results_lbl01.qmd_lsting_development
listings-lab-results-lbl01_rls 👶 $+0.04$ listings_lab_results_lbl01_rls.qmd_lsting_development
listings-lab-results-lbl02a 👶 $+0.04$ listings_lab_results_lbl02a.qmd_lsting_development
listings-lab-results-lbl02a_rls 👶 $+0.06$ listings_lab_results_lbl02a_rls.qmd_lsting_development
listings-lab-results-lbl02b 👶 $+0.04$ listings_lab_results_lbl02b.qmd_lsting_development
listings-medical-history-mhl01 👶 $+0.05$ listings_medical_history_mhl01.qmd_lsting_development
listings-pharmacokinetic-pkcl01 👶 $+0.04$ listings_pharmacokinetic_pkcl01.qmd_lsting_development
listings-pharmacokinetic-pkcl02 👶 $+0.06$ listings_pharmacokinetic_pkcl02.qmd_lsting_development
listings-pharmacokinetic-pkpl01 👶 $+0.04$ listings_pharmacokinetic_pkpl01.qmd_lsting_development
listings-pharmacokinetic-pkpl02 👶 $+0.04$ listings_pharmacokinetic_pkpl02.qmd_lsting_development
listings-pharmacokinetic-pkpl04 👶 $+0.06$ listings_pharmacokinetic_pkpl04.qmd_lsting_development
listings-vital-signs-vsl01 👶 $+0.06$ listings_vital_signs_vsl01.qmd_lsting_development
markdown-snaps 💀 $1.32$ $-1.32$ lsting
markdown-snaps 💀 $26.21$ $-26.21$ result_v1
markdown-snaps 💀 $0.17$ $-0.17$ result_v10
markdown-snaps 💀 $0.46$ $-0.46$ result_v11
markdown-snaps 💀 $0.10$ $-0.10$ result_v12
markdown-snaps 💀 $0.08$ $-0.08$ result_v13
markdown-snaps 💀 $8.83$ $-8.83$ result_v2
markdown-snaps 💀 $5.69$ $-5.69$ result_v3
markdown-snaps 💀 $4.58$ $-4.58$ result_v4
markdown-snaps 💀 $2.59$ $-2.59$ result_v5
markdown-snaps 💀 $0.92$ $-0.92$ result_v6
markdown-snaps 💀 $0.22$ $-0.22$ result_v7
markdown-snaps 💀 $0.69$ $-0.69$ result_v8
markdown-snaps 💀 $0.48$ $-0.48$ result_v9
tables-ADA-adat01 👶 $+0.21$ tables_ADA_adat01.qmd_result_v1_development
tables-ADA-adat02 👶 $+0.07$ tables_ADA_adat02.qmd_result_v1_development
tables-ADA-adat03 👶 $+0.30$ tables_ADA_adat03.qmd_result_v1_development
tables-ADA-adat04a 👶 $+0.17$ tables_ADA_adat04a.qmd_result_v1_development
tables-ADA-adat04b 👶 $+0.16$ tables_ADA_adat04b.qmd_result_v1_development
tables-ECG-egt01 👶 $+0.54$ tables_ECG_egt01.qmd_result_v1_development
tables-ECG-egt02 👶 $+0.07$ tables_ECG_egt02.qmd_result_v1_development
tables-ECG-egt02 👶 $+0.06$ tables_ECG_egt02.qmd_result_v2_development
tables-ECG-egt03 👶 $+1.21$ tables_ECG_egt03.qmd_result_v1_development
tables-ECG-egt03 👶 $+0.10$ tables_ECG_egt03.qmd_result_v2_development
tables-ECG-egt04 👶 $+0.17$ tables_ECG_egt04.qmd_result_v1_development
tables-ECG-egt05_qtcat 👶 $+0.28$ tables_ECG_egt05_qtcat.qmd_result_v1_development
tables-adverse-events-aet01 👶 $+0.12$ tables_adverse_events_aet01.qmd_result_v1_development
tables-adverse-events-aet01 👶 $+0.12$ tables_adverse_events_aet01.qmd_result_v2_development
tables-adverse-events-aet01 👶 $+0.08$ tables_adverse_events_aet01.qmd_result_v3_development
tables-adverse-events-aet01 👶 $+0.11$ tables_adverse_events_aet01.qmd_result_v4_development
tables-adverse-events-aet01_aesi 👶 $+0.12$ tables_adverse_events_aet01_aesi.qmd_result_v1_development
tables-adverse-events-aet01_aesi 👶 $+0.15$ tables_adverse_events_aet01_aesi.qmd_result_v2_development
tables-adverse-events-aet01_aesi 👶 $+0.20$ tables_adverse_events_aet01_aesi.qmd_result_v3_development
tables-adverse-events-aet01_aesi 👶 $+0.15$ tables_adverse_events_aet01_aesi.qmd_result_v4_development
tables-adverse-events-aet02 👶 $+0.09$ tables_adverse_events_aet02.qmd_result_v10_development
tables-adverse-events-aet02 👶 $+0.07$ tables_adverse_events_aet02.qmd_result_v11_development
tables-adverse-events-aet02 👶 $+0.09$ tables_adverse_events_aet02.qmd_result_v12_development
tables-adverse-events-aet02 👶 $+0.08$ tables_adverse_events_aet02.qmd_result_v13_development
tables-adverse-events-aet02 👶 $+0.31$ tables_adverse_events_aet02.qmd_result_v1_development
tables-adverse-events-aet02 👶 $+0.17$ tables_adverse_events_aet02.qmd_result_v2_development
tables-adverse-events-aet02 👶 $+0.18$ tables_adverse_events_aet02.qmd_result_v3_development
tables-adverse-events-aet02 👶 $+0.25$ tables_adverse_events_aet02.qmd_result_v4_development
tables-adverse-events-aet02 👶 $+0.09$ tables_adverse_events_aet02.qmd_result_v5_development
tables-adverse-events-aet02 👶 $+0.15$ tables_adverse_events_aet02.qmd_result_v6_development
tables-adverse-events-aet02 👶 $+0.09$ tables_adverse_events_aet02.qmd_result_v7_development
tables-adverse-events-aet02 👶 $+0.13$ tables_adverse_events_aet02.qmd_result_v8_development
tables-adverse-events-aet02 👶 $+0.09$ tables_adverse_events_aet02.qmd_result_v9_development
tables-adverse-events-aet02_smq 👶 $+0.07$ tables_adverse_events_aet02_smq.qmd_result_v1_development
tables-adverse-events-aet02_smq 👶 $+0.08$ tables_adverse_events_aet02_smq.qmd_result_v2_development
tables-adverse-events-aet03 👶 $+0.34$ tables_adverse_events_aet03.qmd_result_v1_development
tables-adverse-events-aet04 👶 $+0.36$ tables_adverse_events_aet04.qmd_result_v11_development
tables-adverse-events-aet04 👶 $+0.60$ tables_adverse_events_aet04.qmd_result_v1_development
tables-adverse-events-aet04 👶 $+0.36$ tables_adverse_events_aet04.qmd_result_v2_development
tables-adverse-events-aet04 👶 $+0.68$ tables_adverse_events_aet04.qmd_result_v3_development
tables-adverse-events-aet04 👶 $+0.37$ tables_adverse_events_aet04.qmd_result_v4_development
tables-adverse-events-aet04 👶 $+0.35$ tables_adverse_events_aet04.qmd_result_v6_development
tables-adverse-events-aet04 👶 $+0.35$ tables_adverse_events_aet04.qmd_result_v8_development
tables-adverse-events-aet04 👶 $+0.47$ tables_adverse_events_aet04.qmd_result_v9_development
tables-adverse-events-aet04_pi 👶 $+0.70$ tables_adverse_events_aet04_pi.qmd_result_v1_development
tables-adverse-events-aet04_pi 👶 $+0.08$ tables_adverse_events_aet04_pi.qmd_result_v2_development
tables-adverse-events-aet04_pi 👶 $+0.11$ tables_adverse_events_aet04_pi.qmd_result_v3_development
tables-adverse-events-aet04_pi 👶 $+0.07$ tables_adverse_events_aet04_pi.qmd_result_v4_development
tables-adverse-events-aet04_pi 👶 $+0.13$ tables_adverse_events_aet04_pi.qmd_result_v5_development
tables-adverse-events-aet04_pi 👶 $+0.11$ tables_adverse_events_aet04_pi.qmd_result_v6_development
tables-adverse-events-aet04_pi 👶 $+0.11$ tables_adverse_events_aet04_pi.qmd_result_v7_development
tables-adverse-events-aet04_pi 👶 $+0.13$ tables_adverse_events_aet04_pi.qmd_result_v8_development
tables-adverse-events-aet05 👶 $+0.05$ tables_adverse_events_aet05.qmd_result_v1_development
tables-adverse-events-aet05 👶 $+0.05$ tables_adverse_events_aet05.qmd_result_v2_development
tables-adverse-events-aet05_all 👶 $+0.07$ tables_adverse_events_aet05_all.qmd_result_v1_development
tables-adverse-events-aet05_all 👶 $+0.05$ tables_adverse_events_aet05_all.qmd_result_v2_development
tables-adverse-events-aet06 👶 $+0.80$ tables_adverse_events_aet06.qmd_result_v1_development
tables-adverse-events-aet06 👶 $+0.24$ tables_adverse_events_aet06.qmd_result_v2_development
tables-adverse-events-aet06 👶 $+0.29$ tables_adverse_events_aet06.qmd_result_v3_development
tables-adverse-events-aet06 👶 $+0.20$ tables_adverse_events_aet06.qmd_result_v4_development
tables-adverse-events-aet06 👶 $+0.32$ tables_adverse_events_aet06.qmd_result_v5_development
tables-adverse-events-aet06_smq 👶 $+0.11$ tables_adverse_events_aet06_smq.qmd_result_v1_development
tables-adverse-events-aet06_smq 👶 $+0.11$ tables_adverse_events_aet06_smq.qmd_result_v2_development
tables-adverse-events-aet06_smq 👶 $+0.09$ tables_adverse_events_aet06_smq.qmd_result_v3_development
tables-adverse-events-aet07 👶 $+0.05$ tables_adverse_events_aet07.qmd_result_v1_development
tables-adverse-events-aet07 👶 $+0.04$ tables_adverse_events_aet07.qmd_result_v2_development
tables-adverse-events-aet09 👶 $+0.14$ tables_adverse_events_aet09.qmd_result_v1_development
tables-adverse-events-aet09 👶 $+0.17$ tables_adverse_events_aet09.qmd_result_v2_development
tables-adverse-events-aet09_smq 👶 $+0.06$ tables_adverse_events_aet09_smq.qmd_result_v1_development
tables-adverse-events-aet09_smq 👶 $+0.08$ tables_adverse_events_aet09_smq.qmd_result_v2_development
tables-adverse-events-aet10 👶 $+0.10$ tables_adverse_events_aet10.qmd_result_v1_development
tables-adverse-events-aet10 👶 $+0.07$ tables_adverse_events_aet10.qmd_result_v2_development
tables-concomitant-medications-cmt01 👶 $+0.12$ tables_concomitant_medications_cmt01.qmd_result_v1_development
tables-concomitant-medications-cmt01 👶 $+0.08$ tables_concomitant_medications_cmt01.qmd_result_v2_development
tables-concomitant-medications-cmt01 👶 $+0.08$ tables_concomitant_medications_cmt01.qmd_result_v3_development
tables-concomitant-medications-cmt01 👶 $+0.10$ tables_concomitant_medications_cmt01.qmd_result_v4_development
tables-concomitant-medications-cmt01a 👶 $+0.22$ tables_concomitant_medications_cmt01a.qmd_result_v1_development
tables-concomitant-medications-cmt01a 👶 $+0.16$ tables_concomitant_medications_cmt01a.qmd_result_v2_development
tables-concomitant-medications-cmt01a 👶 $+0.16$ tables_concomitant_medications_cmt01a.qmd_result_v3_development
tables-concomitant-medications-cmt01a 👶 $+0.14$ tables_concomitant_medications_cmt01a.qmd_result_v4_development
tables-concomitant-medications-cmt01b 👶 $+0.33$ tables_concomitant_medications_cmt01b.qmd_result_v1_development
tables-concomitant-medications-cmt01b 👶 $+0.19$ tables_concomitant_medications_cmt01b.qmd_result_v2_development
tables-concomitant-medications-cmt01b 👶 $+0.27$ tables_concomitant_medications_cmt01b.qmd_result_v4_development
tables-concomitant-medications-cmt02_pt 👶 $+0.08$ tables_concomitant_medications_cmt02_pt.qmd_result_v1_development
tables-deaths-dtht01 👶 $+0.19$ tables_deaths_dtht01.qmd_result_v1_development
tables-deaths-dtht01 👶 $+0.13$ tables_deaths_dtht01.qmd_result_v2_development
tables-deaths-dtht01 👶 $+0.07$ tables_deaths_dtht01.qmd_result_v3_development
tables-deaths-dtht01 👶 $+0.09$ tables_deaths_dtht01.qmd_result_v4_development
tables-demography-dmt01 👶 $+0.21$ tables_demography_dmt01.qmd_result_v1_development
tables-demography-dmt01 👶 $+0.16$ tables_demography_dmt01.qmd_result_v2_development
tables-demography-dmt01 👶 $+0.14$ tables_demography_dmt01.qmd_result_v3_development
tables-demography-dmt01 👶 $+0.13$ tables_demography_dmt01.qmd_result_v4_development
tables-demography-dmt01 👶 $+0.12$ tables_demography_dmt01.qmd_result_v5_development
tables-disclosures-disclosurest01 👶 $+0.14$ tables_disclosures_disclosurest01.qmd_result_v1_development
tables-disclosures-disclosurest01 👶 $+0.22$ tables_disclosures_disclosurest01.qmd_result_v2_development
tables-disclosures-disclosurest01 👶 $+0.08$ tables_disclosures_disclosurest01.qmd_result_v3_development
tables-disclosures-disclosurest01 👶 $+0.10$ tables_disclosures_disclosurest01.qmd_result_v4_development
tables-disclosures-disclosurest01 👶 $+0.07$ tables_disclosures_disclosurest01.qmd_result_v5_development
tables-disclosures-disclosurest01 👶 $+0.04$ tables_disclosures_disclosurest01.qmd_result_v6_development
tables-disclosures-eudrat01 👶 $+0.14$ tables_disclosures_eudrat01.qmd_result_v1_development
tables-disclosures-eudrat02 👶 $+0.08$ tables_disclosures_eudrat02.qmd_result_v1_development
tables-disposition-dst01 👶 $+0.16$ tables_disposition_dst01.qmd_result_v1_development
tables-disposition-dst01 👶 $+0.09$ tables_disposition_dst01.qmd_result_v2_development
tables-disposition-dst01 👶 $+0.12$ tables_disposition_dst01.qmd_result_v3_development
tables-disposition-pdt01 👶 $+0.15$ tables_disposition_pdt01.qmd_result_v1_development
tables-disposition-pdt02 👶 $+0.07$ tables_disposition_pdt02.qmd_result_v1_development
tables-efficacy-aovt01 👶 $+0.57$ tables_efficacy_aovt01.qmd_result_v1_development
tables-efficacy-aovt02 👶 $+0.18$ tables_efficacy_aovt02.qmd_result_v1_development
tables-efficacy-aovt03 👶 $+1.00$ tables_efficacy_aovt03.qmd_result_v1_development
tables-efficacy-cfbt01 👶 $+0.20$ tables_efficacy_cfbt01.qmd_result_v1_development
tables-efficacy-cmht01 👶 $+1.87$ tables_efficacy_cmht01.qmd_result_v1_development
tables-efficacy-cmht01 👶 $+0.25$ tables_efficacy_cmht01.qmd_result_v2_development
tables-efficacy-coxt01 👶 $+0.14$ tables_efficacy_coxt01.qmd_result_v1_development
tables-efficacy-coxt01 👶 $+0.09$ tables_efficacy_coxt01.qmd_result_v2_development
tables-efficacy-coxt01 👶 $+0.09$ tables_efficacy_coxt01.qmd_result_v3_development
tables-efficacy-coxt01 👶 $+0.08$ tables_efficacy_coxt01.qmd_result_v4_development
tables-efficacy-coxt02 👶 $+0.08$ tables_efficacy_coxt02.qmd_result_v1_development
tables-efficacy-coxt02 👶 $+0.06$ tables_efficacy_coxt02.qmd_result_v2_development
tables-efficacy-dort01 👶 $+0.90$ tables_efficacy_dort01.qmd_result_v1_development
tables-efficacy-dort01 👶 $+0.08$ tables_efficacy_dort01.qmd_result_v2_development
tables-efficacy-dort01 👶 $+0.09$ tables_efficacy_dort01.qmd_result_v3_development
tables-efficacy-dort01 👶 $+0.09$ tables_efficacy_dort01.qmd_result_v4_development
tables-efficacy-lgrt02 👶 $+0.17$ tables_efficacy_lgrt02.qmd_result_v1_development
tables-efficacy-lgrt02 👶 $+0.16$ tables_efficacy_lgrt02.qmd_result_v2_development
tables-efficacy-lgrt02 👶 $+0.12$ tables_efficacy_lgrt02.qmd_result_v3_development
tables-efficacy-lgrt02 👶 $+0.14$ tables_efficacy_lgrt02.qmd_result_v4_development
tables-efficacy-mmrmt01 👶 $+0.20$ tables_efficacy_mmrmt01.qmd_result_v1_development
tables-efficacy-mmrmt01 👶 $+0.08$ tables_efficacy_mmrmt01.qmd_result_v2_development
tables-efficacy-mmrmt01 👶 $+0.23$ tables_efficacy_mmrmt01.qmd_result_v3_development
tables-efficacy-onct05 👶 $+0.19$ tables_efficacy_onct05.qmd_result_v1_development
tables-efficacy-onct05 👶 $+0.09$ tables_efficacy_onct05.qmd_result_v2_development
tables-efficacy-onct05 👶 $+0.09$ tables_efficacy_onct05.qmd_result_v3_development
tables-efficacy-onct05 👶 $+0.09$ tables_efficacy_onct05.qmd_result_v4_development
tables-efficacy-ratet01 👶 $+0.26$ tables_efficacy_ratet01.qmd_result_v1_development
tables-efficacy-rbmit01 👶 $+0.11$ tables_efficacy_rbmit01.qmd_result_v1_development
tables-efficacy-rspt01 👶 $+0.44$ tables_efficacy_rspt01.qmd_result_v1_development
tables-efficacy-rspt01 👶 $+0.11$ tables_efficacy_rspt01.qmd_result_v2_development
tables-efficacy-rspt01 👶 $+0.09$ tables_efficacy_rspt01.qmd_result_v3_development
tables-efficacy-rspt01 👶 $+0.11$ tables_efficacy_rspt01.qmd_result_v4_development
tables-efficacy-rspt01 👶 $+0.10$ tables_efficacy_rspt01.qmd_result_v5_development
tables-efficacy-rspt01 👶 $+0.09$ tables_efficacy_rspt01.qmd_result_v6_development
tables-efficacy-ttet01 👶 $+1.21$ tables_efficacy_ttet01.qmd_result_v1_development
tables-efficacy-ttet01 👶 $+0.12$ tables_efficacy_ttet01.qmd_result_v2_development
tables-efficacy-ttet01 👶 $+0.15$ tables_efficacy_ttet01.qmd_result_v3_development
tables-efficacy-ttet01 👶 $+0.13$ tables_efficacy_ttet01.qmd_result_v4_development
tables-efficacy-ttet01 👶 $+0.23$ tables_efficacy_ttet01.qmd_result_v5_development
tables-efficacy-ttet01 👶 $+0.13$ tables_efficacy_ttet01.qmd_result_v6_development
tables-exposure-ext01 👶 $+0.22$ tables_exposure_ext01.qmd_result_v1_development
tables-exposure-ext01 👶 $+0.18$ tables_exposure_ext01.qmd_result_v2_development
tables-exposure-ext01 👶 $+0.22$ tables_exposure_ext01.qmd_result_v3_development
tables-lab-results-lbt01 👶 $+0.21$ tables_lab_results_lbt01.qmd_result_v1_development
tables-lab-results-lbt02 👶 $+0.16$ tables_lab_results_lbt02.qmd_result_v1_development
tables-lab-results-lbt03 👶 $+0.15$ tables_lab_results_lbt03.qmd_result_v1_development
tables-lab-results-lbt03 👶 $+0.13$ tables_lab_results_lbt03.qmd_result_v2_development
tables-lab-results-lbt04 👶 $+0.07$ tables_lab_results_lbt04.qmd_result_v1_development
tables-lab-results-lbt05 👶 $+0.15$ tables_lab_results_lbt05.qmd_result_v1_development
tables-lab-results-lbt05 👶 $+0.13$ tables_lab_results_lbt05.qmd_result_v2_development
tables-lab-results-lbt05 👶 $+0.11$ tables_lab_results_lbt05.qmd_result_v4_development
tables-lab-results-lbt06 👶 $+0.24$ tables_lab_results_lbt06.qmd_result_v1_development
tables-lab-results-lbt06 👶 $+0.48$ tables_lab_results_lbt06.qmd_result_v2_development
tables-lab-results-lbt07 👶 $+0.16$ tables_lab_results_lbt07.qmd_result_v1_development
tables-lab-results-lbt08 👶 $+0.14$ tables_lab_results_lbt08.qmd_result_v1_development
tables-lab-results-lbt09 👶 $+0.33$ tables_lab_results_lbt09.qmd_result_v1_development
tables-lab-results-lbt09 👶 $+0.18$ tables_lab_results_lbt09.qmd_result_v2_development
tables-lab-results-lbt10 👶 $+0.07$ tables_lab_results_lbt10.qmd_result_v1_development
tables-lab-results-lbt10 👶 $+0.05$ tables_lab_results_lbt10.qmd_result_v2_development
tables-lab-results-lbt10_bl 👶 $+0.08$ tables_lab_results_lbt10_bl.qmd_result_v1_development
tables-lab-results-lbt10_bl 👶 $+0.05$ tables_lab_results_lbt10_bl.qmd_result_v2_development
tables-lab-results-lbt11 👶 $+0.31$ tables_lab_results_lbt11.qmd_result_v1_development
tables-lab-results-lbt11 👶 $+0.07$ tables_lab_results_lbt11.qmd_result_v2_development
tables-lab-results-lbt11 👶 $+0.11$ tables_lab_results_lbt11.qmd_result_v3_development
tables-lab-results-lbt11_bl 👶 $+0.31$ tables_lab_results_lbt11_bl.qmd_result_v1_development
tables-lab-results-lbt11_bl 👶 $+0.07$ tables_lab_results_lbt11_bl.qmd_result_v2_development
tables-lab-results-lbt11_bl 👶 $+0.10$ tables_lab_results_lbt11_bl.qmd_result_v3_development
tables-lab-results-lbt12 👶 $+0.14$ tables_lab_results_lbt12.qmd_result_v1_development
tables-lab-results-lbt12_bl 👶 $+0.09$ tables_lab_results_lbt12_bl.qmd_result_v1_development
tables-lab-results-lbt13 👶 $+0.74$ tables_lab_results_lbt13.qmd_result_v1_development
tables-lab-results-lbt13 👶 $+0.48$ tables_lab_results_lbt13.qmd_result_v2_development
tables-lab-results-lbt13 👶 $+0.48$ tables_lab_results_lbt13.qmd_result_v3_development
tables-lab-results-lbt13 👶 $+0.49$ tables_lab_results_lbt13.qmd_result_v4_development
tables-lab-results-lbt13 👶 $+0.90$ tables_lab_results_lbt13.qmd_result_v5_development
tables-lab-results-lbt14 👶 $+0.39$ tables_lab_results_lbt14.qmd_result_v1_development
tables-lab-results-lbt14 👶 $+0.27$ tables_lab_results_lbt14.qmd_result_v2_development
tables-lab-results-lbt14 👶 $+0.27$ tables_lab_results_lbt14.qmd_result_v3_development
tables-lab-results-lbt14 👶 $+0.27$ tables_lab_results_lbt14.qmd_result_v4_development
tables-lab-results-lbt14 👶 $+0.61$ tables_lab_results_lbt14.qmd_result_v5_development
tables-lab-results-lbt15 👶 $+0.10$ tables_lab_results_lbt15.qmd_result_v1_development
tables-lab-results-lbt15 👶 $+0.10$ tables_lab_results_lbt15.qmd_result_v2_development
tables-medical-history-mht01 👶 $+0.16$ tables_medical_history_mht01.qmd_result_v1_development
tables-medical-history-mht01 👶 $+0.06$ tables_medical_history_mht01.qmd_result_v2_development
tables-medical-history-mht01 👶 $+0.12$ tables_medical_history_mht01.qmd_result_v3_development
tables-medical-history-mht01 👶 $+0.14$ tables_medical_history_mht01.qmd_result_v4_development
tables-pharmacokinetic-pkct01 👶 $+0.48$ tables_pharmacokinetic_pkct01.qmd_result_v1_development
tables-pharmacokinetic-pkct01 👶 $+0.15$ tables_pharmacokinetic_pkct01.qmd_result_v2_development
tables-pharmacokinetic-pkct01 👶 $+0.46$ tables_pharmacokinetic_pkct01.qmd_result_v3_development
tables-pharmacokinetic-pkpt02 👶 $+0.13$ tables_pharmacokinetic_pkpt02.qmd_result_v1_development
tables-pharmacokinetic-pkpt02 👶 $+0.09$ tables_pharmacokinetic_pkpt02.qmd_result_v2_development
tables-pharmacokinetic-pkpt03 👶 $+1.72$ tables_pharmacokinetic_pkpt03.qmd_result_v1_development
tables-pharmacokinetic-pkpt03 👶 $+0.01$ tables_pharmacokinetic_pkpt03.qmd_result_v2_development
tables-pharmacokinetic-pkpt03 👶 $+0.01$ tables_pharmacokinetic_pkpt03.qmd_result_v3_development
tables-pharmacokinetic-pkpt04 👶 $+0.16$ tables_pharmacokinetic_pkpt04.qmd_result_v1_development
tables-pharmacokinetic-pkpt04 👶 $+0.11$ tables_pharmacokinetic_pkpt04.qmd_result_v2_development
tables-pharmacokinetic-pkpt05 👶 $+0.15$ tables_pharmacokinetic_pkpt05.qmd_result_v1_development
tables-pharmacokinetic-pkpt05 👶 $+0.09$ tables_pharmacokinetic_pkpt05.qmd_result_v2_development
tables-pharmacokinetic-pkpt06 👶 $+0.07$ tables_pharmacokinetic_pkpt06.qmd_result_v1_development
tables-pharmacokinetic-pkpt06 👶 $+0.05$ tables_pharmacokinetic_pkpt06.qmd_result_v2_development
tables-pharmacokinetic-pkpt07 👶 $+0.08$ tables_pharmacokinetic_pkpt07.qmd_result_v1_development
tables-pharmacokinetic-pkpt07 👶 $+0.06$ tables_pharmacokinetic_pkpt07.qmd_result_v2_development
tables-pharmacokinetic-pkpt08 👶 $+0.12$ tables_pharmacokinetic_pkpt08.qmd_result_v1_development
tables-pharmacokinetic-pkpt11 👶 $+0.06$ tables_pharmacokinetic_pkpt11.qmd_result_v1_development
tables-risk-management-plan-rmpt01 👶 $+0.05$ tables_risk_management_plan_rmpt01.qmd_result_v1_development
tables-risk-management-plan-rmpt03 👶 $+0.10$ tables_risk_management_plan_rmpt03.qmd_result_v1_development
tables-risk-management-plan-rmpt03 👶 $+0.06$ tables_risk_management_plan_rmpt03.qmd_result_v2_development
tables-risk-management-plan-rmpt04 👶 $+0.05$ tables_risk_management_plan_rmpt04.qmd_result_v1_development
tables-risk-management-plan-rmpt05 👶 $+0.06$ tables_risk_management_plan_rmpt05.qmd_result_v1_development
tables-risk-management-plan-rmpt06 👶 $+0.16$ tables_risk_management_plan_rmpt06.qmd_result_v1_development
tables-risk-management-plan-rmpt06 👶 $+0.07$ tables_risk_management_plan_rmpt06.qmd_result_v2_development
tables-risk-management-plan-rmpt06 👶 $+0.11$ tables_risk_management_plan_rmpt06.qmd_result_v3_development
tables-risk-management-plan-rmpt06 👶 $+0.10$ tables_risk_management_plan_rmpt06.qmd_result_v4_development
tables-safety-enrollment01 👶 $+0.73$ tables_safety_enrollment01.qmd_result_v1_development
tables-safety-enrollment01 👶 $+0.75$ tables_safety_enrollment01.qmd_result_v2_development
tables-safety-enrollment01 👶 $+0.52$ tables_safety_enrollment01.qmd_result_v3_development
tables-safety-enrollment01 👶 $+0.47$ tables_safety_enrollment01.qmd_result_v4_development
tables-vital-signs-vst01 👶 $+0.31$ tables_vital_signs_vst01.qmd_result_v1_development
tables-vital-signs-vst02 👶 $+0.12$ tables_vital_signs_vst02.qmd_result_v1_development
tables-vital-signs-vst02 👶 $+0.11$ tables_vital_signs_vst02.qmd_result_v2_development

Results for commit 8bbf8b5

♻️ This comment has been updated with latest results.

Copy link
Contributor

@edelarua edelarua left a comment

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

Looks great! The clearer messaging and separation in the test output is much nicer :) Thanks @pawelru!!

@shajoezhu
Copy link
Contributor

hi @khatril , please have a look what pawel wrote, and overall objective for this pr. :)

@pawelru
Copy link
Contributor Author

pawelru commented Mar 8, 2024

This PR awaits updates of docker image - we need to have quarto >= 1.4 (a package not the tool). This is being in progress now.

@pawelru
Copy link
Contributor Author

pawelru commented Mar 11, 2024

OK so this is green and approved so I can merge it but I think it would be better to merge #202 first and then I will update affected snapshots in this PR. Therefore, I kindly ask you to make a review of aforementioned PR :)

@pawelru pawelru merged commit 168ee7e into main Mar 12, 2024
18 checks passed
@pawelru pawelru deleted the snapshot_testing branch March 12, 2024 14:04
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Labels
None yet
Projects
None yet
Development

Successfully merging this pull request may close these issues.

4 participants