Results and Observations

Benchmarking

This shows the comparision of Shot and Paparazzi screenshot libraries. Tests are run on design module.

Design module has 14 Previews.
Showkase is used along with shot or paparazzi, which allows shot / paparazzi to take screenshots of the Previews.

In both the cases, there are 56 tests run.
i.e, 14 Previews, each run on Dark & Light theme and RTL & LTR layout directions.
14 x 2 X 2 = 56 tests

Paparazzi & Showkase results

Iterations	Clean & Record	Record Again	Verify	Clean & Verify	Change & Verify	Record
1	1m 10s	3s	3s	46s	36s	27s

Shot & Showkase results

Iterations	Clean & Record	Record Again	Verify	Clean & Verify	Change & Verify	Record
1	2m 51s	2m 15s	2m 42s	3m 20s	2m 31s	2m 28s

Decision

Observations