Template Testing

[psimk]

To improve the reliability of our templates, we need to make sure that they are properly tested before publishing. Currently this is a tedious and error prone manual process of running whatever npm scripts are included in the project and testing the template against each of the scripts packages that it supports.

We need a way to automate this, so that we can quickly and easily confirm that a template is working as expected; the solution should also be something that we can easily reuse in a CI/CD tool (#2).

What exactly needs to be tested?

For each template we need to test the following things:

1. a fresh npm install without package-lock.json
2. running each npm script
   • this is both easy and complicated - some scripts might throw an error, while for others, like plop, we need to confirm that they successfully accomplished their task
3. running the template against every support scripts package

3 is the only one that I would consider "up in the air", as we might want to do the reverse for scripts packages - testing a script package for each template that it should support.