Share caches across worker implementations

[matt-boris]

So long as the docker worker task is submitted to a generic worker pool (and being translated via d2g), I think it'd make sense to be able to share these docker worker caches with generic worker tasks as well.

I believe there's some renaming of the cache that happens inside taskgraph that's currently making it so generic worker and docker worker tasks cannot share caches.

[jcristau]

I'm curious about the use case for this, can you elaborate?

[matt-boris]

Yeah, so I've added checkout caches to taskcluster's CI and we use a mix of both generic worker and docker worker implementations (to better integrate in with taskgraph, for example the build docker image tasks I believe need to be docker worker). So I'd love for a checkout cache to be shared across all of these cases, since generic worker is what's handling all of our CI tasks.

taskcluster/taskcluster#7540

[ahal]

Isn't a pool either D2G or not though? Or can the same workers run a mix of tasks?

[matt-boris]

Or can the same workers run a mix of tasks?

Yes, this is how we have our pools set up in community, at least. I believe all of our generic worker pools have d2g enabled, by default. So they all can accept both task payloads.