Expose more arguments to dataloader

[anton-emanuel]

Summary

I have noticed differences in data loading speeds by varying persistent_workers, pin_memory, and prefetch_factor. In the dataloader. I saw that persistent_workers has already been enabled when num_workers>1 (#2291). Would it be possible to let more arguments than num_workers be configurable in datamodules?

Rationale

It enables faster data loading in some cases.

Implementation

Let pin_memory and prefetch_factor be configurable like num_workers. See #2333.

Alternatives

Maybe not so nice with many additional arguments to datamodule. Is there any way to get around that?

Additional information

No response