Training so slow~~~

[YangParky]

Hi，Thank you very much for your efforts, but when I ran it with three graphics cards, it took a very long time to run, and the GPU utilization did not reach 100%, and was 0% most of the time.

[auniquesun]

how long did you take to pre-train 300 epochs? I use 6 2080Ti GPUs and the time is about 7 hours. I think the time duration is reasonable for me.