distributed training bug fix, to maintain same order for mem queue fo… #402

Job	Run time
call-base-test-workflow / build (3.8, 1.6, 0.7)	2m 27s
call-base-test-workflow / build (3.9, 2.1, 0.16)	3m 0s
	5m 27s

Provide feedback