modifiy cache path rule for pretrain datasets to fix bug#285

Open

ba5bo wants to merge 1 commit intoyangjianxin1:masterfrom ba5bo:ba5bo-mr-share

+5-2

Commits on Jul 16, 2024

modifiy cache path rule for pretrain datasets to support different model and redo tokenizer when source file changed .

mr
authored and
ba5bo
committed