How to pre-train the pegasus language model?

[CountingMstar]

Hello every one. I am a master course student in AI. As a researcher, I want to make better language model in the text summarization field. To do this, I want to know how pre-train the pegasus model. In this repo is very good but I don't know about this. If you know about that how to pre-train the model for the text summraization(pegasus, bart ect) please let me know. Thanks.