Does it support TF and Pytorch?

[josephykwang]

How much rewrite is required for existing TF and Pytorch models?
Are the models compatible with TF Serve, TorchServe, or Nvidia Triton?

[FrankLeeeee]

If it is a transformer model, you can directly copy the transformer layer from Titans. It is compatible with torch serve/nvidia triton if it runs on a single GPU. If it needs to run on multiple GPUs, you can look at EnergonAI.

[FrankLeeeee]

This project is built upon PyTorch, thus it requires more efforts to migrate from TF to PyTorch.