GPU Inferencing using GGML

[saakethch]

Is your feature request related to a problem? Please describe.
No problems, Would be much better if we have a gpu inference run time as it will be much much faster.
Describe the solution you'd like
Using GGML might help as it deal with cpp code.
Describe alternatives you've considered
Am not entirely sure if the approach is correct. But please do let me know if the team is doing so
Additional context
Add any other context or screenshots about the feature request here.

[squidarth]

Hey @saakethch -- could you please elaborate a little on where you are trying to run your model? And then what GGML model are you trying to run? Do you have a truss that you are trying to use?