Skip to content

Releases: theBeginner86/triton-perf

Triton Perf v0.1.0

11 Jan 12:26
Compare
Choose a tag to compare
  1. Support for batching requests
  2. Custom concurrent requests
  3. Loading Custom dataset
  4. Supports any ASR model
  5. Output latency mapped to datapoint spitted as csv