github:ethanrise/dsh-model-deploy
devgit
Inspects ONNX models (inputs/outputs, shapes, opset, operators, size) and benchmarks them with ONNX Runtime on the local machine or on a remote target over SSH, reporting average/P50/P95/P99 latency, FPS and the execution provider actually used, with PASS/FAIL gates for FPS, P95 latency and model si
下载量 / Downloads
0
Install
dsh plugin --profile web add github:ethanrise/dsh-model-deploy
Sandbox test
This plugin has not been tested yet. Submit a test →