Plugins

Inspects ONNX models (inputs/outputs, shapes, opset, operators, size) and benchmarks them with ONNX Runtime on the local machine or on a remote target over SSH, reporting average/P50/P95/P99 latency, FPS and the execution provider actually used, with PASS/FAIL gates for FPS, P95 latency and model size. Requires Python 3.10+ with numpy, onnx, onnxruntime, and psutil installed (pip install numpy onnx onnxruntime psutil); remote targets need python3, numpy, and onnxruntime.