model running speed

#4
by gangqiang03 - opened

Hi,Could you please share with me how fast does lama _fp32.onnx model runs using TensorRT plz? I want to know if this model could run at 20 FPS on Nvidia TensorRT devices, Much thanks.

Sign up or log in to comment