Tag: model inference

All the articles with the tag "model inference".

• Model Size vs. Inference Speed in Deep Learning

  4 Mar, 2022

  An examination of how FLOPs, parameter count, memory access volume, and memory footprint affect inference speed, with practical network design recommendations for different hardware platforms.