it corresponds to the calculation time in milliseconds. The accuracy of the neural network usually correlates with the inference time, i.e. the more time is allowed for a decision, the more accurate the neural network can operate.
@mircsicz frigate with hw acceleration and npu object detection works nicely on joshua’s ubuntu 24.04 for me. i have inference speeds between 25 to 40 ms. i believe it would be same on armbian.