Perhaps too slow. On the M4 you can use all 3 cameras on USB 3.0, or use a USB 3.0 Hat for the M4. If you use USB2.0, all three cameras combined are limited to the speed of a single USB2 connection.
The specs for that camera do not say how fast it is on USB2 or USB3. It is pretty costly. I have been experimenting with one of the FriendlyELEC cameras (MIPI/CSI not USB) and low light/IR is pretty interesting