What sort of latencies did you see in this project while the car was running? Specifically, from the point where you have access to the camera's preview buffer to encoding it, sending it, running it through the neural network, and sending the button bits to the microcontroller.
A great question - I haven't actually measured it directly, but it's probably < 200ms (video feels 'live' when you watch it). The prediction step takes circa 20ms on a MacBook Air and the serial port runs at 9600 baud and needs to send a single byte, which will propagate very quickly. I'll see what instrumentation I can add to the video frame -> computer via wifi step.
