Client side, we've already done it (we have a Raspberry Pi client that actually works well, but still needs a bit of polish.).
Server side I'm not sure. I know the Windows API for grabbing frames is really good, and I assume there's a similar API for Linux. Shouldn't be too bad. But you will likely see a macOS server first...