I suspect it depends on whether you see it as just viewing a flat picture, or as actually seeing from the rover's perspective. Personally, I see it as the latter, so I would actually find it unintuitive if the controls were reversed.

It's kind of funny how such a seemingly irrelevant semantic argument gives a completely opposite implementation.