This is why I chose not to provide real-time analytics for Instahero[1]. Apart from being very constraining, implementation-wise, it simply does not provide that much business value.

Much in the same way that looking at an A/B test invalidates it, it's better if you let your metrics converge before you look.

[1] http://www.instahero.com