Super interesting article. With a system like this you can also get great metrics for product health / tech debt. If you were also looking at key growth metrics for the apps, you'd be able to see which releases improved them, and give credit (in the cases where it makes sense).
what is missing in all of this, i think, is the ability to do a/b testing. It'd be nice if app stores provided the ability to repush existing version and new version to a small fraction of users - this way you could compare in a more sane way.
Metrics related, here's a book review of Moneyball I just wrote: https://dtrejo.com/moneyball-book-review-and-measuring-reven...