Both had rich parents though. I think that makes it slightly easier to get into Harvard. They could live in good neighborhoods, attend the best public or private schools and also try entrepreneurial activities with a safety net. Now maybe that safety is overrated in general but it is still there nonetheless.

Gates also left a mark or two at Harvard for actual academic stuff: https://en.wikipedia.org/wiki/Pancake_sorting