The definition of bootstrapping includes saving up ones own money to start a business, generally from a previous or other job. Most companies are started that way. Venture is the exception, not the rule.

And prior to EC2 a lot of people either just rented servers (in someone elses colo), or got a leased line and hosted servers in their office. Both were very, very common in the 90's.