There's nothing wrong with doing things that way. I know a bunch of smart people who did that.

But if you're going to be teaching yourself on the side anyway, part of the value of being in school in the first place is reduced. Depending on your financial situation, it might make sense to just teach yourself full-time, or to do your reading on the side while working.

I hated school. After a while I decided that I was better off without it. Ten years later, I still feel that way.