Up until recently I did not know there was a way out from the Great Lakes into the ocean that does not involve going up North all the way through St. Lawrence. You can go through the Welland canal and shortcuts and end up going down South.
You can also go out the Chicago River and down the Mississippi. There is a path called "The Great Loop" which takes you around the entire eastern United States. (well, most people skip New England and Mississippi (the state), but you could include them if you wanted.)