I'm a non-American native English speaker and "I could care less.." confused me until I had it explicitly explained to me. I took it as some kind of inversion of "I couldn't care less" which I had heard plenty. It still doesn't make any sense (if you could care less, it's implicit that you care to some degree, right..?) but at least I get it now.