That is the task they are constructed to perform, but that's just an output, not the inner workings of what's happening to arrive at that next token. You can give a human the same constrained task, but the output alone doesn't a human mind make.

Well then the common refutation is that humans are also next token predicting machines!