yeah, i dont understand, whatsoever, the folks who are running models locally other than for privacy/curiosity. It is surely FAR slower, more expensive (electricity + hardware costs), and worse quality. Better to outsource to providers who have optimized everything and costs are distributed/amortized across all users.

Perhaps someday local llms will be sufficient for coding etc, but it's going to be a while.