I agree there's an equivocation going on for "PhD level" between "so smart, it could get a PhD" (as in come up with and publish new research and defend its own thesis) and "it can solve quizzes at the level that PhDs can".
Services that make this claim are paying people with PhDs to ask their models questions and then provide feedback on the responses with detailed reasoning.
