> Why don't the details of how consciousness arises in one system inform your judgment of whether it can exist in a different system that only has partial structural overlap?
A light bulb doesn't need to do fusion to make light. An airplane doesn't need to flap its wings to fly. An ANN doesn't need to use a brain's structure to think.
You haven’t proven an LLM has thought. I can measure the spectral properties of light from both a bulb and the sun.
I can measure the dynamics that go with thought in a human.
I can measure some dynamics in an LLM. From all we know, there are huge differences, not least that you can literally turn off an LLM, whereas every process but death in biology shows continued activity even when the organism “looks” off,
What you haven’t shown me is that what the LLM does when it is on is “thinking”. Given that the dynamics are different, the substrate is different, and one can be fully turned off and the other cannot, why are these two things the same?
Give me any problem that previously required human thinking. Any. That can be solved by LLMs. All you have to do is provide a single counterexample.
> not least that you can literally turn off an LLM, whereas every process but death in biology shows continued activity even when the organism “looks” off,
There is no reasonable definition of thinking that requires that it can't be paused.
> why are these two things the same?
I said they aren't the same, just as a bulb isn't the same as a star. An LLM can think, just as a human brain can think. A bulb can produce light, just as a star can produce light.
>Give me any problem that previously required human thinking. Any. That can be solved by LLMs. All you have to do is provide a single counterexample.
Theres an itch deep in my butt, but I'm in an important meeting and can't leave the seat. Nor can I openly scratch the area.
I can tell myself these things, focus on the itching, think about how itching is felt by the body, think about the social consequences, and make it feel more bearable.
Please tell me which LLM has solved this problem so I can not outsource the issue to it. I eagerly await your answer.
> There is no reasonable definition of thinking that requires that it can't be paused.
Is there a reasonable definition of thinking where the words "paused" and "turned off" aren't treated the same? Can you do that kind of thinking and get back to me?
> I said they aren't the same, just as a bulb isn't the same as a star. An LLM can think, just as a human brain can think. A bulb can produce light, just as a star can produce light.
An LLM can produce language. You are yet to show me it produces thinking.
Your claim is like saying the bulb produces light, so it also goes through fusion.
The LLM will tell you how to solve it. If you mean the LLM should modify your thoughts, no human could do that for you either, but an LLM agent can just as easily as a human figure out how to build the brain computer interface to make this possible in the future.
> Is there a reasonable definition of thinking where the words "paused" and "turned off" aren't treated the same?
No reasonable definition of thinking requires that thinking can't be paused or turned off. Please state your point more clearly.
> You are yet to show me it produces thinking.
Every problem that previously required human thought can be solved by LLM. QED.
> Your claim is like saying the bulb produces light, so it also goes through fusion.
No. How many times do I have to explain that the mechanism of thinking is not the same, just as the mechanism of producing light is not the same? You need to think to understand this, which is something that frontier LLMs have no problem with, but which most humans struggle with.
You’ve shifted your goal posts. You asked me for a problem I can solve with thinking. Not a problem another human can solve for me by their thinking. I have given you exactly what you asked for. An LLM cannot solve it. A human can’t solve it for me but can solve it for themselves (or not be capable of it), it varies.
Whatever you thought you were going to prove with your question, I do hope you’ll dwell on what my example tells you about what thinking is. It isn’t a string of words only. It can be that, but it’s more.
> No reasonable definition of thinking requires that thinking can't be paused or turned off. Please state your point more clearly.
It does. Please define thinking however you want. I’ll show you that it’s a requirement.
> Every problem that previously required human thought can be solved by LLM. QED.
Again, this is the same superficial thinking. Firstly, as my example above showed, no. There are other examples. It requires human thought to cook. No LLM can, nor is smell digitizable in an equivalent way to humans, and yet, cooking is one place where having a human nose is determinative to making appetizing food. Your QED is logically absurd, but is also resting on an assertion that’s flatly untrue.
> No. How many times do I have to explain that the mechanism of thinking is not the same, just as the mechanism of producing light is not the same? You need to think to understand this, which is something that frontier LLMs have no problem with, but which most humans struggle with.
When your “proof” for thinking is the output, I will also compare it to the output, light. My analogy shows the idiocy of your argument, and you don’t want to sit with its implications.
LLMs replicate human language. And many tasks human language can do, LLMs can do or help with. Thinking is not just producing word strings. We think about our family. We think about our bodily aches and pains. We think about how best to do various physical tasks. All this we do sans words, and LLMs don’t do. To call their internal dynamics “thinking” is silly wishful thinking by those who don’t have the ability to go read and understand biology.
And it’s a sad statement of how little you think of your own mind that you won’t explore facts that are outside your expertise that will actually teach you how your mind works, and the wondrous complexity underlying it, and the potential it has to keep doing new things.
I’m going to stop engaging at this point. You seem convinced LLMs think. I wish you the joy of that belief, whatever it is. Religion is always absurd, and this new one is no different.
Remember the problem we're discussing is whether these LLM systems can think. Your deliberate misinterpretation of a question does not make you win that argument.
An LLM can solve problems for itself in just the same way that a human can solve problems for itself. It cannot directly rewire your thinking in the same way that another human cannot.
You have yet to show me a problem that can only be solved by human thinking.
> When your “proof” for thinking is the output
What other way can we show thinking? From the input? Obviously not.
> My analogy shows the idiocy of your argument
It shows the idiocy of your argument. The output is thinking, just as the output is light. You are the one who continues to mistake the output for the mechanism.
> Religion is always absurd, and this new one is no different.
Your assertion of magic in biology that can't be replicated artificially is indeed absurd and one that almost no scientist would agree with.
A light bulb doesn't need to do fusion to make light. An airplane doesn't need to flap its wings to fly. An ANN doesn't need to use a brain's structure to think.