180
you are viewing a single comment's thread
view the rest of the comments
view the rest of the comments
this post was submitted on 29 Jul 2023
180 points (100.0% liked)
Technology
37689 readers
211 users here now
A nice place to discuss rumors, happenings, innovations, and challenges in the technology sphere. We also welcome discussions on the intersections of technology and society. If it’s technological news or discussion of technology, it probably belongs here.
Remember the overriding ethos on Beehaw: Be(e) Nice. Each user you encounter here is a person, and should be treated with kindness (even if they’re wrong, or use a Linux distro you don’t like). Personal attacks will not be tolerated.
Subcommunities on Beehaw:
This community's icon was made by Aaron Schneider, under the CC-BY-NC-SA 4.0 license.
founded 2 years ago
MODERATORS
What is a Chinese room?
Imagine that you're locked in a room. You don't know any Chinese, but you have a huge instruction book written in English that tells you exactly how to respond to Chinese writing. Someone outside the room slides you a piece of paper with Chinese writing on it. You can't understand it, but you can look up the characters in your book and follow the instructions to write a response.
You slide your response back out to the person waiting outside. From their perspective, it seems like you understand Chinese because you're providing accurate responses, but actually, you don't understand a word. You're just following instructions in the book.
Its a thought experiment involving a room where people write letters and shove them under the door of the Chinese kid's dorm room. He doesn't understand what's in the letters so he just forwards the mail randomly to his Russian and Indian neighbours who sometimes react angrily or happily depending on the content. Over time the Chinese kid learns which symbols make the Russian happy and which symbols make the Indian kid happy, and so forwards the mail correspondingly until he starts dating and gets a girlfriend that tells him that people really shouldn't be shoving mail under his door, and he shouldn't be forwarding mail he doesnt understand for free.
https://en.wikipedia.org/wiki/Chinese_room
Wow, solid wiki article! It's very hard to say anything on the subject that hasn't been said.
I didn't see the simple phrasing:
"What if the human brain is a Chinese Room?"
but that seems to fall under eliminative materialism replies.
Part of the Chinese Room program (both in our heads and in an AI) could be dedicated to creating the experience of consciousness.
Searle has no substantial logical reply to this criticism. He openly takes it on faith that humans have consciousness, which is funny because an AI could say the same thing.
The whole point of the Chinese room is that it doesn't need anything "dedicated to creating the experience of consciousness". It can pass the Turing test perfectly well without such a component. Therefore passing the Turing test - or any similar test based solely on algorithmic output - is not the same as possessing consciousness.
"The room understands" is a common counterargument, and it was addressed by Searle by proposing that a person memorize the contents of the book.
And the room passes the Turing test, that does not mean that "it passes all the tests we can throw at it". Here is one test that it would fail: it contains various components that respond to the word "red", but it does not contain any components that exclusively respond to any use of the word "red". This level of abstraction is part of what we mean by understanding. Internal representation matters.
This is exactly Searle's point. Whatever the room is doing, it is not the same as what humans do.
If you accept that, then the rest is semantics. You can call what the room does "intelligent" or "understanding" if you want, but it is fundamentally different from "human intelligence" or "human understanding".
It's more than that. He says that all Turing machines are fundamentally the same as the Chinese room, and therefore no Turing machine will ever be capable of "human understanding".
Alternately, if anyone ever builds a machine that can achieve "human understanding", it will not be a Turing machine.
Man, I love coming across terms like this.
Chinese Room, Chinese Walls, Dutch Treat, Dutch Uncle, Dutch Oven.
Wow! Me, too! What is a Dutch Oven!?
Or a fart in a blanket :)
*Satisfied nod.*
A covered pot.