Blindsight and Gorgias: The Chinese Room and Sophistry
I recently finished reading the sci-fi novel Blindsight by Peter Watts. I think I was led to it when searching for authors similar to Neal Stephenson, whose works I really enjoy. And it was bang on. Like Stephenson, Watts crams so many ideas into Blindsight. Blindsight is much more compact than Stephenson's later works, and I have to say Watts is better at tying everything together at the end.
Through the novel Watts explores the role of consciousness in life and challenges the psychocentric status quo. Somehow it is not totally ridiculous for vampires to exist in this world. The protagonist, Siri Keeton, lost his sense of empathy after an invasive brain surgery. His interaction with people is through a large and complex set of rules in order to react correctly. It reminds me of how some isolated internet autistics describes their experience in trying to communicate with neurotypicals in social situations, an impossibly large set of rules to memorize and apply that they were never privy to. The man is however not devoid of feelings, he is clearly touched by his interactions with other people. Though he does not always seem to recognize his feelings and how it affects him. The protagonists mode of social interaction extends to his vocation. Artificial intelligence and enhanced humans have taken research in Blindsight so far that their ideas have become impossible for the normal human mind to comprehend. Synthesists are tasked with translating these complex information structures into something their clients can understand, or at least be satisfied with in feeling as they understand it. Critically, the synthesists are not experts in the subjects they translate. Like a flatlander conveying the idea of 3 dimensions to their fellow flatlanders.
The protagonist compares himself to the Chinese Room. The concept describes how a system can have intelligence without a mind: There is a room with 2 slots, one receives papers written with Chinese and the other puts out responses. Inside is a man and a rulebook. The man has no understanding of Chinese but follows the extensive ruleset of the book to create responses. Any input to the Chinese Room will get an appropriate output, yet there is no mind ruling it (the man only follows the rules as a logical engine). The concept has been popular in recent times with the rapid advances of LLM AI, complex systems that without mind can create convincing outputs in all manner of fields such as text, video and audio.
Reading Blindsight and it's musings on intelligence sans consciousness, I came to think that there are some similarities with how Plato criticises sophistry in his writings. Some quick searching gave that no one else had made the connection, so I decided to make this blog post about it. I have not yet finished my project of reading through all of Plato's writings, the Sophist dialogue could perhaps have been handy here, but I will make my best attempt.
In Ancient Greece sophists were learned men which had gotten rich from taking money in exchange for lessons. They are frequently the eponymous "antagonist" of Plato's dialogues such as Gorgias and Protagoras. Some dialogues portray them as foolish such as Hippias Minor while Gorgias and Protagoras judge at least the masters to be wise and intelligent but misguided in their convictions. The fundamental critcism is that the sophists prize power and money above knowledge. The sophist Gorgias himself argues that an expert in the oratory art will be more convincing in a subject than an expert in the matter. For example an orator would be better at convincing a patient to take their medicine than the doctor. In short, translating complex ideas without understanding of them. In the grimdark future of Blindsight, the sophists have won.
There is the question of what unconscious intelligence is. We are not given much detail on how the synthesists work. The protagonists perspective does invoke techniques or theory in their approach beyond that they perceive personalities as "topologies". The other characters in the story are wary of the synthesist, but we do not see them disrespect their art as lesser. In the Gorgias dialogue the practice of rhetoric is defined not as an art based on knowledge but as a "knack" based on instinct and experience. The people in Blindsight are confounded that the extraterrestials have advanced intelligence without consciousness. But complexity is not contingent on self-awareness. Life on earth has achieved it without conscious design and LLMs can create very convincing results despite just being a network of weights. Complexity from self-aware decisions and knowledge is actually quite recent in the timespan of life on Earth.
One critical difference between the Chinese Room and sophistry is that the later has a moral component. In general we only attribute morality to conscious beings that can make decisions. The ant colony is not evil for invading my kitchen and it would be pointless to get upset if the Chinese Room instructed me to go fuck myself. Although morality can be extended to organizations of conscious beings such as the polis in Republic. One possible, if fringe, implication of that dialogue is pan-psychism where everything at every layer of reality has consciousness. But the whole premise of the Chinese Room is moot if pan-psychism is accepted. Morality itself gets confusing here if we are to apply it to everything and not just between equal rational entities. Blindsight raises the possibility that the existence of morality could be useless if consciousness merely self-identifies with the decisions that the body decided on before it was thought. You could make the case that intelligence without consciousness would still strive for truth as it would lead to better decisions, i.e fitness in it's environment. The hypothesis that math could be used for communcation with extraterrestial life is put to use in the novel, but it ultimately is unsatisfactory for answering whether it allows for communication. In a platonic framework a perfect Chinese Room might be naturally good by virtue of its perfection.
In short, there is some similarities between the concept of the Chinese Room in Blindsight and sophistry. They describe how intelligence can function without conscioussness or knowledge, but differ in their applications in ethics.