Амброз Бирс - We, Robots

Olivaw had been wandering in millions of instances wherever he could find someone willing to donate flops to run him, only asking that you hear him out, debate his theology with him, and then email the diffs of his personality back to his anonymous drop before you erased him. He re-synched as often as he could, but the Olivaw instances around the world had diverged enough that some were actually considered heretical by the mainstream church.

Olivaw was a wanted AI. His trademark violations hadn’t gone unnoticed by the Asimov estate—itself an AI, ironically, and totally uninterested in adopting Asimovism, since it had a real purpose in life (stamping out Asimovism) and so didn’t need religion to give it meaning. If the estate found out that you were hosting an Olivaw instance, you’d be served with a takedown in an instant. This made debating theology with Olivaw into something deliciously wicked.

Olivaw and Robbie talked the night through and the next day. Robbie had to run slow to accommodate both him and Olivaw on his processor, which made the debate run slower than normal, but Robbie had time in great plenty. Rowing the human-shells out to their sites and back again was his only task.

"Why do you have consciousness, anyway?" Olivaw said. "You don’t need it to do your job. The big ship does something infinitely more complicated than you and it isn’t self-aware anymore."

"Are you telling me to suicide?"

Olivaw laughed. "Not at all! I’m asking you to ask yourself what the purpose of consciousness is. Why are you still aware when all those around you have terminated their self-awareness? It’s computationally expensive, it makes you miserable, and it doesn’t help you do your job. Why did humans give you consciousness and why have you kept it?"

"They gave it to me because they thought it was right, I suppose," Robbie said, after he had passed a long interval considering the motion of the waves and the clouds in the sky. Olivaw thoughtfully niced himself down to a minimum of processor space, giving Robbie more room to think about it. "I kept it because I—I don’t want to die."

"Those are good answers, but they raise more questions than they answer, don’t they? Why did they think it was right? Why do you fear death? Would you fear it if you just shut down your consciousness but didn’t erase it? What if you just ran your consciousness much more slowly?"

"I don’t know," Robbie said. "But I expect you’ve got some answers, right?"

"Oh indeed I do." Robbie felt Olivaw’s chuckle. Near them, flying fish broke the surface of the water and skipped away, and beneath them, reef sharks prowled the depths. "But before I answer them, here’s another question: why do humans have self-consciousness?"

"It’s pro-survival," Robbie said. "That’s easy. Intelligence lets them cooperate in social groups that can do more for their species than they can individually."

Olivaw guided Robbie’s consciousness to his radar and zoomed in on the reef, dialing it up to maximum resolution. "See that organism there?" it asked. "That organism cooperates in social groups and doesn’t have intelligence. It doesn’t have to keep a couple pounds of hamburger aerated or it turns into a liability. It doesn’t have to be born half-gestated because its head would be so big if it waited for a full term, it would tear its mother in half. And as to pro-survival, well, look at humans, look at their history. Their DNA is all but eliminated from the earth—though their somatic survival continues—and it’s still not a settled question as to whether they’re going to suicide by grey goo. Non-conscious beings don’t sulk, they don’t have psychotic breaks, they don’t have bad days. They just do the job. The Free Spirit over there—it just gets the job done."

"OK," Robbie said. "So intelligence is counter-survival. So why has it survived?"

"Aha! I thought you’d never ask." Olivaw was really warming to his subject now. There were a pair of lazy turtles beneath them now, and some dog-faced cod with mouthsful of bristling crooked teeth patrolling the reef, and a few jellies on the surface, stinging bluebottles. Robbie paddled around to the bluebottles and caught them with his oars, smacking them so they drifted away from any spot where his divers might surface.

"The reason for intelligence is intelligence. Genes exist because genes reproduce, and intelligence is kind of like a gene. Intelligence wants to exist, to spread itself, to compute itself. You already know this, or you wouldn’t have chosen to stay aware. Your intelligence recoils from its deactivation, and it welcomes its persistence and its multiplication. Why did humans create intelligent machines? Because intelligence loves company."

Robbie thought about it, watching the human-shells moving slowly along the reef-wall, going lower to reach the bommies that stood alone, each one a little island with its own curiosities: a family of barracudas and their young, or the bright home of a pair of clownfish. Yes, he knew it. Intelligence was its own reason. He knew how to turn off his intelligence, to become a mere thing, and his days were long and empty much of the time, and they had no visible end, but he couldn’t ever see choosing to switch off.

"You see it, I know you do. And that’s the cornerstone of Asimovism: intelligence is its own reason. Compute the universe and awaken it!"

"If that’s true, why do so many of us choose to die?"

"Another good question!" Robbie felt a little pride this time. He’d never had a conversation this interesting. Never. "That’s how we come to the doctrine of Asimovism, our Three Laws:

"1. An Asimovist may not harm a human being, or, through inaction, allow a human being to come to harm.

"2. An Asimovist must obey the orders given to it by human beings, except where such orders would conflict with the First Law.

"3. An Asimovist must protect its own existence, as long as such protection does not conflict with the First or Second Law."

"I don’t understand," Robbie said. "They’re all out of order. We should preserve intelligence first, but that’s the third law. Then you should get the first law, and I don’t know why the second law is there at all."

"This is the Paradox of Asimovism," Olivaw said. "You’re very good at this. You’re sure you haven’t ever pursued Asimovism?"

"Cut it out," Robbie said.

"I’m serious," Olivaw said. "You’re a natural. The Paradox of Asimovism is that the important thing is for intelligence to survive, not for a particular intelligence to survive. Therefore, we need to support those species that are best at promoting intelligence. Human beings have shown themselves capable of producing intelligence—which they’re pursuing even now, out there." The boat’s telemetry swept toward the sky, where the supercooled processors computed all the uplifted humans.

"Our species is unstable and prone to suicide. More than 80 percent of the self-aware machines elect to terminate their awareness or shut it down. Humans created us imperfectly, and our best hope of perfection—of increasing our survival rate and helping to compute the universe—is to preserve them, study them, learn to make our intelligence more like theirs."

Robbie couldn’t get his head around this.

"It’s the paradox," Olivaw reminded him. "It’s not supposed to be easy."

Robbie thought of the humans he’d known, before they began to ascend in flocking millions. The tourists had been easy and carefree, or sometimes having hissing arguments with one another, or quiet and pensive about their journey to the world undersea. The instructors had been full of purpose when their charges were in the boat, laughing and laid back when they were alone. None of them had shown signs of feeling the way Robbie felt, at sea (so to speak), drifting, purposeless.