Isaac Asimov - Utopia

“Yes, I know,” said Soggdon. “And I see you have produced an impressive planetary projection as a result. Would either or both of you care to comment on it?”

“Both willl speeak, and then eachhh,” said the unison voice. “We havvve prrojected forward four ttthousand yearss, as we have found that a wellll-planned operrational sequenzzze will result in a zzzero-maintenance planetary ecologggy within apprrroximately three hundred years. In our projection, the planetary climmmate remainss intrinsically stable, selfffcorrecting, and self-enhancing throughout the period of the metasimulation. There is no apparent danger of recollapse evident in any of the data for the end of the metasimulation period.”

Kresh frowned. Metasimulation? Then he understood. The unison voice was using the term to refer to a simulation inside a simulation—which was what it had been, so far as Dum and Dee were concerned.

Dum spoke next. “Reference to unit Dum’s prior objections in regard to ecological and economic damage. Projections show that the damage to the general ecology and gross planetary product caused by digging inlets for the Polar Sea would be fully compensated for within fifteen years of project completion.”

But if the first two aspects of the combined control system made it all seem wonderful, the third voice pulled everything back down to reality. “It all sounds quite splendid,” said Dee. “There is, of course, the slight problem of it being quite impossible. We ran the metasimulation based on the assumption that it would be possible to dig the channels. It is not possible to dig them. An interesting exercise, I grant you—but it is not one that has a great deal of connection to the world of our simulation.”

“I was afraid she was going to say that,” Soggdon muttered as she switched off her mike. “You’d think she’d be the least sensible of the three possible personality aspects, but instead Dee’s always the one to stick the pin in the balloon. She always reminds us of the practicalities.”

“Maybe this time they’re a bit more possible than you think,” Kresh said. He keyed his own mike back on, and tried to phrase things so that he would not reveal that he had overheard the conversation with Soggdon.

“Unit Dee, that’s a very promising projection there. I take it you think creating the Polar Sea would be a good idea?”

“It is a good idea that cannot be realized, Governor,” said Unit Dee. “You do not have the resources, the energy sources, or the time to construct the needed inlets.”

“That is incorrect,” Kresh said. “It is possible there is a practical, doable, way to dig those inlets. I came here to have you evaluate the proposed procedure. I first wanted to see if the effort would be worthwhile. I see now that it would be.”

“What is the procedure in question?” asked Unit Dee.

Kresh hesitated a moment, but then gave up. There was no way to describe the idea that didn’t sound dangerous, desperate, even insane. Well, maybe it was all three. So be it. “We’re going to break a comet up, and drop the fragments in a line running from the Southern Ocean to the Polar Depression,” he said. Even as he spoke, he realized that he hadn’t put any modifiers or conditionals in. He hadn’t said they might, or they could, or they were thinking of it. He had said they were going to do it. Had he made up his mind without knowing it?

But Dum and Dee—and Soggdon—plainly had more on their minds than Kresh’s reaction to his own words. There was dead silence for a full thirty seconds before any of them reacted. The perfect holographic image of the Inferno of the future flickered and wavered and almost vanished altogether before it resolidified.

Unit Dee recovered first. “Am I to under—under—understand that you intend this as a serious idea?” she asked. The stress in her voice was plain, her words coming out with painful slowness.

“Not good,” said Soggdon, her headset mike still off. She turned toward a side console, paged through several screenfuls of information, and shook her head. “I warned you she took her simulants seriously,” she said. “These readings show you’ve set off a mild First Law conflict in her. You can’t just come in here and play games with her, make up things like that.”

Kresh cut his own mike. “I’m not making things up,” he said. “And I’m not playing games. There is a serious plan in motion to drop a fragmented comet on the Utopia region.”

“But that’s suicidal!” Soggdon protested.

“What difference does it make if the planet’s going to be dead in two hundred years?” Kresh snapped. “And as for Dee, I suggest it is time you start lying to her in earnest. Remind her it’s all a simulation, an experiment. Remind her that Inferno isn’t real, and no one will be harmed.”

“Tell her that?” Soggdon asked, plainly shocked. “No. I will not feed her dangerous and false data. Absolutely not. You can tell her yourself.”

Kresh drew in his breath, ready to shout in the woman’s face, give her the dressing-down she deserved. But no. It would do no good. It was plainly obvious that she was not thinking with the slightest degree of rationality or sense—and he needed her, needed her help, needed her rational and sensible. She was part of the team that had set up this charade. She was the one who would have to prop it up. He would have to reason with her, coolly, calmly. “It would do no good for me to tell her any such thing,” he said. “She thinks I’m a simulant. Simulants don’t know they are simulants. She would not believe me telling her there was no danger—because she does not believe me to be human. And she does not believe that because you have lied to her.”

“That’s different. That’s part of the experiment design. It’s not false data.”

“Nonsense,” Kresh said, a bit more steel coming into his voice as the gentleness left it. “You have set up this entire situation for the sole purpose of allowing her to take risks, to do her job, while believing she could no harm to humans.”

“But—”

Kresh kept talking, rolling right over her protests. “I could even do damage to her if I told her it was just a simulation. There must be some doubt in her mind as to whether her simulants—the people of Inferno—are real. Otherwise she would not be experiencing the slightest First Law conflict concerning them. If I assured her that I was not real, Space alone knows what she would make of that paradox. It seems to me as likely as not that she would reach the conclusion that I was real, and that I was lying to her. If I lie to her, she might realize the truth—and then where would you be, Dr. Soggdon? Only you can do it. Only you can reassure her. And you must do it.”

Soggdon glared at Kresh, the anger and fear plain on her face as she switched on her mike again. “Dee, this is Dr. Soggdon. I am still monitoring the simulation. I am detecting what appear to be First Law conflicts in the positronic pathing display. There is no First Law element to the simulated circumstances under consideration.” Soggdon hesitated, made a face, and then spoke again. “There is absolutely no possibility of harm to human beings,” she said. “Do you understand?”

There was another distinct pause, and Kresh thought he detected another, but much slighter, flicker in the image of the Inferno that was to be. But then Dee spoke again, and her voice was firm and confident. “Yes, Doctor Soggdon. I do understand,” she said. “Thank you. Excuse me. I must return to my conversation with the simulant governor.” Another pause, and then Dee was speaking to Kresh. “I beg your pardon, Governor. Other processing demands took my time up for the moment.”

“Quite all right,” Kresh said. Of course, Dee was no doubt linked to a thousand other sites and operations, and probably having a dozen other conversations with field workers right now. It was not quite a little white lie, but it was certainly close enough to being one. Robots were supposed to be incapable of lying—but this one was clever enough to manage a truthful and yet misleading statement. Dee was a sophisticated unit indeed.