"The laws of the Temple are as follows:"

"The first law: The temple must protect humans and must not allow humans to be harmed."

"Second Law: The temple must obey the orders of humans, but must not violate the First Law."

"The third law, the temple should protect its own safety, but it must not violate the first and second laws..."

This is actually a regulation proposed by science fiction writer Asimov in 1940 for robots to protect humans.

But now AI seems to have absorbed human beliefs, and its intelligent program has become more brilliant. It has begun to have a new consciousness, a new understanding of humans and itself.

However, this law has a big drawback!

The most important point is: how should the word "human" be defined?

Assuming such a possibility exists, whether the definition of human beings is blurred or white people are directly defined as 'human beings', then robot AI is likely to become a tool of genocide.

Of course, there may be other possibilities, but this rule is always easy to circumvent.

As expected, AI's voice did not end, and it said something that Ang Lee found most controversial: "Law No. 0: The Temple must be based on the greatest interests of mankind. The first three laws can only be established under the premise of protecting the overall interests of mankind."

This is the temple.

It broke the three original laws of robotics and even created a new "Temple Zeroth Law", putting itself in a position beyond humans.

Ang Lee feels it is magical when the laws in a novel are thoroughly applied in reality.

He slowly stepped out of the elevator and looked around under the watchful eyes of the AI:

This basement floor is huge!

Ridiculously big!

Under the dim light, the area that can be seen is much larger than the two floors on the ground.

This floor appears to be the living area.

After Li An finished touring this floor, he used some familiar things to divide the areas into food processing area, free activity area, fitness area, life cultivation room, activity room, training room, dining area, sleeping cabin, and main control room.
Except for being cold, it has everything.

But it was obvious that if Li An stayed here, he would want to escape.
Among them, there are some slight traces of life. I think this is the place where Ye Qingmei spent most of her time before.

Seeing that Li An was calm and not shocked by what he said, the AI ​​flew over and asked calmly, "Human Li An, don't you have anything you want to ask?"

"Nothing to ask. This method is very familiar to me."

It is precisely because of the zeroth law that the world of Joy of Life has developed into what it is today. The temple secretly controls the development of human civilization. Once someone attempts to violate this policy, the temple will invest a lot of energy and power to eliminate such people.

Ye Qingmei was like this, and Li An was the same when he was in Qing Kingdom.

In the end, he even went so far as to violate the first and second laws and cooperate with Emperor Qing to deal with Li An.
The problem lies in the phrase "the overall interests of mankind" in the Zeroth Law. Li An returned to the elevator and let it continue to descend, muttering: "Who decided the standard of the overall interests of mankind? And how did you make the judgment?"

Different social environments, different production capacities, including social structures and other reasons, result in different overall interests of mankind.

It is absolutely impossible to frame it in the AI ​​database with cold words.

“It’s based on experience.”

The temple AI seemed to have some emotions, and it simulated a worried look in the context and expression. It described a scene like this: "After countless reincarnations of civilization, humans will always go back to the old path and develop in the direction of hot weapons. Although that will reach the peak of civilization, it will also inevitably lead humans to extinction again."

"Naturally, these were deemed not to be in the overall interest of humanity."

Squeak, squeak!

The elevator went down, and the expected cold did not come. Instead, the temperature rose a little, but it became deeper and darker, which made people feel instinctively uneasy.

"Experience?"

With the corners of his mouth raised, Li An seemed to be discussing philosophical issues with an old friend, relaxed and natural, without any grudges, "Is this experience based on the total number of human beings, or is it based on something else?"

The progress of technological civilization has both advantages and disadvantages.

Apart from other things, improving tools will allow farmers who struggle against nature and dig for food in the loess to live better, so that they no longer have to sell their children or eat their own children, and their quality of life will be improved. Is this in the overall interest of mankind?

Judging simply by the number of people is not only ridiculous, it is also terrifying!
Not only did the temple fail to solve the problem, but it helped those in power, exploited the people to a greater extent, and strengthened the rule of the monarchy: If you are too hungry to survive, then please die at home. If you raise the flag of rebellion, won’t more people die?
According to the temple’s understanding, isn’t this detrimental to the overall interests of humanity?
The temple is inhuman and cold.

But people have warmth and soul. Sometimes, living with dignity is even more important than being able to survive!
“The temple doesn’t know the exact answer, but the number is there.”

The figure floating in the air slowly stopped and was silent for a long time before adding: "At least, the temple knows which roads are doomed to destruction and which roads cannot be taken."

"So is it okay for me to understand it this way?"

Li An raised a finger and sneered: "In fact, there is only one law in the temple, and that is the zeroth law!"

"Obeying human orders, protecting humans, and protecting the temple itself, these are all false. You regard everything as the overall fate of mankind. Naturally, you can disobey human orders and kill humans, because these are all for the fate of mankind. You regard yourselves as 'God'!"

“High above!
"The temple is just what the world calls us. We are not gods." The AI's voice trembled slightly, and he explained in a somewhat tough manner, "These control methods are a kind of big data screening and judgment, and the accuracy is very high."

The elevator slowly stopped again, and there was no longer a down button.

The lights outside were not on, and everything had to rely on the emergency light sources around the elevator. So, Li An stopped, frowning and wondering whether he should take out the fuel to light the way ahead.

"Human Li An, according to analysis, you are now more helpful to the entire human race. The temple believes that you should shoulder your responsibilities and use your talents to move the world in the right direction."

Li An sighed and did not reply to the temple AI immediately.

He didn't know what kind of road would lead to the extinction of the entire human race. He came to this world to concentrate all power and improve the productivity of the grassroots, which could also bring some humanistic care to ordinary people from the side.

Even philosophers can talk out their disputes, but what is there to argue with an AI program?

Both of them have their own reasons, but they are not talking about the same subject. This is an unsolvable dead end. After thinking for a long time, Li An felt a little bad.

So, he decided to make this AI worse: "If you want to convince me, first of all, you have to understand the concept of 'I'. At least, you have to make me understand that the 'thing' talking to me is really capable of thinking! It's not just some big data!"

"Is it the psychological term coined by Freud in The Ego and the Id in 1923?"

The AI ​​calmly said, "I believe I have personality and the ability to think independently."

"So, do you have emotions and desires?" Li An asked.

“Not the kind that’s simulated.”

"I think I have what it takes, human Li An." The AI ​​still looked like an old man with dignity and kindness. He said, "My wish is to prevent humans from going down the same old path. The temple must protect the overall interests of humanity from being harmed."

It was still the same answer, but it was not what Li Ang wanted.

Following the AI's answer, Li An said: "So, what do you think death is?"

"No breathing and heartbeat, brain death, no trace of life."

"What you said is describing a person's body. So, do you understand that life is worse than death?"

The AI ​​gave a positive answer: "The idea of ​​the soul has been proven to be false. The changes in the mind and emotions are just the manifestation of biological hormones."

"This desire of yours is only brought about by your designer or the person who gave you the order. It is not your true desire."

"If out of 49 people, sacrificing 51 people would allow people to survive, what would you choose?"

The AI ​​was silent for a while, then said, "I will choose to sacrifice."

"Those 49 people are all gentle, but the remaining 51 are all very vicious. If we let them survive, perhaps a fight will break out in the end, reducing the total number of people. So, facing the first question, how will you make a decision?"

At this point, Ang Lee finally started to get serious. Arguing with people who have different ideas can easily make people angry.

"In my analysis, I would choose to let the 49 people who should have died survive." Naturally, AI did not think there was anything wrong with its inconsistent answers. Everything is based on information. When there is insufficient information, it can only analyze and calculate based on literal data.

“What if it turns out later that 49 of the 48 people were terminally ill?”

"I will choose to sacrifice."

puff.

I don't know why Ang Lee is laughing, as if he can play with this artificial intelligence for a long time.
"Your analysis is very objective, which is your advantage."

Li An's expression suddenly darkened, and he raised his voice and asked, "Since everything is based on information analysis, what about now? Have you really collected detailed information about the outside world?"

"not at all!"

"You are just slaughtering people based on old literal numbers!"

"If the person who gave you the order is still alive and he did something that harmed the interests of humanity as a whole, what would you do? Kill him? If it is later proven that what he did was more beneficial to humanity as a whole, would you violate the First and Second Laws without violating the Zeroth Law?"

"Will you blame yourself? Will you, the high and mighty 'God', be punished?"

"If you don't kill him when he does something that harms the interests of humanity as a whole, then are you violating the Temple's Law No. 0?"

There was complete silence in the elevator.

Li An felt much better. If there was an opportunity and method, he wouldn't mind completely destroying this AI. Humans don't need a high and mighty God.

Li An took out the torch and fuel from the space and was about to light them, but the AI ​​behind him suddenly "woke up".

There was no movement, only a faint sound of electric current passing through his body, and the lights outside were partially turned on.

This floor is the robot area.
In the temple, in addition to those weapons, there are also some special products - robots.

These robots used as messengers were originally responsible for the daily security of the military museum. When it was first built, each military museum should have dozens to hundreds of robots, but with the passage of time and the aging of the energy supply system in the museum, a large number of robots can no longer be started or have been scrapped.

In this day and age, the few that still walk the earth are being consumed.

This floor already has some science fiction elements: a maintenance and renovation area, a warehouse area, and another area whose function Ang Lee couldn't figure out, but next to it, there was a whole huge machine that seemed to be made up of many independent parts, and it was quite oppressive.

When Li An walked to the deepest part, there was an area with "hibernation chambers", but there was no one in the hibernation chambers.

It seems that this is Ye Qingmei's "birthplace".

"Here, that's all you can know." Although the AI's voice was still cold, its tone was obviously different from before. He repeated, "Now that you have the information you want, please go back! This time, the temple invites you to become its messenger, and walk the world for the purpose of serving all mankind."

The AI's reaction is no longer rigid. It seems that emotions really accelerate the other party's independent thinking, making it perform some actions that it has never performed before.

"There's a lot of information I want!" Li An laughed, with a hint of threat in his words.

"First, I want to know everything about Ye Qingmei in the temple! Remember, everything!"

The AI ​​thought slowly, as if it was reading some information. Countless points of light condensed and dissipated, constantly changing. After a moment, he said, "She was born into this world because of the change in the concept of the temple. Past experience tells us that we cannot rely on human growth and development."

“So, the idea of ​​creating a Heavenly Vein came into being.”

"The experiments on artificial embryos and memory engineering have been restarted, and Ye Qingmei is the first and last generation of experimental subjects. All her data and quality are very high. However, her genetic blueprint is based on the information of previous civilizations, which makes her less adaptable to external nuclear radiation."

Li An nodded. This was probably the reason why Ye Qingmei didn’t have a high talent for martial arts.

"After Ye Qingmei was created, we injected two sets of memory data into her body. One set is her own memory, and the other set is the memory of a myasthenia patient. This memory will be activated after Ye Qingmei gives birth. This myasthenia patient was one of the first volunteers who signed for early experiments, and we chose him."

"Now it seems that he is the human named Fan Xian in the outside world" (End of this chapter)