If, by virtue of the Second Law, we can demand of any robot unlimited obedience in all respects not involving harm to a human being, then any human b… - Isaac Asimov

" "

If, by virtue of the Second Law, we can demand of any robot unlimited obedience in all respects not involving harm to a human being, then any human being, any human being, has a fearsome power over any robot, any robot. In particular, since Second Law supersedes Third Law; any human being can use the law of obedience to overcome the law of self-protection. He can order any robot to damage itself or even to destroy itself for any reason, or for no reason.

Is this just? Would we treat an animal so? Even an inanimate object which had given us good service has a claim on our consideration. And a robot is not insensitive; it is not an animal. It can think well enough so that it can talk to us, reason with us, joke with us. Can we treat them as friends, can we work together with them, and not give them some of the fruits of that friendship, some of the benefits of co-working?

If a man has the right to give a robot any order that does not involve harm to a human being, he should have the decency never to give a robot any order that involves harm to a robot, unless human safety absolutely requires it. With great power goes great responsibility, and if the robots have Three Laws to protect men, is it too much to ask that men have a law or two to protect robots?