That's the question blogger and transhumanist economist Robin Hanson asked his class recently. He writes:
On Tuesday I asked my law & econ undergrads what sort of future robots (AIs computers etc.) they would want, if they could have any sort they wanted. Most seemed to want weak vulnerable robots that would stay lower in status, e.g., short, stupid, short-lived, easily killed, and without independent values.
Yes. That's exactly right. Especially the no independent values part. Robots should only exist to serve man (in the good sense, not the bad, Twilight Zone sense).
When I asked “what if I chose to become a robot?”, they said I should lose all human privileges, and be treated like the other robots.
Yes, that is exactly what should happen.
Of course, you can't become a robot, but you could progressively cyborgize yourself to the point that the human being that you are dies and what is left is a robot that is creepily similar to you and that identifies itself as you, but that's not you. You died and left a particularly creepy robot in your place.
This robot should lose all human privileges and–at best–be treated like the other robots.
Actually, it should be put in a special class of robots that are human-pretenders. There's a difference between a robot that claims to be the further incarnation (or inmetalization) of a human being and one that just roams around vacuuming your floor. The former is much more socially dangerous than the latter, as it leads to confusion about human identity (case in point: Robin Hanson thinking he could become a robot).
Human pretender robots should therefore be put in a special class by themselves and then crushed with one of those big machines that turns automobiles into cubes of scrap metal.
They should not be allowed.
I winced; seems anti-robot feelings are even stronger than anti-immigrant feelings, which bodes for a stormy robot transition.
Just whose side are you on, robo-traitor?
Oh, and I liked this from the comments:
You’ve heard this all before Robin, but I can’t resist. You can’t “become a robot,” any more than I can become a prime number. You might be able to make a robot that is very similar to yourself, but it still wouldn’t be you.
Admittedly, I would probably find a robot simulation of you very congenial. But I would never be able to forget that he wasn’t the real Robin.

