Understanding the human mind is key to the better design of artificial minds.

A short report based on a paper by Darius-Aurel Frank, Polymeros Chrysochou, Panagiotis Mitkidis, and Dan Ariely

Technology around us is becoming smarter. Much smarter. And with this increased smartness come a lot of benefits for individuals and society. Specifically, smarter technology means that we can let technology make better decisions for us and let us enjoy the outcome of good decisions without having to make the effort. All of this sounds amazing – better decisions with less effort. However, one of the challenges is that decisions sometimes include moral tradeoffs and, in these cases, we have to ask ourselves if we are willing to allocate these moral decisions to a non-human system.

One of the clearest cases for such moral decisions involves autonomous vehicles. Autonomous vehicles have to make decisions about what lane to drive in or who to give way at a busy intersection. But they also have to make much more morally complex decisions – such as choosing whether to disregard traffic regulations when asked to rush to the hospital or to select whose safety to prioritize in the event of an inevitable car accident. With these questions in mind it is clear that assigning the ability to make decisions for us is not that easy and that it requires that we have a good model of our own morality, if we want autonomous vehicles to make decisions for us.

This brings us to the main question of this paper: how should we design artificial minds in terms of their underlying ethical principles? What guiding principle should we use for these artificial machines? For example, should the principals guiding these machines be to protect their owners above others? Or should they view all living creatures as equals? Which autonomous vehicles would you like to have and which autonomous vehicles would you like your neighbor to have?

To start examining these kinds of questions, we followed an experimental approach and mapped the decisions of many to uncover the common denominators and potential biases of the human minds. In our experiments, we followed the Moral Machine project and used a variant of the classical trolley dilemma – a thought experiment, in which people are asked to choose between undesirable outcomes under different framing. In our dilemmas, decision-makers were asked to choose who should an autonomous vehicle sacrifice in the case of an inevitable accident: the passengers of the vehicle or pedestrians in the street. The results are published under open-access license and are available for everyone to read for free at: https://www.nature.com/articles/s41598-019-49411-7.

In short, what we find are two biases that influence whether people prefer that the autonomous vehicle sacrifices the pedestrians or the passengers. The first bias is related to the speed with which the moral decision was made. We find that quick, intuitive moral decisions favor killing the passengers – regardless of the specific composition of the dilemma. While in deliberate, thoughtful decisions, people tend to prefer sacrificing the pedestrians more often. The second bias is related to the initial perspective of the person making the judgment. Those who started by caring more about the passengers in the dilemma ended up sacrificing the pedestrians more often, and vice versa. Interestingly overall and across conditions people prefer to save the passengers over the pedestrians.

What we take away from these experiments, and the Moral Machine, is that we have some decisions to make. Do we want our autonomous vehicles to reflect our own morality, biases and all or do we want their moral outlook to be like that of Data from Star Track? And if we want these machines to mimic our own morality, do we want that to be the morality as it is expressed in our immediate gut feelings or the ones that show up after we have considered a moral dilemma for a while?

These questions might seem like academic philosophical debates that almost no one should really care about, but the speed in which autonomous vehicles are approaching suggests that these questions are both important and urgent for designing our joint future with technology.

My 2-year cell phone contract was up last month, and even before the date when I could opt for an upgrade, I began to experience the pain of indecision: which was it going to be – a Samsung Galaxy S3 or an iPhone 5? I was one of the only Android (HTC Evo) users in our Center for Advanced Hindsight team, and swayed by the rest of the group’s dedication to Apple, I was looking forward to switching to the new iPhone as soon as my contract was up. But I was not going to be able to befriend the newest iOS 6-adorned Siri until the iPhone’s release in a couple of months. In today’s impatient tech age, that is an eternity. My longing for an Apple clashed with my itching desire to get a new phone.

After watching a hopeless number of face-off videos, reading about the features and specs of Galaxy S3 compared with the endless mock ups of the rumored iPhone 5, and even throwing the question around at dinner parties, I decided to come to my senses, listen to what research has to say, and make an irrationally rational decision. Though surely evidence from decades of research is not limited to the following considerations, I picked a number of conceptual tools from decision-making research that could help shed light on this quandary of iPhone vs. Samsung:

1. Now vs. Later: I should pit my short-term interest in having a new smartphone now against my long-term interest in having an iPhone later. Temporal discounting suggests that we have the tendency to want things now rather than later, and delaying gratification depends on whether we are convinced that what will happen in the future is going to be better than what we can have now. In other words: howmuch better is this nebulous iPhone of the future when I could have this immediately awesome Galaxy S3?  Given that the specs of Galaxy S3 are available but those of the iPhone 5 are not, it might be smart to bet for what is certain. (Winner: Galaxy S3)
2. Misremembering the past vs. mispredicting the future: I can go with the certain specs of Galaxy S3, or potentially recall my past experiences with iPhones and decide accordingly. Sadly we are bad at remembering past feelings; rather than correctly weighing the positives and negatives we remember the peak moments and selected experiences. Since I am unable to accurately recall my past emotional states, then maybe I can imagine how much pleasure each of these phones could bring me in the future? Unfortunately, we are also notoriously bad at predicting the duration and intensity of future feelings. (Winner: Galaxy S3)
3. Want vs. need: Do I want a new phone? Yes. Do I really need a new phone? No, because my old one is still in good shape. With the irresistible discounts of signing up for a new 2-year plan, I am conditioned by the cell phone market to switch to a new phone as soon as possible. This conditioning moves me from casually wanting a new device to absolutely needing it to survive (!). I feel that the longer I wait, the more I am giving up on a perceived opportunity. (Winner: wait until my current phone gives up, and then get an iPhone 5).
4. Decoy options iPhone 4s vs. HTC Evo: In my indecision, I can introduce a third option that is asymmetrically dominated either by Galaxy S3 or iPhone 5. If I consider iPhone 4S as a potential option, it would (hopefully) be dominated by iPhone 5 but could still be superior to the Galaxy S3 with the ease of its use, compactness and such. If I am leaning more towards the Android options, then I can consider staying with HTC Evo as a potential third choice, and given that Galaxy S3 surpasses my old Android in nearly every domain, I would lean towards upgrading to Samsung. (Winner: Depends on the decoy option)
5. Reactance to unavailability: The brands also complicate the issue as they control supply and increase demand by playing with the availability of their products as well as the timing of their release. This can create several types of responses:

• Since iPhone 5 is currently unavailable, I experience a pressure to select iPhone 4S which is a similar alternative. If I perceive this as a limitation on my freedom to choose, I might react by selecting a dissimilar option. (Winner: Galaxy S3)
• The unavailability of iPhone 5 could also lead me to perceive it as more desirable. (Winner: iPhone 5)
• Or I can just despise what I can’t have. (Winner of the sour grapes story: Galaxy S3)

So, what should I do? Given the considerations above, there is still no clear winner for me. Yes, I have the plague of newism: I run after the genuine, exciting proposition of the emerging trends and products. Yes, I know there is something good now, but possibly something better around the corner.

At the end of the day, I will toss a coin: not because it will settle the question for me, but because in that brief moment when the coin is in the air, I will suddenly know which side I hope to see when it lands in my palm. And besides, whether I purchase my new phone from Apple or from Samsung, I will stick to my commitment, almost immediately forget about the forsaken option, and justify my choice infallibly in retrospect.

~Lalin Anik~

I am interested in the morally ambiguous realm of music/video/book piracy, a place where everyone has something to say and no qualms about saying it. A couple weeks ago, over a chocolate croissant, I was having what was probably my 5,637^th conversation on this topic, and my new friend (for his own protection let’s just call him Steve — apologies to all the Steves out there) began voicing his opinions: he was vehemently against illegal downloading, but fine with checking CDs out from the library and making personal copies for himself.

The conversation went as follows:

Me: “You know that’s illegal?”

Steve: “It’s a gray area.”

Me: “According to the law, it is not.”

Steve: “I still think it is kind of gray. And I need to put the songs on my iPod to listen to them, so I have to copy them anyway.”

After this conversation I was left wondering whether Steve was a criminal anomaly or if the rest of America was on his side. So I divided a sample of Americans into two groups and had them rate the moral “wrongness” of the two types of piracy. Group A) was told that Steve downloaded an album online without paying and Group B) was told that Steve checked out the CD from the library and made a personal copy.

The Conclusion:  America agrees with Steve. People generally viewed Steve’s actions as significantly less morally adverse when he made a copy from the library.  From a legal perspective, Steve had committed an equally unlawful act, but Americans still viewed the crimes differently.

So how could (illegally) copying from the library be viewed as less wrong than (illegally) downloading?

Illegal downloading has a sting against it while copying does not. Copying does not feel as much like stealing. There’s also a fellow person or institution (like a library or generous friend) to share your sin with. Pirates are a tainted outgroup, but anyone can be a copier of media.

Libraries make it okay. It can be safely assumed that libraries know that we have the ability to copy CDs but make no efforts to stop us; by providing us with the opportunity, they are more or less condoning piracy.

It’s so easy to copy CDs.  For this study our sample consisted mostly of people who do not know how to illegally download online (e.g., they were not particularly aware of cyber lockers or torrent clients). In other words, they probably know how to copy and burn a CD but not illegally download music.  I believe that most of the moral qualms people have against piracy would be wiped away if they just learned a virus-free, super-easy way to pirate high quality media.

I think the “easy” factor is partially why people view streaming illegal content (watching the content within browser without downloading it) as different from illegally downloading. Many illegal streamers say they are okay with streaming but not downloading because streaming is just “borrowing.” I think that, in actuality, people choose not to download because they do not know how, they find downloading to be a hassle, or are scared of viruses rather than because of their high moral standards. To avoid looking incompetent, they say (and believe) that the reason they don’t illegally download is because that type of piracy is morally wrong. But the kind they can do and easily benefit from (like copying from library CDs) is okay.

If you would like to help us out and provide any strong (or morally gray) opinions, please share them with us

~Troy Campbell~