There was a day, about 10 years ago, when I asked a friend to hold a baby dinosaur robot upside down. It was this toy called a Pleo that I had ordered, and I was really excited about it because I've always loved robots. And this one has really cool technical features. It had motors and touch sensors and it had an infrared camera. And one of the things it had was a tilt sensor, so it knew what direction it was facing. And when you held it upside down, it would start to cry. And I thought this was super cool, so I was showing it off to my friend, and I said, "Oh, hold it up by the tail. See what it does." So we're watching the theatrics of this robot struggle and cry out. And after a few seconds, it starts to bother me a little, and I said, "OK, that's enough now. Let's put him back down." And then I pet the robot to make it stop crying.
Jednog dana, pre oko 10 godina, zamolila sam prijatelja da drži robota bebu dinosaurusa naopačke. Bila je to igračka po imenu Plio koju sam naručila, i zbog nje sam bila jako uzbuđena jer sam oduvek volela robote. A ovaj ima stvarno kul tehnička svojstva. Imao je motor, senzore dodira i infracrvenu kameru. Još jedna od stvari koju je imao bio je senzor naginjanja, pa je znao u kom smeru je okrenut. Ako biste ga držali naopačke, počeo bi da plače. Mislila sam da je ovo jako zabavno, pa sam ga pokazala prijatelju, i rekla sam: „Drži ga za rep. Videćeš šta radi.“ I tako smo gledali performans ovog robota koji se borio i plakao. Nakon nekoliko sekundi, počelo je malo da mi smeta, pa sam rekla: „Okej, sad je dosta. Hajde da ga spustimo dole.“ Zatim sam mazila robota da bi prestao da plače.
And that was kind of a weird experience for me. For one thing, I wasn't the most maternal person at the time. Although since then I've become a mother, nine months ago, and I've learned that babies also squirm when you hold them upside down.
I to mi je bilo prilično čudno iskustvo. Prvo, tada baš i nisam imala majčinski instinkt. Iako sam od tada postala majka, pre devet meseci, i shvatila da se i bebe vrpolje kada ih držite naopačke.
(Laughter)
(Smeh)
But my response to this robot was also interesting because I knew exactly how this machine worked, and yet I still felt compelled to be kind to it. And that observation sparked a curiosity that I've spent the past decade pursuing. Why did I comfort this robot? And one of the things I discovered was that my treatment of this machine was more than just an awkward moment in my living room, that in a world where we're increasingly integrating robots into our lives, an instinct like that might actually have consequences, because the first thing that I discovered is that it's not just me.
Moja reakcija na ovog robota je bila zanimljiva i zato što sam tačno znala kako ova mašina radi, a ipak sam se osećala primorano da budem dobra prema njoj. To opažanje je izazvalo radoznalost koju sam sledila proteklih deset godina. Zašto sam tešila ovog robota? Jedna od stvari koju sam otkrila je da je moje ponašanje prema ovoj mašini bilo više od neprijatnog trenutka u mojoj dnevnoj sobi, da u svetu u kome robote sve više uključujemo u svoje živote takav instinkt u stvari može imati posledice, jer sam prvo otkrila da nisam samo ja u pitanju.
In 2007, the Washington Post reported that the United States military was testing this robot that defused land mines. And the way it worked was it was shaped like a stick insect and it would walk around a minefield on its legs, and every time it stepped on a mine, one of the legs would blow up, and it would continue on the other legs to blow up more mines. And the colonel who was in charge of this testing exercise ends up calling it off, because, he says, it's too inhumane to watch this damaged robot drag itself along the minefield. Now, what would cause a hardened military officer and someone like myself to have this response to robots?
List „Vašington post“ je 2007. godine izvestio da je vojska SAD-a testirala nekog robota koji je uklanjao mine. Radio je tako što je imao oblik izduženog insekta koji bi šetao po minskom polju na svojim nogama, a svaki put kad bi stao na minu, jedna noga bi mu eksplodirala, i nastavio bi na ostalim nogama da razminira još mina. Pukovnik koji je bio zadužen za ovu vežbu ju je na kraju otkazao, jer, kako kaže, previše je nehumano gledati oštećenog robota kako se vuče minskim poljem. E sad, šta bi nateralo očeličenog vojnika i nekog kao što sam ja na ovakvu reakciju na robote?
Well, of course, we're primed by science fiction and pop culture to really want to personify these things, but it goes a little bit deeper than that. It turns out that we're biologically hardwired to project intent and life onto any movement in our physical space that seems autonomous to us. So people will treat all sorts of robots like they're alive. These bomb-disposal units get names. They get medals of honor. They've had funerals for them with gun salutes. And research shows that we do this even with very simple household robots, like the Roomba vacuum cleaner.
Pa, naravno, naveli su nas naučna fantastika i masovna kultura da zaista želimo da personifikujemo ove stvari, ali istina ide malo dublje od toga. Ispostavlja se da nam je biološki urođeno da projektujemo smisao i život na bilo šta što se kreće u fizičkom svetu što nam se čini samostalno. Tako da će ljudi tretirati sve vrste robota kao da su živi. Ovi koji uklanjaju bombe dobijaju imena. Dobijaju medalje časti. Organizovane su im sahrane uz počasnu paljbu. Istraživanje pokazuje da radimo isto to čak i sa prostim kućnim robotima, kao što je usisivač Rumba.
(Laughter)
(Smeh)
It's just a disc that roams around your floor to clean it, but just the fact it's moving around on its own will cause people to name the Roomba and feel bad for the Roomba when it gets stuck under the couch.
To je samo disk koji tumara vašim podom i čisti ga, ali sama činjenica da se sam kreće okolo navešće ljude da mu daju ime i da ga sažaljevaju kad se zaglavi ispod kauča.
(Laughter)
(Smeh)
And we can design robots specifically to evoke this response, using eyes and faces or movements that people automatically, subconsciously associate with states of mind. And there's an entire body of research called human-robot interaction that really shows how well this works. So for example, researchers at Stanford University found out that it makes people really uncomfortable when you ask them to touch a robot's private parts.
Možemo posebno dizajnirati robote da izazovu ovu reakciju, koristeći oči, lice ili pokrete koje ljudi automatski, podsvesno povezuju sa stanjem svesti. Postoji čitava oblast istraživanja zvana interakcija čoveka i robota koja pokazuje kako ovo funkcioniše. Na primer, istraživači sa Stenforda su otkrili da je ljudima jako neprijatno ako im tražite da dotaknu intimne delove robota.
(Laughter)
(Smeh)
So from this, but from many other studies, we know, we know that people respond to the cues given to them by these lifelike machines, even if they know that they're not real.
Iz ovog, ali i mnogih drugih istraživanja, znamo da ljudi reaguju na date signale ovih čovekolikih mašina, iako znaju da nisu prave.
Now, we're headed towards a world where robots are everywhere. Robotic technology is moving out from behind factory walls. It's entering workplaces, households. And as these machines that can sense and make autonomous decisions and learn enter into these shared spaces, I think that maybe the best analogy we have for this is our relationship with animals. Thousands of years ago, we started to domesticate animals, and we trained them for work and weaponry and companionship. And throughout history, we've treated some animals like tools or like products, and other animals, we've treated with kindness and we've given a place in society as our companions. I think it's plausible we might start to integrate robots in similar ways.
Uskoro ćemo živeti u svetu u kome su roboti svuda. Robotska tehnologija se širi van fabričkih zidova. Ulazi u poslovni svet, domaćinstva. Pošto ove mašine koje mogu da osećaju, samostalno donose odluke i uče stupaju u zajednički prostor, mislim da je najbolja analogija za ovo naša veza sa životinjama. Pre više hiljada godina, počeli smo da pripitomljavamo životinje, da ih dresiramo za rad, oružje i drugarstvo. Kroz istoriju, neke životinje smo tretirali kao alate ili proizvode, a druge sa ljubaznošću i pružili im mesto u društvu kao našim drugarima. Moguće je da ćemo verovatno početi da integrišemo robote na sličan način.
And sure, animals are alive. Robots are not. And I can tell you, from working with roboticists, that we're pretty far away from developing robots that can feel anything. But we feel for them, and that matters, because if we're trying to integrate robots into these shared spaces, we need to understand that people will treat them differently than other devices, and that in some cases, for example, the case of a soldier who becomes emotionally attached to the robot that they work with, that can be anything from inefficient to dangerous. But in other cases, it can actually be useful to foster this emotional connection to robots. We're already seeing some great use cases, for example, robots working with autistic children to engage them in ways that we haven't seen previously, or robots working with teachers to engage kids in learning with new results. And it's not just for kids. Early studies show that robots can help doctors and patients in health care settings.
Naravno, životinje su žive. Roboti nisu. Mogu vam reći, pošto sam radila sa robotičarima, da smo prilično daleko od stvaranja robota koji mogu bilo šta da osete. Ali mi saosećamo sa njima, i to je važno, jer ako pokušavamo da integrišemo robote u ove zajedničke prostore, moramo razumeti da će ih ljudi tretirati drugačije od ostalih uređaja, a to u nekim slučajevima, na primer, u slučaju vojnika koji se emocionalno veže za robota sa kojim radi, samo može da bude neefikasno i opasno. U drugim slučajevima, može čak biti i korisno negovanje ove emotivne veze sa robotima. Već imamo sjajne načine korišćenja robota, na primer, roboti koji rade sa autističnom decom kako bi ih aktivirali na nove načine, ili oni koji pomažu nastavnicima da uključe decu u proces učenja sa novim rezultatima. I to nije samo za decu. Rane studije pokazuju da roboti mogu pomoći doktorima i pacijentima u zdravstvenoj zaštiti.
This is the PARO baby seal robot. It's used in nursing homes and with dementia patients. It's been around for a while. And I remember, years ago, being at a party and telling someone about this robot, and her response was, "Oh my gosh. That's horrible. I can't believe we're giving people robots instead of human care." And this is a really common response, and I think it's absolutely correct, because that would be terrible. But in this case, it's not what this robot replaces. What this robot replaces is animal therapy in contexts where we can't use real animals but we can use robots, because people will consistently treat them more like an animal than a device.
Ovo je robotska beba foke PARO. Koristi se u staračkim domovima i sa dementnim pacijentima. Koristi se već neko vreme. Sećam se da sam, pre dosta godina, bila na nekoj žurci i pričala nekome o ovom robotu, a njen odgovor je bio: „Zaboga. To je strašno, Ne mogu da verujem da ljudima umesto ljudske nege dajemo robote.“ Ovo je veoma česta reakcija, i mislim da je potpuno ispravna, jer bi to bilo strašno. Ali u ovom slučaju, nije do toga šta robot zamenjuje. Robot zamenjuje terapiju životinja u kontekstima u kojima ne možemo koristiti prave životinje ali možemo robote, jer će ih ljudi dosledno tretirati više kao životinju nego kao uređaj.
Acknowledging this emotional connection to robots can also help us anticipate challenges as these devices move into more intimate areas of people's lives. For example, is it OK if your child's teddy bear robot records private conversations? Is it OK if your sex robot has compelling in-app purchases?
Prepozavanje ove emotivne veze sa robotima može nam pomoći i da predvidimo izazove kako ovi uređaji ulaze u intimnije sfere ljudskih života. Na primer, je li u redu ako robot meda vašeg deteta snima privatne razgovore? Je li u redu ako vaš robot za seks ima
(Laughter)
primamljive ponude za kupovinu u sastavu aplikacije?
(Smeh)
Because robots plus capitalism equals questions around consumer protection and privacy.
Jer roboti plus kapitalizam daju pitanja vezana za zaštitu potrošača i privatnost.
And those aren't the only reasons that our behavior around these machines could matter. A few years after that first initial experience I had with this baby dinosaur robot, I did a workshop with my friend Hannes Gassert. And we took five of these baby dinosaur robots and we gave them to five teams of people. And we had them name them and play with them and interact with them for about an hour. And then we unveiled a hammer and a hatchet and we told them to torture and kill the robots.
I to nisu jedini razlozi zbog kojih je naše ponašanje sa ovim mašinama važno. Par godina nakon svog prvog iskustva sa robotom bebe dinosaurusa, imala sam radionicu sa prijateljem Hanesom Gasertom. Uzeli smo pet ovih robotskih beba dinosaurusa i podelili ih ljudima u pet timova. Tražili smo da im daju imena, da se igraju i druže s njima oko sat vremena. Onda smo im dali čekić i sekiru i rekli im da muče i ubiju robote.
(Laughter)
(Smeh)
And this turned out to be a little more dramatic than we expected it to be, because none of the participants would even so much as strike these baby dinosaur robots, so we had to improvise a little, and at some point, we said, "OK, you can save your team's robot if you destroy another team's robot."
Ovo se ispostavilo malo dramatičnijim nego što smo očekivali, jer niko od učesnika nije hteo čak ni da udari robote beba dinosaurusa, pa smo morali malo da improvizujemo, i u jednom momentu smo rekli: „Okej, možete spasiti robota svog tima ako uništite robota drugog tima.“
(Laughter)
(Smeh)
And even that didn't work. They couldn't do it. So finally, we said, "We're going to destroy all of the robots unless someone takes a hatchet to one of them." And this guy stood up, and he took the hatchet, and the whole room winced as he brought the hatchet down on the robot's neck, and there was this half-joking, half-serious moment of silence in the room for this fallen robot.
Čak ni to nije uspelo. Nisu mogli. Na kraju smo rekli: „Mi ćemo uništiti sve robote ukoliko neko ne podigne sekiru na jednog.“ Jedan tip je ustao i podigao sekiru, i cela prostorija je drhtala dok je spuštao sekiru na robotov vrat, i onda se javio polusmešan, poluozbiljan momenat tišine u prostoriji za palog robota.
(Laughter)
(Smeh)
So that was a really interesting experience. Now, it wasn't a controlled study, obviously, but it did lead to some later research that I did at MIT with Palash Nandy and Cynthia Breazeal, where we had people come into the lab and smash these HEXBUGs that move around in a really lifelike way, like insects. So instead of choosing something cute that people are drawn to, we chose something more basic, and what we found was that high-empathy people would hesitate more to hit the HEXBUGS.
To je bilo baš zanimljivo iskustvo. To očigledno nije bila kontrolisana studija, ali je kasnije dovela do mog istraživanja na MIT-u sa Palašem Nandijem i Sintijom Brezil, kada su ljudi dolazili u laboratoriju i uništavali robote HEXBUG koje se kreću kao da su živi, kao insekti. Umesto da izaberemo nešto slatko što privlači ljude, izabrali smo nešto prostije, i saznali smo da ljudi sa razvijenom empatijom više oklevaju da udare robote HEXBUG.
Now this is just a little study, but it's part of a larger body of research that is starting to indicate that there may be a connection between people's tendencies for empathy and their behavior around robots. But my question for the coming era of human-robot interaction is not: "Do we empathize with robots?" It's: "Can robots change people's empathy?" Is there reason to, for example, prevent your child from kicking a robotic dog, not just out of respect for property, but because the child might be more likely to kick a real dog?
To je samo mala studija, ali je deo većeg istraživanja koje počinje da pokazuje da može postojati veza između sklonosti ljudi ka empatiji i njihovog ponašanja prema robotima. Ali moje pitanje za buduću eru interakcije između čoveka i robota nije: „Da li saosećamo sa robotima?“ Nego: „Da li roboti mogu promeniti ljudsku empatiju?“ Da li postoji razlog da, na primer, branimo detetu da šutne psa robota, ne samo iz poštovanja prema vlasništvu, već zato što je veća šansa da će šutnuti pravog psa?
And again, it's not just kids. This is the violent video games question, but it's on a completely new level because of this visceral physicality that we respond more intensely to than to images on a screen. When we behave violently towards robots, specifically robots that are designed to mimic life, is that a healthy outlet for violent behavior or is that training our cruelty muscles? We don't know ... But the answer to this question has the potential to impact human behavior, it has the potential to impact social norms, it has the potential to inspire rules around what we can and can't do with certain robots, similar to our animal cruelty laws. Because even if robots can't feel, our behavior towards them might matter for us. And regardless of whether we end up changing our rules, robots might be able to help us come to a new understanding of ourselves.
I opet, nisu u pitanju samo deca. Ovo je pitanje nasilnih video igrica, ali na potpuno novom nivou zbog te primarne fizikalnosti na koju intenzivnije reagujemo nego na slike na ekranu. Kada se ponašamo nasilno prema robotima, posebno onima dizajniranim da imitiraju živa bića, da li je to zdrav izduvni ventil za nasilno ponašanje ili tako treniramo mišiće za okrutnost? Ne znamo... Odgovor na ovo pitanje može uticati na ljudsko ponašanje, kao i na društvene norme, može uticati na pravila o tome šta možemo a šta ne sa određenim robotima, kao u zakonima o zlostavljanju životinja. Jer iako roboti ne mogu da osećaju, naše ponašanje prema njima može biti važno za nas. Bez obzira na to da li ćemo na kraju promeniti pravila, roboti mogu da nam pomognu da bolje razumemo sami sebe.
Most of what I've learned over the past 10 years has not been about technology at all. It's been about human psychology and empathy and how we relate to others. Because when a child is kind to a Roomba, when a soldier tries to save a robot on the battlefield, or when a group of people refuses to harm a robotic baby dinosaur, those robots aren't just motors and gears and algorithms. They're reflections of our own humanity.
Većina onoga što sam naučila u poslednjih 10 godina uopšte nema veze sa tehnologijom. Nego o ljudskoj psihologiji, o empatiji i o tome kako se odnosimo prema drugima. Jer kada je dete ljubazno prema Rumbi, kada vojnik pokuša da spase robota na bojnom polju, ili kada grupa ljudi odbije da povredi robotsku bebu dinosaurusa, ti roboti nisu samo motori, zupčanici i algoritmi. Oni su odraz naše ljudskosti.
Thank you.
Hvala vam.
(Applause)
(Aplauz)