I thought I'd begin with a scene of war. There was little to warn of the danger ahead. The Iraqi insurgent had placed the IED, an Improvised Explosive Device, along the side of the road with great care. By 2006, there were more than 2,500 of these attacks every single month, and they were the leading cause of casualties among American soldiers and Iraqi civilians. The team that was hunting for this IED is called an EOD team— Explosives Ordinance Disposal—and they're the pointy end of the spear in the American effort to suppress these roadside bombs. Each EOD team goes out on about 600 of these bomb calls every year, defusing about two bombs a day. Perhaps the best sign of how valuable they are to the war effort, is that the Iraqi insurgents put a $50,000 bounty on the head of a single EOD soldier.
Mislio sam početi sa prikazom rata. Malo toga je upozoravalo na opasnost sprijeda. Irački su pobunjenici postavili IED, Improvised Explosive Device (Improvizirani eksplozivni uređaj), pokraj ceste s velikom pažnjom. Do 2006, bilo je više od 2.500 takvih napada svaki pojedini mjesec, i oni su bili vodeći uzrok žrtava među američkim vojnicima i iračkim civilima. Tim koji je lovio za takvim IED-ima se zove EOD tim -- Explosives Ordinance Disposal (uklanjanje eksplozivnih naprava) -- i oni su oštri vrh koplja u američkom naporu da suzbije takve drumske bombe. Svaki EOD tim izlazi na otprilike 600 takvih bombaških poziva svake godine, razoružavajući otprilike dvije bombe dnevno. Možda je najbolji znak koliko su vrijedni u ratnom pothvatu, je kako su irački pobunjenici stavili nagradu od 50.000 dolara na glavu pojedinog EOD vojnika.
Unfortunately, this particular call would not end well. By the time the soldier advanced close enough to see the telltale wires of the bomb, it exploded in a wave of flame. Now, depending how close you are and how much explosive has been packed into that bomb, it can cause death or injury. You have to be as far as 50 yards away to escape that. The blast is so strong it can even break your limbs, even if you're not hit. That soldier had been on top of the bomb.
Nažalost, ovaj naročit poziv neće završiti dobro. Do vremena kad vojnici napreduju dovoljno blizu da vide izdajničke žice bombe, eksplodirala je u valu plamena. Sad, ovisno koliko ste blizu i koliko je eksploziva bilo postavljeno u tu bombu, može uzrokovati smrt ili ozlijedu. Morali bi biti čak oko 50 jarda (~46 metara) udaljeni da to izbjegnete. Udar je tako jak da može čak slomiti udove, čak i ako niste pogođeni. Ovaj je vojnik bio točno na bombi.
And so when the rest of the team advanced they found little left. And that night the unit's commander did a sad duty, and he wrote a condolence letter back to the United States, and he talked about how hard the loss had been on his unit, about the fact that they had lost their bravest soldier, a soldier who had saved their lives many a time. And he apologized for not being able to bring them home. But then he talked up the silver lining that he took away from the loss. "At least," as he wrote, "when a robot dies, you don't have to write a letter to its mother."
Tako da dok je ostatak tima napredovao našli su malo ostataka. A te je noći zapovjednik jedinice izvršio tužnu dužnost i napisao pismenu sućut za poslati u Sjedinjene države, gdje je pričao kako je težak to bio gubitak za jedinicu, te o činjenici kako su izgubili svog najhrabrijeg vojnika, vojnika koji im je spasio živote više puta. I ispričao se zato što nije u mogućnosti vratiti ih doma. Ali tada je pričao o sretnom detalju koji je uočio u ovom gubitku. "Barem", pisao je, "kad pogine robot, ne morate pisati pismo njegovoj majci."
That scene sounds like science fiction, but is battlefield reality already. The soldier in that case was a 42-pound robot called a PackBot. The chief's letter went, not to some farmhouse in Iowa like you see in the old war movies, but went to the iRobot Company, which is named after the Asimov novel and the not-so-great Will Smith movie, and... um... (Laughter)... if you remember that in that fictional world, robots started out carrying out mundane chores, and then they started taking on life-and-death decisions. That's a reality we face today.
Ova scena zvuči poput znanstvene fantastike, ali to je stvarnost na bojištu već sada. Vojnik je u ovom slučaju bio 42 funte (~19 kg) težak robot imenom PackBot. Zapovjednikovo pismo nije išlo na neku farmu u Iowu, kao što vidite u starim ratnim filmovima, nego je išlo kompaniji iRobot, koja je dobila ime po Asimovljevoj zbirci pripovjedaka i ne tako dobrom filmu s Will Smithom, i... hm.. (Smijeh)... Ako se sjećate kako u izmišljenom svijetu, roboti su počeli izvršavati svakodnevne zadatke, a onda su počeli donositi odluke o životu ili smrti. To je stvarnost kojoj smo sučeljeni danas.
What we're going to do is actually just flash a series of photos behind me that show you the reality of robots used in war right now or already at the prototype stage. It's just to give you a taste. Another way of putting it is you're not going to see anything that's powered by Vulcan technology, or teenage wizard hormones or anything like that. This is all real. So why don't we go ahead and start those pictures.
Što ćemo učiniti je zbilja samo brza serija fotografija iza mene koje pokazuje stvarnost upotrebe robota u ratu upravo sada ili već u fazi prototipa. To je samo da vam da uvid. Drugi način kako to prikazati je kako ovdje nećete vidjeti ništa što je pogonjeno Vulkanskom tehnologijom, ili tinejdžerskim čarobnjačkim hormonima ili već čim tome nalik. Ovo je sve stvarno. Pa zašto ne bismo nastavili i počeli sa tim slikama.
Something big is going on in war today, and maybe even the history of humanity itself. The U.S. military went into Iraq with a handful of drones in the air. We now have 5,300. We went in with zero unmanned ground systems. We now have 12,000. And the tech term "killer application" takes on new meaning in this space.
Nešto se veliko događa s ratom danas, a možda čak i sa samom poviješću čovječanstva. Vojska Sjedinjenih država je otišla u Irak sa šačicom bespilotnih letjelica. Danas ih imamo 5.300. Otišli smo sa nula kopnenih sustava bez posade. Sad ih imamo 12.000. A tehnološki termin "ubojita aplikacija" dobija novo značenje u ovom prostoru.
And we need to remember that we're talking about the Model T Fords, the Wright Flyers, compared to what's coming soon. That's where we're at right now. One of the people that I recently met with was an Air Force three-star general, and he said basically, where we're headed very soon is tens of thousands of robots operating in our conflicts, and these numbers matter, because we're not just talking about tens of thousands of today's robots, but tens of thousands of these prototypes and tomorrow's robots, because of course, one of the things that's operating in technology is Moore's Law, that you can pack in more and more computing power into those robots, and so flash forward around 25 years, if Moore's Law holds true, those robots will be close to a billion times more powerful in their computing than today.
A moramo upamtiti kako pričamo o Fordovim T modelima, Wrightovim letjelicama, u usporedbi s onim što uskoro dolazi. Ovo je gdje se nalazimo upravo sada. Jedan od ljudi s kojima sam se nedavno sreo je bio general-pukovnik zračnih snaga, i rekao je u osnovi, kamo idemo vrlo uskoro su deseci tisuća robota koji djeluju u našim sukobima, a ti brojevi znače, jer ne pričamo samo o desecima tisuća današnjih robota, već desecima tisuća tih prototipova i sutrašnjih robota, jer naravno, jedna od stvari koje djeluju u tehnologiji je Mooreov zakon, kako možete utrpati više i više računalne moći u te robote, i tako premotajmo unaprijed 25 godina, ako se Mooreov zakon održi, ti će roboti biti gotovo milijardu puta moćniji u svojem računanju nego danas.
And so what that means is the kind of things that we used to only talk about at science fiction conventions like Comic-Con have to be talked about in the halls of power and places like the Pentagon. A robots revolution is upon us.
A što to znači je kako vrste stvari o kojima smo navikli pričati samo na znanstveno fantastičnim konvencijama poput Comic-Cona moraju biti raspravljene i u dvoranama moći i mjestima poput Pentagona. Robotska je revolucija ovdje.
Now, I need to be clear here. I'm not talking about a revolution where you have to worry about the Governor of California showing up at your door, a la the Terminator. (Laughter)
Sad, trebam ovdje biti jasan. Ne govorim o revoluciji gdje se morate brinuti o guverneru Kalifornije kako vam se pojavljuje pred vratima, a la Terminator. (Smijeh)
When historians look at this period, they're going to conclude that we're in a different type of revolution: a revolution in war, like the invention of the atomic bomb. But it may be even bigger than that, because our unmanned systems don't just
Kad će povjesničari gledati ovo razdoblje, zaključit će kako smo u drugačijem tipu revolucije: u obratu rata, poput izuma atomske bombe. Ali može biti čak i veća od toga, stoga što sustavi bez posade ne utječu samo
affect the "how" of war-fighting, they affect the "who" of fighting at its most fundamental level. That is, every previous revolution in war, be it the machine gun, be it the atomic bomb, was about a system that either shot faster, went further, had a bigger boom. That's certainly the case with robotics, but they also change the experience of the warrior and even the very identity of the warrior.
na to "kako" se vodi rat, već utječu na "tko" se bori na najtemeljnijoj razini. To jest, svaki prethodni obrat ratovanja, bila to strojnica, bila to atomska bomba, je bio o sustavu koji ili puca brže, ide dalje, ima veći bum. To je sigurno slučaj i sa robotikom, ali također mijenja iskustvo ratnika i čak i sam identitet ratnika.
Another way of putting this is that mankind's 5,000-year-old monopoly on the fighting of war is breaking down in our very lifetime. I've spent the last several years going around meeting with all the players in this field, from the robot scientists to the science fiction authors who inspired them to the 19-year-old drone pilots who are fighting from Nevada, to the four-star generals who command them, to even the Iraqi insurgents who they are targeting and what they think about our systems, and what I found interesting is not just their stories, but how their experiences point to these ripple effects that are going outwards in our society, in our law and our ethics, etc. And so what I'd like to do with my remaining time is basically flesh out a couple of these.
Drugi način da to kažemo je kako se 5.000 godina star monopol čovječanstva na vođenje rata raspada unutar našeg životnog vijeka. Potrošio sam zadnjih nekoliko godina obilazeći uokolo susrećući se sa svim igračima u ovom polju, od znanstvenika oko robota do autora znanstvene fantastike koji su ih nadahnuli do 19-godišnjih pilota dronova koji se bore iz Nevade, do generala zbora koji im zapovijedaju, čak do iračkih pobunjenika koje oni ciljaju i što oni misle o našim sustavima, a što sam našao zanimljivim nisu samo njihove priče, nego kako njihova iskustva ukazuju na učinke tog talasanja koji prelaze u naše društvo, u naše zakone, u našu etiku itd. A što bih volio učiniti sa svojim preostalim vremenom je u biti ukazati na neki broj tih učinaka.
So the first is that the future of war, even a robotics one, is not going to be purely an American one. The U.S. is currently ahead in military robotics right now, but we know that in technology there's no such thing as a permanent first move or advantage. In a quick show of hands, how many people in this room still use Wang Computers? (Laughter) It's the same thing in war. The British and the French invented the tank. The Germans figured out how to use it right, and so what we have to think about for the U.S. is that we are ahead right now, but you have 43 other countries out there working on military robotics, and they include all the interesting countries like Russia, China, Pakistan, Iran.
prvi je kako budućnost rata, pa čak i robotskog, neće biti čisto američka. Sjedinjene države trenutno predvode u vojnoj robotici, ali znamo kako u tehnologiji nema takve stvari kao stalna prednost prvog poteza. Kratkim dizanjem ruku, koliko ljudi u ovoj prostoriji i dalje koriste Wang računala? (Smijeh) Ista je stvar u ratu. Britanci i Francuzi su izmislili tenk. Njemci su shvatili kako ga pravilno koristiti, a ono o čemu moramo razmisliti za Sjedinjene države je kako predvodimo upravo sada, ali imate 43 druge zemlje koje rade na vojnoj robotici, a to uključuje sve zanimljive zemlje poput Rusije, Kine, Pakistana, Irana.
And this raises a bigger worry for me. How do we move forward in this revolution given the state of our manufacturing and the state of our science and mathematics training in our schools? Or another way of thinking about this is, what does it mean to go to war increasingly with soldiers whose hardware is made in China and software is written in India?
A to stvara veću brigu za mene. Kako da se krećemo naprijed u ovoj revoluciji uzevši u obzir stanje naše proizvodnje i stanje našeg znanstvenog i matematičkog obrazovanja u našim školama. Ili drugačiji način razmišljanja o ovome je, što to znači ići u rat sve više sa vojnicima čiji je hardver napravljen u Kini a softver napisan u Indiji?
But just as software has gone open-source, so has warfare. Unlike an aircraft carrier or an atomic bomb, you don't need a massive manufacturing system to build robotics. A lot of it is off the shelf. A lot of it's even do-it-yourself. One of those things you just saw flashed before you was a raven drone, the handheld tossed one. For about a thousand dollars, you can build one yourself, equivalent to what the soldiers use in Iraq.
Ali jednako kako je softver prešao u otvoreni kod, tako je i ratovanje. Za razliku od nosača aviona ili atomske bombe, ne trebate krupni proizvodni sustav da gradite robotiku. Velik je dio nje sa polica. Velik je dio nje čak uradi-sam. Jedna od ovih stvari koje ste upravo vidjeli kako vam je proletjela ispred vas je bila bespilotna letjelica Gavran, na ručni izbačaj. Za oko tisuću dolara, možete si sagraditi jednu, ekvivalentnu onoj koju vojnici koriste u Iraku.
That raises another wrinkle when it comes to war and conflict. Good guys might play around and work on these as hobby kits, but so might bad guys. This cross between robotics and things like terrorism is going to be fascinating and even disturbing, and we've already seen it start.
To stvara novu brigu kad dolazi do rata i konflikta. Dobri momci se mogu igrati uokolo i raditi na ovima iz hobija, ali isto tako to mogu i loši momci. Ovo križanje između robotike i stvari poput terorizma će biti očaravajuće i čak uznemirujuće i već smo ga vidjeli kako počinje.
During the war between Israel, a state, and Hezbollah, a non-state actor, the non-state actor flew four different drones against Israel. There's already a jihadi website that you can go on and remotely detonate an IED in Iraq while sitting at your home computer.
Tijekom rata između Izraela, države, i Hezbolaha, nedržavnog sudionika, nedržavni sudionik je koristio četiri različite bespilotne letjelice protiv Izraela. Već postoji džihadistička web stranica gdje možete otići i daljinski detonirati IED u Iraku dok sjedite za svojim kućnim računalom.
And so I think what we're going to see is two trends take place with this. First is, you're going to reinforce the power of individuals against governments, but then the second is that we are going to see an expansion in the realm of terrorism. The future of it may be a cross between al Qaeda 2.0 and the next generation of the Unabomber. And another way of thinking about this is the fact that, remember, you don't have to convince a robot that they're gonna receive 72 virgins after they die to convince them to blow themselves up.
Tako da mislim što ćemo vidjeti su dva trenda unutar ovoga. Prvi je, osnažiti ćete pojedince protiv vlada, ali drugi je kako ćemo vidjeti širenje u carstvu terorizma. Njegova budućnost može biti križanac između al Qaede 2.0 i slijedeće generacije Unabombera. A drugi je način razmišljanja o ovome činjenica kako, zapamtite, ne morate uvjeriti robota kako će dobiti 72 djevice nakon što umre a da bi ga uvjerili da se raznese.
But the ripple effects of this are going to go out into our politics. One of the people that I met with was a former Assistant Secretary of Defense for Ronald Reagan, and he put it this way: "I like these systems because they save American lives, but I worry about more marketization of wars, more shock-and-awe talk, to defray discussion of the costs. People are more likely to support the use of force if they view it as costless."
Ali učinci talasanja ovoga će izaći i u našu politiku. Jedan od ljudi koje sam sreo je bio pomoćnik ministra obrane za Ronalda Reagana, i on je stvari postavio ovako: "Sviđaju mi se ovi sustavi jer spašavaju američke živote, ali brinem se radi veće tržišnosti ratova, uzdizanja šoka i strahopoštovanja u javnom govoru, da se rasprava udalji od troškova. Vjerojatnije je kako će ljudi podržati upotrebu sile ako je vide kao besplatnu."
Robots for me take certain trends that are already in play in our body politic, and maybe take them to their logical ending point. We don't have a draft. We don't have declarations of war anymore. We don't buy war bonds anymore. And now we have the fact that we're converting more and more of our American soldiers that we would send into harm's way into machines, and so we may take those already lowering bars to war and drop them to the ground.
Roboti se po meni uklapaju u određene trendove koji se već odigravaju u našoj politici, i možda ih dovode do njihove logične krajnje točke. Nemamo novačenje. Nemamo više niti objave rata. Više ne kupujemo ratne obveznice. A sad imamo činjenicu kako preokrećemo sve više naših Američkih vojnika koje bismo poslali u opasnost u strojeve, i možemo uzeti već snižene ljestvice do rata i baciti ih na zemlju.
But the future of war is also going to be a YouTube war. That is, our new technologies don't merely remove humans from risk. They also record everything that they see. So they don't just delink the public: they reshape its relationship with war. There's already several thousand video clips of combat footage from Iraq on YouTube right now, most of it gathered by drones.
Ali budućnost rata će također biti i YouTube rat. To jest, naše nove tehnologije ne da tek miču ljude od rizika. One također i snimaju sve što vide. Tako da nije da samo odspajaju javnost: oni mijenjaju njen odnos s ratom. Već ima više tisuća videoisječaka snimki bitaka iz Iraka na YouTube-u u ovom trenu, većinom skupljenih bespilotnim letjelicama.
Now, this could be a good thing. It could be building connections between the home front and the war front as never before. But remember, this is taking place in our strange, weird world, and so inevitably the ability to download these video clips to, you know, your iPod or your Zune gives you the ability to turn it into entertainment.
Sad, ovo bi mogla biti dobra stvar. Mogla bi stvoriti vezu između doma i bojišta kao nikad ranije. Ali zapamtite, ovo se odvija u našem čudnom, neobičnom svijetu, pa tako neizbježno mogućnost skidanja tih videoklipova na, znate, vaš iPod ili vaš Zune daje vam mogućnost da to pretvorite u zabavu.
Soldiers have a name for these clips. They call it war porn. The typical one that I was sent was an email that had an attachment of video of a Predator strike taking out an enemy site. Missile hits, bodies burst into the air with the explosion. It was set to music. It was set to the pop song "I Just Want To Fly" by Sugar Ray.
Vojnici imaju ime za te klipove. Zovu ih ratni porn. Jedan tipičan koji mi je poslan je bio email sa privitkom snimke napada Predatora koji je uništio neprijateljski položaj. Projektil pogađa, tijela pršte u zrak sa eksplozijom. Stavljena je glazba. Stavljena je pop stvar "I just Want to Fly" od Sugar Raya.
This ability to watch more but experience less creates a wrinkle in the public's relationship with war. I think about this with a sports parallel. It's like the difference between watching an NBA game, a professional basketball game on TV, where the athletes are tiny figures on the screen, and being at that basketball game in person and realizing what someone seven feet really does look like.
Ova mogućnost da se gleda više ali iskusi manje stvara brigu glede odnosa javnosti spram rata. Razmišljam o tome u paraleli sa sportom. To je kao razlika između gledanja NBA utakmice, profesionalne košarkaške utakmice na TV, gdje su sportaši mali likovi na ekranu, i osobnog bivanja na košarkaškoj utakmici i shvatiti kako netko od 2,15 m zbilja izgleda.
But we have to remember, these are just the clips. These are just the ESPN SportsCenter version of the game. They lose the context. They lose the strategy. They lose the humanity. War just becomes slam dunks and smart bombs.
Ali moramo zapamtiti, ovo su samo snimke. Ovo je samo ESPN SportsCenterova verzija utakmice. Gube kontekst. Gube strategiju. Gube čovječnost. Rat samo postaje zakucavanja i pametne bombe.
Now the irony of all this is that while the future of war may involve more and more machines, it's our human psychology that's driving all of this, it's our human failings that are leading to these wars.
Sad, ironija je u svemu tome dok budućnost rata može uključiti sve više strojeva, naša je ljudska psihologija koja pokreće sve to, naši ljudski nedostatci koji dovode do tih ratova.
So one example of this that has big resonance in the policy realm is how this plays out on our very real war of ideas that we're fighting against radical groups. What is the message that we think we are sending with these machines versus what is being received in terms of the message.
Tako je jedan primjer toga koji ima velik odjek u stvarnosti politike je kakvu to ulogu igra u našem vrlo stvarnom ratu ideja koji vodimo protiv radikalnih grupa. Koja je poruka koju mislimo da šaljemo s tim strojevima protiv onog što biva primljeno u pogledu poruke.
So one of the people that I met was a senior Bush Administration official, who had this to say about our unmanning of war: "It plays to our strength. The thing that scares people is our technology." But when you go out and meet with people, for example in Lebanon, it's a very different story. One of the people I met with there was a news editor, and we're talking as a drone is flying above him, and this is what he had to say. "This is just another sign of the coldhearted cruel Israelis and Americans, who are cowards because they send out machines to fight us. They don't want to fight us like real men, but they're afraid to fight, so we just have to kill a few of their soldiers to defeat them."
Tako je jedan od ljudi koje sam sreo bio stariji dužnosnik iz Bushove administracije, koji je imao ovo za reći o našem micanju ljudi iz rata: "To je naš adut. Stvar koja plaši ljude naša je tehnologija." Ali kad izađete među ljude, na primjer u Libanonu, vrlo je različita priča. Jedan od ljudi koje sam sreo je bio taj urednik vijesti, i bili smo pričali dok je bespilotna letjelica letjela nad njim, i ovo je što je imao za reći: "Ovo je samo još jedan znak bezdušnih okrutnih Izraelaca i Amerikanaca, koji su kukavice jer šalju strojeve da se bore s nama. Ne žele se boriti s nama poput pravih ljudi, već ih je strah boriti se, tako da samo trebamo pobiti nekoliko njihovih vojnika kako bismo ih pobijedili."
The future of war also is featuring a new type of warrior, and it's actually redefining the experience of going to war. You can call this a cubicle warrior. This is what one Predator drone pilot described of his experience fighting in the Iraq War while never leaving Nevada. "You're going to war for 12 hours, shooting weapons at targets, directing kills on enemy combatants, and then you get in the car and you drive home and within 20 minutes, you're sitting at the dinner table talking to your kids about their homework."
Budućnost rata također sadrži novu vrstu ratnika, i zapravo redefinira iskustvo odlaska u rat. Možete to nazvati uredski ratnik. Ovo je kako je pilot drona Predatora opisao svoje iskustvo borbe u Iračkom ratu dok uopće nije napustio Nevadu: "Odlazite u rat na 12 sati, pucate iz oružja po metama, usmrćujete neprijateljske borce, a onda sjednete u auto i odvezete se doma i unutar 20 minuta, sjedite za stolom za večerom i pričate sa svojim klincima o njihovoj domaćoj zadaći."
Now, the psychological balancing of those experiences is incredibly tough, and in fact those drone pilots have higher rates of PTSD than many of the units physically in Iraq. But some have worries that this disconnection will lead to something else, that it might make the contemplation of war crimes a lot easier when you have this distance. "It's like a video game," is what one young pilot described to me of taking out enemy troops from afar. As anyone who's played Grand Theft Auto knows, we do things in the video world that we wouldn't do face to face.
Sad, psihološko balansiranje tih iskustava je nevjerojatno teško, i zapravo ti piloti dronova imaju višu stopu PTSP-a od brojnih jedinica fizički u Iraku. Ali neki brinu kako će ta razvezanost dovesti do nečeg drugog, kako može učiniti razmišljanje o ratnim zločinima puno lakšim kad imate to odstojanje."Poput video igre je," je kako mi je jedan mladi pilot opisao uništavanje neprijateljskih postrojbi iz daljine. Kako svatko tko je igrao Grand Theft Auto zna, činimo stvari u video svijetu koje ne bismo činili uživo.
So much of what you're hearing from me is that there's another side to technologic revolutions, and that it's shaping our present and maybe will shape our future of war. Moore's Law is operative, but so's Murphy's Law. The fog of war isn't being lifted. The enemy has a vote.
Toliko toga što čujete od mene je kako postoji druga strana tehnoloških revolucija, i kako nam oblikuje sadašnjost a možda će oblikovati i našu budućnost rata. Mooreov zakon djeluje, ali djeluje i Murphyjev. Ratna magla se nije maknula. Neprijatelj ima glas.
We're gaining incredible new capabilities, but we're also seeing and experiencing new human dilemmas. Now, sometimes these are just "oops" moments, which is what the head of a robotics company described it, you just have "oops" moments. Well, what are "oops" moments with robots in war? Well, sometimes they're funny. Sometimes, they're like that scene from the Eddie Murphy movie "Best Defense," playing out in reality, where they tested out a machine gun-armed robot, and during the demonstration it started spinning in a circle and pointed its machine gun at the reviewing stand of VIPs. Fortunately the weapon wasn't loaded and no one was hurt, but other times "oops" moments are tragic, such as last year in South Africa, where an anti-aircraft cannon had a "software glitch," and actually did turn on and fired, and nine soldiers were killed.
Stječemo nevjerojatne nove sposobnosti, ali također vidimo i proživljavamo nove ljudske dileme. Sad, nekad su to samo "ups!" trenuci, što je kako je to šef robotičke kompanije opisao, samo imate "ups!" trenutke. Dobro, što su "ups!" trenuci s robotima u ratu? Pa, ponekad su fora. Ponekad, nalik su sceni iz Eddie Murphyjevog filma "Najbolja obrana", koja se odigrava u stvarnosti, gdje su isprobali strojnicom naoružanog robota, i tijekom javnog prikazivanja se počeo vrtjeti u krug i usmjerio svoju strojnicu u tribinu punu VIP-ovaca. Srećom oružje nije bilo napunjeno i nitko nije ozlijeđen, ali u drugim prilikama "ups!" momenti su tragični, kao prošle godine u Južnoj Africi, gdje je protuzračni top imao "softverski kvar", i zapravo se upalio i zapucao i ubio devet vojnika.
We have new wrinkles in the laws of war and accountability. What do we do with things like unmanned slaughter? What is unmanned slaughter? We've already had three instances of Predator drone strikes where we thought we got bin Laden, and it turned out not to be the case. And this is where we're at right now. This is not even talking about armed, autonomous systems with full authority to use force. And do not believe that that isn't coming. During my research I came across four different Pentagon projects on different aspects of that.
Imamo nove brige u ratnim pravilima i uračunljivosti. Što činimo sa stvarima poput bespilotnog pokolja? Što je bespilotni pokolj? Već smo imali tri slučaja napada Predatorom gdje smo mislili kako imamo Bin Ladena, a da je ispalo kako to nije slučaj. I to je gdje smo upravo sada. Ovo čak i nije razgovor o naoružanim autonomnim sustavima sa punim ovlastima upotrebe sile. A ne vjerujte da to ne dolazi. Tijekom mog istraživanja naišao sam na četiri različita projekta iz Pentagona o različitim vidovima toga.
And so you have this question: what does this lead to issues like war crimes? Robots are emotionless, so they don't get upset if their buddy is killed. They don't commit crimes of rage and revenge. But robots are emotionless. They see an 80-year-old grandmother in a wheelchair the same way they see a T-80 tank: they're both just a series of zeroes and ones. And so we have this question to figure out: How do we catch up our 20th century laws of war, that are so old right now that they could qualify for Medicare, to these 21st century technologies?
I onda imate ovo pitanje: čemu to vodi u pitanjima poput ratnih zločina? Roboti su bez emocija, pa se ne uzrujavaju ako su im drugovi ubijeni. Ne čine zločine iz bijesa ili osvete. Ali roboti su bez emocija. Vide 80-godišnju baku u kolicima na isti način kako vide i tenk T-80: oboje su tek nizovi nula i jedinica. Pa imamo ovo pitanje za shvatiti: Kako ćemo sustići naša ratna pravila 20. stoljeća, koja su sada već toliko stara da bi se mogla prijaviti za zdravstvenu skrb, sa ovim tehnologijama 21. stoljeća?
And so, in conclusion, I've talked about what seems the future of war, but notice that I've only used real world examples and you've only seen real world pictures and videos. And so this sets a great challenge for all of us that we have to worry about well before you have to worry about your Roomba sucking the life away from you. Are we going to let the fact that what's unveiling itself right now in war sounds like science fiction and therefore keeps us in denial? Are we going to face the reality of 21st century war? Is our generation going to make the same mistake that a past generation did with atomic weaponry, and not deal with the issues that surround it until Pandora's box is already opened up?
I tako, u zaključku, pričao sam o što se čini budućnošću rata, ali primijetite da sam samo koristio primjere iz stvarnog svijeta a vi ste vidjeli samo slike i filmove iz stvarnog svijeta. A to tako postavlja veliki izazov za sve nas o kojem se moramo brinuti poprilično prije nego brinuti o vašoj Roombi kako siše život iz vas. Hoćemo li pustiti činjenicu koja se razotkriva upravo sada u ratu da zvuči kao znanstvena fantastika i prema tome ostati u poricanju? Hoćemo li se suočiti sa stvarnošću rata u 21. stoljeću? Hoće li naša generacija napraviti istu grešku koju je napravila i prethodna s atomskim oružjem, i ne pozabaviti se problemima koji ju okružuju sve dok Pandorina kutija ne bude već otvorena?
Now, I could be wrong on this, and one Pentagon robot scientist told me that I was. He said, "There's no real social, ethical, moral issues when it comes to robots. That is," he added, "unless the machine kills the wrong people repeatedly. Then it's just a product recall issue."
Sad, mogu o ovome biti u krivu, a jedan pentagonski znanstvenik robotičar mi je rekao da i jesam. Rekao je: "Nema stvarnih društvenih, etičkih, moralnih pitanja kad dođe do robota. To jest, "dodaje, "osim ako stroj opetovano ne ubija krive ljude. Onda je to samo pitanje povlačenja proizvoda."
And so the ending point for this is that actually, we can turn to Hollywood. A few years ago, Hollywood gathered all the top characters and created a list of the top 100 heroes and top 100 villains of all of Hollywood history, the characters that represented the best and worst of humanity. Only one character made it onto both lists: The Terminator, a robot killing machine. And so that points to the fact that our machines can be used for both good and evil, but for me it points to the fact that there's a duality of humans as well.
Zadnja je točka ovoga kako zapravo, možemo se okrenuti Hollywoodu. Prije nekoliko godina, Hollywood je skupio sve glavne likove i stvorio listu glavnih 100 heroja te glavnih 100 zlikovaca holivudske povijesti, likove koji predstavljaju sve najbolje i sve najbolje od čovječanstva. Samo se jedan lik našao na obje liste: Terminator, ubojit robotski stroj. A to ukazuje na činjenicu kako naši strojevi mogu biti korišteni jednako za dobro i za zlo, ali za mene to ukazuje na činjenicu kako postoji takva dvojnost i ljudi.
This week is a celebration of our creativity. Our creativity has taken our species to the stars. Our creativity has created works of arts and literature to express our love. And now, we're using our creativity in a certain direction, to build fantastic machines with incredible capabilities, maybe even one day an entirely new species. But one of the main reasons that we're doing that is because of our drive to destroy each other, and so the question we all should ask: is it our machines, or is it us that's wired for war?
Ova je tjedan proslava našeg stvaralaštva. Naše je stvaralaštvo povelo našu vrstu do zvijezda. Naše je stvaralaštvo stvorilo umjetnička djela i književnost da nam izrazi ljubav. A sada, koristimo naše stvaralaštvo u određenom smjeru, da napravimo fantastične strojeve s nevjerojatnim sposobnostima, možda čak jednog dana jednu posve novu vrstu. Ali jedan je od glavnih razloga što to činimo naš nagon da uništimo jedni druge, tako da je pitanje koje bismo se svi trebali zapitati: Jesu li naši strojevi, ili smo mi oni koji su predodređeni za rat?
Thank you. (Applause)
Hvala vam. (Pljesak)