Many believe driving is an activity solely reserved for those who can see. A blind person driving a vehicle safely and independently was thought to be an impossible task, until now. Hello, my name is Dennis Hong, and we're bringing freedom and independence to the blind by building a vehicle for the visually impaired.
Mnogi veruju da je vožnja aktivnost rezervisana isključivo za one koji vide. Mogućnost slepe osobe koja bezbedno i nezavisno vozi se smatralo nemogućim zadatakom, sve do sada. Zdravo, moje ime je Denis Hong, i mi uvodimo slobodu i nezavisnost za slepe osobe praveći vozilo za osobe sa oštećenim vidom.
So before I talk about this car for the blind, let me briefly tell you about another project that I worked on called the DARPA Urban Challenge. Now this was about building a robotic car that can drive itself. You press start, nobody touches anything, and it can reach its destination fully autonomously. So in 2007, our team won half a million dollars by placing third place in this competition. So about that time, the National Federation of the Blind, or NFB, challenged the research committee about who can develop a car that lets a blind person drive safely and independently. We decided to give it a try, because we thought, "Hey, how hard could it be?" We have already an autonomous vehicle. We just put a blind person in it and we're done, right? (Laughter) We couldn't have been more wrong. What NFB wanted was not a vehicle that can drive a blind person around, but a vehicle where a blind person can make active decisions and drive. So we had to throw everything out the window and start from scratch.
Pre nego što počnem da govorim o automobilu za slepe osobe, ukratko ću vam reći o još jednom projektu na kome sam radio koji se naziva DARPA Urbani Izazov. Ovde se radilo o pravljenju robotskog automobila koji može sam da vozi. Pritisnete start, niko ne dira ništa, i on može da stigne do svog odredišta potpuno autonomno. Naš tim je 2007. godine osvojio pola miliona dolara, osvojivši treće mesto na ovom takmičenju. U to vreme, Nacionalna federacija slepih, ili NFB, uputila je izazov istraživačkom komitetu vezan za to ko može da razvije automobil koji omogućava slepoj osobi da vozi bezbedno i nezavisno. Odlučili smo da pokušamo i mislili smo “Koliko to teško može da bude?“ Mi već imamo autonomno vozilo. Samo stavimo slepu osobu unutra i to je to, je li tako? (Smeh) Nismo mogli više da pogrešimo. Ono što je NFB želela nije vozilo koje može da vozi slepu osobu, već vozilo gde slepa osoba može da donosi aktivne odluke i da upravlja vozilom. Morali smo da se odreknemo svega i da počnemo ispočetka.
So to test this crazy idea, we developed a small dune buggy prototype vehicle to test the feasibility. And in the summer of 2009, we invited dozens of blind youth from all over the country and gave them a chance to take it for a spin. It was an absolutely amazing experience. But the problem with this car was it was designed to only be driven in a very controlled environment, in a flat, closed-off parking lot -- even the lanes defined by red traffic cones.
Da bi testirali ovu ludu ideju, razvili smo malo prototip vozilo za vožnju po pesku da testiramo izvodljivost toga. U leto 2009., pozvali smo desetine slepih mladih ljudi iz cele zemlje i dali smo im šansu da isprobaju vozilo. To je bilo apsolutno neverovatno iskustvo. Problem sa ovim automobilom je bio taj da je bio projektovan samo za vožnju u veoma kontrolisanom okruženju, na ravnom, zatvorenom parkingu – čak su i saobraćajne trake bile definisane crvenim saobraćajnim kupama.
So with this success, we decided to take the next big step, to develop a real car that can be driven on real roads. So how does it work? Well, it's a rather complex system, but let me try to explain it, maybe simplify it. So we have three steps. We have perception, computation and non-visual interfaces. Now obviously the driver cannot see, so the system needs to perceive the environment and gather information for the driver. For that, we use an initial measurement unit. So it measures acceleration, angular acceleration -- like a human ear, inner ear. We fuse that information with a GPS unit to get an estimate of the location of the car. We also use two cameras to detect the lanes of the road. And we also use three laser range finders. The lasers scan the environment to detect obstacles -- a car approaching from the front, the back and also any obstacles that run into the roads, any obstacles around the vehicle.
Sa ovim uspehom, odlučili smo da napravimo sledeći veliki korak, da razvijemo stvarni automobil, koji se može voziti na pravim putevima. Kako to funkcioniše? Dakle, to je veoma složen sistem, ali dozvolite mi da pokušam da objasnim, ili da ga pojednostavim. Postoje tri koraka. Postoje percepcija, obrada i ne-vizuelni interfejsi. Očigleno je da vozač ne može da vidi, tako da sistem mora da opaža okruženje i prikuplja informacije za vozača. Za ovu svrhu, koristi se početna merna jedinica. Ona meri ubrzanje, ugaono ubrzanje – kao ljudsko uho, unutrašnje uho. Te informacije se spajaju sa GPS jedinicom da bi se dobila procena lokacije automobila. Takođe se koriste dve kamere za detektovanje saobraćajnih traka na putu. Koriste se i tri laserska detektora. Laseri skeniraju okruženje da bi detektovali prepreke – vozilo koje se približava sa prednje strane, sa zadnje strane i bilo koje prepreke koje se nalaze na putu, kao i prepreke koje se nalaze oko vozila.
So all this vast amount of information is then fed into the computer, and the computer can do two things. One is, first of all, process this information to have an understanding of the environment -- these are the lanes of the road, there's the obstacles -- and convey this information to the driver. The system is also smart enough to figure out the safest way to operate the car. So we can also generate instructions on how to operate the controls of the vehicle. But the problem is this: How do we convey this information and instructions to a person who cannot see fast enough and accurate enough so he can drive? So for this, we developed many different types of non-visual user interface technology. So starting from a three-dimensional ping sound system, a vibrating vest, a click wheel with voice commands, a leg strip, even a shoe that applies pressure to the foot. But today we're going to talk about three of these non-visual user interfaces.
Ova ogromna količina informacija se zatim šalje u kompjuter, i kompjuter može da radi dve stvari. Jedna je, pre svega, obrada ovih informacija zbog razumevanja okruženja – to su trake na putu, prepreke – i da prenese ove informacije vozaču. Sistem je dovoljno pametan da odredi najbezbedniji put za kretanje vozila. Takođe mogu da se naprave instrukcije kako upravljati komandama u vozilu. Ali problem je sledeći: Kako da prenesemo ove informacije i instrukcije osobi koja ne može da vidi dovoljno brzo i precizno da vidi da bi mogla da vozi? Za ovu svrhu, razvili smo mnogo različitih tipova tehnologija ne-vizuelnih, korisničkih interfejsa. Počevši sa trodimenzionalnim ping zvučnim sistemom, vibrirajućim prslukom, volanom sa dugmićima i zvučnim komandama, nožnom trakom, čak i cipelom koja prenosi pritisak na stopalo. Danas ćemo govoriti o tri od ovih ne-vizuelnih interfejsa.
Now the first interface is called a DriveGrip. So these are a pair of gloves, and it has vibrating elements on the knuckle part so you can convey instructions about how to steer -- the direction and the intensity. Another device is called SpeedStrip. So this is a chair -- as a matter of fact, it's actually a massage chair. We gut it out, and we rearrange the vibrating elements in different patterns, and we actuate them to convey information about the speed, and also instructions how to use the gas and the brake pedal. So over here, you can see how the computer understands the environment, and because you cannot see the vibration, we actually put red LED's on the driver so that you can see what's happening. This is the sensory data, and that data is transferred to the devices through the computer.
Prvi interfejs se zove Upravljačko rukovanje. To je par rukavica koje poseduju vibrirajuće elemente u predelu šake i omogućavaju prenošenje instrukcije koje se tiču upravljanja – smer i intenzitet. Drugi uređaj se zove Brzinska oprema. To je stolica – u stvari, to je stolica koja masira. Rekonstruisali smo je, preuredili smo vibrirajuće elemente na različite načine i aktivirali smo ih da prenose informacije o brzini, takođe i instrukcije kako se koriste pedale gasa i kočnice. Ovde možete videti kako kompjuter razume okruženje, i zato što vi ne možete da vidite vibraciju, stavili smo crvene LED svetiljke na vozača tako da možete da vidite šta se dešava. Ovo su podaci sa senzora, i ti podaci se prenose u uređaje pomoću kompjutera.
So these two devices, DriveGrip and SpeedStrip, are very effective. But the problem is these are instructional cue devices. So this is not really freedom, right? The computer tells you how to drive -- turn left, turn right, speed up, stop. We call this the "backseat-driver problem." So we're moving away from the instructional cue devices, and we're now focusing more on the informational devices. A good example for this informational non-visual user interface is called AirPix. So think of it as a monitor for the blind. So it's a small tablet, has many holes in it, and compressed air comes out, so it can actually draw images. So even though you are blind, you can put your hand over it, you can see the lanes of the road and obstacles. Actually, you can also change the frequency of the air coming out and possibly the temperature. So it's actually a multi-dimensional user interface. So here you can see the left camera, the right camera from the vehicle and how the computer interprets that and sends that information to the AirPix. For this, we're showing a simulator, a blind person driving using the AirPix. This simulator was also very useful for training the blind drivers and also quickly testing different types of ideas for different types of non-visual user interfaces. So basically that's how it works.
Ova dva uređaja, Upravljačko rukovanje i Brzinska oprema, su veoma efektivni. Problem je što su to uređaji koji daju instrukcije. Ovo nije u stvari sloboda, zar ne? Kompjuter vam govori kako da vozite – skreni levo, skreni desno, ubrzaj, zaustavi se. Mi ovo nazivamo "problem da vam stalno neko suflira". Mi se udaljavamo od uređaja koji daju instrukcije, i sada se više fokusiramo na informativne uređaje. Dobar primer ovih informativnih ne-vizuelnih korisničkih interfejsa se naziva Vazdušna fotografija. To zamislite kao monitor za slepe ljude. To je mala ploča, ima mnogo otvora u sebi, kompresovani vazduh izlazi napolje, tako da on u stvari može da pravi slike. Čak iako ste slepi, možete da stavite ruku preko njega i da vidite saobraćajne trake na putu i prepreke. Takođe možete da promenite učestalost vazduha koji izlazi kao i temperaturu. To je u stvari multidimenzionalni korisnički interfejs. Ovde možete da vidite levu kameru, desnu kameru vozila i kako kompjuter to interpretira i šalje te informacije Vazdušnoj fotografiji. Za ovu svrhu, pokazujemo simulator, slepa osoba koja vozi koristeći Vazdušnu fotografiju. Ovaj simulator je takođe veoma bio koristan za obuku slepih vozača kao i za brzo testiranje različitih tipova ideja za različite tipove ne-vizuelnih, korisničkih interfejsa. U osnovi to radi ovako.
So just a month ago, on January 29th, we unveiled this vehicle for the very first time to the public at the world-famous Daytona International Speedway during the Rolex 24 racing event. We also had some surprises. Let's take a look.
Pre samo mesec dana, 29. januara, po prvi put smo prikazali ovo vozilo javnosti na svetski poznatoj Dejtona međunarodnoj stazi tokom Roleks 24 trkačkog događaja. Imali smo i nekoliko iznenađenja. Hajde da pogledamo.
(Music)
(Muzika)
(Video) Announcer: This is an historic day in January. He's coming up to the grandstand, fellow Federationists.
(Video) Spiker: Ovo je istorijski dan u januaru. On izlazi na pozornicu, drugovi naši.
(Cheering)
(Ovacije)
(Honking)
(Trubljenje)
There's the grandstand now. And he's [unclear] following that van that's out in front of him. Well there comes the first box. Now let's see if Mark avoids it. He does. He passes it on the right. Third box is out. The fourth box is out. And he's perfectly making his way between the two. He's closing in on the van to make the moving pass. Well this is what it's all about, this kind of dynamic display of audacity and ingenuity. He's approaching the end of the run, makes his way between the barrels that are set up there.
Tamo je sada pozornica. I on [nejasno] prati taj kombi koji je ispred njega. Dolazi prva kutija. Da vidimo da li će je Mark izbeći. Izbegava je. On je prolazi sa desne strane. Treća kutija je izbačena. Četvrta kutija je izbačena. On savršeno pronalazi put između dve kutije. Približava se kombiju da bi ga pretekao. U ovome je suština, vrsta dinamičnog monitora sa zvukovima i genijalnošću. On se približava kraju staze i pronalazi put između buradi koja je tamo postavljena.
(Honking)
(Trubljenje)
(Applause)
(Aplauz)
Dennis Hong: I'm so happy for you. Mark's going to give me a ride back to the hotel.
Denis Hong: Veoma sam srećan zbog tebe. Mark će me odvesti nazad do hotela.
Mark Riccobono: Yes.
Mark Rikobono: Da.
(Applause)
(Aplauz)
DH: So since we started this project, we've been getting hundreds of letters, emails, phone calls from people from all around the world. Letters thanking us, but sometimes you also get funny letters like this one: "Now I understand why there is Braille on a drive-up ATM machine." (Laughter) But sometimes -- (Laughter) But sometimes I also do get -- I wouldn't call it hate mail -- but letters of really strong concern: "Dr. Hong, are you insane, trying to put blind people on the road? You must be out of your mind." But this vehicle is a prototype vehicle, and it's not going to be on the road until it's proven as safe as, or safer than, today's vehicle. And I truly believe that this can happen.
DH: Od kada smo započeli ovaj projekat, dobijamo stotine pisama, mejlova, telefonskih poziva od ljudi iz čitavog sveta. Pisma u kojima nam se zahvaljuju, a ponekad dobijemo i neko zabavno pismo kao što je ovo: “Sad razumem zašto se Brajevo pismo nalazi na bankomatu kome se može prići kolima.” (Smeh) Ponekad – (Smeh) Ponekad stvarno dobijem – ne bih to nazvao mejlom mržnje – već pisma veoma velike zabrinutosti: “Dr Hong, da li ste vi normalni, pokušavate da stavite slepe ljude da voze? Mora da ste van pameti.” Ovo vozilo je prototip vozilo i neće se naći na ulicama dok se ne dokaže kao podjednako bezbedno ili bezbednije od današnjeg vozila. Ja zaista verujem da se ovo može dogoditi.
But still, will the society, would they accept such a radical idea? How are we going to handle insurance? How are we going to issue driver's licenses? There's many of these different kinds of hurdles besides technology challenges that we need to address before this becomes a reality. Of course, the main goal of this project is to develop a car for the blind. But potentially more important than this is the tremendous value of the spin-off technology that can come from this project. The sensors that are used can see through the dark, the fog and rain. And together with this new type of interfaces, we can use these technologies and apply them to safer cars for sighted people. Or for the blind, everyday home appliances -- in the educational setting, in the office setting. Just imagine, in a classroom a teacher writes on the blackboard and a blind student can see what's written and read using these non-visual interfaces. This is priceless. So today, the things I've showed you today, is just the beginning.
Ali da li će društvo prihvatiti ovako radikalnu ideju? Kako će se rešiti osiguranje? Kako će se izdavati vozačke dozvole? Postoji mnogo različitih poteškoća pored tehničkih izazova koje moramo da rešimo pre nego što ovo postane realnost. Naravno, glavni cilj ovog projekta je da se razvije automobil za slepe ljude. Još važnije od ovoga potencijalno može biti ogromna vrednost nove tehnologije koja može da se izrodi iz ovog projekta. Senzori koji se koriste mogu da vide po mraku, magli i kiši. Zajedno sa ovim novim tipom interfejsa, možemo da koristimo ove tehnologije i primenimo ih na bezbednije automobile za osobe sa dobrim vidom. I za slepe ljude, svakodnevne kućne uređaje – u obrazovnom okruženju, u kancelarijskom okruženju. Samo zamislite, u učionici nastavnik piče na tabli a slepi student može da vidi šta je napisano i čita pomoću ovih ne-vizuelnih interfejsa. To je neprocenjivo. Stvari koje sam vam pokazao danas, su samo početak.
Thank you very much.
Hvala vam puno.
(Applause)
(Aplauz)