My passions are music, technology and making things. And it's the combination of these things that has led me to the hobby of sound visualization, and, on occasion, has led me to play with fire.
Moje strasti su glazba, tehnologija i pravljenje stvari. I kombinacija ovih stvari dovela me je do hobija vizualizacije zvuka, i, ponekad, dovelo me da se igram s vatrom.
This is a Rubens' tube. It's one of many I've made over the years, and I have one here tonight. It's about an 8-foot-long tube of metal, it's got a hundred or so holes on top, on that side is the speaker, and here is some lab tubing, and it's connected to this tank of propane. So, let's fire it up and see what it does. So let's play a 550-herz frequency and watch what happens.
Ovo je Rubenova cijev. To je jedna od mnogih koje sam napravio s godinama i imam jednu ovdje večeras. To je cijev od metala duga 8 stopa, ima stotinu ili više rupa na vrhu, i sa strane je zvučnik, i ovdje imamo cijevi iz laboratorija, povezanih s ovim spremnikom propana. Pa, upalimo ga da vidimo što radi. Zasvirajmo frekvenciju od 550 herca i pogledajmo što se događa.
(Frequency)
(Frekvencija)
Thank you. (Applause) It's okay to applaud the laws of physics, but essentially what's happening here -- (Laughter) -- is the energy from the sound via the air and gas molecules is influencing the combustion properties of propane, creating a visible waveform, and we can see the alternating regions of compression and rarefaction that we call frequency, and the height is showing us amplitude. So let's change the frequency of the sound, and watch what happens to the fire.
Hvala vam. (Pljesak) U redu je zapljeskati zakonima fizike, ali ono što se zapravo događa -- (Smijeh) -- je da energija iz zvuka putem molekula zraka i plina utječe na zapaljiva svojstva propana, stvarajući vidljiv oblik valova, i možemo vidjeti izmjenjujuća područja kompresije i frekvenciju, i visinu koja nam pokazuje amplitudu. Dakle, promijenimo frekvenciju zvuka, i pogledajmo što se događa s vatrom.
(Higher frequency)
(Viša frekvencija)
So every time we hit a resonant frequency we get a standing wave and that emergent sine curve of fire. So let's turn that off. We're indoors. Thank you. (Applause)
Tako kad god pogodimo rezonantnu frekvenciju dobijemo stojeći val i tu uzlaznu krivulju vatre. Isključimo sad to. Nalazimo se unutra. Hvala vam. (Pljesak)
I also have with me a flame table. It's very similar to a Rubens' tube, and it's also used for visualizing the physical properties of sound, such as eigenmodes, so let's fire it up and see what it does.
Također imam sa sobom i vatreni stol. Vrlo je sličan Rubensovoj cijevi, i također je rabljen za vizualizaciju fizičkih osobnosti zvuka, pa upalimo ga i vidimo što radi.
Ooh. (Laughter) Okay. Now, while the table comes up to pressure, let me note here that the sound is not traveling in perfect lines. It's actually traveling in all directions, and the Rubens' tube's a little like bisecting those waves with a line, and the flame table's a little like bisecting those waves with a plane, and it can show a little more subtle complexity, which is why I like to use it to watch Geoff Farina play guitar.
Ooh. (Smijeh) Okej. Sad, dok stol dolazi do pritiska, samo da napomenem kako zvuk ne putuje u savršenim linijama. On zapravo putuje u svim smjerovima, i rubensova "cijev" radi disekciju tih valova linijom, a vatreni stol radi disekciju tih valova po ravnini, i može nam pokazati malo suptilne složenosti, zašto volim koristiti to kako bih gledao Geoff Farinu kako svira gitaru.
(Music)
(Glazba)
All right, so it's a delicate dance. If you watch closely — (Applause) If you watch closely, you may have seen some of the eigenmodes, but also you may have seen that jazz music is better with fire. Actually, a lot of things are better with fire in my world, but the fire's just a foundation. It shows very well that eyes can hear, and this is interesting to me because technology allows us to present sound to the eyes in ways that accentuate the strength of the eyes for seeing sound, such as the removal of time.
Dakle, to je složen ples. Ako gledate pažljivo --- (Pljesak) ako gledate pažljivo, možda ste vidjeli neke od eigenmodova, ali možda ste vidjeli i to da je jazz glazba bolja s vatrom. Zapravo, puno stvari je bolje s vatrom u mom svijetu, ali vatra je samo osnova. Pokazuje vrlo dobro da oči mogu čuti, i ovo je meni zanimljivo zato što nam tehnologija dozvoljava da predstavimo zvuk očima na način koji naglašava snagu očiju kako bi vidjele zvuk, kao što je izmicanje vremena.
So here, I'm using a rendering algorithm to paint the frequencies of the song "Smells Like Teen Spirit" in a way that the eyes can take them in as a single visual impression, and the technique will also show the strengths of the visual cortex for pattern recognition. So if I show you another song off this album, and another, your eyes will easily pick out the use of repetition by the band Nirvana, and in the frequency distribution, the colors, you can see the clean-dirty-clean sound that they are famous for, and here is the entire album as a single visual impression, and I think this impression is pretty powerful.
Dakle, ovdje koristimo algoritam kako bismo naslikali frekvencije pjesme "Smells Like Teen Spirit" na način na koji ga oči mogu primiti kao jednu vizualnu impresiju, i tehnika će također pokazati snage vizualnog korteksa za prepoznavanje uzoraka. Pa ako vam pokažem još jednu pjesmu s ovog albuma, i još jednu, vaše oći će lako moći razabrati korištenje ponavljanja od strane Nirvane, i u distribuciji frekvencija, u bojama, možete vidjeti čisti-prljavi-čisti zvuk po kojem su poznati, i ovdje je cijeli album kao jedna vizualna impresija, i mislim da je ova impresija vrlo moćna.
At least, it's powerful enough that if I show you these four songs, and I remind you that this is "Smells Like Teen Spirit," you can probably correctly guess, without listening to any music at all, that the song a die hard Nirvana fan would enjoy is this song, "I'll Stick Around" by the Foo Fighters, whose lead singer is Dave Grohl, who was the drummer in Nirvana. The songs are a little similar, but mostly I'm just interested in the idea that someday maybe we'll buy a song because we like the way it looks.
Barem, dovoljno je jaka kako bi ako vam pokažem ove četiri pjesme, i podsjetim vas da je ovo "Smells Like Teen Spirit," možete vrlo vjerojatno točno pogoditi, bez slušanja glazbe, da će pjesma u kojoj će uživati pravi fanovi Nirvane je ova pjesma, "I'll Stick Around" od Foo Fightersa, čiji je pjevač Dave Grohl, koji je bio bubnjar u Nirvani. Pjesme su pomalo slične, ali najviše me zanima ideja da ćemo jednog dana možda moći kupiti pjesmu jer nam se sviđa kako izgleda.
All right, now for some more sound data. This is data from a skate park, and this is Mabel Davis skate park in Austin, Texas. (Skateboard sounds) And the sounds you're hearing came from eight microphones attached to obstacles around the park, and it sounds like chaos, but actually all the tricks start with a very distinct slap, but successful tricks end with a pop, whereas unsuccessful tricks more of a scratch and a tumble, and tricks on the rail will ring out like a gong, and voices occupy very unique frequencies in the skate park.
U redu, pogledajte sada malo više zvukovnih podataka. Ovo je podatak iz skate parka, i ovo je Mabel Davis skate park u Austinu, Texas. (Zvuk skejta) I zvukovi koje čujete dolaze iz osam mikrofona spojenih na rampe po parku, i zvuči kao kaos, ali zapravo trikovi počinju sa vrlo određenim udarcem, ali uspješni trikovi završavaju s pucketanjem, gdje neuspješni trikovi završe sa grebanjem i udaranjem, dok trikovi na šipci zvone kao gong, i glasovi su na jedinstvenoj frekvenciji u skate parku.
So if we were to render these sounds visually, we might end up with something like this. This is all 40 minutes of the recording, and right away the algorithm tells us a lot more tricks are missed than are made, and also a trick on the rails is a lot more likely to produce a cheer, and if you look really closely, we can tease out traffic patterns. You see the skaters often trick in this direction. The obstacles are easier.
Pa ako bismo vizualno prikazali ove zvukove, možda ćemo završiti s nečim kao što je ovo. Ovo je svih 40 minuta snimke, i odmah nam algoritam govori da ima više neuspjelih nego uspjelih trikova, i da će trik na šipci vrlo vjerojatno izazvati poklike, i ako pogledate pažljivo, možemo izvući uzorke prometa. Vidite, skejteri često rade trikove u tom smjeru. Rampe su lakše.
And in the middle of the recording, the mics pick this up, but later in the recording, this kid shows up, and he starts using a line at the top of the park to do some very advanced tricks on something called the tall rail. And it's fascinating. At this moment in time, all the rest of the skaters turn their lines 90 degrees to stay out of his way. You see, there's a subtle etiquette in the skate park, and it's led by key influencers, and they tend to be the kids who can do the best tricks, or wear red pants, and on this day the mics picked that up.
I usred snimanja, mikrofoni pokupe ovo, ali kasnije u snimci, ovaj klinac se pojavi, i počinje koristiti smjer na vrhu parka kako bi napravio neke napredne trikove na nečem što se zove visoka šipka. I to je fascinantno. U ovom trenutku u vremenu, svi ostali skejteri okreću svoj smjer kretanja za 90 stupnjeva kako bi mu se maknuli s puta. Vidite, postoji suptilna pristojnost u parku, i vode ju glavni nositelji utjecaja, i to su najčešće djeca koja mogu raditi najbolje trikove, ili nose crvene hlače, i ovog dana mikrofoni su to primjetili.
All right, from skate physics to theoretical physics. I'm a big fan of Stephen Hawking, and I wanted to use all eight hours of his Cambridge lecture series to create an homage. Now, in this series he's speaking with the aid of a computer, which actually makes identifying the ends of sentences fairly easy. So I wrote a steering algorithm. It listens to the lecture, and then it uses the amplitude of each word to move a point on the x-axis, and it uses the inflection of sentences to move a same point up and down on the y-axis.
Od fizike skejta do teoretske fizike. Ja sam veliki fan Stephen Hawkinga, i htio sam iskoristiti svih osam sati njegovog predavanja na Cambridgeu kako bih stvorio posvetu. Sada, u ovoj seriji on govori uz pomoć računala, što zapravo omogućuje identifikaciju krajeva rečenica dosta jednostavno. Pa sam stvorio skretajući algoritam. On sluša predavanje, i onda koristi amplitude svake riječi kako bi pomaknuo točku na x osi, i koristi modulaciju rečenica kako bi pomaknuo istu točku gore i dolje po y osi.
And these trend lines, you can see, there's more questions than answers in the laws of physics, and when we reach the end of a sentence, we place a star at that location. So there's a lot of sentences, so a lot of stars, and after rendering all of the audio, this is what we get. This is Stephen Hawking's universe.
I ove linije, kao što vidite, ostavljaju više pitanja nego odgovora u zakonima fizike, i kad dođemo do kraja rečenice, stavljamo zvjezdicu na tu lokaciju. Dakle postoji puno rečenica, pa puno zvijezda, i nakon renderiranja sveg zvuka, ovo je što dobijemo. Ovo je svemir Stephena Hawkinga.
(Applause)
(Pljesak)
It's all eight hours of the Cambridge lecture series taken in as a single visual impression, and I really like this image, but a lot of people think it's fake. So I made a more interactive version, and the way I did that is I used their position in time in the lecture to place these stars into 3D space, and with some custom software and a Kinect, I can walk right into the lecture. I'm going to wave through the Kinect here and take control, and now I'm going to reach out and I'm going to touch a star, and when I do, it will play the sentence that generated that star.
Ovo je svih osam sati predavanja sa Cambridgea prikazanih u jednoj vizualnoj impresiji, i stvarno mi se sviđa ova slika, ali mnogo ljudi misli da je ovo lažno. Pa sam stvorio interaktivniju verziju, a to sam učinio tako što sam koristio njihov položaj u vremenu u predavanju kako bih postavio ove zvijezdice u 3D prostoru, i s nešto posebnog softwarea i Kinectom, mogu ušetati u predavanje. Mahnut ću kroz Kinect ovdje i preuzeti kontrolu, i sada ću posegnuti i dodirnuti zvjezdu, i kada to učinim, pustit će rečenicu koja je stvorila tu zvjezdu.
Stephen Hawking: There is one, and only one, arrangement in which the pieces make a complete picture.
Stephen Hawking: Postoji jedan, i samo jedan, aranžman u kojem dijelovi čine čitavu sliku.
Jared Ficklin: Thank you. (Applause) There are 1,400 stars. It's a really fun way to explore the lecture, and, I hope, a fitting homage.
Jared Ficklin: Hvala vam. (Pljesak) Postoji 1.400 zvjezda. To je zaista zanimljiv način za istraživanje predavanja, i, nadam se, dostojna posveta.
All right. Let me close with a work in progress. I think, after 30 years, the opportunity exists to create an enhanced version of closed captioning. Now, we've all seen a lot of TEDTalks online, so let's watch one now with the sound turned off and the closed captioning turned on.
U redu. Dopustite da završim sa radom koji je u tijeku. Mislim, nakon 30 godina, da postoji prilika za stvaranje poboljšane verzije zatvorenog titlovanja. Sad, puno nas je vidjelo puno TED govora online, pa pogledajmo jedan bez zvuka i uključenim sustavom zatvorenog titlovanja.
There's no closed captioning for the TED theme song, and we're missing it, but if you've watched enough of these, you hear it in your mind's ear, and then applause starts. It usually begins here, and it grows and then it falls. Sometimes you get a little star applause, and then I think even Bill Gates takes a nervous breath, and the talk begins.
Ne postoji zatvoreno titlovanje za TED pjesmu, i nedostaje nam, ali ako ste pogledali dovoljno ovoga, čujete ju u vašem uhu, i onda pljesak počinje. Obično počinje ovdje, i raste a zatim pada. Nekad dobijete pljesak male zvjezde, i onda mislim da čak i Bill Gates nervozno udahne, i govor počne.
All right, so let's watch this clip again. This time, I'm not going to talk at all. There's still going to be no audio, but what I am going to do is I'm going to render the sound visually in real time at the bottom of the screen. So watch closely and see what your eyes can hear.
Dobro, pogledajmo ovaj isječak ponovno. Ovoga puta, neću uopće govoriti. I dalje neće biti zvuka, ali ono što ću ja učiniti je prevesti zvuk vizualno u realnom vremenu na dnu ekrana. Gledajte pažljivo i vidite što vaše oči mogu čuti.
This is fairly amazing to me. Even on the first view, your eyes will successfully pick out patterns, but on repeated views, your brain actually gets better at turning these patterns into information. You can get the tone and the timbre and the pace of the speech, things that you can't get out of closed captioning. That famous scene in horror movies where someone is walking up from behind is something you can see, and I believe this information would be something that is useful at times when the audio is turned off or not heard at all, and I speculate that deaf audiences might actually even be better at seeing sound than hearing audiences. I don't know. It's a theory right now. Actually, it's all just an idea.
Ovo je poprilično zadivljuuće za mene. Čak i na prvi pogled, oči će uspješno izabrati uzorke, no u opetovanim gledanjem, vaš mozak zapravo postaje bolji u pretvaranju ovih uzoraka u informacije. Možete osjetiti ton i boju zvuka i brzinu govora, stvari koje ne možete dobiti iz zatvorenog titlovanja. Ona poznata scena u horor filmovima gdje netko dolazi straga je nešto što možete vidjeti, i vjerujem da je ova informacija nešto što je korisno kada je isključen zvuk ili nije čuo uopće, i pretpostavljam da će gluha publika možda biti i bolja u viđenju zvuka nego publika koja čuje. Ne znam. Za sada je to samo teorija. Zapravo, to je sve samo ideja.
And let me end by saying that sound moves in all directions, and so do ideas. Thank you. (Applause)
I dopustite da završim s tim da se zvuk kreće u svim smjerovima, a tako se kreću i ideje. Hvala vam. (Pljesak)