The challenge: reinvent ‘TV news’ online

May 3, 2011 § 9 Comments

Recently, we’ve seen a huge change in video online. The advent of web native <video> makes it possible to mash up moving images with social media, tie clips to data from across the web or, more simply, create simple transcript-based interfaces for navigating long pieces of video. Yet, despite the these capabilities, we’ve seen almost nothing in the way of new kinds of storytelling. Telling stories with video online today looks pretty much the same as it did when I used to shoot local TV news 20 years ago.

This is something we hope to change with the first Knight Mozilla news innovation challenge topic. We’re inviting hacks and hackers from around the world to answer the question: how can new web video tools transform news storytelling? People with the best ideas will get to bring them to life with a full year paid fellowship in a world leading newsroom.

The next ‘montage moment’

What do I mean by transform storytelling? Just that: taking today’s online video tools beyond the mechanical and obvious, bringing people, ideas and events to life in ways we haven’t seen before. To get your imagination going, think back to how visual storytelling emerged in the world of cinema.

The Lumiere brothers made some of the worlds first films. Workers going to a factory. A train arriving at a station. Etc. The Lumiere’s fixed frame wasn’t much to write home about in terms of story. But seeing moving photographs was hugely impressive to most people at the time. It was a technical wonder.

It took 25 years for Eisenstein to grab hold of this technical wonder and then say: wow, I bet you we could tell a more powerful story if we varied the shots a bit and then edited them together. With Potemkin, he invented the visual language we still use to tell stories today: montage.

The fundamental technology didn’t change in those 25 years. The Lumiere’s knew how to splice film and move the camera around. Eisenstein’s breakthrough was to use basic film technology to tell a story in a new and creative way. Which is very much like where we are at with web native video today: huge technological potential just waiting to be seized for creative storytelling. What we need now is a ‘montage moment’ for the web era.

Open video: a huge palette of awesomeness

The potential of web native <video> truly is awesome: we can now link any frame within any video to any other part of the web. This was hard to do in the world of Flash video. The introduction of the HTML5 <video> tag over the last two years has made it easy.

Early experiments and demos hint at the potential of this new open video palette. With the recent State of the Union, PBS used Mozilla’s popcorn.js tools to synchronize their live blogging with the timecode of the President’s speech:

The same tools have been used to show how transcripts can be used to search and then navigate immediately to anywhere within a long clip. This demo from Danish public radio shows how this can work with web native <audio>. The same thing could easily be done with video.

Of course, the big potential is in connecting video to the massive amount media and data that already exists all across the web. Imagine if you could weave the sum of all human knowledge seamlessly into your news story or documentary. That’s now possible. This book report demo shows the basics concept, with a student connecting her narration to wikipedia articles and news reports.

Google and Arcade Fire took this idea a step further, pulling moving images from street view and Google Earth into a rock video. If you enter your zip code, your neighborhood becomes a character in the narrative in real time.

The Japanese based Sour-Mirror went even further, pulling you into the video. Enter your Facebook ID and turn on your camera, and then you become a character in the band’s video. Again, in real time.

These demos make an important point: the line between what’s in the frame and what’s on the web is dissolving. Or, put nerdily, timecode and hypertext are fusing together. They are becoming one.

Are you the next Eisenstein?

Despite all the niftyness, there is a problem: these demos do not yet tap the open video palette to tell stories in meaningfully new ways. Open video tools like Mozilla’s Popcorn and Butter provide a starting point. But they need people with a creative flair for both web technology and storytelling to bring them life. Which is exactly why Knight and Mozilla threw out ‘how can new web video tools transform news storytelling?’ as our first MoJo challenge question.

We’re hoping that you — or someone you know — is up to this challenge. If you think you are, you should enter the MoJo innovation challenge. All you need to do is: draw up a napkin sketch showing how you might tell a story in a new way with open video, write a brief paragraph about it and then submit it online. If your idea is solid, you’ve got a good chance at a fellowship where you could actually bring it to life at the Al Jazeera, BBC, the Guardian, Die Zeit or the Boston Globe. Who knows, maybe you could be the Eisenstein of open video?

Find out more about Knight Mozilla News Innovation Partnership on the MoJo web site. Or enter the MoJo news innovation challenge today.

§ 9 Responses to The challenge: reinvent ‘TV news’ online

  • Great examples. I’m going to steal some of these and put them into the MoJo event toolkit. 🙂

  • skierpage says:

    “with a creative flare”
    I think you mean “creative flair”, unless you’re talking about bell-bottom trousers.

    Is HardDisken using a version of Universal Subtitles? It’s a nifty interface, seems an audio version might be possible.

  • […] web del proyecto de Mozilla y periodismo Cuenta de twitter del proyecto The challenge: reinvent ‘TV news’ online por Mark Surman Primer desafío, liberando el […]

  • Brett Zamir says:

    How about the possibility of clicking (or right-clicking, mouseover, etc.) only a portion of a frame ala image maps?

    Right-click an object in a video to get more information about it, etc…

    • Brett Zamir says:

      I meant to add, not only like image maps, but like SVG–where a component in the frame could be made interactive with any kind of event…

  • […] In particular this session focused on the beauty that is HTML5 video, and brainstorming awesome applications of it. Mark Surman hosted the session, and afterwards wrote up a sweet piece outlining the challenge. […]

  • Russ Hawkes says:

    The traditional journalistic “lede” is a declarative simple sentence, thus: “John kicked the dog.” A new medium could hit harder simply by putting words and phrases in descending order according to their individual emotional punch, thus: “Master assassin Osama bin Laden died today before the pistol muzzles of American counter-assassins” Then each succeeding sentence would appear in order according to its own degree of punch without complicated rationalistic structure.

  • John M says:

    The best way to show news is from the birds-eye view. When showing viewers news like they are there,this allows viewers to feel and experience the story to the fullest. Filming and showing news by the seat of your pants puts viewers in the action that is taking place.It makes for great reporting and with high value added to your journalist team.

  • […] early in the project, has been creating tools for non-developers to explore the possibilities of what we’re calling “web-native” cinema. Here’s a look at where we’ve been, and where we’re […]

What’s this?

You are currently reading The challenge: reinvent ‘TV news’ online at commonspace.


%d bloggers like this: