Monthly Archives

3 Articles

Posted by Tom Cheesewright on

Be The Director: The Future of Event Television

Television used to be such a passive experience. Lean back on your cushions and let the drama flood your brain. Not so anymore. From the red button, to SMS voting, to third screen apps like zeebox, it seems the trend is to pass control from the hidden directors and writers behind the scenes to us, the audience.

At a demonstration of a new suite of TV technologies yesterday I got some insight into where this trend might be going.

The FascinatE Project is one of those weird international collaborations between public and private that could probably only happen in the EU (it is funded to the tune of EURO9.5m by the EU). It involves technology companies like Alcatel Lucent, broadcasters like the BBC, research organisations like Fraunhofer (creators of the ubiquitous MP3 music format), and universities like Salford, location for yesterday’s presentation.

FascinatE (a slightly tortured acronym accounts for that capitalised final letter) aims to provide a more interactive experience for users watching live events — concerts, dramas, sports etc. The technology it uses to does this comes in four main parts.

Capture

If you want to let users direct their own viewing, then you need to capture more of what’s going on at an event. That means more cameras and more microphones. But the ability to switch between a series of fixed shots — where the focus is still in the control of a camera operator or director — is a bit old school. Why not capture EVERYTHING and then allow users to choose their own virtual camera shot?

To do this FascinatE uses a new panoramic camera created by Fraunhofer. Featuring 10 Indiecam 2K (twice HD) or even ALEXA 4K cameras (in a much larger form factor). Each camera is sited as close as possible to its two neighbours in a ring, pointed upwards towards a continuous circle of mirrors at 45 degrees to the floor. Siting the cameras so close together enables their images to be stitched together in software with minimal distortion, providing a complete, panoramic, high resolution capture of the event.

If you have ever taken a series of photos in a circle and then stitched them together on a computer to make a single panorama, imagine the same process but for live video, and done in real time.

3D sound is captured by a single MH Acoustics Eigenmike — essentially 32 microphones in a single sphere, giving a complete picture of the soundfield in three dimensions. The 3D sound is tied to the view: focus on the drummer and the drum sounds come up in the mix. Pan to the left and the drum sounds get louder on your right.

Having just a single mike and camera to do complete capture of the event makes for a potentially very portable and easy to set up package. Although in the demonstration and likely in reality, these are supplemented with mics on all the main sound sources (instruments, singers etc) and standard cameras for alternative views.

With the current technology you need these extra cameras, particularly for large scale events like football. The lack of focal length control on the panoramic camera means that there’s some loss of resolution when zoomed right in, even when shooting at 2K.

Transfer

When you’re shooting with that many cameras at high definition, you’re going to be storing and more importantly shipping a lot of data. Since we’re talking about live events, the first issue is getting the raw video — 20Gbps of it using the 2K camera setup — to somewhere you can process it. This is just a question of raw bandwidth.

The next issue is getting it out to consumers across all of the many devices they may want to use: TV, smartphone, tablet, etc. You obviously can’t ship they everything, so how do you ensure they can choose exactly which view they want to see?

Alcatel Lucent tackled this problem and came up with a way of breaking the enormous 20x2K picture into a grid of smaller ‘tiles’. Rather than shipping the whole picture, the network node serving the video only sends the tiles that feature in the picture the consumer has selected. For example, they might have chosen to focus on the lead singer at a gig. Only the tiles that feature the singer and his surrounds need to be sent, compressed, to the user device.

This is clever but it doesn’t scale too well: what if 10,000 people choose the same view? You’re streaming the same four tiles 10,000 times — tough on bandwidth and your servers. Here the server’s intelligence kicks in and switches from unicast (tiles that only one person wants) to broadcast (popular tiles that are shared) ensuring it minimises server load and bandwidth.

So you’ve got huge amounts of video and three dimensional sound. How do you choose what view to watch?

Robot Director

Did you know there was an established ‘grammar’ for cinematography? Nor did I until yesterday. But like the ‘golden ratio’ seems to define aesthetically pleasing shapes, the grammar of cinematography gives us a set of rules for deciding whether to pan or cut, when, and how fast. Joanneum Research has taken these rules and applied them to the vast amount of data coming in from the cameras, and given a system intelligence to identify people and events on the screen.

The result is essentially a fully, or semi-automated director, able to process vast amounts of data into a watchable programme, with or without the input of human directors either in the studio or in the home.

The Client

Robot director or not, none of this clever technology is going to be of any value without an engaging user experience. And the demo we saw yesterday seems to have that. Via tablet, smartphone or TV the ability to pan around the performance space where students from Salford were performing a series of dance pieces was slick and seamless (barring a temporary loss of sound — no demonstration is ever going to be perfect). Swiping your finger across the tablet resulted in the video panning smoothly and responsively. Admittedly the performance was only in the next room, but the way the system is designed, network latency shouldn’t be too much of an issue.

Where it got really exciting was with the gesture-based interface. You can pan and zoom just by waving your hands in the air. Increase the volume by cupping your hand to your ear, lower it with a finger to your lips.

Imagine coupling the display to an immersive headset and having the video pan with your head movements. That would be an incredible way to remotely experience a gig or event.

Timeline

According to one BBC member of the project, they are considering using some of this technology for events in 2014. Certainly it didn’t seem far from consumer-ready as a technology suite, not withstanding the usual levels of rigorous testing required for broadcast equipment. My guess is that it will be small scale tests next year before wider roll-out the following year. But you can easily see the relevant technology being added to the iPlayer client to support this sort of broadcast.

Posted by Tom Cheesewright on

The Future of Retail: What the High Street Has to Fear from Social Selling

The high street casualties to date have largely been killed off by eCommerce. How could HMV with 4300 staff and all the costs associated with shops and distribution, compete with iTunes? iTunes has 15 staff in Europe, delivers digitally and yet turns over significantly more than HMV did when it went under.

eCommerce is clearly lethal to some businesses. But technology has presented the high street with another threat: the social seller. People who adopt retail as a way of life, selling things they know and love, and use the internet to amplify what used to be a purely offline, geographically-limited model.

Let me give you an example.

Karen Makin had a real grounding in high street retail. Like many successful people I’ve met, she started on the management training programme at M&S. She learned the ropes before moving into management at age 22. At a brand new Savastore she became duty manager then assistant store manager, controlling 800 staff.

In the 80s Karen took advantage of the boom with a jump into estate agency, before meeting her husband, moving to Bolton and settling down to raise two kids. She was out of retail for 14 years. Until recently.

With another recession slowing down her husband’s architecture business, Karen decided to get back into retail. She didn’t want to be back on the shop floor so she needed something a bit different.

A friend introduced her to a wholesale supplier of jewellery and accessories, and offered to front her the capital to buy some stock. Her friend was selling the stock through house parties, organising events at people’s homes. Initially sceptical, Karen was sold after the first event when it became clear that these weren’t awkward old Tupperware parties: people really appreciated having the goods (at a reasonable price) brought to them.

Karen started operating on the same model, under the name Antonia’s Recession Busting Glitz & Glamour. She used her contacts through school and gym to organise parties. And 20 years ago this is where the story would end: a small, simple lifestyle business that involved endless (face to face) networking, constantly looking for new relationships with potential party hosts.

But where Karen’s business really took off, and where technology adds the element of scale, was when she got a Facebook page.

Karen confesses that she was not technology literate. It was not so much that she was scared of technology, she just didn’t see the point of the computer. Over time though she was introduced by her husband and kids to email and Facebook and liked that she could keep in touch with people remotely. Then one day someone suggested a Facebook page for her business and her son helped her to set it up.

“That’s when it went crazy,” says Karen.

Karen’s still running the events but now people find her online. She ships around the UK. She uses the Mac in her kitchen and her mobile to respond to people. “Last night I sold three scarves, while sat in front of the TV,” says Karen.

Social Selling: Love the Product, Low Capital Investment, Round the Clock Engagement

Let’s recap here. Karen invested nothing in a website or eCommerce presence. She does not have a website other than her Facebook page. Her total capital investment, including stock and display hardware was less than £2k — much of it from her angel friend who got her into the business in the first place. That capital has been repaid in just 9 months. Karen is buying from a wholesaler rather than direct. Yet she can comfortably undercut the high street AND offer customers the benefit of bringing the stock to them at home or in the office. Whereas in the past her business would have been geographically limited, now she can sell across the UK and she’s looking to expand into Ireland.

This is still a microbusiness and probably always will be. But the threat to the high street is not Karen expanding to become the next Debenhams. It is the prospect of 10,000, 100,000 or even 1 million Karens.

In a recent piece I did for the Institute of Chartered Accountants on the future of work, I came to the conclusion that many more of us will be self-employed in the future. Most self-employed people that I know do more than one thing. I’d expect that a fair few of us will be retailers — as many are today via eBay, Etsy and more. We all have our specialisms that we could turn into shops — many of us selling things that we really enjoy working with, as Karen does with accessories.

Working like this has its challenges, as Karen acknowledges: it’s hard to switch off sometimes when your work is connected to your social profile and always accessible online. But it also has great upsides in its flexibility.

People have always run microbusinesses like this from home, be they self-started or franchise. But the ubiquity of the Internet and social networking particularly has created the opportunity for these microbusinesses to operate more efficiently and scale to a much greater audience very rapidly.

Look out high street: it may not be eCommerce that kills you, it could be your customers.

Tom Cheesewright