Video: AV1 – A Reality Check

Released in 2018, AV1 had been a little over two years in the making at the Alliance of Open Media founded by industry giants including Google, Amazon, Mozilla, Netflix. Since then work has continued to optimise the toolset to bring both encoding and decoding down to real-world levels.

This talk brings together AOM members Mozilla, Netflix, Vimeo and Bitmovin to discus where AV1’s up to and to answer questions from the audience. After some introductions, the conversation turns to 8K. The Olympics are the broadcast industry’s main driver for 8K at the moment, though it’s clear that Japan and other territories aim to follow through with further deployments and uses.

“AV1 is the 8K codec of choice” 

Paul MacDougall, Bitmovin
 CES 2020 saw a number of announcements like this from Samsung regarding AV1-enabled 8K TVs. In this talk from Google, Matt Frost from Google Chrome Media explains how YouTube has found that viewer retention is higher with VP9-delivered videos which he attributes to VP9’s improved compression over AVC which leads to quicker start times, less buffering and, often, a higher resolution being delivered to the user. AV1 is seen as providing these same benefits over AVC without the patent problems that come with HEVC.

 
It’s not all about resolution, however, points out Paul MacDougall from BitMovin. Resolution can be useful, for instance in animations. For animated content, resolution is worth having because it accentuates the lines which add intelligibility to the picture. For some content, with many similar textures, grass, for instance, then quality through bitrate may be more useful than adding resolution. Vittorio Giovara from Vimeo agrees, pointing out that viewer experience is a combination of many factors. Though it’s trivial to say that a high-resolution screen of unintended black makes for a bad experience, it is a great reminder of things that matter. Less obviously, Vittorio highlights the three pillars of spatial, temporal and spectral quality. Temporal refers to upping the bitrate, spatial is, indeed, the resolution and spectral refers to bit-depth and colour-depth know as HDR and Wide Colour Gamut (WCG).

Nathan Egge from Mozilla acknowledges that in their 2018 code release at NAB, the unoptimized encoder which was claimed by some to be 3000 times slower than HEVC, was ’embarrassing’, but this is the price of developing in the open. The panel discusses the fact that the idea of developing compression is to try out approaches until you find a combination that work well. While you are doing that, it would be a false economy to be constantly optimising. Moreover, Netflix’s Anush Moorthy points out, it’s a different set of skills and, therefore, a different set of people who optimise the algorithms.

Questions fielded by the panel cover whether there are any attempts to put AV1 encoding or decoding into GPU. Power consumption and whether TVs will have hardware or software AV1 decoding. Current in-production AV1 uses and AVC vs VVC (compression benefit Vs. royalty payments).

Watch now!
Speakers

Vittorio Giovara Vittorio Giovara
Manager, Engineering – Video Technology
Vimeo
Nathan Egge Nathan Egge
Video Codec Engineer,
Mozilla
Paul MacDougall Paul MacDougall
Principal Sales Engineer,
Bitmovin
Anush Moorthy Anush Moorthy
Manager, Video and Image Encoding
Netflix
Tim Siglin Tim Siglin
Founding Executive Director
Help Me Stream, USA

Video: Things Developers Believe About Video Files (Proven Wrong by User Uploads)


For many transcoding workflows, efficiency or quality are the primary factors defining how they are created. But when ingesting user-generated videos like those uploaded to the online video platform, Vimeo, life gets difficult. Dealing with the wide variety of formats uploaded and the many edge cases in the way that otherwise normal AVC videos are delivered means throwing out any assumptions you ever had and analysing every aspect of the file.

Senior video encoding engineer, Derek Buitenhuis takes us through the many lessons he and his colleagues have learnt over the years. Don’t, he says, assume that properties don’t change between frames – sometimes they change in every single frame. Assuming that you have a single frame rate throughout the video is another ‘no no’ as there are many variable-frame rate videos.

Derek also looks at dealing with samples stamped with negative timestamps, the need for sample durations, the myriad of issues seeking through a file, the fun of having some frames that aren’t displayed and multiple-track videos.

Colour spaces, no surprise to anyone, cause handling difficulties for example if the bitstream colour properties are different to those in the container. As the talk finishes, we’re left considering old MPEG2 files that can have unavoidable banding, replicating looping MOV files, and dealing with QuickTime special effects channels that animate a fire on the screen.

Watch now!
Speakers

Derek Buitenhuis Derek Buitenhuis
Senior Video Encoding Engineer,
Vimeo

Video: AV1 in video collaboration

AV1 is famous for its promise to deliver better compression than HEVC but also for it being far from real-time. This talk has a demonstration of the world’s first real-time AV1 video call showing that speed improvement are on the way and, indeed, some have arrived.

Encoding is split into ‘tools’ so where you might hear of ‘h.264’ or ‘MPEG 2’, these are names for a whole set of different ways of looking at – and squeezing down – a picture. They also encompass the rules of how they should act together to form a cohesive encoding mechanism. (To an extent, such codecs tend to define only how the decode should happen, leaving encoding open to innovation.) AV1 contains many tools, many of which are complex and so require a lot of time even from today’s fast computers.

Cisco’s Thomas Davies, who created the BBC’s Dirac codec which is now standardised under SMPTE’s VC-2 standard, points out that whilst these tools are complex, AV1 also has a lot of them and this diversity of choice is actually a benefit for speed and in particular for the speed of software codecs.

After demonstrating the latency and bandwidth benefits of their live, bi-directional, AV1 implementation against AVC, Thomas looks at the deployment possibilities and of AV1. The talk finishes with a summary of what AV1 brings in benefits to sum up why this new effort, with the Alliance of Open Media, is worth it.

Watch now!

Speaker

Thomas Davies Thomas Davies
Principal Engineer,
Cisco Media Engineering, UK

Video: Get Ready For A Multiple Codec World

The codec world is fragmenting. None of the new entrants on to the market is expected to ever gain the universal status that AVC enjoys. This panel from Streaming Media East takes a look at how to prepare for this.

The panel kicks off discussing the differences between AVC and HEVC, VP9 and AV1 and moves on to discuss the pros and cons of supporting multiple codecs. Tarek from Twitch explains its partial adoption of VP9 – the reasons that it makes sense but the overheads which it brings the business.

Vittorio Giovara from Vimeo explains their reasons for using HEVC including their drive to be able to encode and deliver 10-bit video. Ellation’s Subhrendu Sarakar makes the point that managing codec changes and bitrate changes needs to be done carefully to ensure viewers that notice the change understand them and don’t feel there has been a reduction of quality.

After a brief discussion of encoding strongly characterised video types such as anime and gaming, the conversation moves on to AV1 and migrating from VP9 and there is an audience question on HEVC licensing and the lack of use of SVC (Scalable Video Coding)

It’s now relatively well known that Twitch deployed VP9 using FPGAs rather than as a software encoder which was the only way to get the real-time speed at 1080p60. The panel discusses encoding speed both in the encoder and decoder for VP9 and AV1 then finishes with a Q&A from the audience.

Watch now!

Speakers

Tim Siglin Tim Siglin
Founding Executive Director
Help Me! Stream
Tarek Amara Tarek Amara
Principal Video Specialist,
Twitch
Vittorio Giovara Vittorio Giovara
Senior Engineer, Video Encoding
Vimeo
Nathan Egge Nathan Egge
Video Codec Engineer,
Mozilla
Subhrendu Sarkar Subhrendu Sarkar
Senior Engineering Manager, Video Infrastructure & CMS,
Ellation