Video: Towards a healthy AV1 ecosystem for UGC platforms


Twitch is an ambassador for new codecs and puts its money where its mouth is; it is one of the few live streaming platforms which streams with VP9 – and not only at, with cloud FPGA acceleration thanks to Xylinx’s acquisition of NGCODEC.

As such, they have a strong position on AV1. With such a tech savvy crowd, they stream most of their videos at the highest bitrate (circa 6mbps). With millions of concurrent videos, they are highly motivated to reduce bandwidth where they can and finding new codecs is one way to do that.

Principal Research Engineer, Yueshi discusses Twitch’s stance on AV1 and the work they are doing to contribute in order to get the best product at the end of the process which will not only help them, but the worldwide community. He starts by giving an overview of Twitch which, while many of us are familiar with the site, the scale and needs of the site may be new information and drive the understanding of the rest of the talk.

Reduction in bitrate is a strong motivator, but also the fact that supporting many codecs is a burden. AV1 promises a possibility of reducing the number of supported codecs/formats. Their active contribution in AV1 is also determined by the ‘hand wave’ latency; a simple method of determining the approximate latency of a link which is naturally very important to a live streaming platform. This led to Twitch submitting a proposal for SWITCH_FRAME which is a technique, accepted in AV1, which allows more frequent changes by the player between the different quality/bitrate streams available. This results in a better experience for the user and also reduced bitrate/buffers.

YueShi then looks at the projected AV1 deployment roadmap and discusses when GPU/hardware support will be available. The legal aspect of AV1 – which promises to be a free-to-use codec is also discussed with the news that a patent pool has formed around AV1.

The talk finishes with a Q&A.

Watch now!

Speakers

Yueshi Shen Yueshi Shen
Principal (Level 7) Research Engineer & Engineering Manager,
Twitch

Video: General Codec Update

People are relentlessly trying to find better ways to compress video. For some, better means lower bitrate. For some, this means faster processing. But for everyone this means new codecs and new standards.

Andreas Rossholm from Eyevinn Technology gives us the ‘lay of the land’ and explains the factors looming large in the minds of those who are developing the new standards.

Perceived Quality (QoE) is influenced by many factors, so is a moveable, translatable feast when it comes to pinning it down to a number. Andreas also talks about objective and subjective measurements are both valuable and so very different. We also see the advance from 2017 into 2018 of HEVC and AV1 with a look at the things to look out for when you hear about the results of a test. This will help you work out whether the results apply to you, or whether you need to do your own.

Andreas does a great job of explaining the types of things codecs are trying to minimise and the tools they’re using to succeed.

With a final look to the future and how codecs like AV1 and HEVC will perform, Andreas reminds us it’s not just about the codecs but also about how you use them; per-title parameters or per-shot?

This is a talk from the Streaming Tech Sweden 2018 conference. These talks are free to view to anyone who attended the event. After several months they then become free to view for everyone (free registration required).

The 2019 Streaming Tech Sweden conference from Eyevinn Technology takes place this November.
This year’s lineup of streaming tech talks at Streaming Tech Sweden will be presented on October 1st 08:30 CET live on Streaming Tech TV+.

Watch Andreas’ Talk!

Free Registration Required

Watch the live announcement of this year’s talks!
Free Registration Required

Speakers

Andreas Rossholm Andreas Rossholm
Media Specialist Consultant,
Eyevinn Technology

Video: A Technical Overview of AV1

If there’s any talk that cuts through the AV1 hype, it must be this one. The talk from the @Scale conference starts by re-introducing AV1 and AoM but then moves quickly on to encoding techniques and the toolsets now available in AV1.

Starting by looking at the evolution from VP9 to AV1, Google engineer Yue Chen looks at:

  • Extended Reference Frames
  • Motion Vector Prediction
  • Dynamic Motion Vector Referencing
  • Overlapped Block Motion Compensation
  • Masked Compound Prediction
  • Warped Motion Compensation
  • Transform (TX) Coding, Kernels & Block Partitioning
  • Entropy Coding
  • AV1 Symbol Coding
  • Level-map TX Coefficient Coding
  • Restoration and Post-Processing
  • Constrained Dire. Enhancement Filtering
  • In-loop restoration & super resolution
  • Film Grain Synthesis

The talk finishes by looking at Compression Efficiency of AV1 against both HEVC (x.265) & VP9 (libvpx) then coding complexity in terms of speed plus what’s next on the roadmap!

Watch now!

Speaker

Yue Chen Yue Chen
Senior AV1 Engineer,
Google

Video: The Past, Present and Future of AV1

AV1 has strong backing from tech giants but is still seldom seen in the wild. Find out what the plans are for the future with Google’s Debargha Mukherjee.

Debargha’s intent in this talk is simple: to frame a description of what AV1 can do and is doing today in terms of the history of the codec and looking forward to the future and a potential AV2.

The talk starts by demonstrating the need for better video codecs not least of which is the statistic that by 2021, 81% of the internet’s traffic is expected to be video. But on top of that, there is a frustration with the slow decade-long refresh process which is traditional for video codecs. In order to match the new internet landscape with fast-evolving services, it seemed appropriate to have a codec which not only delivered better encoding but also saw a quicker five-year refresh cycle.

As a comparison to the royalty-free AV1, Debargha then looks at VP9 it is deployed. Further more, VP10 who’s development was stopped and diverted into the AV1 effort which is then the topic for the next part of the talk; the Alliance for Open Media, the standardisation process and then a look at some of the encoding tools available to archive the stated aims.

To round off the description of what’s presently happening with AV1 trials of VP9, HEVC and AV1 are shown demonstrating AV1s ability to improve compression for a certain quality. Bitmovin and Facebook’s tests are also highlighted along with speed tests.

Looking, now, to the future, the talk finishes by explaining the future roadmap for hardware decoding and other expected milestones in the coming years plus the software work such as SVT-AV1 and DAV1D for optimised encoding and decoding. With the promised five-year cycle, we need to look forward now to AV2 and Debargha discusses what it might be and what it would need to achieve.

Watch now!
Speaker

Debargha Mukherjee Debargha Mukherjee
Principal Software Engineer,
Google