Video: General Codec Update

People are relentlessly trying to find better ways to compress video. For some, better means lower bitrate. For some, this means faster processing. But for everyone this means new codecs and new standards.

Andreas Rossholm from Eyevinn Technology gives us the ‘lay of the land’ and explains the factors looming large in the minds of those who are developing the new standards.

Perceived Quality (QoE) is influenced by many factors, so is a moveable, translatable feast when it comes to pinning it down to a number. Andreas also talks about objective and subjective measurements are both valuable and so very different. We also see the advance from 2017 into 2018 of HEVC and AV1 with a look at the things to look out for when you hear about the results of a test. This will help you work out whether the results apply to you, or whether you need to do your own.

Andreas does a great job of explaining the types of things codecs are trying to minimise and the tools they’re using to succeed.

With a final look to the future and how codecs like AV1 and HEVC will perform, Andreas reminds us it’s not just about the codecs but also about how you use them; per-title parameters or per-shot?

This is a talk from the Streaming Tech Sweden 2018 conference. These talks are free to view to anyone who attended the event. After several months they then become free to view for everyone (free registration required).

The 2019 Streaming Tech Sweden conference from Eyevinn Technology takes place this November.
This year’s lineup of streaming tech talks at Streaming Tech Sweden will be presented on October 1st 08:30 CET live on Streaming Tech TV+.

Watch Andreas’ Talk!

Free Registration Required

Watch the live announcement of this year’s talks!
Free Registration Required


Andreas Rossholm Andreas Rossholm
Media Specialist Consultant,
Eyevinn Technology

Video: Deep Neural Networks for Video Coding

Artificial Intelligence, Machine Learning and related technologies aren’t going to go away…the real question is where they are best put to use. Here, Dan Grois from Comcast shows their transformative effect on video.

Some of us can have a passable attempt at explaining what neural networks, but to start to understand how this technology works understanding how our neural networks work is important and this is where Dan starts his talk. By walking us through the workings of our own bodies, he explains how we can get computers to mimic parts of this process. This all starts by creating a single neuron but Dan explains multi-layer perception by networking many together.

As we see examples of what these networks are able to do, piece by piece, we start to see how these can be applied to video. These techniques can be applied to many parts of the HEVC encoding process. For instance, extrapolating multiple reference frames, generating interpolation filters, predicting variations etc. Doing this we can achieve a 10% encoding improvements. Indeed, a Deep Neural Network (DNN) can totally replace the DCT (Discrete Cosine Transform) widely used in MPEG and beyond. Upsampling and downsampling can also be significantly improved – something that has already been successfully demonstrated in the market.

Dan isn’t shy of tackling the reason we haven’t seen the above gains widely in use; those of memory requirements and high computational costs. But this work is foundational in ensuring that these issues are overcome at the earliest opportunity and in optimising the approach to implementing them to the best extent possible to day.

The last part of the talk is an interesting look at the logical conclusion of this technology.

Watch now!


Dan Grois Dan Grois
Principal Researcher

Video: Multiple Codec Live Streaming At Twitch

Twitch is constantly searching for better and lower cost ways of streaming and its move to include VP9 was one of the most high profile ways of doing this. In this talk, a team of Twitch engineers examine the reasons for this and other moves.

Tarek Amara first takes to the stage to introduce Twitch and its scale before looking at the codecs available, the fragmentation of support but also the drivers to improve the video delivered to viewers both in terms of frame rate and resolution in addition to quality. The discussion turns to the reasons to implement of VP9 and we see that if HEVC were chosen instead, less than 3% of people would be able to receive it.

Nagendra Babu explains the basic architecture employed at Twitch before going on to explain the challenges they met in testing and developing the backend and app. He also talks about the difficulty of running multiple transcodes in the cloud. FPGAs are in important tool for Twitch, and Nagendra discusses how they deal with their programming.

The last speaker is Nikhil who talks about the format of VP9 being FMP4 delivered by transport stream and then outlines the pros and cons of Fragmented FMP4 before handing the floor to the audience.

Watch now!

Tarek Amara Tarek Amara
Principal Video Specialist,
Nikhil Purushe Nikhil Purushe
Senior Software Engineer,
Nagendra Babu Nagendra Babu
Senior Software Engineer,