Video: SRT – How the hot new UDP video protocol actually works under the hood

In the west, RTMP is seen as a dying protocol so the hunt is on for a replacement which can be as widely adopted but keep some of it’s best parts including relatively low latency. SRT is a protocol for Secure, Reliable Transport of streams over the internet so does this have a role to play and how does it work?

Alex Converse from Twitch picks up the gauntlet to dive deep into the workings of SRT to show how it compares to RTMP and specifically how it improves upon it.

RTMP fails in many ways, two to focus on are that the spec has stopped moving forward and it doesn’t work well over problematic networks. So Alex takes a few minutes to explain where SRT has come from, the importance of t being open source and how to get hold of the code and more information.

Now, Alex starts his dive into the detail reminding us about UDP, TS Packets and Ethernet MTUs has he goes down. We look at how SRT data packets are formed which helps explain some of the features and sets us up for a more focussed look.

SRT, as with other, similar protocols which create their resilience by retransmitting missing packets, need to use buffers in order to have a chance to send the missing data before it’s needed at the decoder. Alex takes us through how the sender and receiver buffers work to understand the behaviour in different situations.

Fundamental to the whole protocol is packet the packet acknowledgement and negative acknowledgements which feature heavily before we discuss handshaking as we start our ascent from the depths of the protocol. As much as acknowledgements provide the reliability, encryption provides the ‘secure’ in Secure Reliable Transport. We look at the approach taken to encryption and how it relates to current encryption for websites.

Finally, Alex answers a number of questions from the audience as he concludes this talk from the San Francisco Video Tech meet-up.

Watch now!

Speaker

Alex Converse Alex Converse
Streaming Video Software Engineer,
Twitch

Video: Multiple Codec Live Streaming At Twitch

Twitch is constantly searching for better and lower cost ways of streaming and its move to include VP9 was one of the most high profile ways of doing this. In this talk, a team of Twitch engineers examine the reasons for this and other moves.

Tarek Amara first takes to the stage to introduce Twitch and its scale before looking at the codecs available, the fragmentation of support but also the drivers to improve the video delivered to viewers both in terms of frame rate and resolution in addition to quality. The discussion turns to the reasons to implement of VP9 and we see that if HEVC were chosen instead, less than 3% of people would be able to receive it.

Nagendra Babu explains the basic architecture employed at Twitch before going on to explain the challenges they met in testing and developing the backend and app. He also talks about the difficulty of running multiple transcodes in the cloud. FPGAs are in important tool for Twitch, and Nagendra discusses how they deal with their programming.

The last speaker is Nikhil who talks about the format of VP9 being FMP4 delivered by transport stream and then outlines the pros and cons of Fragmented FMP4 before handing the floor to the audience.

Watch now!
Speakers

Tarek Amara Tarek Amara
Principal Video Specialist,
Twitch
Nikhil Purushe Nikhil Purushe
Senior Software Engineer,
Twitch
Nagendra Babu Nagendra Babu
Senior Software Engineer,
Twitch

Video: Get Ready For A Multiple Codec World

The codec world is fragmenting. None of the new entrants on to the market is expected to ever gain the universal status that AVC enjoys. This panel from Streaming Media East takes a look at how to prepare for this.

The panel kicks off discussing the differences between AVC and HEVC, VP9 and AV1 and moves on to discuss the pros and cons of supporting multiple codecs. Tarek from Twitch explains its partial adoption of VP9 – the reasons that it makes sense but the overheads which it brings the business.

Vittorio Giovara from Vimeo explains their reasons for using HEVC including their drive to be able to encode and deliver 10-bit video. Ellation’s Subhrendu Sarakar makes the point that managing codec changes and bitrate changes needs to be done carefully to ensure viewers that notice the change understand them and don’t feel there has been a reduction of quality.

After a brief discussion of encoding strongly characterised video types such as anime and gaming, the conversation moves on to AV1 and migrating from VP9 and there is an audience question on HEVC licensing and the lack of use of SVC (Scalable Video Coding)

It’s now relatively well known that Twitch deployed VP9 using FPGAs rather than as a software encoder which was the only way to get the real-time speed at 1080p60. The panel discusses encoding speed both in the encoder and decoder for VP9 and AV1 then finishes with a Q&A from the audience.

Watch now!

Speakers

Tim Siglin Tim Siglin
Founding Executive Director
Help Me! Stream
Tarek Amara Tarek Amara
Principal Video Specialist,
Twitch
Vittorio Giovara Vittorio Giovara
Senior Engineer, Video Encoding
Vimeo
Nathan Egge Nathan Egge
Video Codec Engineer,
Mozilla
Subhrendu Sarkar Subhrendu Sarkar
Senior Engineering Manager, Video Infrastructure & CMS,
Ellation

Video: AAC Demystified: How the AAC audio codec works and how to make sense of all its crazy profiles.

The title says it all! Alex Converse speaks here at the San Fancisco Video Tech meet up while he was working at Google discussing the ins and outs of AAC – and since he implemented an AAC decoder himself, he should know a thing or two about it.

Sure enough, Alex delivers by talking about the different version of AAA that have been around since MPEG 2 AAC through to the high efficiency AACs we have seen more recently.

Walking through the AAC Encoder block diagram we look at each of the different sections from sampling, MDCT (a type of Fourier transform) to psychoacoustic processing, stereo processing and more.

We then start to look at the syntax for the way the streams are structured which brings us in to understanding the AAC channel modes, and the enhanced mechanisms for encoding and processing used by the later versions of AAC including HE-AAC V2.

Alex finished with quick look at low delay codecs and a Q&A.

A great, detailed, overview of AAC. Ideal for developers and those who need to fully understand audio.

Watch now!

Speaker

Alex Converse Alex Converse
Senior Software Engineer,
Twitch