How the H.266 video standard will help stream content way faster
Coming to a screen in your home soon
Why do we need video compression?
Content creation studios shoot and edit files for shows and movies in ananalog/RAW format, which preserves the maximum amount of information so that editors have the flexibility to tweak the colors and other visual parameters without affecting the fidelity of the image. These files are large, and it would take a lot of bandwidth and processing to beam them over your phone.
So, platforms such as Netflix, HBO, and Amazon Prime need to convert them into digital formats and compress the files.
What are the commonly used video compression standards?
Some of the standards generally used across the web for video streaming are AV1, H.264, H.265/HEVC (High-Efficiency Video Coded), VC-1, and Apple ProRes. Most of these use a mathematical concept called Discrete Cosine Transform (DCT). It’s the technique used to identify redundant pixels in an image that could bethat can be discarded while compressing it, without majorly affecting image quality.
Who develops these standards?
A collective known as Telecommunication Standardization Sector (ITU-T) — specifically the study group 16 — is mainly concerned with all codecs related to the H.26x series. The function of this clutch of participating companies, which is based in Geneva, is to devise and maintain such technological standards. Its members consist of Apple, IBM, Huawei, and Nokia.
First, a working group lists out requirements for the standard that is to be developed. Then it puts out a call for evidence, asking differentdevelopers to propose the best implementationto achieve all these standards.
After that, there’s a call for proposals where different developers submit their own solutions. Finally, the standard is based on combining the best parts of different proposals.
What is H.266?
H.266 or VVC (Versatile Video Codec) is a new compression standard developed bythe Joint Video Experts Team (JVET). The team was formed by experts fromthe Moving Picture Experts Group (MPEG)from the ISO/IEC group andthe Video Coding Experts Group (VCEG)from the ITU-T group. Phew, that’s a lot of acronyms. I’m sorry.
The JVET will be also responsible for maintaining the existing H.264 and H.265 standards.
Fraunhofer Heinrich Hertz Institute, based in Germany, which was one of the developers of the standards, officially announced the standard in July 2020.
Benjamin Bross, the head of the video coding systems group, Fraunhofer HHI, said that this standard came into the picture as more phones and devices now have support for capturing high-resolution footage in 4K, and we need a powerful, efficient video encoding system to send them across the internet and store it in devices:
You can read the technical details of the H.266 compressions standardhere.
What’s the advantage of H.266?
The primary aim for any new video compression standardis to reduce the bandwidth a video takes up while preserving the fidelity as much as possible.
Early tests suggest that H.266achieves 40%-50% better compression rates than HEVC, which is currently used by Apple in iPhones. That could mean that you can stream an episode of your favorite series by using almost half the data.
When the standard was released Fraunhofer HHI claimed that the HEVC standard takes up 10GB of data to stream a 90-minute long 4K video file. In comparison, H.266 uses only 5GB of data to stream the same file.
The JVET decided to build H.266 (VVC) for applications beyond video streaming. The standard has support for beaming 4K to 8K videos seamlessly, along with support for 360-degree videos. This could be useful in VR and AR applications.
Bross mentioned that H.266 is designed in such a way that that you can access different regions of a frame directly in the bitstream. So a video streaming service could choose to streams regions that are not very important in the scence in a lower resolution to save bandwidth.
Who is using this and what are the problems?
Currently, India-based streaming platformMX Playeris one of the few platforms of the world that has adopted the H.266 standard to stream its content.
Siddharth Mantri, chief product officer at MX Player, told TNWthat while the cost of mobile data has gone down in India, there are still bandwidth limitations that could throttle the quality of videos:
While MX Player prefers to stream its content on H.266, depending on the device and network conditions, it might have to fall back to other standards such as AV1 or H.265 on some devices, until playback support for the new standard is baked into chips that are used in those gadgets. Other streaming players will also face this challenge and have to follow suit for a while.
Mantri said that the company has been servicing content through H.266 standard to almost 20% of its customer base and it has received no complaints.
While both the encoder and decoder are open-sourced, it’s hard to develop them both for all companies. MX Player has built its own encoder, and has licensed the decoder from Tencent, one of its investors.
There are also companies likeMPEG-LAandAccess Advancethat offer licenses to H.266. They have a pool of licenses from different right holders and developers, and you can choose what’s best for you. You can read more about ithere.
Qualcomm said last year that we will seecompanies deploying H.266 on a commercial level in 2021. MX Player and Tencent Cloud are some examples of that, with more to come.
It’s important to keep in mind that while HEVC was released in 2013, it was supported in iPhones only by 2017. Bross said that we might see support for H.266 in chipsets by the end of this year or next year, and wider support in devices should follow soon.
H.266 looks like an efficient and flexible standard on paper, but it’ll take a couple of years for it to dethrone current standards such as H.265 and AV1.
Story byIvan Mehta
Ivan covers Big Tech, India, policy, AI, security, platforms, and apps for TNW. That’s one heck of a mixed bag. He likes to say “Bleh.“Ivan covers Big Tech, India, policy, AI, security, platforms, and apps for TNW. That’s one heck of a mixed bag. He likes to say “Bleh.”
Get the TNW newsletter
Get the most important tech news in your inbox each week.
