Christian Timmerer is a researcher, entrepreneur, and teacher on immersive multimedia communication, streaming, adaptation, and Quality of Experience. He is an Assistant Professor at Alpen-Adria-Universität Klagenfurt, Austria. Follow him on Twitter at http://twitter.com/timse7 and subscribe to his blog at http://blog.timmerer.com.
The 103rd MPEG meeting was held in Geneva, Switzerland, January 21-15, 2013. The official press release can be found here (doc only) and I’d like to introduce the new MPEG-H standard (ISO/IEC 23008) referred to as high efficiency coding and media delivery in heterogeneous environments:
- Part 1: MPEG Media Transport (MMT) – status: 2nd committee draft (CD)
- Part 2: High Efficiency Video Coding (HEVC) – status: final draft international standard (FDIS)
- Part 3: 3D Audio – status: call for proposals (CfP)
MPEG Media Transport (MMT)
The MMT project was started in order to address the needs of modern media transport applications going beyond the capabilities offered by existing means of transportation such as formats defined by MPEG-2 transport stream (M2TS) or ISO base media file format (ISOBMFF) group of standards. The committee draft was approved during the 101st MPEG meeting. As a response to the CD ballot, MPEG received more than 200 comments from national bodies and, thus, decided to issue the 2nd committee draft which will be publicly available by February 7, 2013.
High Efficiency Video Coding (HEVC) – ITU-T H.265 | MPEG HEVC
HEVC is the next generation video coding standard jointly developed by ISO/IEC JTC1/SC29/WG11 (MPEG) and the Video Coding Experts Group (VCEG) of ITU-T WP 3/16. Please note that both ITU-T and ISO/IEC MPEG use the term “high efficiency video coding” in the the title of the standard but one can expect – as with its predecessor – that the former will use ITU-T H.265 and the latter will use MPEG-H HEVC for promoting its standards. If you don’t want to participate in this debate, simply use high efficiency video coding.
The MPEG press release says that the “HEVC standard reduces by half the bit rate needed to deliver high-quality video for a broad variety of applications” (note: compared to its predecessor AVC). The editing period for the FDIS goes until March 3, 2013 and then with the final preparations and a 2 month balloting period (yes|no vote only) once can expect the International Standard (IS) to be available early summer 2013. Please note that there are no technical differences between FDIS and IS.
The ITU-T press release describes HEVC as a standard that “will provide a flexible, reliable and robust solution, future-proofed to support the next decade of video. The new standard is designed to take account of advancing screen resolutions and is expected to be phased in as high-end products and services outgrow the limits of current network and display technology.”
HEVC currently defines three profiles:
- Main Profile for the “Mass-market consumer video products that historically require only 8 bits of precision”.
- Main 10 Profile “will support up to 10 bits of processing precision for applications with higher quality demands”.
- Main Still Picture Profile to support still image applications, hence, “HEVC also advances the state-of-the-art for still picture coding”
The 3D audio standard shall complement MMT and HEVC assuming that in a “home theater” system a large number of loudspeakers will be deployed. Therefore, MPEG has issued a Call for Proposals (CfP) with the selection of the reference model v0 due in July 2013. The CfP says that MPEG-H 3D Audio “might be surrounding the user and be situated at high, mid and low vertical positions relative to the user’s ears. The desired sense of audio envelopment includes both immersive 3D audio, in the sense of being able to virtualize sound sources at any position in space, and accurate audio localization, in terms of both direction and distance.”
“In addition to a “home theater” audio-visual system, there may be a “personal” system having a tablet-sized visual display with speakers built into the device, e.g. around the perimeter of the display. Alternatively, the personal device may be a hand-held smart phone. Headphones with appropriate spatialization would also be a means to deliver an immersive audio experience for all systems.”
Complementary to the CfP, MPEG also provided the encoder input format for MPEG-H 3D audio and a draft MPEG audio core experiment methodology for 3D audio work.
Publicly available MPEG output documents
The following documents shall be come available at http://mpeg.chiariglione.org/ (note: some may have an editing period – YY/MM/DD). If you have difficulties to access one of these documents, please feel free to contact me.
- Study text of DIS of ISO/IEC 23000-13, Augmented Reality Application Format (13/01/25)
- Study text of DTR of ISO/IEC 23000-14, Augmented reality reference model (13/02/25)
- Text of ISO/IEC FDIS 23005-1 2nd edition Architecture (13/01/25)
- Text of ISO/IEC 2nd CD 23008-1 MPEG Media Transport (13/02/07)
- Text of ISO/IEC 23008-2:201x/PDAM1 Range Extensions (13/03/22)
- Text of ISO/IEC 23008-2:201x/PDAM2 Multiview Extensions (13/03/22)
- Call for Proposals on 3D Audio (13/01/25)
- Encoder Input Format for MPEG-H 3D Audio (13/02/08)
- Draft MPEG Audio CE methodology for 3D Audio work (13/01/25)
- Draft Requirements on MPEG User Descriptions (13/02/08)
- Draft Call for Proposals on MPEG User Descriptions (13/01/25)
- Draft Call for Proposals on Green MPEG (13/01/25)
- Context, Objectives, Use Cases and Requirements for Green MPEG (13/01/25)
- White Paper on State of the Art in compression and transmission of 3D Video (13/01/28)
- MPEG Awareness Event Flyer at 104th MPEG meeting in Incheon (13/02/28)