Design, Development and Evaluation of an Adaptive and Standardized RTCP-based IDMS Solution
Supervisor(s) and Committee member(s): Co-Supervisor: Prof. Fernando Boronat (UPV, Spain)
Co-Supervisor: Dr. Pablo Cesar (CWI, Amsterdam)
Nowadays, we are witnessing a transition from physical togetherness towards networked togetherness around media content. Novel forms of shared media experiences are gaining momentum, allowing geographically distributed users to concurrently consume the same media content while socially interacting (e.g., via text, audio or video chat). Relevant use cases are, for example, Social TV, networked games and multi-party conferencing.
However, realizing enjoyable shared media services faces many challenges. In particular, a key technological enabler is the concurrent synchronization of the media playout across multiple locations, which is known as Inter-Destination Multimedia Synchronization (IDMS).
This PhD thesis presents an inter-operable, adaptive and accurate IDMS solution, based on extending the capabilities of RTP/RTCP standard protocols (RFC 3550). Concretely, two new RTCP messages for IDMS have been defined to carry out the necessary information to achieve IDMS. Such RTCP extensions have been standardized within the IETF, in RFC 7272. In addition, novel standard-compliant Early Event-Driven (EED) RTCP feedback reporting mechanisms have been also designed to enhance the performance in terms of interactivity, flexibility, dynamism and accuracy when performing IDMS.
The designed IDMS solution makes use of globally synchronized clocks (e.g., using NTP) and can adopt different (centralized and distributed) architectural schemes to exchange the RTCP messages for IDMS. This allows efficiently providing IDMS in a variety of networked scenarios and applications, with different requirements (e.g., interactivity, scalability, robustness…) and available resources (e.g., bandwidth, latency, multicast support…). Likewise, various monitoring and control algorithms, such as dynamic strategies for selecting the reference timing to synchronize with, and fault tolerance mechanisms, have been added. Moreover, the proposed IDMS solution includes a novel Adaptive Media Playout (AMP) technique, which aims to smoothly adjust the media playout rate, within perceptually tolerable ranges, every time an asynchrony threshold is exceeded.
Prototypes of the IDMS solution have been implemented in both a simulation and in real media framework. The evaluation tests prove the consistent behavior and the satisfactory performance of each one of the designed components (e.g., protocols, architectural schemes, master selection policies, adjustment techniques…). Likewise, comparison results between the different developed alternatives for such components are also provided. In general, the obtained results demonstrate the ability of this RTP/RTCP-based IDMS solution to concurrently and independently maintain an overall synchronization status (within allowable limits) in different logical groups of users, while avoiding annoying playout discontinuities and hardly increasing the computation and traffic load.
To check the contributions of the PhD thesis, please visit my website: https://sites.google.com/site/mamontor/
Interactive and Immersive Media (IIM) R&D Group; Distributed and Interactive Systems (DIS) Group
IIM Group: IIM is an emerging research group composed of professors, researchers and students, most of them belonging to the Polytechnic University of Valencia (UPV, Spain), in particular to the Gandia Campus. Its main research line is the design and evaluation of interactive and distributed multimedia systems, mainly focusing on synchronization (especially Inter-Destination Media Synchronization – IDMS - and Hybrid Synchronization) and Quality of Experience (QoE) aspects. Additionally, IIM group is also very interested in other research topics, such as web-based communications, development of immersive scenarios, 3D virtual reality environments, networked multimedia games, Motion Capture (MOCAP), gesture interaction and control, and Multi-Sensorial Media (MulSeMedia) experiences.
DIS Group: DIS group focuses on modeling and controlling complex collections of media objects (including real-time media and sensor data) that are interactive and distributed in time and space. The group’s fundamental interest is in understanding how the various notions of ‘time’ influence the creation, distribution and delivery of complex content in a customizable manner.