Linking distortion perception and visual saliency in H.264/AVC coded video containing packet loss

Ulrich Engelke; Romuald Pepion; Patrick Le Callet; Hans-Jürgen Zepernick

doi:10.1117/12.863508

13 July 2010 Linking distortion perception and visual saliency in H.264/AVC coded video containing packet loss

Ulrich Engelke, Romuald Pepion, Patrick Le Callet, Hans-Jürgen Zepernick

Proceedings Volume 7744, Visual Communications and Image Processing 2010; 774406 (2010) https://doi.org/10.1117/12.863508
Event: Visual Communications and Image Processing 2010, 2010, Huangshan, China

Abstract

In this paper, distortions caused by packet loss during video transmission are evaluated with respect to their perceived annoyance. In this respect, the impact of visual saliency on the level of annoyance is of particular interest, as regions and objects in a video frame are typically not of equal importance to the viewer. For this purpose, gaze patterns from a task free eye tracking experiment were utilised to identify salient regions in a number of videos. Packet loss was then introduced into the bit stream such as that the corresponding distortions appear either in a salient region or in a non-salient region. A subjective experiment was then conducted in which human observers rated the annoyance of the distortions in the videos. The outcomes show a strong tendency that distortions in a salient region are indeed perceived as much more annoying as compared to distortions in the non-salient region. The saliency of the distorted image content was further found to have a larger impact on the perceived annoyance as compared to the distortion duration. The findings of this work are considered to be of great use to improve prediction performance of video quality metrics in the context of transmission errors.

Citation Download Citation

Ulrich Engelke, Romuald Pepion, Patrick Le Callet, and Hans-Jürgen Zepernick "Linking distortion perception and visual saliency in H.264/AVC coded video containing packet loss", Proc. SPIE 7744, Visual Communications and Image Processing 2010, 774406 (13 July 2010); https://doi.org/10.1117/12.863508

ACCESS THE FULL ARTICLE

INSTITUTIONAL
Select your institution to access the SPIE Digital Library.

SELECT YOUR INSTITUTION

PERSONAL
Sign in with your SPIE account to access your personal subscriptions or to use specific features such as save to my library, sign up for alerts, save searches, etc.

PERSONAL SIGN IN

No SPIE Account? Create one

PURCHASE THIS CONTENT

SUBSCRIBE TO DIGITAL LIBRARY

50 downloads per 1-year subscription

Members: $195

Non-members: $335 ADD TO CART

25 downloads per 1 - year subscription

Members: $145

Non-members: $250 ADD TO CART

PURCHASE SINGLE ARTICLE

Includes PDF, HTML & Video, when available