This monograph introduces a comprehensive framework for optimizing perceptual quality in online, real-time, interactive multimedia systems involving multiple users, performance metrics, and application controls. It outlines an integrated offline-online process that learns perceptual quality under controlled conditions and adapts it to dynamic, real-time environments. The optimization is modeled as a decomposable multi-metric, multi-control problem, solvable in polynomial time by integrating solutions from simpler subproblems. Each subproblem is evaluated using a novel, function-free method based on dominance and a binary-divide algorithm with guaranteed error tolerance.
The work is the first to show that the relationship between a stimulus and its variation in multimedia and psychophysical applications can be nonlinear yet monotonic and non-smooth. It also pioneers a method for optimizing perceptual quality in real-time communications without requiring original data at the receiver. This long-standing open problem is challenging due to the subjective nature of perceptual quality and the complexity of unknown tradeoffs among quality measures. The findings demonstrate the feasibility of solving these challenges through decomposition and dominance, offering practical solutions for improving perceptual quality in online real-time interactive multimedia applications.
This monograph introduces a comprehensive framework for optimizing perceptual quality in online, real-time, interactive multimedia systems involving multiple users, performance metrics, and application controls. It outlines an integrated offline-online process that learns perceptual quality under controlled conditions and adapts it to dynamic, real-time environments. The optimization is modeled as a decomposable multi-metric, multi-control problem, solvable in polynomial time by integrating solutions from simpler subproblems. Each subproblem is evaluated using a novel, function-free method based on dominance and a binary-divide algorithm with guaranteed error tolerance.
The work is the first to show that the relationship between a stimulus and its variation in multimedia and psychophysical applications can be nonlinear yet monotonic and non-smooth. It also pioneers a method for optimizing perceptual quality in real-time communications without requiring original data at the receiver. This long-standing open problem is challenging due to the subjective nature of perceptual quality and the complexity of unknown tradeoffs among quality measures. The findings demonstrate the feasibility of solving these challenges through decomposition and dominance, offering practical solutions for improving perceptual quality in online real-time interactive multimedia applications.
Benjamin W. Wah
Function-free psychometric functions Internet Multimedia Applications Just noticeable difference Multi-metric, multi-control applications Multiparty online action games Multiparty videoconferencing Objective perceptual quality models Offline-online optimization Online real-time interactive multimedia applications Optimal runtime perceptual quality Decomposable formulation Perceptual quality in psychophysics Subjective evaluations Voice over IP