Psycho-Physiological Quality Assessment (PsyPhyQA)


Principal Investigator at CSIRO Data61

Ulrich Engelke, Senior Research Scientist (email)


Sebastian Bosse, Fraunhofer Institute for Telecommunications, Germany (VQEG Co-chair)
Naeem Ramzan, University of the West of Scotland, UK (VQEG Co-chair)
Sebastian Arndt, Norwegian University of Science and Technology, Norway
Maria Martini, Kingston University, UK
Dan Darcy, Dolby Laboratories, USA
Grant Mulliken, Dolby Laboratories, USA
Jan-Niklas Antons, Technical University of Berlin, Germany
Kit Yan Chan, Curtin University, Australia
Kjell Brunnstroem, ACREO, Sweden


2015 – ongoing

Project Description

Video quality assessment is typically performed using questionnaires, either open-ended or based on psychometric scales, such as n-point Likert scales. As valuable as these studies are, they are based on conscious responses by the participants and often do not provide sufficiently deep insight into underlying perceptual and cognitive processes. In order to gain a deeper understanding about the perceptual and cognitive processes underlying video quality perception, psycho-physiological measurements can be performed. For instance,

  • Eye gaze tracking provides valuable information about overt visual attention in visual space,
  • Electroencephalography (EEG) measurements inform about cognitive activity, such as cognitive load, situational awareness, emotional responses, and covert attention, and
  • Galvanic skin response (GSR) provides insight into arousal and hence emotional states.

These psychophysiological responses are not intended to replace well established psychophysical assessment techniques, but to augment them and provide additional sub-conscious information.

The PsyPhyQA project aims to establish novel psycho-physiology based techniques and methodologies for video quality assessment and real-time interaction of humans with advanced video communication environments. Specifically, some of the aspects that the project is looking at include

  • Video quality assessment based on human psycho-physiology, including, eye gaze, EEG, EKG, EMG, GSR, etc
  • Computational video quality models based on psycho-physiological measurements
  • Signal processing and machine learning techniques for psycho-physiology based video quality assessment
  • Experimental design and methodologies for psycho-physiological assessment
  • Correlates of psychophysics and psycho-physiology

The PsyPhyQA project is part of the Video Quality Experts Group (VQEG) that brings together global leaders from academia and industry to investigate quality of experience and user experience for modern image and video communication services. For more information visit the official VQEG website.

Classification of physiological measurement techniques.