Presentation at the Symposium on Applied Perception



This coming Friday, Jacob Hadnett-Hunter will attend the Symposium on Applied Perception (SAP 2019) in Barcelona to present a recently published a paper in Transactions on Applied Perception (TAP) called ‘The effect of task on visual attention in interactive virtual environments‘. The SAP 2019 provides an intimate, immersive forum for researchers who combine knowledge, methods, and insights from perception research and computer science disciplines.

Jacob’s co-author George Nicolaou is a recently graduated final year project student who helped collect data and design the experiment – a great example of how getting involved with the research that is going on in the department can lead to good things such as publication!


Eye Tracking Demo, Barcelona Pavilion

Abstract

Virtual environments for gaming and simulation provide dynamic and adaptive experiences, but, despite advances in multisensory interfaces, these are still primarily visual experiences. To support real-time dynamic adaptation, interactive virtual environments could implement techniques to predict and manipulate human visual attention. One promising way of developing such techniques is to base them on psychophysical observations, an approach that requires a sound understanding of visual attention allocation. Understanding how this allocation of visual attention changes depending on a user’s task offers clear benefits in developing these techniques and improving virtual environment design. With this aim, we investigated the effect of task on visual attention in interactive virtual environments. We recorded fixation data from participants completing freeview, search, and navigation tasks in three different virtual environments. We quantified visual attention differences between conditions by identifying the predictiveness of a low-level saliency model and its corresponding color, intensity, and orientation feature-conspicuity maps, as well as measuring fixation center bias, depth, duration, and saccade amplitude. Our results show that task does affect visual attention in virtual environments. Navigation relies more than search or freeview on intensity conspicuity to allocate visual attention. Navigation also produces fixations that are more central, longer, and deeper into the scenes. Further, our results suggest that it is difficult to distinguish between freeview and search tasks. These results provide important guidance for designing virtual environments for human interaction, as well as identifying future avenues of research for developing “attention-aware” virtual worlds.

The three virtual environments in which participants performed freeview, search, and navigation tasks.
On the left is an indoor office space. In the middle, a suburban street. On the right is a desert junkyard.

Hadnett-Hunter, J., Nicolaou, G., O’Neill, E. and Proulx, M., 2019. The Effect of Task on Visual Attention in Interactive Virtual Environments. ACM Transactions on Applied Perception (TAP), 16(3), p.17.


Written by CAMERA Centre Coordinator