Predicting Eye Fixations on Webpage with an Ensemble of Early Features and High-Level Representations from Deep Network

Chengyao Shen, Xun Huang, Qi Zhao

Research output: Contribution to journalArticlepeer-review

31 Scopus citations

Abstract

In recent decades, webpages are becoming an increasingly important visual information source. Compared with natural images, webpages are different in many ways. For example, webpages are usually rich in semantically meaningful visual media (text, pictures, logos, and animations), which make the direct application of some traditional low-level saliency models ineffective. Besides, distinct web-viewing patterns such as top-left bias and banner blindness suggest different ways for predicting attention deployment on a webpage. In this study, we utilize a new scheme of low-level feature extraction pipeline and combine it with high-level representations from deep neural networks. The proposed model is evaluated on a newly published webpage saliency dataset with three popular evaluation metrics. Results show that our model outperforms other existing saliency models by a large margin and both low- and high-level features play an important role in predicting fixations on webpage.

Original languageEnglish (US)
Article number7294708
Pages (from-to)2084-2093
Number of pages10
JournalIEEE Transactions on Multimedia
Volume17
Issue number11
DOIs
StatePublished - Nov 1 2015

Bibliographical note

Publisher Copyright:
© 2015 IEEE.

Keywords

  • Deep learning
  • visual attention
  • web viewing
  • webpage saliency

Fingerprint

Dive into the research topics of 'Predicting Eye Fixations on Webpage with an Ensemble of Early Features and High-Level Representations from Deep Network'. Together they form a unique fingerprint.

Cite this