Intelligent Web Advertisement Based on Eye-Tracking and Machine Learning

Document Type : Original Article


School of Mathematics, Statistics and Computer Science, College of Science, University of Tehran, Tehran, Iran


Building and maintaining brand loyalty is a vital issue for market research departments. ‎Various means, including online advertising, helps with promoting loyalty to the brand amongst users. The present paper studies intelligent web advertisements with an ‎eye-tracking technique that calculates users’ eye movements, ‎gaze ‎points, and heat maps. This ‎paper ‎examines different ‎features of an online ad and their combinations, such as underlining words and personalization by eye-tracking. These characteristics include underlining, changing color, number of words, personalizing, inserting a related photograph, and changing the size and location of the advertisement on a website. They help advertisers to improve their ability to manage the ads by increasing users' attention. Moreover, the current research argues the impact of gender on users' visual behavior for advertising features in different Cognitive Demand (CD) levels of tasks while avoiding interruption of users’ cognitive processes with eye-tracking techniques. Also, it provides users the most relevant advertisement compatible with CD level of a task by Support Vector Machine (SVM) algorithm with high accuracy. This paper consists of two experiments that one of them has two phases. In the first and second experiments, a news website alongside an advertisement and an advertising website is shown to the users. The results of the first experiment revealed that personalizing and underlining the words of the ad grabs more attention from users in a low CD task. Furthermore, darkening the background promotes users' frequency of attention in a high CD task. By analyzing the impact of gender on users' visual behavior, males are attracted to the advertisement with red-colored words sooner than females during the high CD task. Females pay more prolonged and more frequent attention to the ads with red-colored words and larger sizes in the low CD task. The second experiment shows that the gazing start point of users with a right to left mother tongue language direction is mainly in the middle of the advertising website.


Main Subjects

  • AdNews (2013, June13). No one’s paying attention to digital ads…well, 8% are Retrieved from
  • Bang, Hyejin, and Bartosz W. Wojdynski. "Tracking users' visual attention and responses to personalized advertising based on task cognitive demand." Computers in Human Behavior 55 (2016): 867-876.
  • Dehghani, Milad, et al. "Evaluating the influence of YouTube advertising for attraction of young customers." Computers in human behavior 59 (2016): 165-172.
  • Kumar, Naveen, Varun Maheshwari, and Jyoti Kumar. "A comparative study of user experience in online social media branding web pages using eye tracker." 2016 international conference on advances in human machine interaction (HMI). IEEE, 2016.
  • Buscher, Georg, Edward Cutrell, and Meredith Ringel Morris. "What do you see when you're surfing?: using eye tracking to predict salient regions of web pages." Proceedings of the SIGCHI conference on human factors in computing systems. ACM, 2009.
  • Sørum, Hanne. "Design of Public Sector Websites: Findings from an Eye Tracking Study Emphasizing Visual Attention and Usability Metrics." International Conference on Electronic Government and the Information Systems Perspective. Springer, Cham, 2016.
  • Zhang, Jin-Ting, et al. "A new test for functional one-way ANOVA with applications to ischemic heart screening." Computational Statistics & Data Analysis 132 (2019): 3-17
  • Ponzio, Francesco, et al. "A human-computer interface based on the “voluntary” pupil accommodative response." International Journal of Human-Computer Studies 126 (2019): 53-63.
  • Kaur, Akriti, Ashutosh Agrawal, and Pradeep Yammiyavar. "Exploring 3D Interactions for Number Entry and Menu Selection in Virtual Reality Environment." Research into Design for a Connected World. Springer, Singapore, 2019. 781-791.
  • Jerome, Theresa, Leong Wai Shan, and Kok Wei Khong. "Online advertising: a study on Malaysian consumers." Available at SSRN 1644802 (2010).
  • Brajnik, Giorgio, and Silvia Gabrielli. "A review of online advertising effects on the user experience." International Journal of Human-Computer Interaction 26.10 (2010): 971-997.
  • Rodgers, Shelly, and Esther Thorson. "The interactive advertising model: How users perceive and process online ads." Journal of interactive advertising 1.1 (2000): 41-60.
  • Faber, Ronald J., Mira Lee, and Xiaoli Nan. "Advertising and the consumer information environment online." American Behavioral Scientist 48.4 (2004): 447-466.
  • Rodgers, Shelly, and Esther Thorson. "The interactive advertising model: How users perceive and process online ads." Journal of interactive advertising 1.1 (2000): 41-60.
  • ACM SIGCHI: The Association for Computing Machinery Special Interest Group on Computer-Human Interaction (1992). Accessed 14 Mar 2016
  • Frøkjær, Erik, and Kasper Hornbæk. "Metaphors of human thinking for usability inspection and design." ACM Transactions on Computer-Human Interaction (TOCHI) 14.4 (2008): 20.
  • International Organization for Standardization (ISO) 9241-11: Ergonomic Requirements for Office Work with Visual Display Terminals (VDTs) – Part 11: Guidance on Usability (1998)
  • Berger, Jonah, and Katherine L. Milkman. "What makes online content viral?" Journal of marketing research 49.2 (2012): 192-205.
  • Yu, Jay, and Brenda Cude. "‘Hello, Mrs. Sarah Jones! We recommend this product!’Consumers' perceptions about personalized advertising: comparisons across advertisements delivered via three different types of media." International journal of consumer studies 33.4 (2009): 503-514.
  • Lang, A. (2006). Using the limited capacity model of motivated mediated message processing to design effective cancer communication messages. Journal of Communication,56(1),57–S80.
  • Petty, R.E., Barden, J., & Wheeler, S.C.(2002). The elaboration likelihood model of persuasion: health promotions that yield sustained behavioral change. InR.J. DiClemente, A. Crosby, &Kegler (Eds.), Emerging theories in health promotion practice and research(pp.71–99). San Francisco: Jossey-Bass.
  • Malheiros, Miguel, et al. "Too close for comfort: A study of the effectiveness and acceptability of rich-media personalized advertising." Proceedings of the SIGCHI conference on human factors in computing systems. ACM, 2012.
  • Tam, Kar Yan, and Shuk Ying Ho. "Web personalization as a persuasion strategy: An elaboration likelihood model perspective." Information systems research 16.3 (2005): 271-291.
  • Kreuter, Matthew W., and Ricardo J. Wray. "Tailored and targeted health communication: strategies for enhancing information relevance." American journal of health behavior 27.1 (2003): S227-S232.
  • Pavlou, Paul A., and David W. Stewart. "Measuring the effects and effectiveness of interactive advertising: A research agenda." Journal of Interactive Advertising 1.1 (2000): 61-77.
  • Baek, Tae Hyun, and Mariko Morimoto. "Stay away from me." Journal of advertising 41.1 (2012): 59-76.
  • Howard, Daniel J., and Roger A. Kerin. "The effects of personalized product recommendations on advertisement response rates: The “try this. It works!” technique." Journal of consumer psychology 14.3 (2004): 271-279.
  • Li, Cong. "When does web-based personalization really work? The distinction between actual personalization and perceived personalization." Computers in Human Behavior 54 (2016): 25-33.
  • Phelps, Joseph E., Giles D'Souza, and Glen J. Nowak. "Antecedents and consequences of consumer privacy concerns: An empirical investigation." Journal of Interactive Marketing 15.4 (2001): 2-17.
  • Sacirbey, O. "Privacy Concerns, Advertising Hamper E-commerce." IPO Reporter 24.35 (2000): 11-11.
  • Van Doorn, Jenny, and Janny C. Hoekstra. "Customization of online advertising: The role of intrusiveness." Marketing Letters 24.4 (2013): 339-351.
  • Kempf, DeAnna S., Kay M. Palan, and Russell N. Laczniak. "Gender differences in information processing confidence in an advertising context: A preliminary study." ACR North American Advances (1997).
  • Shavitt, Sharon, Pamela Lowrey, and James Haefner. "Public attitudes toward advertising: More favorable than you might think." Journal of advertising research 38.4 (1998): 7-22.
  • Sweller, John. "Cognitive load during problem solving: Effects on learning." Cognitive science 12.2 (1988): 257-285.
  • Sweller, John, Jeroen JG Van Merrienboer, and Fred GWC Paas. "Cognitive architecture and instructional design." Educational psychology review 10.3 (1998): 251-296.
  • Rodgers, Shelly, and Esther Thorson. "The interactive advertising model: How users perceive and process online ads." Journal of interactive advertising 1.1 (2000): 41-60.
  • Hoffman, Donna L., and Thomas P. Novak. "Marketing in hypermedia computer-mediated environments: Conceptual foundations." Journal of marketing 60.3 (1996): 50-68.
  • Wise, Kevin, Hyo Jung Kim, and Jeesum Kim. "The effect of searching versus surfing on cognitive and emotional responses to online news." Journal of Media Psychology 21.2 (2009): 49-59.
  • Wolford, George, and Fred Morrison. "Processing of unattended visual information." Memory & Cognition 8.6 (1980): 521-527.
  • Nielsen, Jakob. " F-Shaped Pattern For Reading Web Content, Jakob Nielsen's Alertbox." http://www. useit. com/alertbox/reading_pattern. html (2006).
  • Nielsen, J.: Designing Web Usability. New Riders Publishing, Indianapolis (2000). ISBN 1-56205-810-X
  • Johansen, Sune Alstrup, and John Paulin Hansen. "Do we need eye trackers to tell where people look?." CHI'06 Extended Abstracts on Human Factors in Computing Systems. ACM, 2006.
  • Ehmke, Claudia, and Stephanie Wilson. "Identifying web usability problems from eye-tracking data." Proceedings of the 21st British HCI Group Annual Conference on People and Computers: HCI... but not as we know it-Volume 1. British Computer Society, 2007.
  • Bojko, Aga. Eye tracking the user experience: A practical guide to research. Rosenfeld Media, 2013, P.27.
  • Byrne, Michael D., et al. "Eye tracking the visual search of click-down menus." Proceedings of the SIGCHI conference on Human Factors in Computing Systems. ACM, 1999.
  • Jacob, Robert JK, and Keith S. Karn. "Eye tracking in human-computer interaction and usability research: Ready to deliver the promises." The mind's eye. North-Holland, 2003. 573-605.
  • Carpenter, P. A., and M. A. Just. "Linguistic influences on picture scanning." Eye movements and psychological processes (1976): 459-472.
  • Graf, W., and H. Krueger. "Ergonomic evaluation of user-interfaces by means of eye-movement data." Proceedings of the third international conference on human-computer interaction, Vol. 1 on Work with computers: organizational, management, stress and health aspects. Elsevier Science Inc., 1989.
  • Wedel, Michel, and Rik Pieters. "A review of eye-tracking research in marketing." Review of marketing research. Routledge, 2017. 123-147.
  • Kong, Shaojun, et al. "Web advertisement effectiveness evaluation: Attention and memory." Journal of Vacation Marketing 25.1 (2019): 130-146.
  • Muñoz-Leiva, Francisco, Janet Hernández-Méndez, and Diego Gómez-Carmona. "Measuring advertising effectiveness in Travel 2.0 websites through eye-tracking technology." Physiology & behavior 200 (2019): 83-95.
  • Okano, Masao, and Masami Asakawa. "Eye tracking analysis of consumer's attention to the product message of web advertisements and TV commercials." 2017 5th International Conference on Cyber and IT Service Management (CITSM). IEEE, 2017.
  • Weizhe, Li, and Fei Hu. "Eye-Tracking assisted Human-Computer Interaction on E-Shopping Website: A Preliminary Study." (2020).
  • Jagadale, Pooja Ganesh. "Role of Eye Tracking System To Enhance Life Of Disable People." International Research Journal of Modernization in Engineering Technology and Science 2(11) (2020):715-719.
  • Agarkhed, Jayashree, et al. "Human Computer Interaction System Using Eye-Tracking Features." 2020 IEEE Bangalore Humanitarian Technology Conference (B-HTC). IEEE, 2020.
  • Brosens, Jacques, Funmi Adebesin, and Rendani Kruger. "In the eye of the beholder: Teaching user-centered design to information and communication technology students with the help of eye tracking." Handbook of research on diverse teaching strategies for the technology-rich classroom. IGI Global, 2020. 296-318.
  • Gwizdka, Jacek. "Distribution of cognitive load in web search." Journal of the American Society for Information Science and Technology 61.11 (2010): 2167-2187.