nach oben

Erschienen in:

2024 | OriginalPaper | Buchkapitel

Computational Methods to Infer Human Factors for Adaptation and Personalization Using Eye Tracking

verfasst von : Ben Steichen

Erschienen in: A Human-Centered Perspective of Intelligent Personalized Environments and Systems

Verlag: Springer Nature Switzerland

Einloggen

Aktivieren Sie unsere intelligente Suche, um passende Fachinhalte oder Patente zu finden.

search-config

KI-gestützte Suche

Aus

Abstract

“The Eyes Are the Window to the Soul” is a commonly used phrase that refers to the intricate relationship between a person's eyes and their underlying thought processes and affective states. Indeed, researchers in perceptual and cognitive psychology have long studied a user's eye movements in order to understand attention patterns and emotional responses to stimuli. More recently, researchers in Human–Computer Interaction and Artificial Intelligence have started to study the potential of using eye tracking to infer a user's underlying human factors, in order to drive personalized systems that adapt to an individual user's abilities, traits, and states. This chapter provides an overview of eye tracking technology, as well as a review of the various eye movement features that may be calculated from eye tracking data. This is followed by a review of various modeling techniques that use these features to infer human factors, as well as a range of application scenarios and examples. Lastly, the chapter concludes with an outlook on the use of eye tracking technology for human factor inference, including both challenges and opportunities.

Sie haben noch keine Lizenz? Dann Informieren Sie sich jetzt über unsere Produkte:

Springer Professional "Wirtschaft+Technik"

Online-Abonnement

Mit Springer Professional "Wirtschaft+Technik" erhalten Sie Zugriff auf:

über 102.000 Bücher
über 537 Zeitschriften

aus folgenden Fachgebieten:

Automobil + Motoren
Bauwesen + Immobilien
Business IT + Informatik
Elektrotechnik + Elektronik
Energie + Nachhaltigkeit
Finance + Banking
Management + Führung
Marketing + Vertrieb
Maschinenbau + Werkstoffe
Versicherung + Risiko

Jetzt Wissensvorsprung sichern!

Jetzt informieren

Springer Professional "Technik"

Online-Abonnement

Mit Springer Professional "Technik" erhalten Sie Zugriff auf:

über 67.000 Bücher
über 390 Zeitschriften

aus folgenden Fachgebieten:

Automobil + Motoren
Bauwesen + Immobilien
Business IT + Informatik
Elektrotechnik + Elektronik
Energie + Nachhaltigkeit
Maschinenbau + Werkstoffe

Jetzt Wissensvorsprung sichern!

Jetzt informieren

Springer Professional "Wirtschaft"

Online-Abonnement

Mit Springer Professional "Wirtschaft" erhalten Sie Zugriff auf:

über 67.000 Bücher
über 340 Zeitschriften

aus folgenden Fachgebieten:

Bauwesen + Immobilien
Business IT + Informatik
Finance + Banking
Management + Führung
Marketing + Vertrieb
Versicherung + Risiko

Jetzt Wissensvorsprung sichern!

Jetzt informieren

Vorheriges Kapitel Inferring Eudaimonia and Hedonia from Digital Traces

Nächstes Kapitel Coarse-Grained Detection for Personalized Online Learning Interventions

Aggarwal CC (2016) Recommender systems, vol 1. Springer, Berlin

Anderson NC, Anderson F, Kingstone A, Bischof WF (2015) A comparison of scanpath comparison methods. Behav Res Methods 47:1377–1392CrossRef

Ashton MC, Lee K, Perugini M, Szarota P, De Vries RE, Di Blas L, Boies K, De Raad B (2004) A six-factor structure of personality-descriptive adjectives: solutions from psycholexical studies in seven languages. J Pers Soc Psychol 86(2):356CrossRef

Baltrusaitis T, Zadeh A, Lim YC, Morency LP (2018) Openface 2.0: Facial behavior analysis toolkit. In: 2018 13th IEEE international conference on automatic face and gesture recognition (FG 2018), pp 59–66

Bergstrom JR, Schall A (eds) (2014) Eye tracking in user experience design. Elsevier

Berkovsky S, Taib R, Koprinska I, Wang E, Zeng Y, Li J, Kleitman S (2019) Detecting personality traits using eye-tracking data. In: Proceedings of the 2019 CHI conference on human factors in computing systems, pp 1–12

Brusilovsky P, Kobsa A, Nejdl W (eds) (2007) The adaptive web: methods and strategies of web personalization, vol 4321. Springer Science & Business Media

Brusilovsky P, Sosnovsky S, Thaker K (2022) The return of intelligent textbooks. AI Mag 43(3):337–340

Chen L, Cai W, Yan D, Berkovsky S (2023) Eye-tracking-based personality prediction with recommendation interfaces. User Model User-Adap Interact 33(1):121–157CrossRef

10.

Conati C, Lallé S, Rahman MA, Toker D (2020) Comparing and combining interaction data and eye-tracking data for the real-time prediction of user cognitive abilities in visualization tasks. ACM Trans Interact Intell Syst (TiiS) 10(2):1–41CrossRef

11.

Duchowski AT (2017) Eye tracking methodology: theory and practice. Springer, Berlin

12.

Ekstrom RB, Harman HH (1976) Manual for kit of factor-referenced cognitive tests. Educational testing service

13.

Fu B, Noy NF, Storey MA (2017) Eye tracking the user experience–an evaluation of ontology visualization techniques. Semantic Web 8(1):23–41CrossRef

14.

Goldberg JH, Kotval XP (1999) Computer interface evaluation using eye movements: methods and constructs. Int J Ind Ergon 24(6):631–645CrossRef

15.

Goldberg JH, Helfman JI (2010) Visual scanpath representation. In: Proceedings of the 2010 symposium on eye-tracking research and applications, pp 203–210

16.

Hall M, Frank E, Holmes G, Pfahringer B, Reutemann P, Witten IH (2009) The WEKA data mining software: an update. ACM SIGKDD Explor Newsl 11(1):10–18CrossRef

17.

Sriram H, Conati C, Field T (2023) Classification of Alzheimer's disease with deep learning on eye-tracking data. In: Proceedings of the 25th international conference on multimodal interaction (ICMI ‘23), pp 104–113

18.

Huang J, White R, Buscher G (2012) User see, user point: gaze and cursor alignment in web search. In: Proceedings of the sigchi conference on human factors in computing systems, pp 1341–1350

19.

Karolus J, Wozniak PW, Chuang LL, Schmidt A (2017) Robust gaze features for enabling language proficiency awareness. In: Proceedings of the 2017 CHI conference on human factors in computing systems, pp 2998–3010

20.

Kiefer P, Giannopoulos I, Duchowski A, Raubal M (2016) Measuring cognitive load for map tasks through pupil diameter. In: geographic information science: 9th international conference, GIScience 2016, Proceedings, vol 9. Montreal, QC, Canada, pp 323–33.

21.

Kinnebrew JS, Biswas G (2012) Identifying learning behaviors by contextualizing differential sequence mining with action features and performance evolution. In: Proceedings of EDM, 5th international conference on educational data mining, pp 57–64

22.

Krejtz K, Duchowski A, Szmidt T, Krejtz I, González Perilli F, Pires A, Vilaro A, Villalobos N (2015) Gaze transition entropy. ACM Trans Appl Percept (TAP) 13(1):1–20CrossRef

23.

Kuhn M (2008) Building predictive models in R using the caret package. J Stat Softw 28(5):1–26CrossRef

24.

Le Louedec J, Guntz T, Crowley JL, Vaufreydaz D (2019) Deep learning investigation for chess player attention prediction using eye-tracking and game data. In: Proceedings of the 11th ACM symposium on eye tracking research and applications (ETRA ’19), pp 1–9

25.

Levenshtein VI (1966) Binary codes capable of correcting deletions, insertions, and reversals. Sov Phys Doklady 10(8):707–710

26.

Matthews G, Deary IJ, Whiteman MC (2003) Personality traits. Cambridge University PressCrossRef

27.

McCrae RR, Costa PT Jr (1999) A five-factor theory of personality. Handb Pers: Theory Res 2(1999):139–153

28.

Millecamp M, Conati C, Verbert K (2021) Classifeye: classification of personal characteristics based on eye tracking data in a recommender system interface. In: Joint proceedings of the ACM IUI 2021 workshops

29.

Morey LC (2014) The personality assessment inventory. In: Personality assessment. Routledge, pp 193–240

30.

Murali R, Conati C, Azevedo R (2023) Predicting co-occurring emotions in metatutor when combining eye-tracking and interaction data from separate user studies. In: LAK23: 13th international learning analytics and knowledge conference, pp 388–398

31.

Papoutsaki A, Sangkloy P, Laskey J, Daskalova N, Huang J, Hays J (2016) Webgazer: scalable webcam eye tracking using user interactions. In: Proceedings of the twenty-fifth international joint conference on artificial intelligence, pp 3839–3845

32.

Paszke A, Gross S, Massa F, Lerer A, Bradbury J, Chanan G, Killeen T, Lin Z, Gimelshein N, Antiga L, Desmaison A (2019) Pytorch: an imperative style, high-performance deep learning library. Adv Neural Inf Process Syst 32

33.

Pedregosa F, Varoquaux G, Gramfort A, Michel V, Thirion B, Grisel O, Blondel M, Prettenhofer P, Weiss R, Dubourg V, Vanderplas J (2011) Scikit-learn: machine learning in python. J Mach Learn Res 12:2825–2830

34.

Pusiol G, Esteva A, Hall SS, Frank M, Milstein A, Fei-Fei (2016) Vision-based classification of developmental disorders using eye-movements. In: Medical image computing and computer-assisted intervention–MICCAI 2016, pp 317–325

35.

Raptis GE, Fidas CA, Avouris NM (2016) Using eye tracking to identify cognitive differences: a brief literature review. In: Proceedings of the 20th pan-hellenic conference on informatics, pp 1–6

36.

Raptis GE, Katsini C, Belk M, Fidas C, Samaras G, Avouris N (2017) Using eye gaze data and visual activities to infer human cognitive styles: method and feasibility studies. In: Proceedings of the 25th conference on user modeling, adaptation and personalization, pp 164–173

37.

Rayner K (1998) Eye movements in reading and information processing: 20 years of research. Psychol Bull 124(3)

38.

Rayner K, Pollatsek A, Ashby J, Clifton Jr, C (2012) Psychology of reading

39.

Ricci F, Rokach L, Shapira B (2021) Recommender systems: Techniques, applications, and challenges. In: Recommender systems handbook, pp 1–35

40.

Shiferaw BA, Downey LA, Westlake J, Stevens B, Rajaratnam SM, Berlowitz DJ, Swann P, Howard ME (2018) Stationary gaze entropy predicts lane departure events in sleep-deprived drivers. Sci Rep 8(1):1–10CrossRef

41.

Špakov O (2012) Comparison of eye movement filters used in HCI. In: Proceedings of the symposium on eye tracking research and applications, pp 281–284

42.

Spiller M, Liu YH, Hossain MZ, Gedeon T, Geissler J, Nürnberger A (2021) Predicting visual search task success from eye gaze data as a basis for user-adaptive information visualization systems. ACM Trans Interact Intell Syst (TiiS) 11(2):1–25CrossRef

43.

Steichen B, Ashman H, Wade V (2012) A comparative survey of personalised information retrieval and adaptive hypermedia techniques. Inf Process Manag 48(4):698–724CrossRef

44.

Steichen B, Wu MM, Toker D, Conati C, Carenini G (2014a) Te, Te, Hi, Hi: Eye gaze sequence analysis for informing user-adaptive information visualizations. In: User modeling, adaptation, and personalization: 22nd international conference, UMAP 2014, pp 183–194

45.

Steichen B, Conati C, Carenini G (2014) Inferring visualization task properties, user performance, and user cognitive abilities from eye gaze data. ACM Trans Interact Intell Syst (TiiS) 4(2):1–29CrossRef

46.

Steichen B, Fu B (2019) Towards adaptive information visualization-a study of information visualization aids and the role of user cognitive style. Front Artif Intell 2019(2):22CrossRef

47.

Steichen B, Fu B, Nguyen T (2020) Inferring cognitive style from eye gaze behavior during information visualization usage. In: Proceedings of the 28th ACM conference on user modeling, adaptation and personalization, pp 348–352

48.

Steichen B, Kosasih W, Becerra C (2022) Inferring search user language proficiency from eye gaze data. In ACM SIGIR conference on human information interaction and retrieval, pp 211–220

49.

Sternberg RJ, Grigorenko EL (1997) Are cognitive styles still in style? Am Psychol 52(7):700CrossRef

50.

Stranc S, Muldner K (2020) Scanpath analysis of student attention during problem solving with worked examples. In: Artificial intelligence in education: 21st international conference, AIED 2020, Proceedings, Part II 21, pp 306–311

51.

West JM, Haake AR, Rozanski EP, Karn KS (2006) eyePatterns: software for identifying patterns and similarities across fixation sequences. In: Proceedings of the 2006 symposium on eye tracking research and applications, pp 149–154

52.

White RW (2016) Interactions with search systems. Cambridge University PressCrossRef

53.

White RW, Chu W, Hassan A, He X, Song Y, Wang H (2013) Enhancing personalized search by mining and modeling task behavior. In: Proceedings of the 22nd international conference on world wide web, pp 1411–1420

54.

Young LR, Sheena D (1975) Survey of eye movement recording methods. Behav Res Methods Instrum 7(5):397–429CrossRef

55.

Yoshimura K, Kise K, Kunze K (2015) The eye as the window of the language ability: Estimation of English skills by analyzing eye movement while reading documents. In: 2015 13th international conference on document analysis and recognition, pp 251–255

Titel: Computational Methods to Infer Human Factors for Adaptation and Personalization Using Eye Tracking
verfasst von: Ben Steichen
Verlag: Springer Nature Switzerland
Buch: A Human-Centered Perspective of Intelligent Personalized Environments and Systems
Print ISBN: 978-3-031-55108-6

Electronic ISBN: 978-3-031-55109-3

Copyright-Jahr: 2024
DOI: https://doi.org/10.1007/978-3-031-55109-3_7

Springer Professional

Abstract

Bitte loggen Sie sich ein, um Zugang zu Ihrer Lizenz zu erhalten.

Sie haben noch keine Lizenz? Dann Informieren Sie sich jetzt über unsere Produkte:

Springer Professional "Wirtschaft+Technik"

Springer Professional "Technik"

Springer Professional "Wirtschaft"