Skip to main content
Erschienen in: Journal of Computing in Higher Education 1/2024

24.01.2023

Wild brooms and learning analytics

verfasst von: Benjamin A. Motz, Anastasia S. Morrone

Erschienen in: Journal of Computing in Higher Education | Ausgabe 1/2024

Einloggen

Aktivieren Sie unsere intelligente Suche, um passende Fachinhalte oder Patente zu finden.

search-config
loading …

Abstract

In this commentary we present an analogy between Johann Wolfgang Von Goethe’s classic poem, The Sorcerer’s Apprentice, and institutional learning analytics. In doing so, we hope to provoke institutions with a simple heuristic when considering their learning analytics initiatives. They might ask themselves, “Are we behaving like the sorcerer’s apprentice?” This would be characterized by initiatives lacking faculty involvement, and we argue that when initiatives fit this pattern, they also lack consideration of their potential hazards, and are likely to fail. We join others in advocating for institutions to, instead, create ecosystems that enable faculty leadership in institutional learning analytics efforts.

Sie haben noch keine Lizenz? Dann Informieren Sie sich jetzt über unsere Produkte:

Springer Professional "Wirtschaft+Technik"

Online-Abonnement

Mit Springer Professional "Wirtschaft+Technik" erhalten Sie Zugriff auf:

  • über 102.000 Bücher
  • über 537 Zeitschriften

aus folgenden Fachgebieten:

  • Automobil + Motoren
  • Bauwesen + Immobilien
  • Business IT + Informatik
  • Elektrotechnik + Elektronik
  • Energie + Nachhaltigkeit
  • Finance + Banking
  • Management + Führung
  • Marketing + Vertrieb
  • Maschinenbau + Werkstoffe
  • Versicherung + Risiko

Jetzt Wissensvorsprung sichern!

Springer Professional "Technik"

Online-Abonnement

Mit Springer Professional "Technik" erhalten Sie Zugriff auf:

  • über 67.000 Bücher
  • über 390 Zeitschriften

aus folgenden Fachgebieten:

  • Automobil + Motoren
  • Bauwesen + Immobilien
  • Business IT + Informatik
  • Elektrotechnik + Elektronik
  • Energie + Nachhaltigkeit
  • Maschinenbau + Werkstoffe




 

Jetzt Wissensvorsprung sichern!

Springer Professional "Wirtschaft"

Online-Abonnement

Mit Springer Professional "Wirtschaft" erhalten Sie Zugriff auf:

  • über 67.000 Bücher
  • über 340 Zeitschriften

aus folgenden Fachgebieten:

  • Bauwesen + Immobilien
  • Business IT + Informatik
  • Finance + Banking
  • Management + Führung
  • Marketing + Vertrieb
  • Versicherung + Risiko




Jetzt Wissensvorsprung sichern!

Literatur
Zurück zum Zitat Arnold, K. E., & Pistilli, M. D. (2012, April). Course signals at Purdue: Using learning analytics to increase student success. In Proceedings of the 2nd International Conference on Learning Analytics and Knowledge (pp. 267–270). https://doi.org/10.1145/2330601.2330666 Arnold, K. E., & Pistilli, M. D. (2012, April). Course signals at Purdue: Using learning analytics to increase student success. In Proceedings of the 2nd International Conference on Learning Analytics and Knowledge (pp. 267–270). https://​doi.​org/​10.​1145/​2330601.​2330666
Zurück zum Zitat Borden, V. M. (2018). The need for and value of scholarship in institutional research. Building Capacity in Institutional Research and decision support in Higher Education (pp. 53–66). Cham: Springer.CrossRef Borden, V. M. (2018). The need for and value of scholarship in institutional research. Building Capacity in Institutional Research and decision support in Higher Education (pp. 53–66). Cham: Springer.CrossRef
Zurück zum Zitat Clow, D., Ferguson, R., Kitto, K., Cho, Y. S., Sharkey, M., & Aguerrebere, C. (2017). Beyond failure: the 2nd LAK Failathon. In Proceedings of the 7th International Conference on Learning Analytics and Knowledge (pp. 504–505). https://doi.org/10.1145/3027385.3029429 Clow, D., Ferguson, R., Kitto, K., Cho, Y. S., Sharkey, M., & Aguerrebere, C. (2017). Beyond failure: the 2nd LAK Failathon. In Proceedings of the 7th International Conference on Learning Analytics and Knowledge (pp. 504–505). https://​doi.​org/​10.​1145/​3027385.​3029429
Zurück zum Zitat Dawson, S., Poquet, O., Colvin, C., Rogers, T., Pardo, A., & Gasevic, D. (2018). Rethinking learning analytics adoption through complexity leadership theory. In Proceedings of the 8th International Conference on Learning Analytics and Knowledge (pp. 236–244). https://doi.org/10.1145/3170358.3170375 Dawson, S., Poquet, O., Colvin, C., Rogers, T., Pardo, A., & Gasevic, D. (2018). Rethinking learning analytics adoption through complexity leadership theory. In Proceedings of the 8th International Conference on Learning Analytics and Knowledge (pp. 236–244). https://​doi.​org/​10.​1145/​3170358.​3170375
Zurück zum Zitat Fyfe, E., de Leeuw, J., Carvalho, P., Goldstone, R., Sherman, J., & Motz, B. (2021). ManyClasses 1: assessing the generalizable effect of immediate feedback versus delayed feedback across many college classes. Advances in Methods and Practices in Psychological Science, 4(3), 1–24. https://doi.org/10.1177/25152459211027575[42 others].CrossRef Fyfe, E., de Leeuw, J., Carvalho, P., Goldstone, R., Sherman, J., & Motz, B. (2021). ManyClasses 1: assessing the generalizable effect of immediate feedback versus delayed feedback across many college classes. Advances in Methods and Practices in Psychological Science, 4(3), 1–24. https://​doi.​org/​10.​1177/​2515245921102757​5[42 others].CrossRef
Zurück zum Zitat Goldstein, P., & Katz, R. (2005). Academic analytics: the uses of Management Information and Technology in Higher Education. Louisville, CO, USA: EDUCAUSE Center for Applied Research. Goldstein, P., & Katz, R. (2005). Academic analytics: the uses of Management Information and Technology in Higher Education. Louisville, CO, USA: EDUCAUSE Center for Applied Research.
Zurück zum Zitat Jaggars, S., Motz, B., Rivera, M., Heckler, A., Quick, J., Hance, E., & Karwisch, C. (2021). Digital divides at the University: Lessons learned from the COVID-19 emergency transition. Aaron Horn. Minneapolis, MN: Ed., Midwest Higher Education Compact (MHEC). Jaggars, S., Motz, B., Rivera, M., Heckler, A., Quick, J., Hance, E., & Karwisch, C. (2021). Digital divides at the University: Lessons learned from the COVID-19 emergency transition. Aaron Horn. Minneapolis, MN: Ed., Midwest Higher Education Compact (MHEC).
Zurück zum Zitat Jivet, I., Scheffel, M., Specht, M., & Drachsler, H. (2018). License to evaluate: Preparing learning analytics dashboards for educational practice. In Proceedings of the 8th international conference on learning analytics and knowledge (pp. 31–40). https://doi.org/10.1145/3170358.3170421 Jivet, I., Scheffel, M., Specht, M., & Drachsler, H. (2018). License to evaluate: Preparing learning analytics dashboards for educational practice. In Proceedings of the 8th international conference on learning analytics and knowledge (pp. 31–40). https://​doi.​org/​10.​1145/​3170358.​3170421
Zurück zum Zitat Kia, F., Teasley, S., Hatala, M., Karabenick, S., & Kay, M. (2020). How patterns of students dashboard use arerelated to their achievement and self-regulatory engagement.InProceedings of the 10th International Conferenceon Learning Analytics and Knowledge(pp. 340-349). https://doi.org/10.1145/3375462.3375472 Kia, F., Teasley, S., Hatala, M., Karabenick, S., & Kay, M. (2020). How patterns of students dashboard use arerelated to their achievement and self-regulatory engagement.InProceedings of the 10th International Conferenceon Learning Analytics and Knowledge(pp. 340-349). https://​doi.​org/​10.​1145/​3375462.​3375472
Zurück zum Zitat Macfadyen, L. (2022). Institutional implementation of learning analytics: current state, Challenges, and guiding frameworks. In C. Lang, A. Wise, A. Merceron, D. Gasevic, & G. Siemens (Eds.), The handbook of learning analytics (2nd ed.). Vancouver, Canada: Society for Learning Analytics Research. Macfadyen, L. (2022). Institutional implementation of learning analytics: current state, Challenges, and guiding frameworks. In C. Lang, A. Wise, A. Merceron, D. Gasevic, & G. Siemens (Eds.), The handbook of learning analytics (2nd ed.). Vancouver, Canada: Society for Learning Analytics Research.
Zurück zum Zitat Macfadyen, L., Dawson, S., Pardo, A., & Gasevic, D. (2014). Embracing big data in complex educational systems: the learning analytics imperative and the policy challenge. Research & Practice in Assessment, 9, 17–28. https://eric.ed.gov/?id=EJ1062692. Macfadyen, L., Dawson, S., Pardo, A., & Gasevic, D. (2014). Embracing big data in complex educational systems: the learning analytics imperative and the policy challenge. Research & Practice in Assessment, 9, 17–28. https://​eric.​ed.​gov/​?​id=​EJ1062692.
Zurück zum Zitat Michos, K., Lang, C., Hernández-Leo, D., & Price-Dennis, D. (2020). Involving teachers in learning analytics design: Lessons learned from two case studies. In Proceedings of the 10th International Conference on Learning Analytics & Knowledge (pp. 94–99). https://doi.org/10.1145/3375462.3375507 Michos, K., Lang, C., Hernández-Leo, D., & Price-Dennis, D. (2020). Involving teachers in learning analytics design: Lessons learned from two case studies. In Proceedings of the 10th International Conference on Learning Analytics & Knowledge (pp. 94–99). https://​doi.​org/​10.​1145/​3375462.​3375507
Zurück zum Zitat Motz, B. (August 23, 2019). Principles for the responsible design of automated student support. EDUCAUSE Review, Transforming Higher Ed Blog. Motz, B. (August 23, 2019). Principles for the responsible design of automated student support. EDUCAUSE Review, Transforming Higher Ed Blog.
Zurück zum Zitat Motz, B., Bergner, Y., Brooks, C., Gladden, A., Gray, G., Lang, C., Li, W., Marmolejo-Ramos, F., & Quick, J. (preprint). A LAK of direction: Misalignment between the goals of learning analytics and its research scholarship. Journal of Learning Analytics. https://doi.org/10.35542/osf.io/bzahw Motz, B., Bergner, Y., Brooks, C., Gladden, A., Gray, G., Lang, C., Li, W., Marmolejo-Ramos, F., & Quick, J. (preprint). A LAK of direction: Misalignment between the goals of learning analytics and its research scholarship. Journal of Learning Analytics. https://​doi.​org/​10.​35542/​osf.​io/​bzahw
Zurück zum Zitat Muenks, K., Canning, E., LaCosse, J., Green, D., Zirkel, S., Garcia, J., & Murphy, M. (2020). Does my professor think my ability can change? Students’ perceptions of their STEM professors’ mindset beliefs predict their psychological vulnerability, engagement, and performance in class. Journal of Experimental Psychology: General, 149(11), 2119–2144. https://doi.org/10.1037/xge0000763.CrossRef Muenks, K., Canning, E., LaCosse, J., Green, D., Zirkel, S., Garcia, J., & Murphy, M. (2020). Does my professor think my ability can change? Students’ perceptions of their STEM professors’ mindset beliefs predict their psychological vulnerability, engagement, and performance in class. Journal of Experimental Psychology: General, 149(11), 2119–2144. https://​doi.​org/​10.​1037/​xge0000763.CrossRef
Zurück zum Zitat O’Neil, C. (2016). Weapons of math destruction: how big data increases inequality and threatens democracy. New York: Broadway Books. O’Neil, C. (2016). Weapons of math destruction: how big data increases inequality and threatens democracy. New York: Broadway Books.
Zurück zum Zitat Pomerantz, J., & Brooks, D. C. (2017). ECAR Study of Faculty and Information Technology, 2017. Louisville, CO: EDUCAUSE Center for Analysis and Research (ECAR). Pomerantz, J., & Brooks, D. C. (2017). ECAR Study of Faculty and Information Technology, 2017. Louisville, CO: EDUCAUSE Center for Analysis and Research (ECAR).
Zurück zum Zitat Reinhart, A., Haring, S., Levin, J., Patall, E., & Robinson, D. (2013). Models of not-so-good behavior: yet another way to squeeze causality and recommendations for practice out of correlational data. Journal of Educational Psychology, 105(1), 241–247. https://doi.org/10.1037/a0030368.CrossRef Reinhart, A., Haring, S., Levin, J., Patall, E., & Robinson, D. (2013). Models of not-so-good behavior: yet another way to squeeze causality and recommendations for practice out of correlational data. Journal of Educational Psychology, 105(1), 241–247. https://​doi.​org/​10.​1037/​a0030368.CrossRef
Zurück zum Zitat Riazy, S., Simbeck, K., & Schreck, V. (2020). Fairness in Learning Analytics: Student at-risk prediction in virtual learning environments. In Proceedings of the 12th International Conference on Computer Supported Education (pp. 15–25). https://doi.org/10.5220/0009324100150025 Riazy, S., Simbeck, K., & Schreck, V. (2020). Fairness in Learning Analytics: Student at-risk prediction in virtual learning environments. In Proceedings of the 12th International Conference on Computer Supported Education (pp. 15–25). https://​doi.​org/​10.​5220/​0009324100150025​
Zurück zum Zitat Tsai, Y., Singh, S., Rakovic, M., Lim, L., Roychoudhury, A., & Gasevic, D. (2022). Charting Design Needs and Strategic Approaches for Academic Analytics Systems through Co-Design. In Proceedings of the 12th International Conference on Learning Analytics and Knowledge (pp. 381–391). https://doi.org/10.1145/3506860.3506939 Tsai, Y., Singh, S., Rakovic, M., Lim, L., Roychoudhury, A., & Gasevic, D. (2022). Charting Design Needs and Strategic Approaches for Academic Analytics Systems through Co-Design. In Proceedings of the 12th International Conference on Learning Analytics and Knowledge (pp. 381–391). https://​doi.​org/​10.​1145/​3506860.​3506939
Zurück zum Zitat Wheeler, B., & Hilton, J. (2012). The marketecture of community. EDUCAUSE Review, 47(6), 66–82. Wheeler, B., & Hilton, J. (2012). The marketecture of community. EDUCAUSE Review, 47(6), 66–82.
Zurück zum Zitat Willis, J. E., Slade, S., & Prinsloo, P. (2016). Ethical oversight of student data in learning analytics: a typology derived from a cross-continental, cross-institutional perspective. Educational Technology Research and Development, 64(5), 881–901.CrossRef Willis, J. E., Slade, S., & Prinsloo, P. (2016). Ethical oversight of student data in learning analytics: a typology derived from a cross-continental, cross-institutional perspective. Educational Technology Research and Development, 64(5), 881–901.CrossRef
Zurück zum Zitat Yanosky, R., & Arroway, P. (2015). The Analytics Landscape in Higher Education, 2015. Louisville, CO, USA: EDUCAUSE Center for Applied Research. Yanosky, R., & Arroway, P. (2015). The Analytics Landscape in Higher Education, 2015. Louisville, CO, USA: EDUCAUSE Center for Applied Research.
Zurück zum Zitat Yu, R., Li, Q., Fischer, C., Doroudi, S., & Xu, D. (2020). Towards Accurate and Fair Prediction of College Success: Evaluating Different Sources of Student Data. Proceedings of the 13th International Conference on Educational Data Mining (pp. 292–301). https://eric.ed.gov/?id=ED608066 Yu, R., Li, Q., Fischer, C., Doroudi, S., & Xu, D. (2020). Towards Accurate and Fair Prediction of College Success: Evaluating Different Sources of Student Data. Proceedings of the 13th International Conference on Educational Data Mining (pp. 292–301). https://​eric.​ed.​gov/​?​id=​ED608066
Metadaten
Titel
Wild brooms and learning analytics
verfasst von
Benjamin A. Motz
Anastasia S. Morrone
Publikationsdatum
24.01.2023
Verlag
Springer US
Erschienen in
Journal of Computing in Higher Education / Ausgabe 1/2024
Print ISSN: 1042-1726
Elektronische ISSN: 1867-1233
DOI
https://doi.org/10.1007/s12528-023-09353-6

Weitere Artikel der Ausgabe 1/2024

Journal of Computing in Higher Education 1/2024 Zur Ausgabe

Premium Partner