nach oben

Technology, Knowledge and Learning

03.05.2024 | Original research

The Effects of Competition in Gamified Online Discussions on Learners’ Behavioral and Cognitive Engagement

verfasst von: Taufik Slamet, Thomas Brush, Kyungbin Kwon

Erschienen in: Technology, Knowledge and Learning

Einloggen

Aktivieren Sie unsere intelligente Suche, um passende Fachinhalte oder Patente zu finden.

search-config

KI-gestützte Suche

Aus

Abstract

This study aims to investigate the effects of competition through a digital leaderboard in gamified online discussions on learners’ behavioral and cognitive engagement in learning. Twenty-three graduate students pursuing master’s degree in instructional technology in a public university in Indonesia were involved in a five-week quasi-experiment (N = 23; Group A = 12 & Group B = 11). All discussion activities were performed on a gamification platform designed specifically to facilitate online discussions. Several game elements were used on this platform, including points, badges, quizzes, and leaderboards. The discussion topics encompassed instructional design case studies in varied contexts (K-12, higher education, and industry). In this study, we measured behavioral engagement by tallying the number of posts and earned points from participants. Additionally, cognitive engagement was evaluated by analyzing the cognitive level evident in participants’ posts. A framework entitled the levels of Knowledge construction was used for analyzing the quality of the posts. After a five-week implementation period, our investigation revealed that incorporating competition through leaderboards did not yield significant differences in learners’ behavioral engagement, measured by two metrics: the number of posts (Z = − 0.346, p = .729) and earned points (Z = -1.283, p = .200). Regarding cognitive engagement in online asynchronous discussions, no evidence supported the effectiveness of competition in gamified online discussions across various levels of knowledge construction, including initiation (Z = -1.826, p = .068), development (Z = -1.604, p = .109), and construction (Z = -1.289, p = .197). This study also scrutinized limitations and critical issues, offering essential recommendations to guide future research.

Sie haben noch keine Lizenz? Dann Informieren Sie sich jetzt über unsere Produkte:

Springer Professional "Wirtschaft+Technik"

Online-Abonnement

Mit Springer Professional "Wirtschaft+Technik" erhalten Sie Zugriff auf:

über 102.000 Bücher
über 537 Zeitschriften

aus folgenden Fachgebieten:

Automobil + Motoren
Bauwesen + Immobilien
Business IT + Informatik
Elektrotechnik + Elektronik
Energie + Nachhaltigkeit
Finance + Banking
Management + Führung
Marketing + Vertrieb
Maschinenbau + Werkstoffe
Versicherung + Risiko

Jetzt Wissensvorsprung sichern!

Jetzt informieren

Springer Professional "Technik"

Online-Abonnement

Mit Springer Professional "Technik" erhalten Sie Zugriff auf:

über 67.000 Bücher
über 390 Zeitschriften

aus folgenden Fachgebieten:

Automobil + Motoren
Bauwesen + Immobilien
Business IT + Informatik
Elektrotechnik + Elektronik
Energie + Nachhaltigkeit
Maschinenbau + Werkstoffe

Jetzt Wissensvorsprung sichern!

Jetzt informieren

Althaus, S. L. (1997). Computer-mediated communication in the university classroom: An experiment with on‐line discussions. Communication Education, 46(3). https://doi.org/10.1080/03634529709379088. Article 3.

Appleton, J. J., Christenson, S. L., & Furlong, M. J. (2008). Student engagement with school: Critical conceptual and methodological issues of the construct. Psychology in the Schools, 45(5). https://doi.org/10.1002/pits.20303.

Bangert, A. W. (2004). The Seven principles of Good Practice: A framework for evaluating on-line teaching. The Internet and Higher Education, 7(3). https://doi.org/10.1016/j.iheduc.2004.06.003.

Barata, G., Gama, S., Jorge, J., & Gonçalves, D. (2015). Gamification for smarter learning: Tales from the trenches. Smart Learning Environments, 2(1). https://doi.org/10.1186/s40561-015-0017-8.

Beatman, T., & Duff, R. (2019). Games in Learning: Shedding light on a problematic taxonomy. EAI Endorsed Transactions on Game-Based Learning, 5(17), 156151. https://doi.org/10.4108/eai.13-9-2018.156151.CrossRef

Birch, S. H., & Ladd, G. W. (1997). The teacher-child relationship and children’s early school adjustment. Journal of School Psychology, 35(1). https://doi.org/10.1016/S0022-4405(96)00029-5.

Bond, M., Buntins, K., Bedenlier, S., Zawacki-Richter, O., & Kerres, M. (2020). Mapping research in student engagement and educational technology in higher education: A systematic evidence map. International Journal of Educational Technology in Higher Education, 17(1). https://doi.org/10.1186/s41239-019-0176-8.

Bouchrika, I., Harrati, N., Wanick, V., & Wills, G. (2021). Exploring the impact of gamification on student engagement and involvement with e-learning systems. Interactive Learning Environments, 29(8). https://doi.org/10.1080/10494820.2019.1623267. Article 8.

Bovee, B. S., Jernejcic, T., & El-Gayar, O. (2020). A GAMIFICATION TECHNIQUE TO INCREASE ENGAGEMENT IN ASYNCHRONOUS ONLINE DISCUSSIONS. Issues in Information Systems, 21(3). https://iacis.org/iis/2020/3_iis_2020_20-30.pdf.

Buck, B., Carr, S. R., & Robertson, J. (2008). Positive Psychology and Student Engagement (1). 1(1), Article 1.

Buhs, E., & Ladd, G. (2001). Peer rejection as antecedent of young children’s school adjustment: An examination of mediating processes. Developmental Psychology, 37, 550–560. https://doi.org/10.1037//0012-1649.37.4.550.CrossRef

Buunk, A. P., & Gibbons, F. X. (2007). Social comparison: The end of a theory and the emergence of a field. Organizational Behavior and Human Decision Processes, 102(1). https://doi.org/10.1016/j.obhdp.2006.09.007.

Camilleri, V., Busuttil, L., & Montebello, M. (2011). Social Interactive Learning in Multiplayer Games. In M. Ma, A. Oikonomou, & L. C. Jain (Eds.), Serious Games and Edutainment Applications (pp. 481–501). Springer. https://doi.org/10.1007/978-1-4471-2161-9_23.

Charness, G., Gneezy, U., & Kuhn, M. A. (2012). Experimental methods: Between-subject and within-subject design. Journal of Economic Behavior & Organization, 81(1), 1–8.CrossRef

Chen, C., & Chen, P. (2023). A gamified instant perspective comparison system to facilitate online discussion effectiveness. British Journal of Educational Technology, 54(3), 790–811. https://doi.org/10.1111/bjet.13295.CrossRef

Cheung, W. S., & Hew, K. F. (2004). Evaluating the extent of ill-structured problem solving process among pre-service teachers in an asynchronous online discussion and reflection log learning environment. Journal of Educational Computing Research, 30(3), Article3.CrossRef

Christy, K. R., & Fox, J. (2014). Leaderboards in a virtual classroom: A test of stereotype threat and social comparison explanations for women’s math performance. Computers & Education, 78, 66–77. https://doi.org/10.1016/j.compedu.2014.05.005.CrossRef

da Seixas, R., Gomes, L., A. S., & de Filho, M., I. J (2016). Effectiveness of gamification in the engagement of students. Computers in Human Behavior, 58, 48–63. https://doi.org/10.1016/j.chb.2015.11.021.CrossRef

de-Marcos, L., Garcia-Lopez, E., & Garcia-Cabot, A. (2016). On the effectiveness of game-like and social approaches in learning: Comparing educational gaming, gamification & social networking. Computers & Education, 95, 99–113. https://doi.org/10.1016/j.compedu.2015.12.008.CrossRef

Deterding, S., Sicart, M., Nacke, L., O’Hara, K., & Dixon, D. (2011). Gamification. Using game-design elements in non-gaming contexts. In CHI’11 extended abstracts on human factors in computing systems (pp. 2425–2428).

Dicheva, D., Dichev, C., Agre, G., & Angelova, G. (2015). Gamification in education: A systematic mapping study. Journal of Educational Technology & Society, 18(3), Article 3.

Ding, L. (2019a). Applying gamifications to asynchronous online discussions: A mixed methods study. Computers in Human Behavior, 91, 1–11.CrossRef

Ding, L. (2019b). Applying gamifications to asynchronous online discussions: A mixed methods study. Computers in Human Behavior, 91, 1–11.CrossRef

Ding, L., Kim, C., & Orey, M. (2017). Studies of student engagement in gamified online discussions. Computers & Education, 115, 126–142.CrossRef

Ding, L., Er, E., & Orey, M. (2018). An exploratory study of student engagement in gamified online discussions. Computers & Education, 120, 213–226. https://doi.org/10.1016/j.compedu.2018.02.007.CrossRef

Dunlap, J. C. (2005). Workload reduction in online courses: Getting some shuteye. Performance Improvement, 44(5), Article 5.

Eickhoff, C., & Harris, C. G. (n.d.). Quality through flow and immersion: Gamifying crowdsourced relevance assessments. 10.

Ertmer, P. A., Richardson, J. C., Belland, B., Camin, D., Connolly, P., Coulthard, G., Lei, K., & Mong, C. (2007). Using peer feedback to enhance the quality of Student Online postings: An exploratory study. Journal of Computer-Mediated Communication, 12(2). https://doi.org/10.1111/j.1083-6101.2007.00331.x.

Ertmer, P. A., Quinn, J. A., & Glazewski, K. D. (2019). The ID casebook: Case studies in instructional design. Routledge.

Farzan, R., Dimicco, J. M., Millen, D. R., Brownholtz, B., & Geyer, W. (n.d.). Deploying.

Festinger, L. (1954). A theory of social comparison processes. Human Relations, 7(2). https://doi.org/10.1177/001872675400700202.

Fredricks, J. A., Blumenfeld, P. C., & Paris, A. H. (2004). School Engagement: Potential of the Concept, State of the evidence. Review of Educational Research, 74(1). https://doi.org/10.3102/00346543074001059.

Fülöp, M. (2009). Happy and Unhappy Competitors: What Makes the Difference. 24.

Garrett, C. E. (2020). Three Key Principles for Improving Discussion-Based Learning in College Classrooms. https://doi.org/10.15142/VNKZ-P273.

Goggins, S., & Xing, W. (2016). Building models explaining student participation behavior in asynchronous online discussion. Computers & Education, 94, 241–251.CrossRef

Greenwood, C. R., Horton, B. T., & Utley, C. A. (2002). Academic Engagement: Current perspectives on Research and Practice. School Psychology Review, 31(3). https://doi.org/10.1080/02796015.2002.12086159.

Hamari, J. (2019). Gamification. The Blackwell Encyclopedia of Sociology (pp. 1–3). John Wiley & Sons, Ltd. https://doi.org/10.1002/9781405165518.wbeos1321.

Hamari, J., Koivisto, J., & Sarsa, H. (2014). Does Gamification Work? – A Literature Review of Empirical Studies on Gamification. 2014 47th Hawaii International Conference on System Sciences, 3025–3034. https://doi.org/10.1109/HICSS.2014.377.

Hamari, J., Shernoff, D. J., Rowe, E., Coller, B., Asbell-Clarke, J., & Edwards, T. (2016). Challenging games help students learn: An empirical study on engagement, flow and immersion in game-based learning. Computers in Human Behavior, 54, 170–179. https://doi.org/10.1016/j.chb.2015.07.045.CrossRef

Hanus, M. D., & Fox, J. (2015a). Assessing the effects of gamification in the classroom: A longitudinal study on intrinsic motivation, social comparison, satisfaction, effort, and academic performance. Computers & Education, 80, 152–161. https://doi.org/10.1016/j.compedu.2014.08.019.CrossRef

Hanus, M. D., & Fox, J. (2015b). Assessing the effects of gamification in the classroom: A longitudinal study on intrinsic motivation, social comparison, satisfaction, effort, and academic performance. Computers & Education, 80, 152–161. https://doi.org/10.1016/j.compedu.2014.08.019.CrossRef

Herman, J. H., & Nilson, L. B. (2018). Creating engaging discussions: Strategies for avoiding crickets in any size classroom and online. Stylus Publishing.

Hew, K. F., Cheung, W. S., & Ng, C. S. L. (2010a). Student contribution in asynchronous online discussion: A review of the research and empirical exploration. Instructional Science, 38(6). https://doi.org/10.1007/s11251-008-9087-0. Article 6.

Hew, K. F., Cheung, W. S., & Ng, C. S. L. (2010b). Student contribution in asynchronous online discussion: A review of the research and empirical exploration. Instructional Science, 38(6), Article 6.

Hew, K. F., Cheung, W. S., & Ng, C. S. L. (2010c). Student contribution in asynchronous online discussion: A review of the research and empirical exploration. Instructional Science, 38(6), 571–606.CrossRef

Hewitt, J. (2005). Toward an understanding of how threads die in asynchronous computer conferences. The Journal of the Learning Sciences, 14(4), Article4.CrossRef

Hmelo-Silver, C. E. (2003). Analyzing collaborative knowledge construction: Multiple methods for integrated understanding. Computers & Education, 41(4). https://doi.org/10.1016/j.compedu.2003.07.001.

Hmelo-Silver, C. E., & Barrows, H. S. (2006). Goals and strategies of a problem-based learning facilitator. Interdisciplinary Journal of Problem-Based Learning, 1(1), Article 1.

Ho, J. C. S., Hung, Y. S., & Kwan, L. Y. Y. (2022). The impact of peer competition and collaboration on gamified learning performance in educational settings: A Meta-analytical study. Education and Information Technologies, 27(3), 3833–3866. https://doi.org/10.1007/s10639-021-10770-2.CrossRef

Hu, P. J. H., & Hui, W. (2012). Examining the role of learning engagement in technology-mediated learning and its effects on learning effectiveness and satisfaction. Decision Support Systems, 53(4). https://doi.org/10.1016/j.dss.2012.05.014.

Huang, B., & Hew, K. F. (2018). Implementing a theory-driven gamification model in higher education flipped courses: Effects on out-of-class activity completion and quality of artifacts. Computers & Education, 125, 254–272. https://doi.org/10.1016/j.compedu.2018.06.018.CrossRef

Huang, B., & Hew, K. F. (2021). Using gamification to Design courses: Lessons learned in a three-year design-based study. Educational Technology & Society, 24(1), 44–63.

Huang, B., Hew, K. F., & Lo, C. K. (2019). Investigating the effects of gamification-enhanced flipped learning on undergraduate students’ behavioral and cognitive engagement. Interactive Learning Environments, 27(8), 1106–1126. https://doi.org/10.1080/10494820.2018.1495653.CrossRef

Huang, B., Hwang, G. J., Hew, K. F., & Warning, P. (2019b). Effects of gamification on students’ online interactive patterns and peer-feedback. Distance Education, 40(3), Article 3.

Ibanez, M. B., Di-Serio, A., & Delgado-Kloos, C. (2014). Gamification for engaging computer science students in learning activities: A case study. IEEE Transactions on Learning Technologies, 7(3), Article 3.

Jahn, K., Kordyaka, B., Machulska, A., Eiler, T. J., Gruenewald, A., Klucken, T., Brueck, R., Gethmann, C. F., & Niehaves, B. (2021). Individualized gamification elements: The impact of avatar and feedback design on reuse intention. Computers in Human Behavior, 119, 106702. https://doi.org/10.1016/j.chb.2021.106702.CrossRef

Johns, J. D., Hayes, A., Grant, L., & Caldwell, D. (2018). Classroom Gamification: Merging Game Design Theory and Behavior Analysis for Increased Engagement. In P. Zaphiris & A. Ioannou (Eds.), Learning and Collaboration Technologies. Learning and Teaching (pp. 150–163). Springer International Publishing. https://doi.org/10.1007/978-3-319-91152-6_12.

Kapp, K. M. (2012). The gamification of learning and instruction: Game-based methods and strategies for training and education. Wiley.

Knutas, A., Ikonen, J., Nikula, U., & Porras, J. (2014). Increasing collaborative communications in a programming course with gamification: A case study. Proceedings of the 15th International Conference on Computer Systems and Technologies, 370–377.

Koivisto, J., & Hamari, J. (2019). The rise of motivational information systems: A review of gamification research. International Journal of Information Management, 45, 191–210. https://doi.org/10.1016/j.ijinfomgt.2018.10.013.CrossRef

Kwon, K., Park, S. J., Shin, S., & Chang, C. Y. (2019). Effects of different types of instructor comments in online discussions. Distance Education, 40(2), 226–242.CrossRef

Landers, R. N., Bauer, K. N., Callan, R. C., & Armstrong, M. B. (2015). Psychological theory and the gamification of learning. Gamification in Education and Business, 165–186.

Landers, R. N., Bauer, K. N., & Callan, R. C. (2017). Gamification of task performance with leaderboards: A goal setting experiment. Computers in Human Behavior, 71, 508–515. https://doi.org/10.1016/j.chb.2015.08.008.CrossRef

Lester, D. (n.d.). A Review of the Student Engagement Literature. 8.

Li, Y., & Lerner, R. M. (2013). Interrelations of behavioral, emotional, and Cognitive School Engagement in High School Students. Journal of Youth and Adolescence, 42(1). https://doi.org/10.1007/s10964-012-9857-5.

Li, W., Grossman, T., & Fitzmaurice, G. (2012). GamiCAD: A gamified tutorial system for first time autocad users. Proceedings of the 25th Annual ACM Symposium on User Interface Software and Technology, 103–112.

Ma, M., Oikonomou, A., Jain, L., Landers, R., & Callan, R. (2011a). Casual Social Games as Serious Games: The Psychology of Gamification in Undergraduate Education and Employee Training. In Serious Games and Edutainment Applications (pp. 399–423). https://doi.org/10.1007/978-1-4471-2161-9_20.

Ma, M., Oikonomou, A., Jain, L., Landers, R., & Callan, R. (2011b). Casual Social Games as Serious Games: The Psychology of Gamification in Undergraduate Education and Employee Training. In Serious Games and Edutainment Applications (pp. 399–423). https://doi.org/10.1007/978-1-4471-2161-9_20.

MacKnight, C. B. (2000). Teaching critical thinking through online discussions. Educause Quarterly, 23(4), Article 4.

Marangunić, N., & Granić, A. (2015). Technology acceptance model: A literature review from 1986 to 2013. Universal Access in the Information Society, 14(1), 81–95. https://doi.org/10.1007/s10209-014-0348-1.CrossRef

McKenney, S., & Reeves, T. C. (2018). Conducting educational design research. Routledge.

Mese, C., & Dursun, O. O. (2019). Effectiveness of gamification elements in blended learning environments. Turkish Online Journal of Distance Education, 119–142. https://doi.org/10.17718/tojde.601914.

Morschheuser, B., Hamari, J., & Maedche, A. (2019). Cooperation or competition – when do people contribute more? A field experiment on gamification of crowdsourcing. International Journal of Human-Computer Studies, 127, 7–24. https://doi.org/10.1016/j.ijhcs.2018.10.001.CrossRef

Ouyang, F., & Chang, Y. H. (2019). The relationships between social participatory roles and cognitive engagement levels in online discussions. British Journal of Educational Technology, 50(3), 1396–1414. https://doi.org/10.1111/bjet.12647.CrossRef

Pilkington, R. (2004). Developing discussion for learning

Pilotti, M., Anderson, S., Hardy, P., Murphy, P., & Vincent, P. (2017). Factors related to cognitive, emotional, and behavioral Engagement in the online Asynchronous Classroom. International Journal of Teaching and Learning in Higher Education, 29(1), Article1.

Puritat, K. (2019). Enhanced Knowledge and Engagement of Students through the Gamification Concept of Game Elements. International Journal of Engineering Pedagogy, 9(5). https://search.ebscohost.com/login.aspx?direct=true&profile=ehost&scope=site&authtype=crawler&jrnl=21924880&AN=139880246&h=8thhh8tvI8yt%2BZYA%2Fl99TffQnCTOW3BxwE44VpmgKUTik3zCeN3n45H7Ywbgs7h4YtvRXjzhJtTM9ejitDqqOQ%3D%3D&crl=c

Rabe-Hemp, C., Woollen, S., & Humiston, G. S. (2009). A comparative analysis of student engagement, learning, and satisfaction in lecture hall and online learning settings. Quarterly Review of Distance Education, 10(2), Article2.

Reyssier, S., Hallifax, S., Serna, A., Marty, J. C., Simonian, S., & Lavoué, E. (2022). The impact of game elements on learner motivation: Influence of initial motivation and player profile. IEEE Transactions on Learning Technologies, 15(1), 42–54.CrossRef

Roosta, F., Taghiyareh, F., & Mosharraf, M. (2016). Personalization of gamification-elements in an e-learning environment based on learners’ motivation. 2016 8th International Symposium on Telecommunications (IST), 637–642. https://doi.org/10.1109/ISTEL.2016.7881899.

Rovai, A. P. (2007). Facilitating online discussions effectively. The Internet and Higher Education, 10(1), Article1.CrossRef

Ruan, X., & Wu, X. (2013). The Skinner automaton: A psychological model formalizing the theory of operant conditioning. Science China Technological Sciences, 56(11), 2745–2761. https://doi.org/10.1007/s11431-013-5369-0.CrossRef

Sanmugam, M., Zaid, N. M., Abdullah, Z., Aris, B., Mohamed, H., & van der Meijden, H. (2016). The impacts of infusing game elements and gamification in learning. 2016 IEEE 8th International Conference on Engineering Education (ICEED), 131–136. https://ieeexplore.ieee.org/abstract/document/7856058/.

Sarkies, M. N., Skinner, E. H., Bowles, K. A., Morris, M. E., Williams, C., O’Brien, L., Bardoel, A., Martin, J., Holland, A. E., Carey, L., White, J., & Haines, T. P. (2019). A novel counterbalanced implementation study design: Methodological description and application to implementation research. Implementation Science, 14(1), 45. https://doi.org/10.1186/s13012-019-0896-0.CrossRef

Strickhouser, J. E., & Zell, E. (2015). Self-evaluative effects of dimensional and social comparison. Journal of Experimental Social Psychology, 59, 60–66. https://doi.org/10.1016/j.jesp.2015.03.001.CrossRef

Subhash, S., & Cudney, E. A. (2018). Gamified learning in higher education: A systematic review of the literature. Computers in Human Behavior, 87, 192–206. https://doi.org/10.1016/j.chb.2018.05.028.CrossRef

Tripathi, K. N. (1992). Competition and intrinsic motivation. The Journal of Social Psychology, 132(6). https://doi.org/10.1080/00224545.1992.9712101.

Uz Bilgin, C., & Gul, A. (2020). Investigating the effectiveness of gamification on group cohesion, attitude, and academic achievement in collaborative learning environments. TechTrends, 64(1), Article 1.

Wu, D., & Hiltz, S. R. (2004). Predicting learning from asynchronous online discussions. Journal of Asynchronous Learning Networks, 8(2), Article 2.

Xie, K., & Ke, F. (2011). The role of students’ motivation in peer-moderated asynchronous online discussions: Motivation in peer-moderated discussions. British Journal of Educational Technology, 42(6). https://doi.org/10.1111/j.1467-8535.2010.01140.x. Article 6.

Xie, K. U. I., Debacker, T. K., & Ferguson, C. (2006). Extending the traditional classroom through online discussion: The role of student motivation. Journal of Educational Computing Research, 34(1), Article1.CrossRef

Zainuddin, Z., Shujahat, M., Haruna, H., & Chu, S. K. W. (2020). The role of gamified e-quizzes on student learning and engagement: An interactive gamification solution for a formative assessment system. Computers & Education, 145, 103729. https://doi.org/10.1016/j.compedu.2019.103729.CrossRef

Zhu, E. (2006). Interaction and cognitive engagement: An analysis of four asynchronous online discussions. Instructional Science, 34(6). https://doi.org/10.1007/s11251-006-0004-0.

Zichermann, G., & Cunningham, C. (2011). Gamification by design: Implementing game mechanics in web and mobile apps. O’Reilly Media, Inc.

Titel: The Effects of Competition in Gamified Online Discussions on Learners’ Behavioral and Cognitive Engagement
verfasst von: Taufik Slamet
Thomas Brush
Kyungbin Kwon
Publikationsdatum: 03.05.2024
Verlag: Springer Netherlands
Erschienen in: Technology, Knowledge and Learning
Print ISSN: 2211-1662
Elektronische ISSN: 2211-1670
DOI: https://doi.org/10.1007/s10758-024-09740-7

Premium Partner

Marktübersichten

Die im Laufe eines Jahres in der „adhäsion“ veröffentlichten Marktübersichten helfen Anwendern verschiedenster Branchen, sich einen gezielten Überblick über Lieferantenangebote zu verschaffen.

Zur Marktübersicht