Game learning analytics of instant messaging and online discussion forums in higher education

Abstract

Purpose: With the growth of digital education, students increasingly interact in a variety of ways. The potential effects of these interactions on their learning process are not fully understood and the outcomes may depend on the tool used. This study explores the communication patterns and learning effectiveness developed by students using two basic synchronous and asynchronous communication tools in e-learning environments, specifically business simulation games. Design/methodology/approach: The authors conduct a quasi-experiment research with 478 online business students, 267 of whom used online discussion forums and 211 interacted via an instant messaging app. The application of learning analytics and text mining on natural language processing allows us to explore the student communication patterns with each of tools and their effectiveness in terms of learning. Findings: The results confirm the complementarity of the communication tools, asynchronous tools being especially the suitable for task-related communication and synchronous ones for speeding up and facilitating student social interactions. Originality/value: The main value of this research lies in the use of data analytics and text mining to access and analyse the content of student interactions to assess the learning process in greater depth, comparing synchronous and asynchronous learning modes, considering that little is known about the impact of online synchronous interaction or instant messaging, and even less about the different features, content and performance that emerge when these two learner interaction modalities are compared.