Please use this identifier to cite or link to this item:
Title: Distributed-based massive processing of activity logs for efficient user modeling in a virtual campus
Author: Caballé Llobet, Santi  
Xhafa, Fatos
Others: Universitat Oberta de Catalunya. Internet Interdisciplinary Institute (IN3)
Universitat Politècnica de Catalunya
Keywords: massive processing
log files
cluster computing
web mining usage
WEKA framework
navigation patterns
virtual campus
Issue Date: 18-Mar-2013
Publisher: Cluster Computing
Citation: Caballé, S. & Xhafa, F. (2013). Distributed-based Massive Processing of Activity Logs for Efficient User Modeling in a Virtual Campus. Cluster Computing, 16(4), 829-844. doi: 10.1007/s10586-013-0256-9
Also see:
Abstract: This paper reports on a multi-fold approach for the building of user models based on the identification of navigation patterns in a virtual campus, allowing for adapting the campus' usability to the actual learners' needs, thus resulting in a great stimulation of the learning experience. However, user modeling in this context implies a constant processing and analysis of user interaction data during longterm learning activities, which produces huge amounts of valuable data stored typically in server log files. Due to the large or very large size of log files generated daily, the massive processing is a foremost step in extracting useful information. To this end, this work studies, first, the viability of processing large log data files of a real Virtual Campus using different distributed infrastructures. More precisely, we study the time performance of massive processing of daily log files implemented following the master-slave paradigm and evaluated using Cluster Computing and PlanetLab platforms. The study reveals the complexity and challenges of massive processing in the big data era, such as the need to carefully tune the log file processing in terms of chunk log data size to be processed at slave nodes as well as the bottleneck in processing in truly geographically distributed infrastructures due to the overhead caused by the communication time among the master and slave nodes. Then, an application of the massive processing approach resulting in log data processed and stored in a well-structured format is presented. We show how to extract knowledge from the log data analysis by using the WEKA framework for data mining purposes showing its usefulness to effectively build user models in terms of identifying interesting navigation patters of on-line learners. The study is motivated and conducted in the context of the actual data logs of the Virtual Campus of the Open University of Catalonia.
Language: English
ISSN: 1386-7857MIAR
Appears in Collections:Articles

Files in This Item:
File Description SizeFormat 
Caballe_Xhafa_CC_Distributed.pdfPost-print1.2 MBAdobe PDFView/Open

This item is licensed under a Creative Commons License Creative Commons