Assessment and evaluation of Games-Based Learning (GBL) in e-learning contexts

Abstract

The use of gamification in education and specifically in e-learning environments has been an exponential increase from 2014. Currently coexist more than 10,000 mobile applications (apps) that intermingle instructional design, educational content and playful interaction elements. However, there is no consensus in the scientific community about how to evaluate and assess Games Based Learning (GBL) of these platforms. This research aims to apply the Theoretical Integrated Gamification Model Environments E-Learning (E-MIGA) at 10 apps with more downloads in AppStore (IOS) and PlayStore (Android), through a judgment of 30 experts in the field of e-learning and gamification, to transform this theoretical model into an instrument of quantifiable dimensions and indicators. A pilot with scores drawn from expert judgment apps aforementioned test is then applied. It follows that neither test mobile applications analyzed education has received an excellent score of 62 points, although several of them as Memrise, Kahoot and Duolingo fully comply with 72% of the values set by the indicators.
  • Referencias
  • Cómo citar
  • Del mismo autor
  • Métricas
Anderson, C. A. (2004). An update on the effects of playing violent video games. Journal of Adolescence, 27, 113–122. https://doi.org/10.1016/j.adolescence.2003.10.009

Anderson, C. A. y Bushman, B. J. (2001). Effects of violent video games on aggressive behavior, aggressive cognition, aggressive affect, physiological arousal, and prosocial behavior: a meta-analytic review of the scientific literature. Psychological Science, 12, 353–359. https://doi.org/10.1111/1467-9280.00366

Cabero, J. y Llorente-Cejudo, M.C. (2013). La aplicación del juicio de experto como técnica de evaluación de las tecnologías de la información (TIC). Eduweb, 7(2), 11-22.

Campbell, J. P. y Kuncel, N. R. (2002). Individual and team training. En N. Anderson y D. S. Ones (Eds.), Handbook of industrial, work and organizational psychology (pp. 278-312). Thousand Oaks, CA: SAGE.

Caponetto, I., Earp, J. y Ott, M. (2013). Aspects of the integration of games into educational processes. International Journal of Knowledge Society Research (IJKSR), 4(3), 11-21. https://doi.org/10.4018/ijksr.2013070102

De Prato, G., Feijoo, C. y Simon, J.P. (2014). The Road to E-Services: Online and Mobile Games as Enablers. En Baek, Y., et al. (eds.) Trends and Applications of Serious Gaming and Social Media, Gaming Media and Social Effects. Singapore: Springer Science+Bussiness. https://doi.org/10.1007/978-981-4560-26-9_2

Deterding, S., Dixon, D., Khaled, R. y Nacke, L. (2011). From Game Design Elements to Gamefulness: Defining Gamification. En Proceedings of the 15th International Academic MindTrek Conference: Envisioning Future Media Environments (pp. 9-15). Nueva York: ACM. https://doi.org/10.1145/2181037.2181040

DEV, 2014. Libro blanco del desarrollo español de los videojuegos [Web]. Madrid: DEV. Recuperado de: https://goo.gl/7tvzwp

De Freitas, S. y Liarokapis, F. (2011). Serious games: a new paradigm for education? En Serious games and edutainment applications (pp. 9-23). Londo: Springer. https://doi.org/10.1007/978-1-4471-2161-9_2

Dicheva, D., Dichev C., Agre G. y Angelova G. (2015). Gamification in Education: A Systematic Mapping Study. Educational Technology y Society, 18(3), 75–88.

Erenli, K. (2013). The impact of gamification-recommending education scenarios. International Journal of Emerging Technologies in Learning (iJET), 8(2013), 15-21. https://doi.org/10.3991/ijet.v8is1.2320

Erhel, S. y Jamet, E. (2013). Digital game-based learning: Impact of instructions and feedback on motivation and learning effectiveness. Computers & Education, 67, 156-167. https://doi.org/10.1016/j.compedu.2013.02.019

Escobar-Pérez, J. y Cuervo-Martínez, A. (2008). Validez de contenido y juicio de expertos: Una aproximación a su utilización. Avances en Medición, 6, 27-36.

Fernández-Montalvo, J., Peñalva-Vélez, M.A. y Irazabal, I. (2015). Hábitos de uso y conductas de riesgo en Internet en la preadolescencia. Comunicar, 22(44), 113-120. https://doi.org/10.3916/C44-2015-12

García-Peñalvo, F. J. & Seoane-Pardo, A. M. (2015). Una revisión actualizada del concepto de eLearning. Décimo Aniversario. Education in the Knowledge Society, 16(1), 119-144. https://doi.org10.14201/eks2015161119144

Griffiths, M. D. y Davies, M. N. O. (2002). Excessive online computer gaming: implications for education. Journal of Computer Assisted Learning, 18, 379–380. https://doi.org/10.1046/j.0266-909.2002.00248.x

Gros, B. & García-Peñalvo, F. J. (2016). Future trends in the design strategies and technological affordances of e-learning. In M. Spector, B. B. Lockee, & M. D. Childress (Eds.), Learning, Design, and Technology. An International Compendium of Theory, Research, Practice, and Policy (pp. 1-23). Switzerland: Springer International Publishing. https://doi.org10.1007/978-3-319-17727-4_67-1

Goasduff, L. y Pettey, C. (2011). Gartner says by 2015, more than 50 percent of organizations that manage innovation processes will gamify those processes. Recuperado de http://www.gartner.com/it/page.jsp?id=1629214

Gómez, J. (1990). Metodología de encuestas por muestreo. En J. Arnau, M.T. Anguera, y J. Gómez (Eds.), Metodología de la Investigación en Ciencias del Comportamiento (pp.239-310). Murcia:Secretariado de Publicaciones de la Universidad de Murcia.

Green, C. S. y Bavelier, D. (2003). Action video game modifies visual selective attention. Nature,423 (6939), 534-537. https://doi.org/10.1038/nature01647

Hamari, J., Koivisto, J. y Sarsa, H. (2014). Does gamification work? A Literature Review of Empirical Studies on Gamification. En IEEE Computer Society (ed.). System Sciences (HICSS) (pp. 3025-3034). https://doi.org/10.1109/HICSS.2014.377

Hunicke, R., LeBlanc, M. y Zubek, R. (2004). MDA: A formal approach to game design and game research. En Proceedings of the AAAI Workshop on Challenges in Game AI (Vol. 4).

Kapp, K. M. (2012). The gamification of learning and instruction: game-based methods and strategies for training and education. John Wiley & Sons.

Ke, F. (2009). A qualitative meta-analysis of computer games as learning tools. En R.E. Ferdig (Ed.), Handbook of research on effective electronic gaming in education (Vol. 1, pp. 1–32). Hershey, PA: Information Science Reference. https://doi.org/10.4018/978-1-59904-808-6.ch001

Keller, J. M. (1987). Strategies for stimulating the motivation to learn. Performance and Instruction. IMMS: Florida State University.

Kim, B., Park, H. y Baek, Y. (2009). Not just fun, but serious strategies: Using meta-cognitive strategies in game-based learning. Computers & Education, 52(4), 800-810. https://doi.org/10.1016/j.compedu.2008.12.004

Kim, J. T. y Lee, W. H. (2015). Dynamical model for gamification of learning (DMGL). Multimedia Tools and Applications, 74(19), 8483-8493. https://doi.org/10.1007/s11042-013-1612-8

Kim, S., Song, K., Lockee, B. y Burton, J. (2018). Gamification Cases in Education. En Gamification in Learning and Education (pp. 117-123). Chan: Springer. https://doi.org/10.1007/978-3-319-47283-6_10

Kopcha, T. J., Ding, L., Neumann, K. L. y Choi, I. (2016). Teaching technology integration to k-12 educators: A ‘Gamified’approach. TechTrends, 60(1), 62-69. https://doi.org/10.1007/s11528-015-0018-z

Malone, T. W. (1980). What makes things fun to learn? Heuristics for designing instructional computer games. En Proceedings of the 3rd ACM SIGSMALL symposium and the first SIGPC symposium on Small systems (pp. 162-169). ACM. https://doi.org/10.1145/800088.802839

Merhi, O., Faugloire, E., Flanagan, M. y Stoffregen, T. (2007). Motion sickness, console video games, and head-mounted displays. Human Factors, 45(9), 920–935. https://doi.org/10.1518/001872007X230262

Mohammad, A. S. (2014). Gameducation: Using Gamification Techniques to Engage Learners in Online Learning. En Ebner et al. (eds.). Immersive Education (pp. 85-97). Viena: Springer International Publishing. https://doi.org/10.1007/978-3-319-22017-8_8

Monterrat, B., Lavoué, E. y George, S. (2013). Toward Personalized Gamification for Learning Environments. En 4th Workshop on Motivational and Affective Aspects in Technology Enhanced Learning (MATEL 2013) in conjunction with EC-TEL 2013. Berlín: Springer. https://doi.org/10.1145/2513002.2513024

Lee, J. J. y Hammer, J. (2011). Gamification in education: What, how, why bother? Academic Exchange
Quarterly, 15(2), 146-151.

Ogletree, S. M. y Drake, R. (2007). College students’ video game participation and perceptions: gender differences and implications. Sex Roles, 56, 537–542. https://doi.org/10.1007/s11199-007-9193-5

Pace, R., Dipace, A. y Di Matteo, A. (2014). On-site and online learning paths for an educational farm. Pedagogical perspectives for knowledge and social development. Research on Education and Media, 6(1), 39-56.

Prensky, M. (2001). Digital game-based learning. New York: McGraw-Hill.

Quiroga, M. A., Herranz, M., Gómez-Abad, M., Kebir, M., Ruiz, J. y Colom, R. (2009). Videogames: Do they require general intelligence? Computers & Education, 53 (2), 414-418. https://doi.org/10.1016/j.compedu.2009.02.017

Rincón Flores, Elvira G., Ramírez, M. S. y Mena Marcos, Juan J. (2016). Challenge-based gamification as a teaching’ Open Educational Innovation strategy in the energy sustainability area. En Fourth International Conference on Technological Ecosystems for Enhancing Multiculturality, TEEM 2016. https://doi.org/10.1145/3012430.3012658

Rincón-Flores, E., Ramírez-Montoya, M. S. y Serra-Barragán, L. A. (2017). Gamificación basada en retos en el MOOC «La reforma energética en México y sus oportunidades». En M.S. Ramírez-Montoya y A. Mendoza-Domínguez (Eds.), Innovación y Sustentabilidad Energética: Formación con MOOCs e investigación educativa, pp. 57-83. Madrid: Narcea. Disponible en: http://hdl.handle.net/11285/628012

Robles, P. y Rojas, M. (2015). La validación por juicio de expertos: Dos investigaciones cualitativas en Lingu?ística aplicada. Revista Nebrija de Lingu?ística Aplicada, 9(12).

Romero-Rodríguez, L.M., Torres-Toukoumidis, A. y Aguaded, I. (2017). Ludificación y educación para la ciudadanía. Revisión de las experiencias significativas. Educar, 53(1), 1-20. https://doi.org/10.5565/rev/educar.846

Romero-Rodríguez, L.M., Torres-Toukoumidis, A. y Pérez-Rodríguez, A. (2017). Modelo Integrado de Gamificación en Ambientes E-Learning (E-MIGA). Revista Complutense de Educación, 28(1), 129-145. https://doi.org/10.5209/RCED.52117

Romero-Rodríguez, L.M. y Torres-Toukoumidis, A. (2018). Con la información sí se juega: Los newsgames como narrativas inmersivas transmedias. En A. Torres-Toukoumidis y L.M. Romero-Rodríguez (Eds.), Gamificación en Iberoamérica Experiencias desde la Comunicación y la Educación (pp. 36-52). Quito: Abya-Yala.

Sitzmann, T. (2011). A meta-analytic examination of the instructional effectiveness of computerbased simulation games. Personnel Psychology, 64, 489–528. https://doi.org/10.1111/j.1744-6570.2011.01190.x

Sousa Borges, S. de, Durelli, V. H., Reis, H. M. y Isotani, S. (2014). A systematic mapping on gamification applied to education. En Proceedings of the 29th Annual ACM Symposium on Applied Computing (pp. 216-222). Nueva York: ACM. https://doi.org/10.1145/2554850.2554956

Simões, J., Redondo, R. D. y Vilas, A. F. (2013). A social gamification framework for a K-6 learning platform. Computers in Human Behavior, 29(2), 345-353. https://doi.org/10.1016/j.chb.2012.06.007

Tomé, A., da Cunha, L., Farias, M., Rosa, B., Anton, A. y Gasparini, I. (2015). Gamification in e-Learning Systems: A Conceptual Model to Engage Students and Its Application in an Adaptive e-Learning System. En Zaphiris, P. y Ioannou, A. (Eds.) Learning and Colaboration Technologies vol. 9192 (pp. 595-607). https://doi.org/10.1007/978-3-319-20609-7_56

Torres-Toukoumidis, A. y Romero-Rodríguez, L.M. (2018). Gamificación en los docentes de educación superior del Ecuador. En A. Torres-Toukoumidis y L.M. Romero-Rodríguez (Eds.), Gamificación en Iberoamérica Experiencias desde la Comunicación y la Educación (pp. 36-52). Quito: Abya-Yala.

Torres-Toukoumidis, A., Romero-Rodríguez, L., Pérez-Rodríguez, M.A. y Björk, S. (2016a). Development of reading skills through video games: state of the art. Ocnos, 15(2), 37-49. https://doi.org/10.18239/ocnos_2016.15.2.1124

Torres-Toukoumidis, A., Romero-Rodríguez, L.M. y Pérez-Rodríguez, M.A. (2016b). Análisis de la gamificación en la estructura de las aplicaciones móviles de E-Learning. En M.J. Barriga-Cano (Ed.), ¿Nuevas alternativas de la comunicación? Soportes, contenidos y audiencias (pp. 31-51). Sevilla: Egregius.

Torres-Toukoumidis, Á., Romero-Rodríguez, L. M. y Pérez-Rodríguez, M. A. (2018). Ludificación y sus posibilidades en el entorno de blended learning: revisión documental. RIED. Revista Iberoamericana de Educación a Distancia, 21(1), 95-111. https://doi.org/10.5944/ried.21.1.18792

Urh, M., Vukovic, G. y Jereb, E. (2015). The model for introduction of gamification into e-learning in higher education. Procedia-Social and Behavioral Sciences, 197, 388-397. https://doi.org/10.1016/j.sbspro.2015.07.154

Valdemoros-San-Emeterio, M. A., Sanz-Azazuri, E., Ponce-de-León-Elizondo, A. (2017). Ocio digital y ambiente familiar en estudiantes de Postobligatoria. Comunicar, 25(50), 99-108. https://doi.org/10.3916/C50-2017-09

Vogel, J. J., Vogel, D.S., Cannon-Bowers, J., Bowers, C.A., Muse, K. y Wright, M. (2006). Computer gaming and interactive simulations for learning: A meta-analysis. Journal of Educational Computing Research, 34, 229–243. https://doi.org/10.2190/FLHV-K4WA-WPVQ-H0YM

Werbach, K. y Hunter, D. (2012). For the Win: How Game Thinking Can Revolutionize Your Business. Wharton Digital Press: Philadelphia.

Wilson, K. A., Bedwell, W. L., Lazzara, E. H., Salas, E., Burke, C. S., Estock, J., . . . Conkey, C. (2009). Relationships between game attributes and learning outcomes: Review and research proposals. Simulation y Gaming, 40(2), 217-266. https://doi.org/10.1177/1046878108321866

Wood, L. C. y Reiners, T. (2012). Gamification in logistics and supply chain education: Extending active learning. En P. Kommers, T. Issa y P. Isaías (Eds.), IADIS International Conference on Internet Technologies y Society (pp. 101-108). Perth: IADIS Press.

Wouters, P., van Oostendorp, H., Boonekamp, R. y van der Spek, E. D. (2011). The role of game discourse analysis and curiosity in creating engaging and effective serious games by implementing a backstory and foreshadowing. Interacting With Computers, 23, 329 –336. https://doi.org/10.1016/j.intcom.2011.05.001

Wouters, P., van Nimwegen, C., van Oostendorp, H. y van der Spek, E. D. (2013). A Meta-Analysis of the Cognitive and Motivational Effects of Serious Games. Journal of Educational Psychology, 105(2), 249-265. https://doi.org/10.1037/a0031311

Zyda, M. (2005). From visual simulation to virtual reality to games. Computer, 38(9), 25–32. https://doi.org/10.1109/MC.2005.297
Torres-Toukoumidis, Ángel, Ramírez-Montoya, M. S., & Romero-Rodríguez, L. M. (2019). Assessment and evaluation of Games-Based Learning (GBL) in e-learning contexts. Education in The Knowledge Society, 19(4), 109–128. https://doi.org/10.14201/eks2018194109128

Downloads

Download data is not yet available.

Author Biographies

Ángel Torres-Toukoumidis

,
Universidad Politécnica Salesiana
Universidad Politécnica Salesiana, Ecuador

María Soledad Ramírez-Montoya

,
Tecnológico de Monterrey
Tecnológico de Monterrey, México

Luis M. Romero-Rodríguez

,
Universidad Espíritu Santo
ESAI Business School, Universidad Espíritu Santo, Ecuador
+