2024
Miguel-Alonso, Ines; Checa, David; Guillen-Sanz, Henar; Bustillo, Andres
Evaluation of the novelty effect in immersive Virtual Reality learning experiences Journal Article
In: Virtual Reality, vol. 28, no. 27, 2024, ISSN: 1434-9957.
Abstract | Links | BibTeX | Tags: head mounted display, Learning, novelty effect, serious games, tutorial, Virtual Reality
@article{miguel-alonso2024,
title = {Evaluation of the novelty effect in immersive Virtual Reality learning experiences},
author = {Ines Miguel-Alonso and David Checa and Henar Guillen-Sanz and Andres Bustillo},
url = {https://doi.org/10.1007/s10055-023-00926-5 },
doi = {https://doi.org/10.1007/s10055-023-00926-5 },
issn = {1434-9957},
year = {2024},
date = {2024-01-21},
urldate = {2024-01-21},
journal = {Virtual Reality},
volume = {28},
number = {27},
abstract = {In this study, the novelty effect or initial fascination with new technology is addressed in the context of an immersive Virtual Reality (iVR) experience. The novelty effect is a significant factor contributing to low learning outcomes during initial VR learning experiences. The aim of this research is to measure the effectiveness of a tutorial at mitigating the novelty effect of iVR learning environments among first-year undergraduate students. The iVR tutorial forms part of the iVR learning experience that involves the assembly of a personal computer, while learning the functions of the main components. 86 students participated in the study, divided into a Control group (without access to the tutorial) and a Treatment group (completing the tutorial). Both groups showed a clear bimodal distribution in previous knowledge, due to previous experience with learning topics, giving us an opportunity to compare tutorial effects with students of different backgrounds. Pre- and post-test questionnaires were used to evaluate the experience. The analysis included such factors as previous knowledge, usability, satisfaction, and learning outcomes categorized into remembering, understanding, and evaluation. The results demonstrated that the tutorial significantly increased overall satisfaction, reduced the learning time required for iVR mechanics, and improved levels of student understanding, and evaluation knowledge. Furthermore, the tutorial helped to homogenize group behavior, particularly benefiting students with less previous experience in the learning topic. However, it was noted that a small number of students still received low marks after the iVR experience, suggesting potential avenues for future research.},
keywords = {head mounted display, Learning, novelty effect, serious games, tutorial, Virtual Reality},
pubstate = {published},
tppubtype = {article}
}
In this study, the novelty effect or initial fascination with new technology is addressed in the context of an immersive Virtual Reality (iVR) experience. The novelty effect is a significant factor contributing to low learning outcomes during initial VR learning experiences. The aim of this research is to measure the effectiveness of a tutorial at mitigating the novelty effect of iVR learning environments among first-year undergraduate students. The iVR tutorial forms part of the iVR learning experience that involves the assembly of a personal computer, while learning the functions of the main components. 86 students participated in the study, divided into a Control group (without access to the tutorial) and a Treatment group (completing the tutorial). Both groups showed a clear bimodal distribution in previous knowledge, due to previous experience with learning topics, giving us an opportunity to compare tutorial effects with students of different backgrounds. Pre- and post-test questionnaires were used to evaluate the experience. The analysis included such factors as previous knowledge, usability, satisfaction, and learning outcomes categorized into remembering, understanding, and evaluation. The results demonstrated that the tutorial significantly increased overall satisfaction, reduced the learning time required for iVR mechanics, and improved levels of student understanding, and evaluation knowledge. Furthermore, the tutorial helped to homogenize group behavior, particularly benefiting students with less previous experience in the learning topic. However, it was noted that a small number of students still received low marks after the iVR experience, suggesting potential avenues for future research.
Martinez, Kim; Checa, David; Bustillo, Andres
In: Electronics, vol. 13, iss. 281, no. 2, pp. 281, 2024.
Abstract | Links | BibTeX | Tags: game design, game engagement, game evaluation, serious games, Virtual Reality
@article{martinez2024,
title = {Development of the Engagement Playability and User eXperience (EPUX) Metric for 2D-Screen and VR Serious Games: A Case-Study Validation of Hellblade: Senua’s Sacrifice },
author = {Kim Martinez and David Checa and Andres Bustillo},
url = {https://doi.org/10.3390/electronics13020281},
doi = {electronics13020281},
year = {2024},
date = {2024-01-08},
urldate = {2024-01-08},
journal = {Electronics},
volume = {13},
number = {2},
issue = {281},
pages = {281},
abstract = {Research into the design of serious games still lacks metrics to evaluate engagement with the experience so that users can achieve the learning aims. This study presents the new EPUX metric, based on playability and User eXperience (UX) elements, to measure the capability of any serious game to maintain the attention of players. The metric includes (1) playability aspects: game items that affect the emotions of users and that constitute the different layers of the game, i.e., mechanics, dynamics and aesthetics; and (2) UX features: motivation, meaningful choices, usability, aesthetics and balance both in the short and in the long term. The metric is also adapted to evaluate virtual reality serious games (VR-SGs), so that changes may be considered to features linked to playability and UX. The case study for the assessment of the EPUX metric is Hellblade, developed in two versions: one for 2D-screens and the other for VR devices. The comparison of the EPUX metric scores for both versions showed that (1) some VR dynamics augmented the impact of gameplay and, in consequence, engagement capacity; and (2) some game design flaws were linked to much lower scores. Among those flaws were low numbers of levels, missions, and items; no tutorial to enhance usability; and lack of strategies and rewards to increase motivation in the long term.},
keywords = {game design, game engagement, game evaluation, serious games, Virtual Reality},
pubstate = {published},
tppubtype = {article}
}
Research into the design of serious games still lacks metrics to evaluate engagement with the experience so that users can achieve the learning aims. This study presents the new EPUX metric, based on playability and User eXperience (UX) elements, to measure the capability of any serious game to maintain the attention of players. The metric includes (1) playability aspects: game items that affect the emotions of users and that constitute the different layers of the game, i.e., mechanics, dynamics and aesthetics; and (2) UX features: motivation, meaningful choices, usability, aesthetics and balance both in the short and in the long term. The metric is also adapted to evaluate virtual reality serious games (VR-SGs), so that changes may be considered to features linked to playability and UX. The case study for the assessment of the EPUX metric is Hellblade, developed in two versions: one for 2D-screens and the other for VR devices. The comparison of the EPUX metric scores for both versions showed that (1) some VR dynamics augmented the impact of gameplay and, in consequence, engagement capacity; and (2) some game design flaws were linked to much lower scores. Among those flaws were low numbers of levels, missions, and items; no tutorial to enhance usability; and lack of strategies and rewards to increase motivation in the long term.
2022
Martinez, Kim; Menéndez-Menéndez, María Isabel; Bustillo, Andres
A New Measure for Serious Games Evaluation: Gaming Educational Balanced (GEB) Model Journal Article
In: Applied Sciences, vol. 12, iss. 22, no. 11757, 2022, ISSN: 2076-3417.
Abstract | Links | BibTeX | Tags: game design, game evaluation, metrics, serious games
@article{kim2022,
title = {A New Measure for Serious Games Evaluation: Gaming Educational Balanced (GEB) Model},
author = {Kim Martinez and María Isabel Menéndez-Menéndez and Andres Bustillo},
editor = {Maya Satratzemi and Stelios Xinogalos},
doi = {10.3390/app122211757},
issn = {2076-3417},
year = {2022},
date = {2022-11-19},
urldate = {2022-11-19},
journal = {Applied Sciences},
volume = {12},
number = {11757},
issue = {22},
abstract = {Serious games have to meet certain characteristics relating to gameplay and educational content to be effective as educational tools. There are some models that evaluate these aspects, but they usually lack a good balance between both ludic and learning requirements, and provide no guide for the design of new games. This study develops the Gaming Educational Balanced (GEB) Model which addresses these two limitations. GEB is based on the Mechanics, Dynamics and Aesthetics framework and the Four Pillars of Educational Games theory. This model defines a metric to evaluate serious games, which can also be followed to guide their subsequent development. This rubric is tested with three indie serious games developed using different genres to raise awareness of mental illnesses. This evaluation revealed two main issues: the three games returned good results for gameplay, but the application of educational content was deficient, due in all likelihood to the lack of expert educators participating in their development. A statistical and machine learning validation of the results is also performed to ensure that the GEB metric features are clearly explained and the players are able to evaluate them correctly. These results underline the usefulness of the new metric tool for identifying game design strengths and weaknesses. Future works will apply this metric to more serious games to further test its effectiveness and to guide the design of new serious games.},
keywords = {game design, game evaluation, metrics, serious games},
pubstate = {published},
tppubtype = {article}
}
Serious games have to meet certain characteristics relating to gameplay and educational content to be effective as educational tools. There are some models that evaluate these aspects, but they usually lack a good balance between both ludic and learning requirements, and provide no guide for the design of new games. This study develops the Gaming Educational Balanced (GEB) Model which addresses these two limitations. GEB is based on the Mechanics, Dynamics and Aesthetics framework and the Four Pillars of Educational Games theory. This model defines a metric to evaluate serious games, which can also be followed to guide their subsequent development. This rubric is tested with three indie serious games developed using different genres to raise awareness of mental illnesses. This evaluation revealed two main issues: the three games returned good results for gameplay, but the application of educational content was deficient, due in all likelihood to the lack of expert educators participating in their development. A statistical and machine learning validation of the results is also performed to ensure that the GEB metric features are clearly explained and the players are able to evaluate them correctly. These results underline the usefulness of the new metric tool for identifying game design strengths and weaknesses. Future works will apply this metric to more serious games to further test its effectiveness and to guide the design of new serious games.
2021
Martínez, Kim; Menéndez, María Isabel Menéndez; Bustillo, Andrés
A systematic review of serious games for children and adolescents: awareness, prevention, detection and therapy for depression and anxiety Journal Article
In: JMIR Serious Games, vol. 9, no. 4 (2021), 2021, ISSN: 2291-9279.
Abstract | Links | BibTeX | Tags: adolescents, anxiety, awareness, children, depression, detection, mental health, prevention, serious games, therapy, Virtual Reality
@article{Martínez2021,
title = {A systematic review of serious games for children and adolescents: awareness, prevention, detection and therapy for depression and anxiety},
author = {Kim Martínez and María Isabel Menéndez Menéndez and Andrés Bustillo},
url = {https://games.jmir.org/2021/4/e30482},
doi = {10.2196/30482},
issn = {2291-9279},
year = {2021},
date = {2021-12-16},
journal = {JMIR Serious Games},
volume = {9},
number = {4 (2021)},
abstract = {Background:
Depression and anxiety in children and adolescents are major health problems worldwide. In recent years, serious games research has advanced in the development of tools to address these mental health conditions. However, there has not been an extensive analysis of these games, their tendencies, and capacities.
Objective:
This review aims to gather the most current serious games, published from 2015 to 2020, with a new approach focusing on their applications: awareness, prevention, detection, and therapy. The purpose is also to analyze the implementation, development, and evaluation of these tools to obtain trends, strengths, and weaknesses for future research lines.
Methods:
The identification of the serious games through a literature search was conducted on the databases PubMed, Scopus, Wiley, Taylor and Francis, Springer, PsycINFO, PsycArticles, Web of Science, and Science Direct. The identified records were screened to include only the manuscripts meeting these criteria: a serious game for PC, smartphone, or virtual reality; developed by research teams; targeting only depression or anxiety or both; aiming specifically at children or adolescents.
Results:
A total of 34 studies have been found that developed serious games for PC, smartphone, and virtual reality devices and tested them in children and adolescents. Most of the games address both conditions and are applied in prevention and therapy. Nevertheless, there is a trend that anxiety is targeted more in childhood and depression targeted more in adolescence. Regarding design, the game genres arcade minigames, adventure worlds, and social simulations are used, in this order. For implementation, these serious games usually require sessions of 1 hour and are most often played using a PC. Moreover, the common evaluation tools are normalized questionnaires that measure acquisition of skills or reduction of symptoms. Most studies collect and compare these data before and after the participants play.
Conclusions:
The results show that more awareness and detection games are needed, as well as games that mix the awareness, prevention, detection, and therapy applications. In addition, games for depression and anxiety should equally target all age ranges. For future research, the development and evaluation of serious games should be standardized, so the implementation of serious games as tools would advance. The games should always offer support while playing, in addition to collecting data on participant behavior during the game to better analyze their learning. Furthermore, there is an open line regarding the use of virtual reality for these games due to the capabilities offered by this technology.},
keywords = {adolescents, anxiety, awareness, children, depression, detection, mental health, prevention, serious games, therapy, Virtual Reality},
pubstate = {published},
tppubtype = {article}
}
Background:
Depression and anxiety in children and adolescents are major health problems worldwide. In recent years, serious games research has advanced in the development of tools to address these mental health conditions. However, there has not been an extensive analysis of these games, their tendencies, and capacities.
Objective:
This review aims to gather the most current serious games, published from 2015 to 2020, with a new approach focusing on their applications: awareness, prevention, detection, and therapy. The purpose is also to analyze the implementation, development, and evaluation of these tools to obtain trends, strengths, and weaknesses for future research lines.
Methods:
The identification of the serious games through a literature search was conducted on the databases PubMed, Scopus, Wiley, Taylor and Francis, Springer, PsycINFO, PsycArticles, Web of Science, and Science Direct. The identified records were screened to include only the manuscripts meeting these criteria: a serious game for PC, smartphone, or virtual reality; developed by research teams; targeting only depression or anxiety or both; aiming specifically at children or adolescents.
Results:
A total of 34 studies have been found that developed serious games for PC, smartphone, and virtual reality devices and tested them in children and adolescents. Most of the games address both conditions and are applied in prevention and therapy. Nevertheless, there is a trend that anxiety is targeted more in childhood and depression targeted more in adolescence. Regarding design, the game genres arcade minigames, adventure worlds, and social simulations are used, in this order. For implementation, these serious games usually require sessions of 1 hour and are most often played using a PC. Moreover, the common evaluation tools are normalized questionnaires that measure acquisition of skills or reduction of symptoms. Most studies collect and compare these data before and after the participants play.
Conclusions:
The results show that more awareness and detection games are needed, as well as games that mix the awareness, prevention, detection, and therapy applications. In addition, games for depression and anxiety should equally target all age ranges. For future research, the development and evaluation of serious games should be standardized, so the implementation of serious games as tools would advance. The games should always offer support while playing, in addition to collecting data on participant behavior during the game to better analyze their learning. Furthermore, there is an open line regarding the use of virtual reality for these games due to the capabilities offered by this technology.
Depression and anxiety in children and adolescents are major health problems worldwide. In recent years, serious games research has advanced in the development of tools to address these mental health conditions. However, there has not been an extensive analysis of these games, their tendencies, and capacities.
Objective:
This review aims to gather the most current serious games, published from 2015 to 2020, with a new approach focusing on their applications: awareness, prevention, detection, and therapy. The purpose is also to analyze the implementation, development, and evaluation of these tools to obtain trends, strengths, and weaknesses for future research lines.
Methods:
The identification of the serious games through a literature search was conducted on the databases PubMed, Scopus, Wiley, Taylor and Francis, Springer, PsycINFO, PsycArticles, Web of Science, and Science Direct. The identified records were screened to include only the manuscripts meeting these criteria: a serious game for PC, smartphone, or virtual reality; developed by research teams; targeting only depression or anxiety or both; aiming specifically at children or adolescents.
Results:
A total of 34 studies have been found that developed serious games for PC, smartphone, and virtual reality devices and tested them in children and adolescents. Most of the games address both conditions and are applied in prevention and therapy. Nevertheless, there is a trend that anxiety is targeted more in childhood and depression targeted more in adolescence. Regarding design, the game genres arcade minigames, adventure worlds, and social simulations are used, in this order. For implementation, these serious games usually require sessions of 1 hour and are most often played using a PC. Moreover, the common evaluation tools are normalized questionnaires that measure acquisition of skills or reduction of symptoms. Most studies collect and compare these data before and after the participants play.
Conclusions:
The results show that more awareness and detection games are needed, as well as games that mix the awareness, prevention, detection, and therapy applications. In addition, games for depression and anxiety should equally target all age ranges. For future research, the development and evaluation of serious games should be standardized, so the implementation of serious games as tools would advance. The games should always offer support while playing, in addition to collecting data on participant behavior during the game to better analyze their learning. Furthermore, there is an open line regarding the use of virtual reality for these games due to the capabilities offered by this technology.