Assessment of teams in a digital game environment

Research output: Contribution to journalArticleScientificpeer-review

1 Citation (Scopus)

Abstract

Background. Despite the increasing pervasiveness of digital entertainment and serious games in organisational life, there is little evidence for the validity of game-based team training and assessment. Aim. The authors used the game, TEAMUP for a series of team training and assessment sessions, while at the same time researching the internal validity of the game for this purpose. Method. A total of 106 sets of data on games played by teams of professionals (police officers, auditors, consultants, etc.) and undergraduates and postgraduates (in aerospace engineering, entrepreneurship, etc.) were gathered for analysis through pre- and post-game questionnaires focusing on constructs for team quality, such as psychological safety and team cohesiveness. In addition, a large quantity of such data as time to complete task, distance and avoidable mistakes were logged to measure in-game team performance. Correlation and regression analyses were conducted to find relationships between team structure factors, team quality constructs and in-game performance measures. Results. The main finding is that the in-game performance measure ‘avoidable mistakes’ (a proxy for task quality) correlates markedly and pervasively with ‘team cohesiveness’. More important, the findings support the premise that in-game assessment can be internally valid for team research and assessment purposes.

Original languageEnglish
JournalSimulation & Gaming
DOIs
Publication statusPublished - 2018

Keywords

  • serious games
  • team assessment
  • team training
  • validation

Cite this

@article{434ec5ccfef24d88adf8f894f6d525ca,
title = "Assessment of teams in a digital game environment",
abstract = "Background. Despite the increasing pervasiveness of digital entertainment and serious games in organisational life, there is little evidence for the validity of game-based team training and assessment. Aim. The authors used the game, TEAMUP for a series of team training and assessment sessions, while at the same time researching the internal validity of the game for this purpose. Method. A total of 106 sets of data on games played by teams of professionals (police officers, auditors, consultants, etc.) and undergraduates and postgraduates (in aerospace engineering, entrepreneurship, etc.) were gathered for analysis through pre- and post-game questionnaires focusing on constructs for team quality, such as psychological safety and team cohesiveness. In addition, a large quantity of such data as time to complete task, distance and avoidable mistakes were logged to measure in-game team performance. Correlation and regression analyses were conducted to find relationships between team structure factors, team quality constructs and in-game performance measures. Results. The main finding is that the in-game performance measure ‘avoidable mistakes’ (a proxy for task quality) correlates markedly and pervasively with ‘team cohesiveness’. More important, the findings support the premise that in-game assessment can be internally valid for team research and assessment purposes.",
keywords = "serious games, team assessment, team training, validation",
author = "IS Mayer",
year = "2018",
doi = "10.1177/1046878118770831",
language = "English",
journal = "Simulation & Gaming",
issn = "1046-8781",
publisher = "SAGE Publications",

}

Assessment of teams in a digital game environment. / Mayer, IS.

In: Simulation & Gaming, 2018.

Research output: Contribution to journalArticleScientificpeer-review

TY - JOUR

T1 - Assessment of teams in a digital game environment

AU - Mayer, IS

PY - 2018

Y1 - 2018

N2 - Background. Despite the increasing pervasiveness of digital entertainment and serious games in organisational life, there is little evidence for the validity of game-based team training and assessment. Aim. The authors used the game, TEAMUP for a series of team training and assessment sessions, while at the same time researching the internal validity of the game for this purpose. Method. A total of 106 sets of data on games played by teams of professionals (police officers, auditors, consultants, etc.) and undergraduates and postgraduates (in aerospace engineering, entrepreneurship, etc.) were gathered for analysis through pre- and post-game questionnaires focusing on constructs for team quality, such as psychological safety and team cohesiveness. In addition, a large quantity of such data as time to complete task, distance and avoidable mistakes were logged to measure in-game team performance. Correlation and regression analyses were conducted to find relationships between team structure factors, team quality constructs and in-game performance measures. Results. The main finding is that the in-game performance measure ‘avoidable mistakes’ (a proxy for task quality) correlates markedly and pervasively with ‘team cohesiveness’. More important, the findings support the premise that in-game assessment can be internally valid for team research and assessment purposes.

AB - Background. Despite the increasing pervasiveness of digital entertainment and serious games in organisational life, there is little evidence for the validity of game-based team training and assessment. Aim. The authors used the game, TEAMUP for a series of team training and assessment sessions, while at the same time researching the internal validity of the game for this purpose. Method. A total of 106 sets of data on games played by teams of professionals (police officers, auditors, consultants, etc.) and undergraduates and postgraduates (in aerospace engineering, entrepreneurship, etc.) were gathered for analysis through pre- and post-game questionnaires focusing on constructs for team quality, such as psychological safety and team cohesiveness. In addition, a large quantity of such data as time to complete task, distance and avoidable mistakes were logged to measure in-game team performance. Correlation and regression analyses were conducted to find relationships between team structure factors, team quality constructs and in-game performance measures. Results. The main finding is that the in-game performance measure ‘avoidable mistakes’ (a proxy for task quality) correlates markedly and pervasively with ‘team cohesiveness’. More important, the findings support the premise that in-game assessment can be internally valid for team research and assessment purposes.

KW - serious games

KW - team assessment

KW - team training

KW - validation

U2 - 10.1177/1046878118770831

DO - 10.1177/1046878118770831

M3 - Article

JO - Simulation & Gaming

JF - Simulation & Gaming

SN - 1046-8781

ER -