Collaborative Evaluation: Mapping Socio-Technical Patterns in an Emergency Exercise

Abstract

Evaluating both exercises and real events can be challenging. This is especially evident in full-scale exercises, where a wide range of organizations must collaborate to solve a common problem. Information sharing, use of technology, and role understanding can be particularly challenging. In this article, we illustrate how academia can meaningfully engage in conducting and executing a comprehensive Emergency Exercise, ensuring that insights from prior research are evident from the outset. We employ a method where we co-create a Socio-Technical Network map together with practitioners. The method provides results that help visualize the complexity generated by large-scale collaboration, fostering involvement and engagement from both researchers and practitioners. Through this mapping, we gained valuable insights into barriers to Team Situation Awareness, technological possibilities and limitations, and a better understanding of various roles and their information needs.