Empirical evaluation of a visualization tool for knowledge engineering
Date
2003
Authors
Allen, Mary Margaret
Journal Title
Journal ISSN
Volume Title
Publisher
Abstract
The lack of methods and models for evaluation has long been a challenge in software development. Without empirical investigations into real practice, the potential of many new technologies may remain unexplored. While tools that support the knowledge engineering process through information visualization are being created, there is an absence of established evaluation theory or task models in this domain. Through contextual observation and an introspective case study, this thesis demonstrates the feasibility of using requirement elicitation techniques to guide the refinement and evaluation of such a tool.
Through the analysis of our qualitative results, we derive a descriptive taxonomy of tasks performed by users of frame-based knowledge representation systems. Suggestions for cognitive support for some of these tasks, including potential visualization support, are also proposed. We further provide some more experimental evaluation designs based on these results, which can be used to investigate the theories we propose. The Shrimpbib knowledge management tool built as part of a case study is also an important contribution. It uses visualization techniques to share knowledge about academic references among members of a small research group.