Long-Term Interaction: Learning the 4 Rs

Long-Term Interaction: Learning the 4 Rs

Alan Dix, Devina Ramduny, Julie Wilkinson

at time of publication: HCI Research Centre, Huddersfield University


Abstract

In long-term interaction (over minutes, hours, or days) the tight cycle of action and feedback is broken. People have to remember that they have to do things, that other people should do things and why things happen when they do. This paper describes some results of a study into long-term processes associated with the running of the HCI'95 conference. The focus is on the events which trigger the occurrence of activities. However, during the study we also discovered a recurrent pattern of activities and triggers we have called the 4Rs. For a longer report see [2].

Keywords

Interruptions, reminders, events, workflow

Long-term interaction

Interaction is often seen as a form of cycle where a user has an intention, performs an action, observes and evaluates the effect of the actions and then modifies future plans and actions based on the results [3]. However, this model only really applies when the feedback from one's actions is effectively instantaneous. In particular, the user is assumed to wait until the effects of an action are observed and is also assumed to be able to remember why an action was performed when interpreting the effects.

In many situations, these assumptions do not hold and the feedback from an action may occur minutes, hours or days later. This is the norm in many cooperative situations where messages are sent by post or email and in the control of industrial processes. However, even single-user computer systems may operate in this mode due to long network or computational delays.

In previous work, we have investigated the problems which arise when the interaction cycle is broken [1]. Two principle issues arise: (i) how do you recall the context when you eventually receive the feedback and (ii) how do you remember that some feedback should occur (and so react if it doesn't). The second of these is closely related to a third problem of long-term interaction (iii) how do you remember that you have to do something (prospective memory [4]). We observed that users adopt various coping strategies to deal with these problems, and based on these were able to suggest potential design heuristics.

Case study

Our existing work was based partly on theoretical analysis, and partly on personal and reported observations. However, we decided that we needed further empirical input in order to check the completeness of our existing analysis and uncover any additional issues for future study. The HCI'95 conference was being held in Huddersfield in August 1995 and was being administered locally. We decided that this was an ideal focus for a detailed investigation of long-term office procedures. Ann (the conference administrator) performed many duties in addition to those for the conference. This meant that direct observation would have been inappropriate and instead we relied on focused interviews for the study.

Focus

Part of the data we collected was on what was done. In traditional workflow fashion, we catalogued the various activities performed by Ann and others and the dependencies between the activities. However, this was only intended as the superstructure of the analysis, not the focus. Instead, our focus was on when activities were performed and whether they happened at all. The dependency tells you that one activity cannot happen before another has completed, but not how long the gap between will be. So, for each activity we asked what event triggered the activity to occur. It is this strong analytic focus which allows us to obtain reliable results from interviews. This is important as, although we would normally expect some additional direct observation, practical design must rely principally on more directed and less intrusive techniques.

Triggers

Based principally on previous theoretical analysis and refined by the results of our case study we have classified the kinds of triggers which occur.

These include:
(a) when one activity directly follows another,
(b) spontaneous recall that something needs to be done,
(c) timed events such as things done every morning, according to a diary etc.,
(d) external events such as messages from other people or from computer systems,
(e) environmental cues such as piles of paper on a desk.

The first two of these classes (a)&(b) are insecure being liable to interruptions and poor memory respectively. In each case we look for a secondary or back-up trigger, or where this is absent look at the process as a whole and assess the consequences if the activity fails to trigger at all. Other triggers also lead to follow-on questions. For example, if an event is triggered because it is in a diary, what makes you look in the diary?

Environmental cues

We fully expected and found in our study that environmental cues were one of the principal and most robust triggering mechanisms. Several ethnographic studies have noted the importance of the ecology of the workplace, including whiteboards, calendars, individual papers and piles on desks [5]. We are focusing on a particular role of these cues, namely their ability to remind and trigger future actions. This is particularly important if there are plans to automate parts of an office procedure. Understanding why paper is important can allow us to see whether automation will break the existing work system and if so whether alternative cues can be provided.

An example

As an example let's look at a simplified part of the procedure when a paper arrived at the HCI'95 office (figure 1). The sub-process starts when the author sends the paper, Ann receives it through the post and then records the details of the paper in a database before filing the paper (ready for subsequent review). For each activity we look at the triggering event.

  1. This is simply when the packet containing the paper arrives. We could investigate the postal system in detail, but normally we would stop here, recording our expectations about its reliability and timeliness.
  2. Ann did not immediately enter the paper's details. Instead, when a small pile had accumulated she entered them together. The trigger is the pile of papers on her desk, an environmental cue.
  3. As soon as the details were recorded, the papers were filed. However, as we have noted this is liable to interruptions and so we looked for a secondary trigger. In this case, the unfiled papers are still sitting on the desk.
Unfortunately, this leads to a further problem. Two activities have the same trigger. Potentially, either the recording will be repeated after an interruption or may be omitted entirely (if Ann mistakenly thought an interruption had previously occurred). Happily, Ann's memory was good enough and these problems did not arise in this case.



Figure 1. The 4Rs

The 4Rs

As noted, our initial focus was on the individual triggers more than the processes themselves and so, it was only when presenting early findings that we noticed a pattern emerging. The papers process in figure 1 is very similar to the process that one of the authors follows when dealing with email. When the mail arrives, he reads it (or at least notes its arrival), but does not deal with it immediately - it stay in his 'in-tray' until he has replied or otherwise dealt with it, only at that stage does he file it in a folder or discard it. If interrupted after replying, the original message is still in the in-tray (secondary trigger). Recently, whilst in the middle of replying to a message, the machine crashed (interruption). When some time later he again read his email, he mistakenly (and unconsciously!) took the continued presence of the email in the in-tray as signifying an interruption before filing (secondary trigger) and hence filed the message without replying.

We can see in this a general structure: request - someone sends a message (or implicitly passes an object) requiring your action, receipt - you receive it, response - you perform some necessary action, and release - you file or dispose of the things used during the process. Furthermore, the triggers are also similar. The response activity is typically triggered by the presence of a document or other object, the release removes that cue, but also relies on its existence as a secondary trigger. The problems with the author's email will occur elsewhere! This pattern has various refinements, for example, when a note is made of a verbal request. However, it appears to be a pervasive, generic pattern, at a lower level than those identified in speech-act theory [6], and perhaps being the long-term interaction equivalent of adjacency pairs found in conversational analysis.

Towards design

The analysis we have used was targeted at increasing our theoretical understanding, but we also believe it has direct design implications. It determines whether a process is robust to interruptions, forgetfulness, etc. and if not, identify why not and where the problems arise. As we have noted these problems are particularly likely when a functioning paper-based system is automated - the analysis can target potential problem spots before they occur. Finally, the existence of generic patterns makes it easier to uncover problem situations quickly and to take solutions found in one situation and adapt them to another.

References

  1. A. Dix (1994). Que sera sera - The problem of the future perfect in open and cooperative systems. Proceedings of HCI'94: People and Computers IX, Glasgow, Cambridge University Press.
  2. A. Dix, D. Ramduny and J. Wilkinson (1995). Interruptions Deadlines and Reminders: Investigations into the Flow of Cooperative Work. RR9509, University of Huddersfield.
  3. D. A. Norman (1988). The Psychology of Everyday Things. Basic Books.
  4. S. J. Payne (1993). Understanding Calendar Use. Human-Computer Interaction. 8(2): 83-100.
  5. M. Rouncefield, J. A. Hughes, T. Rodden and S. Viller (1994). Working with "Constant Interruption" CSCW and the Small Office. Proceedings of CSCW'94, Chapel Hill, North Carolina, ACM Press.
  6. T. Winograd and F. Flores (1986). Understanding computers and cognition : a new foundation for design. New York, Addison-Wesley Publishing Company, Inc.

Alan Dix