The human viewpoint and the system's viewpoint

This chapter describes how the same immersive language learning session is ‘seen’ from two different points of view: the human users’ and the digital system’s. Given the complexity of human-computer interaction data, whose transcription requires integrating verbal and non-verbal activities by quite diff erent sorts of ‘participants’, the chapter will start by problematizing such a secondary source of data, reflecting on why, how and what to transcribe. Different transcription formats will be evaluated, including parallel columns and score- like representations, as are made possible with the software ELAN. Such integrated transcripts can yield interesting insights into the system’s working and contribute to an understanding of what type of ‘communication’ takes place in a EDK cooking session, with implications for redesign and technology development. This chapter demonstrates that a session in an immersive digital environment can be best represented by reporting how both humans and the system access the ongoing situation.