Quantifying the experience of immersion in games
|
|
|
- Emerald Simpson
- 9 years ago
- Views:
Transcription
1 Quantifying the experience of immersion in games Paul Cairns Anna Cox Nadia Berthouze Samira Dhoparee Charlene Jennett UCL Interaction Centre University College London Remax House, Alfred Place London WC1E 7DP UK Abstract Games are undoubtedly the most successful computer application yet it is not easy to attribute their success to any one particular feature. Nonetheless, when talking about games, gamers and reviewers frequently refer to the immersive experience of the game as an important aspect to be attained. However, it is not clear what immersion is and even if it is a comparable experience between different players and different games. This paper aims to develop more quantifiable and therefore objective measures of immersion. We describe a study into switching from an immersive gaming experience to another task, not in the game world. Though the degree of immersion does seem to have an impact on the ability to perform the task, the experimental approach is complex and possibly quite fragile. We therefore set out hypotheses for a similar experiment with the aim of exploring whether eyetracking and body motion provide better indicators of the degree of immersion. Immersion in Games Engaging with media such as computer games, virtual reality, cinema and even books has been described as giving rise to experiences of feeling deeply involved with that particular medium. In software research, numerous terms have been developed to try to account for these experiences, such as flow, presence and immersion (Csikszentmihalyi, 1990; Slater, Usoh & Steed, 1994; Witmer & Singer, 1998). Within game reviews, the term usually used is that of immersion (for example, TTLG, 2005) but it is not clear if this corresponds to immersion in other contexts or the extent to which it relates to other involving experiences. Even within the term immersion, there are competing definitions. Coomans and Timmermans (1997) describe immersion as a feeling of being deeply engaged where people enter a make-believe world as if it is real whilst Menetta and Blade (1998) describe it with respect to the emotional response presented by a virtual world. Radford (2000) describes immersion as being related to the ability to enter a game through its controls, although it is unclear how this relationship affects or gives rise to immersion. Approaching the concept from a different perspective, Slater et al. (1994), defined immersion with respect to the technology rather than the human experience. Immersion is described as how far the system delivers an environment that creates a sense of presence. The experiences of the user are related to presence which is a sense of being there in a mediated environment and the experience is confined to virtual reality (VR) domains, where one perceives themselves to be surrounded by (particularly visual) stimuli. In this sense, presence in VR would seem to correspond to immersion in games though clearly Slater et al. make it clear that non-vr games could not lead to presence. However there is a paradox, Schubert and Crusius (2002) argue that an individual reading a book may feel just as present in that medium as they might be engaging in a VR setting, even though they are not completely surrounded by stimuli. This is supported by other work where immersion as understood by gamers (Brown and Cairns, 2004) is found to be comparable to immersion in reading and film (Cairns et al., under review). Definitions are further hindered by overlaps of the underlying concept of immersion, according to the gaming community s usage, with themes from related constructs. For example, flow (Csikszentmihalyi, 1990) is described as an optimal experience achieved in the pursuit of intrinsically rewarding physical or symbolic activities where individuals are so involved in an activity that nothing else seems to matter. Similarly, Agarwal and Karahanna s (2001) construct of cognitive absorption (CA) is intended as a state of deep involvement with software. Their study highlights the discrepancy between studies as to what constitutes antecedents and features of constructs such as flow and cognitive absorption, and the consequences of being in these states. Also, it is worth noting that CA is better understood as a personality trait rather than an immersive state since the instrument used to measure CA questions general experiences of using software rather than any particular experience. These differing approaches within and across domains create a certain level of confusion as to what exactly is immersion, whether or not it is a common experience of gamers, or whether it is so different from related constructs. In an attempt to classify immersion Brown and Cairns (2004) investigated gamers own understandings of immersion using grounded theory (Strauss & Corbin, 1998). The theory supported immersion as the degree of involvement with a computer game and also identified barriers that could limit the degree of involvement. These barriers arose from a combination of human, computer and contextual factors. The type of barrier sug-
2 gested different levels of immersion which were dubbed engagement, engrossment and total immersion. This last, most involved state was equated by the gamers to a sense of presence, which may overlap with the virtual reality concept or even flow, in achieving an optimal state although total immersion may be more fleeting and be mediated by negative elements such as guilt. Given that gamers are able to identify immersion for themselves but that the concept is currently rather under-defined, the aim of this paper is to consider player s subjective experiences of immersion and to attempt to relate these to more quantitative, objective measures. The first study is founded on the premise that if a person becomes present in some alternative game world then there may be some measurable effect on their return to the real world. That is, in transferring from a game task to a real world task, the real world task performance could be impaired in proportion to the degree of immersion. The study does seem to indicate that this is the case but, as will be discussed, it is not clear what aspect of immersion is causing the effect and therefore whether it is immersion per se that is being measured by the real world task performance. The second part of the paper therefore considers other types of objective measures and hypotheses about how they relate to immersion. Experiment on Immersion Overview of the experiment The goal of this experiment is to relate the experience of immersion to a more objective measure. Immersion is measured with a questionnaire based on previous work and the more objective measure is the time taken to complete a task. In order to manipulate immersion, there are two conditions: in the control condition participants perform a simple button clicking activity and in the experimental condition the participants play the opening section of a first-person shooter, Half-Life. The task is intended to require both cognitive effort and be physically based so that the participants really do have to switch from the game world into the physical, real world in order to complete the task. The task chosen was a tangram task. These can be quite challenging and many people have not seen tangrams before. Thus, participants completed the task both before and after the game/control task so as to reduce the effect that novelty might have in impairing their ability to do the tangram. Hypotheses The main measures in the experiment were the subjective level of immersion as measured by a questionnaire of 32 questions, the time taken to complete the task before the experimental activity and the time taken to complete the task after the experimental activity. Naturally we expect the time to complete the task the second time to be quicker than the first time. However, immersion should interfere with the process. Accordingly, the hypotheses are: 1. The level of immersion in playing the game will be Figure 1: A screenshot from Half Life higher than the level of immersion in the control activity 2. The improvement in task performance (as measured by task completion time) will be less in the experimental condition than in the control condition. Method Participants Forty participants, all students from a London University took part in this study, with an average age of 21 (SD= 3.51), ranging from 18 to 36 years. Ten were male and thirty female. Computer game and control task In the experimental condition, participants played HALF LIFE, a 3- Dimensional First person shooter game on a Dell Inspiron Laptop. This game resembles the format of virtual reality games, see Figure 1, which according to Slater et al. (1994) is the only interface capable of generating presence. Participants first played the hazard training course which required players to train their character through a series of tasks enabling them to become familiar with all the controls. The hazard training course gives participants maximum possible sense of control and autonomy, by gradually introducing controls to the participant within the game environment, whilst still maintaining a sense of purpose: to complete the course. The hazard training course takes between 10 and 15 minutes to complete depending on the skill of the player. Participants could begin the actual game once they had completed the course or at any point when they felt comfortable to proceed further. All game configurations were displayed on a paper placed in front of participants so all controls were instantly accessible to them, causing minimum disruption whilst playing. The control task was designed to be as minimally engaging as possible, whilst still being interactive with a computer interface. This was to demonstrate whether it was the computer game that created a sense of immersion or any form of computer interaction. The simple program was developed on Visual Basic 6.0, which presents a series of squares that appear and disappear in a regular pattern, as in Figure 2. It was again per-
3 Figure 2: The Control Task formed on a Dell Inspiron laptop. Participants respond to the squares by clicking on them with the left mouse key when they appear, the square then disappears and reappears elsewhere on the screen. The squares appear at any point on an invisible 9 by 9 grid, for which the coordinates were generated randomly, to create the pattern that they would follow. Immersion questionnaire The questionnaire is developed from findings of previous studies into related areas. Included are Agarwal and Karahanna s (2000) five dimensions of CA, these areas are: temporal dissociation; focused immersion; heightened enjoyment; control; curiosity. However, unlike the standard CA questions, these questions relate to the particular experience of the given task rather than general experience of using software. Other questions were also derived from Brown and Cairns (2004) study, namely: emotional involvement (empathizing with a game s purpose or characters, wanting to speak out loud to the game, suspense about the games events), transportation to a different place (how far was disbelief about the game was suspended and how far participants felt that they were no longer attached to the real world), attention, ( distractibility by other thoughts, awareness of external events), control and autonomy (ease of controls, using the controls as traveling somewhere and interacting with a world). Two questionnaires were developed, with two pairs (positive and negative version) of related questions developed for each target area. These were then counterbalanced so that both questionnaires contained a question from each pair. In the control task, the questionnaire was exactly the same, except the word game was replaced with task. The questionnaire asked how far participants agreed with statements describing their possible experiences before they were interrupted. Answers for each question were marked on a five point scale: disagree, partially disagree, neither agree/disagree, partially agree, agree, where 1 is disagree and 5 is agree. Tangram task In principle the tangram task was selected as a task centred in and engaging with the real world as much as possible; which could contrast with the computer game (or task) world. If there is a tran- Figure 3: Tangram pieces arranged as a square sition period just after breaking out of immersion as one re-engages with the real world, then the tangram task should cause the transition to take place. Assuming this transition period is prolonged by an increased level of immersion, this would imply that the time taken for an individual to complete the tangram task would reflect the extent to which that individual was immersed. The tangram task was chosen for both its cognitive and physical elements. A solution can only be achieved by moving pieces, Figure 3, around physically in the real world, and seeing the way in which shapes relate to each other. Though a solution could be achieved by purely reflecting on the task, the participants would still have to manipulate pieces to present the solution. Also, if participants do start to move pieces around, the positioon of pieces can be used to indicate partial solutions in the manner of distributed cognition ToDo: Ref. Participants are therefore required to directly engage physically and mentally in the real world and the physical engagement can aid in achieving the task. Numerous tangram figures can be generated from tangram shapes, all of varying difficulty. Pre-tests were conducted to select an appropriate figure for construction that would be appropriately challenging and take a modest amount of time to complete. This would avoid swamping the transition time with problem solving ability or motivation. The final figure chosen, a fox as in Figure 4, took on average four minutes to complete in the pre-testing. Procedure The basic structure of the procedure is that participants are given the tangram task to do first, they then perform either the control or experimental task for ten minutes when they are interrupted to fill in the immersion questionnaire. They then continue for a further ten minutes when they carry out the tangram task for a second time. The details are as follows. Before beginning the computer game or task, participants were first presented with the tangram task that
4 Figure 4: The fox figure they would then re-perform after the computer task. This involved constructing the tangram figure from the tangram shapes. Pilots demonstrated that tangram task performance is affected by familiarity with tangrams so how the pieces can be used was demonstrated to give the participants some idea of what was required. When presented with the tangram task at the beginning of the experiment, the tangram pieces were arranged into a square in front of participants, to give them an insight into how the pieces can be rotated and aligned to form new figures. From the square, participants were presented with the fox figure, which they were told they had to construct by rearranging the square to make the new figure. It should be noted that the fox figure shown participants was not quite like Figure 4 in that the white lines outlining the pieces were omitted. The time taken for participants to construct the new figure was recorded. Participants were told that they would return to the tangram task later. Participants were then presented with the computer game or task, depending on if they had been assigned to the control or experimental condition. When presented with the computer game, participants were introduced to the game s purpose and explained its format. The first essential movement controls were demonstrated to them and they were then told that the rest of the controls they would need were on the paper in front of them. Participants first played the hazard training course but could move straight to the game at any point. This allowed participants to control their own development through the game, reducing the barrier of access (Brown and Cairns, 2004) which is affected by interest, investment and usability of controls. Therefore less advanced players were not overwhelmed by difficult controls and more advanced players would not be bored by over-simplicity. It also avoided any external interruptions not part of the world created by the game. Participants given the control task were told that they would have to follow a square that would appear and reappear elsewhere on the screen once they responded to it by pressing it. In order to minimally engage participants, they were also told to be as accurate as possible whilst playing. Participants were told that they would have to perform the computer game or control task, for ten minutes after which time they would be interrupted. The warning avoids startling participants and so the interruption has less impact on the task in hand (Trafton et al, 2003). After ten minutes of engaging with the task, participants were interrupted and made to fill in the immersion ratings questionnaire. Basing their responses on the moment just prior to interruption, participants rated how far their own experiences matched with those described in the questionnaire. Participants then resumed the game or task, again they were warned that they would be stopped after ten minutes, following which participants were made to return to the tangram task. On the second attempt, the tangram square was preconstructed from which they were made to reconstruct the tangram figure made earlier, the time taken to do so was recorded. Participants were not questioned on immersion at the same time as doing the task as either the questioning before the task would result in loss of the effect of immersion and questioning after the task may mean that their experience of immersion is moderated by their ability to do the task. Results The immersion scores were calculated based on 0 for a strongly disagree to an immersion question and 4 for strongly agree. This was also adjusted appropriately for positive or negative version of the immersion questions. As predicted in the first hypothesis, the experimental mean was higher than the control mean: 69.6 and 52.5 respectively (and corresponding standard deviations of 18.2 and 17.2). As there was no requirement on the immersion scores to be normal, these were compared non-parametrically and found to be significantly different (Mann Whitney U = 96, p = 0.005). As it happened, the data across both conditions did fit well with a normal distribution and the corresponding t-test gave identical probabilities. To test for the effect of immersion on task performance, the difference between the pre-test and post-test times was found. As expected, apart from two participants, the time to complete the task the second time was less than the first time. It is not clear why these two participants failed to improve their task time so they were not included in all subsequent analysis. The hypothesis predicts that the more immersed a person is, the smaller the difference between the two task times. As the experimental and control conditions should only affect immersion, the differences and immersion scores were corre-
5 lated across both conditions and a significant correlation was found (Spearman s ρ = 0.45, p = 0.003). That is, as predicted, the time difference is less the greater the immersion. Using regression to consider the effect size, a one point change in immersion corresponded to a 4.2s reduction in the time difference. Thus, the effect is appreciable on the range of immersion scores found in this study. Surprisingly, when divided into the two conditions, the correlation between immersion and task time difference was not significant in the control condition. The second tangram task completion times between the two conditions were also compared but again there was no significant difference. Discussion The hypotheses of the experiment are supported by the results of the experiment. The relationship between task time change and immersion score only appears to exist in the experimental condition, it demonstrates that a proportion of variability in time change in the experimental condition can be accounted for by variability in immersion score, but not in the control condition. The results suggest that being increasingly immersed in a game decreased one s ability to reengage with the real world, supporting to some extent the idea of a transitional period between coming out of immersion in the world of the game, and returning to the real world. This effect however is not observed in the simple computer task, perhaps because any immersive effects are diluted by other factors unaccounted for by the model. It also suggests that the computer game enabled a higher level of immersion to be reached and potentially have a greater impact on performance. The immersion score obtained in the experimental condition was significantly higher compared to that of the control condition. The questionnaire was generally successful in obtaining an immersion score, and demonstrated normal distributions in the level of immersion reached in either of the two conditions. Another interpretation of the second hypothesis would be that, due to lower immersion, the control condition task time differences should be higher than the experimental condition s. However, this was not found. Thus, the effects observed by the computer game may be due to other unknown factors which have influenced task performance on the tangram task and that also correlated with the immersion questionnaire. The experiment also has some unsatisfactory features. Whilst immersion and the second task attempt are performed at separate times for a good reason, it is still possible that the immersion at the end of the playing experience is not the same as the point at which it was measured. Also, the very interruption used to measure immersion may lead to reduced immersion in the remainder of the experimental activity. The task also still takes quite a long time. The average task completion time in the second condition was still 61s and a standard deviation of 33s. It is not clear if any effect of immersion could be considered to be present after a minute of working on the task. Thus, perhaps what is being measured is more about how much learning has gone on from the first time to the second time the task is done. Immersion may be interfering with the mulling over of the tangram task which may explain why it is having an effect in the experimental condition but no effect in the control condition as in the latter there is plenty of time for consideration. To help address some of these concerns, a second experiment was devised with a cube arranging task as the intended way to objectively measure immersion. The idea was that the time at which different cube arrangements were generated would give a cross section of times as the participants emerged from an immersed state. However, this task whilst cognitively demanding in the long run showed no differences between participants in the first few arrangements. This suggests that the experimental task is highly interlinked in finding this sort of world transition effect but without a better knowledge of immersion justifying which tasks are best to use may be post hoc and convenient rather than rigorous and insightful. Thus, whilst this experimental approach offers hope that some sort of objective measure of immersion is feasible, it is clear that there are many problems in setting up a dual task situation of this sort. Instead, we turn to consider non-intrusive measures that can be taken during an immersive activity, namely eye-tracking and body motion. Exploring eye-tracking and body motion during games Eye-tracking has become an increasingly popular methodology for measuring attention, and with recent developments in technology it is becoming increasingly reliable too. In the past eye-tracking has been used to analyse how people read, perceive scenery, artwork, and films (Duchowski, 2003). Recently, eye-tracking has also been used to investigate how people perceive websites (Silva & Cox, 2006) and attentional paradigms such as inattentional blindness (Koivisto, Hyona & Revonsuo, 2004; Memmert, 2006; Pappas et al, 2005) and change blindness (Hollingworth, Williams & Henderson, 2001; Triesch et al. 2003). However, when it comes to how people perceive computer games, very little is known. In Brown & Cairns (2004), gamers described total immersion as you feel like you re there and when you stop thinking about the fact that you re playing a computer game and you re just in a computer. These quotes strongly suggest that gamers actually feel as if they are viewing a real scene when they are immersed. In a review of eye-tracking studies investigating scene perception, Rayner (1998) reports that the gist of a static scene is extracted from the first few fixations, and then the remainder of the fixations are more focused on particular objects, to fill in the details. Similarly, in the attention literature Styles (1997) reviews a number of studies and suggests that visual attention can be compared to a zoom lens: initially attention is widely distributed over all el-
6 ements of the display, but then attention is narrowed down and becomes more fixed. However, whereas the scenes talked about in this past literature are static, in a computer game the scene is always changing (like real life). Therefore, rather than eye movements becoming more fixed as time progresses one might predict that as a gamer becomes more immersed in the game and attempts to take in the whole scene while meeting the demands of the task eye movements will increase. In contrast, for a non-immersive game one might predict that an individual s eye movements will decrease over time; not necessarily because the person is focusing in on the task but because they are more likely to drift off as they become bored. As well as eye movements, bio-physical sensors and non-verbal expressions provide an alternative, nonintrusive source of information on the cognitive and affective state of the user. While quite a few studies have focused on the use of bio-physical sensors (Ravaja et al, 2005), very little attention has been given to posture despite ample evidence that it provides a very reliable window on the affective states of the user. De Silva and Berthouze (2003) and Coulson (2004) for example reported very high classification rates for human subjects recognizing emotions from body postures of avatars, either from ad-hoc body postures or avatars postures reconstructed from human motion data. Moreover, Berthouze and Kleinsmith (2003) demonstrated that a simple kinematic description of the posture was sufficient to automatically construct a classification model for affective postures. More directly related to the states of interest for gaming, Mota and Picard (2003) showed how postural information detected by pressure sensors mounted on a chair provided information pertaining to the levels of interest in students. We therefore believe that motion-capture and in particular, postural information, might provide us with interesting ways in which to measure the degree of immersion experienced. Posture may also integrate well with eye-tracking. Indeed, as pointed out by Gibson (1986), one sees the environment not with the eyes but with the eyes-in-thehead-on-the-body-resting-on-the-ground and therefore constraints imposed on body postures by the affective state, or the cognitive load, of the user also impose constraints on how the gamer (actively) perceives the gaming environment. For instance, Sennersten s (2004) study of eye fixations during an action game suggests as much when it reports a significant disparity between observed behaviour and reported behaviour. While subjects reported getting salient information from looking at the face of the visual stimulus, fixations revealed a much greater focus on body areas which was more consistent with the physical constraints of the game, such as, the fact that time pressure results in a head-down posture. Hypotheses on eyetracking, body motion and immersion Given the potential offered by eyetracking and body movement, we propose here hypotheses that builds on the first experiment in trying to find objective measures of the degree of immersion experienced by people as they play games. The hypotheses address these ideas by considering participants changes in eye movement and body motion while they engage in either the immersive or non-immersive task. The immersion questionnaire used above will still be used to assess the validity of these behavioural measures in relation to immersion. For example, one might predict that participants who exhibit changes in eye movements associated with immersion should have higher self-reported ratings of immersion than participants that did not exhibit such changes in eye movements. In an another attempt to test the validity of the behavioural measures, it is predicted that participants that have high ratings of absorption or openness to experience (two personality traits closely related to immersion) will exhibit eye movements and body movements associated with immersion sooner and for a longer period of time than participants that have low ratings of absorption or openness to experience. Overall, the proposed study has four main hypotheses: 1. Participants in an immersive condition will show a greater increase in the number of fixations and saccades, and a greater decrease in fixation length, than participants in a non-immersive condition. 2. Participants in an immersive condition will exhibit body motions that are different to the body motions exhibited by participants in a non-immersive condition. 3. Subjective self-reported immersion ratings will correlate with these objective behavioural measures of immersion. We are currently running an experiment to test these hypotheses and we hope to report the first analyses of our data at the workshop. Acknowledgments The authors would like to thank UCLIC for supporting Charlene Jennett. References Agarwal, R., & Karahanna, E. (2000). Time flies when you re having fun: Cognitive Absorption and beliefs about information technology usage. MIS Quarterly, 24(4), Bianchi-Berthouze, N. & Kleinsmith, A. (2003). A categorical approach to affective gesture recognition. Connection Science, 15 (4), Brown, E., & Cairns, P. (2004). A grounded investigation of game immersion. CHI 2004, ACM Press, Cairns, P., Cox, A., Dhoparee, S., Hong, R. & Jennett, C. (under review). Investigating Immersion: transferring the positive experience of playing games. Coomans, M.K.D., & Timmermanns, H.J.P. (1997). Towards a Taxonomy of Virtual reality user interfaces.
7 International conference on information visualisation (IV97), London. Coulson M. (2004). Attributing emotion to static body postures: recognition accuracy, confusions, and viewpoint dependence, Journal of Nonverbal Behavior,28(2), Czikszentmihalyi, M. (1990). Flow: ThePsychology of Optimal Experience. Harper and Row: New York. Duchowski, A. T. (2003). Eye Tracking Methodology. Springer-Verlag London Ltd. Gibson, J.J. (1986). The Ecological Approach to Visual Perception, Mahwah, NJ:Erlbaum. Hollingworth, A., Williams, C. C. & Henderson, J. M. (2001). To see and remember: visually specific information is retained in memory from previously attended objects in natural scenes. Psychonomic Bulletin and Review, 8 (4), Koivisto, M., Hyona, J. & Revonsuo, A. (2004). The effects of eye movements, spatial attention, and stimulus features on inattentional blindness. Vision Research, 44, Memmert, D. (2006). The effects of eye movements, age and expertise on inattentional blindness. Consciousness and Cognition in press. Menetta, C., & Blade, R.A. (1998). Glossary of Virtual Reality Terminology. International Journal of Virtual Reality, Mota S, & Picard R. (2003). Automated posture analysis for detecting Learner s Interest Level. IEEE Workshop on Computer Vision and Pattern Recognition for Human Computer Interaction, Madison, Wisconsin. Pappas, J., Fishel, S., Moss,J., Hicks, J. & Leech, T (2005). An Eye-Tracking Approach to Inattentional Blindness, Proc. of the Human Factors and Ergonomics Society, September 26 30, 2005, Orlando. Radford A., (2000). Games and Learning about Form in Architecture. Automation in Construction, 9, Ravaja, N., Saari, T., Laarni, J., Kallinen, K., Salminen, M., Holopainen, J. & Järvinen, A. (2005). The Psychophysiology of Video Gaming: Phasic Emotional Responses to Game Events. International DIGRA Conference Rayner, K. (1998). Eye movements in reading and information processing: 20 years of research. Psychological Bulletin, 124 (3), Schubert, T. & Crusius, J. (2002). Five theses on thebook problem: Presence in books, film and VR. In Fifth Annual International Workshop on Presence, Porto, Portugal Sennersten, C. (2004). Eye movements in an Action Game Tutorial. Technical report, Department of Cognitive Science, Lund University, Sweden Studentpapers/CharlotteSennersten.pdf de Silva, P.R. & Bianchi-Berthouze, N. (2004). Modeling human affective postures: An in-formation theoretic characterization of posture features. Journal of Computer Animation and Virtual Worlds, 15, Silva, M.M. & Cox, A.L. (2006). What have eye movements told us so far and what is next? Workshop in Proc. of the 28th Annual Meeting of the Cognitive Science Society, Vancouver, Canada. Slater, M., & Steed, A., (2000). A Virtual Presence Counter. ztextitpresence, 9(5), Slater, M., Usoh, M., & Steed, A. (1994). Depth of presence in virtual enviromnetas. Presence, Teleoperators and Virtual Environments 3(2), Strauss, A. & Corbin, J. (1998) Basics of Qualitative Research: Techniques and Procedures for Developing Grounded Theory, Sage Publications. Trafton,J.G., Altmann, E.M., Brock, D.P. & Mintz, F. (2003). Preparing to resume an interrupted task: effects of prospective goal encoding and retrospective rehearsal. Int. J. of Human-Computer Studies, 58, Treisch, J. T., Ballard, D. H., Hayhoe, M. M. & Sullivan, B. T. (2003). What you see is what you need. Journal of Vision, 3, TTLG (2005). The last (Xbox) Thief3 preview you will ever need to read. Watson, D., Clark, L.A., & Tellegen, A., (1988). Development and validation of brief measures of positive and negative affect: The PANAS scales. J. of Personality and Social Psychology, 54(6), Witmer, B., G., & Singer, M.J. (1998). Measuring presence in virtual environments: A presence questionnaire. Presence, Teleoperators and Virtual Environments, 7(3),
Measuring and Defining the. Experience of Immersion in Games
Measuring and Defining the Experience of Immersion in Games Charlene Jennett UCL Interaction Centre Anna L. Cox UCL Interaction Centre Paul Cairns Dept of Computer Science, University of York Samira Dhoparee
PERSPECTIVE. How Top-Down is Visual Perception?
PERSPECTIVE How Top-Down is Visual Perception? featuring new data (VSS Poster): Attentional Cycles in Detecting Simple Events within Complex Displays Sunday PM Poster #36.301, VSS 2014 Thomas Sanocki,
Tracking translation process: The impact of experience and training
Tracking translation process: The impact of experience and training PINAR ARTAR Izmir University, Turkey Universitat Rovira i Virgili, Spain The translation process can be described through eye tracking.
Chapter 2 Quantitative, Qualitative, and Mixed Research
1 Chapter 2 Quantitative, Qualitative, and Mixed Research This chapter is our introduction to the three research methodology paradigms. A paradigm is a perspective based on a set of assumptions, concepts,
Program Visualization for Programming Education Case of Jeliot 3
Program Visualization for Programming Education Case of Jeliot 3 Roman Bednarik, Andrés Moreno, Niko Myller Department of Computer Science University of Joensuu [email protected] Abstract:
Design Analysis of Everyday Thing: Nintendo Wii Remote
1 Philip Stubbs Design Analysis of Everyday Thing: Nintendo Wii Remote I. Introduction: Ever since being released in November 2006, the Nintendo Wii gaming system has revolutionized the gaming experience
Observing and describing the behavior of a subject without influencing it in any way.
HOW TO CHOOSE FROM THE DIFFERENT RESEARCH METHODS* The design is the structure of any scientific work. It gives direction and systematizes the research. The method you choose will affect your results and
The Relationship between the Fundamental Attribution Bias, Relationship Quality, and Performance Appraisal
The Relationship between the Fundamental Attribution Bias, Relationship Quality, and Performance Appraisal Executive Summary Abstract The ability to make quality decisions that influence people to exemplary
NON-PROBABILITY SAMPLING TECHNIQUES
NON-PROBABILITY SAMPLING TECHNIQUES PRESENTED BY Name: WINNIE MUGERA Reg No: L50/62004/2013 RESEARCH METHODS LDP 603 UNIVERSITY OF NAIROBI Date: APRIL 2013 SAMPLING Sampling is the use of a subset of the
WMS III to WMS IV: Rationale for Change
Pearson Clinical Assessment 19500 Bulverde Rd San Antonio, TX, 28759 Telephone: 800 627 7271 www.pearsonassessments.com WMS III to WMS IV: Rationale for Change Since the publication of the Wechsler Memory
Research Methods & Experimental Design
Research Methods & Experimental Design 16.422 Human Supervisory Control April 2004 Research Methods Qualitative vs. quantitative Understanding the relationship between objectives (research question) and
New Jersey Core Curriculum Content Standards for Visual and Performing Arts INTRODUCTION
Content Area Standard Strand By the end of grade P 2 New Jersey Core Curriculum Content Standards for Visual and Performing Arts INTRODUCTION Visual and Performing Arts 1.4 Aesthetic Responses & Critique
A qualitative examination of online gambling culture among college students: Factors influencing participation, maintenance and cessation
A qualitative examination of online gambling culture among college students: Factors influencing participation, maintenance and cessation R I N A G U P T A, J E F F D E R E V E N S K Y & M I C H A E L
CALCULATIONS & STATISTICS
CALCULATIONS & STATISTICS CALCULATION OF SCORES Conversion of 1-5 scale to 0-100 scores When you look at your report, you will notice that the scores are reported on a 0-100 scale, even though respondents
Constructing a TpB Questionnaire: Conceptual and Methodological Considerations
Constructing a TpB Questionnaire: Conceptual and Methodological Considerations September, 2002 (Revised January, 2006) Icek Ajzen Brief Description of the Theory of Planned Behavior According to the theory
IMPLEMENTING BUSINESS CONTINUITY MANAGEMENT IN A DISTRIBUTED ORGANISATION: A CASE STUDY
IMPLEMENTING BUSINESS CONTINUITY MANAGEMENT IN A DISTRIBUTED ORGANISATION: A CASE STUDY AUTHORS: Patrick Roberts (left) and Mike Stephens (right). Patrick Roberts: Following early experience in the British
Usability metrics for software components
Usability metrics for software components Manuel F. Bertoa and Antonio Vallecillo Dpto. Lenguajes y Ciencias de la Computación. Universidad de Málaga. {bertoa,av}@lcc.uma.es Abstract. The need to select
A DESIGN AND DEVELOPMENT OF E-LEARNING CONTENT FOR MULTIMEDIA TECHNOLOGY USING MULTIMEDIA GAME
A DESIGN AND DEVELOPMENT OF E-LEARNING CONTENT FOR MULTIMEDIA TECHNOLOGY USING MULTIMEDIA GAME Thongchai Kaewkiriya Faculty of Information Technology, Thai-Nichi Institute of Technology, Bangkok, Thailand
Fundamentals Explained
Fundamentals Explained Purpose, values and method of Scouting Item Code FS140099 July 13 Edition no 2 (103297) 0845 300 1818 Fundamentals Explained This document contains detailed information on Fundamentals
CELL PHONE INDUCED PERCEPTUAL IMPAIRMENTS DURING SIMULATED DRIVING
CELL PHONE INDUCED PERCEPTUAL IMPAIRMENTS DURING SIMULATED DRIVING David L. Strayer, Frank A. Drews, Robert W. Albert, and William A. Johnston Department of Psychology University of Utah Salt Lake City,
Evaluating Survey Questions
Evaluating Survey What Respondents Do to Answer a Question Chase H. Harrison Ph.D. Program on Survey Research Harvard University Comprehend Question Retrieve Information from Memory Summarize Information
Association Between Variables
Contents 11 Association Between Variables 767 11.1 Introduction............................ 767 11.1.1 Measure of Association................. 768 11.1.2 Chapter Summary.................... 769 11.2 Chi
3D Interactive Information Visualization: Guidelines from experience and analysis of applications
3D Interactive Information Visualization: Guidelines from experience and analysis of applications Richard Brath Visible Decisions Inc., 200 Front St. W. #2203, Toronto, Canada, [email protected] 1. EXPERT
Statistical tests for SPSS
Statistical tests for SPSS Paolo Coletti A.Y. 2010/11 Free University of Bolzano Bozen Premise This book is a very quick, rough and fast description of statistical tests and their usage. It is explicitly
High School Psychology and its Impact on University Psychology Performance: Some Early Data
High School Psychology and its Impact on University Psychology Performance: Some Early Data John Reece Discipline of Psychology School of Health Sciences Impetus for This Research Oh, can you study psychology
Extend Table Lens for High-Dimensional Data Visualization and Classification Mining
Extend Table Lens for High-Dimensional Data Visualization and Classification Mining CPSC 533c, Information Visualization Course Project, Term 2 2003 Fengdong Du [email protected] University of British Columbia
V1.0 - Eurojuris ISO 9001:2008 Certified
Risk Management Manual V1.0 - Eurojuris ISO 9001:2008 Certified Section Page No 1 An Introduction to Risk Management 1-2 2 The Framework of Risk Management 3-6 3 Identification of Risks 7-8 4 Evaluation
Behavior Rating Inventory of Executive Function - Adult Version BRIEF-A. Interpretive Report. Developed by
Behavior Rating Inventory of Executive Function - Adult Version BRIEF-A Interpretive Report Developed by Peter K. Isquith, PhD, Robert M. Roth, PhD, Gerard A. Gioia, PhD, and PAR Staff Client Information
Appendix B Data Quality Dimensions
Appendix B Data Quality Dimensions Purpose Dimensions of data quality are fundamental to understanding how to improve data. This appendix summarizes, in chronological order of publication, three foundational
Job Design from an Alternative Perspective
Job Design from an Alternative Perspective Paula W. Potter Western Kentucky University Abstract The purpose of this paper is to explore a theoretical aspect of job design in a way that departs from the
The effects of beliefs about language learning and learning strategy use of junior high school EFL learners in remote districts
The effects of beliefs about language learning and learning strategy use of junior high school EFL learners in remote districts ABSTRACT Ching-yi Chang Leader University, Taiwan Ming-chang Shen Leader
Unit 3: Acting Skills
Unit 3: Acting Skills Level: 1 and 2 Unit type: Optional specialist Guided learning hours: 60 Assessment type: Internal Unit introduction Do you know what kind of training every actor needs in order to
Research Investments in Large Indian Software Companies
Research Investments in Large Indian Software Companies Pankaj Jalote Professor, Department of Computer Science and Engineering Indian Institute of Technology Kanpur, India 208016 [email protected], www.cse.iitk.ac.in/users/jalote
Written Example for Research Question: How is caffeine consumption associated with memory?
Guide to Writing Your Primary Research Paper Your Research Report should be divided into sections with these headings: Abstract, Introduction, Methods, Results, Discussion, and References. Introduction:
Restorative Parenting: A Group Facilitation Curriculum Activities Dave Mathews, Psy.D., LICSW
Restorative Parenting: A Group Facilitation Curriculum Activities Dave Mathews, Psy.D., LICSW RP Activities 1. Framework of Resourcefulness 2. Identifying the Broken Contract Articles 3. The Process of
Reading with Mobile Phone & Large Display
Reading with Mobile Phone & Large Display Roswitha Gostner Computing Department Lancaster University, [email protected] Hans Gellersen Computing Department Lancaster University Lancaster, LA1 4WY, UK
Joseph Fordham. Kuo-Ting Huang. Corrie Strayer. Rabindra Ratan. Michigan State University
Running head: GIRLS GETTING PLAYED 1 Girls getting played: Video game stereotype effects on gendered career perceptions Joseph Fordham Kuo-Ting Huang Corrie Strayer Rabindra Ratan Michigan State University
Shell Mentoring Toolkit
Shell Mentoring Toolkit A reference document for mentors and mentees Human Resources LEARNING 25/07/2007 Copyright: Shell International Ltd 2006 CONTENTS What is Mentoring? 4 The Mentor s Role The Role
Learning theories Judy McKimm
Learning theories Judy McKimm There has been a lot of research into the way people learn and certain theories have been influential on developments in all areas of education, but particularly in adult
Studying the contextual cues associated with fear of crime through eye tracking techniques
Studying the contextual cues associated with fear of crime through eye tracking techniques Inês Guedes 1, Pedro Fernandes 2 & Carla Cardoso 1 1 School of Criminology, Faculty of Law, University of Porto
TAXREP 01/16 (ICAEW REP 02/16)
TAXREP 01/16 (ICAEW REP 02/16) January 2016 ICAEW research survey: HMRC Customer Service Standards 2015 Results of the ICAEW 2015 research survey among ICAEW smaller agents about HMRC service standards.
METHODOLOGIES FOR STUDIES OF PROGRAM VISUALIZATION
Full paper ABSTRACT METHODOLOGIES FOR STUDIES OF PROGRAM VISUALIZATION Niko Myller & Roman Bednarik Department of Computer Science University of Joensuu PO Box 111, FI-80101 [email protected]
History of eye-tracking in psychological research
History of eye-tracking in psychological research In the 1950s, Alfred Yarbus showed the task given to a subject has a very large influence on the subjects eye movements. Yarbus also wrote about the relation
Motivations for Volunteering with Youth-Oriented Programs
Motivations for Volunteering with Youth-Oriented Programs A REPORT Harold A. Riemer, Kim D. Dorsch, and Larena Hoeber University of Regina David M. Paskevich University of Calgary Packianathan Chelladurai
COMPETENCY ACC LEVEL PCC LEVEL MCC LEVEL 1. Ethics and Standards
ICF CORE COMPETENCIES RATING LEVELS Adapted from the Minimum Skills Requirements documents for each credential level (Includes will-not-receive-passing-score criteria- gray background) COMPETENCY ACC LEVEL
The Role of Reactive Typography in the Design of Flexible Hypertext Documents
The Role of Reactive Typography in the Design of Flexible Hypertext Documents Rameshsharma Ramloll Collaborative Systems Engineering Group Computing Department Lancaster University Email: [email protected]
Teaching Methodology for 3D Animation
Abstract The field of 3d animation has addressed design processes and work practices in the design disciplines for in recent years. There are good reasons for considering the development of systematic
To Virtualize or Not? The Importance of Physical and Virtual Components in Augmented Reality Board Games
To Virtualize or Not? The Importance of Physical and Virtual Components in Augmented Reality Board Games Jessica Ip and Jeremy Cooperstock, Centre for Intelligent Machines, McGill University, Montreal,
Problem of the Month: Fair Games
Problem of the Month: The Problems of the Month (POM) are used in a variety of ways to promote problem solving and to foster the first standard of mathematical practice from the Common Core State Standards:
To answer the secondary question, if hands-on activities would increase student interest and comprehension, several hands-on activities were used:
1 The Effect of an Overarching Topic on Student Performance in Algebra II Christine Consoletti and David Collins J.E.B. Stuart High School Fairfax County (VA) Public Schools June 2003 Question Does an
THE EFFECT OF MATHMAGIC ON THE ALGEBRAIC KNOWLEDGE AND SKILLS OF LOW-PERFORMING HIGH SCHOOL STUDENTS
THE EFFECT OF MATHMAGIC ON THE ALGEBRAIC KNOWLEDGE AND SKILLS OF LOW-PERFORMING HIGH SCHOOL STUDENTS Hari P. Koirala Eastern Connecticut State University Algebra is considered one of the most important
Counting Money and Making Change Grade Two
Ohio Standards Connection Number, Number Sense and Operations Benchmark D Determine the value of a collection of coins and dollar bills. Indicator 4 Represent and write the value of money using the sign
User research for information architecture projects
Donna Maurer Maadmob Interaction Design http://maadmob.com.au/ Unpublished article User research provides a vital input to information architecture projects. It helps us to understand what information
Current Situations and Issues of Occupational Classification Commonly. Used by Private and Public Sectors. Summary
Current Situations and Issues of Occupational Classification Commonly Used by Private and Public Sectors Summary Author Hiroshi Nishizawa Senior researcher, The Japan Institute for Labour Policy and Training
An Overview of the Developmental Stages in Children's Drawings
Marilyn Zurmuehlen Working Papers in Art Education ISSN: 2326-7070 (Print) ISSN: 2326-7062 (Online) Volume 2 Issue 1 (1983) pps. 2-7 An Overview of the Developmental Stages in Children's Drawings Hufford
Poster presentation School Physical Education: From the eyes of students
Commissioned by PE Section, Curriculum Development Institute, Education Bureau Hosted by Department of Health and Physical Education, The Hong Kong Institute of Education Summer School for PE Teachers
ICF CORE COMPETENCIES RATING LEVELS
coachfederation.org ICF CORE COMPETENCIES RATING LEVELS Adapted from the Minimum Skills Requirements documents for each credential level Includes will-not-receive-passing-score criteria. COMPETENCY 1.
The National Arts Education Standards: Curriculum Standards <http://artsedge.kennedy-center.org/teach/standards/standards.cfm>
Discipline-Based Art Education: Theoretical Curriculum Model Discipline-Based Art Education (DBAE) is an approach to arts education developed and formalized in the early 1980s by the Getty Center for Arts
Degree in Art and Design
Subjects Summary Degree in Art and Design Fourth Year Semester ECTS Subject 1 12 Workshop on Applied Arts This practical subject focuses on mastering techniques, materials and the professions of artistic
Brain Training Influence. Cognitive Function Effectiveness. Boiron Labs
Brain Training Influence on Cognitive Function Effectiveness at Boiron Labs By Bernard Croisile (1), Gilles Reilhac (2), Sandrine Bélier (2), Franck Tarpin-Bernard (2) & Michel Noir (2) (1) Centre Mémoire
Publishing papers in international journals
Publishing papers in international journals I B Ferguson The Horticulture & Food Research Institute of New Zealand Private Bag 92169 Auckland New Zealand [email protected] 1. Introduction There
Using Feedback Tags and Sentiment Analysis to Generate Sharable Learning Resources
Using Feedback Tags and Sentiment Analysis to Generate Sharable Learning Resources Investigating Automated Sentiment Analysis of Feedback Tags in a Programming Course Stephen Cummins, Liz Burd, Andrew
How do you use word processing software (MS Word)?
How do you use word processing software (MS Word)? Page 1 How do you use word processing software (MS Word)? Lesson Length: 2 hours Lesson Plan: The following text will lead you (the instructor) through
0.75 75% ! 3 40% 0.65 65% Percent Cards. This problem gives you the chance to: relate fractions, decimals and percents
Percent Cards This problem gives you the chance to: relate fractions, decimals and percents Mrs. Lopez makes sets of cards for her math class. All the cards in a set have the same value. Set A 3 4 0.75
Microsoft PowerPoint Exercises 4
Microsoft PowerPoint Exercises 4 In these exercises, you will be working with your Music Presentation file used in part 1 and 2. Open that file if you haven t already done so. Exercise 1. Slide Sorter
International IPTV Consumer Readiness Study
International IPTV Consumer Readiness Study Methodology The Accenture International IPTV Study is based on structured telephone interviews using a standard questionnaire and quantitative analysis methods
When being a good lawyer is not enough: Understanding how In-house lawyers really create value
When being a good lawyer is not enough: Understanding how In-house lawyers really create value Contents Foreword... 3 Do you really understand how In-house lawyers create value?... 4 Why creating value
Correlational Research. Correlational Research. Stephen E. Brock, Ph.D., NCSP EDS 250. Descriptive Research 1. Correlational Research: Scatter Plots
Correlational Research Stephen E. Brock, Ph.D., NCSP California State University, Sacramento 1 Correlational Research A quantitative methodology used to determine whether, and to what degree, a relationship
Research Design and Research Methods
CHAPTER 3 Research Design and Research Methods Overview This chapter uses an emphasis on research design to discuss qualitative, quantitative, and mixed methods research as three major approaches to research
Subject specific vocabulary (version 2.0)
Subject specific vocabulary (version 2.0) The following subject specific vocabulary provides definitions of key terms used in our GCSE Dance specification (8236). Students should be familiar with and gain
APPLYING THE TECHNOLOGY ACCEPTANCE MODEL AND FLOW THEORY TO ONLINE E-LEARNING USERS ACCEPTANCE BEHAVIOR
APPLYING THE TECHNOLOGY ACCEPTANCE MODEL AND FLOW THEORY TO ONLINE E-LEARNING USERS ACCEPTANCE BEHAVIOR Su-Houn Liu, Chung Yuan Christian University, [email protected] Hsiu-Li Liao, Chung Yuan Christian
Grounded Theory. 1 Introduction... 1. 2 Applications of grounded theory... 1. 3 Outline of the design... 2
Grounded Theory Contents 1 Introduction... 1 2 Applications of grounded theory... 1 3 Outline of the design... 2 4 Strengths and weaknesses of grounded theory... 6 5 References... 6 1 Introduction This
National Disability Authority Resource Allocation Feasibility Study Final Report January 2013
National Disability Authority Resource Allocation Feasibility Study January 2013 The National Disability Authority (NDA) has commissioned and funded this evaluation. Responsibility for the evaluation (including
The Impact of Management Information Systems on the Performance of Governmental Organizations- Study at Jordanian Ministry of Planning
The Impact of Management Information Systems on the Performance of Governmental Organizations- Study at Jordanian Ministry of Planning Dr. Shehadeh M.A.AL-Gharaibeh Assistant prof. Business Administration
9.63 Laboratory in Visual Cognition. Single Factor design. Single design experiment. Experimental design. Textbook Chapters
9.63 Laboratory in Visual Cognition Fall 2009 Single factor design Textbook Chapters Chapter 5: Types of variables Chapter 8: Controls Chapter 7: Validity Chapter 11: Single factor design Single design
VOLUME MEASUREMENT AND CONSERVATION IN LATE PRIMARY SCHOOL CHILDREN IN CYPRUS
Introduction VOLUME MEASUREMENT AND CONSERVATION IN LATE PRIMARY SCHOOL CHILDREN IN CYPRUS Stamatis Voulgaris*, Anastasia Evangelidou** Primary School Teachers - *A.Vratsanou 31, Chios 82100, Greece **Evripidou
Descriptive Statistics
Descriptive Statistics Primer Descriptive statistics Central tendency Variation Relative position Relationships Calculating descriptive statistics Descriptive Statistics Purpose to describe or summarize
Simulations, Games and Experiential Learning Techniques:, Volume 1, 1974
EXPERIENTIAL LEARNING: CONCEPTUALIZATION AND DEFINITION 1 by J. Duane Hoover Texas Tech University Experiential learning is a highly qualitative concept, and cannot be received as a rigidly defined theory
see more think quicker play better Developing Game Awareness
Soccer eyeq see more think quicker play better Developing Game Awareness Soccer eyeq 2010 P a g e 2 Soccer eyeq 2010 All rights reserved. No part of this report may be reproduced in any manner without
Expectancy Value Theory: Motivating Healthcare Workers
Expectancy Value Theory: Motivating Healthcare Workers Stefania De Simone Researcher in Organizational Behavior Institute for Research on Innovation and Services for Development National Research Council
Center for Effective Organizations
Center for Effective Organizations HR METRICS AND ANALYTICS USES AND IMPACTS CEO PUBLICATION G 04-8 (460) EDWARD E. LAWLER III ALEC LEVENSON JOHN BOUDREAU Center for Effective Organizations Marshall School
Independent samples t-test. Dr. Tom Pierce Radford University
Independent samples t-test Dr. Tom Pierce Radford University The logic behind drawing causal conclusions from experiments The sampling distribution of the difference between means The standard error of
Hints and tips on how to get the most out of the performance. Book 4. Acting tips
Hints and tips on how to get the most out of the performance. Book 4 Acting tips Tips on how to introduce the show to the group, run workshops, explore the text, cast and organise the show. Before the
INTRODUCTION TO COACHING TEACHING SKILLS TEACHING/LEARNING. September 2007 Page 1
TEACHING SKILLS September 2007 Page 1 TEACHING SKILLS Being a teacher is one of the main roles a coach fulfils for their players. The ability to teach effectively, especially the technical skills of ice
Our Guide to Customer Journey Mapping
Our Guide to Customer Journey Mapping Our Guides Our guides are here to help you understand a topic or to provide support for a particular task you might already be working on. Inside you ll find lots
Long-term impact of childhood bereavement
Long-term impact of childhood bereavement Preliminary analysis of the 1970 British Cohort Study (BCS70) Samantha Parsons CWRC WORKING PAPER September 2011 Long-Term Impact of Childhood Bereavement Preliminary
Semi-structured interviews
Semi-structured interviews 3 rd December 2014 Prof. Edwin van Teijlingen BU Graduate School Aim of this session: introduce various ways of conducting interviews with qualitative methods; outline strength
Module 9. Building Communication Skills
Module 9 Building Communication Skills Essential Ideas to Convey To apply a facilitative approach to supervision, supervisors have to approach the people they manage in a different way, by using certain
Conceptualising and Modelling Virtual Experience for the Online Retailer: The 3D Technology
Conceptualising and Modelling Virtual Experience for the Online Retailer: The 3D Technology INTRODUCTION Previous studies (e.g., Jiang & Benbasat, 2005; Algharabat & Dennis, 2010 a, b, c) regarding online
July 2007. Management Practice & Productivity: Why they matter
July 2007 Management Practice & Productivity: Why they matter Nick Bloom Stanford University Stephen Dorgan McKinsey & Company John Dowdy McKinsey & Company John Van Reenen Centre for Economic Performance,
