header
vol. 18 no. 1, March, 2013


Multi-dimensional analysis of dynamic human information interaction


Minsoo Park
Korea Institute of Science and Technology Information, Seoul, Korea

Abstract
Introduction. This study aims to understand the interactions of perception, effort, emotion, time and performance during the performance of multiple information tasks using Web information technologies.
Method. Twenty volunteers from a university participated in this study. Questionnaires were used to obtain general background information and examine the research problem.
Analysis. The quantitative data were analysed using the Statistical Package for the Social Sciences (SPSS).
Results. The results of this study revealed that those with higher cognitive effort experienced more stress and frustration and higher temporal demand, resulting in lower performance, even though they spent more time finishing the information task. A high degree of temporal demand and negative emotional state led people to perform the task poorly even though they invested more mental effort on the task. Our feelings and emotions play a key role in our ability to deal with a situation where multiple information tasks need to be done within a certain time limit.
Conclusions. The results of this study can be employed as a theoretical foundation for designing human-friendly, adaptive user interfaces, which function as intelligent and affective central mechanisms and help users prioritise, monitor and coordinate their needs/tasks/goals effectively and efficiently. This study introduces the emotional factor, which is a newly emerging dimension, in dynamic information seeking and retrieval contexts and enlightens the existing areas of human information interaction.


Introduction

Our adaptation occurs from our ability to process information and modify our information behaviour accordingly (Morgan 2002). Since the advent of the Web, humans have lived in dynamic, volatile digital information environments. Due to the dynamism and complexity of the Web information environments, people are getting more involved in multiple information task behaviours (Waller 1997). Multiple task performance is an important human behaviour that allows people to manage complex situations by handling more than one task in an effective, coordinated way (Burgess 2000; Carlson and Sohn 2000; Lee and Taatgen 2002).

The Compact Oxford English Dictionary (2005) defines multiple task performance as the ability to perform concurrent tasks by interleaving. In cognitive science, the concept of multiple task performance is more complicated than interleaving tasks in a multiple task sense. The complex situations people face often demand further mental activities, such as prioritisations and planning (Burgess 2000).

Multiple task performance has been important in the research of cognitive science, engineering psychology, human computer interaction, and human factors (e.g., Damos 1991; Treisman 1960; Wickens 1989). Early studies in the literature of multiple task performance in cognitive science focused mainly on dichotic listening skills (e.g., Broadbent 1958; Treisman 1960), during which people were asked to listen to two simultaneous messages and shadow one. Later research has focused on both cognitive and motor task performance (e.g., Wickens 1989). According to Wickens researchers in multiple task performance include both task characteristics and coordination processes.

While some tasks can be easily performed concurrently, others compete for cognitive capacities (Wickens 2002; Wickens et al. 2003) and as a consequence, people need to efficiently prioritise and coordinate their tasks with appropriate efforts to accomplish each task successfully. The way in which task prioritisations, task characteristics, and mental effort (cognitive resources) are connected has not yet been explored in information seeking and retrieval contexts. Research on multiple information task interaction in humans in such contexts is necessary for a greater understanding of human information behaviour in dynamic and complex information environments.

Recent studies show that people often perform multiple information tasks while using Web information retrieval (IR) technologies and looking for information through more than one information task over multiple search episodes (Spink 2004; Spink et al. 2002). In an exploratory study of human multiple information task behaviour, Spink et al. (2006) found that information task prioritising processes were influenced by the following factors: level of interest, level of knowledge, perceived level of information available on the Web, level of difficulty, level of importance, and information seeking from general information problems to specific ones.

Multiple task performance has been an important area of study in cognitive science, engineering psychology, human computer interaction, and human factors, but human multiple information task interaction during information seeking and retrieval processes in the Web environment is under-explored.

The overall goal of this study is to explore the relationships of task demand, mental effort, affective state, temporal demand, and performance in the processes of prioritising and coordinating multiple information tasks in the contexts of seeking and retrieving information on the Web.

Literature review

Different theoretical approaches to attention suggest that psychologists are far from agreeing on how to explain the attentional phenomena. Just et al. (2001) defined attention as limited cognitive capacity that can be distributed over tasks, such as in divided attention tasks. Kahneman (1973) viewed attention as a set of cognitive processes for categorizing and recognizing stimuli; the more complex the stimulus, the harder the processing, and therefore the more resources are engaged. Despite the different theoretical approaches, attention has been shown to a flexible aspect of cognition (Kahneman 1973). We see that attention, rather than being rigidly and mechanically limited, is instead a more flexible system, affected by factors such as the complexities of tasks and the person’s intention.

In Treisman’s (1960, 1964) attenuation theory, irrelevant messages (or less important messages) are turned-down through the multi-stage processing (physical/sensory processing, linguistic processing, and semantic/meaning processing), leaving more attention for important information. The turned-down messages are still partially accessible and monitored occasionally. Some messages have low thresholds and are easily processed, e.g., names, danger signals. Unattended information is still available, just less accessible. It requires little constraint on what gets through.

Work such as that by Johnston and Heinz (1978) has led many to use new metaphors when explaining attention. For instance, some compare attention to a spotlight that highlights whatever information the system is currently focused on (Johnson and Dark 1986). Accordingly, psychologists are now interested less in determining what information cannot be processed than exploring what kinds of information people choose to focus on.

In multimode theory (Johnston and Heinz 1978), attention is assumed to be flexible in that attended and non-attended information can be differentiated at different depths of perceptual analysis. Multimode theory assumes that the more processing needed, the greater the capacity and mental effort required, and the later the selection, the harder the task. Free attentional capacity decreases the later the selection occurs.

Kahneman (1973) presented a slightly different model to explain attention. He viewed attention as a set of cognitive processes for categorising and recognising stimuli. The more complex the stimulus, the harder the processing, and therefore the more resources are engaged. However, according to Kahneman, people have some control over where they direct their mental resources: They can often choose what to focus on and devote their mental effort to. Kahneman’s (1973) model of attention indicates how attention can be considered as a flexible system affected by several factors but has a limitation in explaining how an individual’s enduring dispositions and momentary intentions affect the processes of resource allocation. Essentially, this model suggests that we pay more attention to things we are interested in or have judged important.

Everyday observations tell us that the more one concentrates, the better one performs. Many researchers have employed the notion of mental effort (cognitive resources) as a hypothetical construct to explain performance differences (Bandura 1982; Salomon 1981, 1983; Salomon and Leigh 1984).

Bobrow and Collins (1975: 145) pointed out:

Data which were either deemed as important or could not easily be accounted for would receive sufficient processing effort and as a result, they would probably be remembered later. Moreover, we suspect that they would receive conscious attention at the time of their arrival and processing. Thus, data which are expected or otherwise, readily accounted for will be remembered.

To explain the essence of what is meant by constructs such as depth of processing and cognitive capacity, Salomon (1981, 1983) used the construct of amount of invested mental effort, which is defined as 'the number of non-automatic mental elaborations applied to a unit of material'. (Salomon 1984: 648) This concept is based on Kahneman’s (1973) attention theory, which assumes that one has a pool of available mental effort (cognitive capacity) that can be allocated to tasks and conscious information processes demand mental effort and therefore tap the pool of cognitive resources.

According to Salomon, the amount of invested mental effort indicates cognitive and motivational attributes:

It is cognitive in the sense that it pertains to mental elaborations of information material. But as these elaborations are controlled, rather than automatic, their employment implies a measure of choice, as all controlled activities do (Steiner, 1979). The exercise of choice, the preference of one alternative course of action over another, implies in turn the existence of motivation (Brigham, 1979). Non-automatic effort demanding elaborations are at one’s disposal; their actual employment is a matter of choice and motivation. (Salomon 1983: 44)

Motivation, curiosity, anxiety, or arousal may all be necessary factors in producing greater invested mental effort (Salomon 1981). But according to Salomon (1981) the invested mental effort ultimately produces learning. High motivation, even when accompanied by comprehensive knowledge or skill, is not sufficient to produce high performance unless one actually invests mental effort in processing information (Clark 1980).

Langer, Blank, and Chanowitz (1978) showed that when information or stimuli are considered as highly familiar, people tend to respond to them mindlessly, thereby resulting in low performance. The perception toward task difficulty is also thought to influence the amount of effort expended (Weiner 1985). Weiner found that individuals seem to perform best at tasks of intermediate difficulty. When faced with tasks of intermediate difficulty, people invest more effort since these individuals believe that the best performance strategy for high achievement in such situations is to try harder. These studies suggest that invested mental effort may depend on the perceived demand characteristics of the stimulus, the task, or the context.

More demanding, difficult or novel stimuli are generally expected to evoke more effort investment than simple stimuli (Salomon 1983). But according to Salomon, the nature of stimuli, their complexity, novelty, and the like, in interaction with learners’ abilities, affect performance or learning outcomes only to some extent. Perceptions, in the sense of predispositions, preconceptions, attitudes, or attributions, also play an important role in the way one processes information.

In a series of studies (Salomon 1983, 1984; Salomon and Leigh 1984), Salomon addressed the question of how individuals’ perceptions of information categories relate to the amount of invested mental effort and performance. The findings of these studies indicate that differential perceptions of tasks are related to the amount of invested mental effort, which in turn is related to performance and learning. The results suggest that individuals’ performance may depend on what they perceive the tasks to be.

Taken as a whole, this line of research suggests that individuals’ perceived demand characteristics of tasks or contexts affect AIME. The more demanding PDC is, the more AIME would be expended. When people face a task they perceive to be easy relative to their abilities, they may invest less mental effort in its processing or performance. For example, a skilled driver or Web surfer may perceive the respective task of driving or Web surfing to be easy and thus rely more on automatic processes. This is due to knowing that no additional effort investments are needed to perform the task that is perceived to be well mastered (Salomon 1984).

Research in human information behaviour, shows that people often face multiple task situations in information contexts. When they have multiple information tasks or problems, they tend to batch those problems or tasks and try to solve them at once, often using information retrieval systems (Spink 2004). Studies indicate that users’ searches may have multiple goals or topics in the contexts of human information interaction (Miwa 2001; Spink 2004).

The concept of human information coordinating behaviour has been introduced in the studies of human multitasking information behaviour (Spink et al. 2006; Spink et al. 2002; Spink et al. 2006). The general meaning of coordinating is bringing the different elements of a complex activity into a relationship that will ensure efficiency (Compact Oxford English Dictionary 2005). Spink, Park, and Cole emphasise that:

the concept of HICB [human information coordinating behaviour] is an important linking and sustaining process for a science of information that binds together the many HIB [human information behaviour] processes. The development of HIB necessitates a theoretical and empirical explication of the important nature and role of HIB’s, including HICB. In HICB, humans coordinate a number of elements, including their cognitive state, level of domain knowledge, and their understanding of their information problem, into a coherent series of activities that may include seeking, searching, interactive browsing, retrieving, and constructing information. A key process for HICB is to sustain these activities toward completion of some information goal or object. (Spink et al.2006: 150)

In the context of information access and use, task attributes have been investigated in numerous studies (e.g., Byström and Järvelin 1995; Culnan 1983; Hart and Rice 1991; Tiamiyu 1992). These studies show that task characteristics (e.g., task complexity) influence the way people seek and use information. Task complexity is multidimensional (Campbell 1988) and there are systematic interplays among task complexity, information types, information / communication channels, and sources (Bystrom and Jarvelin 1995).

Theoretical model

From the analysis of the studies reviewed, a theoretical model of human prioritising and coordinating information behaviour in the contexts of information seeking and retrieval emerged.

Figure 1 depicts the process of prioritising and coordinating multiple information tasks in the contexts of information seeking and retrieval. The model is fundamentally based on the global single-channel hypothesis, which is all of the mechanisms between stimulus input and response output (stimulus perception, response selection, movement initiation) together constitute a single-channel and can be used by only one task at a time (Craik 1948).

In this model, differential perceptions of tasks initiate the process by influencing the dimensions of task prioritisations, cognitive effort, affective state, and temporal demand. All these components are in turn related to the level of task performance. Performance is then followed by evaluation. Interplay plays an important role in the processes of human prioritising and coordinating behaviour over time in the context of multiple information tasks.

In this study, the notion of multiple task performance is coming from an interdisciplinary perspective of human information interaction. The conceptual foundation of multiple task performance has been built on the studies of cognitive psychology, human factors, and educational psychology and it has been extended in the contexts of information seeking and retrieval in human information interaction. This exploratory study seeks a multi-dimensional understanding of human prioritising and coordinating information behaviour by investigating, in particular, the relationships of task demands, cognitive effort, affective state, temporal demand, and performance.

Theoretical Model of Human Prioritizing and Coordinating Information Behaviour

Figure 1. Theoretical model of human prioritizing and coordinating information behaviour

The next section details the methods used in this study.

Research design

This study aims to understand the relationships of perception, effort, emotion, time, and performance when people manage multiple information tasks using Web information technologies.

Data collection instrument

Data were collected from questionnaires completed before and after the task completion exercise. They were used to obtain general background information and examine the research problem. The pre-task questionnaire contained closed and open-ended questions. The post-task questionnaire was mainly made up of rating scales, applied to collect data on the levels of each of the four dimensions associated with assessment of the following variables: task demand (task dimension), mental effort (cognitive dimension), performance (behavioural dimension), temporal demand (temporal dimension) and psychological or affective level (psychological/affective dimension). Each dimension was defined as follows:

The post-task questionnaire was designed based on the subjective workload assessment technique (Reid and Nygren 1988) with substantial modifications for the purpose of this study. Each scale in the pre and post questionnaires was presented as a 12-cm line with bipolar descriptors at each end (e.g., high or low, excellent or poor). Numerical values were not displayed on the rating scales. A questionnaire was chosen because it has the potential to collect cognitive data quickly and easily. Another advantage of a questionnaire is that the data may be both qualitative and quantitative, allowing them to play a part in both quantitative and qualitative studies (Su 1991).

Subject sample

The first step in choosing a sample is to decide who should be included in the population of interest (Krathwohl 2004). For this study, students and faculty members were the sampled population. The reason for choosing this population was that it was assumed that they regularly interacted with the Web for information or knowledge. Web information technologies have played an important role in electronic learning environments. Students and faculty regularly interact with information and information retrieval systems (e.g., the Web, databases, digital libraries) to solve their information problems and/or broaden their knowledge horizons in electronic learning environments.

Twenty volunteers with diverse academic backgrounds, including telecommunications, library and information science, environmental studies, health and community systems, sociology, nursing, and health information management, participated in this study. All students and faculty members at a university were asked to take part in the study. A notice of recruitment was distributed through emailing lists and notice boards. No demographic and disciplinary limits were set in order to minimise bias in the sampling process.

Data collection

The tasks

After giving general instructions, the subjects were asked to create one information problem for the non-assigned (additional) task. They were then given general descriptions of three different information tasks in random order. It was the participants who decided on the entire process of their searching sessions, e.g., which task they were going to begin with. They had a maximum of one hour to finish their sessions regardless of the state of completion of all tasks. The subjects conducted one task at a time. The three assigned tasks were related to medicine, travel, and research. The descriptions of the assigned tasks were as follows:

A task in this study was not simply a topic or an information search task. Each task entailed several activities such as problem solving and planning to pursue certain goals.

Research setting

The researcher conducted the study in a controlled environment. The research took place in a laboratory, which was equipped with Dell 3.06GHz Pentium PCs with 512 MB RAM and a 80 GB hard disk running on Windows XP. They also had Microsoft Office 2003 packages and several different kinds of Web browsers including the latest versions of Safari, Firefox, Netscape, and Internet Explorer.

Data analysis

The analysed data included pre- and post-task questionnaires. The questionnaires were tabulated, compiled and analysed with computer program SPSS. Cross-tabulated tables provide 'information on the variation of responses with various demographic and other independent variables that can throw considerable light on the respondents’ underlying characteristics, value structures and thinking processes' (Krathwohl 2004: 372).

Results

Demographic information


Table 1: Demographic data for the research subjects
Category Sub-category Frequency Percentage (%)
Age18-21315%
 22-29945%
 30-39630%
 40+ 210%
 Total20100%
SexFemale1575%
 Male525%
 Total 20 100%
Academic Status Undergraduate 3 15%
  Master's 13 65%
  Doctoral 2 10%
  Professor 2 10%
  Total 20 100%
Academic Discipline Social Sciences 12 60%
  Engineering 3 15%
  Health Sciences 4 20%
  Natural Sciences 1 5%
  Total 20 100%

The subjects in this study had varying backgrounds (see Table 1), including different sexes, academic status (e.g., faculty, doctoral students, master’s students, and undergraduate students), ages, and academic discipline areas (e.g., engineering, social sciences, natural sciences, and health sciences). All participants were regular and experienced Web users.

Multidimensional measures on the tasks

This study was designed to gain a multi-dimensional understanding of the multiple information task behaviour in humans by analysing the dynamic interplays of perceived task attributes, mental efforts, affective states, temporal demands, and performances.

Table 2 describes the average scores of the multiple aspects associated with the multiple information task behaviour in humans in the context of information seeking and retrieval.



Table 2. Multidimensional measures on individual information tasks
Measured
variable
Medicine Travel Research Additional
Mean SD Mean SD Mean SD Mean SD
Difficulty 3.870 2.1258 4.465 1.9680 5.690 2.3657 3.870 1.8388
Importance 8.585 2.4692 5.365 2.6039 8.550 2.0075 5.965 3.3137
Interest 7.540 3.2047 6.585 3.3611 6.150 3.1081 8.580 2.6333
Knowledge or familiarity 4.815 3.1179 5.800 2.5381 6.455 2.6518 7.090 2.0619
Complexity 5.830 2.6474 5.315 2.5646 7.775 2.2148 4.950 3.0626
Mental effort 4.685 2.5236 4.715 2.2115 5.940 3.2419 4.090 2.8011
Affective state 3.025 2.6248 3.765 2.3647 4.925 3.2973 3.275 2.8988
Temporal demand 2.780 1.8171 4.185 2.7130 4.560 2.8840 3.205 2.3141
Performance (success) 9.010 2.0047 7.265 3.1174 7.900 2.7719 8.950 2.3332
Performance (satisfaction) 8.740 2.5124 7.275 3.4127 8.030 2.8603 8.700 2.6921
Duration 572.20 339.995 632.35 436.576 833.05 532.620 519.25 318.951

The results in Table 2 show that the medicine task was considered the least difficult and familiar with the mean scores with 3.8 and 4.8, respectively, and most important with a mean of 8.5. The subjects felt the least emotional and temporal demands while working on the medicine task resulting in the highest levels of success and satisfaction regarding their performances.

The travel task was considered the least important (X=5.3) with the lowest levels of overall success (X=7.2) and satisfaction (X=7.2). The additional task was evaluated as the least difficult (X=3.8) and complex (X=4.9). The subjects also thought that the additional task was most interesting (X=8.5) and familiar (X=7.0), requiring the least level (X=4.0) of cognitive processing to perform the task. The subjects spent the least amount of time in conducting the additional task with a mean duration of 519 seconds.

The research task was considered most difficult (X=5.6) and complex (X=7.7), and the least interesting (X=6.1). It seemed that the subjects invested a high level of mental effort (X=5.9). It was noticed that the levels of emotional state and temporal demand were highly evaluated while the subjects were working on the research task. They also seemed to spend the longest amount of time in finishing the research task (833 sec.).

The additional task was considered most interesting (X=8.5) and familiar (X=7.0) and the least difficult (X=3.8) and complex (X=4.9). It was noticed that the subjects invested less time (519 sec.) and mental effort (X=4.0) on the additional task than the other tasks.

Correlation measures on the tasks

These data were analysed further to see if there were any statistically significant correlations among the variables. The results of this analysis are discussed in the following sections.

Correlation measures: medicine task


Table 3. Medicine task correlation matrix
  Difficulty Importance Interest Knowledge or
Familiarity
Complexity Mental
effort
Affective
state
Temporal
demand
Performance
(success)
Performance
(satisfaction)
Duration
Difficulty Pearson 'r' 1 -0.267 -0.078 -0.446* 0.400 0.517* 0.456* 0.211 -0.300 -0.230 -0.059
  Sig. (2-tailed)   0.255 0.743 0.049 0.081 0.020 0.043 0.371 0.199 0.329 0.806
Importance Pearson 'r'   1 0.876** 0.280 0.236 -0.265 -0.394 -0.226 0.529* 0.334 0.097
  Sig. (2-tailed)     .000 .231 .317 .259 .086 .337 .017 .150 .683
Interest Pearson 'r'     1 .336 .300 -.095 -.088 .118 .524* .365 .231
  Sig. (2-tailed)       .147 .198 .689 .711 .621 .018 .114 .326
Knowledge / Familiarity Pearson 'r'       1 .157 -.412 -.113 -.060 .642** .558* .112
  Sig. (2-tailed)         .509 .071 .635 .803 .002 .011 .637
ComplexityPearson 'r'     10.1490.046-0.0540.0700.063-0.043
 Sig. (2-tailed)      0.5310.8480.8210.7710.7920.858
Mental effortPearson 'r'      10.639**0.449*-0.446*-0.532*0.360
 Sig. (2-tailed)       0.0020.0470.0490.0160.119
Affective State Pearson 'r'       10.532*-0.472*-0.473*0.331
 Sig. (2-tailed)        0.0160.0350.0350.154
Temporal demandPearson 'r'        1-0.119-0.0700.315
 Sig. (2-tailed)         0.6170.7690.176
Performance (success)Pearson 'r'         1 0.925**0.020
 Sig. (2-tailed)          0.0000.935
Performance (satisfaction)Pearson 'r'          1-0.147
 Sig. (2-tailed)           0.536
DurationPearson 'r'           1
 Sig. (2-tailed)            

Table 3 presents the results regarding the correlations of the variables on the medicine task. It was found that among the task attributes, difficulty was negatively associated with knowledge or familiarity (r = -0.446) and importance was positively correlated to interest (r=0.876). Task difficulty had a positive correlation with the degree of mental effort (r=0.517) and affective state (r=0.456). In terms of the behavioural dimension, the degree of success was positively associated with several task attributes including task importance (r=0.529), interest (r=0.524), and knowledge or familiarity (r=0.642). The level of satisfaction was correlated with one task attribute, knowledge or familiarity (r=0.558). In the cognitive dimension, it was noticed that several meaningful relationships existed between mental effort and other variables, including affective state (r=0.639) and temporal demand (r=0.449). Interestingly, the degrees of success (r=-0.446) and satisfaction (r=-0.532) were negatively associated with the level of cognitive processing. It was found that a positive relationship existed between affective state and temporal demand (r=0.532). The emotional degree was negatively associated with the levels of success (r=-0.472) and satisfaction (r=-0.473). A very strong relationship (r=0.925) existed between success and satisfaction.

Correlation measures: travel task


Table 4: Travel task correlation matrix
  Difficulty Importance Interest Knowledge or
Familiarity
Complexity Mental
effort
Affective
state
Temporal
demand
Performance
(success)
Performance
(satisfaction)
Duration
Difficulty Pearson 'r'† 1 0.151 -0.021 0.089 0.261 -0.026 0.233 -0.116 -0.160 -0.177 0.290
  Sig. (2-tailed)   0.525 0.930 0.710 0.266 0.912 0.323 0.626 0.501 0.455 0.215
Importance Pearson 'r'   1 0.612** 0.444* 0.310 -0.037 -0.246 -0.162 0.337 0.324 -0.027
  Sig. (2-tailed)     0.004 0.050 0.183 0.875 0.295 0.496 0.146 0.164 0.909
Interest Pearson 'r'     1 0.627** 0.394 0.216 -0.157 -0.168 0.148 0.231 -0.131
  Sig. (2-tailed)       0.003 0.086 0.361 0.509 0.480 0.532 0.326 0.581
Knowledge / Familiarity Pearson 'r'       1 0.121 0.162 -0.258 -0.315 0.185 0.277 -0.222
  Sig. (2-tailed)         0.611 0.495 0.272 0.177 0.434 0.236 0.347
Complexity Pearson 'r'         1 -0.393 -0.281 -0.238 0.161 0.174 0.232
  Sig. (2-tailed)           0.087 0.230 0.312 0.498 0.464 0.324
Mental effort Pearson 'r'           1 0.641** 0.458* -0.501* -0.347 0.115
  Sig. (2-tailed)             0.002 0.042 0.024 0.134 0.631
Affective state Pearson 'r'             1 0.604** -0.752** -0.719** 0.292
  Sig. (2-tailed)               0.005 0.000 0.000 0.211
Temporal demand Pearson 'r'               1 -0.718** -0.700** 0.122
  Sig. (2-tailed)                 0.000 0.001 0.609
Performance (success) Pearson 'r'                 1 0.967** -0.397
  Sig. (2-tailed)                   0.000 0.083
Performance (satisfaction) Pearson 'r'                   1 -0.371
  Sig. (2-tailed)                     0.107
Duration Pearson 'r'                     1
  Sig. (2-tailed)                      
* Correlation is significant at the 0.05 level (2-tailed)        ** Correlation is significant at the 0.01 level (2-tailed).

The results in Table 4 indicate that among the task attributes, task importance was positively associated with interest (r=0.612) and knowledge or familiarity (r=0.444). A positive relationship (r=0.627) was found between interest and knowledge or familiarity. It was noticed that mental effort was related to affective state (r=0.641), temporal demand (r=0.458), both positively, and success negatively (r=-0.501). It was found that there was a relationship (r=0.604) between affective state and temporal demand. The degree of emotional state was also negatively associated with overall performance, including success (r=-0.752) and satisfaction (r=-0.719). There was a strong relationship between temporal demand and performance: success (r=-0.718) and satisfaction (r=-0.700). In the travel task, it was also found that the level of success was strongly related to the level of satisfaction.

Correlation measures: research task


Table 5: Research task correlation matrix
  Difficulty Importance Interest Knowledge or
familiarity
Complexity Mental
effort
Affective
state
Temporal
demand
Performance
(success)
Performance
(satisfaction)
Duration
Difficulty Pearson 'r' 1 -0.039 -0.284 -0.268 0.432 0.437 0.372 0.230 -0.414 -0.416 0.062
  Sig. (2-tailed)   0.872 0.225 0.253 0.057 0.054 0.107 0.329 0.069 0.068 0.797
Importance Pearson 'r'   1 0.280 0.300 0.449* 0.005 -0.048 0.087 0.089 0.092 0.568**
  Sig. (2-tailed)     0.231 0.199 0.047 0.982 0.840 0.715 0.709 0.700 0.009
Interest Pearson 'r'     1 0.374 -0.112 -0.160 -0.273 -0.259 0.533* 0.595** -0.078
  Sig. (2-tailed)       0.104 0.638 0.500 0.245 0.270 0.015 0.006 0.743
Knowledge or familiarity Pearson 'r'       1 0.023 0.046 -0.050 -0.294 0.238 0.284 -0.163
  Sig. (2-tailed)         0.922 0.847 0.835 0.208 0.312 0.225 0.492
Complexity Pearson 'r'         1 0.181 0.206 0.315 -0.294 -0.284 0.428
  Sig. (2-tailed)           0.446 0.383 0.176 0.208 0.225 0.060
Mental effort Pearson 'r'           1 0.680** 0.669** -0.638** -0.615** 0.197
  Sig. (2-tailed)             0.001 0.001 0.002 0.004 0.405
Affective state Pearson 'r'             1 0.509* -0.751** -0.682** 0.259
  Sig. (2-tailed)               0.022 0.000 0.001 0.270
Temporal demand Pearson 'r'               1 -0.563** -0.596** 0.483*
  Sig. (2-tailed)                 0.010 0.006 0.031
Performance (success) Pearson 'r'                 1 0.941** -0.233
  Sig. (2-tailed)                   0.000 0.323
Performance (satisfaction) Pearson 'r'                   1 -0.279
  Sig. (2-tailed)                     0.233
Duration Pearson 'r'                     1
  Sig. (2-tailed)                      
* Correlation is significant at the 0.05 level (2-tailed).         ** Correlation is significant at the 0.01 level (2-tailed)

Table 5 shows that among the task attributes, importance was correlated to complexity (r=0.449) and duration (r=0.568). There was a relationship between interest and performance: success (r=0.533) and satisfaction (r=0.595). It was noticed that mental effort was associated with several variables including affective state (r=0.680), temporal demand (r=0.669), success (r=-0.638), and satisfaction (r=-0.615). Affective state was related to temporal demand positively (r=0.509) and performance negatively (success, r=-0.751; satisfaction, r=-0.682). The degree of temporal demand was positively associated with task duration (r=0.483) and negatively related to both success (r=-0.563) and satisfaction (r=-0.596). A noticeable relationship (r=0.941) existed between success and satisfaction.

Correlation measures: additional task


Table 6: Additional task correlation matrix
  Difficulty Importance Interest Knowledge or
familiarity
Complexity Mental
effort
Affective
state
Temporal
demand
Performance
(success)
Performance
(satisfaction)
Duration
Difficulty Pearson 'r' 1 0.441 0.257 0.111 0.562** 0.332 0.288 0.398 -0.061 0.095 0.318
  Sig. (2-tailed)   0.051 0.275 0.641 0.010 0.152 0.218 0.082 0.798 0.691 0.171
Importance Pearson 'r'   1 0.465* 0.399 0.241 0.241 0.267 0.412 -0.020 0.116 0.306
  Sig. (2-tailed)     0.039 0.082 0.306 0.305 0.256 0.071 0.934 0.626 0.190
Interest Pearson 'r'     1 0.012 0.473* 0.263 0.279 0.152 -0.146 -0.108 0.482*
  Sig. (2-tailed)       0.960 0.035 0.262 0.233 0.523 0.539 0.650 0.031
Knowledge or familiarity Pearson 'r'       1 0.052 0.025 0.124 0.139 0.279 0.363 0.086
  Sig. (2-tailed)         0.828 0.918 0.602 0.559 0.234 0.116 0.720
Complexity Pearson 'r'         1 0.014 -0.075 0.234 0.123 0.260 0.116
  Sig. (2-tailed)           0.952 0.753 0.321 0.605 0.268 0.625
Mental effort Pearson 'r'           1 0.737** 0.388 -0.548* -0.448* 0.580**
  Sig. (2-tailed)             0.000 0.091 0.012 0.048 0.007
Affective state Pearson 'r'             1 0.153 -0.611** -0.530* 0.240
  Sig. (2-tailed)               0.521 0.004 0.016 0.309
Temporal demand Pearson 'r'               1 0.041 0.142 0.464*
  Sig. (2-tailed)                 0.864 0.552 0.039
Performance (success) Pearson 'r'                 1 0.943** -0.070
  Sig. (2-tailed)                   0.000 0.770
Performance (satisfaction) Pearson 'r'                   1 0.058
  Sig. (2-tailed)                     0.809
Duration Pearson 'r'                     1
  Sig. (2-tailed)                      
* Correlation is significant at the 0.05 level (2-tailed).         ** Correlation is significant at the 0.01 level (2-tailed)

In Table 6, for the additional task, task complexity was associated with both difficulty (r=0.562) and interest (r=0.473). It was found that perceived task interest was related to importance (r=0.465) and time spent (r=0.482). It was noticed that the degree of mental effort was associated with several variables including affective state (r=0.737), performance (success, r=-0.548; satisfaction, r=-0.448), and duration (r=0.580). Affective state was also negatively related to performance (success, r=-0.611; satisfaction, r=-0.530). A relationship existed between the level of temporal demand and the time spent on the task (r=0.464). In the additional task, the level of success was also strongly related to the level of satisfaction (r=0.943).

Discussion and conclusion

Multiple information task behaviour in humans consists of multiple components. The success of such activities depends on how people bring those different elements into a relationship that will ensure efficiency and harmony.

The correlations between the measures were examined at the significant levels of .01 and .05. Table 7 shows the dynamic interplays of the components of human multiple information task interaction on the Web, employing a matrix to represent/visualise the numeric data in a meaningful way.

Statistically significant relationships exist among the perceived attributes of the information tasks. Interest is related with importance (r=0.88, medicine task; r=0.61, travel task; r=0.47, additional task). knowledge or familiarity is associated with both importance (r=0.44, travel task) and interest (r=0.63, travel task). At the same time, knowledge or familiarity is negatively correlated with difficulty (r=-0.45, medicine task). Complexity is associated with multiple task attributes, including difficulty (r=0.56, additional task), importance (r=0.45, research task), and interest (r=0.47, additional task). Interesting information tasks are considered important. When people determine that they have some experience or are familiar with a certain information task, they think the task is more important and interesting and less challenging. A complex information task is perceived as more difficult, important, and interesting.

Both mental effort (r=0.52, medicine task) and affective state (r=0.46, medicine task) are correlated with the perceived degree of task difficulty. Negative perceptions toward an information task (e.g., higher task difficulty) led people to try harder but this feeling counteracts and increases stress and frustration. This might be caused by low self-confidence in performing the task.

In terms of performance, task importance (r=0.53, medicine task), interest (r=0.52, medicine task; r=0.53, research task), and knowledge or familiarity (r=0.64, medicine task) are all significantly correlated with success. Among them, only task interest (r=0.60, research task) and knowledge or familiarity (r=0.56, medicine task) are significantly related to satisfaction. There is a significant correlation between duration and task importance (r=0.57, research task). Duration is also correlated with task interest (r=0.48, additional task). It seems that people perform better with higher satisfaction when faced with more important, interesting, and familiar information tasks. In addition, they tend to spend more time on interesting and important tasks to complete them.

It should be noticed that there are dynamic correlations among other measures, including mental effort, affective state, temporal demand, performance, and duration, for most of the information tasks.

Mental effort is positively associated with multiple measures, such as affective state (r=0.64, medicine task; r=0.64, travel task; r=0.68, research task; r=0.74, additional task), temporal demand (r=0.45, medicine task; r=0.46, travel task; r=0.67, research task), and duration (r=0.58, additional task). At the same time, the cognitive measure is negatively correlated with performance in terms of success (r=-0.45, medicine task; r=-0.50, travel task; r=-0.64, research task; r=-0.55, additional task) and satisfaction (r=-0.53, medicine task; r=-0.62, research task; r=-0.45, additional task).

Another measure, which is related to multiple dimensions, is affective state. It was found that a statistically significant relationship exists between affective state and temporal demand (r=0.53, medicine task; r=0.60, travel task; r=0.51, research task). Affective state is also negatively correlated with performance, with respect to success (r=-0.47, medicine task; r=-0.75, travel task; r=-0.75, research task; r=-0.61, additional task) and satisfaction (r=-0.47, medicine task; r=-0.72, travel task; r=-0.68, research task; r=-0.53, additional task).

A negative correlation exists between temporal demand and performance in terms of success (r=-0.72, travel task; r=-0.56, research task) and satisfaction (r=-0.70, travel task; r=-0.60, research task). In addition, temporal demand is positively correlated with duration (r=0.48, research task; r=0.46, additional task). There is a highly significant correlation between success and satisfaction (r=0.93, medicine task; r=0.97, travel task; r=0.94, research task; r=0.94, additional task).


Model revisited

Figure 2: Model revisited

With the resulting data, the theoretical model of human prioritising and coordinating information behaviour was revisited. Figure 2 indicates those with higher cognitive effort experienced more stress and frustration and higher temporal demand, resulting in lower levels of performance, even though they spent more time finishing the information task. It seems that cognitive, emotional, temporal, and behavioural aspects are closely related to each other across the tasks. When people consider a task to be demanding (e.g., higher difficulty or complexity), they often become frustrated. In this case, even though they try harder to solve the problem for a longer time period, their negative emotional state prevents them from performing the task successfully. In other words, high degrees of temporal demand and a negative emotional state led people to perform poorly even though they invest more mental effort on the task. Our feelings and emotions play a key role in our ability to deal with a situation where multiple information tasks need to be done within time limits.

Humans have inhabited dynamic, volatile information environments since the advent of the Web. As Web information environments become more complex and dynamic, people often find themselves faced with multiple information tasks or goals while interacting with Web information technologies. Our adaptation occurs from our ability to process information effectively and adapt our information behaviour accordingly. Despite the values, current studies of human-information interaction have limitations in explaining our adaptive information behaviour in dynamic and complex Web information environments.


Table 7: Interactions of the components of human multiple information task behaviour
  Interest Knowledge or
familiarity
Complexity Mental
effort
Affective
state
Temporal
demand
Performance
(success)
Performance
(satisfaction)
Duration
Difficulty   -.446*[MT] .562*[AT] .517*[MT] .456*[MT]        
Importance .876***[MT]
.612**[TT]
.465*[AT]
.444*[TT] .449*[RT]       .529*[MT]   .568*[RT]
Interest   .627**[TT] .473*[AT]       .524*[MT]
.533*[RT]
.595*[RT] .482*[AT]
Knowledge or familiarity             .642**[MT] .558*[MT]  
Mental effort         .639**[MT]
.641**[TT]
.680**[RT]
.737**[AT]
.449*[MT]
.458*[TT]
.669**[RT]
-.446*[MT]
-.501*[TT]
-.638**[RT]
-.548*[AT]
-.532*[MT]
-.615**[RT]
-.448*[AT]
.580*[AT]
Affective state           .532*[MT]
.604**[TT]
.509*[RT]
-.472*[MT]
-.752**[TT]
-.751**[RT]
-.611**[AT]
-.473*[MT]
-.719**[TT]
-.682**[RT]
-.530*[AT]
 
Temporal demand             -.718**[TT]
-.563*[RT]
-.700**[TT]
-.596*[RT]
.483*[RT]
.464*[AT]
Performance (success)               .925***[MT]
.967***[TT]
.941***[RT]
.943***[AT]
 
Note 1: * means moderate correlation; ** strong correlation; *** very strong correlation
Note 2: MT stands for Medicine task; TT, Travel task; RT, Research task; AT, Additional task

The understanding of human multiple information task behaviour can be utilized as a conceptual base to design information systems which support efficient and effective human-information and human-computer interactions in complex and dynamic information seeking and retrieval environments.

From the system design point of view, it would be advantageous for systems to support a user’s individuality to close the gaps in performance differences. Adaptive (also called personalised) information systems are designed to deal with the fact that users are individuals, taking into account individual features such as goals/tasks, knowledge, background, Web experience, preferences and interests (Brusilovsky, 2001). To build such systems to be human-friendly, system designers first need to understand the dynamic interplays of humans, information, tasks, and systems.

Researchers in the field of human-information interaction and human-computer interaction can incorporate the concept of human multiple task performance to design adaptive user interfaces. Creating effective user interfaces requires knowledge of how people actually deal with multiple information task situations physically, cognitively, and emotionally under dynamic and complex circumstances. The results of this study can be employed as a theoretical foundation for designing human-friendly, adaptive user interfaces, which function as intelligent and affective central mechanisms and help users prioritise, monitor and coordinate their needs/tasks/goals effectively and efficiently.

This study identifies the significance of the emotional state of the information seeker as a factor in dynamic information seeking and retrieval contexts and enlightens the existing areas of human information interaction. This exploratory study will contribute to the growth of knowledge in information science.

About the author

Minsoo Park is a senior researcher of Korea Institute of Science and Technology Information, Seoul, Korea. Her main areas of research interest are human-information interaction and human-computer interaction. She can be contacted at mspark7@gmail.com.


References
  • Bandura, A. (1982). Self-efficacy mechanism in human agency. American Psychologist, 37(2), 122-147
  • Bobrow, D. G. & Collins, A. (1975). Representation and understanding: atudies in cognitive science. New York, NY: Academic Press.
  • Brigham, T.A. (1979). Some effect of choice academic performance. In L. C. Perlmuter & R. A. Monty (Eds.), Choice and perceived control. Hillsdale, NJ: Erlbaum.
  • Broadbent, D. E. (1958). Perception and communication. New York, NY: Pergamon Press.
  • Brusilovsky, P. (2001). Adaptive hypermedia. User Modeling and User-Adapted Interaction, 11(1), 87-110.
  • Burgess, P. W. (2000). Real-world multitasking from a cognitive neuroscience perspective. In Monsell, S. & Driver, J. (Eds.), Control of cognitive processes: attention and performance XVIII (pp. 465-472). Cambridge, MA: MIT Press.
  • Byström, K. & Järvelin, K. (1995). Task complexity affects information seeking and use. Information Processing & Management, 31(2), 191-213.
  • Campbell, D.J. (1988). Task complexity: a review and analysis. Academy of Management Review, 13(1), 40-52.
  • Carlson, R. A. & Sohn, M.-Y. (2000). Cognitive control of multistep routines: Information processing and conscious intentions. In S. Monsell & J. Driver (Eds.), Control of cognitive processes: attention and performance XVIII (pp. 443-464). Cambridge, MA: MIT Press.
  • Clark, R.E. (1980). Do students enjoy the instructional method from which they learn the least? Antagonism between enjoyment and achievement in ATI studies. Paper presented at annual convention of the American Educational Research Association. Boston, April, 1980.
  • Craik, K.J.W. (1948). Theory of the human operator in control systems: II. Man as an element in a control system. British Journal of Psychology, 38(3), 142-148.
  • Culnan, M.J. (1983). Environmental scanning: the effects of task complexity and source accessibility on information gathering behavior. Decision Sciences, 14(2), 194-206.
  • Damos, D. L. (1991). Multiple-task performance . London: Taylor & Francis.
  • Hart, P.J. & Rice, R.E. (1991). Using information from external databases: contextual relationships of use, access method, task, database type, organization differences, and outcomes. Information Processing & Management 27(5), 461-479.
  • Johnson, W. A. & Dark, V. J. (1986). Selective attention. Annual Review of Psychology, 37, 43-76.
  • Johnston, W. A. & Heinz, S. P. (1978). Flexibility and capacity demands of attention. Journal of Experimental Psychology: General, 107(4), 420-435.
  • Just, M.A., Carpenter, P.A., Keller, T.A., Emery, L., Zajac, H. & Thulborn, K.R. (2001). Interdependence of non-overlapping cortical systems in dual cognitive tasks. NeuroImage, 14(2), 417-426.
  • Kahneman, D. (1973). Attention and effort. Englewood Cliffs, NJ: Prentice Hall
  • Krathwohl, D. R. (2004). Methods of educational and social science research: an integrated approach. Long Grove, IL: Waveland Press.
  • Langer, E., Blank, A. & Chanowitz, B. (1978). The mindlessness of ostensibly thoughtful action: the role of ‘placebic’ information in interpersonal interaction. Journal of Personality and Social Psychology, 36(6), 635-642.
  • Lee, F. J. & Taatgen, N. A. (2002). Multitasking as skill acquisition. Proceedings of the 24th Annual Conference of the Cognitive Science Society (pp. 572-577). Hillsdale, NJ: Lawrence Erlbaum Associates
  • Miwa, M. (2001). User situations and multiple levels of users’ goals in information problem-solving processes of AskERIC users. Proceedings of the Annual Meeting of the American Society for Information Sciences and Technology, 38, 355-371.
  • Morgan, D. L. (2002). Essentials of learning and cognition. Boston, MA: McGraw-Hill
  • Reid, G. B. & Nygren, T. E. (1988). The subjective workload assessment technique: A scaling procedure for measuring mental workload. In P. A. Hancock and N. Meshkati (Eds.), Human mental workload (pp. 185-218). Amsterdam: North-Holland.
  • Salomon, G. (1981). Introducing AIME: The assessment of children’s mental involvement with television. In H. Kelly & H. Gardner (Eds.), New directions for child development: viewing children through television. San Francisco, CA: Jossey-Bass.
  • Salomon, G. (1983). The differential investment of mental effort in learning from different sources. Educational psychologist, 18(1), 42-50
  • Salomon, G. (1984). Television is “easy” and print is “tough”: the differential investment of mental effort in learning as a function of perceptions and attributions. Journal of Educational Psychology, 75 (4), 647-658
  • Salomon, G. & Leigh, T. (1984). Predispositions about learning from print and television. Journal of Communication, 34(2), 119-135
  • Soanes, C. & Hawker, S. (Eds.) (2005). Compact Oxford English Dictionary. 3rd. edition. Oxford: Oxford University Press.
  • Spink, A. (2004). Everyday life multitasking information behavior: An exploratory study. Journal of Documentation, 60(4), 336-345.
  • Spink, A., Ozmutlu, H. C. & Ozmutlu, S. (2002). Multitasking information seeking and searching processes. Journal of the American Society for Information Science and Technology, 53(8), 639-652.
  • Spink, A., Park, M. & Cole, C. (2006). Multitasking and coordinating framework for human information behavior. In A. Spink & C. Cole (Eds.), New directions in human information behavior. Berlin: Springer.
  • Spink, A., Park, M., Jansen, B. J. & Pedersen, J. (2006). Multitasking during Web search sessions. Information Processing and Management , 42(1), 264-275.
  • Spink, A., Park, M. & Koshman, S. (2006). Factors affecting assigned information problem ordering during Web search: an exploratory study. Information Processing and Management, 42(5), 1366-1378.
  • Steiner, I. D. (1979). Three kinds of reported choice. In L. C. Perlmuter & R. A. Monty (Eds.), Choice and perceived control. Hillsdale, NJ: Erlbaum.
  • Su, L.T. (1991). An investigation to find appropriate measures for evaluating interactive information retrieval. Unpublished doctoral dissertation, Rutgers, the State University of New Jersey, New Brunswick, New Jersey, USA
  • Tiamiyu, M. A. (1992). The relationships between source use and work complexity, decision-maker discretion and activity duration in Nigerian government ministries. International Journal of Information Management, 12(2), 130-141.
  • Treisman, A. M. (1960). Contextual cues in selective listening. Quarterly Journal of Experimental Psychology, 12(4), 242-248.
  • Treisman, A. M. (1964). Verbal cues, language, and meaning in selective attention. American Journal of Psychology, 77(2), 206-219.
  • Waller, M. J. (1997). Keeping the pins in the air: How work groups juggle multiple tasks. Advances in interdisciplinary studies of team works, 4, 217-247
  • Weiner, B. (1985). Human motivation. New York, NY: Springer-Verlag.
  • Wickens, C. D. (1989). Attention and skilled performance. In D. Holding (Ed.), Human skills (pp. 71-105). New York, NY: Wiley & Sons.
  • Wickens, C.D. (2002). Multiple resources and performance prediction. Theoretical Issues in Ergonomic Science, 3(2), 159-177.
  • Wickens, C. D., Goh, J., Helleberg, J., Horrey, W.J. & Talleur, D. A. (2003). Attentional models of multi-task pilot performance using advanced display technology. Human Factors, 45(3), 360-380.
How to cite this paper

Park, M. (2013). Multi-dimensional analysis of dynamic human information interaction. Information Research, 18(1) paper 566. [Available at http://InformationR.net/ir/18-1/paper566.html]

Check for citations, using Google Scholar