Appendix 1: The data-collection instruments


Outline

A:  Pre-search instruments

B:  Post search instruments

C:  Searcher assessment of the search

D:  Follow-up interview

Return to Contents Page


A:  Pre-search instruments

For project use: Client number: U_______
Date:__________ Question number: Q____
  Search number: S____
Client name:  
Topic:

Reference Interview

Introduction: introduce yourself to the client, and explain that you will be wanting to know not only some further information on their topic, but also information on such things as the previous searches for information, if any, that they have conducted.

1.  Client. s description of the problem and nature of the enquiry

Before we begin the reference interview I. d like you to tell me in your own words a little about your problem and where you are in relation to it.

Interviewer to probe once the client has made a statement to gain information about the nature of the topic, how it fits into the person. s research generally, what the context is, how significant is the work to you - personally? What pressure, if any, are you under to carry out this work? what the purpose of the search is and whether the topic is based in a single discipline or is multi-disciplinary - In either case, which discipline(s) is/are involved?

NB: Recap on this description of the problem at the end of the reference interview.

[Space for response]

2. Problem-solving stage.

To determine at what point the person is in their problem solving you should ask -

2.1  "Is this a new problem area for you?"

oNo - please go on to question. 3.2

o Yes - Is your problem precisely defined or is it still fuzzy in any way?

oPrecisely defined
oStill fuzzy

2.2  What stage are you at in terms of defining or resolving the problem, or in presenting the answer?

 Please respond using one of the categories indicated below. If no single category sums up where you are in your work please indicate the approximate position.

[Interviewer to probe if client doesn. t specify one of the categories below to determine problem phase]

Problem recognition: I am trying to determine whether or not the topic I. m interested in is a real problem from the point of view of the discipline or area that interests me. I need a search so that I can discover whether others have identified the same issue as problematical.

Problem definition: I have identified a real problem and now need to define it more closely or carefully so that I can determine how to approach the problem and how it relates to other problems in the field. I need a search to help me define my research objectives.

Problem resolution: I am in the process of resolving the problem (engaged in laboratory experiments, field work, etc.) and now need a search to enable me to proceed with and complete that work. The question deals with a particular problem that I need to resolve in completing the work or with aspects of methodology, research approach or research methods.

Solution statement: I have effectively finished the work I was doing and am either tying up loose ends, or finding out from related work how best to report my research or where best to report it.

3.  Client. s indicators of information seeking context

On the scale below, can you indicate how would you describe the degree to which your intended use of the search results was well defined to start with?

Use is not specifically defined; many uses possible Use is specifically defined; one or few specific uses intended

4.  State of personal or internal knowledge

A person. s knowledge about the broad domain and/or the specific problem at hand and its various aspects may vary. The next three questions ask you in your own estimate, how much you know about the broad domain and the specific problem that prompted you to submit the question.

4.1  Broad conceptual knowledge of the domain

On the scale below how would you rank the state of your knowledge in relation to the broader domain to which your problem is related?

Little personal knowledge of the domain; wide gaps Considerable specific knowledge of the domain; few gaps

4.2 Specific knowledge or expertise of the problem

On the scale below please indicate how you would rank the specific knowledge or expertise you feel you possess in relation to the problem at hand?

Little specific knowledge or expertise Considerable specific knowledge or expertise

4.3  Familiarity with the language or terminology used in the problem or domain

A problem, as well as a domain, tends to use terminology specifically defined for its own purposes. On the scale below please indicate how familiar you are with the specific domain or problem-oriented terminology in current use?

Not familiar with or versed in the domain or problem terminology Very familiar with, or versed in, the domain or problem terminology

5. Information Seeking Behaviour

5.1   Looking again at the stage you are at in your work, could you say which of the following terms best defines what you are doing?

5.1.1 _____ Collection - "Having focused my problem I am now collecting specific relevant information."
5.1.2 _____ Exploration - "I am now identifying specific information sources that I think will be of use to me."
5.1.3 _____ Formulation - "The information I have found has enabled me to form a clearer focus on the problem."
5.1.4 _____ Initiation - "I have recognised that I need information at this stage of my work."
5.1.5 _____ Presentation - "I am in the process of finishing the collection of information for this stage of my work."
5.1.6 _____ Selection - "I have identified the general area in which I need information."

5.2 How would you describe your thinking about the problem at this stage?

General or Vague Clear or focused

5.3 How would you describe your level of interest in the problem at this stage?

A rather low level of interest A high level of interest

5.4 And finally, in general, how do you feel about the progress of your work at this point?

5.4.1  Very uncertain Very certain
5.4.2  Pessimistic Optimistic
5.4.3  Confused Clear
5.4.4  Frustrated Relieved
5.4.5  Doubtful Confident
5.4.6  Dissatisfied Satisfied
5.4.7  Dissappointed Pleased

6.  Information Seeking Activities

Which of the following activities is important in your information seeking at this stage?

6.1 Following chains of citations or other forms of referential connection between documents.

Low importance Very important

6.2 Browsing or semi-directed searching in an area of potential interest.

Low importance Very important

6.3 Differentiating sources of information on the basis of the nature and quality of the material examined.

Low importance Very important

6.4 Maintaining awareness of developments in relation to this topic through the monitoring of particular sources.

Low importance Very important

6.5 Systematically working through a particular source to locate material of interest.

Low importance Very important

6.6 Verifying or checking the accuracy of information.

Low importance Very important

6.7 At this point in your search which of the following have you actually engaged in? (Please tick as many as necessary)

6.7.1

_____

Browsing or semi-directed searching in an area of potential interest.

6.7.2

_____

Differentiating sources of information on the basis of the nature and quality of the material examined.

6.7.3

_____

Following chains of citations or other forms of referential connection between documents.

6.7.4

_____

Maintaining awareness of developments in relation to this topic through the monitoring of particular sources.

6.7.5

_____

Systematically working through a particular source to locate material of interest.

6.7.6

_____

Verifying or checking the accuracy of information.

7.  Uncertainty.

(Client to fill this in on Client Response Form - filename clientc.doc)

"I. d now like to ask you about how sure you are about the problem you are investigating and about the probability of useful information being found. Could you reply to each of these points in the way shown on the attached card?"

Please respond to each of the items below by marking a cross (X) on the line to indicate your level of uncertainty regarding the item. For example:

Very uncertainVery certain

will indicate that you feel rather uncertain about an item.

How certain are you:

a) that you have recognised a real issue to investigate?

Very uncertainVery certain

(Prompt for uncertainty question (a) a real problem is - A problem that you think needs to be solved)

b) that you have defined the topic appropriately?

Very uncertainVery certain

c) that the issue can be resolved?

Very uncertainVery certain

d) that an effective way of presenting the results can be found?

Very uncertainVery certain

e) that relevant information is available and can be found?

Very uncertainVery certain

8. Information seeking.

8.1 "Can you tell me what you have done so far to find information on this problem? That is, what journals you have been scanning, what personal contacts you have been following up, whether you have done a search on BIDS or on the campus CD-ROMS or the World Wide Web yourself, etc."

[Interviewer: Probe to get the names of key journals that the client is aware of, which other information sources s/he has used, or regularly uses, which authors work regularly in the field or who are frequently cited, etc.]

Did the searching involve (checklist for interviewer - client can indicate as many as necessary):

____(1) Web based database(s) or information sources
____(2) on-line database(s), searching done by a librarian (intermediary)
____(3) on-line database(s), searching done on your own
____(4) printed index(es)
____(5) library catalogue(s)
____(6) library collection without use of a catalogue
____(7) own collection
____(8) colleagues. collection
____(9) other, please specify: ____________________
____(10)

None

8.2 If you have carried out previous searches, how successful was the previous search or searches in finding desired information?

(Client to fill this in on Client Response Form - filename clientc.doc)

Nothing useful found A lot of useful information found

8.3 Did any of the above previous searches contribute to the formulation of your present question?

____ ____
No Yes


If yes, in what way: _______________________________________________

8.3 Did anything arise out of that previous search that would be of use to me in carrying out a search for you?

[Space for response]

9. Comprehensiveness of the search:

A search could be varied as to its comprehensiveness, from retrieving a few potentially relevant or representative items, to retrieving as many potentially relevant items in the database as possible. On the scale below, please indicate how comprehensive you would like the search to be:

Narrow - a few representative items will suffice Comprehensive - most if not all relevant items are desired.

10. Other aspects.

Language: are you able to use any material I might find in languages other than English?

Date: how far back in time would it be useful to take the search? Five years, ten years, longer? How recent would you like the material to be.

Kinds of information: are there any particular kinds of information that will be of interest to you other than journal papers? For example, laws and statutes, standards, patents, unpublished reports, conference proceedings? Or should any of these be specifically avoided?

Sources to avoid: are there any sources (such as particular) journals that you already know are unlikely to be of value to you?

Authors: are there any authors or researchers to avoid because they take a different approach from yourself? Or that ought to be included for the same reason?

Approaches: are there particular approaches to the problem that I should avoid because they are inappropriate for the approach you are taking yourself?

11. Finally:

Are there any other aspects of your work, or of this problem that might be of help to me in carrying out a search?

12. Recapitulation of the search problem and desired solutions.

(NB: At the end of the reference interview read out statement made at the start.
Recap on the data and language - need a checklist sheet for that?)

Demographics

1. Status Name: 
First              Initial                 Last
Staff - Title: 
Department, school: 
Professional outside a university: Title: 
Organisation: 
Student
Degree sought: 
Subject: 
Department or school:
Present level of attainment (e.g. first year, dissertation research etc.):
2. Education
Highest degree attained and subject:  

3. Application
Type of work related to the question submitted for searching:
____(1) Staff research - funded
____(2) Staff research - not funded (Grant applied for ___)
____(3) R & D outside a university
____(4) Ph.D. dissertation research
____(5) Master. s thesis
____(6) Graduate study
____(7) Teaching
____(8) Other, please describe  

4. Age: ___ 5. Gender: Male___ Female___

Previous research has shown that the age of the information seeker may have an effect on other variables in information seeking behaviour. So I. d like to ask you to state your age for me. (Age - has been shown to be positively related to knowledge within a field.)

6. Research Student

Is the project you are working on one that you identified yourself or one that your supervisor identified? Yes ____ No____

(To be completed after the reference interview by the interviewer - )

Classification of the client. s question

This form is to be completed by the searcher prior to going on-line to conduct the search. We assume that the question has certain attributes or characteristics above and beyond its subject content and that the searcher can recognise these on the basis of the written question statement.

1. Clarity

How clear was the question to start with in terms of semantics (meaning of terms) and syntax (relationship or logic between terms)?

Quite unclear Very clear

2. Specificity

How specific in terms of the majority of terminology involved was the question?

Quite broad Quite narrow

3. Complexity

How complex was the question in terms of the number of search concepts likely to be involved (where a search concept could be translated into any number of related, near-synonyms or synonymous terms)?

Low complexity - few search concepts High complexity - many search concepts

Return to the Top of the Page


B: Post search instruments

Assessment of the search

For project use: Client number: U_______
Date:________ Question number: Q____
Interaction type: I ____ Search number: S____
Database(s) search: D: ____________________  
Client name:  
   

(Asked immediately after the search)

(The interviewer will ask:)

Could you identify your main criteria for judging the relevance of items presented to you during the search?

Example

In some questions you will be asked by the interviewer to indicate your answer by marking a cross on the line. An example of this type of question is provided below.

Please respond to each of the items below by marking a cross (X) on the line to indicate your level of uncertainty regarding the item.

For example:

Very uncertainVery certain

will indicate that you feel rather uncertain about an item.

Assessment of the search

In the following questions I would like you to give us a brief indication of the search in relation to the items on this questionnaire.

1. Effectiveness of communication

1.1 Your explanation (as the client) to the searcher

On the scale below please mark on the scale the position that indicates how well you think that your original explanation of the problem was effective?

I feel that my explanation was not effective I feel that I did a very good job in explaining my needs

1.2 Searcher. s explanation

Please indicate on the scale below how well the searcher explained to you what was going on in the search.

For this search I feel that the searcher was not effective in explanation The searcher was very effective in explanation

1.3 Understanding by you as a client

On the scale below could you please mark how well you understood what was going on?

I gained little or no understanding I gained very good understanding

1.4 Understanding by the searcher

On the scale below could you indicate to what extent you think the searcher gained an understanding of your problem?

Can't judge _____

I feel that the searcher gained little or no under-standing of my problem The searcher gained great under-standing of my problem

1.5 Non-verbal communication

On the scale could you indicate how far the searcher. s non-verbal communication contributed to the effectiveness of your interaction with the searcher? (Prompts: nodding, smiling or lack of smile, silence, eye-contact, non-verbal sounds etc).

Non-verbal communication had a negative effect on interaction Non-verbal communication had a positive effect on interaction

2. Changes due to interaction

2.1 Changes in perception of the problem

On the scale below can you indicate any changes you have made in your perception of the problem from the outset of the search?

No changes in my problem perception or definition Significant changes

If yes, what were the changes? Were the changes brought about by the search?

2.2 Changes in the question

Have you made any changes in your question from the outset of the search? (Changes may include but are not limited to clarification, changes in terminology or level of specificity etc.)

No changes in question from the version submitted in writing Significant changes

If yes, what were the changes in your question?

2.3 Changes in personal knowledge

On the scale below please indicate if any changes occurred in your personal knowledge, of the specific problem at hand, due to the interaction and/or the feedback during the search?

No changes in my personal knowledge on the domain or the problem Significant changes in my personal knowledge on the domain or the problem

If there were any changes, what were they?

2.4 Changes in relevance judgement

Please indicate on the scale below if you made any changes in your criteria for relevance judgements of the items retrieved due to the interaction and /or the feedback during the ongoing search?

No changes in relevance judgements due to the interaction or search feedback Significant changes in relevance judgements

If you made some changes in your relevance judgement what were they?

3. Uncertainty

When you were first interviewed you were asked about the certainty of your knowledge about certain aspects of the problem. I. d like to ask you again about the same issues now we. ve carried out a search.

Could you reply to each of these points in the way shown below?

Please respond to each of the items below by marking a cross (X) on the line to indicate your level of uncertainty regarding the item. For example:

Very uncertainVery certain

will indicate that you feel rather uncertain about an item.


How certain are you:

a) that you have recognised a real issue to investigate?

Very uncertainVery certain

b) that you have defined the topic appropriately?

Very uncertainVery certain

c) that the issue can be resolved?

Very uncertainVery certain

d) that an effective way of presenting the results can be found?

Very uncertainVery certain

e) that relevant information is available and can be found?

Very uncertainVery certain

Research preference questionnaire

Example. In some questions you will be asked by the interviewer to indicate your answer by marking a cross on the line. An example of this type of question is provided below.

Please respond to each of the items below by marking a cross (X) on the line to indicate your level of uncertainty regarding the item.

For example:

Agree with statement on the left Agree with statement on the right


1.

When reading a book (or other information source) for my research I generally tend to concentrate on certain parts, and skip over others quite markedly, going back later if necessary to fill in and . gaps. or . missing links. . I tend to follow the author. s presentation reasonably closely, rather than skipping about a lot

2.

When I. m researching a new subject, I tend to want to keep the whole picture of the subject in my mind all the time and find it hard to concentrate on very detailed aspects unless I can constantly relate them clearly to the broad overall picture. Once I. ve analysed the subject into its component parts, I like to focus on each of these parts in detail, systematically building up the overall picture bit by bit.

3.

Generally I prefer to concentrate on one (or a very few) aspect(s) of a subject at a time when I. m learning about it. Generally I prefer to be learning about a number of different aspects of a subject at the same time.

4.

Once I. ve done a basic analysis of what the subject involves I. m happy to put to the back of my mind temporarily the broad overall picture while I do some work on more detailed aspects. I tend to want to keep the overall picture uppermost in my mind the whole time, and only work on more detailed aspects if I can see precisely how they will fit in to this picture.

5.

I like to approach a new subject in a broad way - often looking at widely spaced aspects of the subject and seeing how they may all fit together, before going back to . fill in. any strictly logical steps that I may have skipped. I like the logical links between different aspects of a new subject to be very close so that when I. m learning about a second aspect I can see very clearly how it relates to the first aspect that I have already learned about, and so on.

6.

I find it too restrictive to wait until I have thoroughly . mastered. one aspect of a new subject I am learning about before going on to study other aspects. I like to deal fairly thoroughly with the particular aspect I. m working on before going on to study others.

7.

When I. m reading a book (or other information source) for my research I prefer to work through it fairly logically from beginning to end. I prefer to skip about and . dip in. quite a lot.

Return to the Top of the Page


C: Searcher assessment of the search

For project use: User number: U_______
Date:________ Question number: Q______
Interaction type: I ______ Search number: S_______

Database(s) search: D:________________

Post search assessments by the searcher

(This form is to be completed by the searcher after the conclusion of the interaction and the search.)

1. Problem definition

How well do you think the problem was defined by the user to start with? On the scale below please show how you would describe the user's degree of clarity.

Can't judge _____

Weakly defined or relatively unfocused Well defined or well focused

2. Problem stage

What stage was the client in terms of defining or resolving the problem, or in presenting the answer? Please respond using one of the categories indicated below:

o Problem recognition: I am trying to determine whether or not the topic I. m interested in is a real problem from the point of view of the discipline or area that interests me. I need a search so that I can discover whether others have identified the same issue as problematical.

o Problem definition: I have identified a real problem and now need to define it more closely or carefully so that I can determine how to approach the problem and how it relates to other problems in the field. I need a search to help me define my research objectives.

o Problem resolution: I am in the process of resolving the problem (engaged in laboratory experiments, field work, etc.) and now need a search to enable me to proceed with and complete that work. The question deals with a particular problem that I need to resolve in completing the work or with aspects of methodology, research approach or research methods.

o Solution statement: I have effectively finished the work I was doing and am either tying up loose ends, or finding out from related work how best to report my research or where best to report it.

3. Intent or purpose for use of obtained information

Please indicate on the scale below how you would describe the degree to which the user's intended use was well defined or envisaged to start with?


Can't judge _____

Use was not specifically defined or many uses possible Use was specifically defined, or one or few specific uses intended

4. Familiarity with problem or domain language or terminology

Can't judge _____

I felt that the user was not familiar or well versed with the domain or problem terminology I felt that the user was very familiar or well versed with the domain or problem terminology

5. Searcher's language familiarity

I am not familiar or well versed with the domain or problem terminology I am very familiar with the problem terminology

6. Searcher's measures on the interaction processes

We are asking here for your impression or opinion as a searcher on a number of aspects and results dealing with the search of the above numbered question.

The first set of measures deals with various aspects associated with effectiveness of communication between you and the user.

The second set of measures deals with the effect of the search environment or the search setting

Finally, the third set of measures deals with a series of possible changes that the user and you may have had during and because of the interaction.

6.1. Effectiveness of communication

6.1.1 User's explanation toward you as the searcher

Please indicate on the scale below how you perceive the degree of effectiveness in the user's explanation to you about the problem and question at hand?

I feel that user's explanation was not effective I feel that the user did a very good job in explaining

6.1.2 Your explanation as the searcher toward the user

Could you indicate on the scale below how well you explained to the user what was going on in the search?

For this question I feel that my explanation was not effective I feel that I did a very good job in explaining

6.1.3 Understanding by the user

On the scale below could you please mark how well you feel the user understood what was going on?

Can't judge _____

For this search I feel that the user gained little or no understanding about the search process The user gained a very good understanding

6.1.4 Understanding by you as a searcher

On the scale below could you indicate to what extent you as the searcher gained an understanding of the user's problem?

For this search I feel that I gained little or no understanding of the problem I gained a very good understanding

6.1.5 User language - 'user talk'.

On the scale below indicate to what degree did you understand the user's specific language (or 'user talk') related to the problem at hand?

I gained little or no understanding of 'user talk' I gained considerable understanding of 'user talk'

6.1.6 Non-verbal communication

On the scale could you indicate how far non-verbalcommunication contributed to the effectiveness of your interaction with the user? (Prompts: nodding, smiling or lack of smile, silence, eye-contact, non-verbal sounds etc.

Non-verbal communication had a negative effect on interaction Non-verbal communication had a positive effect on interaction

7. Changes due to interaction

7.1 User's and searcher's changes in perception of the problem

7.1.1 By the user

Please indicate on the scale below whether you feel that any changes occurred in the user's perception or definition of the problem at hand, as the result of interaction with you and the feedback from the ongoing search?

Can't judge _____

No changes in user's problem perception or definition Significant changes

7.1.2 By the searcher

Please indicate on the scale below whether you feel that any changes occurred in your perception of the user's problem at hand as the result of interaction and feedback from ongoing search?

For this search no changes in my perception of problem Significant changes

7.2 User's changes in the question

Please indicate on the scale below whether you feel that as a result of the interaction and the feedback from ongoing search, the user changed the question from the version stated in writing at the outset of the search? (Changes may include but are not limited to clarification, changes in terminology or level of specificity etc.)

Can't judge _____

No changes in question from the version described in the refernce interview Significant changes

7.3 User's and searcher's changes in personal knowledge

7.3.1 By the user

Indicate on the scale below, whether, as far as you can tell, any changes occur in the user's personal or internal knowledge, either broad in the domain, or the specific in the problem at hand, due to the interaction and/or the feedback during the ongoing search?

Can't judge _____

In this search no changes occurred in the user's personal knowledge Significant changes occurred

7.3.2 By the searcher

Indicate on the scale below whether any changes occur in your personal or internal knowledge, either broad in the domain, or specific in the problem at hand due to the interaction and/or feedback during the ongoing search?

No changes in my personal knowledge on the domain or problem Significant changes

7.4 Changes in relevance judgement

On the scale below please indicate whether you feel that the user made any changes in his/her criteria for relevance judgement of items retrieved due to the interaction and/or the feedback during the ongoing search?

Can't judge _____

For this search no changes occurred in user's relevance judgements Significant changes

Go to the Top of the Page


D: Follow-up interview

For project use: User number: U_______
Date:________ Question number: Q______
Interaction type: I ______ Search number: S_______

Database(s) search: D:________________

1. Worth in relation to your time

Could you rate your participation and interaction in this on-line search, and the information you got as the result of it as (circle one):

5 Worth much more than the time it has taken

4 Worth somewhat more than the time it has taken

3 Worth about as much as the time it has taken

2 Worth less than the time it has taken

1 Practically worthless

2. Time and difficulty in evaluation

2.1 How much time did you spend in evaluating the total set of answers:

__________ (hrs. mins)

2.2 On the scale below please indicate how difficult it was for you to evaluate the answers as to the information conveyed?

Not difficult at all Very difficult

2.3 Please comment on the most useful results. Which have been the most interesting, or look the most promising, what is it about them that looks interesting? (3 or 4 results should be considered)

3. Focus and comprehensiveness of retrieved information

3.1 Focus or targeting

On the scale below please indicate how focused or precisely on target was the retrieved information in relation to the problem at hand and the question you asked?

Way off target Very much on target

3.2 Extraneous or non-relevant information

On the scale below please indicate how much extraneous or non-relevant (unwanted) information was included in answers in addition to relevant ones?

A great deal of non-relevant information included Practically no non-relevant information

3.3 Distraction caused by non-relevant information

If you considered that a great deal of non-relevant information was included, please indicate on the scale below, how bothersome or distracting this was to you in relation to relevant information found?

It was very bothersome or distracting negating the whole effort It bothered me very little or not at all

3.4 Completeness of retrieval

On the scale below please estimate how much of the information about your problem that is out there in the literature was retrieved, or conversely how much of it was missed by this search?

Can't judge _____

Most or all was missed Most or enough was retrieved

4. Contribution to the resolution of your problem

On the scale below please indicate what contribution has the information retrieved made toward the resolution of your problem?

Nothing contributed Substantial contribution

5. Problem stage

Now that you have looked at the results of the search and accessed some literature what stage are you in terms of defining or resolving the problem, or in presenting the answer? Please respond using one of the categories shown below.

o Problem recognition: I am trying to determine whether or not the topic I. m interested in is a real problem from the point of view of the discipline or area that interests me. I need a search so that I can discover whether others have identified the same issue as problematical.

o Problem definition: I have identified a real problem and now need to define it more closely or carefully so that I can determine how to approach the problem and how it relates to other problems in the field. I need a search to help me define my research objectives.

o Problem resolution: I am in the process of resolving the problem (engaged in laboratory experiments, field work, etc.) and now need a search to enable me to proceed with and complete that work. The question deals with a particular problem that I need to resolve in completing the work or with aspects of methodology, research approach or research methods.

o Solution statement: I have effectively finished the work I was doing and am either tying up loose ends, or finding out from related work how best to report my research or where best to report it.

6. Uncertainty

When you were first interviewed you were asked about the certainty of your knowledge about certain aspects of the problem. I. d like to ask you again about the same issues now we've carried out a search.


How certain are you:

a) that you have recognised a real problem to investigate?

Very uncertain Very certain

b) that you have defined the problem appropriately?

Very uncertainVery certain

c) that the problem can be resolved?

Very uncertainVery certain

d) that an effective way of presenting the results can be found?

Very uncertainVery certain

e) that relevant information is available and can be found?

Very uncertainVery certain

7. Expectancy, novelty, serendipity

7.1 Expectancy

Indicate on the line below to what degree were your expectations fulfilled or exceeded in respect to the retrieved information?

Found little or nothing that was not expected Expectations fulfilled or exceeded

7.2 Novelty

Indicate on the line below to what degree the information retrieved (which was related to your topic) new or novel to you?

Little or no novelty for me Information retrieved had considerable novelty for me

7.3 Serendipity

Indicate on the line below to what degree was the retrieved information serendipitous for you, i.e. finding unexpected, interesting information while looking for something else?

No serendipity in retrieved information Considerable serendipity

8. Overall satisfaction

8.1 On the scale below please indicate how satisfied in general were you with the results of the search?

Very dissatisfied Very satisfied

8.2 Thinking about the whole search process how well do you think you could have carried out the search yourself independently?

Ineffectively Effectively

8.3 How would you have carried out the search for information on this topic if this opportunity had not been available

9. About changes to your search topic

9.1 Changes in perception of the problem

On the scale below can you indicate any changes you have made in your perception of the problem from the outset of the search?

No changes in my problem perception or definition Significant changes

If yes, what were the changes? Were the changes brought about by the search?

9.2 Changes in your question

Have you made any changes in your question from the outset of the search? (changes may include but are not limited to clarification, changes in terminology or level of specificity etc.)

No changes in question from the version submitted in writing Significant changes

If yes, what were the changes in your question?

9.3 Changes in personal knowledge

On the scale below please indicate if any changes occurred in your personal knowledge, of the specific problem at hand, due to the interaction and/or the feedback during the ongoing search?

No changes in my personal knowledge on the domain or the problem Significant changes in my personal knowledge on the domain or the problem

If there were any changes, what were they?

9.4 Changes in relevance judgement

Please indicate on the scale below if you made any changes in your criteria for relevance judgements of the items retrieved due to the interaction and /or the feedback during the ongoing search?

No changes in relevance judgements due to the interaction or search feedback Significant changes in relevance judgements

If you made some changes in your relevance judgement what were they?

10. Information Seeking Behaviour

10.1 Looking again at the stage you are at in your work, could you say which of the following terms best defines what you are doing?

10.1.1 _____ Collection - "Having focused my problem I am now collecting specific relevant information."
10.1.2 _____ Exploration - "I am now identifying specific information sources that I think will be of use to me."
10.1.3 _____ Formulation - "The information I have found has enabled me to form a clearer focus on the problem."
10.1.4 _____ Initiation - "I have recognised that I need information at this stage of my work."
10.1.5 _____ Presentation - "I am in the process of finishing the collection of information for this stage of my work."
10.1.6 _____ Selection - "I have identified the general area in which I need information."

10.2 How would you describe your thinking about the problem at this stage?
General or Vague Clear or focused

10.3 How would you describe your level of interest in the problem at this stage?

A rather low level of interest A high level of interest

10.4 And finally, in general, how do you feel about the progress of your work at this point?

10.4.1 Very uncertain Very certain
10.4.2 Pessimistic Optimistic
10.4.3 Confused Clear
10.4.4 Frustrated Relieved
10.4.5 Doubtful Confident
10.4.6 Dissatisfied Satisfied
10.4.7 Disappointed Pleased

11. Information Seeking Activities

Which of the following activities is important in your information seeking at this stage?

11.1 Following chains of citations or other forms of referential connection between documents.

Low importance Very important

11.2 Browsing or semi-directed searching in an area of potential interest.

Low importance Very important

11.3 Differentiating sources of information on the basis of the nature and quality of the material examined.

Low importance Very important

11.4 Maintaining awareness of developments in relation to this topic through the monitoring of particular sources.

Low importance Very important

11.5 Systematically working through a particular source to locate material of interest.

Low importance Very important

11.6 Verifying or checking the accuracy of information.

Low importance Very important

11.7 At this point in your search which of the following have you actually engaged in? (Please tick as many as necessary)

11.7.1 _____ Browsing or semi-directed searching in an area of potential interest.
11.7.2 _____ Differentiating sources of information on the basis of the nature and quality of the material examined.
11.7.3 _____ Following chains of citations or other forms of referential connection between documents.
11.7.4 _____ Maintaining awareness of developments in relation to this topic through the monitoring of particular sources.
11.7.5 _____ Systematically working through a particular source to locate material of interest.
11.7.6 _____ Verifying or checking the accuracy of information.

12. Further searches and General Comments

In the time since the search have you conducted any further literature searches?

If you have:

12.1 What were the search criteria you used?

[Space for response]

12.2 Did the original search offer a basis for further investigation of the problem?

[Space for response]

12.3 Would you like to take this topic forward through further searches as your project progresses?

[Space for response]

12.4 Do you have any comments on the search, the interaction or the results?

(Please use the back of the page if necessary)

[Space for response]


Front Page Contents Report outline

Uncertainty in information seeking, by Professor Tom Wilson, Dr. David Ellis, Nigel Ford, and Allen Foster
Library and Information Commission Research Report 59
ISBN 1 902394 31 3      ISSN 1466-2949
Grant number LIC/RE/019