header
vol. 18 no. 1, March, 2013


Visitors and residents: what motivates engagement with the digital information environment?

Lynn Silipigni Connaway
OCLC Research, 6565 Kilgour Place, Dublin, Ohio 43017
David White
Technology Assisted Lifelong Learning, University of Oxford, Ewert House, Summertown, Oxford OX12 7AQ
Donna Lanclos
J. Murrey Atkins Library, University of North Carolina, Charlotte, 9201 University City Blvd., Charlotte, NC 28223
Alison Le Cornu
The Higher Education Academy, Innovation Way, York Science Park, York, YO10 5BR


Abstract
Introduction. This three-year project is funded by JISC, OCLC, Oxford University and the University of North Carolina, Charlotte. The project is an attempt to fill the gap in user behaviour studies identified in the JISC Digital Information Seeker Report.
Method. Semi-structured interviews with participants from four project-defined educational stages: emerging, establishing, embedding and experienced, are being conducted, supplemented by individual, monthly diaries. A survey will be conducted in Phase 3 to test the findings from the interviews with a broader sample. In year three, a second group will be interviewed in the 'emerging' educational stage to explore possible changes in behaviour over time.
Analysis. Analysis is being undertaken using the visitors and residents framework, which hypothesizes that neither age nor sex determines whether one is a visitor (one who logs on to the virtual environment, performs a specific task or acquires specific information and then logs off) or a resident (one who has an ongoing, developing presence online).
Results. Initial results highlight the importance of convenience as a crucial factor in information-seeking behaviour. There also are indications that as users progress through the educational stages, the digital literacies they employ do not necessarily become more sophisticated.
Conclusions. Although the project continues through 2014, the initial findings indicate that students in the emerging educational stage (late stage secondary school to first year undergraduate) use smart phones and laptop computers to access Wikipedia, Google, teachers or professors, friends and peers to get information for their academic studies.


Introduction

We have little understanding of what motivates individuals to use particular technologies or spaces when engaging with the information environment. As a result people tend to adopt simplistic but culturally panicked ideas in their attempts to grasp the problem while others delve into specifics to the extent that little substantive conclusions can be drawn. This lack of understanding also makes the task of facilitating digital literacy skills challenging, as any form of literacy has to be defined against the motivations and goals of those individuals being taught.

There is now a multiplicity of ways to engage in the information environment. Both physical and digital libraries are among the options available to the information seeker. The large number of available open-access choices creates a competitive information environment for schools and universities that expend a great amount of resources on the information environment in the form of academic staff, print and digital sources and physical space (such as laboratories, libraries and classrooms). The school or university resources are not necessarily the first or even second choices of the students and academic community, who often choose the more convenient, easier to use open-access sources (Beetham et al. 2009; Centre for Information Behaviour... 2008; Connaway and Dickey 2010; Warwick et al. 2008).

Objectives

This three-year longitudinal study is conducted in four iterations of a sample of students and scholars representing different stages of the educational lifecycle:

  1. emerging (late stage secondary school-first year undergraduate);
  2. establishing (second and third year undergraduate);
  3. embedding (postgraduates, PhD students);
  4. experienced (scholars).

The design of the study is an attempt to eliminate any assumed links between age and technological engagement by working with users over time, tracking the shifts in their motivations and forms of engagement as they transition between these educational stages. The study is using the visitors and residents principle proposed by White and LeCornu (2011) as an overarching framework to contextualize participants' motivations to engage with the digital environment. The findings will be used to create a matrix of implementation options, allowing those designing and delivering digital platforms and services to make informed decisions relative to engagement and motivation for individuals at each of the educational stages.

The quantitative and qualitative methods, including ethnographic methods and the individual attention devoted to the subjects will yield a very rich data set enabling multiple methods of analysis. Instead of reporting the general information-seeking habits of the Google Generation and their use of technology, this study explores how the subjects get their information based on the context and situation of their needs during an extended period of time, identifying if and how their behaviour changes. The project is user-centred, not platform- or discipline-centred. There is a history of research conducted on university campuses among undergraduates and faculty, in attempts by libraries and information scientists to learn about how people search for the information they need to live their lives, both in and out of academic environments (e.g., Bartley et al. 2006; Connaway 2008; Connaway et al. 2008; Delcore et al. 2009; Dervin et al. 2003; Foster and Gibbons 2007; Fister 1992; Gabridge et al. 2008; Head and Eisenberg 2009; Jordan and Ziebell 2009; Malvasi et al. 2009; Maybee 2006; Prabha et al. 2007; Suarez 2007; Valentine 2001; White and Le Cornu 2011; Witt and Gearhart 2003). Previous ethnographic studies of students (Bartley et al. 2006; Connaway 2007, Connaway 2008; Delcore et al. 2009; Dervin et al. 2003; Foster and Gibbons 2007; Gabridge et al. 2008; Wu and Lanclos 2011, and the Ethnographic Research in Illinois Academic Libraries (ERIAL) Project), in addition to focusing on university students, also have tended to be limited in time, gathering information from a given semester, or even during the course of a single project within the semester. The literature reviewed includes no longitudinal research studying individuals' information use and search behaviour within a contextual framework in the different educational stages. Another problem with previous studies is that there is very little attention paid to where information-gathering habits originally form in students; doing research exclusively among people who already are in university-either as students or as faculty-does not tell researchers where and how they learned to gather and evaluate information.

The emerging stage, then, is of particular interest as it bridges what is traditionally seen as a distinct divide between higher and tertiary education. We believe that this divide is notional and that the student's information-gathering techniques are unlikely to change in the few months between secondary school and university. By including the emerging educational stage the project will generate outputs which will enable universities to make informed decisions for planning services and systems for entering students; therefore, proactively planning rather than haphazardly reacting to passing trends.

Methodology and research questions

As participants transition through the educational system, they are demarcated by the educational stages mentioned above. In addition, participants will be chosen to draw out engagement factors relative to:

  1. cultural background: participants were recruited from matching educational-stages in both the UK and the USAA.
  2. socio-economic background: participants were recruited to represent a range of socio-economic backgrounds.
  3. disciplinary focus: participants were recruited from the arts and humanities, social sciences and sciences.

Selecting participants on this basis allows the researchers to distinguish generic engagement factors from those that are specific to particular groups.

A set of questions were developed for the individual interviews with the participants. The same questions were asked of all participants. These questions were developed based on the literature and previous research and addressed the participants' needs and behaviour in both personal and academic situations and contexts. See Appendix A for the questions.

Using the visitors and residents principle as a framework, a subset of individuals from each of the educational stages is being tracked (through the monthly interviews, review of diaries, etc.) to identify their changing approaches to the information environment as they move through the educational stages. The participants were given a choice of communication methods, such as instant messenger interviews, email, Facebook, paper or electronic diaries, blogs, face-to-face, or telephone, with the research team. The choice they make provides additional information about the different participants' preferred forms of communication and insight into how services need to be presented as context and expectations shift during the educational lifecycle.

The three-year, four-phased study is based on the following key research questions:

Phase 1: Pilot stage, months 1-6

The initial six-month pilot stage has focused on the emerging educational stage to refine the research methodology and to establish the value of the work to the funders and other supporters. In the USAA the project worked in close partnership with the University of North Carolina, Charlotte (UNCC) to recruit participants from different socio-economic groups, from both private and public secondary schools as well as first-year university students. In the UK participants were drawn from Oxford Brooks University, Warwick University and secondary schools in Oxford and Leicester.

Participants

Thirty-one individuals in the emerging educational stage (late stage secondary or high school and first-year university) were recruited: sixteen in the USA and fifteen in the UK and ranged in age from 16 years old to middle age. See Tables 1 and 2. Of the sixteen first-year university students, nine were in the USA and seven in the UK. Five of the USA students had chosen an engineering major, one was in political science, one in pre-business and two were undeclared. From the UK, three had chosen teaching, one was in chemical biology, one in chemistry, one in history and one in languages.

Of the thirty-one participants recruited, fourteen (eight in the USA and six in the UK) were asked to document their information-seeking activities for a three-month period. They were closely facilitated through this process and communicated with the research team in the medium of their choice during this period.

Data

The information collected from the interviews and monthly correspondence with the selected fourteen students provide rich data that have been analysed and reported both quantitatively and qualitatively.

...our generation isn't technology orientated. I think it's always a stereotype. (Participant UKS4)
I just type it into Google and see what comes-up... (Participant UKS2)
I always stick with the first thing that comes up on Google because I think that's the most popular site which means that's the most correct. (Participant USAS1)

A code book was developed from the emerging themes of the interview transcripts. Then the data were manually coded using theme analysis based on the code book and input into the NVivo software program. This enabled the researchers to analyse and report the data not only by themes and demographics but also by the number of respondents and percentiles.

Note: For anonymity, participants are designated with tags which indicate their country (UK or USA), their educational stage (S for Secondary school/High school, U for University, G for Grads, or F for Faculty) and then an individual number.

Phase 2: months 7-12

The study has been extended to include ten participants from the other three educational stages (five USA and five UK). Building on the principle of Phase 1, the additional participants have been recruited from a post-1992 institution, such as Oxford Brookes University and a Russell Group university, such as Warwick University in order to more accurately portray typical UK students and scholars. This brings the total number of participants, including those from the pilot phase to sixty-one. In the USA, recruiting has continued at UNC Charlotte, which has a history of non-traditional students (especially returning students and transfer students), but has recently begun recruiting larger percentages of students directly from high school, providing an opportunity to have a broader sample of USA students and scholars.

Although the researchers only will discuss the findings from the first two phases of the study, it is important to explain the other two phases of the study to fully understand the scope of the project and the possible impact the findings may have on planning services and systems for students entering universities; therefore, the following phases are outlined to set the pilot phase in the context of the overall longitudinal study. These phases are likely to be iteratively modified to account for ongoing findings and to ensure that the overall study remains as relevant to the stakeholders as possible over time.

Phase 3: months 13-24

In addition to the tracking of the fourteen diarists during the second phase of the study, an online survey will be developed and disseminated to a total of 400 students and scholars-split equally between the USA and the UK. Fifty participants from each of the four educational stages will be selected from each of the universities. The participants will be asked questions derived from the collection and analysis of data collected from the sixty-one participants during the first two phases of the project. Since the longitudinal study sample is small, the online survey is a way to involve more participants in the study to compare with the data collected from the individuals who participate in the three-year study.

Phase 4: months 25-36

In the third year the project will work with a second group of six students (three students from each of the two types of universities) in the emerging stage. This will help to determine if methods of engagement are changing over time as well as through the educational stages.

It is not anticipated that the expectations of the members of the four educational stages will be met by the educational institutions. The educational process should, at times, be challenging and possibly disruptive; there should be a healthy tension between educational institutions and those it is there to serve. However, if a clear picture of student expectations, motivations and behaviour can be identified, informed decisions can be instrumental in determining what expectations should be challenged and the benefit to the learners that these challenges deliver.

Emerging findings

The analysis of phase 1 and 2 data is in its early stages. The development of the code book is a major finding, since it was grounded in the data; notably, to date, the word librarian was never mentioned by title as a source of information. However, Participant USAU5 did so indirectly by referring to 'a lady in the library who helps you find things'.

The project is identifying learner owned digital and information literacies that are little understood by educational institutions. Examples of these include:

The researchers have been experimenting with mapping individual participant's data to the visitors and residents framework as a way of identifying modes of engagement. See Appendix B for an example mapping. (The numbers on the dark blue blocks in the mapping diagram represent the time-code point in the interview at which the participant discussed an activity or approach. A number of quotes have been added to the maps to give a sense of the data that are being plotted and of the character of the participant in terms of the visitors and residents continuum).

A goal of the project is to develop a method which will programmatically produce simple mappings of this type which draw on interview and survey data to indicate engagement trends across key groups. This prototype mapping system can be used as a tool to visually communicate the modes of engagement within the visitors and residents framework as well as a broad model of how digital and information literacies evolve across the educational stages.

The project also is attempting to define the transition points when individuals are most likely to change their mode of participation. For example:

Conclusion

The findings from this research can inform institutions of higher education of current and perspective students' expectations of services and systems based on their engagement with technology and their information-seeking behaviour in different contexts and situations. The research uses both quantitative and qualitative data collection methods, which enable triangulation of the data to provide a more nuanced understanding of students' and scholars' engagement with technology.

Although this project is a multi-phased longitudinal study funded by four institutions, it can be used as a model for single institutions to study and learn about their user groups. This study is not limited to any one organization within the university community; therefore, it can be easily adapted to many different situations. This type of research can be initiated by professionals to collect data that can help organizations make planning decisions based on evidence.

The research findings to date and the research methodology provides others, including those who are new to research, the opportunity to replicate all or selected phases of the research. The more that researchers replicate the methodology used for this project, the better chance there is of making sense of how individuals engage with technology for their information-seeking behaviour, while transitioning between the different educational stages.

Acknowledgements

The authors want to thank Erin Hood, Research Assistant, OCLC Research, for her assistance in analysing the data and preparing the manuscript.

About the authors

Lynn Silipigni Connaway, Ph.D. is a Senior Research Scientist at OCLC Research. She has experience in academic, public and school libraries, as well as library and information science education. She can be contacted at: connawal@oclc.org
David White co-manages Technology-Assisted Lifelong Learning (TALL), an award-winning e-learning research and development group in the University of Oxford. He can be contacted at: david.white@conted.ox.ac.uk
Donna Lanclos, Ph.D. is currently the Library Ethnographer at the University of North Carolina, Charlotte, directing projects on the ethnography of academic work in Optical Engineering, as well as UNC Charlotte student and faculty academic work and information gathering practices in and out of the library. She can be contacted at: dlanclos@uncc.edu
Alison Le Cornu, Ph.D. is Academic Lead for Flexible Learning with the Higher Education Academy in the UK. She was previously a member of the Technology-Assisted Lifelong Learning team in the Department for Continuing Education at Oxford University where she was co-investigator with the Visitors and Residents project. She can be contacted at: alison@alisonlecornu.co.uk

References
  • Bartley, M., Duke, D., Gabridge, T., Gaskell, M., Hennig, N., Quirion, C., Skuce, S., Stout, A. & Duranceau, E. F. (2006). User needs assessment of information seeking activities of MIT students-spring 2006. Retrieved 15 February, 2013 from http://dspace.mit.edu/bitstream/handle/1721.1/33456/userneeds-report.pdf?sequence=1 (Archived by WebCite® at http://www.webcitation.org/6ESNylOP8)
  • Beetham, H., McGill, L. & Littlejohn, A. (2009). Thriving in the 21st century: learning literacies for the digital age (LLiDA Project). Glasgow: The Caledonian Academy, Glasgow Caledonian University. Retrieved 16 February, 2013 from http://www.jisc.ac.uk/media/documents/projects/llidaexecsumjune2009.pdf (Archived by WebCite® at http://www.webcitation.org/6EThMAE7o)
  • Centre for Information Behaviour and the Evaluation of Research [CIBER]. (2008). Information behaviour of the researcher of the future: a CIBER briefing paper. London: CIBER. Retrieved 15 February, 2013 from http://www.jisc.ac.uk/media/documents/programmes/reppres/gg_final_keynote_11012008.pdf (Archived by WebCite® at http://www.webcitation.org/6ESOA3gax)
  • Connaway, L. S. (2007). Mountains, valleys and pathways: serials users' needs and steps to meet them. Part I: Preliminary analysis of focus group and semi-structured interviews at colleges and universities. Serials Librarian, 52(1/2), 223-236. Retrieved 15 February, 2013 from http://www.oclc.org/research/publications/archive/2007/connaway-serialslibrarian.pdf (Archived by WebCite® at http://www.webcitation.org/6ESOGuHv4)
  • Connaway, L. S. (2007). Mountains, valleys and pathways: serials users' needs and steps to meet them. Part I: Preliminary analysis of focus group and semi-structured interviews at colleges and universities. Serials Librarian, 52(1/2), 223-236. Retrieved 15 February, 2013 from http://www.oclc.org/research/publications/archive/2007/connaway-serialslibrarian.pdf (Archived by WebCite® at http://www.webcitation.org/6ESOGuHv4)
  • Connaway, L. S. & Dickey, T. J. (2010). The digital information seeker: report of the findings from selected OCLC, RIN and JISC user behaviour projects. Retrieved 15 February, 2013 from http://www.jisc.ac.uk/media/documents/publications/reports/2010/digitalinformationseekerreport.pdf (Archived by WebCite® at http://www.webcitation.org/6ESOU9yX6)
  • Connaway, L. S., Radford, M. L., Dickey, T. J., Williams, J. D. & Confer, P. (2008). Sense-making and synchronicity: information-seeking behaviors of millennials and baby boomers. Libri, 58(2), 123-135. Retrieved 15, February 2013 from http://www.oclc.org/research/publications/archive/2008/connaway-libri.pdf (Archived by WebCite® at http://www.webcitation.org/6ESOYYz2O)
  • Delcore, H. D., Mullooly, J. & Scroggins, M. (with Arnold, K., Franco, E. & Gaspar, J.). (2009). The library study at Fresno State. Fresno, CA: Institute of Public Anthropology, California State University. Retrieved 15 February, 2013 from http://www.fresnostate.edu/socialsciences/anthropology/documents/ipa/TheLibraryStudy(DelcoreMulloolyScroggins).pdf (Archived by WebCite® at http://www.webcitation.org/6ESOcM74i)
  • Dervin, B., Connaway, L. S. & Prabha, C. (2003). Sense-making the information confluence: the whys and hows of college and university user satisficing of information needs.
  • Foster, N. F. & Gibbons, S. (2007). Studying students: the undergraduate research project at the University of Rochester. Chicago, IL: Association of College and Research Libraries.
  • Fister, B. (1992). The research process of undergraduate students. The Journal of Academic Librarianship, 18(3), 163-169.
  • Gabridge, T., Gaskell, M. & Stout, A. (2008). Information seeking through students' eyes: the MIT photo diary study. College and Research Libraries, 69(6), 510-522.
  • Head, A. & Eisenberg, M. B. (2009). Lessons learned: how college students seek information in the digital age. Seattle, WA: The Information School, University of Washington.
  • Jordan, E. & Ziebell, T. (2009). Learning in the spaces: a comparative study of the use of traditional and 'new generation' library learning spaces by various disciplinary cohorts. Queensland, Australia: The University of Queensland. Retrieved 15, February 2013 from http://espace.library.uq.edu.au/eserv/UQ:157791/NextGenLearningSpacesPaper.pdf (Archived by WebCite® at http://www.webcitation.org/6ESOiVKIz)
  • Malvasi, M., Rudowsky, C. & Valencia, J. M. (2009). Library Rx: measuring and treating library anxiety. A research study. Chicago, IL: Association of College and Research Libraries.
  • Maybee, C. (2006). Undergraduate perceptions of information use: the basis for creating user-centred student information literacy instruction. The Journal of Academic Librarianship, 32(1), 79-85.
  • Prabha, C., Connaway, L. S., Olszewski, L. & Jenkins, L. R. (2007). What is enough? Satisficing information needs. Journal of Documentation, 63(1), 74-89.
  • Suarez, D. (2007). What students do when they study in the library: using ethnographic methods to observe student behavior. Electronic Journal of Academic and Special Librarianship, 8(3). Retrieved 15, February 2013 from http://southernlibrarianship.icaap.org/content/v08n03/suarez_d01.html (Archived by WebCite® at http://www.webcitation.org/6ESOmHTF9)
  • Taylor, A. (2012). A study of the information search behaviour of the millennial generation. Information Research, 17(1), paper508. Retrieved 15, February 2013 from http://informationr.net/ir/17-1/paper508.html (Archived by WebCite® at http://www.webcitation.org/6ESOpKfvZ)
  • Valentine, B. (2001). The legitimate effort in research papers: student commitment versus faculty expectations. The Journal of Academic Librarianship, 27(2), 107-115.
  • Warwick, C., Galina, I., Terras, M., Huntington, P. & Pappa, N. (2008). The master builders: LAIRAH research on good practice in the construction of digital humanities projects. Literary and Linguistic Computing, 23(3), 383-396. Retrieved 15, February 2013 from http://discovery.ucl.ac.uk/13810/1/13810.pdf (Archived by WebCite® at http://www.webcitation.org/6ESOurK0l)
  • White, D. & Le Cornu, A. (2011). Visitors and residents: a new typology for online engagement. First Monday, 16(9). Retrieved 15, February 2013 from http://firstmonday.org/htbin/cgiwrap/bin/ojs/index.php/fm/article/viewArticle/3171/3049 (Archived by WebCite® at http://www.webcitation.org/6ESRHzkxq)
  • Witt, S. & Gearhart, R. (2003). Ethnography and information literacy: an assessment project. In E. F. Avery (Ed.), Assessing student learning outcomes for information literacy instruction in academic institutions, (pp. 265-278). Chicago, IL: Association of College and Research Libraries.
  • Wu, S. K. & Lanclos, D. (2011). Re-imagining the users' experience: an ethnographic approach to web usability and space design. Reference Services Review, 39(3), 369-389.
How to cite this paper

Connaway, L. S., White, D., Lanclos, D. & Le Cornu, A. (2012). Visitors and residents: what motivates engagement with the digital information environment? Information Research, 18(1) paper 556. Retrieved from http://InformationR.net/ir/18-1/paper556.html

Check for citations, using Google Scholar


Appendix A

Participant interview questions – Secondary/High school and University level

  1. Describe the things you enjoy doing with technology and the web each week.
    This is a conversational start in order to put the interviewees at their ease. We are trying to get a sense of their overall digital literacy so that we can set their information seeking behaviors within a broader context. Do they socialize online? (See probe.) Do they ‘contribute' online in the form of pictures, video, blogs, etc.?
    [PROBES: How important is the web for your social life, do you use it to keep in touch with your friends? What gadgets/devices/things do you use the most, is there anything you ‘couldn't live without'? How much time on average do you spend online each week? Is there anything that bothers you about being online?]

  2. Think of the ways you have used technology and the web for your studies. Describe a typical week.
    We are looking at interviewees' use of educational technologies more specifically for study. We hope they will start to introduce informal learning, self-directed study, peer to peer learning, etc. We anticipate they will (or may not) mention Facebook, MySpace, etc.
    [PROBES: How do you keep track of things? What systems for learning online do you have? Can you give us any examples of when you've asked your friends for help on assignments/homework online? What kind of online resources have you found that help you with your studies? How did you find them? What other gadgets or devices do you use for your studies?]

  3. Think about the next stage of your education. Tell me what you think this will be like.
    [Alternative University Student Interviews: What did you think university studies would be like when you were in high school? How is your experience different from what you thought it would be? Describe what you think the next stage of your education will be. Tell me what you think this will be like.]
    This will hopefully encourage them to reflect on what they envisage their role will be in the next stage. What they imagine the next educational-stage to be like will be something we can cross check as we follow them through the project.
    [PROBES: How do you think you will use technology in the next part of your education? If you think you will need to adapt the way you use technology, what sort of changes do you think you'll make?]

  4. Think of a time when you had a situation where you needed answers or solutions and you did a quick search and made do with it. You knew there were other sources but you decided not to use them. Please include sources such as friends, family, teachers, TAs, tutors, coaches, etc. Prompt for both academic and informal (domestic, personal...) examples.
    [PROBES: Did you simply take the first answer/solution you were able to find? What was the situation? What sources did you use? What led you to use them...and not others? Did they help? How? What sources did you decide not to use? What led to this/these decision/s? What did source A give you that you thought source B could not? Are there situations where source B would ‘be a better choice for you? How did you decide when it was time to stop looking? How did you assess what was good enough?]

  5. Have there been times when you were told to use a library or virtual learning environment (or learning platform), and used other source(s) instead?
    [PROBE: What made you decide not to use what you were asked to use? What kinds of things do your instructors want you to do when you're looking for information? Does what you do look like that, and if not, what does it look like?]

  6. If you had a magic wand, what would your ideal way of getting information be? How would you go about using the systems and services? When? Where? How?

  7. What comments or questions do you have for me? Is there anything you would like me to explain? What would you like to tell me that you've thought about during this interview?

Appendix B


Example mapping of a participant's modes of engagement

Example mapping of a participant's modes of engagement using the visitors and residents framework (including selected direct quotes)