Strategies, obstacles, and attitudes: student collaboration in information seeking and synthesis projects
Chris Leeder and Chirag Shah
Introduction
Collaboration is increasingly important in education and work in the 21st century (Barron et al., 2009). At the same time, information and communication technologies are becoming a ubiquitous component of classroom learning (Lampe, Wohn, Vitak, Ellison and Wash, 2011). Today’s students expect to work in groups, share knowledge, and interact socially with peers (Flanagin and Metzger, 2008; Manuel, 2002). Networked social computing enables social interactions that students value (Head and Eisenberg, 2010). Students are accustomed to a socio-technical environment of social media tools such as blogs, chat, discussion forums, collaborative online editing, digital media creation, and social networking (Halse and Mallinson, 2009). These networked information-sharing tools facilitate active involvement in the learning process, which is crucial to effectively educating today’s students (Halse and Mallinson, 2009).
Despite the importance of studying and supporting collaborative work in educational contexts, we still lack certain knowledge about (1) how students’ attitudes towards group work affect their collaboration; (2) what obstacles students face when they collaborate; and (3) how students form and change their strategies as they work through a group project. To investigate these specific aspects of collaborative practices of students, a study was conducted with students during real group project research, which involved information seeking and synthesis. Data gathered for the study included server log data of students using a collaborative search system, together with questionnaires regarding their strategies used in group work, obstacles to successful group work, and attitudes towards group work, as well as changes in those perceptions from before to after completing the project. The final group project grades were used as a measure of success for each group’s collaborative activities. The results presented provide insight into how students collaborate in group projects, their behaviour and attitudes towards group projects, and offer suggestions for instructors and designers to better support students in group work.
Literature review
In research in information behaviour, studies that focus on students’ information seeking behaviour have often treated student’s learning and information seeking as individual activities, not as collaborative group work (e.g., Georgas, 2014; George et al., 2006; Head, 2013; Taylor, 2012). One of the most well known models of information behaviour, Kuhlthau’s information search process, describes information seeking from the user’s perspective, identifying six stages (task initiation, selection, exploration, focus formulation, collection and presentation) as well as incorporating related affective (feelings) and cognitive (thoughts) factors of each stage (Kuhlthau, 1991, 1993). The information search process model was developed from empirical research into the behaviour of individuals. However, users often have a strong social inclination throughout the search process (Evans and Chi, 2010). Information seeking can often be a social process involving groups of people who engage in multiple activities to achieve goals that would be difficult to achieve individually (González-Ibáñez, Haseki and Shah, 2013; Morris, 2008; Reddy and Dourish, 2002). Hyldegard (2006) investigated Kuhlthau’s information search process model with graduate students in a library and information science programme, to explore if members of groups behave differently from the individuals. Findings showed that the model did not take into account the impact of social and contextual factors on group members’ information behaviour. Shah (2012) also found that while the model provides a reasonable conceptual framework for studying information seeking, it did not fully address the social aspects of group work.
There have been a few recent attempts to provide theoretical frameworks that are specifically developed for collaborative information seeking. These include the C5 model proposed by Shah and Leeder (2015) that shows how different aspects of collaboration interact in information seeking; as well as a model of collaborative information behaviour put forward by Karunakaran, Reddy and Spence (2013). These conceptual frameworks provide preliminary, and yet important, insights into studying and explaining collaborative behaviour in information seeking. Unfortunately, these theories and models are still not adequate to study collaborative behaviour of students in information-intensive projects.
Studies on collaborative information seeking have often focused on professional contexts such as software engineers (Hertzum, 2002; Bruce et al., 2003) and the military (Prekop, 2002; Sonnenwald and Pierce, 2000). Morris (2008) found that among professional knowledge workers more than half had cooperatively searched the Web with others for activities ranging from travel planning to looking for medical information. However, the collaborative information seeking behaviour of students present a different context from such professional settings. Students of all ages often collaborate in libraries and classrooms as part of in-class activities or homework assignments (Morris and Teevan, 2009). Group work is a common educational requirement for students, but research has seldom focused on student collaboration in group project work in higher education settings (Hyldegard, 2006, 2009; O'Farrell and Bates, 2009; Shah and Marchionini, 2010; Sormunen, Tanni and Heinström, 2013).
Researchers have studied other types of collaboration in academic settings. Large, Beheshti and Rahman (2002) studied elementary school students and found that they often collaborate on information seeking tasks, due both to group-learning pedagogies and to resource constraints. Limberg (1997) conducted a study of high school students engaged in group projects: how students working on a group project selected sources and dealt with biased sources. Twidale, Nichols and Paice (1997) observed users in a university library and found that students frequently worked together on information-seeking tasks, engaging in social interactions and help-seeking. Amershi and Morris (2008) interviewed school librarians and teachers and found that collaboration on Web searching was common among middle- and high-school aged students. Talja (2002) studied information sharing among academic researchers, and identified four types: strategic, paradigmatic, directive and social sharing, as well as non-sharing of information.
Some studies have addressed student collaboration in group project work in higher education settings. O’Farrell (2009) conducted an online survey of fifty undergraduate and graduate students in an information and library studies programme regarding their information seeking behaviour while involved in group projects. Findings showed that students have positive perceptions of group projects and believe that they have developed useful skills, such as teamwork skills and sharing information resources. Students working in groups can apply sophisticated strategies in balancing between individual and collaborative efforts (Kiili, Laurinen, Marttunen and Leu, 2012). Collaborative group work offers potential benefits for students. Mills (2003) found that group projects foster deep learning and skills development. Schellens and Valcke (2006) suggest that collaboration can effectively promote knowledge construction.
Collaborative information seeking has been defined as ‘an information-seeking process that takes place in a collaborative project (possibly a complex task) among a small group of participants (potentially with different set of skills and/or roles), which is intentional, interactive, and mutually beneficial’ (Shah 2014, p. 219.). Collaborative information seeking helps students explore different viewpoints on an issue, evaluate usefulness of information, and extract main ideas from sources (Kiili et al., 2012). Some core processes of collaborative information seeking include: communication, discussion, and exchange (Hyldegard, 2009); and information sharing, coordination, and awareness (Shah and Marchionini, 2010). Collaborative work has the potential to yield better results than individual efforts due to shared effort (González-Ibáñez et al., 2013). Effective collaborative Web searching can offer benefits such as increased coverage of relevant information, higher confidence in the quality of search findings, and greater productivity due to a reduction in redundant effort (Morris, 2007).
However, students conducting group work may not collaborate effectively. Even when using tools and systems designed for collaboration, students may work in individualistic rather than collective ways (Lakkala, Lallimo and Hakkarainen, 2005; Johnson, Johnson and Roseth, 2010). Sormunenet al. (2013) studied the activities of college students conducting a collaborative source-based writing assignment, and found that while some student groups truly collaborated together (planning the work, searching, assessing and reading sources, and writing), many instead conducted loosely coordinated individual efforts. Todd and Dadlani (2013) behaviour rather than truly collaborative interactions, suggesting that students may conceive group work as a matter of dividing labour and pursuing individual goals rather than truly collaborating. Simply assigning students to work in groups on a given assignment will not necessarily result in productive group interactions and learning outcomes (Gillies, 2003; Huber and Huber, 2008).
Cooperation and collaboration are related yet distinct phenomena. Shah and Leeder (2015) . Sormunen et al. (2013) Thus, collaboration involves shared goals and a group orientation while cooperation parallel goals and an individualistic orientation.
Collaborative work is often studied using three lenses (Rodden, 1991): control (Rodden and Blair, 1991), communication (Handel and Herbsleb, 2002), and awareness (Heath, Svensson, Hindmarsh, Luff and vom Lehn, 2002). These three factors are shown to affect strategies collaborators apply and the productivity they achieve (e.g., Sormunen, Tanni, Alamettälä and Heinström, 2014). Other major factors found to influence group work are time and space configurations (Bradner and Mark, 2002; Olson and Olson, 2000; Twidale et al., 1997). Specifically, in the context of group work by students, it is found that remotely located collaborators have more diversity and better discovery of information, whereas co-located collaborators tend to have more social interactions (Shah, 2011). It is also shown that when students work synchronously, they tend to divide work based on topic and when they work asynchronously, they tend to divide work based on process (e.g., searching and writing) (González-Ibáñez et al., 2013). While these works have been able to shed some light on various trade-offs that we see when students work in different conditions, they have been limited by the use of controlled lab environments. The work reported here addresses this limitation by studying the students in a more naturalistic setting of an in-class collaborative group work assignment. Instead of assigning informational tasks specifically designed for data collection for the research, the students were given the tasks that are normally assigned to them for their coursework; and, instead of asking the participants to work at a designated place (e.g., laboratory) and time, they are allowed to work independently throughout the semester.
Research questions
In order the better to understand student collaborative information seeking behaviour during group project work, this study gathered empirical data on student collaborators during the process of a real-life class assignment. Expanding on the conceptual model of Kuhlthau’s information search process, the goal of the study was to explore how these students progressed through the process of collaborative information seeking in an authentic setting, particularly focusing on the interaction of cooperation and collaboration behaviour. In addition to examining behavioural strategies, the research also investigated student attitudes and perceptions and how they change during the group work process. The study sought to investigate the following questions:
- RQ1: What strategies do students employ during collaborative group work involving seeking and synthesising information, and what obstacles do they perceive to successful outcomes?
- RQ2: What attitudes do students hold towards collaborative group work?
- RQ3: How do these perceptions of strategies, obstacles, and attitudes change as a result of participating in group work?
This study employs a task-based approach to studying information seeking behaviour (Ingwersen and Järvelin, 2005; Vakkari, 2003) in order to ground the analysis in the specific identified actions of the participants and their relation to perceptions of collaborative work.
Method
This empirical case study investigated the collaborative information seeking behaviour of students working on a group project for a class assignment. To capture the authentic behaviour of students working on a real assignment in a class setting, the study was conducted with students recruited from two sections of an undergraduate communications course related to online information seeking and evaluation. This course was chosen because the topic of the class related to the research topic of the study (information seeking) and the students conducted authentic behaviour that was relevant and measurable as part of their assignment. Thus, the participants consist of a convenience sample rather than a randomised sample. The group project assignment normally assigned in the class required students to research an information technology market sector of their choosing, present an in-class presentation, and write a group report which received a class grade. Incorporating this authentic assignment into the study helped ensure that the information seeking and synthesis task was more relevant and motivating to the participants, rather than an artificial assigned task. Grades for the final research reports were provided by the instructors as an outcome measure.
Students formed their own groups based on their interest in the topics, which ranged from cybersecurity to drones to electronic health records. Groups could opt in to participate in the study, with two groups in the class ultimately choosing not to participate. The ten participating groups ranged in size from three to six members. The study ran over a period of eight to nine weeks, depending on the course structure, from initial research for sources on their topic to the submission of the final report. Initial registration consisted of fifty-one participants. Ultimately, thirty-one participants completed the study (61% completion), including the pre- and post-study attitudinal questionnaires, allowing for comparison of changes in attitude towards group work as a result of the study.
During the study, participants used the Coagmento search system while working on their group project. Coagmento has been used in several laboratory studies (González-Ibáñez, Haseki and Shah, 2012; González-Ibáñez et al., 2013). Coagmento is a Firefox browser plugin that installs 1) a toolbar that contains buttons to bookmark pages, save snippets of text, open a collaborative text editor, and 2) a sidebar that displays the group’s history of bookmarks and snippets saved, as well as group chat. Participants use the Coagmento system in their browser when researching online for information sources. All actions while using the tool are recorded by server logs, which include searches completed, webpages viewed, webpages bookmarked, and snippets of text saved. Each group could see a table that indicated the total number of bookmarks, snippets, and searches conducted by each person in the group, to promote awareness of group activity.
Participants self-organised their group work, and were able to use Coagmento either asynchronously and remotely, or synchronously and co-located. Thus, the study captured the participants’ naturalistic group work behaviour. They were informed that they would receive a $40 incentive payment for successfully completing the study, with an additional $20 per person given as a bonus to one group from each section that demonstrated the greatest amount of participation as measured by use of the Coagmento system features, as well as answering all questions. These incentives encouraged students to use the system fully and to conduct their information seeking activities while using the browser plugin. The goal was to capture as much of their authentic behaviour and responses as possible and provide sufficient data for analysis. Since this was not a laboratory study, however, the behaviour of participants was not controlled and their levels of participation varied.
When registering for the study, participants answered an initial questionnaire that asked them about their attitudes towards group work and the importance of related strategies and obstacles. The group work attitudes questionnaire was adapted from Heinström and Sormunen (2013). The strategies and obstacles questionnaire was developed by the researchers based on a prior study of diaries kept by students of their experience during an assigned group project, with response options drawn from frequently used keywords and phrases in these diaries. During the study, participants answered three questionnaires at two-week intervals that asked them about their current group-work behaviour outside of Coagmento. At the end of the study, these questionnaires were repeated, in order to capture any change in attitude as a result of completing the group project, in addition to a post-task questionnaire that asked about their experience using Coagmento. The responses to these questionnaires were used to address RQ1 and RQ2. Changes between the pre-study and post-study responses to the survey questions were used to address RQ3.
Findings
Group activity
Server log data was analysed for each participant and as groups to identify overall activity patterns. The total number of bookmarks, snippets, and searches conducted while using the Coagmento system were compared between groups. The usage of bookmarks, snippets, and searches varied widely between groups. Overall, the average usage of snippets was low (3.6), with three groups not using any. The average usage of bookmarks was higher (15.4) and average searches completed was even higher (97.7). Within these searches, the average number of unique queries was 35.6. Combining total bookmarks, snippets, and searches produced total actions ranging from a high of 241 to a low of 34.
To compare the activity of the groups on a common measure, the grades assigned by the instructors to the group projects were compared. Since one instructor assigned numeric grades on a scale of 100 and the other assigned letter grades on a scale of A-F, the letter grades were converted to numbers to enable statistical comparison. The conversion was based on a table of grade conversions published by the College Board.
Table 1 shows the total of each of the actions, unique queries, average number of unique query terms, as well as the total of all actions per group, and the associated group grades. Grades on the final projects were used as an outcome measure of the success of the group work. Numeric grades ranged from a high of 95 (Group 7) to a low of 81 (Group 2). Group 7 had the highest number of bookmarks (33), while Group 2 had the highest number of queries (220), unique queries (87), and total actions (241). Group 7 also had the second-highest percentage of unique queries (44.4%). Groups 4 and 9 had the lowest number of total actions and may not have consistently used the tool. Bivariate correlation tests (2-tailed) were conducted to find correlations between the activity totals and the grades. There was a significant correlation between the number of searches and the grades (p <0.05), with the group with the lowest grade having the highest number of searches. The other activity totals were not significantly correlated to grades.
Group | Members | Bookmarks | Snippets | Total queries | Unique queries | % Unique queries | All actions | Grade |
---|---|---|---|---|---|---|---|---|
1 | 5 | 5 | 4 | 145 | 48 | 33.1% | 154 | 84 |
2 | 5 | 15 | 6 | 220 | 87 | 39.1% | 241 | 81 |
3 | 6 | 25 | 0 | 79 | 34 | 43.0% | 104 | 84 |
4 | 5 | 4 | 1 | 27 | 13 | 48.20% | 32 | 91 |
5 | 5 | 25 | 17 | 108 | 43 | 39.8% | 150 | 88 |
6 | 6 | 27 | 1 | 68 | 24 | 35.3% | 96 | 94 |
7 | 4 | 33 | 0 | 65 | 37 | 44.4% | 98 | 95 |
8 | 3 | 6 | 0 | 92 | 25 | 27.2% | 98 | 83 |
9 | 3 | 3 | 2 | 29 | 5 | 27.6% | 34 | 88 |
10 | 3 | 11 | 5 | 144 | 40 | 25.4% | 160 | 87 |
Ave | 4.5 | 15.4 | 3.6 | 97.7 | 35.6 | 36.3% | 116.7 | 87.5 |
Analysing the content of the queries showed that Group 2 conducted many off-topic searches such as Donkey Kong and Legend of Zelda, both computer games. Group 7 focused on queries related to their target companies, such as Boeing company and Northrop Grummen. These findings suggest that the group with the highest grade were more efficient searchers and found more relevant sources, while the group with the lowest grade were inefficient searchers who got distracted by frequent off-topic queries.
RQ1: Group work strategies and obstacles
To address the research question What strategies do students employ during collaborative group work involving seeking and synthesising information, and what obstacles do they perceive to successful outcomes?, questionnaire responses were analysed. Along with analysing the server log activity, questionnaires were used to gain an understanding of individuals’ attitudes towards group work. As part of the initial registration survey, participants were shown a list of potential group work strategies and asked to rank in order the top three that they think are most important for successful group work. Participants entered ‘1’ for the most important, ‘2’ for the second most important, and ‘3’ for the third. They could choose only three responses (see Table 2). A total of 93 rankings were completed (31 students could each make three rankings). Combining the totals of all three rankings (Nos. 1-3) in the pre-study questionnaire, the option ‘Communicating through email or text messages’ received the largest total (18), followed by ‘Setting deadlines’ (14). The three options regarding meetings all received the lowest rankings: Scheduling regular meetings’ (3), “Meeting in person” (3), and ‘Meeting virtually’ (0). The same question was asked again at the end of the study. Combining the totals of all three rankings, ’Using collaborative tools such as Google Docs’ (23) received the most rankings, followed by ‘Communicating through email or text messages’ (18). Again, the three options regarding meetings all received the lowest rankings.
Strategies | Pre-study | Post-study | ||||||
---|---|---|---|---|---|---|---|---|
Ranking | No. 1 | No. 2 | No. 3 | Total | No. 1 | No. 2 | No. 3 | Total |
Assigning specific tasks | 5 | 4 | 3 | 12 | 6 | 2 | 4 | 12 |
Communicating through email/texts | 4 | 5 | 9 | 18 | 9 | 4 | 4 | 17 |
Dividing work between group members | 4 | 4 | 3 | 11 | 3 | 9 | 2 | 14 |
Establishing goals | 6 | 2 | 2 | 10 | 3 | 4 | 2 | 9 |
Meeting in person | 1 | 1 | 1 | 3 | 0 | 0 | 1 | 1 |
Meeting virtually | 1 | 0 | 0 | 1 | 0 | 0 | 0 | 0 |
Scheduling regular meetings | 1 | 1 | 1 | 3 | 0 | 0 | 98 | 83 |
Setting deadlines | 3 | 5 | 6 | 14 | 1 | 5 | 5 | 11 |
Tracking progress | 2 | 5 | 2 | 9 | 1 | 0 | 2 | 3 |
Use of Google Docs | 4 | 4 | 4 | 12 | 8 | 7 | 8 | 23 |
93 | 93 |
Following the same procedure, participants were also shown a list of potential obstacles to group work and asked to rank in order the top three that they think they might encounter while completing this group project (see Table 3). Combining the totals of all three rankings in the pre-study questionnaire, the options ‘Communication with group members’ and ‘Unequal participation’ both received the largest total rankings (15). The lowest combined rankings were for ‘Lack of leadership’ (4) and ‘Achieving consensus’ (3). In the post-study questionnaire, ‘Procrastination’ (20) and ‘Coordination between group members’ (15) received the most combined rankings. The lowest combined rankings were for ‘Achieving consensus’ (4) and ‘Unequal participation’ (3).
Obstacles | Pre-study | Post-study | ||||||
---|---|---|---|---|---|---|---|---|
Ranking | No. 1 | No. 2 | No. 3 | Total | No. 1 | No. 2 | No. 3 | Total |
Achieving consensus | 1 | 1 | 1 | 3 | 1 | 0 | 3 | 4 |
Communication with group members | 8 | 1 | 6 | 15 | 4 | 0 | 6 | 10 |
Coordination between group members | 8 | 1 | 6 | 15 | 4 | 0 | 6 | 10 |
Lack of leadership | 0 | 3 | 1 | 4 | 1 | 3 | 2 | 6 |
Lack of motivation | 1 | 4 | 0 | 5 | 2 | 3 | 2 | 7 |
Lack of time | 1 | 3 | 2 | 6 | 3 | 2 | 4 | 9 |
Meeting deadlines | 1 | 2 | 8 | 11 | 3 | 3 | 1 | 7 |
Procrastination | 5 | 3 | 2 | 10 | 8 | 8 | 4 | 20 |
Scheduling conflicts/td> | 5 | 2 | 2 | 9 | 6 | 3 | 3 | 12 |
Unequal participation | 7 | 2 | 6 | 15 | 2 | 0 | 1 | 3 |
93 | 93 |
These survey responses showed that both before and after the group work project, the strategy of communicating through email or text messages was considered important. Before the project, setting deadlines was considered an important strategy, whereas afterwards using collaborative tools such as Google Docs was more important. Before the project, communication and unequal participation were perceived as the greatest obstacles, but after completing the project the perceived obstacles changed to procrastination and coordination. Quantitative changes between the pre- and post-study rankings were then analysed (see findings under RQ3).
RQ2: Attitudes towards group work
To address the research question What attitudes do students hold towards collaborative group work? responses to the questions in a Likert scale survey were analysed. During the pre-study questionnaire, participants were shown a list of possible attitudes towards group work and asked how much they agreed with each statement. Response options were on a Likert 5-point scale from Strongly Disagree to Strongly Agree, and responses were totalled per option across all groups (see Table 4). In the pre-test, the option Assigning specific tasks to group members makes group-work productive received the highest total points (135) followed by Group-work generates many good ideas (128). The lowest combined rankings were for Traditional teacher-focused education is more efficient than group-work (91) and Group discussions are often a waste of time (75). In the post-test, the same two options received the highest total rankings (140 and 123). The lowest ranking again was for Group discussions are often a waste of time (76).
Attitudes | Pre-study | Post-study |
---|---|---|
Assigning specific tasks to group members makes group-work productive | 135 | 140 |
Group discussions are often a waste of time | 75 | 76 |
Group-work fits my study habits | 100 | 95 |
Group-work generates many good ideas | 128 | 123 |
Group-work is more fun than studying alone | 114 | 103 |
I am happy to take on the role of the leader in a group work context | 113 | 115 |
I learn more efficiently by myself than in a group | 97 | 101 |
I often get help from other group members | 101 | 110 |
In group work one person often ends up doing most of the work | 99 | 99 |
In order to learn it is important that the group works closely together | 118 | 122 |
In order to learn it is important that the group works closely together | 91 | 99 |
In addition to the above questions were which asked on both pre- and post-study questionnaires, the post-study questionnaire asked participants to reflect on their group work experience. (The questionnaire was completed before students received their grades, to avoid the possibility of their responses being influenced by grades). Responses were open-ended text. Comments from the groups that received higher grades reflected a positive group work experience. Members of group 7, which received the highest final grade, commented: ‘In this project, group communication and member assistance to one another occurred consistently and often’ and ‘I actually had a great group and we all completed our work with quality and on time’. Members of group 6, which received the second-highest grade, commented: ‘I had a good group and I found myself learning a lot from them’ and ‘I learned that group work is not about one person doing all the work because my group members this time did everything they were supposed to…. Working in a group also helped me learn a lot more than I do individually’. A member of group 4 commented: ‘Group work is fun and if the group gets their tasks down for each member, the output of the work is much easier than if done by myself’. Members of groups with lower grades made less-positive comments. A member of group 1 commented: ‘Difference of opinion drag (sic) the project at a slower pace’. Members of group 3 commented: ‘We learned that procrastination really affects group work’ and ‘I remember how inefficient group work is’. Several participants also commented on the negative effect of procrastination.
RQ3: How do these perceptions of strategies, obstacles, and attitudes change as a result of participating in group work?
To explore how these attitudes may have changed over the course of the study, the numerical difference between the pre- and post-study responses were calculated. For the strategy rankings, the option Using collaborative tools such as Google Docs showed the largest increase in total rankings (+11) followed by Dividing work between group members (+3), while Tracking progress showed the largest decrease (-6) followed by Scheduling regular meetings (-3). See Table 5.
Strategies | Change |
---|---|
Using collaborative tools such as Google Docs | +11 |
Dividing work between group members | +3 |
Assigning specific tasks | 0 |
Communicating through email or text messages | -1 |
Establishing goals | -1 |
Meeting virtually through tools such as Skype or Google Hangouts | -1 |
Scheduling regular meetings | -2 |
Setting deadlines | -3 |
Meeting in person | -5 |
Tracking progress | -6 |
For the obstacle rankings, the option Procrastination showed the largest increase in total rankings (+10) followed by Lack of time (+3) and Scheduling conflicts (+3) while Unequal participation showed the largest decrease (-12) followed by Communication with group members (-5). See Table 6.
Obstacles | Change |
---|---|
Procrastination | +10 |
Lack of time | +3 |
Scheduling conflicts | +3 |
Lack of leadership | +2 |
Lack of motivation | +2 |
Achieving consensus | +1 |
Coordination between group members | +1 |
Meeting deadlines | -2 |
Communication with group members | -5 |
Unequal participation | -12 |
For the attitude rankings, the option I often get help from other group members showed the greatest increase (+9 points), followed by Traditional teacher-focused education is more efficient than group-work (+8 points). The option Group-work is more fun than studying alone showed the greatest decrease (-11 points), followed by both Group-work generates many good ideas (-5) and Group-work fits my study habits (-5 points). See Table 7. Note that the option Traditional teacher-focused education is more efficient than group work is a negatively phrased question, and its increase in rating shows a negative attitude towards group work (preference for individual work). This contrasts with the other positive changes in attitudes in the post-study ratings.
Attitudes | Change |
---|---|
I often get help from other group members | +9 |
Traditional teacher-focused education is more efficient than group-work | +8 |
Assigning specific tasks to group members makes group-work productive | +5 |
I like group-work | +4 |
In order to learn it is important that the group works closely together | +4 |
I am happy to take on the role of the leader in a group work context | +2 |
I learn more efficiently by myself than in a group | +2 |
Group discussions are often a waste of time | +1 |
In group work one person often ends up doing most of the work | 0 |
Group-work fits my study habits | -5 |
Group-work generates many good ideas | -5 |
Group-work is more fun than studying alone | -11 |
These pre/post quantitative results show how students’ strategies, perceived obstacles, and attitudes towards group work changed as a result of completing the group work project. The largest positive pre/post differences were to the strategy of using Google Docs, the perceived obstacle of procrastination, and the attitude ‘I often get help from other group members’. The largest negative changes were to the strategy of tracking progress, the perceived obstacle of unequal participation, and the attitude ‘Group-work is more fun than studying alone’. Both before and after the group work project, the strategy of communicating through email or text messages was considered important, while group meetings were considered unimportant.
Discussion
The comparison of group grades to the group actions while using the Coagmento system showed that the groups that received the highest grade had the highest number of bookmarks, the lowest average number of query terms, and lower number of total searches than the groups who received the lowest grades. There was a significant 2-tailed bivariate correlation between the number of searches and the numerical grade (p <0.05), with the group with the lowest grade having the highest number of searches. The group with the lowest grade conducted many off-topic searches, while the group with the highest grade conducted more on-topic searches. These findings suggest that the more successful groups conducted more focused and efficient searches and found more useful sources during their search.
The pre/post-study ranking of use of Google Docs as a strategy showed the largest increase. This suggests that students preferred the familiarity and ease of use of this tool as opposed to the integrated collaborative text editor. This preference was also indicated in student comments. Dividing work between group members also gained in ranking, suggesting that the perceived value of this strategy increased during the group work process. The strategy of assigning specific tasks remained important both before and after the study, suggesting that this may be a fundamental strategy used by students in completing group work. Strategies that decreased the most in rankings were meeting in person and tracking progress. Participant’s valued working independently and apparently did not value awareness of the groups’ overall progress towards completing the group project.
The pre/post-study ranking of procrastination as an obstacle to group work showed the largest increase in rankings, suggesting that awareness of this obstacle grew during the group work process. This is supported by the students’ open-ended comments. Obstacles of lack of time and scheduling conflicts also increased in ranking, which can be expected for students working on multiple class assignments during the college semester. Obstacles that decreased the most in ranking were communication with group members and unequal participation. Participants were apparently satisfied with their ability to communicate and share responsibility for completing the project.
The pre/post-study ranking of the attitude I often get help from other group members showed the greatest increase. The negatively-phrased question Traditional teacher-focused education is more efficient than group work also increased in rating. This suggests a mixed impact on students from their group work experience. Group-work is more fun than studying alone showed the greatest decrease, followed by both Group-work generates many good ideas and Group-work fits my study habits. These results suggest that there are trade-offs between positive and negative aspects of collaborative group work, with students’ attitudes changing as a result of the perceived success of the group work experience. In terms of Kuhlthau’s six-stage information search process model, students in the higher-scoring groups may have successfully reached the fourth stage of formulation (characterised by feelings of clarity) and the fifth stage of collection (characterised by feelings of confidence), while the lower-scoring groups may have only reached the third stage of exploration (characterised by feelings of confusion, frustration, and doubt).
While Kuhlthau identified feelings associated with stages of the information search process, the model is based conceptually around an individual and their relation to their task and objective. The findings of this study demonstrate that student attitudes and perceptions of group work can also play an important part in their experience of information seeking. As found by Hyldegard (2006) and Shah (2012), Kuhlthau’s information search process model may not adequately address the complex social aspects of collaborative information seeking. The C5 model (Shah and Leeder, 2016) helps to explain how and why collaborators create strategies for dividing up the work, choose different technologies for communicating and sharing information, and deal with challenges and obstacles that arise, as well as emphasising the interactions between cooperation, collaboration, and cooperation over the lifespan of group projects.
Overall, group activities such as meetings and tracking progress were ranked low while dividing labour and assigning specific tasks to individuals was ranked high. These findings support previous work suggesting that students working on group projects often rely on ‘divide and conquer’ behaviour rather than truly collaborative interactions, dividing labour and working individually rather than truly collaborating. As pointed out by Gillies (2003) and Huber and Huber (2008), simply assigning students to work in groups on the given task does not necessarily result in productive interaction and learning gains. This also supports the broader implication suggested by Sormunen et al. (2013) which must be addressed by schools and teachers in order to achieve better learning outcomes for students when assigning group projects. The benefits of collaborative work identified in the literature such as fostering deep learning and skills development, promoting knowledge construction, and achieving greater productivity, may not have been experienced by the participants in this study.
Limitations and future work
There are several limitations to this study’s findings. The participants in the study were all college undergraduates in a particular college class, and their behaviour may not be generalisable to larger, more diverse populations. The participants consisted of a convenience sample rather than a random sample. Study participants were paid a financial incentive to encourage consistent system usage throughout the time period of the study, which may have influenced their observed behaviour. A direct correlation cannot be drawn between grades on the final report and participants’ actions using Coagmento since there are many variables that could affect the grade, such as unequal division of labour in writing the report and level of writing ability of participants, among others. The small number of group projects and grades made it inappropriate to conduct statistical analysis. A larger sample of group projects would allow statistical comparisons and the determination of any significant correlations between actions, attitudes, and outcomes.
Conclusion
The findings of this study suggest implications for instructors and system designers of collaborative group work tools. Since the groups that received the highest grade had the highest number of bookmarks, the lowest average number of query terms, and lower number of total searches, instructors and system designers could incorporate scaffolding for effective strategies for searching and finding sources into assignments and support tools. Such scaffolding could include tips and suggestions for strategies before conducting searches, as well as prompts and reminders during the search process. Group awareness features could also be integrated into tools to help students feel more connected to their collaborators.
The positive comments from members of groups that received higher grades, and negative comments from groups that received lower grades, show that students are aware of the effectiveness of their group work experience before they receive their project grades. This suggests opportunities for instructors and systems designers to incorporate student reflection on their group work during the process of the assignment, and to provide mechanisms for addressing the obstacles and improving strategies used to address them before the end of the project. These changes may help students to achieve more positive and effective outcomes from their group work experiences.
Procrastination emerged as one of the major obstacles to successful collaborative group work. Acknowledgement of this obstacle to success presents instructors and designers an opportunity to structure group work and provide tools that support efficient and effective time-aware participation. Since students value assigning specific tasks to group members, as well as dividing work between group members, instructors and systems designers could emphasise these strategies, as well as potentially incorporating features such as task lists and milestone deadlines, which would increase group awareness and accountability. However, the results of the questionnaires also show that students did not value awareness of the groups’ overall progress towards completing the group project. Past research has shown the importance of awareness to group work (Dourish and Bellotti, 1992; Rodden, 1996), specifically showing how increase in awareness could lead to better coordination and communication (Shah, 2013). Therefore, the value of this awareness may need to be explicitly emphasised by instructors to help students better understand its importance. This research contributes to our understanding of student collaborative practices during group projects, the behaviour and attitudes of students towards group projects, and offers suggestions for instructors and designers to better support students in group work.
Acknowledgements
This work was supported by the IMLS Early Career Development grant #RE-04-12-0105-12. Thanks to Professors Nick Belkin and Nina Wacholder for their assistance with the study.
About the authors
Chris Leeder is a Postdoctoral Researcher in the School of Communication and Information, Rutgers University, New Brunswick, NJ USA. He received his Master's degree in Library and Information Science at the University at Albany and his PhD from the University of Michigan. He can be contacted at
chris.leeder@rutgers.edu
Chirag Shah is an Associate Professor in the School of Communication and Information, Rutgers University, New Brunswick, NJ USA. He received his Master’s degree in Computer Science from University of Massachusetts (UMass) Amherst and PhD in Information Science from University of North Carolina (UNC) Chapel Hill. He can be contacted at chirags@rutgers.edu